| jeblair | clarkb: i don't think we ever want to set ZUUL_BRANCH | 00:00 |
|---|---|---|
| jeblair | (except in periodic jobs, but we should fix that) | 00:01 |
| *** mriedem has joined #openstack-infra | 00:01 | |
| clarkb | jeblair: not set zuul branch | 00:01 |
| clarkb | jeblair: set the override var thing in that change to zuul branch for the project | 00:02 |
| jeblair | clarkb: ah | 00:02 |
| clarkb | because master is too rigid | 00:02 |
| *** ashleighfarnham has quit IRC | 00:02 | |
| clarkb | comments in just a sec | 00:03 |
| mordred | jgriffith: :) | 00:03 |
| jeblair | clarkb: afaik, the current scope of the job is only on master so that should work, but yeah, i think your suggestion is more future-proof | 00:03 |
| clarkb | comments posted | 00:04 |
| *** sabeen3 has quit IRC | 00:05 | |
| sridhar_ram | infra-team: we have a need to host a qcow2 image related to our project (openstack/tacker). It is an image of an opensource virtual router. Do we have some common file repository to store such artifacts ? | 00:06 |
| clarkb | sridhar_ram: can you explain the use case? | 00:07 |
| clarkb | so that we can understand how it will be used which can affect how things are hosted | 00:07 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Add internap to nodepool https://review.openstack.org/247237 | 00:08 |
| sridhar_ram | clarkb: I expect two use cases. (1) immediate need, we will upload this image to glance as part of devstack install of tacker. This will help tacker uses to immediately try some features that bit more appealing with such an image (btw, the image is openwrt router) | 00:08 |
| jeblair | clarkb, mordred: "topic:internap" would be good to get in before tomorrow | 00:09 |
| clarkb | jeblair: will look | 00:09 |
| clarkb | also yay more clouds | 00:09 |
| clarkb | jeblair: does nodepool handle its floating IPs? | 00:10 |
| sridhar_ram | clarkb: (2) next step, to add it to our dsvm gate tests. We some features - like automatic config push, that can only be test with openwrt (as opposed to using cirros image). | 00:10 |
| jeblair | clarkb: not yet | 00:10 |
| jeblair | clarkb: er, i don't think it has floating ips | 00:10 |
| clarkb | jeblair: ah ok | 00:10 |
| clarkb | I thought I heard floating ip mentioned | 00:10 |
| jeblair | clarkb: but nodepool does not detect its public ip correctly | 00:10 |
| clarkb | sridhar_ram: for those things the ironic team publishes their images to tarballs.openstack.org as a post job to their pythonagent | 00:10 |
| jeblair | clarkb: it will be easier for me to make that patch after it's actually in the nodepool config and i can upload an image to it | 00:11 |
| clarkb | sridhar_ram: its probably a good system to copy since they use it in similar ways (easy for others to grab to use ironic and they run tests with the image) | 00:11 |
| clarkb | sridhar_ram: system for that would be whenever thing that determines image content changes run job to build new image and copy to tarballs.openstack.org | 00:12 |
| *** tsg has quit IRC | 00:12 | |
| *** weshay_xchat has quit IRC | 00:12 | |
| sridhar_ram | clarkb: yeah, I've noticed those lines in project.yaml .. I thought those are to push some build artifacts into tarballs.o.o | 00:12 |
| sridhar_ram | clarkb: here we will have the qcow2 from somewhere else .. perhaps a github repo | 00:12 |
| clarkb | sridhar_ram: uh I would recommend not putting qcow2 images in git | 00:13 |
| clarkb | sridhar_ram: I think you are on your own if you are hosting elsewhere | 00:13 |
| clarkb | sridhar_ram: we are happy to host the repo that defines your image builds and build the images for yo uthough | 00:13 |
| sridhar_ram | clarkb: unfortunately we don't want to be in the business of building openwrt images. hosting well know, validated image somewhere is what we need | 00:14 |
| clarkb | sridhar_ram: how big is the image and where is it hosted? | 00:15 |
| mordred | jeblair: I am +2 on all of them - so it's all clarkb | 00:15 |
| clarkb | we can possibly cache it in our test images if it is small and has a reliable source | 00:15 |
| *** gongysh__ has quit IRC | 00:16 | |
| *** arborism has joined #openstack-infra | 00:17 | |
| sridhar_ram | clarkb: it is 53MB. It came from https://downloads.openwrt.org. We altered tiny bit for it work properly in openstack. | 00:17 |
| mordred | sridhar_ram: how did you alter it? | 00:17 |
| mordred | sridhar_ram: is it based on this: https://downloads.openwrt.org/chaos_calmer/15.05/ ? | 00:18 |
| *** EricGonc_ has quit IRC | 00:18 | |
| *** gongysh__ has joined #openstack-infra | 00:18 | |
| sridhar_ram | mordred: we are using a slightly older 12.09 image | 00:18 |
| mordred | sridhar_ram: k. so like this: https://downloads.openwrt.org/attitude_adjustment/12.09/x86/kvm_guest/openwrt-x86-kvm_guest-combined-ext4.img.gz ? | 00:19 |
| sridhar_ram | mordred: I think we just altered the boot line .. the specific thing beat me at the momemt | 00:19 |
| openstackgerrit | Merged openstack-infra/system-config: Add internap pypi mirror https://review.openstack.org/247082 | 00:19 |
| sridhar_ram | mordred: exactly that img | 00:19 |
| mordred | sridhar_ram: k. I'm asking because the diskimage-builder tool actually works by downloading images such as that, applying small modifications to them and then creating new images | 00:20 |
| mordred | sridhar_ram: so it would be fairly trivial to define a dib element that would pull the upstream openwrt image, then add your modifications, then upload the results of that automatically into our infrastructure | 00:20 |
| sridhar_ram | mordred: ah.. that's nice | 00:20 |
| mordred | sridhar_ram: I'm happy to see it's a small image :) | 00:21 |
| greghaynes | We really do want to get that workflow in place - ironic needs to do the same thing | 00:21 |
| sridhar_ram | mordred: indeed it is ..! | 00:21 |
| mordred | ++ | 00:21 |
| *** tsg has joined #openstack-infra | 00:21 | |
| mordred | sridhar_ram: so, greghaynes and I (look, I'm volunteering greghaynes for things) could help you put together such an element - and then also it would be clear to fokls how to use/consume it | 00:22 |
| greghaynes | haha | 00:22 |
| sridhar_ram | lol | 00:22 |
| mordred | sridhar_ram: but then it would be in the pattern of reusing images we produce - which is one we need to solve broadly anyway (there are many projects that need this pattern) | 00:22 |
| greghaynes | Yep, it would be pretty easy to cargo the ubuntu element in dib in to what you need - it does a similar thing with the ubuntu cloud image | 00:23 |
| sridhar_ram | mordred: that's cool.. | 00:24 |
| mordred | sridhar_ram: so if you could dig up the info on what you needed to change about it, that would be really helpful! | 00:24 |
| sridhar_ram | mordred: sure will do... | 00:25 |
| clarkb | jeblair: mordred internap image format is qcow2? | 00:25 |
| clarkb | just checking because thats what we will attempt to upload to them | 00:25 |
| sridhar_ram | mordred: just a related confession - I'm a n00b on things related to infra. I just barely get by jenkins / zuul | 00:25 |
| sridhar_ram | mordred: greghaynes: I would need guidance on any specific jjb lines to be added for the project | 00:26 |
| *** trown is now known as trown|outttypeww | 00:26 | |
| mordred | clarkb: yes. | 00:27 |
| sridhar_ram | mordred: clarkb: greghaynes: thanks a lot.. will get back on the specifics on img touch ups | 00:27 |
| mordred | sridhar_ram: no worries - there is only one good way to learn :) | 00:27 |
| clarkb | jeblair mordred ok all approved | 00:27 |
| *** claudiub has quit IRC | 00:27 | |
| mordred | woot | 00:28 |
| *** gildub_ has joined #openstack-infra | 00:29 | |
| openstackgerrit | Merged openstack-infra/system-config: Add internap to nodepool clouds.yaml https://review.openstack.org/247091 | 00:29 |
| *** rlucio has quit IRC | 00:30 | |
| *** rhallisey has quit IRC | 00:31 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: In get_time_series_runs_by_key_value() add LIKE support https://review.openstack.org/247243 | 00:32 |
| *** rebase has quit IRC | 00:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Add internap to nodepool https://review.openstack.org/247237 | 00:33 |
| Shrews | mordred: yeah, so, ansible has to manually update the submodules before the os_user_group change will appear | 00:36 |
| *** Swami has quit IRC | 00:36 | |
| Shrews | i do not know how often they do that, but it isn't immediate | 00:36 |
| *** danilora_ has joined #openstack-infra | 00:37 | |
| *** sdake has quit IRC | 00:40 | |
| *** daniloramalho has quit IRC | 00:41 | |
| *** _amrith_ is now known as amrith | 00:47 | |
| *** Piet has joined #openstack-infra | 00:49 | |
| *** shashank_hegde has quit IRC | 00:53 | |
| *** salv-orlando has joined #openstack-infra | 00:54 | |
| *** ddieterly has quit IRC | 00:56 | |
| *** ccrouch1 has quit IRC | 00:56 | |
| *** otter768 has joined #openstack-infra | 00:56 | |
| *** jyuso1 has joined #openstack-infra | 00:57 | |
| *** salv-orl_ has quit IRC | 00:57 | |
| *** ivar-laz_ has joined #openstack-infra | 00:57 | |
| *** shashank_hegde has joined #openstack-infra | 00:58 | |
| *** cloudtrainme has joined #openstack-infra | 00:59 | |
| *** rebase has joined #openstack-infra | 00:59 | |
| *** salv-orlando has quit IRC | 00:59 | |
| *** otter768 has quit IRC | 01:01 | |
| *** rhallisey has joined #openstack-infra | 01:01 | |
| *** ivar-lazzaro has quit IRC | 01:01 | |
| *** ivar-laz_ has quit IRC | 01:02 | |
| *** tsg has quit IRC | 01:03 | |
| *** rhallisey has quit IRC | 01:04 | |
| *** jaypipes has quit IRC | 01:06 | |
| *** rossella_s has quit IRC | 01:07 | |
| *** rossella_s has joined #openstack-infra | 01:08 | |
| mordred | oh | 01:08 |
| mordred | that's lame | 01:08 |
| mordred | our submodules update immediately in our system :) | 01:09 |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add check_channels.py and testenv to run it https://review.openstack.org/247249 | 01:10 |
| sridhar_ram | infra team - I've a situation where some LP bugs are not automatically marked in-progress after a patchset is pushed with Closes-Bug header. For eg: https://review.openstack.org/#/c/242248/ | 01:10 |
| sridhar_ram | wondering what could cause this ? | 01:10 |
| *** signed8bit_ZZZzz is now known as signed8bit | 01:11 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 01:12 | |
| *** bpokorny_ has joined #openstack-infra | 01:15 | |
| *** bpokorny has quit IRC | 01:18 | |
| *** bpokorny_ has quit IRC | 01:19 | |
| *** otter768 has joined #openstack-infra | 01:20 | |
| openstackgerrit | Merged openstack-infra/puppet-elastic_recheck: put a 1hr timeout on flock blocking https://review.openstack.org/246508 | 01:22 |
| *** gongysh__ has quit IRC | 01:24 | |
| *** fawadkhaliq has joined #openstack-infra | 01:26 | |
| *** pvaneck has quit IRC | 01:26 | |
| *** ddieterly has joined #openstack-infra | 01:27 | |
| *** akshai has quit IRC | 01:27 | |
| *** rfolco has joined #openstack-infra | 01:29 | |
| *** yamamoto has quit IRC | 01:30 | |
| *** smarcet has joined #openstack-infra | 01:30 | |
| *** Yanyanhu has joined #openstack-infra | 01:30 | |
| *** zhenguo has joined #openstack-infra | 01:32 | |
| *** paco20151113 has joined #openstack-infra | 01:32 | |
| *** amrith is now known as _amrith_ | 01:33 | |
| *** smarcet has quit IRC | 01:34 | |
| *** Sukhdev has quit IRC | 01:35 | |
| *** otter768 has quit IRC | 01:35 | |
| *** sputnik13 has quit IRC | 01:35 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-subunit2sql: Lets time the super long migrations we have to run https://review.openstack.org/246041 | 01:36 |
| *** sputnik13 has joined #openstack-infra | 01:37 | |
| *** paco20151113 has quit IRC | 01:37 | |
| *** otter768 has joined #openstack-infra | 01:41 | |
| *** kun_huang has joined #openstack-infra | 01:42 | |
| *** Sukhdev has joined #openstack-infra | 01:43 | |
| *** paco20151113 has joined #openstack-infra | 01:44 | |
| *** notmorgan has quit IRC | 01:45 | |
| mtreinish | crinkle, nibalizer: if you get a sec, I had a random puppet question inline: https://review.openstack.org/#/c/246041/ | 01:45 |
| *** zhurong has joined #openstack-infra | 01:46 | |
| *** tiswanso has joined #openstack-infra | 01:47 | |
| *** sgordon has quit IRC | 01:47 | |
| *** notmorgan has joined #openstack-infra | 01:48 | |
| *** notmorgan has quit IRC | 01:48 | |
| *** notmorgan has joined #openstack-infra | 01:49 | |
| *** notmorgan has quit IRC | 01:49 | |
| *** sgordon has joined #openstack-infra | 01:49 | |
| *** mestery has joined #openstack-infra | 01:50 | |
| *** notmorgan has joined #openstack-infra | 01:50 | |
| *** notmorgan is now known as Guest50373 | 01:50 | |
| *** Guest50373 is now known as morganfainberg | 01:51 | |
| *** morganfainberg has joined #openstack-infra | 01:52 | |
| *** tiswanso has quit IRC | 01:52 | |
| *** morganfainberg is now known as notmorgan | 01:52 | |
| *** tiswanso has joined #openstack-infra | 01:52 | |
| *** _amrith_ is now known as amrith | 01:52 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add Infra Cloud controller node https://review.openstack.org/209698 | 01:53 |
| *** gyee has quit IRC | 01:55 | |
| openstackgerrit | James E. Blair proposed openstack-infra/jenkins-job-builder: Add template-name as a variable that can be used in a template https://review.openstack.org/247263 | 01:56 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Print the JJB template name in devstack jobs https://review.openstack.org/247264 | 01:56 |
| dims_ | jeblair clarkb ZUUL_BRANCH is for all checkouts right? | 01:56 |
| dims_ | jeblair y, we are trying to transition from having stable branches and caps to doing backward compat | 01:57 |
| *** fawadkhaliq has quit IRC | 01:57 | |
| jeblair | dims_: ZUUL_BRANCH will always be set when zuul runs a job for a change -- it will be the branch of the change it is trying to test | 01:57 |
| dims_ | jeblair ah cool | 01:58 |
| *** spzala has quit IRC | 01:58 | |
| *** ddieterl_ has joined #openstack-infra | 01:59 | |
| *** notmorgan has quit IRC | 02:01 | |
| *** ddieterly has quit IRC | 02:02 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Fix broken stable-compat-jobs for oslo https://review.openstack.org/247188 | 02:03 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add Infra Cloud compute node definition https://review.openstack.org/213980 | 02:03 |
| *** kun_huang has left #openstack-infra | 02:03 | |
| dims_ | jeblair : i should add a d-g review that depends-on this project-config review to test it? | 02:04 |
| *** Sukhdev has quit IRC | 02:05 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate: [WIP] Testing a project-config change https://review.openstack.org/247267 | 02:05 |
| dims_ | jeblair : clarkb : not sure how it would work...but here it goes ^^^ | 02:05 |
| *** notmorgan has joined #openstack-infra | 02:06 | |
| *** notmorgan has quit IRC | 02:06 | |
| dims_ | on a related note, here's a spec from lifeless - https://review.openstack.org/#/c/226157/ ("Backwards compat for libraries and clients.") | 02:07 |
| *** notmorgan has joined #openstack-infra | 02:08 | |
| *** notmorgan has quit IRC | 02:08 | |
| *** dims has joined #openstack-infra | 02:09 | |
| *** notmorgan has joined #openstack-infra | 02:10 | |
| *** notmorgan is now known as Guest14115 | 02:10 | |
| *** dims_ has quit IRC | 02:13 | |
| *** Guest14115 has quit IRC | 02:13 | |
| *** yamamoto has joined #openstack-infra | 02:14 | |
| *** notmorga1 has joined #openstack-infra | 02:15 | |
| *** notmorga1 has quit IRC | 02:15 | |
| crinkle | mtreinish: i'm not really sure, here's what the docs say about it https://docs.puppetlabs.com/references/latest/type.html#exec-provider-posix | 02:15 |
| *** hichihara has joined #openstack-infra | 02:15 | |
| crinkle | mtreinish: so it depends on whether subshells are a posix thing or a bash thing | 02:16 |
| crinkle | mtreinish: should be easy to test out though | 02:16 |
| *** notmorga1 has joined #openstack-infra | 02:16 | |
| *** notmorga1 is now known as morganfainberg | 02:16 | |
| *** morganfainberg has joined #openstack-infra | 02:17 | |
| *** morganfainberg is now known as notmorgan | 02:17 | |
| jeblair | dims: project-config changes are | 02:18 |
| jeblair | grr | 02:18 |
| *** rhallisey has joined #openstack-infra | 02:18 | |
| jeblair | dims: changes to jobs in project-config are not (yet) self-testable, unfortunately | 02:18 |
| *** notmorgan has quit IRC | 02:18 | |
| *** notmorgan has joined #openstack-infra | 02:18 | |
| *** notmorgan has quit IRC | 02:18 | |
| *** notmorgan has joined #openstack-infra | 02:18 | |
| *** openstack has joined #openstack-infra | 02:28 | |
| *** zhurong has quit IRC | 02:30 | |
| *** zhurong has joined #openstack-infra | 02:31 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Adjust DefCore Meeting https://review.openstack.org/247000 | 02:33 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add baremetal hpuswest node definition https://review.openstack.org/208751 | 02:33 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add Infra Cloud modules to modules.env https://review.openstack.org/209617 | 02:33 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Make apply-test aware of modules to upgrade https://review.openstack.org/247273 | 02:34 |
| crinkle | clarkb: ^ i had an idea, not positive it's a good one yet | 02:34 |
| *** mriedem has quit IRC | 02:36 | |
| *** yamahata has quit IRC | 02:36 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Make apply-test aware of modules to upgrade https://review.openstack.org/247273 | 02:37 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add baremetal hpuswest node definition https://review.openstack.org/208751 | 02:37 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add Infra Cloud modules to modules.env https://review.openstack.org/209617 | 02:37 |
| *** EricGonczer_ has quit IRC | 02:38 | |
| *** Sukhdev has joined #openstack-infra | 02:39 | |
| *** achanda has joined #openstack-infra | 02:40 | |
| *** armax has quit IRC | 02:41 | |
| *** thorst has joined #openstack-infra | 02:41 | |
| *** stevemar_ has quit IRC | 02:42 | |
| *** thorst has quit IRC | 02:42 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/irc-meetings: Add check_channels.py and testenv to run it https://review.openstack.org/247249 | 02:42 |
| *** stevemar_ has joined #openstack-infra | 02:43 | |
| *** Sukhdev has quit IRC | 02:44 | |
| openstackgerrit | Apoorva Deshpande proposed openstack-infra/ciwatch: Consolidating database calls in db.py https://review.openstack.org/246723 | 02:45 |
| *** acruz has joined #openstack-infra | 02:46 | |
| *** akshai has quit IRC | 02:49 | |
| *** arxcruz has quit IRC | 02:49 | |
| *** danilora_ has quit IRC | 02:52 | |
| *** apoorvad has quit IRC | 02:53 | |
| *** pcrews has quit IRC | 02:53 | |
| *** pcrews has joined #openstack-infra | 02:53 | |
| lifeless | Nakato: how goes the neutron voting change patch | 02:54 |
| mordred | lifeless: WHEEEEEEE!!!!! | 02:55 |
| Nakato | lifeless: Working on better understanding zuul right now | 02:55 |
| lifeless | Nakato: I generally ask someone like mordred when I face that :) | 02:55 |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/project-config: Set max_microversion on Tempest for microversion testing https://review.openstack.org/247278 | 02:56 |
| *** rfolco_ has quit IRC | 02:56 | |
| ianw | mordred: do you have any idea why https://github.com/openstack/diskimage-builder/blob/master/elements/fedora-minimal/install.d/99-ramdisk exists? | 02:59 |
| lifeless | Nakato: what quandry are you facing at the moment? | 02:59 |
| *** tsg has joined #openstack-infra | 02:59 | |
| lifeless | ianw: yes, I know why | 03:00 |
| ianw | mordred: because i think it's actually the wrong thing, and happens because the "grubby" scripts are not installed | 03:00 |
| Nakato | lifeless: Well looking at it again it's possible I was being dumb and have an answer now. Give me a few minutes to throw it together. | 03:00 |
| lifeless | ianw: at least in the past, dib built in a ramdisk and then copied that to a block device created only once the size of the image was known | 03:00 |
| lifeless | ianw: and then *after that* did boot block manipulation; *also* remember it doesn't always build images with boot blocks. | 03:01 |
| lifeless | ianw: because it can build initrd+kernel+rootfs images [which are very useful sometimes] | 03:01 |
| mordred | ianw: I do not ... but I usually ping greghaynes | 03:02 |
| mordred | or lifeless | 03:02 |
| ianw | lifeless: but this is copying a file named "initrd" out of a subdirectory in /boot back to the top level | 03:02 |
| ianw | lifeless: having a file named "initrd", and it being in a weird subdirectory, is I think an artifact of the kernel install happening without the scripts provided by "grubby" | 03:03 |
| lifeless | ianw: thats entirely possible, I know 3/5ths of sweet nothing about fedora | 03:03 |
| ianw | lifeless: systemd ships with http://pkgs.fedoraproject.org/cgit/systemd.git/tree/kernel-install-grubby.patch | 03:04 |
| lifeless | ianw: but, I do remember the discussion about how to get the right initrd | 03:04 |
| lifeless | ianw: which was roughly this | 03:04 |
| Nakato | mordred: lifeless: What I'm struggling with is making a job non-voting by default, except on branch X | 03:04 |
| *** salv-orlando has joined #openstack-infra | 03:04 | |
| ianw | so if /sbin/new-kernel-pkg exists, that gets used | 03:04 |
| ianw | and makes an initramfs | 03:04 |
| lifeless | ianw: wasn't grubby removed from fedora? | 03:05 |
| *** rlandy has quit IRC | 03:05 | |
| lifeless | ianw: or is the internet wrong? | 03:05 |
| ianw | lifeless: well, there is a special circle of hell for commits like https://github.com/haraldh/dracut/commit/c42064a684f3413dfce249c5bd6ebe0cb0a16908 | 03:05 |
| mordred | Nakato: I believe I was just reading some documentation this weekend about that ... | 03:06 |
| ianw | which turns on grubby as a recommends for > f22 (ero, it breaks on f23) | 03:06 |
| lifeless | ianw: anyhow - one thing to note, is that as there is no block device to operate on during the install phase | 03:06 |
| lifeless | ianw: if grubby really really wants to do that, it won't be able to be installed or it would just break things | 03:06 |
| ianw | however, with no commit message or explanation, deciphering is left as an exercise | 03:06 |
| lifeless | ianw: but I don't know grubby.... | 03:07 |
| openstackgerrit | Li Yingjun proposed openstack-infra/project-config: Add python-searchlightclient repo https://review.openstack.org/246691 | 03:07 |
| lifeless | ianw: (for context, first paragraph of http://docs.openstack.org/developer/diskimage-builder/developer/design.html suggests my memory is still vald | 03:08 |
| lifeless | *valid* | 03:08 |
| mordred | Nakato: https://review.openstack.org/#/c/238656/3/doc/source/creators.rst | 03:08 |
| lifeless | Nakato: aren't the jobs already non-voting by default? | 03:08 |
| mordred | Nakato: Note that you cannot run a job voting on one branch and non-voting on | 03:09 |
| *** unicell has joined #openstack-infra | 03:09 | |
| mordred | another. If you combine non-voting and a branch instruction, it means: | 03:09 |
| mordred | Run the job non-voting - and only on this branch. Example:: | 03:09 |
| Nakato | lifeless: As far as I can tell, all jobs are voting by default, and you flip them to voting. There's no reference to "voting: true" in the entire layout. | 03:09 |
| mordred | Nakato: AJaeger wrote some really good docs at the bottom of that patch | 03:10 |
| Nakato | mordred: The flip is "g-n-py27" needs to vote everything < Liberty, but not Liberty/Master+ | 03:10 |
| *** amrith is now known as _amrith_ | 03:10 | |
| lifeless | perhaps some context | 03:10 |
| mordred | Nakato: yah. I think you can't do that | 03:11 |
| lifeless | mordred: the goal is this: make the neutron tox jobs that are *not* constraints - on master non-voting. | 03:11 |
| lifeless | mordred: and make the neutron tox jobs that are -constraints on master voting | 03:11 |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/project-config: Set max_microversion on Tempest for microversion testing https://review.openstack.org/247278 | 03:11 |
| *** Sree has joined #openstack-infra | 03:11 | |
| lifeless | mordred: *or* | 03:11 |
| lifeless | mordred: stop running the neutron tox jobs that are not constraints, andmake the -constraints ones voting | 03:12 |
| mordred | do you want to run them on master at all? | 03:12 |
| lifeless | mordred: is this possible? | 03:12 |
| mordred | gah | 03:12 |
| mordred | on stable at all? | 03:12 |
| lifeless | mordred: we will want to do this to liberty as well, but not kilo or before | 03:12 |
| mordred | so ... | 03:12 |
| mordred | I'm a bad person | 03:12 |
| lifeless | yes | 03:12 |
| lifeless | and? | 03:12 |
| mordred | because I now need to cut a bird | 03:12 |
| mordred | to make meat | 03:12 |
| mordred | which means I have implied a level of being able to finish this query that I am not able to satisfy | 03:13 |
| * mordred hides | 03:13 | |
| *** pcrews has quit IRC | 03:13 | |
| lifeless | mordred: will you be back soon? | 03:13 |
| *** rebase has quit IRC | 03:14 | |
| lifeless | Nakato: fun stuff - the yaks are strong in this project :) | 03:14 |
| Nakato | mordred: Would this be valid? http://paste.openstack.org/show/479372/ | 03:14 |
| *** Sree has quit IRC | 03:15 | |
| *** bapalm has quit IRC | 03:15 | |
| *** Sree has joined #openstack-infra | 03:15 | |
| *** Sree_ has joined #openstack-infra | 03:16 | |
| *** Sree_ is now known as Guest914 | 03:16 | |
| *** sputnik13 has quit IRC | 03:17 | |
| Nakato | Ah, nope, duplicate names break | 03:18 |
| *** rhallisey has quit IRC | 03:19 | |
| lifeless | Nakato: perhaps we just stop running them on master | 03:19 |
| *** Sree has quit IRC | 03:19 | |
| *** bochi-michael has joined #openstack-infra | 03:19 | |
| lifeless | Nakato: so just add the branch ^(?! regex and profit | 03:20 |
| *** Guest914 has quit IRC | 03:21 | |
| *** bapalm has joined #openstack-infra | 03:21 | |
| *** cloudtrainme has quit IRC | 03:23 | |
| *** baoli_ has quit IRC | 03:23 | |
| *** kushal has joined #openstack-infra | 03:26 | |
| Nakato | lifeless: Yea, I don't see a problem with that, waste of resources to keep running the unconstrained ones really. | 03:28 |
| lifeless | yup | 03:28 |
| openstackgerrit | Merged openstack-infra/system-config: Fix regex for periodic job collection (part2) https://review.openstack.org/243408 | 03:29 |
| *** salv-orlando has quit IRC | 03:31 | |
| *** dims has quit IRC | 03:32 | |
| *** achanda has quit IRC | 03:34 | |
| *** achanda has joined #openstack-infra | 03:34 | |
| *** tlian has quit IRC | 03:34 | |
| *** changbl has joined #openstack-infra | 03:36 | |
| *** achanda has quit IRC | 03:37 | |
| *** jamielennox is now known as jamielennox|away | 03:45 | |
| *** cloudtrainme has joined #openstack-infra | 03:47 | |
| *** cloudtrainme has quit IRC | 03:51 | |
| *** signed8bit_ZZZzz has quit IRC | 03:51 | |
| *** armax has joined #openstack-infra | 03:54 | |
| *** ayoung is now known as ayoung_Zzz | 03:55 | |
| *** jamielennox|away is now known as jamielennox | 03:57 | |
| *** ashleighfarnham has joined #openstack-infra | 03:59 | |
| *** stevemar_ has quit IRC | 04:01 | |
| openstackgerrit | Philip Marc Schwartz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work https://review.openstack.org/239810 | 04:01 |
| *** stevemar_ has joined #openstack-infra | 04:02 | |
| *** mahatic has joined #openstack-infra | 04:03 | |
| *** tsg_ has joined #openstack-infra | 04:03 | |
| *** rguillebert has quit IRC | 04:05 | |
| *** arborism has quit IRC | 04:05 | |
| *** tsg has quit IRC | 04:07 | |
| *** bcourt has quit IRC | 04:07 | |
| *** Ramanjaneya has joined #openstack-infra | 04:08 | |
| *** acruz has quit IRC | 04:15 | |
| *** salv-orlando has joined #openstack-infra | 04:16 | |
| *** shashank_hegde has quit IRC | 04:16 | |
| *** ccrouch has joined #openstack-infra | 04:18 | |
| *** ccrouch1 has joined #openstack-infra | 04:21 | |
| *** wuhg has joined #openstack-infra | 04:21 | |
| *** otter768 has joined #openstack-infra | 04:21 | |
| *** bcourt has joined #openstack-infra | 04:23 | |
| *** ccrouch has quit IRC | 04:23 | |
| *** salv-orlando has quit IRC | 04:24 | |
| *** kushal has quit IRC | 04:24 | |
| *** oomichi has joined #openstack-infra | 04:24 | |
| *** otter768 has quit IRC | 04:27 | |
| *** jhesketh has quit IRC | 04:27 | |
| *** fawadkhaliq has joined #openstack-infra | 04:28 | |
| *** jhesketh has joined #openstack-infra | 04:28 | |
| yamamoto | can anyone enlighten me about "Merge tag" commit? | 04:28 |
| yamamoto | this one https://review.openstack.org/#/c/246441/ | 04:28 |
| yamamoto | is this something i should just merge without looking the diff? | 04:28 |
| *** sridhar_ram has quit IRC | 04:35 | |
| *** achanda has joined #openstack-infra | 04:37 | |
| *** garyk has joined #openstack-infra | 04:39 | |
| *** fedexo has joined #openstack-infra | 04:40 | |
| *** bhunter71 has quit IRC | 04:40 | |
| *** ccrouch1 has quit IRC | 04:42 | |
| *** ccrouch has joined #openstack-infra | 04:43 | |
| *** ashleighfarnham has quit IRC | 04:44 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Pin jaraco requirements to working versions https://review.openstack.org/247092 | 04:48 |
| *** pcrews has joined #openstack-infra | 04:49 | |
| *** ccrouch has quit IRC | 04:54 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Remove fedora-minimal/install.d/99-ramdisk https://review.openstack.org/247295 | 04:55 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Update default to F23 https://review.openstack.org/247296 | 04:55 |
| ianw | ^ trigger warning: systemd | 04:55 |
| StevenK | Haha | 04:55 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Disable failing tests test_gerrit_comment.py https://review.openstack.org/245389 | 04:56 |
| *** ddieterl_ has quit IRC | 04:57 | |
| *** stevemar_ has quit IRC | 05:00 | |
| *** stevemar_ has joined #openstack-infra | 05:00 | |
| *** gongysh__ has joined #openstack-infra | 05:02 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Disable InsecurePlatform Warnings https://review.openstack.org/247069 | 05:03 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Disable InsecurePlatform Warnings https://review.openstack.org/247069 | 05:05 |
| *** tiswanso has quit IRC | 05:05 | |
| *** Daisy has joined #openstack-infra | 05:11 | |
| clarkb | yamamoto: those changes merge the tag back into master so that the master branch knows that a 1.0.0 version exists in its history | 05:11 |
| clarkb | yamamoto: it should not pull any new code into master it only ties up the history, you can't really see this well in gerrit because of how gerrit shows merge commits | 05:12 |
| clarkb | yamamoto: what you can do is pull it locally and verify each side of the merge looks correct and that the diff is empty between HEAD and HEADS first parent (HEAD^) | 05:12 |
| *** tsg_ has quit IRC | 05:13 | |
| *** rkukura_ has joined #openstack-infra | 05:15 | |
| *** rkukura has quit IRC | 05:16 | |
| *** rkukura_ is now known as rkukura | 05:16 | |
| *** manas has joined #openstack-infra | 05:25 | |
| yamamoto | clarkb: thank you. i'll try. | 05:28 |
| *** yamahata has joined #openstack-infra | 05:29 | |
| *** tsg_ has joined #openstack-infra | 05:37 | |
| *** tsg_ has quit IRC | 05:37 | |
| *** tsg_ has joined #openstack-infra | 05:37 | |
| *** greghaynes has quit IRC | 05:38 | |
| *** Daisy has quit IRC | 05:44 | |
| *** Daisy has joined #openstack-infra | 05:45 | |
| openstackgerrit | Sachi King proposed openstack-infra/project-config: Flip Neutron's unit tests to -constraints https://review.openstack.org/247306 | 05:46 |
| *** dingyichen has quit IRC | 05:47 | |
| *** greghaynes has joined #openstack-infra | 05:48 | |
| *** dingyichen has joined #openstack-infra | 05:48 | |
| *** rkukura_ has joined #openstack-infra | 05:48 | |
| *** rkukura has quit IRC | 05:48 | |
| *** rkukura_ is now known as rkukura | 05:48 | |
| *** Daisy has quit IRC | 05:49 | |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/project-config: Set max_microversion on Tempest for microversion testing https://review.openstack.org/247278 | 05:50 |
| *** greghaynes has quit IRC | 05:54 | |
| *** spzala has joined #openstack-infra | 05:54 | |
| *** Daisy has joined #openstack-infra | 05:54 | |
| *** stevemar_ has quit IRC | 05:57 | |
| *** jkraj has joined #openstack-infra | 05:57 | |
| *** ddieterly has joined #openstack-infra | 05:58 | |
| *** spzala has quit IRC | 05:59 | |
| ianw | StevenK: i have an email out to the author of the changes to try and get to the bottom of it | 05:59 |
| StevenK | ianw: Re my XXX? Okay, excellent. | 06:00 |
| *** greghaynes has joined #openstack-infra | 06:00 | |
| *** Daisy has quit IRC | 06:01 | |
| *** Daisy has joined #openstack-infra | 06:02 | |
| *** ddieterly has quit IRC | 06:03 | |
| *** zns has joined #openstack-infra | 06:03 | |
| *** nadya_ has joined #openstack-infra | 06:04 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/meetbot: Add warning if starting a meeting in an unrecognised channel https://review.openstack.org/246695 | 06:04 |
| *** Daisy has quit IRC | 06:06 | |
| *** zns has quit IRC | 06:08 | |
| *** abregman has joined #openstack-infra | 06:11 | |
| *** achanda has quit IRC | 06:15 | |
| *** rkukura_ has joined #openstack-infra | 06:17 | |
| *** rkukura has quit IRC | 06:18 | |
| *** rkukura_ is now known as rkukura | 06:18 | |
| *** sdake has joined #openstack-infra | 06:20 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/meetbot: Add warning if starting a meeting in an unrecognised channel https://review.openstack.org/246695 | 06:21 |
| *** otter768 has joined #openstack-infra | 06:22 | |
| *** rcernin has joined #openstack-infra | 06:23 | |
| *** otter768 has quit IRC | 06:27 | |
| *** yfried has quit IRC | 06:27 | |
| *** rpodolyaka1 has joined #openstack-infra | 06:27 | |
| *** hdd has joined #openstack-infra | 06:28 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/246764 | 06:30 |
| *** harlowja_at_home has joined #openstack-infra | 06:31 | |
| *** tsg_ has quit IRC | 06:35 | |
| *** zhurong has quit IRC | 06:35 | |
| *** nadya_ has quit IRC | 06:35 | |
| *** zhurong has joined #openstack-infra | 06:35 | |
| *** aeng has quit IRC | 06:41 | |
| *** sdake has quit IRC | 06:42 | |
| *** sdake_ has joined #openstack-infra | 06:42 | |
| *** cloudtrainme has joined #openstack-infra | 06:44 | |
| *** FallenPegasus has joined #openstack-infra | 06:45 | |
| *** elemoine has joined #openstack-infra | 06:48 | |
| *** harlowja_at_home has quit IRC | 06:52 | |
| *** yonglihe has quit IRC | 06:52 | |
| *** salv-orlando has joined #openstack-infra | 06:54 | |
| *** dalgaaf has joined #openstack-infra | 06:56 | |
| *** greghaynes has quit IRC | 06:56 | |
| *** elemoine__ has joined #openstack-infra | 06:57 | |
| *** tdurakov has joined #openstack-infra | 06:58 | |
| *** greghaynes has joined #openstack-infra | 06:58 | |
| *** ddieterly has joined #openstack-infra | 06:59 | |
| *** tdurakov has quit IRC | 07:01 | |
| *** ddieterly has quit IRC | 07:03 | |
| *** tdurakov has joined #openstack-infra | 07:04 | |
| *** zns has joined #openstack-infra | 07:04 | |
| *** aopincar has joined #openstack-infra | 07:04 | |
| *** gildub_ has quit IRC | 07:04 | |
| *** salv-orlando has quit IRC | 07:05 | |
| *** elemoine__ has left #openstack-infra | 07:05 | |
| *** cloudtrainme has quit IRC | 07:08 | |
| *** zns has quit IRC | 07:09 | |
| *** yolanda has quit IRC | 07:16 | |
| *** jtomasek has joined #openstack-infra | 07:17 | |
| *** yolanda has joined #openstack-infra | 07:20 | |
| *** ParsectiX has joined #openstack-infra | 07:21 | |
| *** yfried has joined #openstack-infra | 07:22 | |
| *** yolanda has quit IRC | 07:23 | |
| *** yolanda has joined #openstack-infra | 07:24 | |
| *** tdurakov has quit IRC | 07:26 | |
| *** yfried has quit IRC | 07:26 | |
| *** yfried has joined #openstack-infra | 07:26 | |
| *** elemoine has quit IRC | 07:27 | |
| *** fedexo has quit IRC | 07:42 | |
| *** sdake_ has quit IRC | 07:43 | |
| *** elemoine has joined #openstack-infra | 07:43 | |
| *** scheuran has joined #openstack-infra | 07:43 | |
| *** Daisy_ has joined #openstack-infra | 07:44 | |
| *** hichihar_ has quit IRC | 07:44 | |
| *** tdurakov has joined #openstack-infra | 07:44 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Make apply-test aware of modules to upgrade https://review.openstack.org/247273 | 07:44 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add baremetal hpuswest node definition https://review.openstack.org/208751 | 07:44 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add Infra Cloud modules to modules.env https://review.openstack.org/209617 | 07:44 |
| *** Daisy_ has quit IRC | 07:45 | |
| *** Yanyanhu has quit IRC | 07:45 | |
| *** Daisy_ has joined #openstack-infra | 07:45 | |
| *** Daisy_ has quit IRC | 07:50 | |
| *** e0ne has joined #openstack-infra | 07:54 | |
| *** tdurakov has quit IRC | 07:55 | |
| *** amotoki has joined #openstack-infra | 07:56 | |
| *** gongysh__ has quit IRC | 07:57 | |
| yamamoto | is there an easy way to change all "Fix Committed" to "Fix Released" after a release? | 07:57 |
| *** fhubik has joined #openstack-infra | 07:58 | |
| *** mkwiek07 has joined #openstack-infra | 07:58 | |
| *** fhubik is now known as fhubik_brb | 07:58 | |
| *** ddieterly has joined #openstack-infra | 07:59 | |
| *** markvoelker has quit IRC | 08:00 | |
| *** achanda has joined #openstack-infra | 08:02 | |
| *** bochi-michael has quit IRC | 08:03 | |
| *** maishsk has quit IRC | 08:03 | |
| *** bochi-michael has joined #openstack-infra | 08:04 | |
| *** ddieterly has quit IRC | 08:04 | |
| *** mpavone has joined #openstack-infra | 08:05 | |
| *** fhubik_brb is now known as fhubik | 08:05 | |
| *** zns has joined #openstack-infra | 08:05 | |
| *** achanda has quit IRC | 08:08 | |
| *** ifarkas has joined #openstack-infra | 08:08 | |
| *** flepied has quit IRC | 08:08 | |
| *** flepied has joined #openstack-infra | 08:09 | |
| *** matrohon has joined #openstack-infra | 08:09 | |
| *** zns has quit IRC | 08:09 | |
| *** flepied has quit IRC | 08:10 | |
| *** flepied has joined #openstack-infra | 08:10 | |
| *** zeih has joined #openstack-infra | 08:13 | |
| *** dizquierdo has joined #openstack-infra | 08:20 | |
| dtardivel | jhesketh AJaeger: about https://review.openstack.org/#/c/247043/, pypi package names are python-watcher and python-watcherclient ( and not watcher ), and openstackci user has permissions to update these packages. | 08:20 |
| *** nadya has joined #openstack-infra | 08:21 | |
| *** nadya is now known as Guest91492 | 08:21 | |
| *** sshnaidm has joined #openstack-infra | 08:22 | |
| *** otter768 has joined #openstack-infra | 08:23 | |
| *** egonzalez has joined #openstack-infra | 08:26 | |
| *** fawadkhaliq has quit IRC | 08:26 | |
| *** sflanigan has quit IRC | 08:26 | |
| *** otter768 has quit IRC | 08:28 | |
| *** kashyap has quit IRC | 08:29 | |
| *** _ody has joined #openstack-infra | 08:31 | |
| *** unicell1 has joined #openstack-infra | 08:32 | |
| *** armax has quit IRC | 08:32 | |
| *** bdemers_ has joined #openstack-infra | 08:34 | |
| *** phschwartz_ has joined #openstack-infra | 08:34 | |
| *** _ody_ has quit IRC | 08:35 | |
| *** unicell has quit IRC | 08:35 | |
| *** phschwartz has quit IRC | 08:35 | |
| *** jaredrohe_ has quit IRC | 08:35 | |
| *** vipuls has quit IRC | 08:35 | |
| *** clayton has quit IRC | 08:35 | |
| openstackgerrit | David TARDIVEL proposed openstack-infra/project-config: Add pypi publishing job for watcher. https://review.openstack.org/247043 | 08:35 |
| *** jaredrohe has joined #openstack-infra | 08:35 | |
| *** vipuls has joined #openstack-infra | 08:36 | |
| *** bdemers has quit IRC | 08:37 | |
| *** bdemers_ is now known as bdemers | 08:37 | |
| *** jlanoux has joined #openstack-infra | 08:41 | |
| openstackgerrit | David TARDIVEL proposed openstack-infra/project-config: Add #openstack-watcher to accessbot channel. https://review.openstack.org/247349 | 08:44 |
| *** clayton has joined #openstack-infra | 08:44 | |
| openstackgerrit | David TARDIVEL proposed openstack-infra/system-config: Enable logging in #openstack-watcher https://review.openstack.org/246405 | 08:46 |
| *** salv-orlando has joined #openstack-infra | 08:46 | |
| *** nmagnezi has joined #openstack-infra | 08:47 | |
| *** Ala has joined #openstack-infra | 08:48 | |
| *** ihrachys has joined #openstack-infra | 08:48 | |
| *** hashar has joined #openstack-infra | 08:49 | |
| *** salv-orlando has quit IRC | 08:50 | |
| *** jordanP has joined #openstack-infra | 08:51 | |
| *** FallenPegasus has quit IRC | 08:51 | |
| *** jed56 has joined #openstack-infra | 08:55 | |
| *** EricGonczer_ has joined #openstack-infra | 08:56 | |
| *** sergmelikyan has joined #openstack-infra | 08:56 | |
| *** EricGonczer_ has quit IRC | 08:56 | |
| *** ParsectiX has quit IRC | 08:57 | |
| *** Sree has joined #openstack-infra | 08:57 | |
| *** yfried_ has joined #openstack-infra | 08:58 | |
| *** yfried has quit IRC | 09:00 | |
| *** yfried__ has joined #openstack-infra | 09:00 | |
| *** ddieterly has joined #openstack-infra | 09:00 | |
| *** arxcruz has joined #openstack-infra | 09:00 | |
| *** markvoelker has joined #openstack-infra | 09:01 | |
| *** nmagnezi has quit IRC | 09:01 | |
| *** sergmelikyan has quit IRC | 09:01 | |
| *** dingyichen has quit IRC | 09:02 | |
| *** achanda has joined #openstack-infra | 09:03 | |
| *** yfried_ has quit IRC | 09:04 | |
| *** ddieterly has quit IRC | 09:04 | |
| *** kiran-r has joined #openstack-infra | 09:04 | |
| *** ParsectiX has joined #openstack-infra | 09:05 | |
| *** skolekonov has quit IRC | 09:05 | |
| *** markvoelker has quit IRC | 09:06 | |
| *** rpodolyaka1 has quit IRC | 09:06 | |
| *** egonzalez has quit IRC | 09:09 | |
| *** salv-orlando has joined #openstack-infra | 09:11 | |
| *** zhurong has quit IRC | 09:12 | |
| *** skolekonov has joined #openstack-infra | 09:12 | |
| *** nmagnezi has joined #openstack-infra | 09:13 | |
| *** fhubik is now known as fhubik_brb | 09:15 | |
| *** Daisy has joined #openstack-infra | 09:17 | |
| *** k4n0 has joined #openstack-infra | 09:18 | |
| *** e0ne has quit IRC | 09:18 | |
| *** eliqiao1 has joined #openstack-infra | 09:19 | |
| *** Daisy_ has joined #openstack-infra | 09:19 | |
| *** eliqiao1 has quit IRC | 09:19 | |
| *** fhubik_brb is now known as fhubik | 09:20 | |
| *** kozhukalov_ has joined #openstack-infra | 09:21 | |
| *** Daisy has quit IRC | 09:21 | |
| *** Sree has quit IRC | 09:22 | |
| *** Daisy_ has quit IRC | 09:23 | |
| *** Sree has joined #openstack-infra | 09:24 | |
| *** Ala has quit IRC | 09:25 | |
| *** Ala has joined #openstack-infra | 09:26 | |
| *** fhubik is now known as fhubik_brb | 09:26 | |
| *** fhubik_brb is now known as fhubik | 09:26 | |
| *** aspiers has joined #openstack-infra | 09:27 | |
| *** bexelbie_ has joined #openstack-infra | 09:27 | |
| openstackgerrit | Merged openstack-infra/project-config: Switch fuel-astute and fuel-nailgun-agent gates to use puppet templates https://review.openstack.org/246989 | 09:28 |
| *** Sree has quit IRC | 09:29 | |
| *** yfried has joined #openstack-infra | 09:29 | |
| *** maishsk has joined #openstack-infra | 09:30 | |
| *** achanda has quit IRC | 09:30 | |
| *** tdurakov has joined #openstack-infra | 09:30 | |
| *** fhubik is now known as fhubik_brb | 09:31 | |
| *** fhubik_brb is now known as fhubik | 09:32 | |
| *** yfried__ has quit IRC | 09:33 | |
| *** hogepodge has quit IRC | 09:34 | |
| *** jistr has joined #openstack-infra | 09:35 | |
| *** egonzalez has joined #openstack-infra | 09:36 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config: Add PyPI publishing for networking-bagpipe https://review.openstack.org/240890 | 09:37 |
| *** claudiub has joined #openstack-infra | 09:37 | |
| *** dtantsur|afk is now known as dtantsur | 09:39 | |
| *** hogepodge has joined #openstack-infra | 09:39 | |
| *** rpodolyaka1 has joined #openstack-infra | 09:41 | |
| *** rpodolyaka2 has joined #openstack-infra | 09:42 | |
| *** rpodolyaka1 has quit IRC | 09:42 | |
| *** daemontool has joined #openstack-infra | 09:42 | |
| openstackgerrit | Merged openstack-infra/project-config: Add temporary pin on jaraco.itertools https://review.openstack.org/247182 | 09:43 |
| *** elemoine has quit IRC | 09:44 | |
| openstackgerrit | Merged openstack-infra/project-config: Add #openstack-meeting-cp to eavesdrop https://review.openstack.org/246628 | 09:47 |
| *** daemontool has quit IRC | 09:47 | |
| *** daemontool has joined #openstack-infra | 09:48 | |
| *** mpavone has quit IRC | 09:48 | |
| *** yamahata has quit IRC | 09:49 | |
| openstackgerrit | Alexander Evseev proposed openstack-infra/zuul: Don't take into account commit message for skip-if filter https://review.openstack.org/247383 | 09:51 |
| *** tdurakov has quit IRC | 09:52 | |
| openstackgerrit | Alexander Evseev proposed openstack-infra/zuul: Don't take into account commit message for skip-if filter https://review.openstack.org/247383 | 09:52 |
| *** amotoki has quit IRC | 09:53 | |
| *** amotoki has joined #openstack-infra | 09:53 | |
| *** hogepodge has quit IRC | 09:54 | |
| *** tdurakov has joined #openstack-infra | 09:54 | |
| *** amotoki has quit IRC | 09:54 | |
| openstackgerrit | Merged openstack-infra/project-config: Add python-searchlightclient repo https://review.openstack.org/246691 | 09:54 |
| openstackgerrit | Merged openstack-infra/system-config: Add #openstack-meeting-cp to eavesdrop https://review.openstack.org/246629 | 09:55 |
| *** sergmelikyan has joined #openstack-infra | 09:55 | |
| *** mpavone has joined #openstack-infra | 10:00 | |
| openstackgerrit | Merged openstack-infra/infra-manual: Add a link to list of allowed project tags https://review.openstack.org/236735 | 10:01 |
| *** openstackgerrit has quit IRC | 10:01 | |
| *** ddieterly has joined #openstack-infra | 10:01 | |
| *** openstackgerrit has joined #openstack-infra | 10:02 | |
| openstackgerrit | Anastasia Kuznetsova proposed openstack-infra/project-config: Update jobs for mistral https://review.openstack.org/246917 | 10:02 |
| *** maishsk has quit IRC | 10:04 | |
| *** acruz has joined #openstack-infra | 10:05 | |
| *** smarcet has joined #openstack-infra | 10:05 | |
| *** ihrachys has quit IRC | 10:06 | |
| *** rguillebert has joined #openstack-infra | 10:06 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable Python 3 unit tests for os-win https://review.openstack.org/246969 | 10:06 |
| jhesketh | dtardivel: right, sorry about that! | 10:06 |
| *** ddieterly has quit IRC | 10:06 | |
| *** zns has joined #openstack-infra | 10:07 | |
| *** arxcruz has quit IRC | 10:07 | |
| *** zhenguo has quit IRC | 10:07 | |
| *** ihrachys has joined #openstack-infra | 10:07 | |
| openstackgerrit | Merged openstack-infra/project-config: remove oslo-incubator jobs https://review.openstack.org/245462 | 10:08 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Update default to F23 https://review.openstack.org/247296 | 10:08 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Remove fedora-minimal/install.d/99-ramdisk https://review.openstack.org/247295 | 10:09 |
| openstackgerrit | Alexander Evseev proposed openstack-infra/zuul: Don't take into account commit message for skip-if filter https://review.openstack.org/247383 | 10:09 |
| ianw | StevenK: ^ so i spoke with the author. we have always been wrong in not using the kernel install scripts from grubby on fedora. 99-ramdisk is basically a workaround for us using the wrong install path | 10:09 |
| *** hogepodge has joined #openstack-infra | 10:10 | |
| *** jcoufal has joined #openstack-infra | 10:11 | |
| *** dewsday has joined #openstack-infra | 10:11 | |
| *** zns has quit IRC | 10:12 | |
| *** dewsday has quit IRC | 10:13 | |
| *** fawadkhaliq has joined #openstack-infra | 10:14 | |
| *** yfried is now known as yfried|afk | 10:14 | |
| *** ildikov has quit IRC | 10:18 | |
| *** openstack has joined #openstack-infra | 10:21 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Start using cgit::lb class https://review.openstack.org/181829 | 10:23 |
| *** abregman is now known as abregman|lunch | 10:24 | |
| openstackgerrit | Merged openstack-infra/project-config: Add release notes jobs for ironic https://review.openstack.org/242152 | 10:24 |
| openstackgerrit | Merged openstack-infra/project-config: Enable standard python jobs for pymod2pkg https://review.openstack.org/247045 | 10:24 |
| *** otter768 has joined #openstack-infra | 10:24 | |
| *** maiteb has joined #openstack-infra | 10:25 | |
| *** gildub_ has joined #openstack-infra | 10:25 | |
| *** Sree has joined #openstack-infra | 10:25 | |
| *** smarcet has quit IRC | 10:26 | |
| *** achanda has joined #openstack-infra | 10:27 | |
| *** otter768 has quit IRC | 10:28 | |
| openstackgerrit | Merged openstack-infra/zuul: Use 127.0.0.1 rather than localhost for statsd host https://review.openstack.org/229247 | 10:29 |
| openstackgerrit | Sergey Skripnick proposed openstack/requirements: Bump ddt version to >=1.0.1 https://review.openstack.org/247214 | 10:29 |
| *** manas has quit IRC | 10:30 | |
| openstackgerrit | Merged openstack-infra/project-config: add release notes jobs for cinder https://review.openstack.org/244764 | 10:31 |
| openstackgerrit | Merged openstack-infra/zuul: Enhance CRD doc with diagrams https://review.openstack.org/229416 | 10:31 |
| *** maiteb has quit IRC | 10:31 | |
| openstackgerrit | Merged openstack-infra/zuul: Add style for skipped jobs https://review.openstack.org/246226 | 10:31 |
| *** bexelbie_ is now known as bexelbie | 10:32 | |
| hashar | yolanda: jhesketh: thanks for the approval of Zuul CRD diagrams :-} | 10:32 |
| yolanda | this is a great documentation, i think is really useful for end users | 10:33 |
| *** yfried|afk is now known as yfried | 10:34 | |
| *** ldnunes has joined #openstack-infra | 10:36 | |
| *** sergmelikyan has quit IRC | 10:39 | |
| *** mpavone has quit IRC | 10:40 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/diskimage-builder: Install IPA in a virtual enviroment https://review.openstack.org/235843 | 10:41 |
| *** yamamoto has quit IRC | 10:42 | |
| *** hogepodge has quit IRC | 10:42 | |
| *** yfried is now known as yfried|afk | 10:44 | |
| *** mahatic has quit IRC | 10:44 | |
| *** dims has joined #openstack-infra | 10:45 | |
| *** manas has joined #openstack-infra | 10:47 | |
| sdague | jhesketh: something went funky with logstash indexers 6 hours ago | 10:47 |
| bookwar | is there naming policy for pages in wiki? Topic/SubTopic/SubSubTopic is ok? | 10:47 |
| sdague | jhesketh: any chance you can take a look? | 10:48 |
| jhesketh | sdague: oh? | 10:48 |
| jhesketh | sure | 10:48 |
| jhesketh | sdague: where are you seeing them be funky? | 10:48 |
| sdague | they don't exist any more | 10:48 |
| sdague | look at the logstash job queue | 10:48 |
| sdague | and elastic-recheck is reporting 6 hours behind | 10:49 |
| jhesketh | yeah just saw | 10:49 |
| *** mkwiek07 has quit IRC | 10:49 | |
| jhesketh | that's the queue, not necessarily the workers though, so could be gearman/elsewhere | 10:49 |
| sdague | Data Last Updated: Thu Nov 19 2015 05:30:02 GMT-0500 (EST) | 10:49 |
| sdague | Last Elastic Search Index Update: Wed Nov 18 2015 22:34:34 GMT-0500 (EST) | 10:49 |
| sdague | jhesketh: true | 10:49 |
| sdague | but something is busted | 10:49 |
| *** tdurakov has quit IRC | 10:50 | |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Add 'pr-comment' github webhook event https://review.openstack.org/239203 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Add 'push' and 'tag' github webhook events. https://review.openstack.org/191207 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Support GitHub PR webhooks https://review.openstack.org/163117 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Make the string representation of change transparent https://review.openstack.org/238948 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Merge pull requests from github reporter https://review.openstack.org/243250 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Configurable SSH access to GitHub https://review.openstack.org/239138 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Fix job hierarchy bug. https://review.openstack.org/192457 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Allow using webapp from connections https://review.openstack.org/215642 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Support for github commit status https://review.openstack.org/239303 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Add basic Github Zuul Reporter. https://review.openstack.org/191312 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Allow list values in template parameters. https://review.openstack.org/191208 | 10:50 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) support github pull reqeust labels https://review.openstack.org/247421 | 10:50 |
| *** romcheg has joined #openstack-infra | 10:50 | |
| romcheg | Hi folks! | 10:50 |
| *** hogepodge has joined #openstack-infra | 10:51 | |
| romcheg | Sorry, if this was discussed here and I'm just bringing more spam | 10:51 |
| romcheg | The issue is that new version of tox has a bug that breaks CI jobs for some projects | 10:52 |
| romcheg | https://bitbucket.org/hpk42/tox/issues/285/tox-220-breaks-some-toxini-config-files | 10:52 |
| *** mpavone has joined #openstack-infra | 10:53 | |
| romcheg | Looks like a few OpenStack projects are affected. Is it possible to downgrade tox on CI nodes, until the bug is fixed? | 10:53 |
| *** bochi-michael has quit IRC | 10:53 | |
| *** Kennan has quit IRC | 10:53 | |
| *** bochi-michael has joined #openstack-infra | 10:54 | |
| romcheg | ihrachys: I see your comment on that bug, so perhaps you've done more investigation on it? | 10:54 |
| *** jcoufal_ has joined #openstack-infra | 10:54 | |
| *** jcoufal has quit IRC | 10:55 | |
| ihrachys | romcheg: for neutron, we decided to disable the broken feature for a while in our tox.ini files | 10:55 |
| ihrachys | romcheg: not that I think it's the only way to do it, just a suggestion | 10:55 |
| ihrachys | romcheg: and so now we merely wait for that to be fixed and released by tox team, then validate the fix and if it's ok, revert the patch that disabled customizing environments for tox targets | 10:56 |
| *** Sree has quit IRC | 10:56 | |
| *** yfried|afk is now known as yfried | 10:56 | |
| *** Kennan has joined #openstack-infra | 10:56 | |
| ihrachys | romcheg: I believe if you would want to downgrade tox, you would need to mess with infra code to achieve it (and you would need to find a proper place to keep the proper version cap; I guess that would be requirements repo) | 10:57 |
| ihrachys | romcheg: atm images used by infra do not cap, and are built nightly; infra can remove latest images temporarily, but they are regenerated nightly, so the next image breaks you again | 10:58 |
| ihrachys | romcheg: I would actually vote for someone to work on infra code to be explicit about tox version installed. I suspect infra folks could also approve it. | 10:58 |
| *** mkwiek07 has joined #openstack-infra | 10:59 | |
| romcheg | ihrachys: that sounds like a long time to wait :( | 10:59 |
| romcheg | perhaps there's a faster way? | 10:59 |
| *** rpodolyaka2 has quit IRC | 10:59 | |
| romcheg | fungi, maybe you know it? ^ | 10:59 |
| *** phschwartz has joined #openstack-infra | 11:00 | |
| *** pedroalvarez has quit IRC | 11:01 | |
| *** phschwartz_ has quit IRC | 11:01 | |
| *** ParsectiX has quit IRC | 11:01 | |
| ihrachys | romcheg: fastest is fixing it per project and wait for the actual fix :) | 11:01 |
| ihrachys | romcheg: that's what we did in neutron and live happily ever since | 11:01 |
| *** ildikov has joined #openstack-infra | 11:01 | |
| *** pedroalvarez has joined #openstack-infra | 11:02 | |
| *** markvoelker has joined #openstack-infra | 11:02 | |
| romcheg | ihrachys: looks like the plan I'd use | 11:02 |
| *** ddieterly has joined #openstack-infra | 11:03 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/puppet-log_processor: Revert "Create subunit proccessor subclass" https://review.openstack.org/247426 | 11:04 |
| jhesketh | sdague: looks like a bad patch in puppet-log_processor | 11:04 |
| jhesketh | sdague: ^ there's the revert | 11:04 |
| jhesketh | (that code also looks quite wrong at a glance) | 11:04 |
| *** flip211_ is now known as flip214 | 11:04 | |
| *** flip214 has joined #openstack-infra | 11:04 | |
| *** ekarlso has quit IRC | 11:05 | |
| sdague | jhesketh: ok, cool | 11:05 |
| sdague | can that be fast reverted so we can get our logstash pipeline bakc | 11:05 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/puppet-log_processor: Revert "Create subunit proccessor subclass" https://review.openstack.org/247426 | 11:05 |
| jhesketh | sdague: yep, just wanted at least one set of eyes - you've given it a look so I'll merge it now | 11:06 |
| sdague | thanks | 11:06 |
| sdague | I had gotten this set of ebtables race workarounds merged yesterday, and really want data to see if that's going to make things much better | 11:06 |
| *** markvoelker has quit IRC | 11:07 | |
| *** fhubik is now known as fhubik_brb | 11:07 | |
| jhesketh | :-( | 11:07 |
| *** ddieterly has quit IRC | 11:08 | |
| *** zns has joined #openstack-infra | 11:08 | |
| openstackgerrit | Sean Dague proposed openstack-infra/irc-meetings: add meeting for service catalog tng effort https://review.openstack.org/245745 | 11:13 |
| *** zns has quit IRC | 11:13 | |
| *** fhubik_brb is now known as fhubik | 11:13 | |
| *** Kennan has quit IRC | 11:13 | |
| *** bochi-michael has quit IRC | 11:13 | |
| *** bochi-michael has joined #openstack-infra | 11:14 | |
| *** abregman|lunch is now known as abregman | 11:15 | |
| *** Kennan has joined #openstack-infra | 11:16 | |
| sdague | jeblair: you have a -2 on that, which it would be good to reset ^^^ | 11:16 |
| *** aysyd has joined #openstack-infra | 11:17 | |
| *** ociuhandu has quit IRC | 11:17 | |
| *** moravec has quit IRC | 11:19 | |
| *** kushal has joined #openstack-infra | 11:19 | |
| *** moravec has joined #openstack-infra | 11:20 | |
| *** timothyb89_ has joined #openstack-infra | 11:21 | |
| *** timothyb89 has quit IRC | 11:21 | |
| *** jamielennox is now known as jamielennox|away | 11:22 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/diskimage-builder: Install IPA in a virtual enviroment https://review.openstack.org/235843 | 11:22 |
| *** yamamoto has joined #openstack-infra | 11:24 | |
| *** yamamoto_ has joined #openstack-infra | 11:25 | |
| *** ociuhandu has joined #openstack-infra | 11:25 | |
| *** ociuhandu has quit IRC | 11:26 | |
| *** salv-orlando has quit IRC | 11:27 | |
| *** egonzalez has quit IRC | 11:27 | |
| *** moravec has quit IRC | 11:27 | |
| openstackgerrit | Merged openstack-infra/puppet-log_processor: Revert "Create subunit proccessor subclass" https://review.openstack.org/247426 | 11:27 |
| *** Kennan has quit IRC | 11:27 | |
| *** bochi-michael has quit IRC | 11:27 | |
| *** bochi-michael has joined #openstack-infra | 11:28 | |
| *** salv-orlando has joined #openstack-infra | 11:28 | |
| *** bochi-michael has quit IRC | 11:29 | |
| *** yamamoto has quit IRC | 11:29 | |
| *** bochi-michael has joined #openstack-infra | 11:29 | |
| *** ekarlso has joined #openstack-infra | 11:29 | |
| *** Kennan has joined #openstack-infra | 11:30 | |
| jhesketh | sdague: it's merged so I'm applying it to logstash.o.o | 11:31 |
| *** fhubik is now known as fhubik_brb | 11:31 | |
| *** ddieterly has joined #openstack-infra | 11:31 | |
| sdague | jhesketh: thanks | 11:33 |
| *** zns has joined #openstack-infra | 11:33 | |
| jhesketh | apply worked, but the logstash daemon didn't start | 11:34 |
| jhesketh | might need to look at that later, but I've started it manually | 11:34 |
| jhesketh | will apply to a worker now | 11:34 |
| *** Kennan has quit IRC | 11:35 | |
| *** bochi-michael has quit IRC | 11:35 | |
| *** bochi-michael has joined #openstack-infra | 11:36 | |
| jhesketh | ah, it's not needed on the workers | 11:36 |
| jhesketh | sdague: it looks like it's working, but I need to run out for a couple of minutes, will double check when I get back | 11:38 |
| *** Kennan has joined #openstack-infra | 11:38 | |
| sdague | ok, cool, thank you | 11:39 |
| *** weshay_xchat has joined #openstack-infra | 11:39 | |
| *** hashar has quit IRC | 11:39 | |
| jhesketh | anytime, thanks for letting me know | 11:40 |
| *** ihrachys_ has joined #openstack-infra | 11:43 | |
| *** ihrachys has quit IRC | 11:46 | |
| *** Kennan has quit IRC | 11:47 | |
| *** bochi-michael has quit IRC | 11:47 | |
| *** bochi-michael has joined #openstack-infra | 11:48 | |
| flip214 | this is a link to graphite.openstack.org: http://links.linbit.com/openstack-ci-results .... but could somebody explain the graphic? | 11:49 |
| flip214 | is there something broken in graphite? | 11:49 |
| flip214 | since nov 17th ~18:00 always at least 1? | 11:50 |
| *** Kennan has joined #openstack-infra | 11:50 | |
| *** sergmelikyan has joined #openstack-infra | 11:51 | |
| *** fhubik_brb is now known as fhubik | 11:51 | |
| *** rfolco_ has joined #openstack-infra | 11:52 | |
| *** placko_ has joined #openstack-infra | 11:52 | |
| *** Sree has joined #openstack-infra | 11:53 | |
| *** manas has quit IRC | 11:54 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/246764 | 11:54 |
| *** gildub_ has quit IRC | 11:55 | |
| *** gildub has joined #openstack-infra | 11:55 | |
| *** Sree has quit IRC | 11:58 | |
| *** tdurakov has joined #openstack-infra | 11:58 | |
| *** vmbrasseur has quit IRC | 11:59 | |
| *** igorbelikov has quit IRC | 11:59 | |
| *** ihrachys_ has quit IRC | 11:59 | |
| *** vmbrasseur has joined #openstack-infra | 11:59 | |
| *** ihrachys has joined #openstack-infra | 12:00 | |
| *** tdurakov has quit IRC | 12:00 | |
| *** Guest49793 is now known as tdurakov | 12:00 | |
| *** Guest34420 has joined #openstack-infra | 12:00 | |
| *** gildub has quit IRC | 12:01 | |
| *** bochi-michael has quit IRC | 12:01 | |
| *** abregman is now known as abregman|hh | 12:01 | |
| *** bochi-michael has joined #openstack-infra | 12:02 | |
| *** smarcet has joined #openstack-infra | 12:02 | |
| *** FallenPegasus has joined #openstack-infra | 12:02 | |
| *** igorbelikov has joined #openstack-infra | 12:04 | |
| *** ParsectiX has joined #openstack-infra | 12:04 | |
| *** ParsectiX has quit IRC | 12:06 | |
| *** ParsectiX has joined #openstack-infra | 12:06 | |
| *** oomichi has quit IRC | 12:07 | |
| *** FallenPegasus has quit IRC | 12:07 | |
| *** eantyshev has joined #openstack-infra | 12:08 | |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: DNM testing https://review.openstack.org/247002 | 12:08 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Set puppet versions in tripleo.sh not toci_instack.sh https://review.openstack.org/246457 | 12:08 |
| *** jkraj has quit IRC | 12:09 | |
| *** hashar has joined #openstack-infra | 12:09 | |
| *** rpodolyaka1 has joined #openstack-infra | 12:09 | |
| *** rhallisey has joined #openstack-infra | 12:10 | |
| *** Kennan has quit IRC | 12:10 | |
| *** Sree has joined #openstack-infra | 12:12 | |
| *** ociuhandu has joined #openstack-infra | 12:12 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/irc-meetings: neutron_upgrades: added meeting_id and agenda_url https://review.openstack.org/247464 | 12:13 |
| *** julim has joined #openstack-infra | 12:13 | |
| *** Kennan has joined #openstack-infra | 12:13 | |
| *** dims has quit IRC | 12:16 | |
| rhallisey | hello. Any got a minute to review my patch regarding a job for docker & tripleo? https://review.openstack.org/#/c/238475/ | 12:17 |
| *** trown|outttypeww is now known as trown | 12:19 | |
| *** _ody has quit IRC | 12:19 | |
| *** dramalho has joined #openstack-infra | 12:19 | |
| * jhesketh returns | 12:24 | |
| *** dramalho has quit IRC | 12:24 | |
| *** otter768 has joined #openstack-infra | 12:25 | |
| *** maiteb has joined #openstack-infra | 12:25 | |
| flip214 | any graphite problem known since ~42 hours? | 12:25 |
| openstackgerrit | Igor Belikov proposed openstack-infra/project-config: Switch fuel-specs to openstack-specs-jobs template https://review.openstack.org/247471 | 12:25 |
| *** sergmelikyan has quit IRC | 12:27 | |
| *** doug-fish has joined #openstack-infra | 12:29 | |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/puppet-jenkins: Make Jenkins vhost a host-based https://review.openstack.org/247474 | 12:30 |
| *** e0ne has quit IRC | 12:30 | |
| *** otter768 has quit IRC | 12:30 | |
| *** hashar has quit IRC | 12:30 | |
| *** abregman|hh is now known as abregman | 12:32 | |
| *** markvoelker has joined #openstack-infra | 12:33 | |
| *** _ody has joined #openstack-infra | 12:33 | |
| *** Daisy has joined #openstack-infra | 12:37 | |
| *** markvoelker has quit IRC | 12:38 | |
| *** gordc has joined #openstack-infra | 12:39 | |
| *** e0ne has joined #openstack-infra | 12:40 | |
| *** hashar has joined #openstack-infra | 12:41 | |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Add in extra connections tests https://review.openstack.org/169300 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Refactor sources out of triggers https://review.openstack.org/118993 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Move Item formatting into Reporters https://review.openstack.org/223298 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Document the new connections in zuul https://review.openstack.org/169270 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Set keepalives for gerrit connections https://review.openstack.org/238988 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Add support for sqlalchemy reporter https://review.openstack.org/223333 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Add support to reject changes from approvals https://review.openstack.org/211108 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Remove ActionReporters https://review.openstack.org/243474 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Tidy up loggers https://review.openstack.org/224336 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Configure triggers dynamically https://review.openstack.org/119534 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Add support for 'connection' concept https://review.openstack.org/121528 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Add base class for triggers https://review.openstack.org/119532 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Add base class for sources https://review.openstack.org/119531 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Add base class for reporters https://review.openstack.org/119530 | 12:41 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/zuul: Tidy up tests/base.py https://review.openstack.org/238817 | 12:41 |
| flip214 | anteaya: asselin: ping? | 12:44 |
| *** thorst has joined #openstack-infra | 12:44 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Add resource wrappers for boards and worklists https://review.openstack.org/231969 | 12:48 |
| *** Ramanjaneya has quit IRC | 12:49 | |
| *** bochi-michael has quit IRC | 12:50 | |
| *** ParsectiX has quit IRC | 12:50 | |
| *** ParsectiX has joined #openstack-infra | 12:50 | |
| *** achanda has quit IRC | 12:52 | |
| EmilienM | hello infra, I need a last +A on a trivial system-config patch > https://review.openstack.org/242621 - thanks in advance! | 12:52 |
| *** mahatic has joined #openstack-infra | 12:53 | |
| *** salv-orl_ has joined #openstack-infra | 12:54 | |
| *** amuller has joined #openstack-infra | 12:56 | |
| *** baoli has joined #openstack-infra | 12:56 | |
| *** egonzalez has joined #openstack-infra | 12:56 | |
| *** dramalho has joined #openstack-infra | 12:58 | |
| *** salv-orlando has quit IRC | 12:58 | |
| *** zns has quit IRC | 12:58 | |
| *** zns has joined #openstack-infra | 12:59 | |
| *** Kiall has quit IRC | 13:01 | |
| *** Kiall has joined #openstack-infra | 13:02 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Add job for the ovs mechanism driver with native mode https://review.openstack.org/221143 | 13:04 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: [sahara] job based on direct engine only in stable/liberty https://review.openstack.org/247484 | 13:04 |
| *** dizquierdo has quit IRC | 13:05 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Add job for networking-ofagent https://review.openstack.org/244986 | 13:06 |
| *** _amrith_ is now known as amrith | 13:06 | |
| *** rossella_s has quit IRC | 13:07 | |
| *** rossella_s has joined #openstack-infra | 13:07 | |
| mordred | EmilienM: done | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Add 'pr-comment' github webhook event https://review.openstack.org/239203 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Add 'push' and 'tag' github webhook events. https://review.openstack.org/191207 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Support GitHub PR webhooks https://review.openstack.org/163117 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Make the string representation of change transparent https://review.openstack.org/238948 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Merge pull requests from github reporter https://review.openstack.org/243250 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Configurable SSH access to GitHub https://review.openstack.org/239138 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Fix job hierarchy bug. https://review.openstack.org/192457 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) support github pull reqeust labels https://review.openstack.org/247421 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Allow using webapp from connections https://review.openstack.org/215642 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Support for github commit status https://review.openstack.org/239303 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Add basic Github Zuul Reporter. https://review.openstack.org/191312 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Allow list values in template parameters. https://review.openstack.org/191208 | 13:11 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Encapsulate determining the event purpose https://review.openstack.org/247487 | 13:11 |
| EmilienM | mordred: thank you | 13:11 |
| *** signed8bit has joined #openstack-infra | 13:13 | |
| *** zhurong has joined #openstack-infra | 13:15 | |
| openstackgerrit | Merged openstack-infra/system-config: site.pp: add openstackstatus to #puppet-openstack https://review.openstack.org/242621 | 13:16 |
| *** signed8bit is now known as signed8bit_ZZZzz | 13:16 | |
| eantyshev | jhesketh: Hi, I think I have messed you patches for zuul, sorry :(( | 13:17 |
| openstackgerrit | Glauco Oliveira proposed openstack-infra/puppet-openstack_health: Update default api configurations https://review.openstack.org/247492 | 13:18 |
| *** stevemar_ has joined #openstack-infra | 13:18 | |
| jhesketh | eantyshev: how so? | 13:19 |
| eantyshev | jhesketh: don't know... I did "git review -d 224336" and then cherrypicked my change above, and did the "git review" | 13:20 |
| *** Sree has quit IRC | 13:21 | |
| *** sergmelikyan has joined #openstack-infra | 13:21 | |
| jhesketh | eantyshev: hmm, that's odd.. did you do any rebases? | 13:22 |
| *** stevemar_ has quit IRC | 13:22 | |
| *** fawadkhaliq has quit IRC | 13:22 | |
| *** dprince has joined #openstack-infra | 13:22 | |
| jhesketh | eantyshev: it just looks like you've taken my series and rebased it | 13:23 |
| *** glauco___ has joined #openstack-infra | 13:23 | |
| jhesketh | which is fine | 13:23 |
| jhesketh | doesn't look like anything has been lost etc | 13:23 |
| eantyshev | jhesketh: AFAIU, no rebases involved, I checked out today's version of your change and applied my cherry-pick | 13:24 |
| jhesketh | eantyshev: git review will do a rebase when you push it up | 13:24 |
| *** sergmelikyan has quit IRC | 13:24 | |
| eantyshev | jhesketh: Am I right that I rebased your patches on current zuul head? | 13:25 |
| jhesketh | eantyshev: yep | 13:25 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add puppet apply settings to puppet.conf https://review.openstack.org/241495 | 13:27 |
| eantyshev | jhesketh: I did not intend to do that anyway. Just noticed that my change cannot merge, and the previous one can | 13:27 |
| *** glauco has quit IRC | 13:27 | |
| *** sergmelikyan has joined #openstack-infra | 13:27 | |
| jhesketh | eantyshev: that's okay, it would have needed rebasing before merging anyway :-) | 13:27 |
| *** ParsectiX has quit IRC | 13:28 | |
| jhesketh | eantyshev: yes, I did a bunch of rework on the series, tahnks for re-doing your patch | 13:28 |
| eantyshev | jhesketh: no problem then:) | 13:28 |
| *** achanda has joined #openstack-infra | 13:29 | |
| mordred | jhesketh: (and other infra-root) I have tested that the patch above is safe to apply - and I'd like to land it so that we can start doing some direct testing of the puppet apply codepath | 13:30 |
| mordred | (landing that patch is the last thing we need to land globally before we cna test apply on a per-machine basis) | 13:30 |
| *** stevemar_ has joined #openstack-infra | 13:31 | |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Support for dependent pipelines with github https://review.openstack.org/247500 | 13:31 |
| *** amuller has quit IRC | 13:32 | |
| *** bcourt has quit IRC | 13:32 | |
| *** amuller_ has joined #openstack-infra | 13:32 | |
| *** signed8bit_ZZZzz has quit IRC | 13:32 | |
| jhesketh | mordred: lgtm | 13:32 |
| phschwartz | morning infra | 13:32 |
| *** signed8bit has joined #openstack-infra | 13:32 | |
| *** openstackstatus has joined #openstack-infra | 13:33 | |
| *** ChanServ sets mode: +v openstackstatus | 13:33 | |
| openstackgerrit | Merged openstack-infra/project-config: Add pypi publishing job for watcher. https://review.openstack.org/247043 | 13:34 |
| *** markvoelker has joined #openstack-infra | 13:35 | |
| *** regXboi has joined #openstack-infra | 13:36 | |
| *** rpodolyaka1 has quit IRC | 13:38 | |
| *** ayoung_Zzz is now known as ayoung | 13:39 | |
| *** Liuqing has joined #openstack-infra | 13:39 | |
| Liuqing | hello, for the patch: https://review.openstack.org/#/c/247376/, all job success, but the jenkins Verified -1 | 13:39 |
| *** rpodolyaka1 has joined #openstack-infra | 13:40 | |
| mordred | jhesketh: thanks! | 13:40 |
| mordred | morning phschwartz | 13:40 |
| flip214 | anyone interested in a graphite problem? | 13:40 |
| *** aopincar has quit IRC | 13:40 | |
| mordred | flip214: what sort of problem ya got? | 13:40 |
| jroll | .v 41' | 13:40 |
| jroll | wow, I cannot type yet today, sorry | 13:41 |
| phschwartz | Anyone remember off hand the markdown element for pre-formated for code and such? | 13:41 |
| jroll | phschwartz: `one line of code` or ```multiple\nlines``` | 13:41 |
| jroll | iirc | 13:42 |
| flip214 | mordred: http://links.linbit.com/openstack-ci-results is a link into graphite. | 13:42 |
| phschwartz | jroll: wait, not MD. the RST format for our docs | 13:43 |
| flip214 | mordred: if you look at the picture, since Nov 17th ~18:00 the minimum value is 1 | 13:43 |
| flip214 | that doesn't look that sane to me | 13:43 |
| flip214 | thanks for listening & responding, BTW! | 13:43 |
| jroll | phschwartz: oh, http://docutils.sourceforge.net/docs/ref/rst/restructuredtext.html#literal-blocks tl;dr write a thing:: \n\n indented code | 13:44 |
| jroll | the :: is the key | 13:44 |
| mordred | flip214: looking | 13:45 |
| phschwartz | jroll: that helped. found it because of it. | 13:46 |
| phschwartz | jroll: .. code-block:: <language> | 13:46 |
| mordred | flip214: ah - so, we changed some graphite settings - I think something might need to change in that graph to get the right thing (sorry) jeblair was the one who made the change so will have a smarter answer when he's up | 13:46 |
| jroll | phschwartz: cool | 13:47 |
| *** bcourt has joined #openstack-infra | 13:47 | |
| *** amrith is now known as _amrith_ | 13:48 | |
| *** kgiusti has joined #openstack-infra | 13:50 | |
| *** FallenPegasus has joined #openstack-infra | 13:51 | |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Support for dependent pipelines with github https://review.openstack.org/247500 | 13:53 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) Encapsulate determining the event purpose https://review.openstack.org/247487 | 13:53 |
| openstackgerrit | Jan Hruban proposed openstack-infra/zuul: (WIP) support github pull reqeust labels https://review.openstack.org/247421 | 13:53 |
| openstackgerrit | Liuqing Jing proposed openstack/requirements: Add SpiffWorkflow to global requirements https://review.openstack.org/247521 | 13:54 |
| *** eharney has quit IRC | 13:54 | |
| *** xyang1 has joined #openstack-infra | 13:54 | |
| openstackgerrit | Philip Marc Schwartz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work https://review.openstack.org/239810 | 13:54 |
| phschwartz | yolanda: ^^ If you don't mind taking a look | 13:55 |
| *** Daisy has quit IRC | 13:55 | |
| *** bexelbie has quit IRC | 13:55 | |
| yolanda | hi phschwartz, sure | 13:55 |
| *** moravec has joined #openstack-infra | 13:55 | |
| *** Daisy has joined #openstack-infra | 13:55 | |
| yolanda | thanks for addressing that | 13:55 |
| *** FallenPegasus has quit IRC | 13:55 | |
| phschwartz | yolanda: not a problem. The sooner we get this resolved and in, the sooner we can start getting the work done. | 13:55 |
| *** spzala has joined #openstack-infra | 13:55 | |
| *** zns has quit IRC | 13:55 | |
| *** tdurakov is now known as Guest64159 | 13:56 | |
| *** Guest34420 is now known as tdurakov | 13:56 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Remove unused Manila CI job https://review.openstack.org/247524 | 13:56 |
| *** Guest64159 has joined #openstack-infra | 13:57 | |
| openstackgerrit | afazekas proposed openstack/requirements: keyring older then 5.5.1 may print warning https://review.openstack.org/247525 | 13:57 |
| *** zns has joined #openstack-infra | 13:57 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Null Merge tag '1.1.0' into HEAD https://review.openstack.org/247526 | 13:57 |
| flip214 | mordred: thanks, but it should simply count lines that say "failure" or "success" .. don't understand what could affect that, with some specific point in time. | 13:57 |
| flip214 | but thanks, hoping for an answer of jeblair. | 13:58 |
| *** bexelbie_ has joined #openstack-infra | 13:58 | |
| *** glauco___ has quit IRC | 13:58 | |
| *** tlian has joined #openstack-infra | 13:59 | |
| mordred | flip214: we changed how null data is collected, which looking at this makes me think it's maybe related - but yeah, jeblair has the smartness | 13:59 |
| *** xyang1 has left #openstack-infra | 13:59 | |
| *** tlian has quit IRC | 13:59 | |
| *** xyang1 has joined #openstack-infra | 14:00 | |
| *** gongysh__ has joined #openstack-infra | 14:02 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool: Write the cloud name into the provider info https://review.openstack.org/247084 | 14:04 |
| *** tlian has joined #openstack-infra | 14:04 | |
| yolanda | phschwartz, mordred, so my fear with that refactor, is add the nesting of all openstack::server again, while we had an spec to decouple it | 14:06 |
| yolanda | in the past, it proved to be a problem for us | 14:06 |
| *** akshai has joined #openstack-infra | 14:06 | |
| phschwartz | yolanda: There is nothing in the spec about nesting openstack::server | 14:06 |
| yolanda | you talk about a common interface | 14:06 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Change uuid columns to bigint https://review.openstack.org/235009 | 14:07 |
| *** baoli has quit IRC | 14:07 | |
| yolanda | what this interface will contain? | 14:07 |
| mordred | phschwartz: I think she means the coupling of server setup and application setup | 14:07 |
| *** amuller_ is now known as amuller | 14:07 | |
| mordred | yolanda: for me .. | 14:07 |
| yolanda | yep | 14:07 |
| phschwartz | yes and making a version of openstack_project::server that is in openstackci that can be consumed by system-config and others in the site.pp | 14:07 |
| yolanda | that's fear | 14:07 |
| *** tdurakov has quit IRC | 14:08 | |
| mordred | so - I think there are two different goals here that we should tease apart | 14:08 |
| yolanda | because how can you be sure you are covering all ci needs with that interface? we've been consuming that for long time, and the decoupling helped to us | 14:08 |
| *** daemontool_ has joined #openstack-infra | 14:08 | |
| phschwartz | I think your misunderstanding what I have listed in the spec there | 14:08 |
| mordred | _my_ goal with the thing phschwartz is poking as is that a person who says "I want an Infra" who decides to use openstackci to get one | 14:08 |
| phschwartz | I am not talking about coupling it but providing it in the interface the same as server is split out in system-config | 14:08 |
| mordred | should really only need to consume openstackci to get the major infra elements they're looking for | 14:09 |
| *** daemontool has quit IRC | 14:09 | |
| mordred | so if openstackci provides a gerrit, a zuul and a graphite - those should all have entries in openstackci | 14:09 |
| mordred | we can say "yeah, but we can just document which other puppet classes to use" | 14:09 |
| mordred | but we could have done that without openstackci | 14:09 |
| mordred | "just use these 20 modules and configure them the way you want to" | 14:10 |
| *** rlandy has joined #openstack-infra | 14:10 | |
| mordred | peple don't want to configure them the way they want to - they want to configure them the way _we_ want them configured with a few well known exceptions | 14:10 |
| yolanda | yes, i am ok to have entries, that's fine. But from the conversation in the last day, there raised the need to have some interface to define ports, firewall, etc... not sure if that is the scope we need to cover | 14:10 |
| *** tsg has joined #openstack-infra | 14:10 | |
| mordred | right- so that's the second thing | 14:10 |
| mordred | and I think it's good that it's surfaced - which is whether or not openstackci should assume a base configured node to run on top of, and what that base node needs to provide | 14:11 |
| yolanda | and that is the thing that concerns me. Downstream can have lots of different use cases. Firewall restriction, backups | 14:11 |
| mordred | and how to interact with it | 14:11 |
| *** tsg has quit IRC | 14:11 | |
| phschwartz | yolanda: in openstack_project we have the refactored server class that is used in manifests/site.pp to help configure the hosts into a correct state prior to the application setup on the host. This is the exact thing I am trying to bring over for downstream users to consume. No direct coupling, but an interface that they can call in their node {} | 14:12 |
| mordred | because, firewall rules being a good example - if we say "firewalls are site-specific and you'll need ot deal with them" .. how does a module communicate that it needs port X open | 14:12 |
| *** tsg has joined #openstack-infra | 14:12 | |
| mordred | or, how does the "the graphite server needs to open its ports to these 20 machines" thing work | 14:12 |
| yolanda | phschward, and yes, that's my point . In downstream we have a completely openstack_project class, with our bits. So i don't think adding these bits in third party ci is a good idea | 14:12 |
| yolanda | because these internal bits will be very different depending on environments | 14:12 |
| *** ParsectiX has joined #openstack-infra | 14:13 | |
| phschwartz | yolanda: providing a base of what is needed for the system to run and allowing the user to inherit it is the point behind puppet interfaces | 14:13 |
| yolanda | yes, but this base of openstack is not same base as downstream | 14:13 |
| yolanda | so depending on what you add there | 14:13 |
| yolanda | it can be a blocker to consume that in dowstream | 14:14 |
| e0ne | hi all! could anyone help me please: how can I disable specified feature in the tempest.conf for my job? | 14:14 |
| *** peristeri has joined #openstack-infra | 14:14 | |
| phschwartz | yolanda: exactly. That is why I want it to be as minimal as possible. Things like base server dependencies. getting the git clients installed and other minor dependencies followed by a way to allow downstream admins to manage users how we do with openstack_project::users | 14:15 |
| phschwartz | Along with a way to pass ports and firewall rules the user might want to setup | 14:15 |
| yolanda | phschwartz, so that was my point when i asked you to complete the spec with that details. To be sure that what you add there, will make sense and will not be a blocker | 14:15 |
| *** baoli has joined #openstack-infra | 14:15 | |
| yolanda | if you can define a bit more these bits, it will be helpful to review | 14:15 |
| *** ddieterly has quit IRC | 14:15 | |
| phschwartz | yolanda: will do | 14:15 |
| yolanda | take for example, manage users. That's even different downstream. We don't have system users but ldap. So depending on what you add to configure users, that will block us from reusing, and we will have to be depending on modules directly | 14:16 |
| *** alivigni has joined #openstack-infra | 14:16 | |
| *** daemontool_ has quit IRC | 14:16 | |
| *** tsg has quit IRC | 14:17 | |
| *** tsg has joined #openstack-infra | 14:17 | |
| *** daemontool_ has joined #openstack-infra | 14:17 | |
| phschwartz | yolanda: that is the beauty of puppet, if we define the user management as a passed class as a parameter then each downstream user can create a class that manages users in their own unique way, or use a base example that we would provide that uses the Openstack way. | 14:18 |
| *** gongysh__ has quit IRC | 14:18 | |
| *** bswartz has joined #openstack-infra | 14:18 | |
| *** tdurakov has joined #openstack-infra | 14:19 | |
| yolanda | puppet and beauty don't work together for me ... :) so ok, if there is that intention to modularize it, allow to create own classes, that will be great, if you can reflect these bits on the spec it will help a lot | 14:19 |
| ttx | mordred: I think the Citrix posts are coming from Mate Lakat's feed, not John's | 14:19 |
| ttx | At least that's how it shows on planet.openstack.org itself | 14:20 |
| *** tiswanso has joined #openstack-infra | 14:20 | |
| *** andreykurilin has joined #openstack-infra | 14:20 | |
| mordred | ttx: I just looked at Lakat's feed and it doesn't show non-openstack content | 14:21 |
| andreykurilin | hi everyone! Can anyone review my patch to project-config? https://review.openstack.org/#/c/240580/ | 14:21 |
| *** dkranz has joined #openstack-infra | 14:21 | |
| anteaya | yay this fridge shuts off when it reaches temp! | 14:22 |
| *** tsg has quit IRC | 14:22 | |
| *** garyk has quit IRC | 14:22 | |
| anteaya | I can hear the rain and the wind now instead of the fridge! | 14:22 |
| *** achanda has quit IRC | 14:22 | |
| flip214 | anteaya: mordred already pointed me to jeblair. issue is that some graphite pictures looks strange. | 14:23 |
| ttx | mordred: John's doesn't show non-openstack content eiehter | 14:23 |
| openstackgerrit | Merged openstack/requirements: bump upper-constraints for openstackclient to 1.9.0 https://review.openstack.org/246049 | 14:23 |
| mordred | ttx: I have no idea where that citrix post is coming from | 14:23 |
| ttx | mordred: My understanding was that Mate fixed his feed but for some reason the posts stay | 14:23 |
| flip214 | anteaya: so I think it will be taken care of, thanks a lot for asking! | 14:23 |
| *** bexelbie_ is now known as bexelbie | 14:23 | |
| ttx | mordred: If you look at planet.openstack.org directly you can see | 14:23 |
| ttx | They appear under "Mate Lakat" name | 14:23 |
| openstackgerrit | Julien Danjou proposed openstack-infra/system-config: Rename Ceilometer to Telemetry https://review.openstack.org/243020 | 14:23 |
| anteaya | flip214: glad you have what you need | 14:24 |
| mordred | ttx: ah. so it was a broken mate feed, but planet isn't purging old things | 14:24 |
| flip214 | anteaya: not yet, but there's hope ;) | 14:24 |
| ttx | ok, that makes sense | 14:24 |
| *** Daisy has quit IRC | 14:24 | |
| ttx | so your review won't really help (won't hurt either) | 14:25 |
| mordred | kk | 14:25 |
| *** Daisy has joined #openstack-infra | 14:25 | |
| *** amitgandhinz has joined #openstack-infra | 14:25 | |
| openstackgerrit | Merged openstack/requirements: bump zaqarclient version to 0.3.0 https://review.openstack.org/245994 | 14:25 |
| *** amitgandhinz has quit IRC | 14:25 | |
| *** amitgandhinz has joined #openstack-infra | 14:26 | |
| *** otter768 has joined #openstack-infra | 14:26 | |
| openstackgerrit | Ondřej Nový proposed openstack-infra/system-config: IRC channel #openstack-swauth added. https://review.openstack.org/244597 | 14:26 |
| *** dims has joined #openstack-infra | 14:27 | |
| sdague | hey, so all the old graphite queries to get fail / success rates | 14:27 |
| sdague | don't work any more | 14:27 |
| sdague | http://tinyurl.com/nn8chfn | 14:27 |
| mordred | sdague: yup | 14:28 |
| mordred | sdague: we're waiting for jeblair to wake up to talk about it | 14:28 |
| sdague | ok | 14:28 |
| *** mriedem has joined #openstack-infra | 14:28 | |
| *** flepied has joined #openstack-infra | 14:28 | |
| openstackgerrit | Anastasia Kuznetsova proposed openstack-infra/project-config: Update jobs for mistral https://review.openstack.org/246917 | 14:28 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: Set puppet versions in tripleo.sh not toci_instack.sh https://review.openstack.org/246457 | 14:28 |
| mordred | sdague: flip214 is also interested in the topic - my hypothesis is that it has something to do with the statsd config changes we made recently | 14:29 |
| sdague | right, that lines up about right | 14:29 |
| sdague | it's a change that would have landed ~40 hours ago | 14:29 |
| markvoelker | ttx: Are you sure they were correllated to Mate? Looked to me last night like they came from John: https://gist.github.com/markvoelker/716979bc263c9d1888ec | 14:29 |
| *** Daisy has quit IRC | 14:29 | |
| markvoelker | ttx: But anyway as they're both no longer at Citrix, both could probably go... | 14:30 |
| mordred | sdague: yah. ish | 14:30 |
| anteaya | ttx mordred maishsk asked about posts to the planet on tuesday: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2015-11-17.log.html#t2015-11-17T14:56:50 | 14:30 |
| sdague | yeh the 40 hours is just based on where the lines start moving there | 14:30 |
| anteaya | ttx mordred I looked and they all seemed to be under the openstack summit header | 14:30 |
| sdague | accounting for the 12 hour lag on the rolling average | 14:30 |
| anteaya | ttx mordred what was the content you found to be not openstack related? | 14:31 |
| *** otter768 has quit IRC | 14:31 | |
| mordred | anteaya: https://www.citrix.com/blogs/2015/11/17/dont-miss-workspace-cloud-sessions-at-citrix-summit-2016/ | 14:31 |
| markvoelker | anteaya: see https://gist.github.com/markvoelker/716979bc263c9d1888ec for more examples of the content | 14:31 |
| *** jyuso1 has quit IRC | 14:34 | |
| anteaya | my mistake I saw summit and read that as openstack summit | 14:34 |
| anteaya | markvoelker mordred thanks | 14:34 |
| anteaya | markvoelker: thanks for looking into this | 14:34 |
| markvoelker | anteaya: sure thing | 14:35 |
| *** zz_dimtruck is now known as dimtruck | 14:36 | |
| *** gongysh__ has joined #openstack-infra | 14:36 | |
| ttx | markvoelker: They are probably coming from both | 14:36 |
| openstackgerrit | Alexander Evseev proposed openstack-infra/zuul: Don't take into account commit message for skip-if filter https://review.openstack.org/247383 | 14:37 |
| markvoelker | ttx: Yeah, probably. I'll post a patch to clean up Mate and the corresponding images for removed blogs too. | 14:37 |
| ttx | some kind of a redirect to citrix/blogs when the feed points to a given unknown person | 14:37 |
| ttx | markvoelker: Thx, I'll stand by to approve it | 14:37 |
| *** cloudtrainme has joined #openstack-infra | 14:38 | |
| *** edmondsw has joined #openstack-infra | 14:39 | |
| markvoelker | ttx: https://review.openstack.org/247547 | 14:40 |
| *** glauco has joined #openstack-infra | 14:41 | |
| *** tongli has joined #openstack-infra | 14:41 | |
| *** krtaylor has quit IRC | 14:42 | |
| *** cloudtrainme has quit IRC | 14:43 | |
| *** rellerreller has joined #openstack-infra | 14:43 | |
| *** binbincong has quit IRC | 14:43 | |
| rellerreller | Dumb question, where can I find the web page for this README that has recently merged? https://review.openstack.org/#/c/227584/ | 14:44 |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config: swap 3 tempest jobs for 1 layer4 jumbo job https://review.openstack.org/247550 | 14:44 |
| rellerreller | I would rather read online as opposed to the review.openstack view, but I do not know how the pages are mapped. | 14:44 |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add new experimental Tempest job for Manila https://review.openstack.org/247551 | 14:44 |
| *** ddieterly has joined #openstack-infra | 14:45 | |
| *** auggy has quit IRC | 14:45 | |
| *** glauco has quit IRC | 14:46 | |
| *** zxiiro has quit IRC | 14:46 | |
| *** GheRivero has quit IRC | 14:46 | |
| *** dizquierdo has joined #openstack-infra | 14:46 | |
| *** monester has quit IRC | 14:46 | |
| *** rguillebert has quit IRC | 14:47 | |
| *** dtardivel has quit IRC | 14:47 | |
| *** teran has quit IRC | 14:47 | |
| *** ashtokolov has quit IRC | 14:47 | |
| *** romcheg has quit IRC | 14:47 | |
| *** jed56 has quit IRC | 14:47 | |
| *** jpmaxman has quit IRC | 14:47 | |
| *** zns has quit IRC | 14:48 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add new experimental Tempest job for Manila https://review.openstack.org/247551 | 14:48 |
| nibalizer | mordred: when does the [user] section of puppet.conf come in to play? | 14:48 |
| nibalizer | i've never seen that before | 14:48 |
| nibalizer | in 241495/ | 14:48 |
| anteaya | rellerreller: http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/contrib/README.md | 14:48 |
| *** pradk has joined #openstack-infra | 14:49 | |
| rellerreller | anteaya thanks! That will definitely work. I kept looking for something in docs.openstack.org. | 14:49 |
| openstackgerrit | Philip Marc Schwartz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work https://review.openstack.org/239810 | 14:50 |
| phschwartz | yolanda: ^ | 14:51 |
| anteaya | rellerreller: understandable | 14:51 |
| anteaya | rellerreller: and you're welcome | 14:51 |
| yolanda | phschwartz, i need to go now, but i'll take a look today, thanks | 14:51 |
| *** markus_z has joined #openstack-infra | 14:51 | |
| *** lykinsbd has joined #openstack-infra | 14:51 | |
| *** glauco_ has joined #openstack-infra | 14:52 | |
| *** Swami has joined #openstack-infra | 14:52 | |
| *** jed56 has joined #openstack-infra | 14:54 | |
| *** jpmaxman has joined #openstack-infra | 14:54 | |
| *** krtaylor has joined #openstack-infra | 14:55 | |
| *** rpodolyaka1 has quit IRC | 14:56 | |
| openstackgerrit | Merged openstack/requirements: ignore oslosphinx 3.4.0 and use 3.4.1 https://review.openstack.org/246078 | 14:56 |
| openstackgerrit | Merged openstack/requirements: Bump oslo.config >=2.7.0 https://review.openstack.org/246294 | 14:56 |
| *** GheRivero has joined #openstack-infra | 14:56 | |
| *** ashtokolov has joined #openstack-infra | 14:57 | |
| *** zxiiro has joined #openstack-infra | 14:57 | |
| *** rpodolyaka1 has joined #openstack-infra | 14:58 | |
| *** monester has joined #openstack-infra | 14:58 | |
| *** dtardivel has joined #openstack-infra | 14:58 | |
| *** ParsectiX has quit IRC | 14:58 | |
| pabelanger | yolanda: do you have a moment to approve some grafyaml reviews? https://review.openstack.org/#/q/status:open+project:openstack-infra/grafyaml,n,z | 15:01 |
| mriedem | fungi: anteaya: per http://docs.openstack.org/infra/manual/creators.html and "Note that only official OpenStack projects may use certain parts of the OpenStack infrastructure, especially the docs.openstack.org and specs.openstack.org server.", | 15:01 |
| mriedem | fungi: anteaya: i assume that anything that's in the openstack namespace is now an official project? | 15:01 |
| mriedem | and can publish to docs.o.o? | 15:01 |
| anteaya | mriedem: no | 15:01 |
| anteaya | if it is in the governance repo it is official | 15:02 |
| *** Guest91492 is now known as nadya_ | 15:02 | |
| *** auggy has joined #openstack-infra | 15:02 | |
| *** Daisy has joined #openstack-infra | 15:02 | |
| anteaya | mriedem: canonical list of official projects: http://git.openstack.org/cgit/openstack/governance/tree/reference/projects.yaml | 15:02 |
| *** teran has joined #openstack-infra | 15:03 | |
| mordred | nibalizer: puppet apply | 15:03 |
| mriedem | anteaya: ok, so i'm asking about powervm for thorst, and i see they have that for neutron http://git.openstack.org/cgit/openstack/governance/tree/reference/projects.yaml#n2007 | 15:03 |
| *** glauco___ has joined #openstack-infra | 15:03 | |
| mriedem | b/c of stadium | 15:03 |
| *** rcernin has quit IRC | 15:03 | |
| mriedem | but for nova, i guess the nova team would have to agree on that | 15:03 |
| mriedem | since there isn't a nova stadium | 15:03 |
| sdague | codesearch.openstack.org just went down? | 15:03 |
| sdague | I get a 503 service unavailable | 15:04 |
| mordred | nibalizer: https://docs.puppetlabs.com/puppet/3.8/reference/config_file_main.html ". | 15:04 |
| mordred | user is used by the Puppet apply command, as well as many of the less common Puppet subcommands." | 15:04 |
| sdague | mriedem: right | 15:04 |
| anteaya | mriedem: I don't know what powervm for thorst is but if nova wants something to access those services, it offers a patch to governance for that repo | 15:04 |
| thorst | it is a new virt driver that we're proposing | 15:05 |
| thorst | for compute | 15:05 |
| anteaya | oh thorst is a person | 15:05 |
| mordred | sdague: I agree - I also get a 503 | 15:05 |
| *** rguillebert has joined #openstack-infra | 15:05 | |
| mriedem | anteaya: well, the jury is out on that yet | 15:05 |
| *** _amrith_ is now known as amrith | 15:05 | |
| mriedem | thorstbot | 15:05 |
| sdague | ok, so that makes the 3rd piece of infra I've tripped over being broken this morning | 15:06 |
| mordred | sdague: I think it may have just gotten restarted and it takes a jiff for it to restart all its stuff | 15:06 |
| sdague | I think I need to get up and go for a walk | 15:06 |
| thorst | lol Not a bot yet... | 15:06 |
| anteaya | mriedem: oh okay, well whatever/whoever thorst is | 15:06 |
| *** romcheg has joined #openstack-infra | 15:06 | |
| mordred | sdague: we've got a patch to hound coming to not need a restart on config changes | 15:06 |
| anteaya | sdague: I went for a walk this morning | 15:06 |
| *** glauco_ has quit IRC | 15:06 | |
| *** tdurakov has quit IRC | 15:06 | |
| anteaya | sdague: cleared my head and made me realize I needed to ask mordred something, it really helped | 15:07 |
| anteaya | thorst: you know there are already some drivers called powervm? | 15:07 |
| *** Liuqing has quit IRC | 15:07 | |
| mordred | sdague: codesearch is back | 15:07 |
| anteaya | it seems to be a popular name | 15:07 |
| mordred | sdague: sorry for the inconvenience | 15:07 |
| mriedem | anteaya: it's the same | 15:07 |
| anteaya | like region one | 15:07 |
| thorst | anteaya: there was a powervm one. That was pulled :-( | 15:07 |
| anteaya | mriedem: oh okay | 15:08 |
| thorst | but this is one that we've been working for a year | 15:08 |
| mriedem | http://git.openstack.org/cgit/openstack/nova-powervm/ | 15:08 |
| thorst | and have networking-powervm, ceilometer-powervm, etc... | 15:08 |
| mriedem | well, powervm 2.0 | 15:08 |
| anteaya | thorst: as long as you know, oh okay | 15:08 |
| thorst | yep | 15:08 |
| anteaya | alright | 15:08 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 15:08 | |
| sdague | mordred: ok, thanks | 15:08 |
| mriedem | anteaya: so the chicken/egg is they are out of tree and part of getting in tree from the nova team is showing they have users, and part of having users is having published docs, but they can't use docs.o.o w/o being blessed by nova | 15:09 |
| sdague | I'm stumped getting to the bottom of this one: | 15:09 |
| sdague | 2015-11-19 12:22:44.315 7578 WARNING oslo_config.cfg [-] Option "username" from group "nova" is deprecated. Use option "user-name" from group "nova". | 15:09 |
| anteaya | mriedem: it sounds like a fun one | 15:09 |
| sdague | if you actually make the change suggested, it explodes | 15:09 |
| mriedem | anteaya: yeah, it might be a blackhole by design | 15:09 |
| sdague | so we are issuing a deprecation with instructions to destroy your cloud | 15:09 |
| anteaya | mriedem: we seem to be growing that genre | 15:09 |
| dims | sdague https://bugs.launchpad.net/oslo.config/+bug/1438314 | 15:10 |
| openstack | Launchpad bug 1438314 in oslo.config "Option "username" from group "keystone_authtoken" is deprecated. Use option "username" from group "keystone_authtoken"." [Medium,Fix released] - Assigned to Ben Nemec (bnemec) | 15:10 |
| jroll | mriedem: there are ways to publish docs besides docs.o.o :P | 15:10 |
| dims | already fixed | 15:10 |
| anteaya | mriedem: just so you know they don't have to be in tree to be listed in governance/projects.yaml | 15:10 |
| sdague | dims: but not released? | 15:10 |
| anteaya | mriedem: from the tc perspective | 15:10 |
| anteaya | mriedem: not sure if that helps or makes things worse | 15:10 |
| mriedem | anteaya: but who decides on if they get in projects.yaml? | 15:10 |
| thorst | anteaya: we would need the nova PTL sign off on that right? That's what was required for ceilometer and neutron | 15:11 |
| anteaya | mriedem: nova offers the patch if they want it in there | 15:11 |
| dims | sdague : where do you see it? | 15:11 |
| sdague | in every run | 15:11 |
| nibalizer | mordred: that makes no sense | 15:11 |
| anteaya | mriedem: the tc approves the patch, which they will do if the ptl of the project wants it | 15:11 |
| sdague | in every service | 15:11 |
| anteaya | mriedem: and noone has a reason to object | 15:11 |
| dims | sdague : ack will look for it | 15:11 |
| mriedem | jroll: what did you have in mind? read the docs? | 15:11 |
| mordred | nibalizer: what do you mean? | 15:12 |
| anteaya | mriedem: I can't think of a time the tc objected to something a project wanted to have under its umbrella | 15:12 |
| thorst | mriedem: should I ask to add this to the next Nova IRC meeting? | 15:12 |
| mordred | nibalizer: oh, the naming? yeah. it's terrible | 15:12 |
| anteaya | mriedem: the tc doesn't care if it is in tree or not | 15:12 |
| jroll | mriedem: yeah, that's an option. I know other projects not in governance have puvlished there | 15:12 |
| mriedem | thorst: sure, which is today | 15:12 |
| sdague | dims: user-name definitely does not work | 15:12 |
| anteaya | mriedem: just if the project wants it | 15:12 |
| mriedem | anteaya: right | 15:12 |
| mordred | nibalizer: I think it makes sense to my brain because it's similar to how my.cnf works for mysql | 15:12 |
| nibalizer | i was farting with [apply] | 15:12 |
| dims | sdague : ack | 15:12 |
| nibalizer | and it didn't work so im glad you figured it out | 15:12 |
| *** Daisy has quit IRC | 15:12 | |
| sdague | and the bug says that it does | 15:12 |
| thorst | mriedem: I'll add it to the etherpad. Thanks anteaya as well | 15:13 |
| *** eharney has joined #openstack-infra | 15:13 | |
| mordred | me too - I was going to be sad if we had to do the cut-everytihng-over-right-now-kthxbai | 15:13 |
| *** tdurakov has joined #openstack-infra | 15:13 | |
| sdague | so I don't understand why that's fixed released | 15:13 |
| anteaya | thorst: it is up to nova | 15:13 |
| *** tdurakov has quit IRC | 15:13 | |
| openstackgerrit | Zara proposed openstack-infra/storyboard: Mention upgrading in heading https://review.openstack.org/247562 | 15:13 |
| thorst | anteaya: understood | 15:13 |
| anteaya | thorst: thanks | 15:13 |
| sdague | dims: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message:%5C%22Option%20%5C%5C%5C%22username%5C%5C%5C%22%20from%20group%20%5C%5C%5C%22nova%5C%5C%5C%22%20is%20deprecated.%20Use%20option%20%5C%5C%5C%22user-name%5C%5C%5C%22%20from%20group%20%5C%5C%5C%22nova%5C%5C%5C%22%20%5C%22 | 15:13 |
| mriedem | thorst: you probably want to start checking out publishing to readthedocs.org | 15:13 |
| mordred | sdague: user-name will work once nova uses either keystoneclient (not good idea) or keystoneauth (good idea) for all of its conections to other things | 15:13 |
| *** rbrndt has joined #openstack-infra | 15:13 | |
| sdague | 13k hits in logstash for the last 7 days | 15:14 |
| sdague | mordred: we're telling everyone to change it | 15:14 |
| sdague | but then it doesn't work | 15:14 |
| mordred | sdague: yeah. that's not a good idea | 15:14 |
| mordred | sdague: because literally nothing has migrated to using keystoneauth yet | 15:14 |
| *** zhurong has quit IRC | 15:14 | |
| *** Daisy has joined #openstack-infra | 15:14 | |
| sdague | right, so this is face punchingly bad | 15:14 |
| sdague | if you issue a WARNING in the logs with "remove it by doing X" and X breaks the world. wtf. | 15:15 |
| mordred | also, honest to god - changing username to user-name at this point in life is bong - but as long as both continue to work (which both will) - I honestly don't understand why we'd issue a deprecation | 15:15 |
| sdague | mordred: I also agree it's a massively dumb change | 15:15 |
| mordred | sdague: the reasoning is "all the other compound words have - separators" | 15:15 |
| mriedem | host-name? | 15:16 |
| sdague | pass-word ? | 15:16 |
| mriedem | butt-f*? | 15:16 |
| mordred | sdague: I didn't say I agreed | 15:16 |
| sdague | that is litterally the most baffling thing I've heard this month | 15:16 |
| mordred | dims: you said this was fixed already in oslo-config ? | 15:16 |
| *** mkwiek07 has quit IRC | 15:17 | |
| bnemec | The only thing that was fixed in oslo.config was that the deprecation was reported incorrectly. | 15:17 |
| bnemec | It was telling people to change from "username" to "username", which is also nonsense. | 15:17 |
| mordred | bnemec: where is the deprecation itself coming from? | 15:17 |
| sdague | bnemec: but at least that would result in a working config | 15:17 |
| sdague | now it's telling them to make a broken config | 15:17 |
| bnemec | I'm trying to find where the opt is actually defined. | 15:17 |
| mordred | is nova actually using keystoneclient? | 15:17 |
| sdague | I do not consider that fixed | 15:18 |
| *** EricGonczer_ has joined #openstack-infra | 15:19 | |
| *** Zhongjun has joined #openstack-infra | 15:19 | |
| bnemec | sdague: mordred: I think it was coming from here: https://github.com/openstack/python-keystoneclient/blob/5dea3b22fcc672f3e3405f5abec471929c501c0a/keystoneclient/auth/identity/generic/password.py#L29 | 15:19 |
| sdague | typically not directly iirc but we use a bunch of other clients | 15:20 |
| sdague | yeh, can we just freaking alias username to user-name and be done with it | 15:20 |
| *** tonytan4ever has joined #openstack-infra | 15:21 | |
| openstackgerrit | Pedro Alvarez Piedehierro proposed openstack-infra/storyboard: Fix indentation docs https://review.openstack.org/247570 | 15:21 |
| sdague | will note the internal storage var for this is still username | 15:21 |
| *** timrc has quit IRC | 15:21 | |
| *** ccrouch has joined #openstack-infra | 15:21 | |
| sdague | clearly it's not too confusing to not have the - for keystoneclient code - https://github.com/openstack/python-keystoneclient/blob/5dea3b22fcc672f3e3405f5abec471929c501c0a/keystoneclient/auth/identity/generic/password.py#L53-L57 | 15:21 |
| mordred | yes | 15:21 |
| mordred | bnemec: you are correct | 15:21 |
| mordred | sdague: I'm working on a patch | 15:21 |
| sdague | mordred: thanks | 15:21 |
| *** yonglihe has joined #openstack-infra | 15:22 | |
| *** pcrews has quit IRC | 15:22 | |
| *** pcrews has joined #openstack-infra | 15:23 | |
| *** tsg has joined #openstack-infra | 15:23 | |
| *** timrc has joined #openstack-infra | 15:24 | |
| mordred | sdague: https://review.openstack.org/247574 | 15:25 |
| mordred | bnemec, dims: ^^ | 15:25 |
| *** Piet has joined #openstack-infra | 15:25 | |
| *** sergmelikyan has quit IRC | 15:25 | |
| mordred | sdague: (just updated to fix unittest) | 15:26 |
| *** ajmiller has joined #openstack-infra | 15:29 | |
| phschwartz | For gerrit are we using mysql local to the gerrit host or on a separate server | 15:29 |
| *** kiran-r has quit IRC | 15:30 | |
| mordred | trove | 15:30 |
| mordred | (so separate server) | 15:30 |
| *** cloudtrainme has joined #openstack-infra | 15:31 | |
| *** Daisy has quit IRC | 15:31 | |
| flaper87 | Folks, I need to disable the oslo.messaging qpid job from master on. Is modifying the layout file enough? | 15:33 |
| flaper87 | it'll eventually go away | 15:33 |
| * flaper87 always forgets how to do this | 15:33 | |
| *** marcusvrn_ has joined #openstack-infra | 15:33 | |
| *** sergmelikyan has joined #openstack-infra | 15:34 | |
| *** EricGonc_ has joined #openstack-infra | 15:34 | |
| *** test has joined #openstack-infra | 15:36 | |
| *** test has quit IRC | 15:36 | |
| *** EricGonczer_ has quit IRC | 15:37 | |
| e0ne | hi. how can I change tempest.conf only for my job? | 15:38 |
| *** sergmelikyan has quit IRC | 15:39 | |
| *** FallenPegasus has joined #openstack-infra | 15:39 | |
| ihrachys | fungi: https://review.openstack.org/245525 please. | 15:41 |
| mriedem | question about the note on step 3 here: http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-projects-list | 15:41 |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config: Disable qpid's jobs as it's now deprecated https://review.openstack.org/247587 | 15:41 |
| ihrachys | fungi: that's the same periodic jobs story | 15:41 |
| mriedem | patches in gerrit don't update bug status for glance-store in launchpad | 15:41 |
| mriedem | b/c it's glance_store in git, | 15:41 |
| mriedem | and glance-store in launchpad | 15:41 |
| *** nmagnezi has quit IRC | 15:42 | |
| mriedem | that note in http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-projects-list says to make sure the 'groups' is set, which it is for glance_store in projects.yaml, it's set to -glance | 15:42 |
| mriedem | https://github.com/openstack-infra/project-config/blob/master/gerrit/projects.yaml#L1587 | 15:42 |
| mriedem | is there another way to provide the git->launchpad name mapping? | 15:42 |
| mriedem | or does the launchpad project need to be renamed? | 15:42 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/247590 | 15:43 |
| *** jaypipes has joined #openstack-infra | 15:43 | |
| *** FallenPegasus has quit IRC | 15:43 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/247597 | 15:44 |
| *** achanda has joined #openstack-infra | 15:45 | |
| *** fawadkhaliq has joined #openstack-infra | 15:47 | |
| *** burgerk has joined #openstack-infra | 15:47 | |
| *** tdurakov_ has joined #openstack-infra | 15:49 | |
| *** zeih has quit IRC | 15:49 | |
| smarcet | clarkb:mordred: morning , could u review please https://review.openstack.org/#/c/245394/ ? thx :) | 15:50 |
| *** rpodolyaka1 has quit IRC | 15:53 | |
| *** angdraug has joined #openstack-infra | 15:53 | |
| *** harlowja_at_home has joined #openstack-infra | 15:53 | |
| *** fhubik has quit IRC | 15:55 | |
| *** rpodolyaka1 has joined #openstack-infra | 15:56 | |
| *** tdurakov_ has quit IRC | 15:57 | |
| dims | mordred : sdague : stevemar_ : +1 to https://review.openstack.org/#/c/247574/ | 15:58 |
| dims | stevemar_ : let's get a release out when possible :) | 15:58 |
| mordred | smarcet: lgtm - I love removing code | 15:58 |
| *** rellerreller has quit IRC | 15:59 | |
| *** tsg has quit IRC | 15:59 | |
| *** glauco___ has quit IRC | 15:59 | |
| *** tsg has joined #openstack-infra | 16:00 | |
| *** tiswanso has quit IRC | 16:01 | |
| *** sabeen1 has joined #openstack-infra | 16:02 | |
| *** zul has quit IRC | 16:02 | |
| *** Guest64159 is now known as tdurakov | 16:02 | |
| *** tiswanso has joined #openstack-infra | 16:02 | |
| *** k4n0 has quit IRC | 16:02 | |
| *** tdurakov_ has joined #openstack-infra | 16:02 | |
| *** placko_ has quit IRC | 16:02 | |
| *** zul has joined #openstack-infra | 16:04 | |
| mordred | flaper87: I thought qpid got itself undeprecated | 16:05 |
| mordred | flaper87: is it back to deprecated? | 16:05 |
| mordred | flaper87: oh, or was that 0mq I was thinking about | 16:05 |
| flaper87 | mordred: that was 0mq | 16:05 |
| mordred | nod | 16:05 |
| mordred | flaper87: also, sdague's comment on your patch is correct | 16:06 |
| *** yamahata has joined #openstack-infra | 16:06 | |
| mordred | flaper87: you only need the one entry which says "please only run this job on stable branches" | 16:06 |
| dims | sdague : worked with jeblair and clarkb 's suggestions and ended up with this review for the "run oslo.config master review with stable/liberty" - https://review.openstack.org/#/c/247188/ when you get a chance | 16:06 |
| dims | sdague don't know how to test it as the change is a snippet in the job template | 16:07 |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config: Disable qpid's jobs as it's now deprecated https://review.openstack.org/247587 | 16:07 |
| *** dprince has quit IRC | 16:07 | |
| flaper87 | mordred: sdague ^ thanks :D | 16:07 |
| *** Swami has quit IRC | 16:08 | |
| *** amuller has quit IRC | 16:08 | |
| *** yfried has quit IRC | 16:08 | |
| *** ildikov has quit IRC | 16:09 | |
| *** amuller has joined #openstack-infra | 16:09 | |
| mordred | dims, dhellmann: where do we document projected EOL date for a stable release? | 16:10 |
| *** amuller has quit IRC | 16:10 | |
| mordred | there's great docs now on current status of all of th ethings | 16:10 |
| *** amuller has joined #openstack-infra | 16:10 | |
| mordred | but answering the question "when does juno DIAF?" I'm finding hard | 16:10 |
| *** ddieterl_ has joined #openstack-infra | 16:11 | |
| dims | mordred https://wiki.openstack.org/wiki/Releases should be current trying to move stuff from there to the url link in that page | 16:11 |
| mordred | dims: sure - but that doesn't have an EOL date - just the current status of the releases | 16:12 |
| *** glauco has joined #openstack-infra | 16:12 | |
| mordred | dims: so it shows that juno is currently security supported, but not when I can expect that to stop being the case | 16:13 |
| *** sergmelikyan has joined #openstack-infra | 16:14 | |
| dims | mordred right, a mega thread is talking about it right now (http://markmail.org/message/s7wgqths54qoqjhb). let me check if a date was published | 16:14 |
| mordred | oh - that thread | 16:14 |
| mordred | I stopped paying attention to that - it's still going? | 16:14 |
| mordred | oh! tony as declared it dead | 16:15 |
| mordred | awesome | 16:15 |
| *** ddieterly has quit IRC | 16:15 | |
| notmorgan | ooh yay dead release. | 16:16 |
| mordred | ttx: do you happen to remember or have written down projected drop-dead dates for juno and kilo? I'd like to make a patch to the releases repo so that it's documented | 16:17 |
| ddieterl_ | is there a irc room for asking questions about tempest? | 16:17 |
| *** ddieterl_ is now known as ddieterly | 16:17 | |
| mordred | ddieterly: #openstack-qa | 16:17 |
| ddieterly | thnanks | 16:18 |
| *** placko_ has joined #openstack-infra | 16:18 | |
| *** armax has joined #openstack-infra | 16:18 | |
| *** annegentle has joined #openstack-infra | 16:19 | |
| *** fawadkhaliq has quit IRC | 16:19 | |
| *** fawadkhaliq has joined #openstack-infra | 16:20 | |
| *** acruz has quit IRC | 16:20 | |
| openstackgerrit | Merged openstack-infra/storyboard: Fix indentation docs https://review.openstack.org/247570 | 16:21 |
| *** ildikov has joined #openstack-infra | 16:23 | |
| *** gongysh__ has quit IRC | 16:23 | |
| *** tdurakov_ has quit IRC | 16:24 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Add a page to view a worklist https://review.openstack.org/232003 | 16:24 |
| openstackgerrit | Philip Marc Schwartz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work https://review.openstack.org/239810 | 16:25 |
| phschwartz | jswarren: mordred: moravec: ^ | 16:25 |
| phschwartz | thoughts would be appreciated | 16:26 |
| phschwartz | asselin: yolanda: from you guys too. | 16:26 |
| *** otter768 has joined #openstack-infra | 16:27 | |
| *** dizquierdo has quit IRC | 16:28 | |
| *** fawadkhaliq has quit IRC | 16:29 | |
| *** otter768 has quit IRC | 16:32 | |
| *** EricGonc_ has quit IRC | 16:33 | |
| *** sabeen2 has joined #openstack-infra | 16:34 | |
| *** ihrachys has quit IRC | 16:34 | |
| *** sshnaidm has quit IRC | 16:34 | |
| *** tdurakov_ has joined #openstack-infra | 16:34 | |
| *** sabeen1 has quit IRC | 16:38 | |
| *** kozhukalov_ has quit IRC | 16:38 | |
| *** kozhukalov_ has joined #openstack-infra | 16:39 | |
| *** annegentle has quit IRC | 16:40 | |
| *** tdurakov_ has quit IRC | 16:41 | |
| *** tsg_ has joined #openstack-infra | 16:41 | |
| *** bpokorny has joined #openstack-infra | 16:42 | |
| *** tsg has quit IRC | 16:43 | |
| *** annegentle has joined #openstack-infra | 16:44 | |
| *** EricGonczer_ has joined #openstack-infra | 16:45 | |
| *** sdake has joined #openstack-infra | 16:45 | |
| *** shashank_hegde has joined #openstack-infra | 16:47 | |
| jeblair | sdague: 245745 +2 | 16:47 |
| sdague | jeblair: thanks | 16:49 |
| flip214 | jeblair: graphite does strange graphs, have you heard about that already? | 16:49 |
| *** annegentle has quit IRC | 16:49 | |
| flip214 | since ~48h | 16:49 |
| *** e0ne has quit IRC | 16:49 | |
| sdague | jeblair: yeh, all the previous methods for determining failure rates have seemed to no longer work | 16:49 |
| sdague | http://tinyurl.com/nn8chfn as an example | 16:50 |
| *** fawadkhaliq has joined #openstack-infra | 16:50 | |
| *** tonytan4ever has quit IRC | 16:50 | |
| openstackgerrit | Merged openstack-dev/hacking: Updated from global requirements https://review.openstack.org/247590 | 16:51 |
| *** harlowja_at_home has quit IRC | 16:51 | |
| *** jlk has quit IRC | 16:51 | |
| *** jlk has joined #openstack-infra | 16:51 | |
| *** gyee has joined #openstack-infra | 16:51 | |
| *** placko__ has joined #openstack-infra | 16:51 | |
| *** jlk has quit IRC | 16:51 | |
| *** jlk has joined #openstack-infra | 16:51 | |
| *** sridhar_ram has joined #openstack-infra | 16:53 | |
| *** placko_ has quit IRC | 16:54 | |
| jeblair | flip214, sdague: yes, we told statsd to stop storing 0s when it doesn't have data because 99% of our graphite traffic was storing 0s for things that didn't happen. :) you can get the old behavior back by adding "&drawNullAsZero=true" to the graph | 16:56 |
| openstackgerrit | Anastasia Kuznetsova proposed openstack-infra/project-config: Update jobs for mistral https://review.openstack.org/246917 | 16:57 |
| *** glauco__ has joined #openstack-infra | 16:57 | |
| pleia2 | have to bring my fluffy critters to the vet, will bbiab | 16:57 |
| jeblair | flip214, sdague: also, now that we have a grafana at http://grafana.openstack.org/ you might be interested in defining some dashboards here: http://git.openstack.org/cgit/openstack-infra/project-config/tree/grafana | 16:58 |
| *** glauco has quit IRC | 17:00 | |
| *** ihrachys has joined #openstack-infra | 17:00 | |
| *** wuhg has quit IRC | 17:01 | |
| hashar | well done :-} | 17:02 |
| *** nadya_ has quit IRC | 17:02 | |
| hashar | jeblair: our is https://grafana.wikimedia.org/dashboard/db/releng-zuul :-} | 17:02 |
| *** abregman is now known as abregman|mtg | 17:03 | |
| jeblair | hashar: nice! pabelanger, timrc: ^ | 17:03 |
| *** rpodolyaka1 has quit IRC | 17:03 | |
| *** tonytan4ever has joined #openstack-infra | 17:03 | |
| hashar | also you might want to look at how your graphite/influxdb whatever backend aggregate data | 17:03 |
| hashar | after X days | 17:03 |
| hashar | it by default use average to compose the aggregate | 17:03 |
| hashar | so if you have a metric of counts per 5 minutes | 17:03 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Add NodeJS and NPM to single-use-slave https://review.openstack.org/242161 | 17:04 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added NPM Mirror to Infra https://review.openstack.org/235617 | 17:04 |
| hashar | the 1 hour aggregate will be the average of the 5 Minutes slots | 17:04 |
| hashar | instead of the slot | 17:04 |
| *** shashank_hegde has quit IRC | 17:04 | |
| hashar | typically, look at http://grafana.openstack.org/dashboard/db/zuul-status?panelId=6&fullscreen for a month | 17:04 |
| hashar | the number of jobs launcher drop for data older than 10 days :-( | 17:04 |
| hashar | the number of jobs launched drops for data older than 10 days :-( | 17:04 |
| jeblair | hashar: yeah, i have the stats_counts tree set to aggregate with 'sum', and the rest as average | 17:04 |
| hashar | and some time you want to define several aggregates, such as min/max | 17:05 |
| sc68cal | sdague: could I get you to review the multinode grenade patch for neutron? https://review.openstack.org/#/c/245862/ | 17:05 |
| hashar | but for a daily view, dont bother :} | 17:05 |
| jeblair | hashar: do you know about grafyaml? | 17:05 |
| *** angdraug has quit IRC | 17:05 | |
| hashar | jeblair: yup pabelanger told me about grafyaml already | 17:05 |
| jeblair | cool | 17:06 |
| openstackgerrit | Sahdev Zala proposed openstack-infra/project-config: Publish tosca-parser doc on openstack docs https://review.openstack.org/247686 | 17:06 |
| hashar | would have been useful to maintain the graph via puppet, but then our puppet is babysitter by only a few people | 17:06 |
| *** jlanoux has quit IRC | 17:06 | |
| *** cloudtra_ has joined #openstack-infra | 17:06 | |
| *** achanda has quit IRC | 17:06 | |
| hashar | so instead we have two grafana installs. One which is public and readonly, another private which has authentication and give us write access | 17:06 |
| *** cloudtrainme has quit IRC | 17:06 | |
| hashar | so we build the graphs on the admin grafana directly in the web UI. No reviews! | 17:06 |
| *** yfried has joined #openstack-infra | 17:07 | |
| mordred | that sounds terrible - you have to click a web ui to build a ting? :) | 17:07 |
| *** FallenPegasus has joined #openstack-infra | 17:07 | |
| openstackgerrit | Glauco Oliveira proposed openstack-infra/puppet-openstack_health: Update default api configurations https://review.openstack.org/247492 | 17:07 |
| *** rossella_s has quit IRC | 17:07 | |
| jeblair | hashar: we pulled the config files for things like that out of our pupppet repo into its own repo so that reviewers aren't 'puppet' reviewers, they are subject matter reviewers | 17:07 |
| *** timrc has quit IRC | 17:07 | |
| hashar | mordred: yeah this way "product managers" that have no clue how git / puppet works can build their own graphs easily :-} | 17:07 |
| hashar | and you get instant result instead of waiting for reviews hehe | 17:08 |
| *** rossella_s has joined #openstack-infra | 17:08 | |
| *** annegentle has joined #openstack-infra | 17:08 | |
| openstackgerrit | Sahdev Zala proposed openstack-infra/project-config: Publish tosca-parser doc on openstack docs https://review.openstack.org/247686 | 17:08 |
| jeblair | also, i think review for graphs is a really good idea -- statistics are hard. | 17:08 |
| jeblair | people can use all the help they can get :) | 17:08 |
| *** achanda has joined #openstack-infra | 17:08 | |
| hashar | yup | 17:08 |
| *** dtantsur is now known as dtantsur|afk | 17:09 | |
| hashar | potentially,one proposing a patch to a Grafyaml definition could have a dashboard created just for reviews purposes. Kind of like Sphinx doc being generated on patchset proposals | 17:09 |
| hashar | that would surely help reviewing such graphs changes. | 17:09 |
| *** achanda has quit IRC | 17:09 | |
| *** kozhukalov_ has quit IRC | 17:09 | |
| flip214 | jeblair: thanks, still is different from the previous view (scaling) - but doesn't matter. | 17:10 |
| flip214 | is there a way to move from graphite to graphana? | 17:10 |
| *** dprince has joined #openstack-infra | 17:10 | |
| hashar | oh and grafana supports template and parameters. I build a dashboard that give you a view for a given server https://grafana.wikimedia.org/dashboard/db/server-board (look at top for server: acamar, that let you change the server and thus update the underlying statsd metrics) | 17:11 |
| jeblair | flip214: graphana is a frontend to graphite -- you can just take your existing graph definition and put it in a yaml file in project-config | 17:11 |
| hashar | so in theory, you could replace cacti :-} | 17:11 |
| *** mahatic has quit IRC | 17:13 | |
| *** timrc has joined #openstack-infra | 17:13 | |
| *** apoorvad has joined #openstack-infra | 17:13 | |
| *** jistr has quit IRC | 17:14 | |
| *** stevemar_ has quit IRC | 17:14 | |
| clarkb | hashar: is that using collectd on the server? | 17:14 |
| openstackgerrit | Philip Marc Schwartz proposed openstack-infra/infra-specs: Add extension to openstackci for next phase of work https://review.openstack.org/239810 | 17:14 |
| hashar | clarkb: diamond a python daemon on all servers | 17:14 |
| hashar | clarkb: it sends to statsd and we can then graph / alarm etc | 17:15 |
| jeblair | flip214: do you remember if, several days ago, the scale of that graph was up to 1 or 2, or was it .125 or .25? | 17:15 |
| jeblair | flip214: (i see that it changes starting a few days ago, but im wondering if you looked at it 3 days ago would it have looked like the low values on the left or the high values on the right) | 17:15 |
| *** Swami has joined #openstack-infra | 17:15 | |
| hashar | clarkb: and one can write its own collectors https://github.com/wikimedia/operations-puppet/tree/production/modules/diamond/files/collector | 17:15 |
| *** mahatic has joined #openstack-infra | 17:16 | |
| *** harlowja_at_home has joined #openstack-infra | 17:16 | |
| *** acruz has joined #openstack-infra | 17:16 | |
| *** placko__ has quit IRC | 17:16 | |
| *** stevemar_ has joined #openstack-infra | 17:20 | |
| jeblair | that sounds nice | 17:20 |
| pabelanger | jeblair: hashar: Ya, used influxdb before, found it easy to use. Would be interested in seeing if we could use it here in -infra | 17:21 |
| jeblair | pabelanger: why? | 17:21 |
| hashar | we use carbon afaik | 17:21 |
| hashar | I don't think there is any plan to look at influxdb | 17:22 |
| pabelanger | jeblair: of the top of my a 2nd backup source to carbon. Since we have OOM issues all the time | 17:22 |
| pabelanger | or even a replacement | 17:22 |
| jeblair | pabelanger: we do not have oom issues anymore | 17:22 |
| hashar | a floating idea was to have statsd proxy associated with different carbon instances to help scale | 17:22 |
| flip214 | jeblair: previously, it was 0.125 and similar.... | 17:22 |
| pabelanger | jeblair: Oh? we found the problem? | 17:23 |
| flip214 | it doesn't hurt to have it at 1. | 17:23 |
| jeblair | pabelanger: i did | 17:23 |
| *** sambetts is now known as sambetts-afk | 17:23 | |
| pabelanger | nice | 17:23 |
| pabelanger | didn't know that | 17:23 |
| jeblair | pabelanger: http://cacti.openstack.org/cacti/graph.php?action=zoom&local_graph_id=443&rra_id=2&view_type=&graph_start=1447348995&graph_end=1447953795 | 17:23 |
| pabelanger | jeblair: Woah | 17:23 |
| pabelanger | that's a little impressive | 17:23 |
| hashar | bye bye memory leak | 17:23 |
| pabelanger | jeblair: what was the fix? | 17:23 |
| pabelanger | hashar: Ya, I want to look at some of your graphs and see what we can import here too :) | 17:24 |
| *** glauco__ has quit IRC | 17:24 | |
| jeblair | pabelanger: almost no configuration of either statsd or carbon has ever happened on our systems. i did some. | 17:25 |
| rhallisey | Can I ask for a review on tripleo-docker gating job? https://review.openstack.org/#/c/238475/ | 17:25 |
| hashar | pabelanger: no clue whether they are licensed, but most definitely some oss license :-} | 17:25 |
| *** andymaier has joined #openstack-infra | 17:25 | |
| rhallisey | mordred, ^^ | 17:25 |
| rhallisey | much appreciated | 17:25 |
| *** tonytan4ever has quit IRC | 17:25 | |
| hashar | pabelanger: feel free to ask in #wikimedia-operations | 17:25 |
| *** andymaier has quit IRC | 17:25 | |
| *** shardy has quit IRC | 17:26 | |
| *** andymaier has joined #openstack-infra | 17:26 | |
| jeblair | pabelanger: the main thing was identifying that because we have very sparse metrics -- like many tens of thousands of metrics for specific jobs that only occasionally get run, we should disable the statsd feature that records 0s when it doesn't get data | 17:26 |
| pabelanger | hashar: have you moved to 2.5 yet? I need to test it locally, they finally added elasticsearch datasource | 17:27 |
| *** doug-fish has quit IRC | 17:27 | |
| *** FallenPegasus has quit IRC | 17:27 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/infra-manual: Moved Python project guide to Project Team Guide https://review.openstack.org/244851 | 17:28 |
| *** akshai has quit IRC | 17:28 | |
| jeblair | pabelanger: i'm actually really impressed with carbon-cache's ability to deal with the fact that we were throwing an _incredible_ amount of data at it, and it was still actually able to report the correct data even though it was often more than 2 hours behind writing that data to disk. | 17:28 |
| *** fedexo has joined #openstack-infra | 17:28 | |
| hashar | pabelanger: I dont think so. For logstash events we have logstash send metrics to statsd and graph from there. Example counting logs https://grafana.wikimedia.org/dashboard/db/production-logging you want to ping bd808 :-} | 17:28 |
| jeblair | pabelanger: and if we ever get to the point where we are legitimitately sending that much data to it, there are ways to horizontally scale it. | 17:29 |
| *** annegentle has quit IRC | 17:29 | |
| hashar | I am heading back home. see you later and happy graphing | 17:29 |
| jeblair | (there wasn't actually a memory leak -- we told carbon-cache to create an infinitely large cache and it did, because we gave it more data than our io pipeline could handle) | 17:31 |
| *** godog has joined #openstack-infra | 17:31 | |
| *** annegentle has joined #openstack-infra | 17:31 | |
| hashar | let me introduce godog "Filippo Giunchedi". Wikimedia ops who deal with Grafana / Statsd / Carbon etc :-} | 17:31 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Make apply-test aware of modules to upgrade https://review.openstack.org/247273 | 17:31 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add baremetal hpuswest node definition https://review.openstack.org/208751 | 17:31 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add Infra Cloud modules to modules.env https://review.openstack.org/209617 | 17:31 |
| jeblair | flip214: so i would read that as 0.125 failures per 10 seconds. the new values of 1 failure per 10 seconds makes more sense to me. | 17:32 |
| godog | hi hashar and everyone :) | 17:32 |
| openstackgerrit | Merged openstack-infra/project-config: Disable qpid's jobs as it's now deprecated https://review.openstack.org/247587 | 17:32 |
| * hashar vanishes | 17:32 | |
| *** hashar has quit IRC | 17:32 | |
| *** krtaylor has quit IRC | 17:32 | |
| jeblair | godog: o/ | 17:32 |
| pabelanger | jeblair: that is good news | 17:32 |
| *** doug-fish has joined #openstack-infra | 17:32 | |
| jeblair | pabelanger: yes, now we can send it even more useful data :) | 17:33 |
| *** unicell1 has quit IRC | 17:33 | |
| *** glauco has joined #openstack-infra | 17:33 | |
| godog | hey jeblair ! | 17:33 |
| *** dizquierdo has joined #openstack-infra | 17:34 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config: Add neutron-full job template with gate hook enabled https://review.openstack.org/247697 | 17:34 |
| jeblair | godog: pabelanger just set us up a a grafana at http://grafana.openstack.org/ which is driven by yaml files via grafyaml in http://git.openstack.org/cgit/openstack-infra/project-config/tree/grafana | 17:35 |
| pabelanger | jeblair: that is good. Once I have some spare time, I want to start looking of the data again and see what we can create. I know timrc has added some stuff to statsd recently | 17:35 |
| godog | jeblair: that's handy! also I wasn't aware of grafyaml, we might end up doing the same as dashboards are not in git ATM | 17:36 |
| *** dims has quit IRC | 17:36 | |
| jeblair | godog: we love our config files in git :) | 17:36 |
| *** doug-fis_ has joined #openstack-infra | 17:37 | |
| mordred | ++ | 17:37 |
| *** mpavone has quit IRC | 17:37 | |
| *** fedexo has quit IRC | 17:37 | |
| *** doug-fish has quit IRC | 17:38 | |
| *** shashank_hegde has joined #openstack-infra | 17:38 | |
| godog | jeblair: yes! that's so much better as opposed to 'who touched the dashboards?' type of thoughts | 17:39 |
| *** rpodolyaka1 has joined #openstack-infra | 17:39 | |
| *** asselin_ has joined #openstack-infra | 17:39 | |
| *** markus_z has quit IRC | 17:40 | |
| mordred | godog: I read that to the tune of "who let the dogs out?" in my head | 17:40 |
| godog | mordred: hahaha pretty much | 17:41 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Do not send 'router:external' unless it is set https://review.openstack.org/247700 | 17:42 |
| *** doug-fis_ has quit IRC | 17:42 | |
| jeblair | sdague: you should use stats_counts. instead of stats. for counters, that will fix the apparent value changes at the end af the graph. | 17:43 |
| *** Daisy has joined #openstack-infra | 17:43 | |
| *** matrohon has quit IRC | 17:43 | |
| *** daemontool_ has quit IRC | 17:44 | |
| *** egonzalez has quit IRC | 17:44 | |
| *** daemontool_ has joined #openstack-infra | 17:44 | |
| mordred | jeblair: if you have a sec, could you +A 247700? It's a simple patch that fixes a bug that's out in the wild for our friends in ansible land | 17:45 |
| jeblair | sdague: 'stats.' is normalized to a per-second rate so the aggregation is weird (what hashar was saying earlier). 'stats_counts.' is the absolute count for the interval | 17:45 |
| *** asselin_ has quit IRC | 17:45 | |
| *** dangers_away is now known as dangers | 17:45 | |
| sdague | jeblair: hmmm that looks weird in another way | 17:45 |
| sdague | http://tinyurl.com/nvctxtt | 17:45 |
| sdague | do we no longer get to use moving average with this new model? | 17:46 |
| mordred | sdague: you also want to add &drawNullAsZero=true to the graph | 17:47 |
| *** adduarte has quit IRC | 17:47 | |
| mordred | sdague: it fixes the problem you're seeing | 17:47 |
| sdague | to every target? | 17:47 |
| mordred | no - just to the graph itself | 17:47 |
| jeblair | no it's a graph param | 17:47 |
| mordred | add that to the end of the url and it'll fix your graph | 17:47 |
| *** Zhongjun has quit IRC | 17:47 | |
| sdague | http://tinyurl.com/o6p2zew | 17:47 |
| *** Daisy has quit IRC | 17:48 | |
| pabelanger | mordred: decided to whip this up last night: https://github.com/pabelanger/ansible-gofer in an effort to make it easier to check if ansible playbooks are idempotent. Fixes the issue of using bash and grepping for results | 17:48 |
| sdague | that still seems weird | 17:48 |
| pabelanger | mordred: plan on getting some feedback from openstack-ansible see if there is some intersted in expanding on it | 17:48 |
| jeblair | sdague: what seems wrong? | 17:49 |
| *** asselin has quit IRC | 17:49 | |
| sdague | because I'm pretty sure that neutron hasn't failed every gate job in the last 4 hours | 17:49 |
| sdague | or every check job that is | 17:49 |
| sdague | no, sorry, it's the bold line, it's gate | 17:50 |
| zaro | morning | 17:50 |
| *** tonytan4ever has joined #openstack-infra | 17:51 | |
| jeblair | sdague: i'll continue to look into this, but it will take me a while to understand the functions you are using | 17:52 |
| *** abregman|mtg has quit IRC | 17:53 | |
| phschwartz | can I get a few more reviews on this and maybe a core approval. https://review.openstack.org/#/c/245341/ | 17:53 |
| *** timothyb89_ is now known as timothyb89 | 17:53 | |
| *** asselin has joined #openstack-infra | 17:54 | |
| sdague | this is based on what jogo built a long time ago | 17:54 |
| *** eliqiao has quit IRC | 17:54 | |
| sdague | movingAverage lets us smooth things out in a way that normal clusters in random data don't completely skew the system and show 100% failure | 17:55 |
| *** eliqiao has joined #openstack-infra | 17:55 | |
| *** sergmelikyan has quit IRC | 17:56 | |
| *** ashleighfarnham has joined #openstack-infra | 17:57 | |
| *** dimtruck is now known as zz_dimtruck | 17:57 | |
| *** Sukhdev has joined #openstack-infra | 17:57 | |
| *** SumitNaiksatam has joined #openstack-infra | 17:57 | |
| clarkb | jesusaurus: hrm curator didn't seem to run properly yesterday. Will have to keep an eye on it | 17:58 |
| *** FallenPegasus has joined #openstack-infra | 17:59 | |
| *** yonglihe has quit IRC | 18:00 | |
| mordred | clarkb: https://review.openstack.org/#/c/241495/ could you do that when you get a sec? I've verified that it works as expected on our servers (that is, is a no-op for agent runs) | 18:00 |
| mgagne | yesterday was ubuntu mirror, now it's rubygems.org :-/ | 18:01 |
| mgagne | will need to mirror the whole internet | 18:01 |
| *** ashleighfarnham has quit IRC | 18:01 | |
| clarkb | jesusaurus: it seems to have run though at 0200 th e19th | 18:01 |
| *** nadya_ has joined #openstack-infra | 18:01 | |
| clarkb | jesusaurus: syslog doesn't record it exploding or doing anything so not sure hwat happened, do you have any ideas? | 18:02 |
| phschwartz | mordred: nibalizer: mind reviewing https://review.openstack.org/#/c/245341/ | 18:03 |
| phschwartz | :) | 18:03 |
| *** sergmelikyan has joined #openstack-infra | 18:03 | |
| *** monester has quit IRC | 18:03 | |
| clarkb | mordred: nibalizer how are basemodulepath and modulepath different? | 18:03 |
| *** ashtokolov has quit IRC | 18:04 | |
| *** GheRivero has quit IRC | 18:04 | |
| *** rpodolyaka1 has quit IRC | 18:04 | |
| *** jed56 has quit IRC | 18:05 | |
| *** dims has joined #openstack-infra | 18:06 | |
| BobBall | gear's giving me a TimeoutError in sendAdminRequest in a traceback. Should there be any 'gear' processes running? | 18:06 |
| sdague | so, if we land this - https://review.openstack.org/#/c/247550/ we should free up some test nodes but not drop test coverage | 18:06 |
| BobBall | the whole gearman interaction bit is something I struggle with. My brain hasn't twigged yet. | 18:07 |
| *** zxiiro has quit IRC | 18:07 | |
| *** jpmaxman has quit IRC | 18:07 | |
| *** dtardivel has quit IRC | 18:07 | |
| *** auggy has quit IRC | 18:07 | |
| *** romcheg has quit IRC | 18:07 | |
| *** teran has quit IRC | 18:07 | |
| *** rguillebert has quit IRC | 18:07 | |
| BobBall | (traceback is from nodepool when's trying to getNeededWorkers) | 18:07 |
| *** unicell has joined #openstack-infra | 18:07 | |
| sdague | clarkb: so are we just going to be behind for while on logstash after the outage? | 18:08 |
| *** ZZelle_ has joined #openstack-infra | 18:08 | |
| mordred | clarkb: basemodulepath is global, modulepath is not - HOWEVER, thank you for noticing that | 18:08 |
| *** ashleighfarnham has joined #openstack-infra | 18:08 | |
| mordred | clarkb: "Setting a global value for modulepath in puppet.conf is not allowed" | 18:09 |
| mordred | so that should be basemodulepath too | 18:09 |
| *** rpodolyaka1 has joined #openstack-infra | 18:09 | |
| *** jamielennox|away is now known as jamielennox | 18:09 | |
| clarkb | sdague: outage? | 18:09 |
| *** amitgandhinz has quit IRC | 18:09 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Logstash 2.0 compat ES output rule https://review.openstack.org/247714 | 18:09 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Identify logstash multiline events by build uuid https://review.openstack.org/247715 | 18:09 |
| clarkb | (I see we are behind but know not of an outage) | 18:09 |
| *** amitgandhinz has joined #openstack-infra | 18:10 | |
| *** ashtokolov has joined #openstack-infra | 18:10 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add puppet apply settings to puppet.conf https://review.openstack.org/241495 | 18:10 |
| clarkb | thats first set of logstash upgrade changes. Need the actual deployment from deb which makes a bunch of our puppet redundant too | 18:11 |
| sdague | clarkb: yeh, jhesketh did a revert of something that broke all the indexing | 18:11 |
| sdague | it was offline from midnight to 6am my time | 18:11 |
| sdague | https://review.openstack.org/#/c/247426/ | 18:11 |
| sdague | also, I figured out my CORS kibana issue | 18:12 |
| *** amuller is now known as amuller_afk | 18:12 | |
| clarkb | sdague: oh? I did also allow * for cors over the weekend | 18:12 |
| clarkb | since we control api access via proxy | 18:13 |
| sdague | kibana sends a 301 on that failure | 18:13 |
| sdague | which means if it ever fails, you get a permanently cached failure in your browser | 18:13 |
| clarkb | silly kibana | 18:13 |
| clarkb | kibana 4 is on list after logstash 2.0 | 18:14 |
| *** GheRivero has joined #openstack-infra | 18:14 | |
| clarkb | have no idea if it will b ebetter about that | 18:14 |
| *** armax has quit IRC | 18:14 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Use the test_id column as the test identifier https://review.openstack.org/247716 | 18:14 |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add reno jobs for designate https://review.openstack.org/247717 | 18:16 |
| nibalizer | clarkb: mordred modulepath implies old style configuration and basemodulepath uses directory environments | 18:16 |
| clarkb | nibalizer: should we have apply use the not old style for future proofing or is that just not necessary yet? | 18:16 |
| nibalizer | uh i would say apply should use directory environments | 18:17 |
| clarkb | nibalizer: just thinking its easier to work through all of that at once rather than do a thing debug it now then do another thing in 6 months when under pressure due to EOL and debugging again | 18:17 |
| *** cloudtra_ has quit IRC | 18:17 | |
| nibalizer | but i didnt do the extra work yet | 18:17 |
| clarkb | nibalizer: ok https://review.openstack.org/#/c/241495/3/modules/openstack_project/templates/puppet.conf.erb uses modulepath not basemodulepath | 18:17 |
| *** ihrachys has quit IRC | 18:18 | |
| clarkb | nibalizer: we would need to mkdir /etc/puppet/environments/production ? | 18:18 |
| mordred | which https://docs.puppetlabs.com/references/latest/configuration.html#modulepath says is not allowed in global config | 18:18 |
| mordred | AH | 18:18 |
| mordred | it's allowed in 3.x but deprecated | 18:19 |
| *** mahatic has quit IRC | 18:19 | |
| nibalizer | yea | 18:19 |
| *** Ala has quit IRC | 18:19 | |
| clarkb | so fixing that would be required before a ove to 4.x | 18:19 |
| clarkb | (I don't know that we are lose to 4.xing so I don't care strongly about that) | 18:20 |
| nibalizer | and we need to scratch an envirinment.conf or something in /etc/puppet/environments/production/environment.conf | 18:20 |
| *** ivar-lazzaro has joined #openstack-infra | 18:20 | |
| *** cloudtrainme has joined #openstack-infra | 18:20 | |
| nibalizer | or something like that, i dont have the docs immediately in front of me | 18:20 |
| mordred | I love how complicated this has become | 18:20 |
| *** mwagner is now known as mwagner_afk | 18:20 | |
| *** gyee has quit IRC | 18:20 | |
| krotscheck | pleia2: I may have taken you too literally on https://review.openstack.org/#/c/244851/ | 18:20 |
| *** nadya_ has quit IRC | 18:21 | |
| mordred | nibalizer: ok. I've got it - I'll cookup a patch | 18:21 |
| *** zxiiro has joined #openstack-infra | 18:22 | |
| *** Sukhdev has quit IRC | 18:22 | |
| clarkb | mordred: nibalizer the one thing good about doing it now is while transitioning we expect some issues to work thorugh so getting it down now is easier than getting it done when something else dictates we need it | 18:23 |
| mordred | clarkb, nibalizer: this will be an easy patch to fix, turns out | 18:23 |
| clarkb | cool | 18:23 |
| *** teran has joined #openstack-infra | 18:23 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/infra-manual: Moved Python project guide to Project Team Guide https://review.openstack.org/244851 | 18:24 |
| * krotscheck tries that again | 18:24 | |
| *** rguillebert has joined #openstack-infra | 18:25 | |
| *** dtardivel has joined #openstack-infra | 18:26 | |
| *** sabeen2 has quit IRC | 18:26 | |
| *** dims has quit IRC | 18:26 | |
| *** akshai has joined #openstack-infra | 18:27 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add puppet apply settings to puppet.conf https://review.openstack.org/241495 | 18:27 |
| mordred | clarkb, nibalizer: ^^ | 18:27 |
| mordred | we already had a production environment cooked up for puppetmaster | 18:27 |
| mordred | all we need to do is move that to template so that it's everywhere - which will ALSO cover puppetmaster | 18:27 |
| *** otter768 has joined #openstack-infra | 18:28 | |
| openstackgerrit | Mike Dorman proposed openstack-infra/irc-meetings: Add Operators Large Deployment Team Meeting https://review.openstack.org/247725 | 18:28 |
| *** shashank_hegde has quit IRC | 18:28 | |
| *** sputnik13 has joined #openstack-infra | 18:29 | |
| *** Sukhdev has joined #openstack-infra | 18:29 | |
| *** romcheg has joined #openstack-infra | 18:30 | |
| *** jordanP has quit IRC | 18:31 | |
| *** annegentle has quit IRC | 18:32 | |
| *** monester has joined #openstack-infra | 18:32 | |
| *** hdd has quit IRC | 18:32 | |
| *** annegentle has joined #openstack-infra | 18:32 | |
| *** otter768 has quit IRC | 18:33 | |
| *** ociuhandu has quit IRC | 18:34 | |
| *** sabeen has joined #openstack-infra | 18:35 | |
| *** rpodolyaka1 has quit IRC | 18:36 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/ansible-puppet: Install modules before running puppet apply https://review.openstack.org/247730 | 18:37 |
| *** tsg_ has quit IRC | 18:38 | |
| crinkle | nibalizer: mordred is that ^ being done somewhere already? | 18:38 |
| nibalizer | crinkle: i have a patch that does something like that, give me a sec | 18:38 |
| *** harlowja_at_home has quit IRC | 18:38 | |
| nibalizer | crinkle: basicaly the same code you wrote | 18:39 |
| nibalizer | https://review.openstack.org/#/c/241501/2/playbooks/roles/applyprep/tasks/main.yml | 18:39 |
| nibalizer | but i put it in system-config instead of ansible-puppet | 18:39 |
| *** yonglihe has joined #openstack-infra | 18:39 | |
| *** annegentle has quit IRC | 18:39 | |
| crinkle | nibalizer: okie i'll drop mine | 18:39 |
| nibalizer | well | 18:41 |
| *** jed56 has joined #openstack-infra | 18:41 | |
| phschwartz | nibalizer: mind taking a look at https://review.openstack.org/#/c/245341/ I don't want it to get lost in the mix | 18:41 |
| nibalizer | i mean idc | 18:41 |
| *** nadya_ has joined #openstack-infra | 18:41 | |
| *** nadya_ has quit IRC | 18:41 | |
| nibalizer | phschwartz: sure | 18:42 |
| crinkle | nibalizer: i have a patch stack starting at https://review.openstack.org/#/c/247273/ that tries to make the apply-test better able to handle things like the mysql module upgrade, but i'm not sure how to get it to work with an actual deployment | 18:42 |
| *** jpmaxman has joined #openstack-infra | 18:42 | |
| *** auggy has joined #openstack-infra | 18:43 | |
| *** andymaier has quit IRC | 18:43 | |
| *** fitoduarte has joined #openstack-infra | 18:43 | |
| clarkb | crinkle: nibalizer if I want to deprecate a class in puppet because another class has basically superceded it I can nest the two so the old one continues to work properly but want to say "warning this is deprecated" is there a good easy way to do that? | 18:43 |
| clarkb | notify? | 18:43 |
| crinkle | clarkb: yep notify type or warning() function | 18:43 |
| nibalizer | warning() probably | 18:44 |
| nibalizer | no one will look but thats the std way | 18:44 |
| crinkle | yeah function is better because then it doesn't show as changes | 18:44 |
| nibalizer | then you can fail() later once you want to fail hard | 18:44 |
| clarkb | and its just warning('my message here') ? | 18:44 |
| nibalizer | there is also notice() if you just want to put a message | 18:44 |
| crinkle | clarkb: yep it's pretty simple | 18:45 |
| nibalizer | crinkle: ok i will review | 18:45 |
| clarkb | thank you | 18:45 |
| *** amitgandhinz has quit IRC | 18:45 | |
| pabelanger | crinkle: for me, I locally have something that just changes the modulepath based on the site.pp (a la Node-OS). I should loop back to that and upload something. The basic concept is dynamic module paths depending on which module you need. | 18:45 |
| nibalizer | pabelanger: you were punged in the #puppet-community room | 18:45 |
| *** amitgandhinz has joined #openstack-infra | 18:45 | |
| pabelanger | nibalizer: connecting | 18:46 |
| pleia2 | krotscheck: thumbs up! | 18:46 |
| timrc | jeblair: Oh that grafana dashboard is a beautiful sight! | 18:46 |
| krotscheck | pleia2: danke! | 18:47 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Use the test_id column as the test identifier https://review.openstack.org/247716 | 18:47 |
| *** glauco__ has joined #openstack-infra | 18:48 | |
| timrc | pabelanger: I'm going to go nuts with statsd as soon we upgrade gearman-plugin to start sending node label info back to zuul. | 18:48 |
| *** david-lyle has quit IRC | 18:48 | |
| crinkle | clarkb: could you also give feedback on 245341? it's based on your suggestion but i'm hoping it's a little more generic | 18:48 |
| crinkle | er not that one | 18:49 |
| crinkle | clarkb: 247273 | 18:49 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: WIP: Add reno release notes to subunit2sql for 1.0.0 release https://review.openstack.org/247737 | 18:49 |
| timrc | pabelanger: There is a lot of information about provider performance from that. | 18:49 |
| clarkb | crinkle: looking | 18:49 |
| timrc | we can glean from that* | 18:49 |
| *** shashank_hegde has joined #openstack-infra | 18:50 | |
| pabelanger | timrc: cool | 18:50 |
| timrc | There is so much great information in the zuul logs I wish we could visualize too. | 18:50 |
| timrc | pabelanger: Maybe once logstash data for system logs is a thing we can import it into Grafana. | 18:50 |
| *** sabeen has quit IRC | 18:51 | |
| *** glauco has quit IRC | 18:52 | |
| *** sputnik13 has quit IRC | 18:52 | |
| *** dizquierdo has quit IRC | 18:52 | |
| *** dims has joined #openstack-infra | 18:52 | |
| *** fawadkhaliq has quit IRC | 18:54 | |
| clarkb | crinkle: yup and https://review.openstack.org/#/c/209617/ should tell you if it worked | 18:54 |
| clarkb | crinkle: so will hold off on voting until we get results from ^ but thats the idea | 18:54 |
| *** salv-orlando has joined #openstack-infra | 18:54 | |
| crinkle | clarkb: the last patchset just updated the commit message in the first patch so i'm pretty sure it works | 18:54 |
| crinkle | clarkb: but now ansible has to somehow be aware of the tag in site.pp which is kind of weird | 18:55 |
| clarkb | crinkle: oh was that job update already running against the upgrade module sfile? | 18:55 |
| crinkle | clarkb: on patchset 24 yes | 18:55 |
| clarkb | cool can look there | 18:56 |
| nibalizer | phschwartz: there is a weird whitespace issue on https://review.openstack.org/#/c/245341/ but other than that lgtm | 18:56 |
| nibalizer | respin and then I'm good | 18:56 |
| *** salv-orl_ has quit IRC | 18:57 | |
| *** hongbin has joined #openstack-infra | 18:57 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove unused Manila CI job https://review.openstack.org/247524 | 18:57 |
| *** achanda has joined #openstack-infra | 18:58 | |
| openstackgerrit | Philip Marc Schwartz proposed openstack-infra/system-config: Pull o_p::server out of gerrit role https://review.openstack.org/245341 | 18:58 |
| hongbin | yolanda: ping | 18:58 |
| phschwartz | nibalizer: ok, fixed | 18:58 |
| openstackgerrit | Merged openstack-infra/project-config: Create a multinode grenade job for testing Neutron https://review.openstack.org/245862 | 18:58 |
| openstackgerrit | Merged openstack-infra/project-config: Refactor VPN functional tests to use common template https://review.openstack.org/240990 | 18:58 |
| *** amuller_afk is now known as amuller | 18:59 | |
| openstackgerrit | Merged openstack-infra/project-config: Add training-guides translation jobs and scripts https://review.openstack.org/245615 | 18:59 |
| openstackgerrit | Merged openstack-infra/project-config: Add publishing jobs to nova-powervm https://review.openstack.org/245232 | 18:59 |
| openstackgerrit | Merged openstack-infra/project-config: Disable gate-muranoclient-dsvm-functional for kilo and juno https://review.openstack.org/245283 | 19:00 |
| *** bastelfreak has joined #openstack-infra | 19:00 | |
| anteaya | clarkb: this is the file that tells logstash which jenkins job logs to index and includes the tags to use for each file? http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/files/logstash/jenkins-log-client.yaml | 19:00 |
| anteaya | mmedvede: ^^ | 19:00 |
| *** armax has joined #openstack-infra | 19:01 | |
| clarkb | anteaya: yes | 19:01 |
| anteaya | clarkb: thank you | 19:02 |
| openstackgerrit | Merged openstack-infra/project-config: Add neutron-lib repo https://review.openstack.org/174952 | 19:02 |
| anteaya | clarkb: I'm looking for something called a custom analyzer that establishes the tokenization we use, do we have one of those? | 19:02 |
| *** sergmelikyan has quit IRC | 19:02 | |
| anteaya | so far my grepping returns no results | 19:02 |
| *** unicell has quit IRC | 19:03 | |
| *** sabeen has joined #openstack-infra | 19:04 | |
| *** e0ne has joined #openstack-infra | 19:04 | |
| *** Sukhdev has quit IRC | 19:04 | |
| *** smarcet has quit IRC | 19:04 | |
| openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/246764 | 19:05 |
| clarkb | anteaya: no? | 19:05 |
| anteaya | oh okay I will stop looking then, thanks | 19:05 |
| clarkb | anteaya: is there more context behind that? I have none and don't understand what is being asked for | 19:06 |
| dougwig | hi infra, since https://review.openstack.org/#/c/174952/ merged, can you please add me to neutron-lib-core to bootstrap? | 19:06 |
| pleia2 | clarkb: going through reviews to catch up, happened to find this one, want to remove your WIP and let it go? https://review.openstack.org/#/c/211333/ | 19:08 |
| *** unicell has joined #openstack-infra | 19:08 | |
| clarkb | pleia2: there are still a small number of hosts that won't take that key iirc :( | 19:09 |
| pleia2 | clarkb: ah, boo :\ | 19:09 |
| clarkb | pleia2: but they arne't running puppet anways so ya can remove wip | 19:09 |
| *** jtrovo has joined #openstack-infra | 19:09 | |
| clarkb | the lack of puppeting is why they aren't taking new key but I can remove WIP | 19:09 |
| * pleia2 nods | 19:09 | |
| *** unicell1 has joined #openstack-infra | 19:09 | |
| *** unicell has quit IRC | 19:10 | |
| *** hdd has joined #openstack-infra | 19:10 | |
| anteaya | clarkb: oh okay sorry, I was going through the elastic search documentation, I found reference to tokenization, I didn't know what it was, I started looking at bits to see if I could get an idea, I couldn't since everything assumed I knew what a tokenizer was, I looked for an example in our code, thought a custom tokenizer would be something we would have and easy for me to grep | 19:10 |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config: Add reno jobs for designate https://review.openstack.org/247717 | 19:11 |
| clarkb | anteaya: no I don't think we do anything custom | 19:11 |
| clarkb | its just default logstas | 19:11 |
| clarkb | pleia2: done | 19:11 |
| pleia2 | clarkb: ok, I'll approve and will rescue you later if you need your key added somewhere ;) | 19:11 |
| clarkb | sounds good | 19:11 |
| clarkb | thanks | 19:11 |
| *** sabeen has quit IRC | 19:11 | |
| anteaya | clarkb: okay thanks | 19:12 |
| anteaya | http://git.openstack.org/cgit/openstack-infra/logstash-filters/tree/filters/indexer.conf seems to be a copy of http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/templates/logstash/indexer.conf.erb | 19:12 |
| *** hashar has joined #openstack-infra | 19:13 | |
| jtrovo | clarkb: can I get a review here https://review.openstack.org/#/c/235545/ | 19:13 |
| *** bcourt has quit IRC | 19:13 | |
| jtrovo | clarkb: it's about a change on zmq-event-publisher to allow parameters to get it's value from execution time | 19:14 |
| clarkb | ruagair: oh hey we said we would do the thing now, I am about if you are | 19:15 |
| clarkb | ruagair: ended up doing it with mmedvede and anteaya yesterday as well since they were able but happy to run through things with you as well | 19:15 |
| rbrndt | possibly a silly question... Is it possible to run the gate jobs on a patchset without approving it? | 19:15 |
| clarkb | anteaya: ya I think plan is to move to logstash-filters | 19:15 |
| clarkb | anteaya: I really want to get logstash2.0 running first as that makes the whole thing easier with a conf.d dir | 19:16 |
| clarkb | anteaya: which will make it easier to use to separate our filters from our inputs and outputs | 19:16 |
| anteaya | clarkb: very good | 19:16 |
| *** jamielennox is now known as jamielennox|away | 19:16 | |
| clarkb | anteaya: that way ops and us can use the same filters ut have site specific inputs and outputs | 19:16 |
| anteaya | rbrndt: they run as check jobs | 19:16 |
| anteaya | clarkb: interesting | 19:17 |
| clarkb | jtrovo: I am elbow deep in several other things currently | 19:17 |
| clarkb | jtrovo: I will add it to the list | 19:17 |
| rbrndt | anteaya: even if they are only specified in the "gate" list in layout.yaml? | 19:17 |
| anteaya | rbrndt: anything that runs in the gate should be run in check first, it there is a repo not doing that that is an error that needs to be fixed | 19:17 |
| anteaya | rbrndt: can you show me where in layout.yaml you are seeing this please? | 19:17 |
| rbrndt | anteaya: I'm setting up tests for a new project and we were hoping not to slow down our check jobs with a slow (non-voting) test | 19:18 |
| anteaya | so you want to slow down your gate instead? | 19:18 |
| jtrovo | clarkb: sure, let me know if you have any doubts in regard to that | 19:18 |
| rbrndt | rather than slowing both, yes | 19:18 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements https://review.openstack.org/247650 | 19:18 |
| anteaya | rbrndt: jobs run non-voting in check only, if they are voting jobs the run both in check and gate | 19:19 |
| anteaya | this is the openstack way | 19:19 |
| *** mriedem has quit IRC | 19:19 | |
| rbrndt | anteaya: ok, sounds like thats the answer then. Thanks! | 19:19 |
| jtrovo | clarkb: also is there any other person that I can reach out to review that has some knowledge on zmq-event-publisher project? | 19:19 |
| sdague | rbrndt: if you really don't care about per patch results, which is what it sounds like, there is also a periodic queue | 19:20 |
| sdague | so you can run it daily for instance | 19:20 |
| anteaya | rbrndt: you are welcome | 19:20 |
| openstackgerrit | Merged openstack-infra/project-config: Fix Rally job for Manila project https://review.openstack.org/245707 | 19:20 |
| *** Sukhdev has joined #openstack-infra | 19:20 | |
| rbrndt | sdague: we're just looking to get more results so we can fix the tests faster | 19:20 |
| anteaya | rbrndt: now if you want to discuss how to speed up a slow job, that is a topic that is open for discussion | 19:21 |
| *** bardia has joined #openstack-infra | 19:21 | |
| *** amrith has left #openstack-infra | 19:21 | |
| sdague | rbrndt: what are these tests? | 19:21 |
| anteaya | rbrndt: have you heard about the experimental queue? | 19:21 |
| rbrndt | sdague: tempest tests for monasca | 19:21 |
| rbrndt | anteaya: we're using the experimental queue right now, but wanted to have the job start running automatically | 19:22 |
| sdague | rbrndt: yeh, that's really non-voting check as the next step | 19:22 |
| anteaya | rbrndt: what sdague said | 19:22 |
| rbrndt | antenna, stage: sounds good, we'll do that then | 19:23 |
| anteaya | sdague: never thought of you as stage before, that will take me a minute | 19:23 |
| sdague | heh | 19:24 |
| *** kozhukalov_ has joined #openstack-infra | 19:24 | |
| anteaya | rbrndt: yeah that is a far better choice than gating on an unstable job | 19:24 |
| rbrndt | spelling mistake, not sure how it got that far off :) | 19:24 |
| anteaya | rbrndt: it was one of the better ones I have seen | 19:24 |
| mordred | clarkb: could I bother you please for a review on https://review.openstack.org/#/c/247700/ ? | 19:25 |
| openstackgerrit | Merged openstack-infra/system-config: Remove old clarkb key. https://review.openstack.org/211333 | 19:25 |
| *** doug-fish has joined #openstack-infra | 19:25 | |
| *** cloudtrainme has quit IRC | 19:25 | |
| openstackgerrit | Sergey Skripnick proposed openstack/requirements: Bump ddt version to >=1.0.1 https://review.openstack.org/247214 | 19:26 |
| *** akshai has quit IRC | 19:26 | |
| *** bcourt has joined #openstack-infra | 19:26 | |
| *** sabeen2 has joined #openstack-infra | 19:27 | |
| *** nadya_ has joined #openstack-infra | 19:27 | |
| sdague | anteaya: you up for looking at this review - https://review.openstack.org/#/c/247550/ ? | 19:27 |
| openstackgerrit | Ryan Brandt proposed openstack-infra/project-config: Move monasca gate job from experimental to non-voting check job https://review.openstack.org/247752 | 19:28 |
| *** ifarkas has quit IRC | 19:28 | |
| openstackgerrit | Jim Rollenhagen proposed openstack/requirements: Bump ironic-lib to 0.4.0 https://review.openstack.org/247753 | 19:28 |
| *** gyee has joined #openstack-infra | 19:29 | |
| *** electrofelix has quit IRC | 19:29 | |
| *** zer0c00l has quit IRC | 19:29 | |
| *** rbrndt has quit IRC | 19:30 | |
| mgagne | zaro: do you know about any change that would stop Jenkins from rendering HTML in job description? | 19:31 |
| *** mriedem has joined #openstack-infra | 19:31 | |
| *** Piet has quit IRC | 19:31 | |
| *** mwagner_afk is now known as mwagner | 19:32 | |
| *** ociuhandu has joined #openstack-infra | 19:32 | |
| anteaya | sdague: I can do that | 19:32 |
| *** annegentle has joined #openstack-infra | 19:33 | |
| *** akshai has joined #openstack-infra | 19:34 | |
| mgagne | ok, found it in "Configure Global Security" | 19:34 |
| mgagne | Markup Formatter | 19:34 |
| pleia2 | if another infra-root is around to have a look, I'd like to land the zanata upgrade to 3.7.3 and I have time to babysit now: https://review.openstack.org/#/c/232313/ | 19:35 |
| nibalizer | ill look | 19:35 |
| pleia2 | thank you | 19:35 |
| nibalizer | trade you for https://review.openstack.org/#/c/245341/ | 19:35 |
| *** aopincar has joined #openstack-infra | 19:36 | |
| *** bcourt has quit IRC | 19:36 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: WIP - Add ability to opt-in to upgrading modules https://review.openstack.org/247755 | 19:36 |
| * pleia2 has a look | 19:36 | |
| crinkle | nibalizer: ^ not sure if valid ansible | 19:36 |
| *** dims has quit IRC | 19:36 | |
| nibalizer | crinkle: right | 19:37 |
| nibalizer | we shoudl get an ansible-syntax check on system-config before we footgun | 19:37 |
| *** sputnik13 has joined #openstack-infra | 19:37 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-logstash: Install logstash 2.0 https://review.openstack.org/247756 | 19:38 |
| *** woodster_ has joined #openstack-infra | 19:38 | |
| clarkb | jesusaurus: ^ I took a chain saw to logstash, going to WIP that until I can do more testing but thats roughly what it should look like with newer logstash | 19:38 |
| *** achanda has quit IRC | 19:38 | |
| clarkb | +78,-207 :) | 19:38 |
| *** zz_dimtruck is now known as dimtruck | 19:40 | |
| jesusaurus | clarkb: awesome, i'll try to set aside some time soon to review | 19:40 |
| clarkb | pleia2: so it ws md5 and is now sha1? | 19:40 |
| clarkb | pleia2: so we do a dance to work around that? | 19:40 |
| pleia2 | clarkb: see the dependency chain | 19:41 |
| pleia2 | clarkb: it's being danced :) | 19:41 |
| clarkb | ya I had a fun time going through that | 19:41 |
| pleia2 | so we'll upgrade, then swap them out, which shouldn't trigger any further changes since it should just match | 19:42 |
| clarkb | nibalizer: were you also reviewing those changes? | 19:43 |
| clarkb | (I can not approve if yo uwant to look) | 19:43 |
| nibalizer | yep +2's applied | 19:43 |
| clarkb | though my wifi is derping | 19:43 |
| nibalizer | clarkb: pleia2 either of you can approve as you see fit | 19:43 |
| *** david-lyle has joined #openstack-infra | 19:43 | |
| nibalizer | my wifi is exceedingly derpy | 19:43 |
| clarkb | pleia2: should I go ahead and approve as I go? | 19:44 |
| pleia2 | nibalizer: if I understand it correctly with this patch you linked me, the afs stuff in the gerrit.pp were just silly? | 19:44 |
| pleia2 | clarkb: yes please | 19:44 |
| pleia2 | nibalizer: I see that they're being used in review_dev.pp | 19:44 |
| pleia2 | and seems to make more sense this way | 19:45 |
| *** e0ne has quit IRC | 19:46 | |
| clarkb | pleia2: done I apprvoed all 3 | 19:46 |
| clarkb | which should be fine as end state is sha1 with correct data | 19:46 |
| pleia2 | clarkb: thanks | 19:46 |
| * pleia2 nods | 19:46 | |
| *** openstackgerrit has quit IRC | 19:46 | |
| *** openstackgerrit has joined #openstack-infra | 19:47 | |
| mtreinish | so I'm looking at: https://review.openstack.org/#/admin/groups/395,members and I'm able to add new people to the group (the box is greyed out) | 19:47 |
| pabelanger | nibalizer: clarkb: yolanda: first stab at apache::vhost::custom: https://github.com/pabelanger/puppetlabs-apache/blob/temp/vhost_custom/manifests/vhost/custom.pp | 19:47 |
| mtreinish | I know it used to work, because I've added people in the past | 19:47 |
| mtreinish | any idea what changed? | 19:47 |
| pabelanger | nibalizer: yolanda: clarkb: WTB feature requests | 19:47 |
| mtreinish | oh, I see what changed, the group ownership changed to fungi... | 19:48 |
| mtreinish | fungi: this means I'm just going to bug you constantly about gerrit group maint :) | 19:49 |
| clarkb | jtrovo: I thought the plan was to use a prefix to determine which vars should be sipped | 19:49 |
| clarkb | jtrovo: I am not sure we want all env vars to be shipped especailly since this happens over the clear | 19:49 |
| nibalizer | pabelanger: ouch | 19:49 |
| clarkb | jtrovo: that prefix can be configurable maybe with an option to hsip all of them | 19:50 |
| clarkb | pabelanger: wasn't custom_config the thing that appended extr astuff? | 19:51 |
| nibalizer | that was custom_fragment | 19:51 |
| pabelanger | clarkb: no, it takes a raw file | 19:51 |
| *** bcourt has joined #openstack-infra | 19:51 | |
| clarkb | nibalizer: gotcha | 19:51 |
| nibalizer | so i had this idea | 19:51 |
| pabelanger | what nibalizer said, was in vhost.pp | 19:51 |
| mtreinish | infra-root: when someone gets a chance can I be added to the group owners on https://review.openstack.org/#/admin/groups/395,info | 19:52 |
| jtrovo | clarkb: this is one is one step before the prefix parameters change, this change is needed so we can override the parameter values with values from a EnvInject in execution time | 19:52 |
| clarkb | jtrovo: you shouldn't be doing that but ok | 19:52 |
| nibalizer | that we might pass to that defined type a template =>, and a vars => {}, then do template evaluation inside the defined type | 19:52 |
| nibalizer | idunno how pepole feel about that | 19:52 |
| *** achanda has joined #openstack-infra | 19:52 | |
| pabelanger | clarkb: this is basically what our templates would look like: https://review.openstack.org/#/c/205596/ | 19:52 |
| clarkb | jtrovo: typically the job parameters should not be updated by the job itself | 19:52 |
| nibalizer | that way it would have access to things like apache global variables | 19:52 |
| clarkb | jtrovo: bceause then crazyness can happen | 19:52 |
| nibalizer | mtreinish: i gotcha | 19:53 |
| mtreinish | nibalizer: cool thanks | 19:53 |
| *** achanda has quit IRC | 19:53 | |
| clarkb | nibalizer: you mean bundle in a set of vars that can be interpolated? | 19:53 |
| pabelanger | nibalizer: ya, if we pass template(foo) into content, we'll basically lose settings from vhost.pp. Guess that is the trade off right now | 19:54 |
| jtrovo | clarkb: yes, the problem we have here is getting some information available only at runtime to be passed with the prefixed parameters by zmq-event-publisher | 19:54 |
| nibalizer | basically require you to send in all variables you want evaluated in the template | 19:54 |
| clarkb | jtrovo: yes that is fine | 19:54 |
| pabelanger | don't know how much we are using vhost.pp variables | 19:54 |
| pabelanger | would have to check | 19:54 |
| clarkb | jtrovo: i am saying your jobs should not override jenkins params | 19:54 |
| clarkb | jtrovo: if a param is set by jenkins it should never change | 19:54 |
| clarkb | jtrovo: so I am confused why you want the change that you linked me | 19:54 |
| nibalizer | things like apache_log_dir it would be cool to have available from the apache module not our logic (repeated over and over again) | 19:54 |
| clarkb | jtrovo: it appears to workaround a state that you should never be in | 19:54 |
| nibalizer | mtreinish: you are in this group | 19:55 |
| jtrovo | clarkb: so how should we get a prefixed parameter value out of jenkins? | 19:55 |
| clarkb | nibalizer: my only thing about that is it would be another non compatible change | 19:55 |
| mtreinish | nibalizer: it's not group membership, it's group ownership. I'm unable to edit members now | 19:55 |
| clarkb | nibalizer: which will make it hearder to switch | 19:55 |
| *** rbrndt has joined #openstack-infra | 19:55 | |
| nibalizer | mtreinish: im not sure what you'd be asking ous to do | 19:55 |
| clarkb | jtrovo: if it is in the env copy it ot the list of vars | 19:55 |
| clarkb | jtrovo: I just don't know why you need this change | 19:55 |
| openstackgerrit | Merged openstack-infra/project-config: swap 3 tempest jobs for 1 layer4 jumbo job https://review.openstack.org/247550 | 19:55 |
| clarkb | jtrovo: basically do the same thing but don't mask | 19:56 |
| openstackgerrit | Merged openstack-infra/project-config: Move monasca gate job from experimental to non-voting check job https://review.openstack.org/247752 | 19:56 |
| clarkb | masking is bad | 19:56 |
| clarkb | very bad | 19:56 |
| clarkb | becaues te job config is in jenkins | 19:56 |
| pabelanger | nibalizer: well, if we start picking things to template, I would insist going back to custom_fragment. FWIW: I think it actually has sane defaults | 19:56 |
| clarkb | if yo uneed maksing it means your jobs themselves are updating the config | 19:56 |
| pabelanger | like you said, not having to dupe log paths and such | 19:56 |
| mtreinish | nibalizer: on the info page where it says infra-ptl, add subunit2sql-core to that list | 19:56 |
| nibalizer | oh | 19:56 |
| *** doug-fish has quit IRC | 19:56 | |
| clarkb | jtrovo: your if should if envVars.getName().startswith(prefix) then copy to env | 19:57 |
| nibalizer | ya its not letting me | 19:57 |
| pabelanger | nibalizer: this was the diff using custom_frag: https://review.openstack.org/#/c/205596/2/templates/nodepool-log.vhost.erb | 19:57 |
| nibalizer | haha oops | 19:57 |
| pabelanger | either way, need to get daughter from school. BBIAB | 19:57 |
| clarkb | jtrovo: you also need to check against a null envVars | 19:57 |
| mtreinish | nibalizer: it works now, thanks | 19:57 |
| clarkb | I will leave comments in gerrit | 19:57 |
| nibalizer | well, because infra-ptl got kicked out | 19:57 |
| *** maishsk has joined #openstack-infra | 19:58 | |
| *** doug-fish has joined #openstack-infra | 19:58 | |
| mtreinish | nibalizer: works for me, I doubt fungi wants to bother with it anyway :) | 19:58 |
| jtrovo | clarkb why should we use prefix at this point? it's going to be another place to maintain configurable prefix and I see more trouble then good having some parameters getting it's value from the env and some parameters just getting them from the job creation time | 19:58 |
| *** bcourt has quit IRC | 19:58 | |
| nibalizer | and he's on a boat, so he can't complain | 19:58 |
| mtreinish | nibalizer: haha, fair point | 19:59 |
| clarkb | jtrovo: because it is the correct way to do this | 19:59 |
| jeblair | mtreinish: nibalizer er | 19:59 |
| nibalizer | clarkb: should 'owners' be a multigroup thing? at this point i've changed it to subunit2fql-core instead of infra-ptl | 19:59 |
| jeblair | no | 19:59 |
| clarkb | jtrovo: you should not be overriding jenkins vars like this because its easy | 19:59 |
| jeblair | is subunit2sql an infra project? | 19:59 |
| clarkb | jtrovo: since its wrong | 19:59 |
| jeblair | mtreinish, nibalizer: | 19:59 |
| mtreinish | jeblair: it is, but if going through the ptl to add a core is a requirement, I'm going to move it off of infra | 19:59 |
| jeblair | mtreinish: :( | 20:00 |
| jeblair | mtreinish: that's a really strong stance | 20:00 |
| clarkb | jtrovo: commented with psuedo code | 20:01 |
| jeblair | mtreinish: so we worked pretty hard on the organizational structure for infra | 20:01 |
| *** cloudtrainme has joined #openstack-infra | 20:01 | |
| jeblair | mtreinish: it's documented here: http://docs.openstack.org/infra/system-config/project.html#teams | 20:01 |
| mtreinish | jeblair: sure, but I don't think it scales. It's fine for the 100+ puppet things, but the other random projects that are mostly self contained it's unecessary overhead. | 20:02 |
| jeblair | mtreinish: maybe we can discuss this before we get to ultimatums? | 20:02 |
| mtreinish | jeblair: sure | 20:02 |
| mtreinish | but right now I need to find food :) | 20:03 |
| jeblair | mtreinish: it actually is to try to help it to scale | 20:03 |
| jeblair | oh fine | 20:03 |
| *** bcourt has joined #openstack-infra | 20:03 | |
| jeblair | mtreinish: please let me know when it would be convenient for you | 20:04 |
| jtrovo | clarkb: just saw it and it makes sense, I'm gonna update the patch | 20:04 |
| mtreinish | jeblair: sure, will do | 20:04 |
| jeblair | nibalizer: the group structure for infra projects is managed by a script in system-config | 20:04 |
| jeblair | nibalizer: please don't change ownership of infra groups, it is intentionally delegated to the ptl | 20:04 |
| nibalizer | ohhhh | 20:04 |
| nibalizer | i didn't know | 20:04 |
| nibalizer | thanks | 20:04 |
| jtrovo | clarkb: just another thing, how do you think the prefix should be passed as a parameter to the plugin code? | 20:05 |
| *** hongbin has left #openstack-infra | 20:05 | |
| clarkb | jtrovo: it can be a plugin configuration in global config with a default of no prefix (so nothing is copied) and an option to copy all of the job env instead | 20:06 |
| jeblair | nibalizer: system-config/tools/maintain-infra-groups.py | 20:06 |
| clarkb | jtrovo: there should be examples of that for the port that zmq uses since its configurable too | 20:06 |
| jeblair | and i will note that in _every_ openstack project, core membership is as the descretion of the project ptl. this is no different. | 20:06 |
| *** aopincar has quit IRC | 20:08 | |
| clarkb | jtrovo: grep for 8888 | 20:08 |
| openstackgerrit | Merged openstack-infra/project-config: Fix broken stable-compat-jobs for oslo https://review.openstack.org/247188 | 20:09 |
| *** weshay_xchat has quit IRC | 20:10 | |
| *** dramalho has quit IRC | 20:11 | |
| *** maishsk_ has joined #openstack-infra | 20:11 | |
| anteaya | clarkb: when we started up services yesterday we started with logstash and then gearman server, gearmand worker and then gearman client | 20:11 |
| anteaya | clarkb: is that the way you start them up in production? | 20:12 |
| elmiko | hey folks, i'm reading http://docs.openstack.org/developer/requirements/ and have a couple questions | 20:12 |
| elmiko | i need to add castellan>=0.2.0 as a requirement in sahara, is the proper way to do this by making a request to the global-requirements.txt? | 20:12 |
| clarkb | anteaya: yes, they can in theory start in any order but doing it that way allows you to verify everything works each step of the way | 20:13 |
| clarkb | elmiko: yes | 20:13 |
| clarkb | elmiko: then you can propose the change to sahara | 20:13 |
| anteaya | clarkb: okay | 20:13 |
| anteaya | clarkb: what order do you like to turn them off, reverse order to that? | 20:13 |
| clarkb | anteaya: ya | 20:13 |
| anteaya | okay | 20:13 |
| elmiko | clarkb: ok, and then for my patch i just use a Depends-On: tag in the commit message? | 20:13 |
| *** maishsk has quit IRC | 20:14 | |
| *** maishsk_ is now known as maishsk | 20:14 | |
| clarkb | elmiko: yup | 20:14 |
| anteaya | I can't remember how I turned them off last night but logstash went off first and then I couldn't get one of them to close | 20:14 |
| openstackgerrit | Merged openstack-infra/irc-meetings: add meeting for service catalog tng effort https://review.openstack.org/245745 | 20:14 |
| elmiko | clarkb: thanks! | 20:14 |
| clarkb | anteaya: ya the owkrer | 20:14 |
| anteaya | the worker I think | 20:14 |
| * elmiko waves at anteaya | 20:14 | |
| clarkb | I htink it has a bug where there is a non daemon thread | 20:14 |
| anteaya | yay it just kept hanging around | 20:14 |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Add new experimental Tempest job for Manila https://review.openstack.org/247551 | 20:14 |
| * anteaya waves back at elmiko | 20:14 | |
| anteaya | I have a long log of it just retrying things | 20:15 |
| *** bexelbie has quit IRC | 20:15 | |
| anteaya | finally I closed the terminal | 20:15 |
| openstackgerrit | Merged openstack-infra/system-config: Move translate.openstack.org to Zanata 3.7.3 https://review.openstack.org/232313 | 20:15 |
| *** ldnunes has quit IRC | 20:15 | |
| anteaya | it didn't respond to control-c at all | 20:15 |
| clarkb | anteaya: you can use kill to kill it | 20:15 |
| clarkb | it respects sigint | 20:15 |
| clarkb | er sigkill? | 20:15 |
| clarkb | anyways kill works | 20:15 |
| anteaya | okay I can try to remember that next time | 20:16 |
| anteaya | if the worker is running when logstash is not | 20:16 |
| anteaya | thanks | 20:16 |
| * anteaya goes back to reading things | 20:16 | |
| clarkb | anteaya: mmedvede ruagair I did some quick chekcing this morning and it looks like the apacheerror logs for horizon may not be parsing properly | 20:17 |
| openstackgerrit | Ryan Hallisey proposed openstack-infra/project-config: Add a job around using tripleo with docker https://review.openstack.org/238475 | 20:17 |
| clarkb | if you want an example of that | 20:17 |
| anteaya | awesome | 20:17 |
| *** Piet has joined #openstack-infra | 20:17 | |
| * anteaya goes to look at some horizon logs | 20:17 | |
| *** acruz has quit IRC | 20:19 | |
| anteaya | clarkb: so we are running logstash 1.7 and checking 2.0 to see is 2.0 will work as we expect, yes? | 20:19 |
| clarkb | anteaya: thye are in apache/horizon_error.txt or something like that | 20:19 |
| anteaya | clarkb: thanks | 20:19 |
| clarkb | anteaya: we are running logstash 1.3.3 and ya | 20:19 |
| *** _denisra has joined #openstack-infra | 20:20 | |
| *** annegentle has quit IRC | 20:22 | |
| anteaya | ah sorry | 20:22 |
| anteaya | not sure where I got 1.7 from | 20:22 |
| jeblair | sdague: movingAverage(asPercent(transformNull(stats_counts.zuul.pipeline.gate.job.gate-grenade-dsvm.FAILURE),sum(stats_counts.zuul.pipeline.gate.job.gate-grenade-dsvm.{SUCCESS,FAILURE})),'12hours') | 20:23 |
| *** jcoufal_ has quit IRC | 20:23 | |
| *** Piet has quit IRC | 20:24 | |
| *** nadya_ has quit IRC | 20:26 | |
| jeblair | sdague: i have a suspcion, which is probably impossible to prove now, that the original version of the graph behaved differently in the most recent 6-8 hours than the older sections | 20:28 |
| greghaynes | jeblair: Have you looked at the image upload times in the new clouds? I am kind of curious how it compares to rax (obviously not super important) | 20:28 |
| elmiko | clarkb: ok, couple more questions if you've got the time? | 20:28 |
| clarkb | elmiko: sure | 20:28 |
| *** otter768 has joined #openstack-infra | 20:29 | |
| *** annegentle has joined #openstack-infra | 20:29 | |
| *** rebase has joined #openstack-infra | 20:29 | |
| elmiko | so, the requirement i want (castellan>=0.2.0) is already in global-requirements.txt | 20:29 |
| *** sputnik13 has quit IRC | 20:29 | |
| elmiko | but i'm getting some sort of reqs based error on this review https://review.openstack.org/#/c/220680/ | 20:29 |
| elmiko | and it looks like it's complaining about me adding castellan to the requirements.txt | 20:30 |
| anteaya | clarkb: I currently have the output configured as stated on line 598: http://paste.openstack.org/show/479342/ I would like it to go to a file as well in addition to stdout, how do I do that? | 20:30 |
| jeblair | greghaynes: no, however, that data is highly suspect until we move uploads out of the main process anyway | 20:30 |
| elmiko | not sure what i've done wrong here | 20:30 |
| greghaynes | jeblair: Yep. I mostly wonder if we complete them by EOD | 20:30 |
| anteaya | clarkb: and I am seeing grokparse errors as you said | 20:30 |
| *** rebase has quit IRC | 20:31 | |
| greghaynes | or if were making images faster than we can upload them | 20:31 |
| clarkb | elmiko: was it a race between your job running and the req being added? | 20:32 |
| elmiko | clarkb: not that i know of | 20:32 |
| *** apoorvad has quit IRC | 20:32 | |
| elmiko | let me check the timing of that change in the reqs repo | 20:32 |
| ruagair | heya clarkb. My 05:00 start was a little ambitious. I'll read back. | 20:33 |
| *** sputnik13 has joined #openstack-infra | 20:33 | |
| clarkb | ya looks like it was added a while back | 20:33 |
| elmiko | yea | 20:33 |
| clarkb | ruagair: I ended up doing it with anteaya and mmedvede yesterday for which there are logs since we weren't gerriting and mmedvede was available then | 20:33 |
| *** otter768 has quit IRC | 20:33 | |
| *** aeng has joined #openstack-infra | 20:34 | |
| clarkb | ruagair: might start there and I can fill in blanks as needed? | 20:34 |
| clarkb | elmiko: the log sorts it out http://logs.openstack.org/80/220680/3/check/gate-sahara-requirements/4e73fc3/console.html#_2015-11-19_15_26_57_411 | 20:35 |
| *** rguillebert has quit IRC | 20:35 | |
| elmiko | clarkb: could this be because my addition to requirements.txt does not exactly match the line in global-requirements.txt? | 20:35 |
| clarkb | elmiko: the sets need to match and the comment is missing | 20:35 |
| elmiko | hehe | 20:35 |
| clarkb | elmiko: I think thats it yes | 20:35 |
| *** rlandy has quit IRC | 20:36 | |
| elmiko | clarkb: ok, thanks for the help. i was confused since the req is the same, but missing the comment. | 20:36 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add test for os_port Ansible module https://review.openstack.org/247778 | 20:36 |
| *** rlandy has joined #openstack-infra | 20:37 | |
| clarkb | greghaynes: the building images are currently in the hour range | 20:37 |
| clarkb | greghaynes: so they don't seem to have piled up (this is why I am not entirely convinced that the threads are the problem with rax) | 20:38 |
| clarkb | uploads to everywhere else seem fine | 20:38 |
| *** hdd has quit IRC | 20:38 | |
| greghaynes | It could be a network condition that is exacerbated by threads | 20:38 |
| clarkb | except there is only one thread | 20:39 |
| greghaynes | like, window size 0 from them, we fill up our buffers, get interrupted a lot to send more data | 20:39 |
| clarkb | since we do them serially | 20:39 |
| clarkb | and everyone else is happy | 20:39 |
| clarkb | but yes probably does deserve some tcpdumping if it persists | 20:39 |
| ruagair | Plan clarkb :-D | 20:39 |
| greghaynes | clarkb: sure, but I think jeblair mentioned uploads are a ton faster from command | 20:39 |
| clarkb | greghaynes: really? that wasn't my experience | 20:39 |
| jeblair | clarkb, greghaynes: yes, i don't know that the thread contention is the problem with _rax_. i _do_ believe it's a problem generally. like hours -> minutes. | 20:40 |
| clarkb | took hours for me to upload to rax and takes nodepoold hours | 20:40 |
| jeblair | i have not tried a manual upload to rax | 20:40 |
| greghaynes | ah | 20:40 |
| clarkb | jeblair: its only rax that is slow | 20:40 |
| clarkb | at least that is what I thought I had seen | 20:40 |
| jeblair | clarkb: well that's not what i saw uploading to ovh | 20:40 |
| * greghaynes tries not to make comment about how they needed swift for scale yet uploads are super slow | 20:40 | |
| clarkb | jeblair: remember that its serial in nodepoold | 20:40 |
| jeblair | clarkb: yep | 20:41 |
| clarkb | jeblair: so if rax is slow the ovh upload will apear slow | 20:41 |
| clarkb | jeblair: but if you take the logs of start stop for the specific image only rax was slow (granted I only looked at this when we had 2 providers) | 20:41 |
| jeblair | i think we need actual current data :) | 20:41 |
| *** annegentle has quit IRC | 20:41 | |
| greghaynes | sounds like a good stat to add in graphite | 20:42 |
| *** dkranz has quit IRC | 20:42 | |
| clarkb | so OpenStackCloudException: Image creation failed: a float is required (Inner Exception: a float is required) is fine | 20:42 |
| clarkb | er s/fine/fun/ | 20:43 |
| *** rfolco_ has quit IRC | 20:43 | |
| clarkb | rax uploads are not working at all | 20:43 |
| jeblair | i'm all out of floats | 20:43 |
| * clarkb ignore that and returns to answering the current question of time to upload from daemon to not rax | 20:43 | |
| jeblair | greghaynes: agreed, i think because it's special, and not run through the current task manager, it's currently not going to statsd. | 20:44 |
| clarkb | jeblair: `grep 'Uploading dib image' /var/log/nodepool/debug.log` shows you the timestamp between consequitive uploads | 20:45 |
| anteaya | ruagair: glad you are here, I have company at the moment but also happy to do the best I can fielding questions when I return | 20:45 |
| *** Sukhdev has quit IRC | 20:45 | |
| ruagair | thank anteaya | 20:45 |
| anteaya | ruagair: I enjoy having someone at the same level I am to talk to, it helps me to learn | 20:45 |
| clarkb | hrm actually that may just be the queueing :) | 20:45 |
| clarkb | er :( | 20:45 |
| pleia2 | huzzah, translate.o.o is upgraded to 3.7.3, drafting email to i18n team to let them know | 20:46 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Do not send 'router:external' unless it is set https://review.openstack.org/247700 | 20:47 |
| openstackgerrit | Merged openstack-infra/puppet-zanata: Switch the checksum type to SHA-1 https://review.openstack.org/232324 | 20:47 |
| anteaya | pleia2: \o/ | 20:47 |
| openstackgerrit | Merged openstack-infra/system-config: Set translate.openstack.org to 3.7.3 https://review.openstack.org/240383 | 20:47 |
| *** yamahata has quit IRC | 20:47 | |
| clarkb | graphit ehas nodepool.image_update | 20:47 |
| clarkb | so its there too | 20:48 |
| *** hashar has quit IRC | 20:48 | |
| openstackgerrit | Mike Dorman proposed openstack-infra/irc-meetings: Add Operators Large Deployment Team Meeting https://review.openstack.org/247725 | 20:49 |
| greghaynes | clarkb: oh nice | 20:52 |
| greghaynes | clarkb: does it... work? | 20:52 |
| greghaynes | I havent actually ever looked at our graphite, so probably about time I learn | 20:52 |
| clarkb | greghaynes: not sure I am still digigng in logs | 20:52 |
| clarkb | but noticed that in the code | 20:52 |
| *** sidbbt has joined #openstack-infra | 20:53 | |
| greghaynes | hrm, no stats for the past few days on ubuntu-trusty unless I just dont know how to graphite | 20:54 |
| clarkb | so I am actually not sure we serialize uploads | 20:54 |
| sdague | jeblair: thanks! | 20:54 |
| dougwig | repeat, but this time puppet actually did it's magic: hi infra, since https://review.openstack.org/#/c/174952/ merged, can you please add me to neutron-lib-core to bootstrap? | 20:54 |
| clarkb | we say for provider's dib image start a thread to upload imge | 20:55 |
| clarkb | and there doens't appear to be a queue or lock | 20:55 |
| *** maiteb has quit IRC | 20:55 | |
| *** abregman has joined #openstack-infra | 20:55 | |
| *** krtaylor has joined #openstack-infra | 20:55 | |
| *** maishsk has quit IRC | 20:55 | |
| *** maishsk has joined #openstack-infra | 20:56 | |
| *** tongli has quit IRC | 20:56 | |
| sdague | jeblair: yep, that looks like the ticket | 20:57 |
| greghaynes | clarkb: I am reading it the same | 20:57 |
| *** kozhukalov_ has quit IRC | 20:57 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/project-config: Fix group mapping for glance_store https://review.openstack.org/247782 | 20:57 |
| mriedem | clarkb: ^ it's that easy? | 20:57 |
| openstackgerrit | Merged openstack-infra/grafyaml: Default dashboard timezone to UTC https://review.openstack.org/244808 | 20:57 |
| clarkb | greghaynes: jeblair so ithink that is at least a bug | 20:57 |
| clarkb | and makes it hard to know if any one upload hapens in a reasonable amoutn of time | 20:58 |
| greghaynes | clarkb: does the log match that? | 20:58 |
| greghaynes | clarkb: (parallel uploads) | 20:58 |
| clarkb | greghaynes: seems too, many started none complete | 20:58 |
| clarkb | (except for the rax ones which have bailed out immediately because they need more floats to ride on) | 20:58 |
| clarkb | mriedem: yes +2 | 20:58 |
| *** ccarmack has joined #openstack-infra | 20:58 | |
| *** ccarmack has left #openstack-infra | 20:58 | |
| greghaynes | floats are pretty cool | 20:59 |
| rhallisey | clarkb, hey can I poke you for a review on https://review.openstack.org/#/c/238475/ | 20:59 |
| clarkb | greghaynes: but why are they required? | 20:59 |
| rhallisey | if you get a minute | 20:59 |
| greghaynes | *shrug* | 20:59 |
| clarkb | greghaynes: it owuld be awesome if the error actually said where the float was needed and what it is needed for | 20:59 |
| greghaynes | clarkb: Hey now, thats crazy talk | 20:59 |
| *** armax has quit IRC | 21:00 | |
| asselin | lifeless, you around? I'm running into this issue and I can't resolve it: AttributeError: '_socketobject' object has no attribute 'set_tlsext_host_name' | 21:00 |
| asselin | http://paste.openstack.org/show/479482/ | 21:00 |
| clarkb | jeblair: also isn't shade supposed to print the traceback for the inner exception? | 21:01 |
| clarkb | mordred: ^ | 21:01 |
| clarkb | that doesn't seem to be working | 21:01 |
| clarkb | asselin: you probably want to install requests[security] to get lal the deps | 21:02 |
| greghaynes | clarkb: how sure are you that we used to serialize uploads? | 21:02 |
| clarkb | greghaynes: pretty sure | 21:02 |
| *** abregman is now known as abregman|afk | 21:02 | |
| clarkb | but I wouldn't bet on it | 21:02 |
| clarkb | so ~50% | 21:02 |
| greghaynes | heh | 21:03 |
| clarkb | greghaynes: there was a queue | 21:03 |
| asselin | clarkb, yeah I had that and it was failing, so I reverted it | 21:03 |
| asselin | failing with the same stack trace * | 21:03 |
| greghaynes | clarkb: I thought that was just for building? | 21:03 |
| clarkb | greghaynes: so you put a bunch of upload image things onto a queue and a single thing pulled them off and uploaded | 21:03 |
| clarkb | greghaynes: I think it was tied together | 21:03 |
| clarkb | I dunno | 21:03 |
| greghaynes | it kind of is - you cant upload until a build finishes. | 21:03 |
| clarkb | flaper87: any idea what part of image uploading requires floats? | 21:05 |
| openstackgerrit | Merged openstack-infra/project-config: Add a job around using tripleo with docker https://review.openstack.org/238475 | 21:05 |
| sidbbt | asselin, quick question: i'm going to be setting up a CI log server using your script (install_log_server.sh). will the resulting system include a cron job that deletes logs older than a certain number of days? or should i plan on doing that myself? | 21:06 |
| asselin | sidbbt, yeah it will delete after 90 days | 21:06 |
| *** amuller has quit IRC | 21:07 | |
| asselin | sidbbt, btw there are updated instructions if you want to try them | 21:07 |
| *** rossella_s has quit IRC | 21:07 | |
| sidbbt | asselin, where can i find them? | 21:07 |
| asselin | sidbbt, https://github.com/openstack-infra/puppet-openstackci/blob/master/contrib/README.md#setup-the-log-server | 21:07 |
| asselin | but start reading from the top | 21:07 |
| *** rossella_s has joined #openstack-infra | 21:07 | |
| *** sabeen1 has joined #openstack-infra | 21:08 | |
| *** pfallenop has quit IRC | 21:08 | |
| *** e0ne has joined #openstack-infra | 21:08 | |
| *** baoli has quit IRC | 21:08 | |
| *** sabeen2 has quit IRC | 21:09 | |
| onovy | hi, https://review.openstack.org/#/c/244597/ pls some final +A? | 21:09 |
| *** rlandy has quit IRC | 21:10 | |
| *** mfalatic_ has quit IRC | 21:10 | |
| *** pfallenop has joined #openstack-infra | 21:10 | |
| *** annegentle has joined #openstack-infra | 21:11 | |
| sidbbt | asselin, thanks. do your scripts essentially automate some of this stuff? i ask because i've just finished setting up a fully functional CI for cinder. i'm just working on the last remaining task which is moving the log server to a public-facing IP. i used your os-ext-testing repo for all my work. i'm going to be documenting my work so that my co-workers can rebuild the CI in the future if needed. should we continue to use your scripts? or should we | 21:12 |
| sidbbt | use these new instructions instead? | 21:12 |
| clarkb | greghaynes: each worker will serialize its own upload right? | 21:12 |
| greghaynes | clarkb: yes | 21:13 |
| * clarkb decides best course of action is to review those changes again and push to get them merged | 21:13 | |
| greghaynes | clarkb: it doesnt thread at all | 21:13 |
| clarkb | otherwise we will just cause problems | 21:13 |
| clarkb | and overhead on workers | 21:13 |
| *** Piet has joined #openstack-infra | 21:13 | |
| greghaynes | Yep | 21:13 |
| *** rlandy has joined #openstack-infra | 21:13 | |
| asselin | sidbbt, please use the new scripts | 21:13 |
| greghaynes | Fixing bugs right now in image uploading or building is really not fun | 21:13 |
| asselin | sidbbt, it's almost the same, but long-term wise the new approach is better | 21:13 |
| sidbbt | asselin, great, thanks! | 21:14 |
| asselin | sidbbt, also it is the community-supported edition | 21:14 |
| asselin | sidbbt, it should be straight forward to switch | 21:15 |
| * asselin update docs suggesting people to switch | 21:15 | |
| *** ningy_ has joined #openstack-infra | 21:16 | |
| openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/system-config: Add docs for renaming an IRC channel https://review.openstack.org/244860 | 21:17 |
| ningy_ | @here anyone could help me with a question with jenkins job function pre_test_hook? | 21:17 |
| ningy_ | my question is when does this get called? and does it take shell command? | 21:18 |
| *** cloudtrainme has quit IRC | 21:20 | |
| *** sdake has quit IRC | 21:21 | |
| *** krtaylor has quit IRC | 21:22 | |
| mordred | clarkb: yes | 21:23 |
| openstackgerrit | Merged openstack-infra/shade: Add test for os_user_group Ansible module https://review.openstack.org/247105 | 21:24 |
| mordred | clarkb: you got a place where this is happening? (or not happening?) | 21:24 |
| *** maishsk has quit IRC | 21:24 | |
| *** kgiusti has quit IRC | 21:25 | |
| *** peristeri has quit IRC | 21:25 | |
| *** yamahata has joined #openstack-infra | 21:25 | |
| *** jtrovo has quit IRC | 21:25 | |
| *** sabeen1 has quit IRC | 21:25 | |
| *** abregman|afk is now known as abregman | 21:28 | |
| greghaynes | mordred: I think image upload logs are showing a FloatRequired exception without TB | 21:29 |
| *** thiagop has quit IRC | 21:29 | |
| *** e0ne has quit IRC | 21:30 | |
| *** abregman is now known as abregman|nearby | 21:30 | |
| *** apoorvad has joined #openstack-infra | 21:30 | |
| *** kushal has quit IRC | 21:31 | |
| clarkb | mordred: in the nodepool debug log all image uploads to rax fail because a float is required | 21:31 |
| clarkb | mordred: I can paste | 21:31 |
| clarkb | mordred: http://paste.openstack.org/show/479489/ | 21:32 |
| clarkb | ningy_: it is a devstack-gate hook and is called before devstack-gate runs the test hook which installs openstack and runs tempest | 21:32 |
| clarkb | ningy_: it needs to be a bash function | 21:32 |
| mordred | clarkb: thanks | 21:32 |
| *** Steap has quit IRC | 21:33 | |
| *** Steap has joined #openstack-infra | 21:33 | |
| mordred | clarkb: oh - you know what - I'm not sure we've ever added shade debug loging config to the nodepool logging config | 21:33 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Add sdague's tempest graphs to grafana https://review.openstack.org/247797 | 21:34 |
| jeblair | mordred: we don't want shade debug logging | 21:34 |
| *** maishsk has joined #openstack-infra | 21:34 | |
| mordred | jeblair: we do if we want tracebacks from innner exceptions | 21:34 |
| jeblair | gah | 21:34 |
| jeblair | mordred: i thought the whole point of all of that work was so that we don't have to have shade debug logging | 21:35 |
| ningy_ | clarkb: so, can I use pre_test_hook function with couple bash command lines for some pre test setup? | 21:35 |
| clarkb | ningy_: yes | 21:36 |
| ningy_ | clarkb: thanks | 21:36 |
| mordred | jeblair: no - it was to clean up the debug logging so that it was sane logging. however, we _can_ just setup a loging handler for shade.exc which is where all of the exceptions will go | 21:36 |
| jesusaurus | clarkb: do you think you'll get a chance to review the range headers change again soon? | 21:37 |
| clarkb | jesusaurus: oh right that yes I should just do that now because its important | 21:37 |
| clarkb | jesusaurus: also you may want to compare https://review.openstack.org/#/c/190345/1/modules/openstack_project/templates/logstash/indexer.conf.erb to the change I made for making multiline less bad in logstash 2.0 | 21:37 |
| clarkb | jesusaurus: its a different approach but I think the logstash 2.0 one is a bit mor ecomplete? | 21:38 |
| mordred | we have, however, done a lot more cleanups in the exception wrapping since hte versoin that's currently running in nodepool (including not wrapping already wrapped exceptions) | 21:38 |
| jeblair | mordred: i believe it logs at error level | 21:39 |
| jeblair | it==shade inner exceptions | 21:39 |
| mordred | jeblair: oh. sorry. yes. error logging not debug logging. I think what I meant was "I'm not sure we set up logging handlers for shade things" | 21:39 |
| mtreinish | mordred: wait you log exceptions at debug level? | 21:39 |
| *** cloudtrainme has joined #openstack-infra | 21:39 | |
| mordred | mtreinish: no. sorry - I was mis-speaking focused on the wrong topic | 21:39 |
| jeblair | mordred: whew. that's way much different. :) | 21:39 |
| mtreinish | mordred: ok | 21:39 |
| openstackgerrit | Jay_Clark proposed openstack-infra/irc-meetings: Adding the new OpenStack Vahana weekly team meeting. https://review.openstack.org/247799 | 21:40 |
| mordred | yah. SORRY - I was juggling two conversations - my bad | 21:40 |
| clarkb | jesusaurus: those tests are good too | 21:40 |
| openstackgerrit | Jay_Clark proposed openstack-infra/irc-meetings: Adding the new OpenStack Vahana weekly team meeting. https://review.openstack.org/247799 | 21:41 |
| *** daemontool_ has quit IRC | 21:41 | |
| *** Swami has quit IRC | 21:42 | |
| *** kozhukalov_ has joined #openstack-infra | 21:42 | |
| mordred | ok. that failure is from iterate_timeout - it's being passed a string instead of an digit | 21:42 |
| *** daemontool_ has joined #openstack-infra | 21:42 | |
| mordred | one sec, I'll find the actual root cause of that | 21:42 |
| jeblair | mordred: anything interesting at warning level? | 21:42 |
| mordred | (and make a patch to make sure it's ok) | 21:42 |
| mordred | jeblair: don't think so, no | 21:42 |
| mordred | jeblair: just warnings from requests about how we all have bad certs | 21:42 |
| *** EricGonczer_ has quit IRC | 21:44 | |
| openstackgerrit | James E. Blair proposed openstack-infra/system-config: Add shade logging to nodepool https://review.openstack.org/247802 | 21:44 |
| *** Swami has joined #openstack-infra | 21:44 | |
| jeblair | mordred, clarkb: ^ | 21:44 |
| jeblair | mordred: does that mean there's a part of shade that isn't test-covered? | 21:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Make sure timeouts are floats https://review.openstack.org/247803 | 21:45 |
| mordred | jeblair: possibly. I'm still looking in to how that got there | 21:45 |
| mordred | jeblair: we did some work over the past few weeks to ensure the correct data types on stuff | 21:45 |
| jesusaurus | clarkb: is build_uuid unique to the job or unique to the zuul ref? | 21:45 |
| *** jlvillal has quit IRC | 21:46 | |
| mordred | jeblair: which is not in prod on nodepool yet - but I'm going to poke a little and see if it's a new problem or one we've alreayd fixed and tested | 21:46 |
| mordred | jeblair: (I don't want to say "oh, just upgrade" if there _is_ a test hole) | 21:46 |
| jesusaurus | clarkb: as long as we assume single-use slaves, we know that the build_node will map to a single job run | 21:46 |
| jesusaurus | clarkb: but yes, those two changes have some similarity :) | 21:46 |
| jeblair | jesusaurus: it's unique to the build, where a 'build' is a single run of a job. | 21:47 |
| clarkb | jesusaurus: its unique to the job not the ref | 21:47 |
| *** aysyd has quit IRC | 21:47 | |
| clarkb | jesusaurus: though now that you make me think of it there is a bug with it | 21:48 |
| *** jlvillal has joined #openstack-infra | 21:48 | |
| clarkb | actually no no bug | 21:48 |
| clarkb | thought that subnode logs would have the same filename but they have a different relative path so are different | 21:48 |
| jeblair | clarkb: a build isn't a job | 21:48 |
| clarkb | in both cases | 21:48 |
| *** Sukhdev has joined #openstack-infra | 21:48 | |
| clarkb | jeblair: the uuid is new for every submission to gearman right? | 21:49 |
| jesusaurus | also, i didn't know that bug about bug causing stale multiline events to combine logs together | 21:49 |
| jeblair | clarkb: yes | 21:50 |
| clarkb | jesusaurus: its only an issue of the first line of a file is not a match | 21:50 |
| clarkb | jeblair: then it should work in this instance | 21:50 |
| jeblair | clarkb: right, not arguing that -- just trying to be precise since there was a question about terminology :) | 21:50 |
| clarkb | basically the logs in logstash have a uuid unique to that jenkins thing | 21:50 |
| clarkb | ah | 21:50 |
| jeblair | but yep -- even if there's a gate reset and the same job runs again for the same change, that build will get a new zuul_uuid | 21:51 |
| mordred | jeblair: ok. there is no config in clouds.yaml or nodepool that sets a timeout for that image operation, nor does nodepool pass a specific value | 21:51 |
| jeblair | mordred: so something funky in shadeland? | 21:52 |
| jesusaurus | jeblair: thanks, thats good to know | 21:52 |
| mordred | jeblair: I don't see any code in 1.0.0 (which is what nodepool is currently running) that would get a string into that function on that codepath | 21:52 |
| jeblair | mordred: will we see this with a manual image upload? | 21:52 |
| jeblair | (via nodepool image-upload) | 21:52 |
| mordred | jeblair: if it's to rax, yes, you should | 21:52 |
| jeblair | so we can do that with a custom log config and see the actual exception | 21:53 |
| jeblair | i will do that | 21:53 |
| mordred | Shrews: if you happen to be around: https://review.openstack.org/#/c/247803/ I can't figure out any way a non-float gets in to there from create_image | 21:54 |
| mordred | jeblair: ++ | 21:54 |
| clarkb | jesusaurus: approved, any chance you cna keep an eye on it via puppetboard and do some curling once its in? | 21:54 |
| openstackgerrit | Christopher Aedo proposed openstack-infra/puppet-apps_site: Add python WSGI server https://review.openstack.org/245315 | 21:55 |
| mordred | Shrews: but clarkb got http://paste.openstack.org/show/479489/ (this is running 1.0.0) - and passing a string to time.wait() gives that exact error message | 21:55 |
| clarkb | mordred: is there a timeout in our yaml config that is quited or something? | 21:55 |
| Shrews | mordred: looking | 21:55 |
| clarkb | so that it isn't an int/float but is a str? | 21:55 |
| Shrews | mordred: occ version? | 21:55 |
| mordred | clarkb: nope | 21:55 |
| jhesketh | Morning | 21:55 |
| mordred | Shrews: 1.10.2 | 21:56 |
| clarkb | jhesketh: morning | 21:56 |
| mordred | Shrews: but there are no timeouts configured in clouds.yaml or nodepool.yaml on that machine | 21:56 |
| clarkb | jesusaurus: I left a comment for future improvment | 21:56 |
| mordred | Shrews: nor does nodepool pass a value to the timeout parameter of create_image | 21:56 |
| clarkb | jesusaurus: basically reduce the number of slices since that makes a data copy which can possibly be slow | 21:56 |
| mordred | (so it basically just uses the default value for create_image timeout) | 21:56 |
| *** bcourt has quit IRC | 21:57 | |
| lifeless | asselin: looking | 21:57 |
| jesusaurus | clarkb: sure, I can keep an eye on it | 21:58 |
| jeblair | clarkb, mordred: how long after upload till the error hits? | 21:58 |
| lifeless | asselin: https://github.com/pypa/pip/issues/2696 | 21:58 |
| clarkb | jeblair: I think it was almost immediate | 21:59 |
| jeblair | clarkb, mordred: rather, how long after start of upload | 21:59 |
| jeblair | hrm | 21:59 |
| mordred | should be immediate | 21:59 |
| mordred | it's in iterate_timeout | 21:59 |
| mordred | oh. wait | 21:59 |
| mordred | no | 21:59 |
| jeblair | cause 'nodepool image-upload rax-dfw fedora-22' is working | 21:59 |
| Shrews | mordred: are you sure it's not None? | 21:59 |
| mordred | yeah | 21:59 |
| mordred | jeblair: swift upload has to happen | 21:59 |
| mordred | jeblair: it'll be immediately after the glance task-status poll loop happens | 22:00 |
| jeblair | okay. patience. | 22:00 |
| Shrews | mordred: _upload_image_task() has a default timeout of None, which produces the same error | 22:01 |
| jeblair | sdague, pabelanger: https://review.openstack.org/247797 | 22:01 |
| *** changbl has quit IRC | 22:01 | |
| mordred | Shrews: but doesn't the upper layer pass in the timeout which defaults to 3600 ? | 22:01 |
| openstackgerrit | Louis Taylor proposed openstack-infra/project-config: Add releasenotes jobs for searchlight https://review.openstack.org/247807 | 22:01 |
| mordred | Shrews: (good point though) | 22:01 |
| jeblair | sdague, pabelanger: i think we're missing ymin, ymax, etc... yeah? but maybe that's a start | 22:01 |
| Shrews | mordred: ah, you're right | 22:01 |
| mordred | Shrews: we should actuall just remove the default value from the inner method | 22:02 |
| mordred | Shrews: since it's never intended to be called without a value from above | 22:02 |
| *** changbl has joined #openstack-infra | 22:02 | |
| Shrews | mordred: doesn't seem likely from a shade perspective, so no clue | 22:02 |
| *** bswartz has quit IRC | 22:02 | |
| jeblair | o hey! the graphite whisper resize is done! | 22:02 |
| *** dims has joined #openstack-infra | 22:02 | |
| pabelanger | jeblair: looking | 22:03 |
| mordred | jeblair: woot! | 22:03 |
| nibalizer | jeblair: woot | 22:03 |
| pabelanger | jeblair: Ya, we can add them. I haven't used them yet | 22:03 |
| jeblair | clarkb, mordred, Shrews: http://paste.openstack.org/show/479498/ | 22:04 |
| mordred | jeblair: exciting | 22:04 |
| openstackgerrit | Merged openstack-infra/os-loganalyze: Add support for rfc7233 range headers. https://review.openstack.org/241058 | 22:04 |
| openstackgerrit | Merged openstack-infra/grafyaml: Refactor Panel class https://review.openstack.org/241711 | 22:05 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Remove default values from innner method https://review.openstack.org/247809 | 22:05 |
| jeblair | we dropped from 901G to 338G used in graphite | 22:05 |
| openstackgerrit | Merged openstack-infra/grafyaml: Add unit test coverage for panels https://review.openstack.org/241750 | 22:05 |
| mordred | oh! wow | 22:05 |
| *** cburgess_ has quit IRC | 22:05 | |
| mordred | jeblair: thank you for running that - that's in a different place than I expected | 22:05 |
| *** cburgess has joined #openstack-infra | 22:06 | |
| openstackgerrit | Merged openstack-infra/system-config: Pull o_p::server out of gerrit role https://review.openstack.org/245341 | 22:06 |
| *** trown is now known as trown|outttypeww | 22:06 | |
| pabelanger | jeblair: actually, do you mind cutting a new release of grafyaml? | 22:06 |
| jeblair | mordred: yeah...something relating to swiftclient and socket timeouts? | 22:06 |
| *** sridhar_ram1 has joined #openstack-infra | 22:06 | |
| mordred | 'api_timeout': None | 22:06 |
| mordred | yup | 22:06 |
| *** asselin has quit IRC | 22:07 | |
| sdague | jeblair: cool, I typically adhoc this based on what I'm suspecting about jobs, but that's not a bad baseline to have up there | 22:07 |
| mordred | so None as a value to api_timeout is apparently not great | 22:07 |
| *** sridhar_ram has quit IRC | 22:07 | |
| *** asselin has joined #openstack-infra | 22:08 | |
| jeblair | pabelanger: fd09f80b1effb006698ddd7fdb327662c73d211f Merge "Add unit test coverage for panels" ? | 22:08 |
| *** abregman|nearby has quit IRC | 22:09 | |
| pabelanger | jeblair: yes please | 22:09 |
| Shrews | mordred: fwiw, adding a test for os_image is next on my list | 22:09 |
| jeblair | pabelanger: pushed | 22:09 |
| pabelanger | jeblair: danke | 22:09 |
| *** bcourt has joined #openstack-infra | 22:10 | |
| Shrews | i suspect our functional tests are lacking, too | 22:10 |
| mordred | hrm. grumble | 22:10 |
| mordred | requests docs seem to indicate that None is a perfectly acceptable thing to pass | 22:10 |
| mordred | If the remote server is very slow, you can tell Requests to wait forever for a response, by passing None as a timeout value and then retrieving a cup of coffee. | 22:11 |
| *** abregman|nearby has joined #openstack-infra | 22:11 | |
| pabelanger | jeblair: I'll start work on the grid elements later tonight | 22:12 |
| *** cloudtrainme has quit IRC | 22:13 | |
| openstackgerrit | Michael Jeanson proposed openstack-infra/jenkins-job-builder: Add matrixOptions to throttle properties module https://review.openstack.org/241699 | 22:13 |
| *** ddieterly has quit IRC | 22:14 | |
| *** maishsk_ has joined #openstack-infra | 22:14 | |
| *** eharney has quit IRC | 22:15 | |
| *** ggillies has joined #openstack-infra | 22:15 | |
| *** maishsk has quit IRC | 22:16 | |
| *** maishsk_ is now known as maishsk | 22:16 | |
| docaedo | Dearest infra - would love some feedback on https://review.openstack.org/#/c/245315/ - no longer does virtual environments, and now all things work as expected in my infra-test environment. We're ready to switch the site over to this whenever you are :) | 22:16 |
| *** pradk has quit IRC | 22:16 | |
| openstackgerrit | Michael Jeanson proposed openstack-infra/jenkins-job-builder: Add 'do-not-fingerprint' to 'copyartifact' builder https://review.openstack.org/219312 | 22:17 |
| *** dprince has quit IRC | 22:17 | |
| docaedo | and reviewing that might serve as a peaceful break from the normally complicated hard to debug sorts of things you're usually dealing with | 22:17 |
| *** tonytan4ever has quit IRC | 22:17 | |
| *** sdake has joined #openstack-infra | 22:19 | |
| *** cloudtrainme has joined #openstack-infra | 22:20 | |
| *** alivigni has quit IRC | 22:20 | |
| *** camunoz has quit IRC | 22:21 | |
| *** baoli_ has joined #openstack-infra | 22:22 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Fix tempest-dsvm-neutron-src job template https://review.openstack.org/247817 | 22:24 |
| *** gildub has joined #openstack-infra | 22:25 | |
| *** pahuang_ has joined #openstack-infra | 22:25 | |
| dims | sdague : clarkb : found a problem with the template that just got merged, here's a fix - https://review.openstack.org/#/c/247817/ | 22:26 |
| clarkb | looking | 22:26 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Fix tempest-dsvm-neutron-src job template https://review.openstack.org/247817 | 22:27 |
| dims | clarkb "local" causing problems clarkb | 22:27 |
| *** annegentle has quit IRC | 22:27 | |
| dims | clarkb example log in http://logs.openstack.org/00/247600/1/check/gate-tempest-dsvm-neutron-src-futurist/d9bc548/console.html#_2015-11-19_21_54_41_958 | 22:27 |
| *** dingyichen has joined #openstack-infra | 22:28 | |
| clarkb | thats an easy approve | 22:28 |
| dims | thank you! | 22:28 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add ability to opt-in to upgrading modules https://review.openstack.org/247755 | 22:28 |
| *** ayoung has quit IRC | 22:28 | |
| lifeless | mordred: clarkb: https://review.openstack.org/#/c/247306/ | 22:29 |
| lifeless | ^- would move the constraints work to the next level | 22:29 |
| *** otter768 has joined #openstack-infra | 22:29 | |
| lifeless | since we'll be able to document the full end to end migration and encourage folk to do it | 22:29 |
| clarkb | lifeless: needs neutron CI liason ack first | 22:29 |
| lifeless | clarkb: it has teh neutron PTL ack | 22:30 |
| lifeless | clarkb: but sure who is the neutron CI liason ? | 22:30 |
| clarkb | it does not have ptl ack on the change | 22:30 |
| clarkb | ptl is liason | 22:30 |
| lifeless | oh sorry, armax | 22:30 |
| * lifeless confused | 22:30 | |
| *** tiswanso has quit IRC | 22:32 | |
| lifeless | clarkb: if you could at least check its sane that would be useful | 22:32 |
| mordred | Shrews, jeblair: competing documentation batman | 22:32 |
| mordred | Shrews, jeblair: this works as we have it for everywhere that is not swift because we use keystoneauth session | 22:32 |
| mordred | and keystoneauth session has: | 22:32 |
| mordred | if timeout is not None: | 22:32 |
| mordred | self.timeout = float(timeout) | 22:33 |
| mordred | BUT | 22:33 |
| mordred | swiftclient doesn't use keystoneauth | 22:33 |
| notmyname | (yet) | 22:33 |
| mordred | yah | 22:33 |
| mordred | but it means we need to do the work for now | 22:33 |
| mordred | which is fine - I wrote the patch already | 22:33 |
| crinkle | i think https://review.openstack.org/#/c/234984/ is stuck, can someone toggle the +W? | 22:33 |
| mordred | I was just wondering how this wasn't more broken | 22:33 |
| mordred | notmyname: your swift alerts continue to work well :) | 22:34 |
| ianw | infra-roots : anyone got a minute to tell me what's on the console of the f22 node we bring up? it seems it is not booting. nodepool build of the image is ok | 22:34 |
| openstackgerrit | JJ Asghar proposed openstack-infra/irc-meetings: Added the meeting_id and the agenda_url https://review.openstack.org/247818 | 22:34 |
| notmyname | mordred: yeah. I've been watching as you've been mentioning it. is there something you need me to take a loot at? | 22:34 |
| *** otter768 has quit IRC | 22:34 | |
| mordred | notmyname: nope. this is consume-side problems on our side | 22:34 |
| mordred | notmyname: straight up bug | 22:34 |
| notmyname | ok | 22:35 |
| *** thorst has quit IRC | 22:35 | |
| mordred | notmyname: it does motivate me to write you some keystoneauth patches | 22:35 |
| mordred | but that was on my list anyway | 22:35 |
| notmyname | yay ;-) | 22:35 |
| openstackgerrit | Tony Breeds proposed openstack-infra/meetbot: Add warning if starting a meeting in an unrecognised channel https://review.openstack.org/246695 | 22:37 |
| *** thorst has joined #openstack-infra | 22:37 | |
| clarkb | greghaynes: https://review.openstack.org/#/c/198114/32/nodepool/builder.py line 149, is that going to be decimal? otherwise I think you need to provide the encoding? | 22:37 |
| *** baoli_ has quit IRC | 22:37 | |
| stevemar_ | mordred: i love that you're the biggest supporter of keystoneauth | 22:38 |
| *** baoli has joined #openstack-infra | 22:38 | |
| clarkb | greghaynes: sorry for the int() cast | 22:38 |
| mtreinish | mordred, jeblair, clarkb, nibalizer: if you get a sec: https://review.openstack.org/246041 and https://review.openstack.org/246686 should be fairly straightforward | 22:38 |
| stevemar_ | just going around different projects, swooping in and writing patches for ksa and occ | 22:39 |
| mordred | stevemar_: I will get everyone consuming it by the end of this cycle if it's the only thing I do | 22:39 |
| openstackgerrit | Mateusz Matuszkowiak proposed openstack-infra/project-config: Added two new Fuel plugins in OpenStack namespace https://review.openstack.org/247821 | 22:39 |
| greghaynes | clarkb: I'm confused. What is the error youre worried about? | 22:39 |
| mordred | stevemar_: now that I know all of the things it does - it's like a set of 20 things that the only thing you can do differently is get them wrong | 22:39 |
| *** camunoz has joined #openstack-infra | 22:40 | |
| stevemar_ | mordred: if you make that happen i will get you a unicorn | 22:40 |
| stevemar_ | a legit unicorn | 22:40 |
| greghaynes | clarkb: Are you worried that I need to decode? | 22:40 |
| clarkb | greghaynes: yes int('45ab') fails | 22:40 |
| clarkb | needs ot be 0x45ab | 22:41 |
| clarkb | er even that fails beause still trying base10 | 22:41 |
| *** thorst has quit IRC | 22:42 | |
| greghaynes | clarkb: oh, I thought we were base 10 encoding the image id's | 22:42 |
| greghaynes | clarkb: we are | 22:42 |
| *** sdake has quit IRC | 22:43 | |
| clarkb | oh for some reason I thought they wree base16 oh I am confusing the provider id with the actual nodepool id | 22:43 |
| clarkb | derp | 22:43 |
| clarkb | carry on | 22:43 |
| mordred | stevemar_: I've always wanted a unicorn | 22:43 |
| openstackgerrit | Merged openstack/requirements: Bump oslo.versionedobjects>=0.13.0 https://review.openstack.org/245990 | 22:44 |
| *** burgerk has quit IRC | 22:46 | |
| jesusaurus | clarkb: range headers work now \o/ | 22:47 |
| *** sabeen1 has joined #openstack-infra | 22:47 | |
| openstackgerrit | Merged openstack-infra/project-config: Rework pipeline singlestat panel https://review.openstack.org/244747 | 22:47 |
| anteaya | clarkb: I've got some things to do here and will be offline tomorrow, I'll touch base with you on logstash on Monday | 22:48 |
| clarkb | anteaya: ok enjoy the weekend | 22:48 |
| anteaya | thanks you too | 22:48 |
| dims | clarkb : the check job on that review just failed :( - https://jenkins06.openstack.org/job/gate-project-config-compare-xml/19/consoleFull | 22:50 |
| dims | clarkb : review was https://review.openstack.org/#/c/247817/ | 22:51 |
| clarkb | dims: I think its supposed to fail means there is a difference | 22:51 |
| clarkb | should be non voting? | 22:51 |
| clarkb | yup | 22:51 |
| clarkb | its a sanity check job not a gate job | 22:51 |
| dims | whew! got scared | 22:52 |
| dims | thanks | 22:52 |
| jeblair | ianw: did you get a response? | 22:52 |
| ianw | jeblair: not yet | 22:52 |
| *** mriedem has quit IRC | 22:53 | |
| *** baoli has quit IRC | 22:53 | |
| *** baoli has joined #openstack-infra | 22:54 | |
| *** thorst has joined #openstack-infra | 22:54 | |
| clarkb | greghaynes: for https://review.openstack.org/#/c/232800/7/nodepool/config.py what part of the workers needs to care about secure.conf? | 22:56 |
| jeblair | ianw: ok, be with you in a few mins | 22:56 |
| clarkb | greghaynes: shouldn't it be reading only .yal things? | 22:56 |
| clarkb | oh upload derp | 22:56 |
| clarkb | except that chang edoens't seem to make the upload (provider) related stuff compat | 22:57 |
| greghaynes | clarkb: it shouldnt need secure.conf | 22:57 |
| clarkb | so at the very least I think that chang eis buggy since it doesn't do the provider things | 22:57 |
| greghaynes | clarkb: it needs to be ok not having it | 22:57 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Added the meeting_id and the agenda_url https://review.openstack.org/247818 | 22:58 |
| clarkb | greghaynes: ok not hvaing what? | 22:58 |
| openstackgerrit | Yan Ning proposed openstack-infra/project-config: add seperate builder/job for monasca plugin in devstack install https://review.openstack.org/244893 | 22:58 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Pin jaraco requirements to working versions https://review.openstack.org/247092 | 22:58 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Adding the new OpenStack Vahana weekly team meeting. https://review.openstack.org/247799 | 22:58 |
| *** cgalan has joined #openstack-infra | 22:58 | |
| clarkb | greghaynes: it doesn't nee the dburi or the jenkins stuff but it does need the provider things | 22:58 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from global requirements https://review.openstack.org/247650 | 22:58 |
| *** erlon has quit IRC | 22:59 | |
| clarkb | and the provider stuff isn't made compat there | 22:59 |
| *** thorst has quit IRC | 22:59 | |
| clarkb | so you still require the secure.conf | 22:59 |
| clarkb | * you still require the info from somewhere | 22:59 |
| *** regXboi has quit IRC | 22:59 | |
| greghaynes | clarkb: I must be missing some context. The only change there should be that you can run that method without secure.conf specified. | 22:59 |
| clarkb | oh wait we basically reqire oscc for that now nevermind they are unrelated | 23:00 |
| greghaynes | yea | 23:00 |
| clarkb | greghaynes: ya so builers need oscc but not secure.conf | 23:00 |
| greghaynes | yep, and they explicitly need to be ok with no swcure.conf | 23:01 |
| openstackgerrit | Merged openstack-infra/project-config: Fix group mapping for glance_store https://review.openstack.org/247782 | 23:01 |
| clarkb | right as its not necessary | 23:01 |
| openstackgerrit | Merged openstack-infra/project-config: Fix tempest-dsvm-neutron-src job template https://review.openstack.org/247817 | 23:01 |
| *** sabeen3 has joined #openstack-infra | 23:02 | |
| clarkb | greghaynes: though https://review.openstack.org/#/c/232800/7/nodepool/cmd/nodepoolcmd.py still requires it | 23:02 |
| *** sridhar_ram1 has quit IRC | 23:02 | |
| clarkb | because all of those commands hit the db | 23:02 |
| clarkb | s/all/many/ | 23:02 |
| greghaynes | clarkb: yep, later patch fixes that | 23:02 |
| *** sabeen1 has quit IRC | 23:02 | |
| *** changbl has quit IRC | 23:03 | |
| clarkb | greghaynes: should it be fixed in that change? I am just trying to wrap my head around how this fits together | 23:03 |
| clarkb | seems like simplest fix is make loadYamlConfig and loadSecureConfig separate | 23:03 |
| clarkb | then call both in nodepoold/commands and just yaml config from workers/ | 23:03 |
| jeblair | mtreinish: looking at the puppet docs, i'm not actually sure whether the posix or shell provider -- i think it should use posix but then i don't know why any redirection is happening. | 23:03 |
| *** sridhar_ram has joined #openstack-infra | 23:04 | |
| greghaynes | clarkb: it would, but I was trying to not snowball | 23:04 |
| clarkb | ya problem is it already snowballed | 23:04 |
| jeblair | mtreinish: i think it bears either experimentation or closer examination by someone more puppet-experty | 23:04 |
| * clarkb doesn't want to argue merits of backward compat or not, just wants working image uploads | 23:04 | |
| *** sidbbt has quit IRC | 23:05 | |
| mtreinish | jeblair: ok, I'm thinking I should just do a 1 line bash script anyway to be more explicit about it | 23:05 |
| greghaynes | clarkb: yea, so basically that would be just merge together that change and the db dwcoupling change which I am kind of meh on since they are ok on their own | 23:05 |
| jeblair | mtreinish: that's rarely a bad choice | 23:05 |
| mtreinish | we've been bit by the puppet shell game before | 23:05 |
| clarkb | greghaynes: let me read the next one then | 23:05 |
| jeblair | s/shell// | 23:06 |
| mtreinish | jeblair: ok, I'll respin it like that in a second | 23:06 |
| mtreinish | jeblair: heh, I was trying to be clever :) | 23:06 |
| sc68cal | hey- dumb question for zuul people - what does NOT_REGISTERED mean for a job that is supposed to run on the experimental queue, but didn't | 23:06 |
| greghaynes | clarkb: I might be able to swap the ordering, actually | 23:06 |
| sc68cal | what did I mess up | 23:06 |
| greghaynes | not sure it really matters too much though | 23:06 |
| clarkb | sc68cal: that means no jenkins slvae registered the job with gearman yet | 23:07 |
| *** niedbalski has quit IRC | 23:07 | |
| *** ningy_ has quit IRC | 23:07 | |
| clarkb | sc68cal: this could be becase we have none of those slaves, or zuul and jenkins disagree on what label should be used to run the job | 23:07 |
| *** baoli has quit IRC | 23:07 | |
| *** niedbalski has joined #openstack-infra | 23:07 | |
| *** annegentle has joined #openstack-infra | 23:08 | |
| *** baoli has joined #openstack-infra | 23:09 | |
| clarkb | greghaynes: it doesn't look like the next change fixes the nodepoolcmd thing | 23:10 |
| jeblair | ianw: looking | 23:10 |
| *** jbryce has quit IRC | 23:10 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Fix job definition for ceph-src jobs https://review.openstack.org/247832 | 23:10 |
| mtreinish | mrodden: ^^^ | 23:10 |
| sc68cal | clarkb: ack - thanks for the info | 23:10 |
| *** toabctl has quit IRC | 23:11 | |
| greghaynes | clarkb: it removed the db stuff. The command parts arent fixed until there is a separate builder command | 23:11 |
| mtreinish | mrodden: oh, sry I meant the other IBM Matt, who is offline now | 23:11 |
| sc68cal | clarkb: is there anything I need to do to fix it or is it just the case where it eventually will get scheduled | 23:11 |
| mtreinish | so tab complete failed me | 23:11 |
| clarkb | greghaynes: it doesn't remove the db stuff for say list or image-list | 23:11 |
| clarkb | greghaynes: so end state is that db is still required most places | 23:11 |
| clarkb | sc68cal: depends on how it is broken :) but without knowing what job it was I can't help much more | 23:12 |
| jeblair | um, does anyone know where hpcloud put their management interface after the corporate split? | 23:12 |
| sc68cal | clarkb: ah. sorry. gate-grenade-dsvm-neutron-multinode | 23:12 |
| greghaynes | clarkb: yes, those are nodepool commands? | 23:12 |
| clarkb | greghaynes: ya | 23:12 |
| clarkb | greghaynes: they talk direclty to the db to list things | 23:12 |
| *** jbryce has joined #openstack-infra | 23:13 | |
| jeblair | our password file says http://manage.hpcloud.com/ which is not working for me | 23:13 |
| greghaynes | yes, I am unclear on what the issue it. | 23:13 |
| *** ddieterly has joined #openstack-infra | 23:13 | |
| greghaynes | s/it/is | 23:13 |
| clarkb | greghaynes: the issue is secure.conf no longre has a default value | 23:13 |
| clarkb | greghaynes: so I have to type another 15 characters for each command | 23:13 |
| *** toabctl has joined #openstack-infra | 23:13 | |
| clarkb | jeblair: https://horizon.hpcloud.com/ is what I find | 23:13 |
| greghaynes | clarkb: ah, yep. | 23:13 |
| greghaynes | clarkb: so it should have a default | 23:14 |
| jeblair | clarkb: thanks | 23:14 |
| clarkb | greghaynes: so I think you just want to make loadconfig two separate steps | 23:14 |
| clarkb | greghaynes: then you can either load config with or without secure.conf depending on if you need it? | 23:14 |
| greghaynes | clarkb: Ill have a look when im back at computer - phoning ATM | 23:15 |
| clarkb | ok | 23:15 |
| *** baoli has quit IRC | 23:17 | |
| *** baoli has joined #openstack-infra | 23:17 | |
| jeblair | ianw: kernel panic due to invalid opcode 000 | 23:18 |
| clarkb | greghaynes: looks like you sort of make that convention in the builder anyways I would just push it down into config.py and make it resuable | 23:18 |
| greghaynes | good ol colonel panic | 23:18 |
| *** changbl has joined #openstack-infra | 23:18 | |
| *** hichihara has joined #openstack-infra | 23:18 | |
| *** cgalan has quit IRC | 23:19 | |
| greghaynes | clarkb: ya | 23:19 |
| ianw | jeblair: ah. well since i'm close on f23, i'm not sure it makes sense to spend a lot of time investigating this | 23:19 |
| jeblair | o7 colonel panic! | 23:19 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:20 | |
| ianw | greghaynes / jeblair : we'd just need an unscheduled dib release to get https://review.openstack.org/#/c/247817/ in, and i could remove the f22 for f23 builds | 23:20 |
| jeblair | ianw: ok :) | 23:20 |
| jeblair | ianw: is that the right link? | 23:21 |
| *** weshay_xchat has joined #openstack-infra | 23:21 | |
| ianw | ah, maybe https://review.openstack.org/#/c/247296/ | 23:21 |
| ianw | sorry, copy-paste fail | 23:21 |
| *** dims_ has joined #openstack-infra | 23:22 | |
| clarkb | mordred: whats the story with https://review.openstack.org/#/c/245569/1 ? is that something we need or should it be abanonded? | 23:23 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-subunit2sql: Lets time the super long migrations we have to run https://review.openstack.org/246041 | 23:24 |
| mtreinish | jeblair: ^^^ | 23:24 |
| *** kozhukalov_ has quit IRC | 23:24 | |
| *** dims has quit IRC | 23:24 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-subunit2sql: Lets time the super long migrations we have to run https://review.openstack.org/246041 | 23:26 |
| jeblair | mtreinish: ooh you're fixing things i catch before i post them! :) | 23:27 |
| *** baoli has quit IRC | 23:27 | |
| *** baoli has joined #openstack-infra | 23:28 | |
| mtreinish | jeblair: heh | 23:28 |
| mordred | clarkb: don't need it | 23:28 |
| jeblair | mtreinish: 2 more nitty things | 23:28 |
| mordred | clarkb: that was a fix for using python-jenkins | 23:29 |
| mordred | clarkb: but it turns out that there were more brokens | 23:29 |
| mordred | clarkb: so we reverted the whole patch | 23:29 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-subunit2sql: Lets time the super long migrations we have to run https://review.openstack.org/246041 | 23:30 |
| mtreinish | jeblair: ^^^ done | 23:30 |
| clarkb | mordred: is jenkins.JenkinsException valid there? | 23:30 |
| clarkb | oh its using myjenkins now | 23:30 |
| clarkb | can you abandon? | 23:30 |
| jeblair | yeah, that patch is based on not-head | 23:31 |
| clarkb | looks like it is abandoned thanks | 23:31 |
| mordred | I did | 23:32 |
| mordred | the immediate bug was that the module was imported as jenkins but there was also a local variable called jenkins | 23:32 |
| mordred | so that didn't work | 23:32 |
| *** darrenc is now known as darrenc_afk | 23:33 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Set OVH to 55 nodes. https://review.openstack.org/247837 | 23:34 |
| jeblair | clarkb, mordred: ^ that's max-1 for ovh right now | 23:34 |
| clarkb | +2 | 23:34 |
| mordred | jeblair: woot! | 23:34 |
| mordred | jeblair: +A | 23:35 |
| clarkb | are we still debugging the blue box performance issues? | 23:36 |
| jeblair | clarkb: ish? we are not on the right hardware, that should get fixed at some point. we're seeing what we can do with what we're actually on. | 23:37 |
| clarkb | jeblair: does that mean the current hardware is known to have limitations and its just a matter of replacing it? | 23:38 |
| jeblair | clarkb: though we're also waiting on more ips, so it'll actually be hard for us to naturally saturate the current hardware | 23:38 |
| pleia2 | crinkle: fyi, approved 235628 which will cascade into merging the whole pile of patches (others previously approved), I'm around for the next couple hours | 23:38 |
| pleia2 | crinkle: I think groups.openstack.org is the only thing that uses drupal, so we'll keep an eye on it | 23:39 |
| jeblair | clarkb: yep. i think this region is new and they didn't have the new stuff provisioned at the time. | 23:39 |
| crinkle | pleia2: thanks! i will be around as well | 23:39 |
| pleia2 | crinkle: great :) | 23:39 |
| StevenK | pleia2: Oh good, then we can upgrade translate. :-P | 23:40 |
| pleia2 | StevenK: it's done | 23:40 |
| * pleia2 finishes email to i18n list | 23:41 | |
| mordred | also - the current performance graphs for BB are decent | 23:41 |
| StevenK | Clearly, I need to read email before trying to get coworkers to do things. :-) | 23:41 |
| pleia2 | StevenK :D | 23:42 |
| mtreinish | StevenK: nah, that's the exact opposite of what you should be doing :) | 23:42 |
| *** rguillebert has joined #openstack-infra | 23:42 | |
| jeblair | mordred: yes, though we're only going to get to 50% usage on the compute hosts because of the ip limit | 23:42 |
| mordred | ya | 23:43 |
| jeblair | well, i guess we can push it up a little more | 23:43 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config: Increase bluebox to 27 nodes https://review.openstack.org/247843 | 23:45 |
| jeblair | clarkb, mordred: ^ | 23:45 |
| * clarkb does maths | 23:46 | |
| mordred | clarkb: maths are hard | 23:46 |
| *** ZZelle_ has quit IRC | 23:46 | |
| clarkb | /27 is 30 useable IPs 1 for router, 1 for dhcp, that leaves 28 for VMs? | 23:46 |
| jeblair | clarkb: that was my math | 23:47 |
| clarkb | cool | 23:47 |
| jeblair | though, when i had 3 ip addresses allocated but unused, we were seeing errors in nodepool, so we should keep an eye on this change. | 23:47 |
| *** maiteb has joined #openstack-infra | 23:47 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/system-config: Add infracloud playbook https://review.openstack.org/234535 | 23:48 |
| openstackgerrit | Merged openstack-infra/puppet-drupal: Fix $site_root and $site_docroot parameters https://review.openstack.org/235628 | 23:48 |
| *** dimtruck is now known as zz_dimtruck | 23:50 | |
| jeblair | greghaynes: i dif defaultdict, but i don't think it'll work in https://review.openstack.org/246619 -- i left a response | 23:50 |
| *** claudiub has quit IRC | 23:51 | |
| jeblair | clarkb: you might be interested in https://review.openstack.org/246619 -- with it in, i think we can create a nice graph of 'ready nodes by jenkins master' (which is possible but cpu intense now) which may point at jenkins issues | 23:51 |
| openstackgerrit | Merged openstack-infra/puppet-drupal: Fix mysql parameter defaults https://review.openstack.org/235629 | 23:52 |
| openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Ignore broken providers https://review.openstack.org/244340 | 23:55 |
| openstackgerrit | Merged openstack-infra/puppet-drupal: Fix cron setup logic https://review.openstack.org/235630 | 23:55 |
| openstackgerrit | Merged openstack-infra/puppet-drupal: Remove explicit mysql-client installation https://review.openstack.org/235631 | 23:55 |
| * pleia2 crosses fingers | 23:55 | |
| * pleia2 also keeps an eye on groups.o.o | 23:55 | |
| *** darrenc_afk is now known as darrenc | 23:56 | |
| *** gordc has quit IRC | 23:57 | |
| *** baoli has quit IRC | 23:58 | |
| *** sabeen3 has quit IRC | 23:59 | |
| *** sabeen1 has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!