| *** yamamoto has quit IRC | 00:00 | |
| *** achanda has joined #openstack-infra | 00:01 | |
| *** pvaneck has quit IRC | 00:01 | |
| *** ybathia has quit IRC | 00:03 | |
| *** salv-orl_ has quit IRC | 00:03 | |
| *** puranamr has quit IRC | 00:07 | |
| *** Alexandra_ is now known as dews | 00:07 | |
| *** dews is now known as dewsday | 00:07 | |
| *** sridhar_ram has joined #openstack-infra | 00:07 | |
| *** puranamr has joined #openstack-infra | 00:08 | |
| *** gildub has joined #openstack-infra | 00:09 | |
| *** baoli has quit IRC | 00:10 | |
| *** madong_ has joined #openstack-infra | 00:11 | |
| *** larainema has quit IRC | 00:11 | |
| * mmmpork adds some spare change to the swear jar | 00:13 | |
| mmmpork | i swear it won't happen again ;) | 00:13 |
|---|---|---|
| *** madong_ has quit IRC | 00:13 | |
| *** madong_ has joined #openstack-infra | 00:14 | |
| *** rlandy has quit IRC | 00:14 | |
| *** shashank_hegde has quit IRC | 00:14 | |
| *** markvoelker has joined #openstack-infra | 00:15 | |
| *** zul has joined #openstack-infra | 00:16 | |
| *** esmute_ has joined #openstack-infra | 00:17 | |
| *** achanda has quit IRC | 00:18 | |
| *** markvoelker has quit IRC | 00:21 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Upgrade grafana.o.o to 2.1.0 https://review.openstack.org/209218 | 00:24 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Bump puppetlabs-apt to 2.1.0 https://review.openstack.org/209195 | 00:24 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: A warning comment https://review.openstack.org/211738 | 00:24 |
| nibalizer | oops | 00:24 |
| nibalizer | wait | 00:24 |
| *** madong_ has quit IRC | 00:24 | |
| *** sridhar_ram has quit IRC | 00:25 | |
| *** dingyichen has joined #openstack-infra | 00:25 | |
| nibalizer | dangit | 00:25 |
| *** madong__ has joined #openstack-infra | 00:25 | |
| *** achanda has joined #openstack-infra | 00:25 | |
| *** shashank_hegde has joined #openstack-infra | 00:26 | |
| *** tsekiyam_ has joined #openstack-infra | 00:29 | |
| *** skylerberg has quit IRC | 00:29 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Kolla: add non-voting build job https://review.openstack.org/212194 | 00:30 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 00:32 | |
| *** tsekiyama has quit IRC | 00:32 | |
| nibalizer | pabelanger: i rebased some of your stuff sorry, I'll try to put it back the way I found it | 00:32 |
| *** mtanino has quit IRC | 00:32 | |
| *** tsekiyam_ has quit IRC | 00:33 | |
| *** bharath has quit IRC | 00:37 | |
| *** laughterwym has joined #openstack-infra | 00:38 | |
| *** thedodd has quit IRC | 00:39 | |
| *** madong__ has quit IRC | 00:40 | |
| *** madong__ has joined #openstack-infra | 00:40 | |
| *** gyee has quit IRC | 00:40 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Upgrade grafana.o.o to 2.1.0 https://review.openstack.org/209218 | 00:43 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: A warning comment https://review.openstack.org/211738 | 00:43 |
| nibalizer | okay much better | 00:43 |
| *** baoli has joined #openstack-infra | 00:43 | |
| *** sridhar_ram has joined #openstack-infra | 00:44 | |
| *** Rockyg has joined #openstack-infra | 00:46 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Kolla: add non-voting build job https://review.openstack.org/212194 | 00:47 |
| *** sabeen3 has quit IRC | 00:48 | |
| *** crc32 has joined #openstack-infra | 00:49 | |
| *** uberjay has quit IRC | 00:50 | |
| *** uberjay has joined #openstack-infra | 00:51 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit: Add tests for behind_proxy functionality https://review.openstack.org/212229 | 00:51 |
| *** crc32 has quit IRC | 00:52 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit: Fix logic in selinux execs https://review.openstack.org/212230 | 00:52 |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Kolla: add non-voting build job https://review.openstack.org/212194 | 00:54 |
| openstackgerrit | Merged openstack-infra/project-config: Create openstack/kosmos project repo and jobs as experimental https://review.openstack.org/201658 | 00:55 |
| *** achanda has quit IRC | 00:55 | |
| *** shashank_hegde has quit IRC | 00:56 | |
| *** jeblair has quit IRC | 00:56 | |
| *** achanda has joined #openstack-infra | 00:58 | |
| *** baoli has quit IRC | 00:58 | |
| *** boris-42 has quit IRC | 00:58 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Kolla: add non-voting build job https://review.openstack.org/212194 | 00:58 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-cgit: Fix logic in selinux execs https://review.openstack.org/203868 | 00:58 |
| *** erikmwilson has quit IRC | 00:58 | |
| *** jvrbanac has quit IRC | 00:58 | |
| *** jeblair has joined #openstack-infra | 00:58 | |
| *** erikmwilson has joined #openstack-infra | 00:58 | |
| *** isviridov_away has quit IRC | 00:59 | |
| *** freyes has quit IRC | 00:59 | |
| *** w_ has joined #openstack-infra | 01:00 | |
| *** hdd has quit IRC | 01:00 | |
| *** jvrbanac has joined #openstack-infra | 01:00 | |
| *** boris-42 has joined #openstack-infra | 01:00 | |
| *** gildub has quit IRC | 01:01 | |
| *** crc32 has joined #openstack-infra | 01:02 | |
| *** isviridov_away has joined #openstack-infra | 01:02 | |
| *** hdd has joined #openstack-infra | 01:03 | |
| dougwig | hello infra. now that https://review.openstack.org/201658 has merged, can someone please add me to kosmos-core and kosmos-release?no | 01:03 |
| *** olaph has quit IRC | 01:03 | |
| *** chlong has joined #openstack-infra | 01:03 | |
| *** freyes has joined #openstack-infra | 01:03 | |
| dougwig | oops, sorry, mis-hit enter. puppet hasn't done its thing yet. please disregard. | 01:03 |
| *** w_ has quit IRC | 01:05 | |
| anteaya | dougwig: ha ha ha, you had it tee'd up | 01:06 |
| openstackgerrit | Merged openstack-infra/project-config: Remove XML only checks from security-doc https://review.openstack.org/211843 | 01:06 |
| dougwig | anteaya: i typed it, then thought, i bet it hasn't been applied yet, it hadn't, so i was waiting, and then someone asked me something and ... sigh. :) | 01:06 |
| anteaya | ha ha ha | 01:07 |
| *** hdd has quit IRC | 01:08 | |
| anteaya | by the way, I'm making toast | 01:08 |
| *** hdd has joined #openstack-infra | 01:08 | |
| dougwig | ok, take 2, for real: hello infra. now that https://review.openstack.org/201658 has merged, can someone please add me to kosmos-core and kosmos-release? :) | 01:09 |
| jeblair | dougwig: done | 01:10 |
| dougwig | jeblair: thank you. | 01:10 |
| *** salv-orlando has joined #openstack-infra | 01:11 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Kolla: add non-voting build job https://review.openstack.org/212194 | 01:11 |
| *** alexsyip has quit IRC | 01:12 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Add nonvoting beaker tests to infra/puppet* https://review.openstack.org/208799 | 01:12 |
| *** salv-orlando has quit IRC | 01:18 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-httpd: Allow httpd::vhost to take a content parameter https://review.openstack.org/211860 | 01:18 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-httpd: Add vim swp files to gitignore https://review.openstack.org/211861 | 01:18 |
| *** esmute_ has quit IRC | 01:18 | |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: Allow JJB to set connection timeout to jenkins server https://review.openstack.org/151472 | 01:19 |
| *** xyang1 has quit IRC | 01:21 | |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: Allow JJB to set connection timeout to jenkins server https://review.openstack.org/151472 | 01:22 |
| *** jpeeler has quit IRC | 01:23 | |
| openstackgerrit | Merged openstack-infra/zuul: Remove ready_ahead from scheduler https://review.openstack.org/175359 | 01:24 |
| *** sridhar_ram has quit IRC | 01:25 | |
| *** EricGonczer_ has quit IRC | 01:26 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix check-syntax manuals check https://review.openstack.org/211988 | 01:27 |
| *** ayoung has quit IRC | 01:27 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Add nonvoting beaker tests to infra/puppet* https://review.openstack.org/208799 | 01:27 |
| *** gildub has joined #openstack-infra | 01:30 | |
| *** dannywilson has quit IRC | 01:31 | |
| *** dimtruck is now known as zz_dimtruck | 01:31 | |
| sdake | jeblair now that stackforge is deprecated, are you planning a mass move for all projects in some sort of automated way? | 01:32 |
| *** tjones has joined #openstack-infra | 01:33 | |
| *** thorst has joined #openstack-infra | 01:34 | |
| *** patrickeast has quit IRC | 01:35 | |
| *** sthillma_ has joined #openstack-infra | 01:39 | |
| *** yushiro has joined #openstack-infra | 01:40 | |
| anteaya | the only automated way is the same human line up renames have used up until now | 01:41 |
| *** yushiro has quit IRC | 01:41 | |
| *** sthillma has quit IRC | 01:41 | |
| *** sthillma_ is now known as sthillma | 01:41 | |
| anteaya | we will have a plan, which we need to create | 01:41 |
| anteaya | projects that don't want/need to be in the governance repo don't need to do anything at the moment | 01:42 |
| *** sthillma_ has joined #openstack-infra | 01:44 | |
| *** tiswanso has joined #openstack-infra | 01:44 | |
| *** sthillma has quit IRC | 01:45 | |
| *** sthillma_ is now known as sthillma | 01:45 | |
| openstackgerrit | Doug Wiegley proposed openstack-dev/cookiecutter: Bump requirements files https://review.openstack.org/212240 | 01:47 |
| openstackgerrit | Doug Wiegley proposed openstack-dev/cookiecutter: Remove python 2.6, which is not supported in Liberty https://review.openstack.org/212241 | 01:48 |
| *** tiswanso has quit IRC | 01:48 | |
| *** tiswanso has joined #openstack-infra | 01:48 | |
| *** angdraug has quit IRC | 01:49 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Remove check-dg-tempest-* https://review.openstack.org/189314 | 01:49 |
| *** bpokorny has quit IRC | 01:50 | |
| *** Rockyg has quit IRC | 01:50 | |
| *** eantyshev has quit IRC | 01:50 | |
| fungi | sdake: no mass rename planned for the foreseeable future. at the moment it's that we'll honor and batch up requests to rename into the common "openstack" namespace, and avoid adding new projects to the old "stackforge" namespace unnecessarily (really only allowing it for consistency reasons) | 01:51 |
| *** achanda has quit IRC | 01:51 | |
| sdake | fungi cool thanks, so i should keep my rename eview open for kolla | 01:51 |
| fungi | sdake: yep, we will get to it. maybe not next week but soon | 01:52 |
| sdake | no rush just keep geting asked about it | 01:52 |
| sdake | and I point to james email that says "it doesn't matter, the projects.yaml matters" | 01:52 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Change functional testing to use clouds.yaml https://review.openstack.org/212083 | 01:54 |
| *** esmute_ has joined #openstack-infra | 01:54 | |
| *** sthillma has quit IRC | 01:54 | |
| * fungi disappears for the night | 01:55 | |
| anteaya | night fungi | 01:55 |
| sdake | fungi take care | 01:55 |
| *** thorst has quit IRC | 01:55 | |
| *** esmute_ has quit IRC | 02:00 | |
| *** laughterwym_ has joined #openstack-infra | 02:01 | |
| *** baoli has joined #openstack-infra | 02:01 | |
| openstackgerrit | Merged openstack/requirements: Include latest oslo.config in requirements.txt https://review.openstack.org/206229 | 02:04 |
| *** laughterwym has quit IRC | 02:04 | |
| *** markvoelker has joined #openstack-infra | 02:05 | |
| *** esmute_ has joined #openstack-infra | 02:06 | |
| *** sergmelikyan has joined #openstack-infra | 02:08 | |
| *** sabeen has joined #openstack-infra | 02:09 | |
| *** woodster_ has quit IRC | 02:10 | |
| *** esmute_ has quit IRC | 02:10 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Remove extra { on zuul-git-branch-prep https://review.openstack.org/212246 | 02:10 |
| ianw | fungi: ^ when around, trivial but just noticed it | 02:12 |
| *** EricGonczer_ has joined #openstack-infra | 02:12 | |
| *** zz_dimtruck is now known as dimtruck | 02:15 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove check-dg-tempest-* https://review.openstack.org/189314 | 02:16 |
| *** madhu_ak has joined #openstack-infra | 02:21 | |
| *** BharatK has joined #openstack-infra | 02:22 | |
| *** madong__ is now known as larainema | 02:22 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Add nonvoting beaker tests to infra/puppet* https://review.openstack.org/208799 | 02:22 |
| *** salv-orl_ has joined #openstack-infra | 02:23 | |
| *** esmute_ has joined #openstack-infra | 02:26 | |
| madhu_ak | ianw, ping | 02:27 |
| *** salv-orl_ has quit IRC | 02:31 | |
| *** tjones has left #openstack-infra | 02:31 | |
| *** baoli has quit IRC | 02:34 | |
| *** baoli has joined #openstack-infra | 02:34 | |
| *** madong_ has joined #openstack-infra | 02:36 | |
| *** larainema has quit IRC | 02:36 | |
| *** laughterwym has joined #openstack-infra | 02:39 | |
| *** funzo has joined #openstack-infra | 02:42 | |
| *** laughterwym_ has quit IRC | 02:42 | |
| *** madong_ is now known as larainema | 02:43 | |
| *** achanda has joined #openstack-infra | 02:45 | |
| *** EricGonczer_ has quit IRC | 02:46 | |
| *** stevemar has joined #openstack-infra | 02:46 | |
| *** funzo has quit IRC | 02:47 | |
| *** stevemar has quit IRC | 02:49 | |
| *** stevemar_ has joined #openstack-infra | 02:49 | |
| *** tjones has joined #openstack-infra | 02:51 | |
| *** esmute_ has quit IRC | 02:53 | |
| *** esmute_ has joined #openstack-infra | 02:55 | |
| *** esmute_ has quit IRC | 03:02 | |
| *** olaph has joined #openstack-infra | 03:03 | |
| *** yamamoto has joined #openstack-infra | 03:03 | |
| *** baoli has quit IRC | 03:04 | |
| *** madhu_ak has quit IRC | 03:05 | |
| *** aukhan has joined #openstack-infra | 03:06 | |
| *** madhu_ak has joined #openstack-infra | 03:06 | |
| *** esmute_ has joined #openstack-infra | 03:06 | |
| *** tsg has joined #openstack-infra | 03:11 | |
| *** esmute_ has quit IRC | 03:13 | |
| openstackgerrit | Huang Rui proposed openstack-infra/project-config: Create new project ceilometer-zvm on stackforge https://review.openstack.org/212291 | 03:14 |
| *** baoli has joined #openstack-infra | 03:15 | |
| *** otter768 has quit IRC | 03:16 | |
| *** esmute_ has joined #openstack-infra | 03:18 | |
| *** hdd has quit IRC | 03:18 | |
| openstackgerrit | Ye-hong Fang proposed openstack/diskimage-builder: Adds debian support to iso element https://review.openstack.org/211976 | 03:19 |
| *** tlian has joined #openstack-infra | 03:25 | |
| jgriffith | anybody else seen the stack.sh failures on openstack client calls yet? http://54.164.167.86/solidfire-ci-logs/refs-changes-47-212247-1/stack.sh.log.out | 03:27 |
| jgriffith | Seeing it on a few third party CI's that don't use node-pool and confirmed it locally | 03:27 |
| *** tlian has quit IRC | 03:28 | |
| ianw | madhu_ak: hi | 03:29 |
| anteaya | jgriffith: logstash isn't seeing it: http://tinyurl.com/phkj4l7 | 03:30 |
| anteaya | jgriffith: do you know how long ago it started showing up for you? | 03:30 |
| SamYaple | does anyone know the kernel running on the ubuntu gate machines? | 03:32 |
| SamYaple | fedora is 3.19 I believe | 03:32 |
| *** salv-orlando has joined #openstack-infra | 03:33 | |
| anteaya | SamYaple: I don't know how often a fresh precise or trusty is pulled for image creation | 03:34 |
| anteaya | but images are created every 24 hours | 03:34 |
| anteaya | with the prior image being used if the image fails | 03:34 |
| SamYaple | anteaya: ok | 03:34 |
| anteaya | but no, I don't know the kernel version running on the ubuntu nodes | 03:35 |
| SamYaple | so not much control over kernel there | 03:35 |
| ianw | SamYaple: if you look at logs, there's uname output right at the top | 03:35 |
| ianw | e.g. http://logs.openstack.org/51/199851/2/check/check-tempest-dsvm-full/e5ee906/console.html.gz#_2015-07-09_04_43_03_405 | 03:35 |
| anteaya | jgriffith: it seems to start when keystone is started: 2015-08-13 03:21:42.119 | + export OS_URL=http://127.0.0.1:35357/v2.0 | 03:35 |
| SamYaple | ianw: dont have an ubuntu gate on the project currently to check that. thanks for your link! | 03:35 |
| anteaya | jgriffith: v2.0 is exported and then os-url uses v3 --os-url=http://127.0.0.1:5000/v3 | 03:36 |
| anteaya | jgriffith: might it be a keystone version issue? | 03:37 |
| *** bharath has joined #openstack-infra | 03:38 | |
| madhu_ak | ianw, yeah, I saw your comment for vpnaas experimental job patch and commented back to you | 03:39 |
| madhu_ak | could you check and confirm ianw | 03:39 |
| ianw | madhu_ak: ok, if there's changes you depend on, please add Depends-On: to the commit message | 03:39 |
| anteaya | madhu_ak: can you co-ordinate vpnaas testing with dougwig please | 03:39 |
| madhu_ak | sure | 03:40 |
| anteaya | thank you | 03:40 |
| SamYaple | so im not familiar with the gate so much, would I be able to setup a volume/ephemeral disk with the gate to have a raw drive to wrok with? | 03:40 |
| anteaya | what do you mean to work with? | 03:40 |
| SamYaple | format as btrfs, use with lvm for testing | 03:40 |
| madhu_ak | so, wrt to ianw comments, do I need to add depends on that patch? | 03:40 |
| ianw | madhu_ak: yes, for two reasons -- 1 is to help reviewers understand the context, but 2 is because if you're project-config change merges first it will be broken | 03:41 |
| *** shashank_hegde has joined #openstack-infra | 03:41 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Add nonvoting beaker tests to infra/puppet* https://review.openstack.org/208799 | 03:42 |
| madhu_ak | oh okay I got you ianw will add depends on to help reviewers to review that patch | 03:42 |
| *** bharath has quit IRC | 03:42 | |
| *** madhu_ak has quit IRC | 03:43 | |
| *** madhu_ak has joined #openstack-infra | 03:43 | |
| *** hdd has joined #openstack-infra | 03:44 | |
| *** jerryz has quit IRC | 03:45 | |
| *** esmute_ has quit IRC | 03:45 | |
| *** salv-orlando has quit IRC | 03:45 | |
| *** tiswanso has quit IRC | 03:47 | |
| *** larainema has quit IRC | 03:47 | |
| anteaya | SamYaple: I don't know of many testing setups where we reformat disk | 03:47 |
| anteaya | SamYaple: what is it that you want to test? | 03:47 |
| *** esmute_ has joined #openstack-infra | 03:48 | |
| *** larainema has joined #openstack-infra | 03:48 | |
| clarkb | Swe do set up lvm and swap out of the ephemeral drive | 03:49 |
| SamYaple | anteaya: its for Kolla which uses Docker. I wasnted to test against the different Docker backends | 03:49 |
| clarkb | you could in throry undo that | 03:50 |
| clarkb | or just use the cindervg | 03:50 |
| *** tjones has quit IRC | 03:50 | |
| SamYaple | clarkb: yea all of that sounds great. I am just terribly unfamiliar with the gate stuff. Sorry for the n00bish questions | 03:51 |
| SamYaple | sounds like i can find a way to do what i need | 03:51 |
| jgriffith | anteaya: hmm... lemme try, then I'll ask how you figured it out :) | 03:51 |
| jgriffith | anteaya: Ohh, yeah... that makes sense | 03:52 |
| anteaya | jgriffith: I looked at the log and error message | 03:52 |
| jgriffith | Lemme give it a go | 03:52 |
| anteaya | it is upset with the url it is being passed | 03:52 |
| clarkb | http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n272 | 03:52 |
| anteaya | good luck | 03:52 |
| clarkb | SamYaple ^ I would just use cinder vg unless you have cinder | 03:52 |
| SamYaple | clarkb: awesome! | 03:53 |
| SamYaple | thanks for the help | 03:53 |
| *** puranamr has quit IRC | 03:53 | |
| *** puranamr has joined #openstack-infra | 03:54 | |
| jgriffith | anteaya: sorry... I was away when you responded | 03:56 |
| anteaya | jgriffith: no, no worries | 03:57 |
| jgriffith | anteaya: yeah, it first showed up a little over an hour ago | 03:57 |
| anteaya | hmmmm | 03:57 |
| anteaya | any luck with keystone versions? | 03:57 |
| jgriffith | anteaya: Well... I'm kinda confused; the default in stacker is v2 | 03:57 |
| anteaya | jgriffith: have you a log from a prior successful stack? | 03:58 |
| jgriffith | anteaya: Oh, good idea.. and yes | 03:58 |
| jgriffith | for those following at home: http://54.164.167.86/solidfire-ci-logs/refs-changes-04-211804-3/stack.sh.log.out :) | 03:59 |
| jgriffith | hmm... that hasn't changed | 04:00 |
| anteaya | yeah: http://paste.openstack.org/show/412813/ | 04:01 |
| anteaya | same command both times, different response though | 04:01 |
| jgriffith | anteaya: right | 04:02 |
| jgriffith | and I don't see anything merging in devstack, keystone/client or openstack-client | 04:02 |
| jgriffith | so kinda odd | 04:02 |
| anteaya | hmmmm | 04:02 |
| anteaya | a dependency release? | 04:03 |
| *** puranamr has quit IRC | 04:03 | |
| jgriffith | anteaya: Most likely but boy are those sure hard to track down any more | 04:03 |
| anteaya | yeah, I hear that | 04:03 |
| *** esmute_ has quit IRC | 04:03 | |
| jgriffith | The Missing parameter OS_URL thing is what's hanging me up | 04:03 |
| *** puranamr has joined #openstack-infra | 04:03 | |
| jgriffith | anteaya: and interestingly enough I can run that command after stack.sh fails | 04:03 |
| jgriffith | it fails for other reasons, but not that one | 04:04 |
| anteaya | interesting | 04:04 |
| jgriffith | hmm... actually; there we go | 04:04 |
| anteaya | I have seen that before where the command fails during the process and then works manually but I can't remember the cause of it | 04:04 |
| anteaya | you found something | 04:04 |
| jgriffith | http://paste.openstack.org/show/412814/ | 04:05 |
| jgriffith | Well, this last run through I can reproduce it at least | 04:05 |
| jgriffith | that helps (I think) :) | 04:05 |
| *** esmute_ has joined #openstack-infra | 04:06 | |
| anteaya | I hope | 04:06 |
| *** enikanorov2 has quit IRC | 04:06 | |
| anteaya | extended error message too | 04:06 |
| jgriffith | ERROR: openstack Could not determine a suitable URL for the plugin | 04:06 |
| jgriffith | after setting the var | 04:07 |
| *** stevemar_ has quit IRC | 04:07 | |
| jgriffith | http://paste.openstack.org/show/412815/ | 04:07 |
| anteaya | hmmmm, I am wondering if the reason we are not hitting this is because we are running on images | 04:08 |
| jgriffith | anteaya: feel free to tell me to buzz off or that you're occupied; folks well tell you I come here to think out loud which I'm sure is annoying | 04:08 |
| anteaya | and will hit it next image creation | 04:08 |
| anteaya | jgriffith: I'm jet lagged, I'm up | 04:08 |
| jgriffith | anteaya: that's what I'm wondering, and when they update/refresh will you start seeing it ingate | 04:08 |
| jgriffith | anteaya: which is why I dropped in here intiially | 04:08 |
| anteaya | right so I think it worth spending some time on it now | 04:08 |
| anteaya | thank you :) | 04:08 |
| jgriffith | There are a handful of us that build fresh images every time, we all failed tonight | 04:09 |
| anteaya | hmmmmm | 04:09 |
| anteaya | who else is seeing this? are they around? | 04:10 |
| *** dimtruck is now known as zz_dimtruck | 04:11 | |
| jgriffith | nobody that I ever see/know on IRC | 04:11 |
| anteaya | k | 04:11 |
| jgriffith | tintri | 04:11 |
| anteaya | I'm at a loss | 04:12 |
| anteaya | don't know that person | 04:12 |
| anteaya | I think I am going to go back to this list: http://git.openstack.org/cgit/openstack/keystone/tree/requirements.txt | 04:12 |
| anteaya | and work through it to see if any new releases happened lately | 04:12 |
| anteaya | back in a bit | 04:12 |
| jgriffith | yeah, only thing I saw as of late was apache | 04:12 |
| anteaya | what did apache do? | 04:12 |
| jgriffith | cool... thanks, cya | 04:12 |
| jgriffith | sorry... config | 04:13 |
| jgriffith | https://github.com/openstack/requirements/commit/00745b1a706cbbb7973bd040a701d3adbf32a236 | 04:13 |
| *** madhu_ak has quit IRC | 04:14 | |
| *** madhu_ak has joined #openstack-infra | 04:14 | |
| jgriffith | hmm... lemme see here | 04:15 |
| *** enikanorov2 has joined #openstack-infra | 04:15 | |
| anteaya | oh, that's new | 04:16 |
| jgriffith | Yeah, running it with a pinned version there | 04:16 |
| jgriffith | and it's odd, my systems pulled the dev version... which I thought used to be "ok" but we'll see | 04:17 |
| jgriffith | since it's a startup issue that kinda makes sense now | 04:17 |
| jgriffith | we shall see | 04:17 |
| anteaya | so what oslo.config is your system pulling in? | 04:17 |
| * jgriffith wishes his machine stacked faster | 04:18 | |
| jgriffith | oslo.config==2.2.1.dev2 | 04:18 |
| jgriffith | ahh... it updated it for me again; so nice of it | 04:18 |
| jgriffith | Oh... oops, the 2.2.dev is my fault. I have get lib from git setting on that | 04:20 |
| *** unicell has joined #openstack-infra | 04:21 | |
| anteaya | http://paste.openstack.org/show/412816/ the middle three lines are in your failed log and absent from your log of your successful build | 04:21 |
| jgriffith | indeed | 04:21 |
| openstackgerrit | Huang Rui proposed openstack-infra/project-config: Create new project ceilometer-zvm on stackforge https://review.openstack.org/212291 | 04:21 |
| jgriffith | I believe that may be the culprit | 04:21 |
| anteaya | how is 2.2.1.dev2 getting on your system? requirements is looking for 2.1.0 | 04:22 |
| *** madhu_ak has quit IRC | 04:22 | |
| jgriffith | anteaya: that was my fault :) | 04:22 |
| anteaya | ah ha | 04:22 |
| anteaya | :) | 04:22 |
| anteaya | easy to fix then | 04:22 |
| jgriffith | anteaya: I have some libs from git settings on my test machine that I did the pip freeze on | 04:23 |
| anteaya | oh okay | 04:23 |
| anteaya | I'm curious so see what happens if you pull in 2.1.0 | 04:23 |
| jgriffith | Ok, I've got it rolled back to 1.11.0; we'll see if this works | 04:24 |
| anteaya | okay | 04:24 |
| anteaya | then are you willing to try 2.1.0? | 04:24 |
| *** ivar-lazzaro has quit IRC | 04:24 | |
| jgriffith | for shizzle | 04:25 |
| anteaya | thanks | 04:25 |
| * anteaya makes a cup of tea | 04:25 | |
| anteaya | jgriffith: tea? | 04:25 |
| jgriffith | anteaya: yes please | 04:25 |
| jgriffith | coffee all day, beer in the evening, tea before bed | 04:26 |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-httpd: Allow httpd::vhost to take a content parameter https://review.openstack.org/211860 | 04:26 |
| *** tjones has joined #openstack-infra | 04:26 | |
| jgriffith | well crud, that didn't work | 04:26 |
| * anteaya puts more water in the kettle | 04:27 | |
| jgriffith | trying 2.1 now, which I expect to fail based on the paste | 04:27 |
| anteaya | hmmmm | 04:27 |
| *** sthillma has joined #openstack-infra | 04:27 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/puppet-httpd: Add vim swp files to gitignore https://review.openstack.org/211861 | 04:27 |
| jgriffith | I should clarify, my CI system ends up at 2.1, my test box I'm working on here is what I put at 1.11.0 | 04:27 |
| anteaya | why did 1.11 fail | 04:28 |
| anteaya | ah okay | 04:28 |
| jgriffith | same thing oddly enough | 04:28 |
| anteaya | and 1.11 failed for you? with the same error? | 04:28 |
| *** esmute_ has quit IRC | 04:28 | |
| jgriffith | anteaya: affirm | 04:29 |
| *** Sree has joined #openstack-infra | 04:30 | |
| *** sthillma_ has joined #openstack-infra | 04:30 | |
| anteaya | boo | 04:30 |
| jgriffith | anteaya: I would agree with that sentiment | 04:30 |
| anteaya | perhaps oslo.config version is a red herring | 04:30 |
| *** Sree has quit IRC | 04:31 | |
| jgriffith | Perhaps, unless it sucked in some other version of something or other when it updated? | 04:31 |
| *** baoli has quit IRC | 04:31 | |
| anteaya | maybe? | 04:31 |
| anteaya | I don't know if oslo.config has dependencies | 04:31 |
| *** Sree has joined #openstack-infra | 04:31 | |
| *** esmute_ has joined #openstack-infra | 04:31 | |
| * anteaya puts jgriffith's mug of tea down beside him | 04:32 | |
| jgriffith | anteaya: yeah, that was nothing short of a very very long shot | 04:32 |
| anteaya | wild sweet orange, I hope you like it | 04:32 |
| jgriffith | anteaya: Ahh...very nice | 04:32 |
| *** fawadkhaliq has joined #openstack-infra | 04:32 | |
| *** sthillma has quit IRC | 04:32 | |
| *** sthillma_ is now known as sthillma | 04:32 | |
| anteaya | :) | 04:32 |
| anteaya | oslo.config does have requirements: http://git.openstack.org/cgit/openstack/oslo.config/tree/requirements.txt | 04:33 |
| anteaya | but they are all specific versions | 04:33 |
| *** Sree has quit IRC | 04:34 | |
| anteaya | 2.1.0 has argparse in there, and it isn't pinned | 04:34 |
| *** esmute_ has quit IRC | 04:34 | |
| anteaya | sorry so does master | 04:35 |
| jgriffith | Yeah | 04:35 |
| *** esmute_ has joined #openstack-infra | 04:35 | |
| *** esmute_ has quit IRC | 04:35 | |
| anteaya | 1.3 was released in 2014 so dead end | 04:36 |
| jgriffith | hehe... I hope so :) | 04:36 |
| anteaya | I'll look at keystone requirements | 04:37 |
| *** hdd has quit IRC | 04:39 | |
| *** fawadkhaliq has quit IRC | 04:39 | |
| jgriffith | Oh... hmm | 04:39 |
| *** fawadkhaliq has joined #openstack-infra | 04:39 | |
| *** larainema has quit IRC | 04:40 | |
| *** larainema has joined #openstack-infra | 04:40 | |
| anteaya | this is fairly new: https://pypi.python.org/pypi/cryptography/1.0 | 04:42 |
| *** madhu_ak has joined #openstack-infra | 04:42 | |
| anteaya | dstufft: you wouldn't happen to be up, would you? | 04:43 |
| *** w_ has joined #openstack-infra | 04:43 | |
| openstackgerrit | Madhusudhan Kandadai proposed openstack-infra/project-config: Create experimental job for all neutron-vpnaas tests https://review.openstack.org/211767 | 04:43 |
| *** olaph has quit IRC | 04:43 | |
| jgriffith | anteaya: hmm; well I'm afraid I need to take my tea and run at this point | 04:44 |
| *** unicell1 has joined #openstack-infra | 04:44 | |
| anteaya | jgriffith: enjoy your evening | 04:44 |
| anteaya | thanks for thinking of us | 04:44 |
| jgriffith | I'm afraid this will still be here in the morning, and I should be back in just a short bit | 04:45 |
| jgriffith | anteaya: of course! | 04:45 |
| *** unicell has quit IRC | 04:45 | |
| anteaya | hopefully this is me chasing my tail and I'll realize it soon | 04:45 |
| jgriffith | anteaya: There's of course a good chance that I'm wrong | 04:45 |
| anteaya | or it is a thing and it won't break the gate | 04:45 |
| *** sthillma has quit IRC | 04:45 | |
| jgriffith | perhaps | 04:45 |
| anteaya | jgriffith: sure, I understand, thanks for speaking up though | 04:45 |
| anteaya | who is to know | 04:45 |
| jgriffith | anteaya: thanks for looking at it with me, at least if things do get funky we'll have an head start | 04:46 |
| anteaya | we can rule out some things | 04:46 |
| anteaya | :) | 04:46 |
| anteaya | later | 04:46 |
| jgriffith | have a good night | 04:46 |
| anteaya | thanks you too | 04:46 |
| *** shashank_hegde has quit IRC | 04:46 | |
| openstackgerrit | Steven Hillman proposed openstack-infra/project-config: Add create permission for puppet-n1k-vsm core group https://review.openstack.org/212221 | 04:47 |
| *** salv-orlando has joined #openstack-infra | 04:47 | |
| *** sthillma has joined #openstack-infra | 04:48 | |
| *** sthillma has quit IRC | 04:52 | |
| *** fawadkhaliq has quit IRC | 04:57 | |
| *** salv-orlando has quit IRC | 04:59 | |
| *** esmute_ has joined #openstack-infra | 05:04 | |
| *** sabeen has quit IRC | 05:04 | |
| *** nikil89_ has joined #openstack-infra | 05:05 | |
| *** nikil89_ is now known as naggappan | 05:05 | |
| *** naggappan has left #openstack-infra | 05:05 | |
| *** fawadkhaliq has joined #openstack-infra | 05:06 | |
| *** stevemar has joined #openstack-infra | 05:08 | |
| *** deepakcs has joined #openstack-infra | 05:08 | |
| anteaya | cryptography 1.0 was released at 08:38:41 CDT | 05:10 |
| *** tjones has quit IRC | 05:11 | |
| *** stevemar has quit IRC | 05:11 | |
| anteaya | from the cryptography-dev channel | 05:12 |
| *** esmute_ has quit IRC | 05:15 | |
| openstackgerrit | Andrei V. Ostapenko proposed openstack-infra/project-config: Move from stackforge/magnetodb to openstack/magnetodb https://review.openstack.org/203524 | 05:16 |
| openstackgerrit | Andrei V. Ostapenko proposed openstack-infra/project-config: Changes jobs description for MagnetoDB https://review.openstack.org/204478 | 05:16 |
| *** otter768 has joined #openstack-infra | 05:17 | |
| *** sthillma has joined #openstack-infra | 05:21 | |
| *** otter768 has quit IRC | 05:22 | |
| *** sthillma_ has joined #openstack-infra | 05:22 | |
| *** BharatK has quit IRC | 05:22 | |
| *** sergmelikyan has quit IRC | 05:22 | |
| *** sthillma has quit IRC | 05:25 | |
| *** sthillma_ is now known as sthillma | 05:25 | |
| *** madhu_ak has quit IRC | 05:26 | |
| *** ivar-lazzaro has joined #openstack-infra | 05:27 | |
| *** armax has quit IRC | 05:30 | |
| anteaya | jgriffith: join me in #openstack-keystone when you return, you may have found something | 05:33 |
| *** esmute_ has joined #openstack-infra | 05:33 | |
| *** BharatK has joined #openstack-infra | 05:34 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Kolla: Add a gate for image-centos-binary https://review.openstack.org/212194 | 05:35 |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Kolla: add a gate for kolla-centos-source https://review.openstack.org/212346 | 05:35 |
| *** laughterwym_ has joined #openstack-infra | 05:35 | |
| *** sthillma has quit IRC | 05:38 | |
| *** laughterwym has quit IRC | 05:38 | |
| *** BharatK has quit IRC | 05:39 | |
| *** laughterwym__ has joined #openstack-infra | 05:39 | |
| *** yfried has joined #openstack-infra | 05:39 | |
| *** laughterwym_ has quit IRC | 05:39 | |
| *** BharatK has joined #openstack-infra | 05:40 | |
| *** markvoelker has quit IRC | 05:41 | |
| *** ildikov has quit IRC | 05:42 | |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Kolla: Add a gate for image-centos-binary https://review.openstack.org/212194 | 05:42 |
| openstackgerrit | Steven Dake proposed openstack-infra/project-config: Kolla: add a gate for kolla-centos-source https://review.openstack.org/212346 | 05:42 |
| *** esmute_ has quit IRC | 05:42 | |
| *** olaph has joined #openstack-infra | 05:43 | |
| *** crc32 has quit IRC | 05:44 | |
| *** nadya has quit IRC | 05:44 | |
| *** esmute_ has joined #openstack-infra | 05:45 | |
| *** w_ has quit IRC | 05:45 | |
| anteaya | so if I were to offer a pin for cryptography, I have to offer it to global-requirements in the requirements repo first? and then offer it to keystone/requirements? | 05:47 |
| anteaya | morgan_404: ^^ | 05:48 |
| anteaya | lifeless: do you happen to be about? | 05:48 |
| anteaya | jhesketh: ^^ | 05:48 |
| *** fifieldt has joined #openstack-infra | 05:49 | |
| *** esmute_ has quit IRC | 05:49 | |
| *** med_ has quit IRC | 05:50 | |
| *** esmute_ has joined #openstack-infra | 05:50 | |
| *** yamamoto has quit IRC | 05:50 | |
| *** yamamoto has joined #openstack-infra | 05:50 | |
| *** esmute_ has quit IRC | 05:51 | |
| lifeless | anteaya: yes | 05:55 |
| *** tsg has quit IRC | 05:55 | |
| morgan_404 | So barring the odd cffi interaction, jamielennox cryptography 0.9.3 solved the explode issue | 05:55 |
| morgan_404 | Right? | 05:56 |
| openstackgerrit | Anita Kuno proposed openstack/requirements: Cap cryptography to less than 1.0 https://review.openstack.org/212349 | 05:56 |
| morgan_404 | /me moves the convo here | 05:56 |
| jamielennox | so for me on a fresh install F22 i got http://paste.openstack.org/show/412820/ | 05:56 |
| jamielennox | and python: import OpenSSL failed with the same issue | 05:56 |
| anteaya | lifeless: thank you | 05:56 |
| *** sergmelikyan has joined #openstack-infra | 05:57 | |
| anteaya | jamielennox: that failure was with cryptography 1.0, yes? | 05:57 |
| jamielennox | i had to uninstall cffi and cryptography then install cryptography<1.0 and then i could at least import OpenSSL | 05:57 |
| jamielennox | however something pip is caching built objects means i can't upgrade to 1.0 again | 05:57 |
| jamielennox | anteaya: yes, | 05:58 |
| morgan_404 | New transient dep of crypto on newer cffi? | 05:58 |
| *** nadya has joined #openstack-infra | 05:58 | |
| anteaya | lifeless: is the patch to keystone dependent on the patch to requirements? I'm guessing yes | 05:58 |
| *** dingyichen has quit IRC | 05:58 | |
| * morgan_404 is limited by moblie device vs real computer. | 05:58 | |
| *** dingyichen has joined #openstack-infra | 05:59 | |
| jamielennox | so 0.9.3 crypto has cffi>0.8, 1.0 has cffi>1.1 | 05:59 |
| morgan_404 | Shouldnt be an issue | 06:00 |
| morgan_404 | Since >1.1 should be used in both cases. | 06:00 |
| *** vlaza has joined #openstack-infra | 06:00 | |
| jamielennox | morgan_404: somewhere pip is giving me http://paste.openstack.org/show/412821/ | 06:00 |
| jamielennox | which would imply that there is a prebuilt FFI shared object that was build with 0.8.6 that doesn't like it when 1.1.0 tries to be installed | 06:01 |
| morgan_404 | jamielennox: in a venv can you buold 0.9.3 abd upgrade? | 06:01 |
| jamielennox | but i've killed ~/.cache/pip and /root/.cache/pip and nothing | 06:01 |
| jamielennox | need to install it, sec | 06:02 |
| *** salv-orlando has joined #openstack-infra | 06:04 | |
| *** ParsectiX has joined #openstack-infra | 06:04 | |
| openstackgerrit | Anita Kuno proposed openstack/requirements: Cap cryptography to less than 1.0 https://review.openstack.org/212349 | 06:04 |
| jamielennox | hmm, in a virtual env i can pip install cffi cryptography and pyOpenSSL and it seems to work | 06:05 |
| jamielennox | like i can at least import OpenSSL | 06:05 |
| jamielennox | so maybe it's a fedora issue? | 06:05 |
| jamielennox | /cc ianw | 06:05 |
| anteaya | jamielennox: I dont' know jgriffith reported it and he said other third party cis were seeing it | 06:05 |
| anteaya | I don't know what os they use | 06:06 |
| ianw | /uncc /uncc /uncc -- this area is such a nightmare :( | 06:06 |
| *** sdake has quit IRC | 06:07 | |
| jamielennox | ianw: just thought you might have seen it | 06:07 |
| ianw | yeah, sorry no immediate answer | 06:07 |
| jamielennox | i'll boot a new devstack on ubuntu, just none of my scripts work for that :( | 06:07 |
| anteaya | jamielennox: willing to take one for the team, thank you | 06:08 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/212356 | 06:09 |
| *** bharath_ has joined #openstack-infra | 06:09 | |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Remove refs for refs from kosmos project https://review.openstack.org/212361 | 06:11 |
| *** nadya has quit IRC | 06:12 | |
| *** salv-orlando has quit IRC | 06:13 | |
| *** bharath_ has quit IRC | 06:14 | |
| *** flepied1 has joined #openstack-infra | 06:16 | |
| *** flepied has quit IRC | 06:16 | |
| *** oomichi has quit IRC | 06:18 | |
| *** abregman has joined #openstack-infra | 06:18 | |
| *** sergmelikyan has quit IRC | 06:20 | |
| *** mrmartin has joined #openstack-infra | 06:21 | |
| *** k4n0 has joined #openstack-infra | 06:22 | |
| jamielennox | anteaya: my ubuntu devstack just failed in the same way as your third party ci | 06:22 |
| *** med_ has joined #openstack-infra | 06:23 | |
| *** med_ is now known as Guest471 | 06:23 | |
| anteaya | awesome | 06:23 |
| anteaya | and dougwig just shared a paste with me from earlier today | 06:24 |
| anteaya | dougwig: can I share? | 06:24 |
| dougwig | anteaya: of course. | 06:24 |
| anteaya | thanks | 06:24 |
| anteaya | https://www.irccloud.com/pastebin/L2k4CIP6/ | 06:24 |
| anteaya | http://logs.openstack.org/75/209675/16/experimental/gate-neutron-lbaasv2-octavia-dsvm-api/741b90f/console.html#_2015-08-11_20_49_26_504 | 06:24 |
| anteaya | cffi build issue | 06:25 |
| anteaya | perhaps the new cffi lib isn't packaged as expected | 06:25 |
| dougwig | anteaya: in case i fall asleep, you can monitor my clean CI run here: http://jenkins.a10cloud.com/job/a10-neutron-lbaas-github-ec2/60/ | 06:25 |
| anteaya | dougwig: thank you | 06:25 |
| anteaya | ubuntu 14.04 you said for your ci build, yes? | 06:26 |
| anteaya | dougwig: and what os for the paste log? | 06:26 |
| dougwig | anteaya: that was a test on an experimental infra/nodepool job. | 06:26 |
| dougwig | anteaya: 2015-08-11 20:41:09.098 | Building remotely on devstack-trusty-hpcloud-b3-4272963 (devstack-trusty) in workspace /home/jenkins/workspace/gate-neutron-lbaasv2-octavia-dsvm-api | 06:27 |
| anteaya | so it was: devstack-trusty-hpcloud-b3-4272963 | 06:27 |
| anteaya | thank you | 06:27 |
| anteaya | so not just a fedora issue | 06:27 |
| *** ihrachyshka has joined #openstack-infra | 06:27 | |
| dougwig | anteaya: you can ignore the pending shutdown warning on my jenkins. i just don't want it running zuul jobs right now. the one i queued above will finish. | 06:27 |
| anteaya | dougwig: ah okay thanks, that was just what I was wondering about | 06:28 |
| openstackgerrit | Abhishek Kekane proposed openstack/requirements: Nova kilo requires concurrency 1.8.2 or better https://review.openstack.org/212369 | 06:28 |
| anteaya | I am offline for a minute | 06:29 |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Add options: translate for all relevant projects https://review.openstack.org/211722 | 06:29 |
| *** shashank_hegde has joined #openstack-infra | 06:30 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove refs for refs from kosmos project https://review.openstack.org/212361 | 06:31 |
| *** ildikov has joined #openstack-infra | 06:31 | |
| anteaya | back | 06:33 |
| *** arxcruz has joined #openstack-infra | 06:33 | |
| lifeless | cffi < 1.0 had a terrible thing w.r.t. packaging | 06:34 |
| anteaya | it looks like they still have whatever terrible thing they had | 06:35 |
| anteaya | lifeless: what do you want to do with the requirements patch? | 06:35 |
| *** dizquierdo has joined #openstack-infra | 06:35 | |
| lifeless | well, devstack passed with cryptography 1.0 | 06:35 |
| anteaya | did it? | 06:35 |
| lifeless | actually no, its still running sorry | 06:36 |
| anteaya | okay thanks for also testing | 06:36 |
| anteaya | so you jamielennox and dougwig's ci are all running | 06:36 |
| lifeless | but if you look at https://review.openstack.org/#/c/212356/1/upper-constraints.txt you can see that the only dep change in this area is cryptography itself | 06:36 |
| *** dewsday has quit IRC | 06:36 | |
| lifeless | we're already using the latest cffi | 06:36 |
| *** yamahata has joined #openstack-infra | 06:36 | |
| anteaya | from my reading of the backscroll it looked to me like we used whatever cryptography brought in with it, did we not? | 06:37 |
| lifeless | constraints pins everything devstack wise | 06:38 |
| anteaya | and cryptography 0.9.3 brought in cffi 0.8 didn't it, jamielennox? | 06:38 |
| lifeless | jamielennox: is your problem unit tests or devstack ? | 06:38 |
| anteaya | the original problem reported by jgriffith was devstack building | 06:38 |
| lifeless | so the gate is fine | 06:38 |
| anteaya | okay | 06:38 |
| lifeless | right? | 06:38 |
| lifeless | or wrong? | 06:39 |
| anteaya | you tell me | 06:39 |
| lifeless | we don't have unit tests constrained yet | 06:39 |
| anteaya | everyone running a fresh devstack can't get it to build | 06:39 |
| lifeless | how long has this issue been reported for ? | 06:39 |
| lifeless | anteaya: they should set USE_CONSTRAINTS=True | 06:39 |
| lifeless | that will fix that | 06:39 |
| anteaya | if that translates to the gate being fine, that is fine with me | 06:39 |
| anteaya | okay | 06:39 |
| anteaya | well I don't know anyone who knows that | 06:39 |
| lifeless | everyone should | 06:39 |
| anteaya | I didn't know that | 06:39 |
| anteaya | how? | 06:39 |
| anteaya | you telling me is the first I heard of it | 06:40 |
| lifeless | I can pip install cryptography just fine here | 06:40 |
| anteaya | so thank you for telling me | 06:40 |
| *** FallenPegasus has joined #openstack-infra | 06:40 | |
| *** afazekas has joined #openstack-infra | 06:40 | |
| lifeless | anteaya: we have a spec, I've published regular updates on the progress to openstack-dev mailing list | 06:40 |
| anteaya | I appreciate that | 06:40 |
| lifeless | http://specs.openstack.org/openstack/openstack-specs/specs/requirements-management.html | 06:40 |
| anteaya | I am spiritually unable to read all the things | 06:40 |
| jamielennox | anteaya: so https://pypi.python.org/pypi/os-client-config was released today... | 06:40 |
| anteaya | as well written as they may be | 06:40 |
| *** markvoelker has joined #openstack-infra | 06:41 | |
| *** oomichi has joined #openstack-infra | 06:42 | |
| anteaya | it is twenty to three in my morning | 06:42 |
| lifeless | anteaya: reading the things tagged [all] is perhaps something you could achieve, there are few of them, and they tend to be important | 06:42 |
| anteaya | if I am being told to go to bed now, there is no problem I will do so | 06:42 |
| lifeless | like | 06:42 |
| lifeless | http://lists.openstack.org/pipermail/openstack-dev/2015-July/068569.html | 06:42 |
| anteaya | lifeless: please don't attempt to tell me how I should spend my time, that is my choice | 06:43 |
| lifeless | anteaya: well, there's no crisis here worth losing sleep over | 06:43 |
| lifeless | anteaya: of course it is | 06:43 |
| anteaya | good night | 06:43 |
| lifeless | anteaya: I didn't tell you how to spend your time. I offered advice about triaging, which you can take or leave. | 06:43 |
| lifeless | anteaya: no need to go prickly pear on it. | 06:43 |
| *** ihrachyshka has quit IRC | 06:44 | |
| *** Guest471 has quit IRC | 06:44 | |
| jamielennox | anteaya: ok, pretty sure i've got it | 06:44 |
| *** nadya has joined #openstack-infra | 06:44 | |
| lifeless | jamielennox: we'll know shortly when the requirements constraints update succeeds/fails | 06:44 |
| jamielennox | lifeless: which one? | 06:44 |
| lifeless | jamielennox: (as in, we'll have independent confirmation) | 06:44 |
| *** coolsvap_ has joined #openstack-infra | 06:45 | |
| jamielennox | so anteaya's problem isn't cryptography | 06:45 |
| jamielennox | it's os-client-config==1.6.2 | 06:45 |
| *** coolsvap_ has quit IRC | 06:46 | |
| openstackgerrit | Eric Brown proposed openstack/requirements: Bump version of bandit to 0.13.1 https://review.openstack.org/210787 | 06:46 |
| *** markvoelker has quit IRC | 06:46 | |
| dougwig | lifeless: if that devstack setting is something everything should use, why isn't it the default? | 06:47 |
| *** scheuran has joined #openstack-infra | 06:47 | |
| dougwig | lifeless: if the answer is in the email, you can disregard. | 06:48 |
| *** esmute_ has joined #openstack-infra | 06:51 | |
| openstackgerrit | Jamie Lennox proposed openstack/requirements: Exclude os-client-config 1.6.2 https://review.openstack.org/212375 | 06:53 |
| *** esmute_ has quit IRC | 06:54 | |
| *** ivar-lazzaro has quit IRC | 06:56 | |
| *** esmute_ has joined #openstack-infra | 06:57 | |
| *** esmute_ has quit IRC | 07:00 | |
| *** mrunge has joined #openstack-infra | 07:00 | |
| lifeless | dougwig: see that mail indeed :) | 07:03 |
| jamielennox | lifeless: so i've no idea what the cryptography issue is but ^is going to break anyone that's running open ended specs | 07:04 |
| jamielennox | s/specs/requirements | 07:04 |
| lifeless | jamielennox: http://logs.openstack.org/56/212356/1/check/gate-tempest-dsvm-full/0fc9d19/logs/devstacklog.txt.gz#_2015-08-13_06_24_43_701 ? | 07:06 |
| jamielennox | lifeless: yes | 07:06 |
| *** dizquierdo has quit IRC | 07:08 | |
| lifeless | jamielennox: will you also push up the revert? | 07:08 |
| lifeless | nvm, I willl | 07:09 |
| jamielennox | lifeless: i fixed it a different way, i'll let mordred decide if he wants to revert it or take the fix | 07:09 |
| jamielennox | he'll have to do a new release either way | 07:09 |
| jamielennox | https://review.openstack.org/#/c/212377/ | 07:09 |
| lifeless | I suspect he's still sunning himself in Bali :) | 07:09 |
| *** FallenPegasus has quit IRC | 07:10 | |
| *** dizquierdo has joined #openstack-infra | 07:10 | |
| jamielennox | maybe, but he still pops up on irc and he only did that release today | 07:10 |
| lifeless | :) | 07:10 |
| lifeless | the good news is CI was unaffected | 07:10 |
| lifeless | except third-party I guess | 07:11 |
| lifeless | so score one for system working as designed | 07:11 |
| *** esmute_ has joined #openstack-infra | 07:11 | |
| *** salv-orlando has joined #openstack-infra | 07:11 | |
| *** zeih has joined #openstack-infra | 07:13 | |
| *** markus_z has joined #openstack-infra | 07:13 | |
| *** med_ has joined #openstack-infra | 07:15 | |
| *** med_ is now known as Guest61394 | 07:15 | |
| *** zeih has quit IRC | 07:15 | |
| *** esmute_ has quit IRC | 07:16 | |
| jamielennox | so the generated-constraints update would fail before it got to gate, nice | 07:16 |
| *** ivar-lazzaro has joined #openstack-infra | 07:17 | |
| *** fifieldt has quit IRC | 07:17 | |
| *** e0ne has joined #openstack-infra | 07:17 | |
| lifeless | jamielennox: yes | 07:18 |
| *** otter768 has joined #openstack-infra | 07:18 | |
| lifeless | dougwig: I mean, if you have questions, please - lets discuss | 07:18 |
| lifeless | dougwig: but I thought at the time it was fairly self explanatory | 07:18 |
| *** camunoz has quit IRC | 07:22 | |
| *** cdent has joined #openstack-infra | 07:22 | |
| *** otter768 has quit IRC | 07:22 | |
| *** charz has quit IRC | 07:22 | |
| *** esmute_ has joined #openstack-infra | 07:23 | |
| *** dtantsur|afk has quit IRC | 07:23 | |
| *** dtantsur has joined #openstack-infra | 07:24 | |
| *** mtreinish has quit IRC | 07:24 | |
| *** jthan has quit IRC | 07:24 | |
| GheRivero | jamielennox: lifeless: do you want the revert first or the fix for o-c-c? | 07:24 |
| *** jthan has joined #openstack-infra | 07:24 | |
| lifeless | anteaya: for when you get up: sorry for name calling [prickly pear]. I was angry at your claiming that I had told you what to do. | 07:25 |
| *** mwagner_lap has quit IRC | 07:25 | |
| *** therve has quit IRC | 07:25 | |
| *** therve has joined #openstack-infra | 07:25 | |
| lifeless | anteaya: but my response was out of line itself. So: sorry. | 07:25 |
| lifeless | GheRivero: I have no opinion. Right now trunk is broken though, so one or other :) | 07:25 |
| *** dguerri` is now known as dguerri | 07:26 | |
| GheRivero | will go with the revert. The fix including oslo.cfg will need a deeper look | 07:26 |
| *** rossella_ has joined #openstack-infra | 07:27 | |
| openstackgerrit | Jamie Lennox proposed openstack-infra/project-config: Add os-client-config functional testing https://review.openstack.org/212386 | 07:27 |
| *** charz has joined #openstack-infra | 07:27 | |
| *** mwagner_lap has joined #openstack-infra | 07:27 | |
| *** mtreinish has joined #openstack-infra | 07:27 | |
| jamielennox | GheRivero: revert probably makes more sense immediately | 07:28 |
| GheRivero | done | 07:28 |
| jamielennox | GheRivero: do you have the ability to push a version? | 07:29 |
| jamielennox | probably worth doing a 1.6.3 immediately, maybe take 1.6.2 off pypi | 07:29 |
| GheRivero | jamielennox: I don't know how to do that or if I have the ability | 07:30 |
| *** dguerri is now known as dguerri` | 07:31 | |
| jamielennox | looks like just mordred https://review.openstack.org/#/admin/groups/455,members | 07:31 |
| GheRivero | :/ | 07:35 |
| *** jlanoux has joined #openstack-infra | 07:37 | |
| lifeless | any infra root can | 07:40 |
| lifeless | using the account that publishes releases | 07:40 |
| lifeless | [to take off of pypi] | 07:40 |
| *** esmute_ has quit IRC | 07:41 | |
| *** e0ne has quit IRC | 07:41 | |
| *** deepakcs has quit IRC | 07:41 | |
| *** HeOS has quit IRC | 07:41 | |
| *** changbl has quit IRC | 07:41 | |
| *** alex_xu has quit IRC | 07:41 | |
| *** openstackgerrit has quit IRC | 07:41 | |
| *** akscram has quit IRC | 07:41 | |
| *** pabelanger has quit IRC | 07:41 | |
| *** coreycb has quit IRC | 07:41 | |
| *** dosaboy has quit IRC | 07:41 | |
| *** hogepodge has quit IRC | 07:41 | |
| *** gnuoy has quit IRC | 07:41 | |
| *** dhp has quit IRC | 07:41 | |
| *** ttx has quit IRC | 07:41 | |
| *** mattymo has quit IRC | 07:41 | |
| *** crinkle has quit IRC | 07:41 | |
| *** tteggel_ has quit IRC | 07:41 | |
| *** _fortis has quit IRC | 07:41 | |
| *** Kiall has quit IRC | 07:41 | |
| *** cody-somerville- has quit IRC | 07:41 | |
| *** timburke has quit IRC | 07:41 | |
| *** devananda has quit IRC | 07:41 | |
| *** ParsectiX has quit IRC | 07:41 | |
| *** hughsaunders has quit IRC | 07:42 | |
| *** oomichi has quit IRC | 07:42 | |
| *** deepakcs has joined #openstack-infra | 07:42 | |
| *** HeOS has joined #openstack-infra | 07:42 | |
| *** changbl has joined #openstack-infra | 07:42 | |
| *** alex_xu has joined #openstack-infra | 07:42 | |
| *** openstackgerrit has joined #openstack-infra | 07:42 | |
| *** akscram has joined #openstack-infra | 07:42 | |
| *** pabelanger has joined #openstack-infra | 07:42 | |
| *** coreycb has joined #openstack-infra | 07:42 | |
| *** dosaboy has joined #openstack-infra | 07:42 | |
| *** hogepodge has joined #openstack-infra | 07:42 | |
| *** gnuoy has joined #openstack-infra | 07:42 | |
| *** dhp has joined #openstack-infra | 07:42 | |
| *** ttx has joined #openstack-infra | 07:42 | |
| *** mattymo has joined #openstack-infra | 07:42 | |
| *** crinkle has joined #openstack-infra | 07:42 | |
| *** tteggel_ has joined #openstack-infra | 07:42 | |
| *** _fortis has joined #openstack-infra | 07:42 | |
| *** Kiall has joined #openstack-infra | 07:42 | |
| *** cody-somerville- has joined #openstack-infra | 07:42 | |
| *** timburke has joined #openstack-infra | 07:42 | |
| *** devananda has joined #openstack-infra | 07:42 | |
| *** [HeOS] has joined #openstack-infra | 07:43 | |
| *** _fortis has quit IRC | 07:44 | |
| *** mattymo has quit IRC | 07:44 | |
| *** crinkle_ has joined #openstack-infra | 07:44 | |
| rm_work | erk | 07:44 |
| rm_work | so that "ERROR: openstack Missing parameter(s): " is being resolved presently? :P | 07:44 |
| rm_work | seems like *every time* i start spinning up a new devstack box, something horrible has just broken :P | 07:45 |
| *** coreycb has quit IRC | 07:45 | |
| lifeless | rm_work: use USE_CONSTRAINTS=True | 07:45 |
| *** alex_xu has quit IRC | 07:45 | |
| *** openstackgerrit has quit IRC | 07:45 | |
| *** akscram has quit IRC | 07:45 | |
| *** pabelanger has quit IRC | 07:45 | |
| *** dhp has quit IRC | 07:45 | |
| *** ttx has quit IRC | 07:45 | |
| *** devananda has quit IRC | 07:45 | |
| rm_work | where do I put that | 07:45 |
| rm_work | export it first? | 07:46 |
| rm_work | or does it go in a config | 07:46 |
| lifeless | http://lists.openstack.org/pipermail/openstack-dev/2015-July/068569.html | 07:46 |
| *** hughsaunders has joined #openstack-infra | 07:46 | |
| *** deepakcs has quit IRC | 07:46 | |
| *** HeOS has quit IRC | 07:46 | |
| *** changbl has quit IRC | 07:46 | |
| *** dosaboy has quit IRC | 07:46 | |
| *** hogepodge has quit IRC | 07:46 | |
| *** gnuoy has quit IRC | 07:46 | |
| *** crinkle has quit IRC | 07:46 | |
| *** tteggel_ has quit IRC | 07:46 | |
| *** Kiall has quit IRC | 07:46 | |
| *** cody-somerville- has quit IRC | 07:46 | |
| *** timburke has quit IRC | 07:46 | |
| rm_work | ah in stack config | 07:46 |
| rm_work | k | 07:46 |
| *** devananda has joined #openstack-infra | 07:47 | |
| *** dhp has joined #openstack-infra | 07:47 | |
| *** cody-somerville- has joined #openstack-infra | 07:47 | |
| *** dosaboy has joined #openstack-infra | 07:48 | |
| *** tteggel has joined #openstack-infra | 07:48 | |
| *** Kiall has joined #openstack-infra | 07:48 | |
| rm_work | lifeless: i assume just anywhere in my localrc is fine | 07:49 |
| lifeless | rm_work: I presume so | 07:49 |
| lifeless | rm_work: wherever you put other variables like enabling services etc | 07:49 |
| *** coreycb has joined #openstack-infra | 07:50 | |
| *** ttx has joined #openstack-infra | 07:50 | |
| *** alex_xu has joined #openstack-infra | 07:51 | |
| *** _fortis has joined #openstack-infra | 07:51 | |
| *** gnuoy has joined #openstack-infra | 07:51 | |
| *** ttx has quit IRC | 07:52 | |
| *** ttx has joined #openstack-infra | 07:52 | |
| *** pabelanger has joined #openstack-infra | 07:52 | |
| *** nelsnelson has quit IRC | 07:53 | |
| *** mattymo has joined #openstack-infra | 07:54 | |
| *** timburke has joined #openstack-infra | 07:55 | |
| *** shashank_hegde has quit IRC | 07:56 | |
| *** rm_work is now known as rm_work|away | 07:56 | |
| *** rm_work|away is now known as rm_work | 07:58 | |
| *** bharath has joined #openstack-infra | 07:58 | |
| *** akscram has joined #openstack-infra | 07:58 | |
| *** deepakcs has joined #openstack-infra | 07:58 | |
| *** openstackgerrit has joined #openstack-infra | 08:00 | |
| *** jcoufal has joined #openstack-infra | 08:00 | |
| *** rm_work is now known as rm_work|away | 08:00 | |
| *** changbl has joined #openstack-infra | 08:01 | |
| *** shashank_hegde has joined #openstack-infra | 08:01 | |
| *** shashank_hegde has quit IRC | 08:01 | |
| *** placko_ has joined #openstack-infra | 08:01 | |
| *** bharath has quit IRC | 08:03 | |
| *** rm_work|away is now known as rm_work | 08:03 | |
| *** ivar-lazzaro has quit IRC | 08:04 | |
| *** notnownikki has joined #openstack-infra | 08:06 | |
| *** ParsectiX has joined #openstack-infra | 08:08 | |
| *** fhubik has joined #openstack-infra | 08:11 | |
| *** chlong has quit IRC | 08:13 | |
| *** Kennan has quit IRC | 08:14 | |
| *** pblaho has joined #openstack-infra | 08:14 | |
| *** fhubik is now known as fhubik_brb | 08:14 | |
| openstackgerrit | Merged openstack-infra/shade: Add a developer coding standards doc https://review.openstack.org/211148 | 08:17 |
| *** gildub has quit IRC | 08:17 | |
| *** yamahata has quit IRC | 08:17 | |
| *** fhubik_brb is now known as fhubik | 08:19 | |
| *** jokke_ has quit IRC | 08:20 | |
| *** Kennan has joined #openstack-infra | 08:21 | |
| *** [HeOS] has quit IRC | 08:24 | |
| *** rm_work is now known as rm_work|away | 08:25 | |
| *** rm_work|away is now known as rm_work | 08:25 | |
| *** jistr has joined #openstack-infra | 08:26 | |
| *** jcoufal has quit IRC | 08:27 | |
| *** yamamoto has quit IRC | 08:27 | |
| *** rm_work is now known as rm_work|away | 08:28 | |
| *** yamamoto has joined #openstack-infra | 08:28 | |
| *** rm_work|away is now known as rm_work | 08:29 | |
| *** achanda has quit IRC | 08:33 | |
| *** notnownikki has quit IRC | 08:36 | |
| *** jcoufal has joined #openstack-infra | 08:37 | |
| *** laughterwym__ has quit IRC | 08:38 | |
| openstackgerrit | Clint Adams proposed openstack-infra/release-tools: python3-compatible syntax https://review.openstack.org/211972 | 08:38 |
| *** larainema has quit IRC | 08:40 | |
| *** larainema has joined #openstack-infra | 08:40 | |
| *** crinkle_ is now known as crinkle | 08:41 | |
| *** markvoelker has joined #openstack-infra | 08:43 | |
| *** hogepodge has joined #openstack-infra | 08:43 | |
| *** pelix has joined #openstack-infra | 08:47 | |
| *** markvoelker has quit IRC | 08:47 | |
| *** jcoufal has quit IRC | 08:49 | |
| *** tsg has joined #openstack-infra | 08:52 | |
| openstackgerrit | Bharat Kumar Kobagana (BharatK) proposed openstack-infra/project-config: Refactoring Manila GlusterFS job definitions https://review.openstack.org/212419 | 08:53 |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config: WIP: Enable VPNaaS for neutronclient-dsvm-functional https://review.openstack.org/212420 | 08:55 |
| *** tsg has quit IRC | 08:57 | |
| mordred | jamielennox: what did I do? | 08:58 |
| mordred | jamielennox, lifeless: ah - we need to roll forward to jamielennox's patch and a 1.6.3? | 08:59 |
| mordred | oh. oy. that requires oslo.config | 08:59 |
| * mordred ponders | 09:01 | |
| *** dingyichen has quit IRC | 09:04 | |
| mordred | jamielennox: ksc as it is curret is going to pull in oslo.config anyway, right? | 09:04 |
| mordred | so the fix is inline with "if you're in teh sticky situation, this will fix you, and we'll fix it betterer later" | 09:06 |
| *** abregman is now known as abregman|lunch | 09:07 | |
| *** ihrachyshka has joined #openstack-infra | 09:08 | |
| *** stevemar has joined #openstack-infra | 09:09 | |
| jamielennox | mordred: ksc already has a dep on oslo.config so it shouldn't be an addition there, however GheRivero approved the revert so we can wait and discuss it with OSC | 09:10 |
| jamielennox | mordred: either way works, the revert is probably safer in terms of "this broke the gate, push a new release quickly to fix it" | 09:10 |
| jamielennox | or didn't break the gate as lifeless bolted that down, but it broke some third party CI and cost anteaya some sleep | 09:11 |
| *** notnownikki has joined #openstack-infra | 09:12 | |
| *** stevemar has quit IRC | 09:12 | |
| mordred | jamielennox: kk. let's release the revert as 1.6.3, then revert the revert, add your patch and look at that for 1.6.4 | 09:12 |
| *** [HeOS] has joined #openstack-infra | 09:13 | |
| jamielennox | mordred: ++ | 09:13 |
| jamielennox | hopefully we can fix some of this up for ksa | 09:13 |
| mordred | 1.6.3 tag pushed | 09:13 |
| mordred | jamielennox: yah. because eek | 09:13 |
| mordred | GheRivero, jamielennox, lifeless: https://review.openstack.org/#/c/212428/ here's teh revert revert | 09:14 |
| jamielennox | mordred: oh, i also proposed https://review.openstack.org/#/c/212386/ to put a devstack run in the os-client-config gate | 09:15 |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci: Use sudo for pacemaker status output https://review.openstack.org/211535 | 09:15 |
| jamielennox | which i'm guessing is going to be annoying but probably a good idea | 09:15 |
| mordred | jamielennox: that's a great idea ... although sadpanda for slow turnaround times :) | 09:16 |
| openstackgerrit | Merged openstack/requirements: Exclude os-client-config 1.6.2 https://review.openstack.org/212375 | 09:16 |
| mordred | jamielennox: "Hard set this to be what OSC expects for now." | 09:18 |
| *** notnownikki has quit IRC | 09:18 | |
| mordred | jamielennox: shouldn't the ... oh, hrm. urg. | 09:18 |
| *** eantyshev has joined #openstack-infra | 09:18 | |
| *** otter768 has joined #openstack-infra | 09:19 | |
| mordred | jamielennox: but auth_plugin = ksc_auth.token_endpoint.Token | 09:19 |
| mordred | that patch will fix it for people using osc but still prevent people trying to use token_endpoint auth_type from not-osc from being able to do so | 09:20 |
| mordred | perhaps we shoudl create our own auth types - "token" == ksc_auth.token_endpoint.Token , "token_endpoint" == osc ? | 09:21 |
| jamielennox | mordred: this is one of the places where dtroyer did his own thing because he wanted to control the cli flags | 09:21 |
| jamielennox | he and i have argued about it ever since | 09:21 |
| mordred | well, it has broken some things, because we have two plugins with the same name but with different option names | 09:22 |
| jamielennox | he thought --os-url was more user friendly than --os-endpoint, and i don't care either way but if he used the ksc ones then they would be the same for every application | 09:22 |
| openstackgerrit | Nicko Glayre proposed openstack-infra/jenkins-job-builder: Customized pollscm trigger https://review.openstack.org/211993 | 09:22 |
| mordred | jamielennox: ++ | 09:22 |
| jamielennox | mordred: OSC does a whole bunch of validation as well that is on top of ksc | 09:22 |
| jamielennox | in past i've come up with a number of ways we could do this, have OSC define it's own setuptools entry points for plugins and then fall back to a generic loader from ksc if it doesn't know | 09:23 |
| *** otter768 has quit IRC | 09:23 | |
| jamielennox | i had that all ready when OSC adopted OCC | 09:23 |
| jamielennox | and all the paths changed | 09:23 |
| mordred | *doh* | 09:24 |
| jamielennox | my next plan is when ksa is released that we can make OCC depend directly on it and then just offload all the validation etc to it and remove it from OSC | 09:25 |
| jamielennox | and if we have to change a few parameters then at least it's still in one reusable place | 09:25 |
| mordred | yup | 09:25 |
| mordred | I think that's a good plan | 09:25 |
| jamielennox | because IMO OCC should return a plugin, not a dictionary | 09:26 |
| jamielennox | that would have solved this problem as well, because it's OSC looking directly for options | 09:26 |
| mordred | you might have to get me drunk on the "return a plugin" thing | 09:26 |
| mordred | it does currently return an object though | 09:26 |
| mordred | so perhaps making sure that object implements an interface would not be bad | 09:27 |
| jamielennox | mordred: if yaml was stdlib then i'd be inclined just to import it into ksa | 09:27 |
| jamielennox | i think we discussed this briefly at summit | 09:27 |
| mordred | yah. also - why yaml isn't stdlib is bonghits to me... but that's another subject altogether | 09:28 |
| yolanda | mordred, i answered to your questions on https://review.openstack.org/#/c/210502/ and https://review.openstack.org/#/c/209954/ | 09:28 |
| *** AzherKhan has joined #openstack-infra | 09:29 | |
| *** aukhan has quit IRC | 09:29 | |
| *** dtantsur is now known as dtantsur|brb | 09:30 | |
| *** jokke_ has joined #openstack-infra | 09:30 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Make gate-manila-python34 votable https://review.openstack.org/212438 | 09:35 |
| jamielennox | PyYAML is a c binding as well, i get it but scary for a really low level dep | 09:36 |
| *** gildub has joined #openstack-infra | 09:37 | |
| mordred | yolanda: kk | 09:38 |
| mordred | jamielennox: so - back to the current thing | 09:38 |
| *** notnownikki has joined #openstack-infra | 09:39 | |
| mordred | jamielennox: what do we do in the short term to allow humans to use ksc token auth and osc token_endpoint auth? | 09:39 |
| yolanda | mordred, did it sound like a suggestion to review my changes? :) | 09:39 |
| mordred | jamielennox: should we make the hard-coded workaround named "token" rather than "token_endpoint" ? | 09:39 |
| jamielennox | so token has a meaning | 09:40 |
| mordred | oh. piddle | 09:40 |
| jamielennox | it's for authenticating with an exisitng token - | 09:40 |
| mordred | isnt' that what token does? | 09:40 |
| mordred | I mean, token_endpoint? | 09:40 |
| jamielennox | though the more i see it the more it's a requirement in code but probably doesn't need to be user facing | 09:40 |
| jamielennox | mordred: token goes via keystone, given this token get a new token with full service catalog, possible rescope etc | 09:41 |
| *** laughterwym has joined #openstack-infra | 09:41 | |
| jamielennox | it's the service_catalog which is a problem generally for people wanting to use a token | 09:42 |
| mordred | gotcha | 09:42 |
| *** yamamoto has quit IRC | 09:42 | |
| jamielennox | we can call it just "endpoitn" | 09:43 |
| jamielennox | endpoint | 09:43 |
| mordred | k. maybe that's what we shoudl do | 09:43 |
| mordred | at least for now | 09:43 |
| jamielennox | i've never been too concerned as i figured it would just end up as a auth_plugin=XXX string in a yaml file or accrc | 09:43 |
| *** yamamoto has joined #openstack-infra | 09:44 | |
| jamielennox | if you don't know what it is you shouldn't use it | 09:44 |
| mordred | well, yeah - problem is people are trying to use it currently | 09:44 |
| mordred | and the osc thing was breaking them | 09:44 |
| mordred | because oscc coudlnt' validate their options, etc | 09:44 |
| jamielennox | so my bigger problem is https://github.com/openstack/python-openstackclient/blob/master/openstackclient/api/auth.py#L75 | 09:45 |
| dstufft | anteaya: I am now | 09:45 |
| jamielennox | we now have 3 projects trying to validate options | 09:46 |
| jamielennox | and i see how i could be considered biased... | 09:46 |
| mordred | well... so I'm about to be a big ass | 09:46 |
| mordred | and say that osc doing things differently is the thign that's wrong | 09:46 |
| *** bharath__ has joined #openstack-infra | 09:47 | |
| mordred | and I'm very disinclined to perpetuate taht bug | 09:47 |
| mordred | ksa is the source of truth for auth plugins | 09:47 |
| mordred | gah | 09:47 |
| mordred | ksc is the source of truth for auth plugins | 09:47 |
| mordred | and ksa isa bout to be | 09:47 |
| jamielennox | i've had this fight, but yes | 09:47 |
| mordred | well, no, I'm going to unrevert that patch and I will release occ | 09:47 |
| mordred | and osc can either stop using it or fix itself | 09:48 |
| mordred | because this is not ok | 09:48 |
| jamielennox | i haven't looked back into OCC for ksa, it's changed so much i need to figure out how that will work again | 09:48 |
| mordred | I'm going to go drink right now | 09:49 |
| mordred | but when I'm less drun tomorrow, Ill dive in | 09:49 |
| jamielennox | mordred: right - you're supposed to be on holiday, remember? | 09:49 |
| *** bharath__ has quit IRC | 09:51 | |
| EmilienM | I'm facing a Gerrit issue - I can't access to my own patch when I'm logged - https://review.openstack.org/#/c/209296/ - got "The page you requested was not found, or you do not have permission to view this page" | 09:52 |
| EmilienM | if I'm unlogged, I can see the patch | 09:52 |
| *** jcoufal has joined #openstack-infra | 09:53 | |
| EmilienM | I tried with 2 different browsers | 09:53 |
| *** fhubik is now known as fhubik_brb | 09:58 | |
| *** boris-42 has quit IRC | 10:00 | |
| *** fhubik_brb is now known as fhubik | 10:05 | |
| *** jeblair has quit IRC | 10:15 | |
| *** jeblair has joined #openstack-infra | 10:16 | |
| *** dtantsur|brb is now known as dtantsur | 10:16 | |
| *** rlandy has joined #openstack-infra | 10:17 | |
| *** abregman|lunch is now known as abregman | 10:18 | |
| *** yamamoto has quit IRC | 10:21 | |
| *** pc_m has joined #openstack-infra | 10:22 | |
| Clint | dhellmann: no, i don't | 10:24 |
| *** yamamoto has joined #openstack-infra | 10:28 | |
| *** yamamoto has quit IRC | 10:28 | |
| *** yamamoto has joined #openstack-infra | 10:28 | |
| dmellado | anteaya: just checked https://review.openstack.org/#/c/212349/512150 | 10:32 |
| dmellado | sorry, https://review.openstack.org/#/c/212349/ | 10:33 |
| dmellado | could you please give me the link to the upstream bug? | 10:33 |
| dmellado | I commented there, but maybe it wasn't the most proper place | 10:33 |
| dmellado | thanks! | 10:33 |
| openstackgerrit | Chris Dent proposed openstack-infra/project-config: Make aodh dsvm functional tests voting and gating https://review.openstack.org/212459 | 10:37 |
| *** markvoelker has joined #openstack-infra | 10:43 | |
| *** jcoufal_ has joined #openstack-infra | 10:44 | |
| *** kushal has joined #openstack-infra | 10:44 | |
| *** yamamoto has quit IRC | 10:46 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate: neutron: enable q-qos service for gate jobs https://review.openstack.org/212464 | 10:47 |
| *** jcoufal has quit IRC | 10:47 | |
| *** markvoelker has quit IRC | 10:48 | |
| *** rkukura has joined #openstack-infra | 10:50 | |
| *** Hal has joined #openstack-infra | 10:51 | |
| *** claudiub has joined #openstack-infra | 10:51 | |
| *** Hal is now known as Guest55435 | 10:51 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Add 2 missing jobs to ironic-lib https://review.openstack.org/212468 | 10:53 |
| openstackgerrit | Ramakrishnan G proposed openstack-infra/project-config: Add python34 job for ironic-lib https://review.openstack.org/212469 | 10:58 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Do not import using oslo namespace https://review.openstack.org/212473 | 11:02 |
| *** chlong has joined #openstack-infra | 11:04 | |
| *** AzherKhan has quit IRC | 11:04 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config: Removed special treatment for feature/qos branch https://review.openstack.org/212475 | 11:05 |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Optionally check for diskimages on nodepool log generation tool https://review.openstack.org/212477 | 11:06 |
| *** hichihara has quit IRC | 11:07 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Enable VPN DevStack plugin for neutron client https://review.openstack.org/209887 | 11:10 |
| *** stevemar has joined #openstack-infra | 11:10 | |
| *** gildub has quit IRC | 11:11 | |
| *** stevemar has quit IRC | 11:14 | |
| *** rkukura has quit IRC | 11:14 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config: Removed special treatment for feature/qos branch https://review.openstack.org/212475 | 11:14 |
| *** dizquierdo has quit IRC | 11:19 | |
| *** dizquierdo has joined #openstack-infra | 11:19 | |
| *** otter768 has joined #openstack-infra | 11:20 | |
| mordred | jamielennox: OH - I see a thing I missed in your patch | 11:21 |
| mordred | jamielennox: your patch should work with both | 11:21 |
| mordred | things | 11:21 |
| mordred | because it declares endpoint as a deprecated option | 11:21 |
| mordred | or deprecated_name | 11:21 |
| mordred | so that means that a human passing in either token/endpoint or token/url will work | 11:22 |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Make gate-manila-python34 votable https://review.openstack.org/212438 | 11:23 |
| jamielennox | mordred: i thought that too, it failed in validation somewhere in OSC - i didn't look far into why | 11:23 |
| jamielennox | possibly because it's not registering the --os-endpoint to argparse | 11:24 |
| *** jcoufal has joined #openstack-infra | 11:24 | |
| *** rlandy has quit IRC | 11:24 | |
| *** otter768 has quit IRC | 11:25 | |
| *** fhubik is now known as fhubik_brb | 11:25 | |
| *** dizquierdo has quit IRC | 11:26 | |
| mordred | hrm | 11:27 |
| *** jcoufal_ has quit IRC | 11:27 | |
| *** dizquierdo has joined #openstack-infra | 11:31 | |
| *** dizquierdo has quit IRC | 11:32 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: OIDC - OpenId Connect Implementation https://review.openstack.org/198458 | 11:33 |
| *** ParsectiX has quit IRC | 11:33 | |
| *** jcoufal_ has joined #openstack-infra | 11:33 | |
| *** yamamoto has joined #openstack-infra | 11:34 | |
| *** thorst has joined #openstack-infra | 11:35 | |
| *** bharath has joined #openstack-infra | 11:35 | |
| *** jcoufal has quit IRC | 11:37 | |
| *** bharath has quit IRC | 11:40 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: jenkins/scripts/copy_puppet_logs: copy apache logs only if exist https://review.openstack.org/212493 | 11:41 |
| *** w_ has joined #openstack-infra | 11:43 | |
| *** markvoelker has joined #openstack-infra | 11:44 | |
| *** kushal has quit IRC | 11:45 | |
| *** fhubik_brb is now known as fhubik | 11:45 | |
| *** olaph has quit IRC | 11:46 | |
| *** baoli has joined #openstack-infra | 11:46 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Prepare tempest job for ironic-lib https://review.openstack.org/212495 | 11:47 |
| *** markvoelker has quit IRC | 11:49 | |
| *** jklare has quit IRC | 11:51 | |
| *** marzif has joined #openstack-infra | 11:51 | |
| *** markvoelker has joined #openstack-infra | 11:53 | |
| *** dingyichen has joined #openstack-infra | 11:54 | |
| *** ldnunes has joined #openstack-infra | 11:56 | |
| *** mrmartin has quit IRC | 11:58 | |
| *** yamamoto has quit IRC | 12:07 | |
| *** bswartz has quit IRC | 12:09 | |
| *** EricGonczer_ has joined #openstack-infra | 12:09 | |
| yolanda | AJaeger, i got another +2 for the puppet-infra-cookiecutter project, can i get that approved? | 12:11 |
| *** otter768 has joined #openstack-infra | 12:11 | |
| *** notnownikki has quit IRC | 12:12 | |
| *** EricGonczer_ has quit IRC | 12:13 | |
| *** gordc has joined #openstack-infra | 12:13 | |
| *** warpc__ has joined #openstack-infra | 12:13 | |
| *** vinayyadhav has joined #openstack-infra | 12:19 | |
| *** erlon has joined #openstack-infra | 12:21 | |
| *** otter768 has quit IRC | 12:24 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add in extra connections tests https://review.openstack.org/169300 | 12:24 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Refactor sources out of triggers https://review.openstack.org/118993 | 12:24 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Document the new connections in zuul https://review.openstack.org/169270 | 12:24 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Configure triggers dynamically https://review.openstack.org/119534 | 12:24 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add support for 'connection' concept https://review.openstack.org/121528 | 12:24 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for triggers https://review.openstack.org/119532 | 12:24 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for sources https://review.openstack.org/119531 | 12:24 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for reporters https://review.openstack.org/119530 | 12:24 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add support for negative requirements (take 2) https://review.openstack.org/211108 | 12:24 |
| *** jklare has joined #openstack-infra | 12:26 | |
| *** funzo has joined #openstack-infra | 12:27 | |
| *** rkukura has joined #openstack-infra | 12:28 | |
| *** funzo has quit IRC | 12:32 | |
| *** aysyd has joined #openstack-infra | 12:32 | |
| *** jcoufal_ has quit IRC | 12:33 | |
| *** ajmiller has quit IRC | 12:33 | |
| sdague | mordred: aren't you supposed to be vacationing or something? | 12:33 |
| sdague | fungi: gerrit has gone into uber slow mode again | 12:33 |
| *** annegentle has joined #openstack-infra | 12:34 | |
| *** bnemec has joined #openstack-infra | 12:34 | |
| openstackgerrit | Merged openstack-infra/project-config: jenkins/scripts/copy_puppet_logs: copy apache logs only if exist https://review.openstack.org/212493 | 12:36 |
| Shrews | sdague: he is another year older now and forgets things more easily :) | 12:38 |
| sdague | :) | 12:38 |
| *** jcoufal has joined #openstack-infra | 12:38 | |
| *** tpborion_afk has joined #openstack-infra | 12:39 | |
| sdague | I'm a whole 8 days older than him, so no excuses | 12:39 |
| Kiall | sdague: uber slow mode is an understatement ;) | 12:39 |
| sdague | yeh, typically that means that it's leaked too much memory | 12:39 |
| sdague | and needs a restart | 12:39 |
| *** madong_ has joined #openstack-infra | 12:40 | |
| *** larainema has quit IRC | 12:40 | |
| *** tpborion_afk is now known as tpborion | 12:42 | |
| tpborion | sdague: do you have some seconds to take a look at this? https://review.openstack.org/#/c/211301/ | 12:42 |
| sdague | tpborion: approved | 12:43 |
| tpborion | sdague: Thank you! | 12:43 |
| *** dkranz has joined #openstack-infra | 12:43 | |
| *** deepakcs has quit IRC | 12:45 | |
| *** tlian has joined #openstack-infra | 12:49 | |
| *** jsavak has joined #openstack-infra | 12:50 | |
| *** sergmelikyan has joined #openstack-infra | 12:51 | |
| openstackgerrit | Merged openstack-infra/project-config: Make gate-manila-python34 votable https://review.openstack.org/212438 | 12:51 |
| *** gordc has quit IRC | 12:51 | |
| EmilienM | sdague: I have a permission error on https://review.openstack.org/#/c/209296/ - if you're admin, can you abandon https://review.openstack.org/#/c/209296/ please ? | 12:51 |
| *** jcoufal has quit IRC | 12:52 | |
| *** jcoufal has joined #openstack-infra | 12:52 | |
| *** fawadkhaliq has quit IRC | 12:52 | |
| openstackgerrit | Merged openstack-infra/project-config: Adds python-oneviewclient project https://review.openstack.org/211301 | 12:53 |
| *** rkukura has quit IRC | 12:53 | |
| *** fhubik is now known as fhubik_brb | 12:53 | |
| *** sdake has joined #openstack-infra | 12:53 | |
| *** bswartz has joined #openstack-infra | 12:53 | |
| *** sdake_ has joined #openstack-infra | 12:54 | |
| *** doug-fish has joined #openstack-infra | 12:54 | |
| openstackgerrit | Merged openstack-infra/project-config: Make aodh dsvm functional tests voting and gating https://review.openstack.org/212459 | 12:54 |
| *** rfolco has joined #openstack-infra | 12:55 | |
| *** bapalm has joined #openstack-infra | 12:55 | |
| *** sergmelikyan has quit IRC | 12:56 | |
| *** bapalm__ has joined #openstack-infra | 12:57 | |
| *** sdake has quit IRC | 12:57 | |
| *** bapalm___ has joined #openstack-infra | 12:58 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Start using cgit::lb class https://review.openstack.org/181829 | 12:59 |
| *** bapalm has quit IRC | 12:59 | |
| *** mrmartin has joined #openstack-infra | 13:00 | |
| *** bexelbie_ has joined #openstack-infra | 13:01 | |
| *** openstackgerrit has quit IRC | 13:01 | |
| *** bapalm__ has quit IRC | 13:01 | |
| *** bexelbie_ is now known as bexelbie | 13:02 | |
| *** openstackgerrit has joined #openstack-infra | 13:02 | |
| *** fhubik_brb is now known as fhubik | 13:02 | |
| *** baoli_ has joined #openstack-infra | 13:02 | |
| *** xyang1 has joined #openstack-infra | 13:03 | |
| *** mestery has quit IRC | 13:03 | |
| *** annegentle has quit IRC | 13:04 | |
| *** baoli has quit IRC | 13:04 | |
| *** annegentle has joined #openstack-infra | 13:05 | |
| *** bapalm___ has quit IRC | 13:05 | |
| *** yamamoto has joined #openstack-infra | 13:07 | |
| openstackgerrit | Merged openstack-infra/project-config: Add 2 missing jobs to ironic-lib https://review.openstack.org/212468 | 13:07 |
| *** spzala has joined #openstack-infra | 13:08 | |
| *** otter768 has joined #openstack-infra | 13:08 | |
| sdague | EmilienM: I am not a gerrit admin | 13:10 |
| EmilienM | oops | 13:10 |
| EmilienM | sdague: sorry for the noise then | 13:10 |
| sdague | no prob | 13:10 |
| sdague | any idea what happened with that change? | 13:10 |
| EmilienM | I have no clue, it's weird | 13:10 |
| EmilienM | it's a patch of mine | 13:10 |
| EmilienM | and I can't access to it anymre | 13:10 |
| EmilienM | if I'm logged | 13:10 |
| EmilienM | unlogged, I can access it | 13:11 |
| *** stevemar has joined #openstack-infra | 13:11 | |
| *** rguillebert has joined #openstack-infra | 13:11 | |
| *** mestery has joined #openstack-infra | 13:11 | |
| *** yamamoto has quit IRC | 13:12 | |
| *** mrodden has joined #openstack-infra | 13:13 | |
| *** fawadkhaliq has joined #openstack-infra | 13:13 | |
| *** ajmiller has joined #openstack-infra | 13:14 | |
| *** stevemar has quit IRC | 13:15 | |
| *** placko_ has quit IRC | 13:15 | |
| sdague | what project is it? maybe there is a bad acl on that project | 13:16 |
| *** moravec has joined #openstack-infra | 13:18 | |
| sdague | so, there is no ACL file for this project | 13:18 |
| openstackgerrit | Nicko Glayre proposed openstack-infra/jenkins-job-builder: Stash publisher's credentials configuration https://review.openstack.org/212004 | 13:18 |
| sdague | EmilienM: which seems very very weird | 13:19 |
| *** julim has quit IRC | 13:19 | |
| sdague | that is probably the root issue | 13:19 |
| *** tiswanso has joined #openstack-infra | 13:20 | |
| *** akshai has joined #openstack-infra | 13:21 | |
| EmilienM | sdague: I don't think it's the issue because we are pushing patches on this project for a while and I tested another new patch this morning and it works | 13:21 |
| EmilienM | sdague: it's just this patch | 13:21 |
| *** dkranz has quit IRC | 13:21 | |
| *** sergmelikyan has joined #openstack-infra | 13:22 | |
| *** mrodden has quit IRC | 13:22 | |
| *** mrodden has joined #openstack-infra | 13:22 | |
| *** otter768 has quit IRC | 13:22 | |
| *** uberjay has quit IRC | 13:23 | |
| *** bebech has joined #openstack-infra | 13:24 | |
| *** bharath has joined #openstack-infra | 13:24 | |
| sdague | yeh, ok, these do this in a different way. I see it now | 13:24 |
| *** uberjay has joined #openstack-infra | 13:25 | |
| *** uberjay has quit IRC | 13:27 | |
| *** bebech has quit IRC | 13:27 | |
| *** uberjay has joined #openstack-infra | 13:27 | |
| *** bharath has quit IRC | 13:28 | |
| *** regXboi has joined #openstack-infra | 13:31 | |
| openstackgerrit | Merged openstack-infra/puppet-httpd: Add vim swp files to gitignore https://review.openstack.org/211861 | 13:31 |
| *** jsavak has quit IRC | 13:31 | |
| *** amitgandhinz has joined #openstack-infra | 13:32 | |
| *** uberjay has quit IRC | 13:32 | |
| *** alivigni has joined #openstack-infra | 13:33 | |
| *** uberjay has joined #openstack-infra | 13:34 | |
| *** uberjay has quit IRC | 13:34 | |
| *** dkranz has joined #openstack-infra | 13:35 | |
| *** uberjay has joined #openstack-infra | 13:35 | |
| *** uberjay has quit IRC | 13:35 | |
| *** rkukura has joined #openstack-infra | 13:35 | |
| *** uberjay has joined #openstack-infra | 13:36 | |
| *** sergmelikyan has quit IRC | 13:36 | |
| *** sergmelikyan has joined #openstack-infra | 13:37 | |
| *** uberjay has quit IRC | 13:37 | |
| *** prad_ has joined #openstack-infra | 13:37 | |
| mordred | sdague: sure! | 13:38 |
| mordred | sdague: I mean, is this not what vacation looks like to you? :) | 13:39 |
| sdague | vacation != irc for me | 13:39 |
| mordred | nod | 13:40 |
| *** uberjay has joined #openstack-infra | 13:40 | |
| *** uberjay has quit IRC | 13:40 | |
| sdake_ | say any core cats mind looking at my gate review for correctness https://review.openstack.org/#/c/212194/ | 13:40 |
| *** gordc has joined #openstack-infra | 13:41 | |
| openstackgerrit | Nadya Shakhat proposed openstack-infra/project-config: Add DEVSTACK_GATE_POSTGRES variable into functional Ceilometer job https://review.openstack.org/212530 | 13:42 |
| *** ajmiller has quit IRC | 13:43 | |
| *** funzo has joined #openstack-infra | 13:43 | |
| *** jsavak has joined #openstack-infra | 13:43 | |
| *** eharney has quit IRC | 13:43 | |
| *** rkukura has quit IRC | 13:44 | |
| *** puranamr has quit IRC | 13:44 | |
| *** puranamr has joined #openstack-infra | 13:44 | |
| *** uberjay has joined #openstack-infra | 13:45 | |
| *** julim has joined #openstack-infra | 13:46 | |
| *** mriedem has joined #openstack-infra | 13:46 | |
| *** hdd has joined #openstack-infra | 13:47 | |
| *** mwagner_lap has quit IRC | 13:48 | |
| *** funzo has quit IRC | 13:48 | |
| *** alex_xu has quit IRC | 13:48 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/elastic-recheck: Add support to filter results by failure test_ids https://review.openstack.org/209712 | 13:49 |
| *** tiswanso has quit IRC | 13:49 | |
| *** tiswanso has joined #openstack-infra | 13:50 | |
| jklare | hi, somebody here who can tell me where i can find a log from the periodic job from this patch https://review.openstack.org/#/c/194164/2 | 13:50 |
| jklare | i looked through logs.openstack.org/periodic but did not find anthing related | 13:51 |
| *** jswarren has joined #openstack-infra | 13:51 | |
| openstackgerrit | Steve Kowalik proposed openstack-infra/project-config: Add options: translate for all relevant projects https://review.openstack.org/211722 | 13:51 |
| *** alex_xu has joined #openstack-infra | 13:51 | |
| *** moravec has quit IRC | 13:52 | |
| *** moravec has joined #openstack-infra | 13:53 | |
| *** dzamboni has joined #openstack-infra | 13:53 | |
| tpborion | sdague: can you set the PTL and cores for us? | 13:54 |
| tpborion | sdague: what is needed for that? E-mail or just discussion here is fine? | 13:54 |
| *** wenlock has joined #openstack-infra | 13:55 | |
| *** mriedem has quit IRC | 13:55 | |
| sdague | you need an infra core person for that | 13:55 |
| tpborion | can I pass you the names here on the channel? | 13:57 |
| tpborion | or privately? | 13:57 |
| *** sergmelikyan has quit IRC | 13:57 | |
| *** tvanderwiel has joined #openstack-infra | 13:58 | |
| *** tvanderwiel has left #openstack-infra | 13:58 | |
| *** doug-fish has quit IRC | 13:59 | |
| *** mriedem has joined #openstack-infra | 14:00 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/elastic-recheck: Add support to filter results by failure test_ids https://review.openstack.org/209712 | 14:00 |
| *** rkukura has joined #openstack-infra | 14:01 | |
| jgriffith | anteaya: Well interestingly enough, that problem went away sometime between 04:00 MDT and now | 14:02 |
| jgriffith | anteaya: things seem to be happy again | 14:02 |
| *** zz_dimtruck is now known as dimtruck | 14:03 | |
| *** thorst has quit IRC | 14:03 | |
| *** afazekas has quit IRC | 14:03 | |
| *** marzif has quit IRC | 14:04 | |
| *** marzif has joined #openstack-infra | 14:04 | |
| *** tiswanso has quit IRC | 14:05 | |
| fungi | EmilienM: you're the owner of 209296 and a core reviewer. do you have issues performing privileged actions on other changes? are you sure you're logged in? maybe you have more than one gerrit account? | 14:07 |
| EmilienM | fungi: I don't have any issue with anything else | 14:07 |
| EmilienM | only that patch, only when i'm logged | 14:08 |
| *** krtaylor has joined #openstack-infra | 14:08 | |
| *** fifieldt has joined #openstack-infra | 14:08 | |
| fungi | sdague: yeah, gerrit seems slow to me too. seeing if i can spot the cause this time | 14:10 |
| fungi | EmilienM: only when you're logged _in_? | 14:10 |
| EmilienM | yes | 14:10 |
| EmilienM | :) | 14:10 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:10 | |
| fungi | i'll check error logs | 14:10 |
| EmilienM | fungi: don't worry otherwise you can abandon the patch | 14:10 |
| *** vlaza has left #openstack-infra | 14:10 | |
| EmilienM | I created another one and it works now | 14:10 |
| fungi | EmilienM: well, i mostly want to make sure something's not broken with gerrit | 14:11 |
| *** thorst has joined #openstack-infra | 14:11 | |
| *** stevemar has joined #openstack-infra | 14:12 | |
| *** tpborion has left #openstack-infra | 14:12 | |
| *** dizquierdo has joined #openstack-infra | 14:14 | |
| *** k4n0 has quit IRC | 14:14 | |
| *** stevemar has quit IRC | 14:15 | |
| EmilienM | fungi: I've asked someone else to look (spredzy) and he can't see it neither | 14:16 |
| EmilienM | so i'm not alone | 14:16 |
| *** tiswanso has joined #openstack-infra | 14:16 | |
| *** vinayyadhav has quit IRC | 14:16 | |
| *** tpborion has joined #openstack-infra | 14:16 | |
| *** hdd has quit IRC | 14:16 | |
| *** flepied1 has quit IRC | 14:18 | |
| *** flepied has joined #openstack-infra | 14:18 | |
| *** eharney has joined #openstack-infra | 14:18 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Upgrade grafana.o.o to 2.1.0 https://review.openstack.org/209218 | 14:19 |
| *** fhubik has quit IRC | 14:19 | |
| *** fhubik has joined #openstack-infra | 14:19 | |
| *** fhubik has quit IRC | 14:20 | |
| *** annegentle has quit IRC | 14:21 | |
| openstackgerrit | Zhenguo Niu proposed openstack-infra/system-config: Add Mistral channel to eavesdrop https://review.openstack.org/212550 | 14:22 |
| openstackgerrit | Ann Kamyshnikova proposed openstack/requirements: Update Alembic to 0.8.0 https://review.openstack.org/203960 | 14:22 |
| mriedem | this should fix the blocker for neutron grenade in stable/kilo - can we get some eyes on it? https://review.openstack.org/#/c/201279/ | 14:24 |
| tpborion | fungi: can you set some groups for our new project? | 14:24 |
| *** tpborion has left #openstack-infra | 14:24 | |
| *** devlaps has quit IRC | 14:24 | |
| *** tpborion has joined #openstack-infra | 14:24 | |
| fungi | jklare: i'm not having much luck confirming that gate-openstack-chef-repo-chef-rake-integration is being triggered in the periodic pipeline. digging through the debug logs to see if i can figure out what's up there | 14:24 |
| *** zeih has joined #openstack-infra | 14:25 | |
| fungi | tpborion: probably in a bit. my dance card's already pretty full | 14:25 |
| tpborion | fungi: let me know when :) | 14:25 |
| *** hdd has joined #openstack-infra | 14:26 | |
| *** stevemar has joined #openstack-infra | 14:27 | |
| *** barnaby has quit IRC | 14:27 | |
| fungi | EmilienM: okay, this is strange. the changes table says the latest patch set on change 209296 is 3, but the patch_sets table has a patch set 4 for that change with an identical revision (git sha) | 14:27 |
| *** tsekiyama has joined #openstack-infra | 14:28 | |
| pabelanger | fungi: any chance to land 211205 this morning? | 14:29 |
| pabelanger | fungi: when you have time | 14:29 |
| *** jpeeler has joined #openstack-infra | 14:29 | |
| *** e0ne has joined #openstack-infra | 14:29 | |
| fungi | EmilienM: clarkb: jeblair: mordred: pleia2: http://paste.openstack.org/show/412892 | 14:29 |
| *** doug-fish has joined #openstack-infra | 14:29 | |
| fungi | pabelanger: no clue | 14:29 |
| *** EricGonczer_ has joined #openstack-infra | 14:30 | |
| pabelanger | fungi: trystack.org redirect: https://review.openstack.org/#/c/211205/ | 14:30 |
| *** mwagner_lap has joined #openstack-infra | 14:30 | |
| pabelanger | fungi: either way, when things are slower for you | 14:30 |
| fungi | pabelanger: that doesn't look like a redirect. not so great for search engine indexing. have a look at what i added for devstack.org | 14:31 |
| fungi | EmilienM: so it looks like gerrit recorded the same commit upload twice about a second apart | 14:32 |
| *** deepakcs has joined #openstack-infra | 14:32 | |
| pabelanger | fungi: checking | 14:33 |
| *** minwang2 has joined #openstack-infra | 14:33 | |
| fungi | pabelanger: what i originally recommended was to have trystack.org redirect to trystack.openstack.org | 14:33 |
| fungi | (301 permanent) | 14:33 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/system-config: Support CloudLinux in install_puppet.sh https://review.openstack.org/212554 | 14:34 |
| fungi | and try to match subpaths in the urls | 14:34 |
| fungi | that should cause most search engines to update to the new url fairly rapidly | 14:34 |
| fungi | and browser bookmarks and so on | 14:34 |
| pabelanger | fungi: Ah, I see. You would also like: https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/templates/devstack.vhost.erb#L14 | 14:35 |
| *** bexelbie has quit IRC | 14:37 | |
| fungi | pabelanger: yeah, you could just extend the current vhost config to rewrite any of the serveraliases to the vhost fqdn | 14:38 |
| pabelanger | fungi: Ya, okay. need to figure out how that works for just the serveraliases | 14:39 |
| fungi | and preserve the trailing part of the request | 14:39 |
| fungi | pabelanger: well, you could match on any fqdn that' | 14:39 |
| pabelanger | fungi: Ya, think that is right | 14:39 |
| fungi | s not trystack.openstack.org | 14:39 |
| *** esmute_ has joined #openstack-infra | 14:40 | |
| *** placko_ has joined #openstack-infra | 14:41 | |
| *** vmbrasseur has quit IRC | 14:42 | |
| *** unicell has joined #openstack-infra | 14:43 | |
| *** unicell1 has quit IRC | 14:43 | |
| *** barnaby has joined #openstack-infra | 14:44 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Add serveraliases for trystack.org https://review.openstack.org/211205 | 14:45 |
| clarkb | fungi that is odd, seems like a gerrit bug though | 14:46 |
| fungi | clarkb: yep, i'm finding no error for it in the logs at all | 14:46 |
| fungi | EmilienM: i've deleted the duplicate commit patchset from the database and flushed gerrit's caches. can you see if it's still erroring for you? | 14:47 |
| *** zeih has quit IRC | 14:47 | |
| *** vmbrasseur has joined #openstack-infra | 14:47 | |
| dansmith | what kinds of things causes the zuul backlog to grow really large? | 14:48 |
| dansmith | there are only ~90 things in both queues, yet the backlog is 1000 long... | 14:48 |
| EmilienM | fungi: I can see it \o/ | 14:48 |
| fungi | dansmith: are you talking about the zuul job queue graph? | 14:48 |
| *** mtanino has joined #openstack-infra | 14:48 | |
| *** radez_g0n3 is now known as radez | 14:48 | |
| fungi | dansmith: oh, you mean the events queue | 14:49 |
| dansmith | fungi: no, the backlog items as reported in the json | 14:49 |
| dansmith | yeah | 14:49 |
| dansmith | I noticed because I rechecked something a while ago and it still isn't even in the check queue, but the backlog is growing | 14:49 |
| *** BharatK has quit IRC | 14:49 | |
| fungi | dansmith: events are events not changes. things like comments in gerrit or internal events in zuul which need to be inspected to determine whether it should take some action on them | 14:49 |
| dansmith | yeah | 14:49 |
| dansmith | I get that | 14:49 |
| *** austin81 has joined #openstack-infra | 14:50 | |
| fungi | dansmith: for example, a gate reset... all the changes after the failing change need to get requeued. each job that needs restarting has a corresponding event to trigger it. as zuul works through identifying those the events queue grows. as it works through rescheduling each the events queue falls | 14:50 |
| dansmith | yeah, I realize that | 14:51 |
| dansmith | it just flushed by the way | 14:51 |
| fungi | yep | 14:51 |
| dansmith | so what causes that? | 14:52 |
| fungi | in that case, as i said, a gate reset | 14:52 |
| fungi | e.g. a job failing on a dependent queue in the gate pipeline | 14:52 |
| *** laughterwym has quit IRC | 14:52 | |
| dansmith | oh, sorry, you meant that recalculating the gate post-reset takes it a lot of time and it doesn't process new events while doing that? | 14:52 |
| *** achanda has joined #openstack-infra | 14:53 | |
| *** ajmiller has joined #openstack-infra | 14:53 | |
| fungi | well, more precisely, it _adds_ events as it recalculates, and then processes those events to reschedule the jobs that need rerunning | 14:53 |
| dansmith | okay and that can take ~10 minutes? | 14:54 |
| fungi | but also, yes, any other events such as items from the gerrit event stream, internal timer events and so on end up in the same event queue | 14:54 |
| fungi | it can. yes | 14:54 |
| dansmith | okay | 14:54 |
| *** marzif has quit IRC | 14:54 | |
| fungi | it looks like added into the mix that time was a merging nova change | 14:54 |
| fungi | which then triggers zuul to look in gerrit for all open nova changes and schedule merge checks for them | 14:55 |
| dansmith | ah | 14:55 |
| fungi | and nova has... a lot of open changes | 14:55 |
| *** morgan_404 is now known as morgan_302 | 14:55 | |
| dansmith | those nova bastards! | 14:55 |
| fungi | (i'm pretty sure i don't need to tell _you_ that) | 14:55 |
| fungi | so yeah, you can see the merge-check pipeline spiked up to ~500 there | 14:55 |
| dansmith | does it make sense to do that for all open nova changes? | 14:55 |
| dansmith | I mean, maybe just ones from the last 30-60 days would be more than enough | 14:56 |
| dansmith | anything that hasn't been touched in >30 days is unlikely to still be mergeable | 14:56 |
| fungi | dansmith: no idea. when we weren't doing that, reviewers were approving 3-month-old changes that had no hope of merging any longer | 14:56 |
| *** sdake_ is now known as sdake | 14:56 | |
| dansmith | yeah, I know | 14:56 |
| *** jistr is now known as jistr|mtg | 14:57 | |
| dansmith | presumably we hit steady state at some point, where most things that are old are marked as merge conflict and zuul doesn't need to re-check them, right? | 14:57 |
| fungi | this is one of those technical-solution-to-a-social-problem situations which got implemented because people complained that it was too hard to pay attention to how old changes were | 14:57 |
| dansmith | sure, I remember | 14:57 |
| *** sergmelikyan has joined #openstack-infra | 14:58 | |
| *** puranamr has quit IRC | 14:58 | |
| dansmith | I'm just thinking about ways to limit that damage, like maybe anything older than 60 days gets an automatic -1, no merge-ability check needed | 14:58 |
| dansmith | anyway | 14:58 |
| dansmith | thanks for the info, as always | 14:58 |
| *** puranamr has joined #openstack-infra | 14:58 | |
| fungi | the merge conflict details aren't particularly stateful (they're just an arbitrary review comment in gerrit) so non-trivial for zuul to identify | 14:58 |
| *** annegentle has joined #openstack-infra | 14:58 | |
| fungi | if we can get the bugs ironed out of newer gerrit, it actually has a feature to do this for us in the background | 14:59 |
| dansmith | well, I figured anything with a -1 from jenkins could be excluded | 14:59 |
| *** annegentle has quit IRC | 14:59 | |
| dansmith | ah | 14:59 |
| dansmith | cool | 14:59 |
| *** funzo has joined #openstack-infra | 14:59 | |
| *** zeih has joined #openstack-infra | 14:59 | |
| fungi | at which point we can stop doing it in zuul | 14:59 |
| dansmith | cool | 14:59 |
| *** annegentle has joined #openstack-infra | 14:59 | |
| fungi | so doesn't make a lot of sense to continue to overengineer a solution we're hoping to stop needing | 14:59 |
| dansmith | sure | 15:00 |
| dansmith | although given the current speed of gerrit, having it do more things in the background seems like a bad plan | 15:00 |
| dansmith | but maybe that can be done by a worker or something :) | 15:00 |
| *** armax has joined #openstack-infra | 15:00 | |
| openstackgerrit | Merged openstack-infra/storyboard: Do not import using oslo namespace https://review.openstack.org/212473 | 15:01 |
| *** jsavak has quit IRC | 15:03 | |
| *** achanda has quit IRC | 15:03 | |
| *** sergmelikyan has quit IRC | 15:03 | |
| *** funzo has quit IRC | 15:04 | |
| jeblair | dansmith, fungi: there's also a cache issue -- that process can be very slow when zuul has a cold cache, but pretty fast when it's warm. zuul resets its cache when it is reconfigured, which tends to happen a few times per day. | 15:04 |
| jeblair | (that process == searching for open changes) | 15:05 |
| dansmith | ah | 15:05 |
| fungi | oh, right | 15:05 |
| dansmith | I move slower when I'm cold too | 15:05 |
| jeblair | yeah, also before breakfast | 15:05 |
| dansmith | heh | 15:05 |
| fungi | Last reconfigured: Thu Aug 13 2015 13:20:00 | 15:05 |
| fungi | so almost certainly played into the situation as well | 15:05 |
| *** yamahata has joined #openstack-infra | 15:05 | |
| *** jcoufal has quit IRC | 15:06 | |
| jeblair | and i think there may be some things we can do to carry the cache across a reconfig and eventually improve this | 15:06 |
| *** sridhar_ram has joined #openstack-infra | 15:06 | |
| *** jsavak has joined #openstack-infra | 15:07 | |
| *** rlandy has joined #openstack-infra | 15:08 | |
| fungi | placed jenkins02 into prepare for shutdown. it's gumming up the works | 15:09 |
| *** bpokorny has joined #openstack-infra | 15:11 | |
| jeblair | fungi: did you do something to change 209296 ? (the one with 3/4 patchsets) | 15:11 |
| *** moravec has quit IRC | 15:12 | |
| *** rossella_ has quit IRC | 15:12 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/nodepool: Fix schema validator to allow specifying a gearman port https://review.openstack.org/212577 | 15:12 |
| fungi | jeblair: i deleted the duplicate commit row which it considered patchset 4, then flushed gerrit's caches for good measure, and after that EmilienM was able to access it again | 15:12 |
| *** thorst has quit IRC | 15:12 | |
| jeblair | fungi: ok thanks; i looked for that in scrollback but couldn't find it. :) | 15:13 |
| *** bharath has joined #openstack-infra | 15:13 | |
| jeblair | but there was a lot of scrollback | 15:13 |
| fungi | guessing there's some sort of race or other bug in gerrit which could lead to it creating a second entry in the db | 15:13 |
| *** rossella_ has joined #openstack-infra | 15:13 | |
| *** TravT has joined #openstack-infra | 15:14 | |
| fungi | jeblair: 14:47 "i've deleted the duplicate commit patchset from the database and flushed gerrit's caches. can you see if it's still erroring for you?" | 15:14 |
| fungi | and yeah, there was a lot of scrollback | 15:14 |
| jeblair | thanks, just didn't want to miss learning about the potential resolution process for such a bug | 15:15 |
| *** ihrachyshka has quit IRC | 15:16 | |
| fungi | well, i'm thinking we've seen at least one other occurrence of this, though not sure if anyone looked in the db for those. if we can find another we might have something worth opening an upstream bug on | 15:16 |
| EmilienM | fungi: probably a race, I never hit that one before - will let you know if that happens again | 15:17 |
| fungi | EmilienM: yeah, the problem has to be internal to gerrit itself. it shouldn't normally allow two patchsets with the same git sha | 15:17 |
| fungi | and it didn't update the changes table for the second copy | 15:18 |
| *** bharath has quit IRC | 15:18 | |
| fungi | so something going on with how it added the patch set to the patch_sets table | 15:18 |
| *** zeih has quit IRC | 15:18 | |
| *** sabeen has joined #openstack-infra | 15:18 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-cgit: Remove selinux from lb class https://review.openstack.org/212585 | 15:21 |
| *** deepakcs has quit IRC | 15:21 | |
| *** sabeen3 has joined #openstack-infra | 15:23 | |
| *** geoffarnold has joined #openstack-infra | 15:23 | |
| *** angdraug has joined #openstack-infra | 15:23 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Add serveraliases for trystack.org https://review.openstack.org/211205 | 15:24 |
| *** sabeen has quit IRC | 15:24 | |
| *** puranamr has quit IRC | 15:26 | |
| pabelanger | fungi: ^ that seems to work | 15:26 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/devstack-gate: Add q-vpn back to base services but exclude for liberty runs https://review.openstack.org/212588 | 15:27 |
| *** sridhar_ram has quit IRC | 15:28 | |
| timothyb89 | ianw: thanks for the feedback re: dstat and stackviz! could you clarify what you mean by "an EXIT trap to kill $$" ? | 15:29 |
| *** bhunter71 has joined #openstack-infra | 15:31 | |
| *** moravec has joined #openstack-infra | 15:31 | |
| *** e0ne has quit IRC | 15:32 | |
| sc68cal | How do we add another channel to be logged and saved to eavesdrop.openstack.org/irclogs ? | 15:32 |
| *** dannywilson has joined #openstack-infra | 15:33 | |
| *** jistr|mtg is now known as jistr | 15:34 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/devstack-gate: Add q-vpn back to base services but exclude for liberty runs https://review.openstack.org/212588 | 15:34 |
| openstackgerrit | greghaynes proposed openstack-infra/glean: Create systemwide lock for glean https://review.openstack.org/212177 | 15:37 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/irc-meetings: Update chairs for the FwaaS meeting https://review.openstack.org/212595 | 15:38 |
| *** scheuran has quit IRC | 15:38 | |
| mtreinish | sc68cal: http://git.openstack.org/cgit/openstack-infra/project-config/tree/accessbot/channels.yaml | 15:39 |
| fungi | mtreinish: sc68cal: well, first that yes, and then add it to https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/eavesdrop.pp | 15:39 |
| *** tonytan4ever has joined #openstack-infra | 15:40 | |
| fungi | accessbot just handles granting us admin access to the channel so we can help troubleshoot when things go wrong. the eavesdrop manifest is what actually causes the openstack bot to join your channel and log it | 15:40 |
| fungi | but we require the accessbot addition first before we'll add any of our other bots to the channel | 15:41 |
| sc68cal | ah that's the repo i was looking for - system-config | 15:41 |
| *** AJaeger has joined #openstack-infra | 15:41 | |
| AJaeger | Hi, I'd like a pair of eyes to review a skip-if change for zuul: https://review.openstack.org/211642 - when skip-if was introduced we wanted to be very carefull and this change removes "branch" everywhere and I'd like some expert review. clarkb, fungi, jeblair, could you review this at sometime, please? | 15:43 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/irc-meetings: Correct the FwaaS meeting cadence https://review.openstack.org/212600 | 15:44 |
| *** amotoki has joined #openstack-infra | 15:44 | |
| mriedem | logstash appears to be down | 15:45 |
| mtreinish | mriedem: wfm | 15:46 |
| yolanda | hi fungi, did you read abot zuul services by puppet? i think the best we can do is to add a parameter to manage it, by default not managing | 15:46 |
| yolanda | fbo_ ^ | 15:46 |
| mriedem | mtreinish: http://status.openstack.org/elastic-recheck/index.html indexing behind by 8 hours | 15:46 |
| mriedem | logstash job queue graph is nuts | 15:46 |
| mriedem | http://goo.gl/7JR6eN | 15:46 |
| fungi | yolanda: yes, i'm hoping to get jeblair, clarkb and others to weigh in on the thread | 15:46 |
| mtreinish | oh, I thought you meant kibana | 15:47 |
| yolanda | ok | 15:47 |
| fungi | yolanda: which was the whole reason for moving it to the mailing list in the first place | 15:47 |
| mtreinish | which is working for me | 15:47 |
| *** dprince has joined #openstack-infra | 15:47 | |
| *** jistr has quit IRC | 15:48 | |
| *** dtantsur is now known as dtantsur|afk | 15:48 | |
| jeblair | "This message is to inform you that the host your cloud server elasticsearch07.openstack.org' resides on alerted our monitoring systems at 15:37 UTC." | 15:48 |
| jeblair | just got that email | 15:48 |
| fungi | mriedem: yeah that sawtooth pattern on the logstash job queue graph is pretty odd | 15:48 |
| clarkb | fungi yolanda the discussion is missing an important thing puppet does manage and enable the service | 15:49 |
| clarkb | it merely does not ensure it runs at all times. that is inits job | 15:49 |
| clarkb | jeblair cool | 15:49 |
| fungi | clarkb: right, that's what i meant by "downstreams who want to use puppet like a service manager" | 15:49 |
| fungi | (because it's pretty terrible at that, honestly) | 15:50 |
| * greghaynes tries not to comment on the quality of some current init systems which claim to do that | 15:50 | |
| clarkb | (and I'm catching up from a day of doing errands and not really working so can respond soon) | 15:51 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/system-config: Add #openstack-fwaas for logging purposes https://review.openstack.org/212606 | 15:51 |
| fungi | "i got lucky and puppet eventually restarted my failing service" doesn't seem like a very good argument in its favor. there are well established service managers to use if you want to keep a service running all the time and restart it as soon as it fails (as opposed to the next time puppet runs) | 15:51 |
| yolanda | fungi, for some other init services, where packages are managing that, is not needed. But for zuul it's a blocker for automation to don't have puppet spinning that up | 15:51 |
| *** afazekas has joined #openstack-infra | 15:51 | |
| yolanda | so you either do it manually, or add another orchestration layer on top | 15:51 |
| jeblair | i'm not sure whether i should be writing an email or chatting here | 15:51 |
| jeblair | yolanda: we have added another orchestration layer on top | 15:51 |
| openstackgerrit | Sean M. Collins proposed openstack-infra/project-config: Add #openstack-fwaas to the channels https://review.openstack.org/212607 | 15:52 |
| jeblair | so i feel like we've made that choice :) | 15:52 |
| yolanda | infra has | 15:52 |
| yolanda | not all end users | 15:52 |
| AJaeger | jeblair, fungi, clarkb: are we in the business of checking names of new repos? https://review.openstack.org/#/c/204434 has a comment by mestery "The -1 is because the name Fusion almost certainly has copyright issues". Could you check this at one time, please? | 15:52 |
| sc68cal | done and done | 15:52 |
| sc68cal | mriedem: fungi: thanks for the help | 15:52 |
| jeblair | yolanda: how often do you bring up new zuul servers? | 15:52 |
| yolanda | i'd say that quite often | 15:52 |
| *** puranamr has joined #openstack-infra | 15:53 | |
| yolanda | whenever we need to test changes | 15:53 |
| mriedem | sc68cal: ? | 15:53 |
| jeblair | yolanda: can you elaborate? | 15:53 |
| sc68cal | mriedem: sorry- autocomplete- mean mtreinish | 15:53 |
| fungi | dopplegangers | 15:53 |
| mriedem | we are the same | 15:53 |
| yolanda | jeblair, when we need to test changes on zuul without harming production environment | 15:53 |
| yolanda | zuul upgrades, or changes in code | 15:53 |
| sc68cal | no the problem is I do m<TAB> then type a message | 15:53 |
| jeblair | yolanda: yeah, how do you go about doing that? | 15:54 |
| sc68cal | because I'm dumb and lazyh | 15:54 |
| yolanda | it's quite normal to spin up some vms to test | 15:54 |
| *** sdake_ has joined #openstack-infra | 15:54 | |
| yolanda | jeblair at the moment normally, our goal is to orchestrate with ansible | 15:54 |
| jeblair | yolanda: how do you launch the vm? what does it talk to? how do you install the configuration on it? | 15:54 |
| pabelanger | yolanda: left a comment on ML | 15:54 |
| yolanda | manually | 15:54 |
| *** sridhar_ram has joined #openstack-infra | 15:55 | |
| jeblair | yolanda: none of those things is handled by puppet now | 15:55 |
| jeblair | yolanda: all of those things could be handled by ansible | 15:55 |
| jeblair | yolanda: as well as starting zuul | 15:55 |
| jeblair | it seems like a really good fit to me | 15:55 |
| jeblair | whatever test harness you use to run something like that can be responsible for starting the service too | 15:55 |
| openstackgerrit | Emma Barber proposed openstack-infra/puppet-hound: Configure and run apache on top of hound https://review.openstack.org/211640 | 15:55 |
| jeblair | and that sort of thing can be put in the ansible launch node replacement | 15:55 |
| yolanda | jeblair i think that giving the option to end users to choose, it's not harmful, and give end users more possibilities | 15:56 |
| yolanda | by default not managing the service | 15:56 |
| *** thorst has joined #openstack-infra | 15:56 | |
| jeblair | yolanda: i think the option is dangerous. | 15:57 |
| jeblair | i agree that we _could_ put the option in and never use it ourselves. | 15:57 |
| *** woodster_ has joined #openstack-infra | 15:57 | |
| jeblair | i'm not sure i think it's a good idea to put in an option that you know could get people into trouble. | 15:57 |
| yolanda | jeblair, why is that so dangerous? | 15:57 |
| *** sdake has quit IRC | 15:58 | |
| yolanda | pabelanger, saw your comment, seems as we are on the same boat here | 15:58 |
| jeblair | having zuul, nodepool, and gerrit start running under certain conditions could cause harm. | 15:58 |
| *** ihrachyshka has joined #openstack-infra | 15:58 | |
| jeblair | we regularly stop those services manually to fix problems, and having them restart on their own during that time could be very problematic (erroneous test results, lost events, extended downtime, and in the case of gerrit, publication of incorrect git trees) | 15:59 |
| yolanda | you mean, starting before some orchestration bits have been acomplished? | 15:59 |
| fungi | or even starting before you've had a chance to inspect the environment into which it was installed | 15:59 |
| yolanda | jeblair, we do it as well for manual debug. But we stop puppet before | 15:59 |
| pabelanger | defaulting to true / false might require discussion. But, if user wants puppet to manage the services, I'd say let them. | 16:00 |
| jeblair | yolanda: we also sometimes need to stop zuul, run puppet to apply a configuration change, then start zuul | 16:00 |
| pabelanger | With the warning that issue with arise that fungi and jeblair are mentioning | 16:00 |
| jeblair | it is impossible to do that if you have puppet set to ensure=>running | 16:00 |
| fungi | pabelanger: it already does manage those services. we're talking here about whether puppet should start the services itself (and restart them any time they stop) | 16:00 |
| *** w_ has quit IRC | 16:00 | |
| pabelanger | fungi: right. | 16:00 |
| fungi | it currently _enables_ the services and sets them to start on boot | 16:01 |
| jeblair | so i firmly believe that puppet should ensure that a service is _enabled_ so that it starts at boot, etc. but i do not believe that it should always start a service even if it is stopped. there are lots of legitimate reasons sysadmins may have for stopping a service, and puppet should not second guess them. | 16:01 |
| jeblair | so we're left at the only time this would be useful is at the initial installation of a service | 16:01 |
| jeblair | considering that in that case, there's something other than puppet running anyway (soon to be ansible), we should have it perform that step. | 16:01 |
| jeblair | (if we want something to do it) | 16:02 |
| jeblair | it has the correct context to make that decision | 16:02 |
| *** yolanda has left #openstack-infra | 16:02 | |
| *** yolanda has joined #openstack-infra | 16:02 | |
| *** minwang2 has quit IRC | 16:02 | |
| jeblair | now i'm going to go copy and paste all of this into my MUA, and capitalize the first letters of sentences and send it to the mailing list. | 16:03 |
| fungi | ha | 16:03 |
| *** placko_ has quit IRC | 16:03 | |
| fungi | the only reason i recommended moving it to the ml yesterday was that you and clarkb weren't around for the bulk of the conversation. i did my best to explain the reason we designed the modules this way, but didn't want to incorrectly represent your opinions on the matter | 16:04 |
| yolanda | then i'd go at least with documenting that properly in all puppet modules that are afected by this problem, and ensure that all the puppet modules we own do the same, no ensure=>running in services | 16:04 |
| fungi | nor did i want it to seem like it was solely my opinion | 16:04 |
| *** jlanoux has quit IRC | 16:04 | |
| yolanda | problem=feature | 16:05 |
| *** w_ has joined #openstack-infra | 16:05 | |
| *** dprince has quit IRC | 16:05 | |
| yolanda | looking at the +2 in the reviews, this concept seem to be known internally by infra, but not for external users looking at that, so worth documenting properly to avoid mistakes | 16:06 |
| openstackgerrit | greghaynes proposed openstack-infra/glean: Create systemwide lock for glean https://review.openstack.org/212177 | 16:07 |
| greghaynes | mordred: ohai - I did a thing that id love some input on ^ | 16:07 |
| greghaynes | been hitting that on our nodes with multiple interfaces | 16:07 |
| *** sridhar_ram has quit IRC | 16:08 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/irc-meetings: Correct the FwaaS meeting cadence https://review.openstack.org/212600 | 16:08 |
| *** kurtmartin has joined #openstack-infra | 16:09 | |
| *** w_ has quit IRC | 16:10 | |
| *** alexpilotti_ has joined #openstack-infra | 16:11 | |
| clarkb | greghaynes: I think I am very close to getting dib testing working on the nodepool devstack chnage. Really want that to show your image builder workers stuff is happy | 16:12 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add propose-puppet-modulesync-configs-update job https://review.openstack.org/211744 | 16:13 |
| greghaynes | clarkb: got a review? | 16:13 |
| clarkb | greghaynes: https://review.openstack.org/#/c/211754/ | 16:14 |
| clarkb | greghaynes: dib is failing due to set up stuff http://logs.openstack.org/54/211754/2/check/gate-dsvm-nodepool-nv/aeac215/logs/screen-nodepool.txt.gz#_2015-08-12_00_44_57_634 though I have a mkdir -p and chown of that dir I think because /opt isn't writeable by stack it fails | 16:15 |
| *** funzo has joined #openstack-infra | 16:15 | |
| clarkb | going to push those two dirs down a level and try again | 16:15 |
| *** bknudson has joined #openstack-infra | 16:15 | |
| yolanda | hi, can i get https://review.openstack.org/207109 approved? wanted to start some work on it | 16:16 |
| fungi | pabelanger: did you test the satisfy any on apache 2.2? just making sure that's not going to blow up (static.o.o runs on precise) | 16:16 |
| zaro | morning | 16:16 |
| openstackgerrit | Clark Boylan proposed openstack-infra/nodepool: Test dib image builds with devstack too. https://review.openstack.org/211754 | 16:16 |
| clarkb | greghaynes: ^ hoping that gets it fixed | 16:16 |
| greghaynes | clarkb: huh, the plugin looks like it makes that dir though? | 16:16 |
| clarkb | greghaynes: ya exactly | 16:16 |
| clarkb | but I think the mkdir -p ib dib is confused | 16:16 |
| pabelanger | fungi: Oh | 16:16 |
| clarkb | possibly a dib bug too for trying to create it even though it exists | 16:16 |
| pabelanger | fungi: I used 12.04 | 16:17 |
| pabelanger | fungi: let me test locally again | 16:17 |
| *** sridhar_ram has joined #openstack-infra | 16:17 | |
| pabelanger | fungi: err 14.04 | 16:17 |
| zaro | pelix: what do you think of my suggestion? https://review.openstack.org/#/c/211776/ | 16:17 |
| greghaynes | clarkb: mkdir -p should just return true if it exists | 16:17 |
| greghaynes | clarkb: so, I wonder if that plugin is actually being run? | 16:18 |
| clarkb | greghaynes: let me look in the devstack log | 16:18 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/project-config: Don't run gate-neutron-vpnaas-dsvm-functional-sswan on stable/juno https://review.openstack.org/212621 | 16:18 |
| *** alexpilotti_ is now known as alexpilotti | 16:19 | |
| *** alexpilotti has quit IRC | 16:19 | |
| *** hdd has quit IRC | 16:19 | |
| *** alexpilotti has joined #openstack-infra | 16:19 | |
| *** alexpilotti has quit IRC | 16:19 | |
| *** funzo has quit IRC | 16:20 | |
| clarkb | greghaynes: hrm its possible the run I am looking at is for an older patchset | 16:20 |
| clarkb | greghaynes: because devstack definitely doesn't show it running | 16:20 |
| greghaynes | ah | 16:20 |
| greghaynes | that would make sense ;) | 16:20 |
| clarkb | if current patchset works we can decide if we prefer it over the previous one but I expect it to also fix the problem | 16:21 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard: Allow browsing stories by creator_id https://review.openstack.org/212104 | 16:21 |
| *** gyee has joined #openstack-infra | 16:22 | |
| clarkb | AJaeger: in the past we haven't really policed names | 16:22 |
| clarkb | but I can think of at least one conflicting thing with that name juts off the top of my head | 16:22 |
| pelix | zaro: I'm rebasing it onto the change that did trigger the issue just to see if maybe it's more likely to trigger there | 16:23 |
| *** hdd has joined #openstack-infra | 16:23 | |
| clarkb | and the isses are of trademark variety not copyright | 16:23 |
| *** FallenPegasus has joined #openstack-infra | 16:23 | |
| *** dizquierdo has quit IRC | 16:25 | |
| zaro | pelix: you working on https://review.openstack.org/#/c/180185/ at all? | 16:25 |
| *** ashleighfarnham has joined #openstack-infra | 16:26 | |
| openstackgerrit | Merged openstack-infra/project-config: Add openstack-infra/puppet-infra-cookiecutter project https://review.openstack.org/207109 | 16:26 |
| zaro | pelix: i'm thinking of adding those missing tests unless you've already got something going on there. it's so close to another +2. | 16:26 |
| *** shashank_hegde has joined #openstack-infra | 16:28 | |
| *** rossella_ has quit IRC | 16:28 | |
| AJaeger | clarkb: yes, trademark. | 16:28 |
| *** [HeOS] has quit IRC | 16:28 | |
| *** BharatK has joined #openstack-infra | 16:29 | |
| pelix | zaro: hoping to tackle it tomorrow afternoon (usually quiet in the office after 5pm ;) | 16:29 |
| pabelanger | fungi: works as expected | 16:31 |
| fungi | pabelanger: thanks for confirming! +2 | 16:31 |
| *** openstackgerrit has quit IRC | 16:31 | |
| *** unicell has quit IRC | 16:31 | |
| AJaeger | clarkb: So, should we police the name in this case - or stay with not policing? jeblair, fungi, what do you think about https://review.openstack.org/204434 ? | 16:31 |
| *** openstackgerrit has joined #openstack-infra | 16:31 | |
| clarkb | AJaeger: personally I don't like the attitude of "we'll just change it later" if we fix it now then we don't have to worry about it in 6 months | 16:32 |
| *** Sukhdev has joined #openstack-infra | 16:32 | |
| fungi | AJaeger: i'm with clarkb. please don't use a repo name that you think you are likely to need to change | 16:32 |
| fungi | because we may be likely to not get around to changing it for you in that case | 16:33 |
| fungi | consideration is a two-way street | 16:33 |
| *** crc32 has joined #openstack-infra | 16:33 | |
| jeblair | yeah, let's not be the name police, but it seems even the author thinks it might be a problem, in which case, now would be the best time to address it | 16:34 |
| dougwig | can i suggest putting info on how to vet names properly (legal, or whatnot) to the project creator's guide? | 16:34 |
| *** esmute_ has quit IRC | 16:35 | |
| AJaeger | ok, gave a -1 - but I think this is just a "best effort". If people speak up, we reject but no research from us | 16:35 |
| jeblair | dougwig: that's a good idea, but maybe we should ask the legal affairs committee to write that. :) | 16:35 |
| *** ildikov has quit IRC | 16:36 | |
| dougwig | jeblair: right, i realized i don't know the process either, so i can't submit a patch. :) | 16:36 |
| clarkb | dougwig: 99% of the time just googling it and looking at the first page of results is sifficient | 16:36 |
| jeblair | anecdotally, i believe the process at netflix is "google it and see if it looks like it'll be a problem". | 16:36 |
| jeblair | clarkb: ++ :) | 16:36 |
| jeblair | fusion, does in fact, fail that test. | 16:36 |
| jeblair | http://www.vmware.com/products/fusion | 16:36 |
| clarkb | the second result for me is the fail | 16:36 |
| dougwig | ha, effective, but i can see how we wouldn't want to codify that in writing. | 16:37 |
| fungi | any additional recommendations we have should be used to expand http://docs.openstack.org/infra/manual/creators.html#choosing-a-good-name-for-your-project if possible | 16:37 |
| *** ivar-lazzaro has joined #openstack-infra | 16:38 | |
| jokke_ | almost worth of -1 "Also like to mention I have no issues with the name being changed now" ;) | 16:39 |
| zaro | pelix: ohh cool, i'll have my +2 ready for you :) | 16:39 |
| jeblair | 'elasticsearch07.openstack.org'. At this time we have | 16:40 |
| jeblair | not been able to restore access to your cloud server. | 16:40 |
| jeblair | rax problems with that host ongoing ^ | 16:40 |
| *** ivar-lazzaro has quit IRC | 16:40 | |
| clarkb | jeblair: thanks for the update | 16:40 |
| clarkb | pretty sure the behavior we see in logstash queue lengths is the cluster recovering from a lost node | 16:40 |
| clarkb | it has to pause processing on live indexes to recover the secondary shard | 16:41 |
| *** ivar-lazzaro has joined #openstack-infra | 16:41 | |
| clarkb | so whenever thta happens queue takes off, when its done and beings working again it falls | 16:41 |
| clarkb | mriedem: ^ | 16:41 |
| clarkb | no data lost its just underperforming | 16:41 |
| *** rguillebert has quit IRC | 16:41 | |
| *** sdake has joined #openstack-infra | 16:42 | |
| clarkb | (I have confirmed that it is still recovering things | 16:42 |
| mriedem | clarkb: yeah, ok | 16:42 |
| *** hdd has quit IRC | 16:43 | |
| *** shashank_hegde has quit IRC | 16:43 | |
| *** hdd has joined #openstack-infra | 16:45 | |
| jeblair | also, that graph is usually really boring so it's nice to have it draw some neat shapes every now and then | 16:45 |
| AJaeger | another review question: Is there any preference for one or two equal signs in if [ ".." = "..." ] ...? | 16:45 |
| *** jamielennox is now known as jamielennox|away | 16:45 | |
| *** sdake_ has quit IRC | 16:45 | |
| jeblair | AJaeger: bash? | 16:45 |
| AJaeger | jeblair: bash | 16:46 |
| AJaeger | with "if [[ ... == ]]" we have pattern matching, so I prefer a single "=" for the normal [] as well | 16:47 |
| AJaeger | but wonder whether that's worth of a -1 | 16:47 |
| jeblair | apparently they are equivalent, so probably not? i wonder if bash8 checks that | 16:47 |
| jeblair | i probably wouldn't -1 but would suggest following the predominant style in the repo | 16:48 |
| *** enikanorov2 has quit IRC | 16:48 | |
| AJaeger | bash8 does not check for it. | 16:49 |
| *** erikmwilson_ has joined #openstack-infra | 16:49 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Update chairs for the FwaaS meeting https://review.openstack.org/212595 | 16:50 |
| openstackgerrit | Merged openstack-infra/irc-meetings: Correct the FwaaS meeting cadence https://review.openstack.org/212600 | 16:50 |
| * AJaeger will just fix and approve - the change has already a +2 ;) | 16:51 | |
| *** hichihara has joined #openstack-infra | 16:52 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add DEVSTACK_GATE_POSTGRES variable into functional Ceilometer job https://review.openstack.org/212530 | 16:52 |
| *** minwang2 has joined #openstack-infra | 16:52 | |
| *** nadya has quit IRC | 16:53 | |
| *** rguillebert has joined #openstack-infra | 16:54 | |
| *** mriedem is now known as mriedem_lunch | 16:54 | |
| *** patrickeast has joined #openstack-infra | 16:56 | |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Add bots to #openstack-gslb for openstack/kosmos https://review.openstack.org/212660 | 16:56 |
| *** mwagner_lap has quit IRC | 16:57 | |
| *** enikanorov2 has joined #openstack-infra | 16:57 | |
| *** sergmelikyan has joined #openstack-infra | 16:58 | |
| *** unicell has joined #openstack-infra | 16:59 | |
| *** FallenPegasus has quit IRC | 16:59 | |
| fungi | i guess marun isn't around any more? (hasn't been in here for ~45 days, dropped out of the -dev channel a couple weeks ago) | 16:59 |
| *** jsavak has quit IRC | 17:00 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/system-config: Remove jenkins credentials from nodepool.yaml https://review.openstack.org/199750 | 17:00 |
| jeblair | This message is to inform you that your cloud server elasticsearch07.openstack.org' is online. Please log into https://mycloud.rackspace.com and verify elasticsearch07.openstack.org's integrity. | 17:01 |
| AJaeger | fungi: that's what ihrachyshka commented in https://review.openstack.org/#/c/211642/ | 17:01 |
| jeblair | fungi, clarkb: ^ | 17:01 |
| fungi | AJaeger: yep, that's why i was asking | 17:02 |
| *** bharath has joined #openstack-infra | 17:02 | |
| fungi | jeblair: thanks! | 17:02 |
| clarkb | jeblair: 02 reports we have 6 nodes in the cluster again | 17:02 |
| jeblair | i'm guessing we might go about verifying its integrity some other way | 17:02 |
| *** skylerberg has joined #openstack-infra | 17:02 | |
| *** rguillebert has quit IRC | 17:02 | |
| clarkb | jeblair: ya curl -XGET 'http://localhost:9200/_cluster/health?pretty=true' on any cluster node | 17:02 |
| clarkb | and possible /var/log/elasticsearch.log on 07 | 17:02 |
| *** sergmelikyan has quit IRC | 17:02 | |
| BobBall | patrickeast: Howdy - is your scoreboard down? | 17:03 |
| BobBall | or moved? | 17:03 |
| patrickeast | BobBall: uhh maybe | 17:03 |
| * patrickeast checks | 17:03 | |
| * BobBall uses it almost daily :D | 17:03 | |
| patrickeast | BobBall: i just kicked it and seems to be working now | 17:04 |
| jeblair | fungi: when you have a sec, can you look at the conversation with jhesketh and i in https://review.openstack.org/211108 ? | 17:04 |
| jeblair | maybe more like 5 mins than a sec | 17:04 |
| patrickeast | BobBall: ive noticed sometimes the flask server gets in a weird state, throws some error about a broken pipe but doesn’t actually stop | 17:04 |
| BobBall | it is - thanks | 17:04 |
| fungi | jeblair: can do | 17:05 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Cleanup some bash comparisions https://review.openstack.org/212663 | 17:05 |
| ihrachyshka | fungi, he left for containter team in RH and did not plan to track openstack anymore | 17:05 |
| fungi | ihrachyshka: okay, thanks! | 17:05 |
| AJaeger | ihrachyshka: thanks! - sorry to hear | 17:05 |
| *** pc_m has quit IRC | 17:06 | |
| ihrachyshka | indeed it is :( | 17:06 |
| ihrachyshka | but life goes on :) | 17:06 |
| *** bharath has quit IRC | 17:06 | |
| *** esmute_ has joined #openstack-infra | 17:06 | |
| *** FallenPegasus has joined #openstack-infra | 17:06 | |
| *** jsavak has joined #openstack-infra | 17:07 | |
| nibalizer | AJaeger: can you review https://review.openstack.org/#/c/208799/ before you take off for the day? | 17:07 |
| nibalizer | I think I'm finally getting close | 17:07 |
| fungi | okay, jenkins02 is cleaned up and coming back online now | 17:07 |
| AJaeger | nibalizer: will do | 17:07 |
| fungi | jeblair: jhesketh: oh, fun! it's the all vs any concept back for round #2 | 17:08 |
| *** pc_m has joined #openstack-infra | 17:08 | |
| *** fdegir has quit IRC | 17:09 | |
| *** fdegir has joined #openstack-infra | 17:10 | |
| *** mwagner_lap has joined #openstack-infra | 17:11 | |
| AJaeger | nibalizer: yes, very close. You removed one entry that I don't understand. If that's correct, mention it in the commit message - or readd it again. | 17:11 |
| *** boris-42 has joined #openstack-infra | 17:11 | |
| *** mriedem_lunch is now known as mriedem | 17:13 | |
| *** jerryz has joined #openstack-infra | 17:13 | |
| *** ihrachyshka has quit IRC | 17:14 | |
| *** kurtmartin has quit IRC | 17:14 | |
| fungi | jeblair: i've been trying, unsuccessfully, to figure out from the zuul debug log why the periodic job added at https://review.openstack.org/#/c/194164/2/zuul/layout.yaml is not running, but so far i can't find it at all in the log (just instances triggered by actual change events, not periodic) | 17:15 |
| jeblair | fungi: i'm on the hunt | 17:15 |
| fungi | should have run at least the past week | 17:15 |
| eantyshev | Hello! Our CI listening under account vzstorage-ci and it didn't receive some events right now (see last 2 rechecks from https://review.openstack.org/#/c/184153/, only the second was received) | 17:15 |
| fungi | jeblair: oh, i just realized i think the trigger and the run _might_ be split across log rotation boundaries | 17:16 |
| *** abregman has quit IRC | 17:16 | |
| * jeblair stands down | 17:17 | |
| fungi | though also the periodic trigger doesn't seem to mention job names | 17:17 |
| *** tonytan4ever has quit IRC | 17:17 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add MultiJob Project Documentation. https://review.openstack.org/212666 | 17:18 |
| mriedem | hi infra peeps! this should unwedge some things in kilo https://review.openstack.org/#/c/212588/ | 17:20 |
| *** flepied has quit IRC | 17:20 | |
| *** pelix has quit IRC | 17:21 | |
| mriedem | guess i should have updated the title in ps2, but don't want to lose sean's +2 | 17:21 |
| tpborion | fungi: don't forget me :) | 17:21 |
| *** tpborion has left #openstack-infra | 17:21 | |
| *** tpborion has joined #openstack-infra | 17:22 | |
| *** pelix has joined #openstack-infra | 17:22 | |
| *** tonytan4ever has joined #openstack-infra | 17:23 | |
| fungi | tpborion: yep, i'm nearly unwound from earlier | 17:23 |
| *** bharath has joined #openstack-infra | 17:23 | |
| *** moravec has quit IRC | 17:23 | |
| *** pelix has quit IRC | 17:23 | |
| fungi | jeblair: 2015-08-12 06:09:58,852 DEBUG zuul.Scheduler: Adding merge complete event for build set: <BuildSet item: <QueueItem 0x7fa7ec7cec10 for <NullChange for openstack/openstack-chef-repo> in periodic> #builds: 0 merge state: PENDING> | 17:24 |
| fungi | jeblair: that's near the end of debug.log.2.gz | 17:24 |
| waynr | argh jjb defaults | 17:24 |
| *** moravec has joined #openstack-infra | 17:24 | |
| openstackgerrit | Merged openstack-infra/project-config: Add DEVSTACK_GATE_POSTGRES variable into functional Ceilometer job https://review.openstack.org/212530 | 17:24 |
| fungi | jeblair: but i'm having trouble following 0x7fa7ec7cec10 to see if the job ever gets added | 17:25 |
| nibalizer | AJaeger: ok thanks | 17:25 |
| clarkb | fungi: have you looked on the jenkins masters to see if it was run there? | 17:25 |
| clarkb | fungi: might be a quicker check | 17:25 |
| fungi | clarkb: not yet, though i guess i can | 17:25 |
| *** amotoki has quit IRC | 17:25 | |
| *** pelix has joined #openstack-infra | 17:26 | |
| clarkb | fwiw everything I can see about the elasticsearch cluster is that it will be ok, just needs time to recover now that 07 is back | 17:26 |
| *** mrunge has quit IRC | 17:26 | |
| fungi | clarkb: awesome, thanks | 17:28 |
| *** achanda has joined #openstack-infra | 17:29 | |
| *** sdake_ has joined #openstack-infra | 17:29 | |
| jeblair | fungi: the "run right before log rotation" aspect of this doesn't help, does it? :) | 17:31 |
| *** moravec has quit IRC | 17:31 | |
| *** sdake has quit IRC | 17:32 | |
| *** asselin has joined #openstack-infra | 17:33 | |
| fungi | jeblair: no, i tried searching the next log in series for that queueitem | 17:34 |
| AJaeger | fungi: the job is both run from periodic and experimental queue. Would that cause a problem? | 17:34 |
| * AJaeger found the job run from experimental on jenkins02 | 17:34 | |
| fungi | AJaeger: i don't _think_ so as long as the job itself is configured to know how to deal with the limited set of parameters provided in the periodic pipeline | 17:35 |
| jeblair | fungi: https://etherpad.openstack.org/p/xtB6TelFVW | 17:35 |
| clarkb | greghaynes: http://logs.openstack.org/54/211754/4/check/gate-dsvm-nodepool-nv/af02d65/logs/screen-nodepool.txt.gz#_2015-08-13_17_18_49_057 | 17:36 |
| clarkb | greghaynes: I have to pop out for a few but does that look like a dib thing you recognize? | 17:36 |
| AJaeger | fungi: I only found experimental runs on jenkins for it | 17:36 |
| *** nijaba has joined #openstack-infra | 17:36 | |
| *** nijaba_ has quit IRC | 17:36 | |
| greghaynes | clarkb: hah, sudo failing | 17:37 |
| greghaynes | clarkb: I wonder if the dev pts mount failed for some reason... | 17:37 |
| openstackgerrit | Merged openstack-infra/project-config: Refactoring Manila GlusterFS job definitions https://review.openstack.org/212419 | 17:38 |
| openstackgerrit | Matthias Runge proposed openstack-infra/project-config: Add a gate job for Django-1.8 https://review.openstack.org/201467 | 17:38 |
| jeblair | fungi: 2015-08-13 06:00:01,123 DEBUG zuul.IndependentPipelineManager: No jobs for change <NullChange for openstack/openstack-chef-repo> | 17:38 |
| fungi | jeblair: huh. i wonder why that is | 17:39 |
| clarkb | greghaynes oh I know | 17:39 |
| clarkb | greghaynes: we disable stack users sudo perms | 17:39 |
| greghaynes | heh | 17:39 |
| greghaynes | clarkb: wait | 17:39 |
| clarkb | ok gonna have to think about how to fix this | 17:39 |
| greghaynes | clarkb: how did the chroot work | 17:39 |
| clarkb | greghaynes: rootwrap? | 17:39 |
| greghaynes | wah? | 17:39 |
| clarkb | greghaynes: except no we don't rootwrap | 17:39 |
| clarkb | hrm | 17:39 |
| greghaynes | clarkb: oh, its not in chroot yet | 17:40 |
| clarkb | ah ok | 17:40 |
| clarkb | so, easy fix is to not revoke sudo in that job | 17:40 |
| clarkb | I will try this | 17:40 |
| greghaynes | clarkb: DIB should bail earlier in that case too if thats what is going on | 17:40 |
| jeblair | fungi: possibly because the job has a branch specification, and perhaps branch specificiations are undefined with NullChange objects | 17:40 |
| *** angdraug has quit IRC | 17:41 | |
| fungi | jeblair: ahh, yep. i was just starting to hunt through the layout to see if there were any overrides for that job | 17:41 |
| greghaynes | clarkb: oh, maybe that is the first time we sudo since its pre-chroot | 17:41 |
| greghaynes | clarkb: hrm :( | 17:42 |
| *** fawadkhaliq has quit IRC | 17:42 | |
| jeblair | fungi: i pasted zuul's parsing of that part of the config into the ep | 17:42 |
| *** nadya has joined #openstack-infra | 17:42 | |
| clarkb | greghaynes: dib should maybe have a sudo check way early with helpful error message | 17:42 |
| greghaynes | clarkb: yea | 17:42 |
| fungi | jeblair: yep, perfect. i missed you linked an etherpad above | 17:43 |
| clarkb | doesn't look like d-g makes this configurable | 17:43 |
| clarkb | will have to ponder the best course of action here | 17:43 |
| fungi | i think i'm trying to bounce between too many conversations at once | 17:43 |
| clarkb | jeblair: fungi ^ thoughts on allowing stack user to sudo when running nodepool for dib image builds? | 17:43 |
| *** pvaneck has joined #openstack-infra | 17:43 | |
| clarkb | I don't really want to run it in a rootwrap type thing | 17:44 |
| fungi | jklare: so anyway, the short story there is that you can't have a branch override for changes running gate-openstack-chef-repo-chef-rake-integration and also run the same job name in the periodic pipeline since that pipeline is branchless (and changeless for that matter). you probably need a second basically identical job with a separate name | 17:44 |
| *** Guest55435 has quit IRC | 17:45 | |
| AJaeger | jklare: name it periodic-... | 17:45 |
| *** bexelbie_ has joined #openstack-infra | 17:45 | |
| fungi | clarkb: oh, nodepoold is running as stack? | 17:45 |
| clarkb | fungi: ya becaues all the devstack plugin things run as stack | 17:45 |
| clarkb | hrm that makes me think I can run it as jenkins | 17:45 |
| clarkb | maybe | 17:45 |
| *** mattymo_ has joined #openstack-infra | 17:45 | |
| mattymo_ | fungi, ping | 17:45 |
| fungi | mattymo_: i am not an icmp echo responder. please state your question instead | 17:46 |
| mattymo_ | fungi, no naked pings? okay | 17:46 |
| *** ildikov has joined #openstack-infra | 17:46 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/project-config: Add nonvoting beaker tests to infra/puppet-accessbot https://review.openstack.org/208799 | 17:46 |
| mattymo_ | fungi, I was wondering if you could take a look at these 3 repo requests: https://review.openstack.org/#/q/status:open+project:openstack-infra/project-config+branch:master+topic:new-project+owner:%22Bart%25C5%2582omiej+Piotrowski+%253Cbpiotrowski%2540mirantis.com%253E%22,n,z | 17:46 |
| mattymo_ | new fuel plugins | 17:47 |
| AJaeger | mattymo_: see https://blogs.gnome.org/markmc/2014/02/20/naked-pings/ | 17:47 |
| AJaeger | mattymo_: did you see my comment on https://review.openstack.org/#/c/211914/1 ? | 17:47 |
| mattymo_ | AJaeger, I'm aware of this because I used to work at RH and had a great laugh reading that whole thread | 17:47 |
| clarkb | the problem with using jenkins is it assumes you run the plugin on our test infra | 17:47 |
| fungi | mattymo_: why me specifically? that repo has 11 core reviewers | 17:48 |
| clarkb | but running on our test infra fails because we remove sudo which isn't normal for normal devstack useage | 17:48 |
| clarkb | so, Ithink best thing is likely to allow d-g to not remove sudo ? or is there worry that will be abused? | 17:48 |
| fungi | clarkb: how vast is the list of commands being sudo'd? should we just extend the sudoers file? | 17:49 |
| clarkb | fungi: its pretty large and undocumented (because its all dibs inner workings) | 17:49 |
| mattymo_ | fungi, you tend to be the most likely to respond to pings | 17:49 |
| clarkb | fungi: also potentially arbitrary depending on what yo uend up making the image build sdo | 17:49 |
| mattymo_ | sorry for the bad stereotype | 17:49 |
| mattymo_ | AJaeger, I saw your comment. I'll get it addressed if you think it's so important. We're not likely to make any branches. that doesn't tend to be an issue within fuel group | 17:50 |
| fungi | clarkb: on the other hand, i don't see any reason to restrict the environment nodepool runs in artificially. it has full access on the server where it runs in production, and you shouldn't expect to use a devstack machine for anything else besides what you're running on it anyway | 17:50 |
| clarkb | mattymo_: uh I seem to recall just reviewing a change to allow a fuel repo to make branches | 17:50 |
| clarkb | fungi: right, we do it for normal devstack testing to enforce use of rootwrap in the gate | 17:51 |
| clarkb | fungi: but the intent of this test has nothing to do with rootwrap so should be fine to open up | 17:51 |
| *** TravT has quit IRC | 17:51 | |
| mattymo_ | clarkb, sorry that I'm mistaken. it's news to me | 17:52 |
| *** SumitNaiksatam has joined #openstack-infra | 17:52 | |
| AJaeger | mattymo_: if you don't need them, don't add it - deletion of branches is manual work, let's avoid people creating them by accident | 17:52 |
| mattymo_ | AJaeger, you mean remove the create = group fuel-plugin-detach-database-core line altogether? okay | 17:53 |
| *** markus_z has quit IRC | 17:53 | |
| *** FallenPegasus has quit IRC | 17:53 | |
| *** sridhar_ram has quit IRC | 17:54 | |
| *** ybathia has joined #openstack-infra | 17:54 | |
| AJaeger | mattymo_: if you don't need them, remove it. If it's unlikely you need them, use -release group... | 17:55 |
| *** BharatK has quit IRC | 17:55 | |
| *** salv-orl_ has joined #openstack-infra | 17:55 | |
| *** fawadkhaliq has joined #openstack-infra | 17:56 | |
| fungi | tpborion: i've added you as the initial member of https://review.openstack.org/#/admin/groups/1045,members and you should be able to add any other members you need | 17:56 |
| tpborion | cool | 17:56 |
| tpborion | let me check how to do that | 17:56 |
| *** sc68cal has quit IRC | 17:56 | |
| tpborion | fungi: do we need -ptl and -release? | 17:57 |
| fungi | tpborion: your acl didn't add any other groups besides -core | 17:57 |
| pabelanger | clarkb: when you have a moment, would welcome a review of puppet / apache syntax: https://review.openstack.org/#/c/211205/ | 17:58 |
| *** shashank_hegde has joined #openstack-infra | 17:58 | |
| AJaeger | tpborion: and we don't use -ptl anymore. Read the creator's guide on whether you need -release | 17:58 |
| *** sergmelikyan has joined #openstack-infra | 17:58 | |
| *** rm_work is now known as rm_work|away | 17:58 | |
| tpborion | fungi: right, I'll take a look | 17:58 |
| tpborion | fungi: thank you | 17:59 |
| *** salv-orlando has quit IRC | 17:59 | |
| *** rm_work|away is now known as rm_work | 18:00 | |
| *** fawadkhaliq has quit IRC | 18:00 | |
| *** fawadkhaliq has joined #openstack-infra | 18:00 | |
| *** hichihara has quit IRC | 18:00 | |
| *** salv-orl_ has quit IRC | 18:01 | |
| *** salv-orl_ has joined #openstack-infra | 18:01 | |
| *** mrodden has quit IRC | 18:01 | |
| *** bpokorny_ has joined #openstack-infra | 18:02 | |
| *** sc68cal has joined #openstack-infra | 18:02 | |
| *** sc68cal has quit IRC | 18:02 | |
| *** sc68cal has joined #openstack-infra | 18:02 | |
| clarkb | pabelanger: the comment isn't correct though, its rewriting any valid server alias to what you are treating as canonical | 18:04 |
| *** salv-orl_ has quit IRC | 18:04 | |
| *** dkranz has quit IRC | 18:04 | |
| clarkb | pabelanger: sorry, just pointing that out as I spent a bunch of time figuring out how that comment was true | 18:04 |
| *** salv-orl_ has joined #openstack-infra | 18:05 | |
| fungi | fair point. the comment states the intent, rather than describing the implementation | 18:05 |
| *** bpokorny has quit IRC | 18:05 | |
| openstackgerrit | Emma Barber proposed openstack-infra/puppet-hound: Configure and run apache on top of hound https://review.openstack.org/211640 | 18:05 |
| fungi | the net result is the same when considered in conjunction with the manifest, but wouldn't necessarily always be true in the future if the manifest changes | 18:05 |
| clarkb | fungi: right and I was confused at first as a result | 18:06 |
| fungi | i can understand why | 18:06 |
| clarkb | why is the satisfy directie needed? | 18:07 |
| fungi | clarkb: it's not on apache 2.2 but pabelanger was initially testing on 2.4 | 18:08 |
| *** bexelbie_ is now known as bexelbie | 18:08 | |
| *** bexelbie has quit IRC | 18:08 | |
| fungi | i don't see that it hurts anything and is i guess one less line to add when we end up migrating static.o.o to trusty down the road | 18:08 |
| *** bpokorny_ has quit IRC | 18:08 | |
| fungi | i did at least ask him to confirm it didn't break on 2.2 | 18:08 |
| fungi | which he did | 18:08 |
| *** nadya has quit IRC | 18:08 | |
| *** EricGonczer_ has quit IRC | 18:09 | |
| anteaya | jgriffith: thanks for the update | 18:09 |
| *** salv-orlando has joined #openstack-infra | 18:10 | |
| openstackgerrit | Bartłomiej Piotrowski proposed openstack-infra/project-config: Add fuel-plugin-detach-rabbitmq project to stackforge https://review.openstack.org/211915 | 18:10 |
| openstackgerrit | Bartłomiej Piotrowski proposed openstack-infra/project-config: Add fuel-plugin-detach-database project to stackforge https://review.openstack.org/211914 | 18:10 |
| openstackgerrit | Bartłomiej Piotrowski proposed openstack-infra/project-config: Add fuel-plugin-detach-keystone project to stackforge https://review.openstack.org/211910 | 18:10 |
| anteaya | thanks dmellado, there was no bug filed, just stacktraces I liked to in the commit message | 18:11 |
| *** unicell has quit IRC | 18:11 | |
| *** unicell has joined #openstack-infra | 18:11 | |
| *** EricGonczer_ has joined #openstack-infra | 18:12 | |
| *** salv-orl_ has quit IRC | 18:12 | |
| *** sthillma has joined #openstack-infra | 18:12 | |
| clarkb | huh why does 2.4 want it? | 18:13 |
| fungi | clarkb: syntax changed around access permissions in apache 2.4 | 18:14 |
| *** hdd has quit IRC | 18:14 | |
| *** jswarren has quit IRC | 18:14 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Change functional testing to use clouds.yaml https://review.openstack.org/212083 | 18:14 |
| fungi | clarkb: see http://git.openstack.org/cgit/openstack-infra/puppet-zuul/tree/templates/zuul.vhost.erb for an example | 18:15 |
| *** EricGonczer_ has quit IRC | 18:16 | |
| jerryz | fungi: do you know why i am still getting this error http://paste.openstack.org/show/412933/ while jsonschema has excluded 2.5.0 version? | 18:16 |
| *** fawadkhaliq has quit IRC | 18:16 | |
| *** EricGonczer_ has joined #openstack-infra | 18:16 | |
| jerryz | fungi: i am running tempest on a python2.7 environment | 18:16 |
| openstackgerrit | Marton Kiss proposed openstack-infra/puppet-askbot: Fix smtp port and host assignment in config.pp https://review.openstack.org/212687 | 18:17 |
| mrmartin | fungi: ^^^^^ | 18:18 |
| mrmartin | da fix | 18:18 |
| fungi | mrmartin: thanks | 18:18 |
| *** angdraug has joined #openstack-infra | 18:19 | |
| fungi | jerryz: no idea. you need to look at the logs of how/when jsonschema was installed to see what might be causing that version to get installed | 18:19 |
| *** dkranz has joined #openstack-infra | 18:19 | |
| jerryz | fungi: the installed version is 2.5.1 | 18:19 |
| *** davidjc has joined #openstack-infra | 18:20 | |
| jerryz | fungi: which satisfies the requirements | 18:20 |
| fungi | jerryz: i'm missing some context. is this based on a previous discussion i had with you, or did you just ask me at random? | 18:21 |
| *** pelix has quit IRC | 18:21 | |
| jerryz | fungi: i just saw you approved a patch that excluded the 2.5.0 version from global-requirements 2 months ago | 18:21 |
| jerryz | fungi: so i thought you might know the story | 18:21 |
| fungi | jerryz: oh, that's useful background, thanks. i approve a lot of patches and we have a lot of emergencies in the span of two months, so it's hard to recognize a traceback on sight | 18:22 |
| jerryz | fungi: but even without 2.5.0 installed, https://github.com/Julian/jsonschema/issues/233 still applies to my environment | 18:23 |
| fungi | jerryz: thanks, found https://review.openstack.org/189238 just now. revisiting | 18:24 |
| jerryz | fungi: pip 1.4.1 was installed in the virtual environment by virtualenv (13.1.0), so i wonder whether there is any difference between ci-infra and my test node | 18:25 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add flavor access API https://review.openstack.org/211710 | 18:26 |
| fungi | jerryz: yes, we run with latest releases of virtualenv | 18:26 |
| jerryz | fungi: but 13.1.0 is the latest, isn't it | 18:27 |
| fungi | jerryz: virtualenv 13.1.0 should install pip 7.1.0 not pip 1.4.1 | 18:27 |
| jerryz | fungi: i was wondering the same thing | 18:27 |
| fungi | jerryz: pip 1.4.1 must be coming from somewhere else | 18:27 |
| jerryz | fungi: pip list |grep virtualenv | 18:28 |
| jerryz | virtualenv (13.1.0) | 18:28 |
| jerryz | fungi: virtualenv --version | 18:28 |
| jerryz | 1.10.1 | 18:28 |
| jerryz | how come? | 18:29 |
| *** bpokorny has joined #openstack-infra | 18:29 | |
| fungi | jerryz: that looks likely to be the problem https://github.com/Julian/jsonschema/issues/233 | 18:29 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Redirect trystack.org to trystack.o.o https://review.openstack.org/211205 | 18:29 |
| pabelanger | clarkb: thanks, commit message updated | 18:29 |
| crinkle | greghaynes: pleia2: lightning talk signup https://etherpad.openstack.org/p/PAO-ops-lightning-talks | 18:29 |
| fungi | jerryz: chances are you're installing a distro package of virtualenv as well as one from pypi | 18:29 |
| fungi | jerryz: so pip list sees the one from pypi but the one from your distro is first in your execution path | 18:30 |
| jerryz | fungi: tox will use the one in the system first? | 18:30 |
| fungi | jerryz: tox will use your normal execution path, yes | 18:31 |
| *** ParsectiX has joined #openstack-infra | 18:31 | |
| jerryz | fungi: i am removing it. thanks! | 18:32 |
| *** Sukhdev has quit IRC | 18:32 | |
| fungi | you're welcome | 18:32 |
| greghaynes | crinkle: ooo | 18:33 |
| openstackgerrit | Merged openstack-infra/project-config: Skip non-doc and test-only jobs for for all branches https://review.openstack.org/211642 | 18:33 |
| *** rkukura has quit IRC | 18:34 | |
| jeblair | fungi, clarkb, anteaya, AJaeger, sdague, dhellmann: https://etherpad.openstack.org/p/chYVrjmmZ8 | 18:34 |
| *** ParsectiX has quit IRC | 18:34 | |
| jeblair | let me know what you think of that; and also any early feedback on dates (that's just my first stab based on the release calendar and my own schedule :) | 18:35 |
| openstackgerrit | Julia Kreger proposed openstack-infra/shade: Initial support for ironic enroll state https://review.openstack.org/212070 | 18:35 |
| AJaeger | jeblair: We have a few projects since some weeks asking for moving to openstack. Do you want to move them before that cut-off date - or let them wait until the proposed one? | 18:35 |
| AJaeger | jeblair: These projects currently in the queue should be mentioned in your email | 18:36 |
| *** rkukura has joined #openstack-infra | 18:37 | |
| jeblair | AJaeger: good point. maybe we could do a move for projects that have already requested moves in early september? | 18:37 |
| AJaeger | jeblair: also, should we still approve changes for stackforge when other repos of that team are already in stackforge? | 18:37 |
| jeblair | or we could ask them to wait? | 18:37 |
| jeblair | AJaeger: yes, i think we should continue to house projects next to their siblings | 18:37 |
| jeblair | that's worth a mention too | 18:37 |
| AJaeger | jeblair: both works. But looking at magnetodb (https://review.openstack.org/204478) they want to change jobs as well | 18:38 |
| AJaeger | right now, we haven't allowed those. We could ask them to wait and approve the changes since they are an official project already... | 18:38 |
| *** salv-orlando has quit IRC | 18:39 | |
| jeblair | AJaeger: i think we can probably approve changes like that for official projects | 18:39 |
| AJaeger | jeblair: ok, just gave that suggestion on the review | 18:40 |
| anteaya | lifeless: thanks for the apology (still reading scrollback) | 18:41 |
| anteaya | jeblair: looking | 18:41 |
| clarkb | jeblair: etherpad looks like a good plan to me, both dates work for me too | 18:41 |
| anteaya | jeblair: that is a lovely green | 18:41 |
| anteaya | it makes my eyes happy | 18:41 |
| clarkb | pabelanger: the comment in the vhost not the commit message | 18:41 |
| jeblair | anteaya: yeah, i think health institutions have found that to be the case for decades :) | 18:42 |
| *** qb_ has quit IRC | 18:42 | |
| clarkb | pabelanger: I am waffling on whether ot not it is a -1 just because I got confused but also figured it out without too much effort | 18:42 |
| anteaya | jeblair: ha ha ha | 18:42 |
| anteaya | jeblair: I think October 17th is likely to be my family Christmas | 18:43 |
| anteaya | jeblair: as I will be in Tokyo for our usual dates | 18:43 |
| anteaya | jeblair: however most of my contribution comes from the reviewing which I can do in the dates leading up to it | 18:43 |
| AJaeger | jeblair: one crazy idea: Do it in two stages: Mass move ready repos at first date, at second date: mark remaining ones read-only or move them if they wake up... | 18:44 |
| jeblair | anteaya: this is not how you celebrate Christmas? | 18:45 |
| *** gyee has quit IRC | 18:45 | |
| pabelanger | clarkb: -1 away, not an issue. I can add more details into commit message | 18:45 |
| *** moravec has joined #openstack-infra | 18:45 | |
| *** kushal has joined #openstack-infra | 18:45 | |
| AJaeger | jeblair: if we do all changes in one go, we might abandon the already queued ones as well - depending how we do the change... | 18:46 |
| dhellmann | jeblair: that plan looks good to me | 18:46 |
| jeblair | AJaeger: i'd like to try to keep it down to one big move (if we have to do a smaller move before then for people who have been waiting months, that's fine), but for the bulk of these, I think we may be able to get away with just one | 18:46 |
| fungi | jeblair: i'm good with both dates. can't do either of the next two saturdays in november though (i'll be on my way to/from the caribbean) | 18:46 |
| anteaya | jeblair: ha ha ha | 18:46 |
| anteaya | fungi: yay, which island? | 18:47 |
| AJaeger | jeblair: that's why I said crazy ;). I'm fine doing it in one run | 18:47 |
| openstackgerrit | Merged openstack-infra/puppet-askbot: Fix smtp port and host assignment in config.pp https://review.openstack.org/212687 | 18:47 |
| jeblair | AJaeger: cool, it's good to see crazy and then back away slowly | 18:47 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Make it possible to not remove stack sudo https://review.openstack.org/212698 | 18:48 |
| clarkb | fungi: ^ thats sort of what I have in mind, thoughts? | 18:48 |
| *** baoli_ has quit IRC | 18:48 | |
| *** baoli has joined #openstack-infra | 18:49 | |
| fungi | anteaya: many of them. and also a boat | 18:49 |
| *** jsavak has quit IRC | 18:51 | |
| fungi | clarkb: lgtm though the last sentence of the commit message is confounding | 18:51 |
| *** kushal has quit IRC | 18:51 | |
| anteaya | fungi: nice | 18:51 |
| fungi | clarkb: +2. i knew what it meant, even if it said it in a sort of contradictory-sounding way | 18:52 |
| *** moravec has quit IRC | 18:52 | |
| openstackgerrit | Emma Barber proposed openstack-infra/puppet-hound: Configure and run apache on top of hound https://review.openstack.org/211640 | 18:53 |
| *** jsavak has joined #openstack-infra | 18:54 | |
| taron | .oO( three patchsets for me to get the => alignment in order... jeez ) | 18:54 |
| clarkb | fungi: er I should fix that, it is confusing | 18:54 |
| anteaya | taron: how much time left for your internship? | 18:54 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Make it possible to not remove stack sudo https://review.openstack.org/212698 | 18:55 |
| clarkb | fungi: ^ that should read better | 18:55 |
| anteaya | jeblair: I have left some questions for clarification/expansion on item 4 | 18:55 |
| *** hdd has joined #openstack-infra | 18:56 | |
| jeblair | anteaya: thx | 18:56 |
| *** akscram has quit IRC | 18:56 | |
| krotscheck | jhesketh: I responded to your comment on https://review.openstack.org/#/c/210601/ | 18:56 |
| taron | anteaya: officially ends on the 25th | 18:56 |
| AJaeger | jeblair: I'm fine with the plan and expect I'll be fine with your update addressing the TODOs as well... | 18:57 |
| anteaya | taron: so less than 2 weeks | 18:57 |
| *** xyang1 has quit IRC | 18:57 | |
| *** baoli has quit IRC | 18:58 | |
| *** akscram has joined #openstack-infra | 18:58 | |
| anteaya | taron: have you written up a status report yet both of your progress on hound as well as feedback for us on your experience so we can take that into consideration should we want to take another intern again? | 18:58 |
| taron | anteaya: yep. not under any illusions I'll be getting the last payment at this point, but I'm going to do what I can to finish it anyway | 18:58 |
| *** moravec has joined #openstack-infra | 18:58 | |
| *** baoli has joined #openstack-infra | 18:58 | |
| anteaya | taron: :( | 18:58 |
| clarkb | pabelanger: commented | 18:58 |
| *** jsavak has quit IRC | 18:58 | |
| taron | anteaya: I haven't, but I can do that as well | 18:58 |
| anteaya | taron: can you put some comments in an etherpad? | 18:58 |
| taron | of course | 18:58 |
| *** baoli has quit IRC | 18:58 | |
| *** sergmelikyan has quit IRC | 18:59 | |
| *** jsavak has joined #openstack-infra | 18:59 | |
| anteaya | taron: if you could, I was purposely hands off this round as I couldn't dedicate the time I wanted to it | 18:59 |
| openstackgerrit | Madhusudhan Kandadai proposed openstack-infra/project-config: Create experimental job for all neutron-vpnaas tests https://review.openstack.org/211767 | 18:59 |
| anteaya | taron: but I am interested in hearing your thoughts | 18:59 |
| anteaya | taron: including what obstacles we might have presented to you doing what needed to be done to recieve the full stipend | 18:59 |
| anteaya | taron: as you being able to eat and pay bills while you spend time with us is a big part of the program, for me anyway | 19:00 |
| clarkb | elasticsearch has 4 shards left to recover | 19:00 |
| clarkb | so should be green soon | 19:00 |
| *** tiswanso has quit IRC | 19:01 | |
| *** fawadkhaliq has joined #openstack-infra | 19:01 | |
| taron | anteaya: I fault myself mostly for procrastinating/generally doing nothing for most of the summer and not recognizing when I should ask for a bit of direction, a more hands on approach might've helped but at the same time, I had a spec, I knew what I should've been doing | 19:02 |
| anteaya | well mentoring comes in all forms | 19:02 |
| *** tiswanso has joined #openstack-infra | 19:02 | |
| anteaya | and I think that part of it is working with the person to figure out how they work best | 19:02 |
| anteaya | not laying any blame because I couldn't mentor you and you are here, so yay | 19:03 |
| anteaya | and thanks to fungi and pleia2 and others who did step up to help | 19:03 |
| *** bharath has quit IRC | 19:03 | |
| anteaya | but what works for someone doesn't work for someone else | 19:03 |
| *** pc_m has quit IRC | 19:04 | |
| anteaya | and I'm sorry that this didn't work for you in a way that you recieve the full stipend | 19:04 |
| *** pc_m has joined #openstack-infra | 19:04 | |
| *** bharath has joined #openstack-infra | 19:04 | |
| anteaya | so yes, please share your candid thoughts however you can | 19:04 |
| anteaya | so we can take your perspective into account | 19:04 |
| *** dkranz has quit IRC | 19:04 | |
| *** mwagner_lap has quit IRC | 19:04 | |
| anteaya | as we discuss this experience as a team | 19:04 |
| anteaya | and plan accordingly should there be a next time | 19:05 |
| * taron nods, needs to hop on the bus shortly but will do so today | 19:05 | |
| anteaya | taron: thanks | 19:05 |
| anteaya | happy bus ride | 19:05 |
| fungi | taron: anteaya: absolutely. i'm sure i didn't reach out as often as i could have since i tend to assume people don't need help unless they ask for it, but i welcome any constructive criticism | 19:05 |
| anteaya | fungi: thanks, that's what I thought, thank you | 19:05 |
| taron | I do plan on sticking around the community and keeping up helping out where I can in any case, regardless of my opinion of my productivity this summer | 19:06 |
| *** fawadkhaliq has quit IRC | 19:06 | |
| fungi | that was going to be my other question... what can we do to keep you around! we welcome contributions in a variety of forms and quantities | 19:06 |
| *** amitgandhinz has quit IRC | 19:07 | |
| *** bapalm_ is now known as bapalm | 19:07 | |
| sc68cal | taron: just tuning in, but it does sound like you learned something valuable - it might not have been how things could have gone, but it sounds like you gained new insights | 19:07 |
| fungi | not everybody can afford to pitch in 10, 20, 80 hours a week. some may only find one or two | 19:07 |
| sc68cal | so it's not all a loss | 19:07 |
| taron | sc68cal: yup, that's the perspective I"m trying to take on it | 19:08 |
| *** amitgandhinz has joined #openstack-infra | 19:08 | |
| *** bharath has quit IRC | 19:08 | |
| *** sdake has joined #openstack-infra | 19:09 | |
| openstackgerrit | Somay Jain proposed openstack-infra/jenkins-job-builder: Boolean parameters and more options in Parameterized Trigger Plugin https://review.openstack.org/212705 | 19:10 |
| taron | what happened happened, I'll get what I can done now, I'm not hurting for money regardless of whether I get the last payment, and learned a bunch about myself on the way | 19:11 |
| *** madhu_ak has joined #openstack-infra | 19:11 | |
| mmmpork | just chiming in, but in my experience with college interns, having a proactive mentor and some kind of structured check-in type of thing is usually pretty effective | 19:11 |
| mmmpork | by structured check-in it could just be an email once a week of "what i did last week and what i hope to do this week and any other issues" | 19:12 |
| mmmpork | but generally having some kind of back and forth beyond email is more effective | 19:12 |
| *** sdake_ has quit IRC | 19:12 | |
| *** sergmelikyan has joined #openstack-infra | 19:12 | |
| pabelanger | clarkb: I can simple remove the comment. I only added it since I was initially confused about the rewritecond syntax | 19:13 |
| pabelanger | Or just use your comment :) Rewrite any valid serveralias to the srvname | 19:13 |
| *** nadya has joined #openstack-infra | 19:14 | |
| taron | mmmpork: went ahead and created the etherpad since I got distracted and missed the bus if you wanna put your thoughts in https://etherpad.openstack.org/p/outreachy-infra-thoughts | 19:14 |
| mmmpork | thanks! yeah i don't know a lot about this particular context but i'm happy to share my thoughts :) | 19:15 |
| *** tpborion_ has joined #openstack-infra | 19:15 | |
| taron | heh, it's easier to find things in an etherpad than in scrollback, anyway | 19:16 |
| *** shashank_hegde has quit IRC | 19:16 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Redirect trystack.org to trystack.o.o https://review.openstack.org/211205 | 19:17 |
| *** dkranz has joined #openstack-infra | 19:18 | |
| openstackgerrit | Doug Hellmann proposed openstack/requirements: Update review policy for our libraries https://review.openstack.org/212708 | 19:18 |
| *** tpborion_ has quit IRC | 19:20 | |
| openstackgerrit | Matt Riedemann proposed openstack/requirements: Raise the cap on kombu to 3.0.15 since that's when kombu supports py34 https://review.openstack.org/212710 | 19:20 |
| *** FallenPegasus has joined #openstack-infra | 19:21 | |
| *** erikmwilson_ is now known as erikwilson_ | 19:21 | |
| *** rkukura has quit IRC | 19:22 | |
| *** armax has quit IRC | 19:23 | |
| madhu_ak | pc_m, thanks for your comments | 19:24 |
| *** cdent has quit IRC | 19:25 | |
| *** sthillma has quit IRC | 19:26 | |
| *** esker has joined #openstack-infra | 19:28 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Rewrite trystack.org to trystack.o.o https://review.openstack.org/211205 | 19:29 |
| *** puranamr has quit IRC | 19:30 | |
| clarkb | elasticsearch cluster is green now, but it is relocating shards which will have some impact on performance until complete | 19:30 |
| *** puranamr has joined #openstack-infra | 19:30 | |
| *** salv-orlando has joined #openstack-infra | 19:31 | |
| *** moravec has quit IRC | 19:32 | |
| *** bharath has joined #openstack-infra | 19:32 | |
| clarkb | one thing I notice in the nodepool logs is iso8601 is logging at a debug level which is mostly useless noise | 19:32 |
| *** nadya has quit IRC | 19:33 | |
| clarkb | mordred: ^ I believe that is coming from shade? I thought most projects already killed its logging but we apparently missed it somewhere | 19:33 |
| *** sthillma has joined #openstack-infra | 19:33 | |
| *** fifieldt_ has joined #openstack-infra | 19:33 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-packagekit: Add Gemfile and puppet 4 checks https://review.openstack.org/212713 | 19:34 |
| *** fifieldt has quit IRC | 19:34 | |
| *** esker has quit IRC | 19:35 | |
| *** salv-orlando has quit IRC | 19:36 | |
| *** esker has joined #openstack-infra | 19:36 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-pgsql_backup: Add .gitignore https://review.openstack.org/212714 | 19:36 |
| *** sthillma has quit IRC | 19:37 | |
| *** sthillma has joined #openstack-infra | 19:37 | |
| anteaya | just picked up my latest silk from thailand, the reports are that the women are exhausted doing the weaving | 19:41 |
| anteaya | but the younger women haven't been interested in picking up the making silk habit from the older women, so here's hoping they change their mind | 19:42 |
| anteaya | because yay sustainable manufacturing | 19:42 |
| *** tiswanso has quit IRC | 19:42 | |
| *** hodos has joined #openstack-infra | 19:42 | |
| hodos | hi does any1 know how to workaround this: https://bugs.launchpad.net/devstack/+bug/1484448 | 19:43 |
| openstack | Launchpad bug 1484448 in devstack "ERROR: openstack Missing parameter(s): Set a service URL, with --os-url, OS_URL or auth.url" [Undecided,New] | 19:43 |
| *** rkukura has joined #openstack-infra | 19:44 | |
| *** tsg has joined #openstack-infra | 19:45 | |
| *** hemna has quit IRC | 19:45 | |
| *** tiswanso has joined #openstack-infra | 19:45 | |
| anteaya | yes the problem is with openstackclient 1.6.2 | 19:46 |
| anteaya | if you update to 1.6.3 which was released today you should be good | 19:46 |
| *** puranamr has quit IRC | 19:46 | |
| *** puranamr has joined #openstack-infra | 19:47 | |
| Shrews | anteaya: os-client-config, not osc :) | 19:47 |
| anteaya | Shrews: thank you | 19:47 |
| anteaya | hodos: os-client-config | 19:47 |
| anteaya | too many acronyms | 19:47 |
| *** Sukhdev has joined #openstack-infra | 19:47 | |
| *** sthillma has quit IRC | 19:48 | |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-phabricator: Make mysql root password required https://review.openstack.org/212719 | 19:48 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-phabricator: Add Gemfile and puppet 4 checks https://review.openstack.org/212720 | 19:48 |
| hodos | anteaya:thank you | 19:48 |
| anteaya | welcome | 19:49 |
| *** kushal has joined #openstack-infra | 19:49 | |
| *** salv-orlando has joined #openstack-infra | 19:50 | |
| *** sthillma has joined #openstack-infra | 19:51 | |
| *** achanda has quit IRC | 19:52 | |
| *** hdd has quit IRC | 19:53 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/irc-meetings: Update FwaaS meeting cadence https://review.openstack.org/212723 | 19:53 |
| *** tiswanso has quit IRC | 19:54 | |
| *** tiswanso has joined #openstack-infra | 19:56 | |
| lifeless | clarkb: so, Nakato's patch worked, what next ? | 19:58 |
| clarkb | lifeless: now that we have working test we can show people we need to either update the existing jobs everywhere or make a case for expanding the testing interface | 19:59 |
| clarkb | either way should be fine long term and now we have something concrete to look at | 20:00 |
| lifeless | clarkb: so my understanding of the plan - and yes, I know you weren't there - | 20:00 |
| lifeless | clarkb: was that we'd let folk opt in | 20:00 |
| clarkb | lifeless: yup I think we can do that with either of the two options listed above. | 20:01 |
| lifeless | ok | 20:01 |
| *** AJaeger has quit IRC | 20:01 | |
| clarkb | if we keep the existing jobs they would opt in by updating their tox.ini's targets to use constraints. If we make new targets they opt in by making new targets in the tox.inis | 20:01 |
| *** mrmartin has quit IRC | 20:02 | |
| lifeless | so the other concern we had was that developers at home also opt in | 20:02 |
| clarkb | the only issue with making new targets is we do have a defined testing interface that we expect projects to standardize on | 20:02 |
| lifeless | which to my mind rules out changing tox's existing targets | 20:02 |
| clarkb | and for the most part they do so any changes to that should be recognized | 20:02 |
| lifeless | sure | 20:02 |
| *** annegentle has quit IRC | 20:02 | |
| clarkb | lifeless: they can land an empty constraints.txt file to the repo at the same time | 20:03 |
| lifeless | so - it sounds to me like we need a patch to governance/reference/project-testing-interface | 20:03 |
| clarkb | which gets overwritten in the gate | 20:03 |
| clarkb | but localtesting is unaffected | 20:03 |
| lifeless | clarkb: I would be worried about that causing significant confusion | 20:03 |
| *** puranamr has quit IRC | 20:03 | |
| lifeless | clarkb: either by it getting edited by projects, or by folk trying to figure out whats going on. | 20:04 |
| *** puranamr has joined #openstack-infra | 20:04 | |
| clarkb | we could put a comment in it | 20:04 |
| lifeless | so I'd say we'd need to force that to be just a comment | 20:04 |
| clarkb | explaining how constraints work and why its empty in repo | 20:04 |
| lifeless | done by the requirements sync job | 20:04 |
| clarkb | but eithre way (new targets/update old targets) should owrk fine | 20:04 |
| lifeless | I'm leaning towards new targets | 20:04 |
| clarkb | just different sets of work go along with each and I guess different sets of confusion | 20:04 |
| lifeless | fungi: ^ seeking 3rd opinion | 20:05 |
| fungi | itym "enforced by the requirements check job" | 20:05 |
| *** alivigni has quit IRC | 20:05 | |
| *** shashank_hegde has joined #openstack-infra | 20:05 | |
| fungi | the requirement sync job is what proposes updates, so wouldn't itself prevent projects from modifying the file | 20:05 |
| *** vinayyadhav has joined #openstack-infra | 20:06 | |
| fungi | lifeless: clarkb: link to the job definition you're discussing? | 20:06 |
| *** ivar-lazzaro has quit IRC | 20:06 | |
| clarkb | probably best to look at the nova tox.ini change | 20:06 |
| clarkb | let me find it | 20:06 |
| *** ivar-lazzaro has joined #openstack-infra | 20:06 | |
| fungi | k | 20:07 |
| clarkb | fungi: https://review.openstack.org/#/c/211392/1/tox.ini basically do we do the constraints install line across the board in existing tox targets or do we make a second set of tox targets that doe sthat | 20:07 |
| *** puranamr has quit IRC | 20:07 | |
| fungi | or some other third option | 20:07 |
| fungi | looking | 20:07 |
| *** puranamr has joined #openstack-infra | 20:07 | |
| clarkb | (yes or some third option as long as projects can opt in as that appears to be an agreed upon requirement previously) | 20:08 |
| fungi | what gets the upper-constraints.txt file into place? | 20:08 |
| fungi | zuul-cloner? | 20:08 |
| clarkb | fungi: a zuul-cloner command that we worked out during oscon | 20:08 |
| clarkb | ya | 20:08 |
| openstackgerrit | Merged openstack/requirements: Bump oslo.utils to 2.0.0 https://review.openstack.org/204904 | 20:08 |
| clarkb | its applied to your bindep test job right now for testing against 211392 | 20:09 |
| fungi | is there a slave script proposed somewhere with that bit of the logic? | 20:09 |
| fungi | aha, thanks | 20:09 |
| *** sridhar_ram has joined #openstack-infra | 20:09 | |
| fungi | ahh, the zuul-git-prep-upper-constraints macro | 20:09 |
| fungi | okay, i recall reviewing that with you at oscon now | 20:10 |
| *** ivar-lazzaro has quit IRC | 20:10 | |
| *** ivar-lazzaro has joined #openstack-infra | 20:11 | |
| clarkb | so question now is "we have constraints in place and that all works, how do we get projects t oconsume sanely while allowing opt in and not breaking local devs?" | 20:11 |
| *** esmute_ has quit IRC | 20:11 | |
| fungi | right | 20:11 |
| fungi | can pip be made to treat a nonexistent constraints file as an empty one? | 20:11 |
| fungi | if so, there's an easy enough answer | 20:12 |
| *** HeOS has joined #openstack-infra | 20:12 | |
| fungi | alternately, can tox have a conditional to only add the constraints option of a specific file exists? | 20:12 |
| fungi | s/of/if/ | 20:12 |
| clarkb | install commands could be ninjad to run in a subshell and do file existence tests maybe | 20:13 |
| clarkb | but thats hacky | 20:13 |
| clarkb | and I would expect pip to error if you give it an invalid file path | 20:13 |
| fungi | testing now | 20:14 |
| fungi | Could not open requirements file: [Errno 2] No such file or directory: 'foo' | 20:15 |
| *** jsavak has quit IRC | 20:15 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add MultiJob Project Documentation. https://review.openstack.org/212666 | 20:16 |
| fungi | yeah | 20:16 |
| clarkb | lifeless: anyways I am happy to help either way, I think they will both be fine but getting input from fungi and others now is helpful too | 20:16 |
| clarkb | jeblair may have throughts on the testing interface | 20:16 |
| fungi | reading up on the tox.ini possibilities | 20:17 |
| fungi | it does have some conditional logic, but mostly around env name | 20:17 |
| clarkb | ya I think latest tox makes it easy to use different install commands based on an env name prefix | 20:18 |
| fungi | right, doesn't seem to have support for other test conditions like file existence | 20:19 |
| fungi | so i'm not seeing other options for the moment that don't involve hacky wrapper scripts or extra shell evaluation in the tox.ini | 20:20 |
| *** Alexandra_ has joined #openstack-infra | 20:20 | |
| fungi | (arguably those are both slightly different implementations of a common hacky solution) | 20:20 |
| *** jsavak has joined #openstack-infra | 20:21 | |
| fungi | so... one option is for the job runner to check for the existence of constraints support in the tox.ini and then decide to run an alternate constraints-py27 or something like that | 20:21 |
| fungi | devs could choose to run either py27 or constraints-py27 | 20:21 |
| clarkb | yup that is what lifeless would like aiui | 20:22 |
| fungi | and gate-{name}-py27 would run constraints-py27 if it's available, py27 otherwise | 20:22 |
| *** esmute_ has joined #openstack-infra | 20:22 | |
| clarkb | the second option I proposed was adding an empty upper constraints to the repo that is overwritten when you need real constraints (eg in the gate) and just always attempt to apply the constraints empty or not | 20:22 |
| fungi | similar to the fallback logic i've for for bindep | 20:22 |
| fungi | i agree with lifeless that the empty constraints file is likely to be confusing | 20:23 |
| fungi | marginally less so if it has comments in it explaining why it's empty and should always remain so, but that still seems marginally silly | 20:23 |
| fungi | demerits to me for using marginally twice there | 20:24 |
| *** ivar-lazzaro has quit IRC | 20:24 | |
| *** nadya has joined #openstack-infra | 20:25 | |
| anteaya | marginal demerits | 20:26 |
| *** vinayyadhav has quit IRC | 20:26 | |
| fungi | anyway, i think the main reason i'm in favor of the default/fallback logic in the job is that it makes the addition entirely self-testing without needing to implement new jobs as well | 20:26 |
| fungi | if you don't have constraints-py27 support in your tox.ini (determined via `tox -l` i guess) then you'll get the normal job run. if you propose a change to add that to your tox.ini, it will get run instead and you can confirm it's working before it merges so that you don't get hamstrung | 20:27 |
| clarkb | fungi: I think we do still need to codify that in the testing interface though | 20:28 |
| *** vinayyadhav has joined #openstack-infra | 20:28 | |
| clarkb | so that there isn't confusion around "how do I run python tests" | 20:28 |
| *** nadya has quit IRC | 20:28 | |
| fungi | and that puts the implementation timeline 100% in the hands of individual projects, without creating lots of patches for infra to review | 20:28 |
| jhesketh | Morning | 20:28 |
| fungi | clarkb: that i completely agree with | 20:28 |
| *** warpc__ has quit IRC | 20:28 | |
| pabelanger | fungi: clarkb: think this addresses comments: https://review.openstack.org/#/c/211205/ | 20:28 |
| fungi | clarkb: lifeless: should be a broader conversation around the pti, but i think it's the way to go | 20:29 |
| anteaya | morning jhesketh | 20:29 |
| jhesketh | o/ | 20:29 |
| *** baoli has joined #openstack-infra | 20:29 | |
| *** kushal has quit IRC | 20:30 | |
| pabelanger | could also use the help of an infra-core with DIBs and selinux: https://review.openstack.org/#/c/211703/ | 20:31 |
| pabelanger | need help validating that | 20:31 |
| *** _Alexandra_ has joined #openstack-infra | 20:31 | |
| *** sdake_ has joined #openstack-infra | 20:32 | |
| clarkb | pabelanger: fungi for 211703 what do the yum built and centos cloud image build dib images do? they turn on selinux by default? | 20:32 |
| *** Alexandra_ has quit IRC | 20:32 | |
| *** achanda has joined #openstack-infra | 20:33 | |
| clarkb | pabelanger: fungi: or is it off? I think either that code is removed because it is off or that code stays with an updated comment if selinux is on | 20:33 |
| *** rbradfor has joined #openstack-infra | 20:34 | |
| *** tim_o__ has joined #openstack-infra | 20:34 | |
| *** baoli has quit IRC | 20:34 | |
| pabelanger | clarkb: checking nodepool logs to see | 20:35 |
| *** madong_ has quit IRC | 20:35 | |
| *** tsg has quit IRC | 20:35 | |
| *** madong_ has joined #openstack-infra | 20:35 | |
| *** tsg has joined #openstack-infra | 20:35 | |
| *** flepied has joined #openstack-infra | 20:35 | |
| *** sdake has quit IRC | 20:36 | |
| *** _Alexandra_ is now known as dewsday-WFB | 20:36 | |
| greghaynes | clarkb: that is at build time in chroot though, so I think it just matters what the host does | 20:36 |
| greghaynes | the build host | 20:36 |
| *** sridhar_ram has quit IRC | 20:36 | |
| openstackgerrit | Merged openstack-infra/system-config: Rewrite trystack.org to trystack.o.o https://review.openstack.org/211205 | 20:36 |
| *** krtaylor has quit IRC | 20:37 | |
| *** ayoung has joined #openstack-infra | 20:37 | |
| jeblair | clarkb, fungi: yeah, it sounds like a proposed change to the pti is the best way to evaluate this | 20:38 |
| fungi | clarkb: [fungi@centos-6-rax-iad-4308157 ~]$ grep ^SELINUX= /etc/sysconfig/selinux | 20:38 |
| fungi | SELINUX=disabled | 20:38 |
| clarkb | fungi: cool | 20:40 |
| clarkb | greghaynes: build host is ubuntu so definitely disabled by default there | 20:40 |
| fungi | clarkb: no, wait, scratch that. i forgot centos-6 is snapshot-based on rax still | 20:41 |
| *** barnaby has quit IRC | 20:41 | |
| fungi | i need to get a dib-built one booted in hpcloud to properly confirm | 20:41 |
| clarkb | fungi: ah ok will hold off on my review then | 20:41 |
| greghaynes | clarkb: hrm, maybe someone who understands this more than I should chime in, but I figure thats how it works | 20:41 |
| *** annegentle has joined #openstack-infra | 20:41 | |
| pabelanger | Ya, not sure where / who is controlling selinux on jenkins slaves from puppet. Guess we could add something to enable/disable | 20:44 |
| fungi | pabelanger: afaik we rely on whatever's set in the base image | 20:44 |
| fungi | pabelanger: but since with dib we're creating the base image... | 20:45 |
| jeblair | sometime recently rax switched their base images to selinux disabled by default | 20:45 |
| jeblair | which is evil | 20:45 |
| jeblair | we ended up with 1/3 of the git.o.o farm selinux disabled | 20:45 |
| pabelanger | fungi: Ya. I something tells me adding a check into puppet would help ensure it is controlled as we expect it to be | 20:45 |
| fungi | i guess in the centos-6 case anyway we're relying on whatever initial value is in the seed image used by the centos dib element | 20:45 |
| fungi | pabelanger: well, i think as much as possible we want to test whatever people are likely to get on a platform by default, to minimize surprises | 20:46 |
| pabelanger | fungi: Ya, I can see that | 20:46 |
| fungi | okay, i've got a centos-6 dib-based node booting in hpcloud-b5 now | 20:46 |
| *** fawadkhaliq has joined #openstack-infra | 20:48 | |
| lifeless | fungi: clarkb: Nakato: ok, so I think the next step is a patch to the governance repo proposing the new -constraints target. | 20:48 |
| *** madong_ is now known as larainema | 20:49 | |
| *** krtaylor has joined #openstack-infra | 20:49 | |
| *** woodster_ has quit IRC | 20:50 | |
| *** mjturek1 has quit IRC | 20:51 | |
| fungi | clarkb: pabelanger: greghaynes: [fungi@host-10-0-4-238 ~]$ grep ^SELINUX= /etc/sysconfig/selinux | 20:51 |
| fungi | SELINUX=enforcing | 20:51 |
| * fungi sighs loudly | 20:51 | |
| *** Guest61394 is now known as med_ | 20:51 | |
| *** med_ has joined #openstack-infra | 20:51 | |
| greghaynes | hehe | 20:51 |
| fungi | pabelanger: so for dib, we've got it always enabled i guess, which means we should always work around it, not just conditionally work around it | 20:51 |
| pabelanger | clarkb: fungi: okay, just updated my hosts file to use 192.237.219.31 for trystack.org. Rewrite to trystack.o.o worked as expected. When you have time, do you mind updating dns for trystack.org? | 20:52 |
| greghaynes | do we want to disable it in dib? | 20:52 |
| pabelanger | fungi: ugh, okay. | 20:52 |
| *** julim has quit IRC | 20:52 | |
| greghaynes | I think some people like to be able to test against that, but sounds like that is not the current state of things | 20:52 |
| pabelanger | greghaynes: that is a good question. What does -infra think of selinux? | 20:52 |
| fungi | greghaynes: i think we want it to be whatever people get by default when they install centos 6. if that's enforcing, then i think that's what we need | 20:52 |
| greghaynes | I belive it is enforcing by default | 20:53 |
| fungi | right now we've got a mishmash of enforcing in hpcloud and disabled in rackspace anyway | 20:53 |
| *** shashank_hegde has quit IRC | 20:53 | |
| fungi | hpcloud seems to use distro-provided base images rather than rolling their own like rackspace does | 20:53 |
| fungi | so i'd tend to say what we get on hpcloud is probably more typical | 20:54 |
| fungi | and dib seems to have it enforcing by default too (i think because the centos element uses a seed image which probably has it enforcing) | 20:54 |
| *** woodster_ has joined #openstack-infra | 20:54 | |
| greghaynes | Yep, it does | 20:54 |
| greghaynes | In tripleo days it was by default unenforcing for a long time but we got it back to enforcing, I dont remember if that happened in DIB or tripleo elements though | 20:55 |
| *** shashank_hegde has joined #openstack-infra | 20:57 | |
| fungi | anyway the original point of my comment which spawned pabelanger's change is that in our dib elements there's no need to have conditional logic based on what may or may not be enabled in a given cloud provider's base images, because we're providing a consistent image (the entire point of using dib) | 20:57 |
| *** tpborion is now known as thiagop | 20:58 | |
| pabelanger | okay, let try see why fedora22 is failing to run chron then. It was bombing about not finding system_u:object_r:named_conf_t:s0 | 20:58 |
| *** moravec has joined #openstack-infra | 20:58 | |
| fungi | chcon? | 20:58 |
| * fungi hopes cron is not broken on f22 ;) | 20:59 | |
| pabelanger | chcon* | 20:59 |
| pabelanger | fat fingers | 20:59 |
| *** pc_m has quit IRC | 20:59 | |
| *** bswartz has quit IRC | 20:59 | |
| greghaynes | fungi: for selinux it is exposing what is enabled on the build host I *think* though | 20:59 |
| greghaynes | fungi: actually, that check might not even do the right thing ;) | 21:00 |
| fungi | greghaynes: very interesting given that the build host is ubuntu with selinux disabled and ends up creating a centos 6 image with selinux enabled | 21:00 |
| fungi | copying behaviors of the host system is a little dubious for a cross-build system | 21:01 |
| greghaynes | can you even chcon in a chroot that has selinux enabled on a host that does not? | 21:01 |
| fungi | greghaynes: likely not | 21:01 |
| *** sabeen3 has quit IRC | 21:01 | |
| greghaynes | I guess what im trying to articulate ;) since that is what the check there would try and do | 21:01 |
| fungi | greghaynes: though maybe if it's stored in filesystem attributes | 21:02 |
| *** shashank_hegde has quit IRC | 21:03 | |
| fungi | greghaynes: looks like it should work fine? "SELinux stores file security labels in xattrs" | 21:03 |
| greghaynes | ah ok | 21:03 |
| fungi | https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/4/html/SELinux_Guide/rhlcommon-section-0019.html | 21:03 |
| pabelanger | okay, rebuilding fedora22 dib. Going to step out for some food. Thanks for everybodies help | 21:04 |
| * fungi gets back to completing six impossible things before his breakfast reservation at milliways | 21:05 | |
| openstackgerrit | Merged openstack/requirements: Raise the cap on kombu to 3.0.15 since that's when kombu supports py34 https://review.openstack.org/212710 | 21:05 |
| *** aysyd has quit IRC | 21:06 | |
| *** tsg has quit IRC | 21:07 | |
| *** tsg has joined #openstack-infra | 21:08 | |
| *** yamamoto has joined #openstack-infra | 21:10 | |
| openstackgerrit | Merged openstack-infra/project-config: Don't run gate-neutron-vpnaas-dsvm-functional-sswan on stable/juno https://review.openstack.org/212621 | 21:13 |
| *** thorst has quit IRC | 21:14 | |
| *** rfolco has quit IRC | 21:14 | |
| *** ldnunes has quit IRC | 21:15 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid: OIDC - OpenId Connect Implementation https://review.openstack.org/198458 | 21:15 |
| waynr | zaro: here's a pretty simple doc update to JJB https://review.openstack.org/#/c/212666/ | 21:15 |
| waynr | who else has workflow approval for JJB? | 21:16 |
| zaro | waynr: pelix | 21:17 |
| fungi | waynr: http://docs-draft.openstack.org/66/212666/2/check/gate-jenkins-job-builder-docs/575c5b6//doc/build/html/project_multijob.html#module-project_multijob lgtm | 21:17 |
| *** jsavak has quit IRC | 21:18 | |
| *** vinayyadhav has quit IRC | 21:19 | |
| *** unicell has left #openstack-infra | 21:19 | |
| *** yamamoto has quit IRC | 21:19 | |
| *** tonytan4ever has quit IRC | 21:20 | |
| *** ayoung has quit IRC | 21:21 | |
| *** Sukhdev has quit IRC | 21:21 | |
| zaro | waynr: ohh yeah and all the other infra cores | 21:21 |
| zaro | like fungi | 21:21 |
| fungi | (who already +2'd it) | 21:21 |
| *** armax has joined #openstack-infra | 21:22 | |
| anteaya | we still have a bug bot chorus in -meeting :( | 21:22 |
| anteaya | we discussed banning uvirtbot | 21:23 |
| anteaya | can we do that? | 21:23 |
| anteaya | thank you | 21:23 |
| fungi | done to all the meeting channels and the dev channel | 21:23 |
| anteaya | thank you | 21:24 |
| fungi | looks like it wasn't in -3 or -4 anyway | 21:24 |
| *** sabeen1 has joined #openstack-infra | 21:24 | |
| anteaya | cool | 21:24 |
| *** Sukhdev has joined #openstack-infra | 21:24 | |
| *** smyers has quit IRC | 21:25 | |
| *** otter768 has joined #openstack-infra | 21:26 | |
| *** tiswanso has quit IRC | 21:27 | |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Restore neutron running tests when its own tests change https://review.openstack.org/212798 | 21:27 |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Restore neutron running tests when its own tests change https://review.openstack.org/212798 | 21:28 |
| *** sergmelikyan has quit IRC | 21:28 | |
| *** hdd has joined #openstack-infra | 21:29 | |
| *** sabeen3 has joined #openstack-infra | 21:29 | |
| *** alexsyip has joined #openstack-infra | 21:29 | |
| anteaya | dougwig: can you and ihar please co-ordinate here | 21:30 |
| anteaya | this is exactly what we have been discussing for the past 2 days | 21:30 |
| *** dewsday-WFB has quit IRC | 21:30 | |
| *** otter768 has quit IRC | 21:30 | |
| *** sabeen1 has quit IRC | 21:31 | |
| *** sergmelikyan has joined #openstack-infra | 21:31 | |
| dougwig | anteaya: right, this should not have been submitted while things were broken, and it's not correct to boot. i'll have to talk to him tomorrow, and he's offline already. | 21:31 |
| anteaya | got it and thank you | 21:31 |
| anteaya | sigh | 21:31 |
| *** dkranz has quit IRC | 21:32 | |
| fungi | dougwig: can you expand on what's not correct? is it that tempest tests are in-tree in neutron in one of the directories skipped by that filter set? | 21:32 |
| *** moravec has quit IRC | 21:33 | |
| dougwig | fungi: line 614 in the diff means that any change that modifies anything under neutron/tests does not run the api/fullstack/functional tests, even though those files definitely affect the output of those jobs. | 21:33 |
| dougwig | (and only under there, like the gate_hook change i just made for the api job, which did not itself run the api job.) erg. | 21:34 |
| fungi | dougwig: got it. i wonder if it was assumed that tree only included unit tests | 21:34 |
| *** tonytan4ever has joined #openstack-infra | 21:34 | |
| *** amitgandhinz has quit IRC | 21:34 | |
| fungi | dougwig: because i believe the intent of that part of the filter was to not run devstack-based tests when only unit tests were altered | 21:35 |
| fungi | dougwig: anyway, i'm in favor of reverting whatever's necessary there. i was not particularly a fan of the skip-if stuff to begin with because i was afraid it was going to cause necessary jobs to not be run under certain circumstances, and running a few extra unnecessary jobs on simple changes never seemed like a major waste | 21:36 |
| *** ajmiller has quit IRC | 21:37 | |
| dougwig | fungi: it's nice when it's quick, but you're right, the added complexity leads to more errors. as proven here. | 21:37 |
| *** sergmelikyan has quit IRC | 21:37 | |
| fungi | safer to run jobs you don't need than to miss those you do | 21:38 |
| *** puranamr has quit IRC | 21:39 | |
| *** erikmwilson_ has joined #openstack-infra | 21:40 | |
| *** ajmiller has joined #openstack-infra | 21:40 | |
| anteaya | jenkins is unhappy | 21:40 |
| anteaya | is there a spare : in there somewhere? | 21:40 |
| fungi | which jenkins? | 21:40 |
| anteaya | sorry | 21:40 |
| anteaya | on dougwig's patch | 21:41 |
| anteaya | sorry sorry | 21:41 |
| fungi | oh, hrm | 21:41 |
| dougwig | oh, a newline got inserted. | 21:41 |
| fungi | aha, yeppers | 21:41 |
| *** madhu_ak has quit IRC | 21:41 | |
| openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Restore neutron running tests when its own tests change https://review.openstack.org/212798 | 21:42 |
| *** tonytan4ever has quit IRC | 21:42 | |
| *** gyee has joined #openstack-infra | 21:42 | |
| *** tonytan4ever has joined #openstack-infra | 21:42 | |
| anteaya | dougwig: what is assaf talking about? | 21:42 |
| *** puranamr has joined #openstack-infra | 21:43 | |
| *** madhu_ak has joined #openstack-infra | 21:43 | |
| fungi | anteaya: he's providing an example of why that change is needed | 21:43 |
| anteaya | thank you | 21:43 |
| anteaya | sorry in a meeting as well | 21:43 |
| *** smyers has joined #openstack-infra | 21:44 | |
| *** erikwilson_ has quit IRC | 21:44 | |
| *** erikmwilson_ has quit IRC | 21:44 | |
| *** annegentle has quit IRC | 21:45 | |
| *** mriedem is now known as mriedem_away | 21:45 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 21:46 | |
| *** olaph has joined #openstack-infra | 21:46 | |
| *** tonytan4ever has quit IRC | 21:46 | |
| clarkb | fungi: pabelanger for the trystack DNS update that can't be a CNAME right? so I guess just an updated A record | 21:46 |
| dougwig | fungi, anteaya: thank you, sorry for yet another faux pas. | 21:47 |
| fungi | clarkb: both. address record for @ and then cname for www.@ | 21:47 |
| anteaya | dougwig: well thanks for being up on it | 21:47 |
| anteaya | dougwig: and yes it only supports the need to have some organization in neutron around infra interactions | 21:48 |
| anteaya | so that clear plans are executed | 21:48 |
| fungi | pabelanger: thinking about it, if www.trystack.org is also working in the wild, we may want it added to the serveraliases list | 21:48 |
| anteaya | and we know who our point person is for neutron | 21:48 |
| fungi | i haven't tested | 21:48 |
| *** hodos has quit IRC | 21:48 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Update FwaaS meeting cadence https://review.openstack.org/212723 | 21:49 |
| fungi | anteaya: i'm not 100% convinced it would have helped in this case. i think part of the problem is that the mechanism of filtering out jobs based on which files are being changed is a bit opaque and hard to reason about until you see the end result on a change which you forgot needed to be covered and now isn't | 21:49 |
| fungi | especially as job definition/configuration moves more and more into the projects being tested | 21:50 |
| *** hdd has quit IRC | 21:50 | |
| anteaya | fungi: fair enough | 21:50 |
| fungi | doubtful this issue would have been spotted in review | 21:51 |
| anteaya | the larger picture is that neutron vpnaas has been broken for 3 days or more | 21:51 |
| anteaya | and that dougwig and I and mtreinish and markmcclain have been reviewing the situation and trying to agree to a way forward | 21:51 |
| *** stevemar has quit IRC | 21:51 | |
| anteaya | offering a patch of this nature during this time when vpnaas testing is the priority is just ill timed | 21:52 |
| *** ivar-lazzaro has joined #openstack-infra | 21:52 | |
| anteaya | though the point about foresight given the current info is well taken | 21:52 |
| *** sharikapongubala has joined #openstack-infra | 21:53 | |
| *** FallenPegasus has quit IRC | 21:53 | |
| *** sharikapongubala has quit IRC | 21:55 | |
| *** sharikapongubala has joined #openstack-infra | 21:55 | |
| openstackgerrit | Merged openstack-infra/project-config: Restore neutron running tests when its own tests change https://review.openstack.org/212798 | 21:55 |
| fungi | sure, i get that timing was likely not great and coordination might have helped avoid making an existing bad situation worse | 21:56 |
| *** tlian2 has joined #openstack-infra | 21:56 | |
| anteaya | thanks that was my only point | 21:57 |
| anteaya | since we currently are stuck in the mud and dont' have clear agreement on how to get out | 21:57 |
| anteaya | still working on it though | 21:57 |
| clarkb | fungi: pabelanger one more dns question. trystack.o.o is actually static.o.o d we want to optimize the number of requests needed there and CNAME ot static or use trystack.o.o? | 21:57 |
| clarkb | for the www addr | 21:57 |
| *** puranamr has quit IRC | 21:58 | |
| jlvillal | Would these neutron vpnaas failures also affect oslo.messaging? In particular the check job 'gate-tempest-dsvm-neutron-src-oslo.messaging' ? | 21:58 |
| *** tlian has quit IRC | 21:59 | |
| anteaya | jlvillal: I dont' know | 21:59 |
| anteaya | dougwig: ^^ | 21:59 |
| dougwig | jlvillal: job link? | 21:59 |
| jlvillal | For example: https://review.openstack.org/#/q/project:openstack/oslo.messaging,n,z | 21:59 |
| jlvillal | dougwig, https://review.openstack.org/#/c/212643/ | 22:00 |
| *** baoli has joined #openstack-infra | 22:00 | |
| dougwig | jvrbanac: that doesn't look related. | 22:00 |
| jlvillal | dougwig, Okay. Thanks. I saw neutron mentioned, so I was hopeful :) | 22:01 |
| dougwig | jlvillal: you might've reduced me to real tears. :) | 22:02 |
| jeblair | fungi, anteaya: it turns out that eventbrite "only" saw a 1.07% drop in conversions on free events after instituting the required-account policy | 22:02 |
| anteaya | hehehe | 22:02 |
| *** tsg has quit IRC | 22:03 | |
| anteaya | jeblair: so they have convinced themselves to keep it | 22:03 |
| jeblair | fungi, anteaya: so, er, "we are the 1%"? | 22:03 |
| *** alexpilotti has joined #openstack-infra | 22:03 | |
| anteaya | jeblair: congratulations for remaining in the 1% | 22:03 |
| anteaya | ha ha ha | 22:03 |
| *** tsg has joined #openstack-infra | 22:03 | |
| jeblair | i've never been a 1%er before! | 22:03 |
| jeblair | it's, frankly, not at all what i was expecting. | 22:03 |
| anteaya | ha ha ha | 22:03 |
| anteaya | but you have a most excellent hat for it | 22:04 |
| *** armax has quit IRC | 22:04 | |
| *** morgan_302 has quit IRC | 22:04 | |
| jeblair | i don't think 1%ers wear hats, i think they have people to do that for them. | 22:05 |
| *** baoli has quit IRC | 22:05 | |
| anteaya | ah | 22:05 |
| anteaya | noone looks as good in your hat though | 22:05 |
| jlvillal | dougwig, :) | 22:06 |
| *** EricGonczer_ has quit IRC | 22:07 | |
| *** morganfainberg has joined #openstack-infra | 22:07 | |
| anteaya | I think I will eat some food and perhaps go for a walk | 22:07 |
| anteaya | someone willing to hold my cat? | 22:07 |
| *** dzamboni has quit IRC | 22:07 | |
| jeblair | anteaya: i would not give it to mordred. it may get wet. | 22:07 |
| anteaya | true | 22:07 |
| anteaya | and perhaps shaved for a worst cat photo | 22:07 |
| *** sharikapongubala has quit IRC | 22:08 | |
| * anteaya protects her cat from mordred | 22:08 | |
| *** sharikapongubala has joined #openstack-infra | 22:09 | |
| *** tsg has quit IRC | 22:10 | |
| *** sergmelikyan has joined #openstack-infra | 22:10 | |
| *** puranamr has joined #openstack-infra | 22:10 | |
| *** doug-fish has left #openstack-infra | 22:11 | |
| *** sdake has joined #openstack-infra | 22:12 | |
| *** gyee is now known as gyee_500 | 22:12 | |
| *** ayoung has joined #openstack-infra | 22:13 | |
| *** annegentle has joined #openstack-infra | 22:15 | |
| *** sdake_ has quit IRC | 22:16 | |
| *** tvanderwiel has joined #openstack-infra | 22:16 | |
| *** FallenPegasus has joined #openstack-infra | 22:17 | |
| *** tsg has joined #openstack-infra | 22:18 | |
| *** w_ has joined #openstack-infra | 22:18 | |
| *** sthillma has quit IRC | 22:18 | |
| *** sthillma has joined #openstack-infra | 22:19 | |
| *** puranamr has quit IRC | 22:19 | |
| *** bnemec has quit IRC | 22:20 | |
| *** olaph has quit IRC | 22:20 | |
| *** dimtruck is now known as zz_dimtruck | 22:21 | |
| clarkb | whats the difference between neutron lbaas and octavia? | 22:22 |
| *** regXboi has quit IRC | 22:22 | |
| clarkb | I probably don't want to know and should just +2 this change | 22:22 |
| clarkb | actually hrm, what do people think about trimming the PROJECTs list in d-g | 22:23 |
| rm_work | heh | 22:23 |
| rm_work | clarkb: Neutron-LBaaS is the end-user facing API for LBaaS | 22:23 |
| clarkb | then getting project specific tests to add to that list instead of d-g doing a blanket clone of all the things | 22:23 |
| rm_work | clarkb: Octavia is an OpenSource VM based Appliance that is one possible backend for Neutron-LBaaS | 22:23 |
| clarkb | rm_work: so neutron lbaas is not actually load balancer service and is purely an api? | 22:23 |
| dougwig | clarkb: i suggested using zuul-cloner in that review, and not expanding PROJECTS. | 22:23 |
| clarkb | that seems poorly named | 22:24 |
| rm_work | yes | 22:24 |
| rm_work | lol | 22:24 |
| rm_work | don't think about it too hard | 22:24 |
| dougwig | clarkb: octavia is a backend for neutron-lbaas (e.g. haproxy, f5, a10, octavia, radware, ...) | 22:24 |
| rm_work | yep | 22:24 |
| *** [HeOS] has joined #openstack-infra | 22:24 | |
| clarkb | dougwig: ya, we are finding there can be a relatively high cost to setting up those git repos even though we cache them | 22:24 |
| clarkb | dougwig: so reducing the amount we do it everywhere would be good | 22:24 |
| *** gordc has quit IRC | 22:25 | |
| clarkb | but this is sort of standard operating procedure today so happy to +2 then we can figure out a better way to do it independently | 22:25 |
| sdake | any chance an infra core could review two gate patches already reviewed and +2'ed by Andreas? https://review.openstack.org/#/c/212346/ | 22:25 |
| dougwig | clarkb: i figured that if it had a devstack plugin/, it shouldn't be in any hard-coded lists. but i don't know if we've gone that far yet. | 22:25 |
| clarkb | dougwig: the problem with the plugins is we tell devstack not to clone anything intentionally to ensure that your tests are testing what you want to test | 22:26 |
| clarkb | dougwig: so the plugin shouldn't clone things | 22:26 |
| clarkb | d-g should be doing it, we just don't need it to set up octavia for every test run | 22:26 |
| *** stevemar has joined #openstack-infra | 22:26 | |
| dougwig | clarkb: can PROJECTS be expanded in the job definition? | 22:26 |
| clarkb | dougwig: yes | 22:27 |
| clarkb | dougwig: I think thats what we should be doing but will take time | 22:27 |
| dougwig | clarkb: that might be better spot for non-global projects, then. | 22:27 |
| dougwig | be a better, i mean. | 22:27 |
| clarkb | yup | 22:27 |
| *** HeOS has quit IRC | 22:27 | |
| *** funzo has joined #openstack-infra | 22:30 | |
| *** julim has joined #openstack-infra | 22:32 | |
| clarkb | sdague has written a nice ansible in d-g cleanup at https://review.openstack.org/#/c/202494/ and mordred has another atop that that make things simpler too | 22:33 |
| *** sabeen3 has quit IRC | 22:33 | |
| clarkb | tl;dr reviewing those are worthwhile for code hygeine | 22:33 |
| *** jamielennox|away is now known as jamielennox | 22:33 | |
| clarkb | https://review.openstack.org/#/c/189316/ is another good one | 22:35 |
| *** funzo has quit IRC | 22:35 | |
| *** tvanderwiel has quit IRC | 22:35 | |
| *** gildub has joined #openstack-infra | 22:35 | |
| *** sergmelikyan has quit IRC | 22:36 | |
| *** puranamr has joined #openstack-infra | 22:38 | |
| *** akshai has quit IRC | 22:38 | |
| *** sdake_ has joined #openstack-infra | 22:42 | |
| *** eharney has quit IRC | 22:44 | |
| *** bhunter71 has quit IRC | 22:44 | |
| *** eharney has joined #openstack-infra | 22:44 | |
| *** jaypipes has quit IRC | 22:44 | |
| *** austin81 has left #openstack-infra | 22:45 | |
| openstackgerrit | Tim Buckley proposed openstack-infra/devstack-gate: Install and run StackViz during devstack-gate host cleanup. https://review.openstack.org/212207 | 22:45 |
| *** sdake has quit IRC | 22:46 | |
| *** annegentle has quit IRC | 22:46 | |
| *** sergmelikyan has joined #openstack-infra | 22:49 | |
| *** alexpilotti has quit IRC | 22:49 | |
| *** puranamr has quit IRC | 22:49 | |
| *** smyers has quit IRC | 22:50 | |
| *** zz_dimtruck is now known as dimtruck | 22:52 | |
| *** puranamr has joined #openstack-infra | 22:52 | |
| *** sabeen has joined #openstack-infra | 22:57 | |
| *** morganfainberg is now known as morgan_404 | 22:57 | |
| *** earlephilhower has quit IRC | 22:59 | |
| *** woodster_ has quit IRC | 23:00 | |
| *** tsg has quit IRC | 23:00 | |
| *** FallenPegasus is now known as MarkAtwood | 23:02 | |
| *** ivar-lazzaro has quit IRC | 23:03 | |
| *** dimtruck is now known as zz_dimtruck | 23:04 | |
| *** sharikapongubala has quit IRC | 23:04 | |
| *** thiagop has quit IRC | 23:06 | |
| *** ayoung has quit IRC | 23:07 | |
| *** wenlock has quit IRC | 23:08 | |
| *** prad_ has quit IRC | 23:08 | |
| jeblair | anteaya, fungi: updated https://etherpad.openstack.org/p/chYVrjmmZ8 | 23:11 |
| *** minwang2 has quit IRC | 23:12 | |
| *** fbo_ has quit IRC | 23:12 | |
| *** minwang2 has joined #openstack-infra | 23:13 | |
| clarkb | is anyone here familiar with killing the iso8601 debug logs? hoping I can get a head start in fixing that for nodepoo | 23:14 |
| *** fbo has joined #openstack-infra | 23:15 | |
| *** sergmelikyan has quit IRC | 23:15 | |
| greghaynes | good ol nodepoo | 23:16 |
| clarkb | I expected someone to comment on that :) | 23:17 |
| clarkb | its organic grass fed nodepoo too | 23:17 |
| greghaynes | best kind | 23:17 |
| *** jamielennox is now known as jamielennox|away | 23:18 | |
| *** stevemar has quit IRC | 23:20 | |
| *** stevemar has joined #openstack-infra | 23:21 | |
| *** zz_dimtruck is now known as dimtruck | 23:22 | |
| *** geoffarnold has quit IRC | 23:22 | |
| jeblair | clarkb: let me know what you think of my comment in https://review.openstack.org/#/c/202494/ | 23:22 |
| anteaya | the flowers that grow from our nodepoo | 23:23 |
| clarkb | dougwig: for the advanced services and mysql driver situation we have https://review.openstack.org/#/c/199672/ https://review.openstack.org/#/c/212464/ and https://review.openstack.org/#/c/205473/ that are all related, I know you are looking into that stuff do you have enough info now to determine which of those we want now (if any) and which we need long term? | 23:23 |
| StevenK | clarkb: Can I get you to log into translate-dev and pastebin /var/log/register-zanata-projects.log if it in fact contains anything ? | 23:23 |
| *** stevemar has quit IRC | 23:24 | |
| clarkb | jeblair: good point particularly for projects using ansible for other purposes | 23:24 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: jenkins/scripts/copy_puppet_logs: fix typo https://review.openstack.org/212835 | 23:24 |
| *** Sukhdev has quit IRC | 23:24 | |
| jeblair | clarkb: also, asked a question in https://review.openstack.org/202566 which you may know the answer to | 23:24 |
| *** olaph has joined #openstack-infra | 23:25 | |
| clarkb | jeblair: ah yup I asked mordred that too and he says that ansibles -U flag runs sudo with -H | 23:25 |
| jeblair | i'm going to paste that into the change :) | 23:25 |
| clarkb | StevenK: yes doing now | 23:26 |
| *** w_ has quit IRC | 23:26 | |
| clarkb | StevenK: its empty | 23:26 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-project_config: Add Gemfile and puppet 4 checks https://review.openstack.org/212837 | 23:26 |
| *** otter768 has joined #openstack-infra | 23:27 | |
| StevenK | clarkb: Hum. Do those logs go anywhere, or do they stay put on the machine itself? | 23:28 |
| mordred | clarkb, jeblair: yes | 23:28 |
| clarkb | StevenK: they stay on the machine | 23:28 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-puppet: Fix Gemfile https://review.openstack.org/212840 | 23:28 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: puppet: enable copy_logs publisher for beaker-rspec-dsvm jobs https://review.openstack.org/212841 | 23:29 |
| *** dannywilson has quit IRC | 23:29 | |
| EmilienM | crinkle: I might want your eye on ^ | 23:29 |
| StevenK | clarkb: /home/wildfly/projects.yaml exists, right? | 23:29 |
| clarkb | StevenK: yes | 23:29 |
| anteaya | jeblair: a further question/suggestion on point 4 of the etherpad | 23:29 |
| StevenK | log.info("Registering projects in Zanata") | 23:30 |
| StevenK | :-( | 23:30 |
| clarkb | maybe it hasn't run yet? | 23:30 |
| clarkb | it should fire on every change to that file though iirc | 23:31 |
| jeblair | anteaya: i think we're planning on generating the patches ourselves, probably automatically, so we should have a fairly quick turnaround time. i'm okay with adding a freeze period in there, though i'm not certain it needs to be 7 days. | 23:31 |
| anteaya | fair enough | 23:31 |
| jeblair | also, possibly 'patch' rather than 'patches' | 23:31 |
| StevenK | It landed a while back, and I think projects.yaml has changed since then | 23:31 |
| anteaya | yup | 23:31 |
| *** otter768 has quit IRC | 23:31 | |
| clarkb | StevenK: ya it has | 23:32 |
| anteaya | you are picturing one giant patch? | 23:32 |
| *** krtaylor has quit IRC | 23:32 | |
| StevenK | clarkb: It might be a logging bug in register-zanata-projects, I will have a play around when I get to the office. | 23:32 |
| *** geoffarnold has joined #openstack-infra | 23:32 | |
| *** dimtruck is now known as zz_dimtruck | 23:32 | |
| clarkb | StevenK: ok, let me know if I can do any other debugging (can run manually on host too or trigger puppet) | 23:32 |
| anteaya | but some time period beyond which respondants have missed the train | 23:32 |
| jeblair | anteaya: maybe i can put something like 'we will freeze the list as well as new project creation several days before' | 23:32 |
| *** eharney has quit IRC | 23:32 | |
| anteaya | sure I can live with that | 23:32 |
| jeblair | and we can decide on the exact freeze date later | 23:33 |
| StevenK | clarkb: Run it manually, it should do nothing, but at least log a few things | 23:33 |
| anteaya | yup | 23:33 |
| jeblair | depending on how complex the process actually looks | 23:33 |
| anteaya | several days for me gives us a minimum of 3 days | 23:33 |
| anteaya | and more if required | 23:33 |
| EmilienM | I have two project-config review requests for puppet modules: https://review.openstack.org/#/c/212835 and https://review.openstack.org/#/c/212841 - thanks folks! | 23:35 |
| *** sergmelikyan has joined #openstack-infra | 23:38 | |
| *** hdd has joined #openstack-infra | 23:39 | |
| *** thorst has joined #openstack-infra | 23:43 | |
| clarkb | its almost 5pm already where did the day go | 23:44 |
| *** Sukhdev has joined #openstack-infra | 23:44 | |
| *** Alexandra_ has joined #openstack-infra | 23:44 | |
| *** tsg has joined #openstack-infra | 23:44 | |
| *** krtaylor has joined #openstack-infra | 23:45 | |
| clarkb | anteaya: prophetstor CI claims to have fixed their issues, we ask them to get the projects they comment on to ok them being reenabled? | 23:45 |
| clarkb | thingee: ^ I think thats you | 23:45 |
| *** Alexandra_ has quit IRC | 23:45 | |
| *** Alexandra_ has joined #openstack-infra | 23:46 | |
| *** jamielennox|away is now known as jamielennox | 23:47 | |
| *** julim has quit IRC | 23:47 | |
| *** Alexandra_ is now known as dewsday | 23:49 | |
| anteaya | clarkb: yes until thingee says re-enable prophetstor CI I'm sitting on my hands | 23:50 |
| clarkb | anteaya: danke | 23:50 |
| anteaya | this person rick___ has been in -cinder many days | 23:50 |
| anteaya | never when thingee is available | 23:50 |
| *** fawadkhaliq has quit IRC | 23:50 | |
| anteaya | and never in appreciation of what he is being told or what is going on | 23:50 |
| anteaya | so thanks for asking | 23:50 |
| anteaya | and I wish I had a better answer | 23:50 |
| *** markvoelker has quit IRC | 23:50 | |
| anteaya | with ponies and rainbows | 23:51 |
| anteaya | :( | 23:51 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-redis: Fix template variables https://review.openstack.org/212849 | 23:52 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-redis: Add Gemfile and puppet 4 checks https://review.openstack.org/212850 | 23:52 |
| thingee | anteaya, clarkb lol, Rick from prophetstor emailed the openstack list to get my attention | 23:53 |
| anteaya | thingee: yes | 23:53 |
| anteaya | I saw that in channel | 23:53 |
| anteaya | he kept showing up after everyone was offline | 23:53 |
| *** zz_dimtruck is now known as dimtruck | 23:54 | |
| anteaya | thingee: what do you want us to do here | 23:54 |
| anteaya | if anything | 23:54 |
| thingee | anteaya: wait, I can't even find their email in the openstack mailing list. | 23:54 |
| thingee | anteaya: even though rick said he sent it there | 23:55 |
| clarkb | thingee: they sent to the infra list | 23:55 |
| clarkb | thats where I saw it at least | 23:55 |
| anteaya | yeah infra list | 23:56 |
| thingee | ugh ok | 23:56 |
| openstackgerrit | Colleen Murphy proposed openstack-infra/puppet-refstack: Add Gemfile and puppet 4 checks https://review.openstack.org/212852 | 23:57 |
| anteaya | and can I just say asselin is wonderful at replying to ci emails | 23:57 |
| anteaya | thank you asselin: http://lists.openstack.org/pipermail/openstack-dev/2015-August/072020.html | 23:58 |
| asselin | anteaya, thanks. I don't subscribe to infra list | 23:58 |
| *** julim has joined #openstack-infra | 23:58 | |
| *** laughterwym has joined #openstack-infra | 23:59 | |
| anteaya | http://lists.openstack.org/pipermail/openstack-infra/2015-August/003050.html | 23:59 |
| anteaya | so you can follow along | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!