Friday, 2016-03-25

jeblair(sorry, i have to run soon)00:00
clarkbyou can determine the name of the branch a commit is on. I think the tarball jobs work that way00:00
jeblairinfra-root: i'll be afk for much of tomorrow00:00
pleia2jeblair: thanks for the heads up00:00
clarkbsounds like everyone else will be too :)00:00
jeblairwell, i was on duty last friday :P00:01
pleia2I'll be here00:01
jrolljeblair: yeah, that makes sense, I'll try to figure it out, curious what to do about the files bits but I can probably dig it up00:01
jrollthanks00:01
*** eil397 has quit IRC00:01
pvaneckjeblair: mind revisiting this real quick? https://review.openstack.org/#/c/281737/00:01
pleia2and the cadbury creme eggs in the kitchen don't mean I have a holiday on Sunday, so I'll be aroundish then too00:01
pleia2(I just really like sugar)00:01
*** salv-orlando has joined #openstack-infra00:02
tonybdid etherpad.o.o restart/die ?00:03
jrollmuahaha, found it00:03
clarkbtonyb: daily db backups00:03
*** esikachev has quit IRC00:03
*** EricGonczer_ has quit IRC00:03
tonybclarkb: okay.00:03
clarkbjroll: shouldnt that image be branchless though00:03
pleia2fungi: congratulations! http://civs.cs.cornell.edu/cgi-bin/results.pl?id=E_d534a4a1b583069c00:03
clarkbjroll: seems odd to need a specific image for different brnaches00:03
*** sheeprine has quit IRC00:03
tonybclarkb: roughly how long do they take .... we were just finaising the election ...00:03
pleia2(thank goodness)00:04
clarkbtonyb: 5 minutes or so00:04
jrollclarkb: that project has stable branches00:04
clarkbshould be back in a minute or two00:04
tonybclarkb: cool00:04
tonybpleia2: is very diligent ;P00:04
pleia2:D00:04
jrollclarkb: we've kept master working with all branches of ironic, historically, but it also means we don't test the stable IPA version on stable ironic patches00:04
pleia2tonyb: thanks for your work00:04
clarkbjroll: ah so this is more about making sure old versions keep working00:05
*** salv-orl_ has quit IRC00:05
*** akshai has joined #openstack-infra00:05
jrollclarkb: ya00:05
tonybpleia2: You're welcome.00:06
*** akshai_ has joined #openstack-infra00:06
*** fawadkhaliq has quit IRC00:07
*** fawadkhaliq has joined #openstack-infra00:07
openstackgerritEmilien Macchi proposed openstack-infra/project-config: WIP - release puppet-aodh in tarball  https://review.openstack.org/29746900:09
clarkbbah fedora-23 appears affected by the iptables thing too00:10
clarkbI am going to revert that change00:10
anteaya:(00:10
*** akshai has quit IRC00:10
*** sridhar_ram has quit IRC00:10
*** sheeprine has joined #openstack-infra00:10
clarkbsorry rabbitmq00:10
clarkbbut ya00:10
EmilienMI'm not an expert of OpenStack tarballs, if anyone is, please look at https://review.openstack.org/#/c/297469/00:11
openstackgerritClark Boylan proposed openstack-infra/project-config: Revert "Allow test slaves to talk to themselves"  https://review.openstack.org/29747100:12
EmilienMthat is a first experimentation of having puppet modules tarballs00:12
anteayajroll: ack00:12
clarkbpabelanger: mordred fungi jroll pleia2 anteaya ^00:12
anteayajroll: enjoy easter00:12
anteayafungi pleia2 thanks to both of you for giving us an election!00:13
anteayathings were getting boring in infra, thanks for the excitement :)00:13
clarkbEmilienM: will puppet module build do the right thing for versions?00:13
EmilienMclarkb: they should be00:13
clarkbEmilienM: thats the only thing I would check if I were you, so that when you make your second release the first one isn't overwritten00:14
clarkbotherwise this lgtm00:14
jrollanteaya: ?00:14
anteayajroll: see pleia2's link to cvis results above00:15
anteayacivs00:15
anteayaclarkb: can you put a comment on https://review.openstack.org/#/c/296707/ saying you are reverting?00:15
anteayaand yay cadbury's00:15
EmilienMin my first implementation, the tarball will be overwritten everytime00:15
EmilienMI need to investigate that00:16
clarkbanteaya: done00:16
jrollanteaya: I guess I don't know why you said ack to me, maybe a mis-ping :)00:16
*** ihrachys has quit IRC00:16
*** rfolco_ has joined #openstack-infra00:16
anteayaclarkb: thanks00:17
anteayajroll: did I ack you?00:17
anteayaI did so00:17
clarkbI think anteaya meant jeblair00:17
jrollanteaya: yeah, no worries if unintentional00:17
clarkbbut that tab key is trick00:17
clarkby00:17
jrollpossible00:17
anteayajroll: you are just one of those people who are always in my life, I think of you as always around00:17
EmilienMclarkb: but when is produced the release tarball (not master) ? when creating the tag?00:17
jrolljust making sure I wasn't missing something00:17
jrollanteaya: heh, glad to hear it00:17
anteaya:)00:18
*** rfolco_ has quit IRC00:18
anteayaand yeah I think I mis-tabbed and meant jeblair00:18
clarkbEmilienM: yes prerelease and release happen on tags00:18
EmilienMclarkb: and master?00:20
*** sdake_ has joined #openstack-infra00:20
*** achanda has joined #openstack-infra00:20
clarkbEmilienM: you want a new tarball on every merge to master?00:20
clarkbEmilienM: you want the branch tarball jobs for that and they run in post00:20
EmilienMclarkb: yeah, like http://tarballs.openstack.org/aodh/00:21
EmilienMprerelease and release are periodics?00:21
clarkbEmilienM: no they run when tags are made00:21
EmilienMok00:21
clarkbso you want both the branch tarball job and the {name}-tarball job00:22
*** sdake has quit IRC00:22
EmilienMok00:22
*** achanda has quit IRC00:23
*** SumitNaiksatam has quit IRC00:26
*** clsacramento has quit IRC00:26
anteayaI think I have successfully figured out how to get kibana to never stop loading00:26
anteayawooo, the endless loop00:26
pleia2anteaya: oh dear00:26
tonybanteaya: message:fu as oppsed to message:"fu" will do it00:27
anteayaawesome00:27
tonybI'm supposed to be on vacation ! /me bails00:27
anteayatonyb: ah sorry no I have kibana4 on a vm, trying to figure out how to hide the button that leads to breaking the config00:27
openstackgerritEmilien Macchi proposed openstack-infra/project-config: WIP - release puppet-aodh in tarball  https://review.openstack.org/29746900:27
anteayatonyb: go, vacate00:27
anteayatonyb: have a good easter00:28
EmilienMclarkb: I updated, to use only post for now, and only master.00:28
tonybanteaya: thanks.00:28
anteaya:)00:28
tonybanteaya: sadly it is a vacation *with* laptop :/00:29
*** clsacramento has joined #openstack-infra00:29
anteayano no00:30
anteayaredefine it00:30
openstackgerritEmilien Macchi proposed openstack-infra/project-config: publish puppet-aodh in tarball for master  https://review.openstack.org/29746900:30
anteayathe rpm election could have gone either way00:31
anteayaan electorate of 500:31
openstackgerritJim Rollenhagen proposed openstack-infra/project-config: Refactor IPA post jobs to handle branches  https://review.openstack.org/29747400:33
*** nadya has joined #openstack-infra00:34
openstackgerritwatanabe isao proposed openstack-infra/devstack-gate: Remove unnecessary doubled configuration in local.conf  https://review.openstack.org/29747500:34
openstackgerritJim Rollenhagen proposed openstack-infra/project-config: Give ironic tempest-full job more "bare metal"  https://review.openstack.org/29747600:35
jrolljeblair: mgagne: if you're curious, 297474 is what I ended up with00:35
openstackgerritwatanabe isao proposed openstack-infra/devstack-gate: Remove doubled configuration in local.conf  https://review.openstack.org/29747500:37
anteayawell I'm finding out how to break kibana in various ways00:37
anteayayou'd think removing a button would be a simple process00:38
anteaya/** button */ done00:38
*** fawadkhaliq has quit IRC00:38
*** fawadkhaliq has joined #openstack-infra00:39
*** nadya has quit IRC00:39
anteayaclarkb: this might be the entire section of the source code that addresses the advanced features: https://github.com/elastic/kibana/tree/4.1/src/kibana/plugins/settings/sections/advanced00:41
*** salv-orlando has quit IRC00:42
anteayaI could set the value of all the buttons to cancelEdit: ng-click="cancelEdit(conf)"00:42
anteayathat would be fun00:43
*** wfoster has quit IRC00:43
*** pvaneck has quit IRC00:43
anteayahttps://github.com/elastic/kibana/blob/4.1/src/kibana/plugins/settings/sections/advanced/advanced_row.html00:44
*** bpokorny_ has joined #openstack-infra00:44
*** flaper87 has quit IRC00:45
*** wfoster has joined #openstack-infra00:45
*** Qiming has joined #openstack-infra00:46
*** flaper87 has joined #openstack-infra00:46
*** bpokorny has quit IRC00:47
*** fawadkhaliq has quit IRC00:47
*** fawadkhaliq has joined #openstack-infra00:48
*** bpokorny_ has quit IRC00:48
*** knikolla has quit IRC00:50
*** gongysh_ has joined #openstack-infra00:51
*** amitgandhinz has joined #openstack-infra00:53
anteayakibana doesn't seem to have logs in /var/log00:54
*** fawadkhaliq has quit IRC00:54
anteayaI'm not sure where to look to see if changing things in the advanced settings changes things in the kibana config00:54
*** IlyaG has joined #openstack-infra00:55
anteayaI think I'm going to back it in and come back to this00:55
anteayapack it in00:55
anteayaI'm around tomorrow on and off00:57
*** apoorvad has quit IRC00:58
*** zhurong has joined #openstack-infra01:00
wznoinskhi all01:02
anteayamost folks are doing evening things01:04
timrcpleia2: You'll make a fine PTL.  It's cool that infra has a pool of really awesome people to draw from01:05
timrcEr You'd01:06
anteayano I think you'll is correct here01:06
anteayajust a matter of time01:06
Clintpreordained01:06
timrcanteaya: Right, that's hat I mean.01:06
timrcwhat*01:06
timrcI fail at typing.01:06
anteayaso much typing01:07
anteayabound to have some words not work as planned01:07
pleia2timrc: thank you, the thoughts I had in my nomination doc are things I can do without being PTL too, so I'll get to work on them :)01:07
anteaya:)01:12
*** amitgandhinz has quit IRC01:12
*** achanda has joined #openstack-infra01:12
*** Sukhdev has quit IRC01:12
anteayahere is what I did to set up an elasticsearch and a kibana on a vm: http://paste.openstack.org/show/491835/01:12
anteayain case anyone else wants to do it too01:12
*** EricGonczer_ has joined #openstack-infra01:12
anteayathe point is to remove access to the advanced features which we can't allow folks to have access to lest they take out our instance01:13
*** asettle has joined #openstack-infra01:15
*** angdraug has quit IRC01:20
*** asettle has quit IRC01:20
*** piet has joined #openstack-infra01:26
*** sdake_ has quit IRC01:27
mriedemanyone know why the stable/mitaka grenade runs for neutron would be trying to upgrade from kilo starting today? http://logs.openstack.org/27/297127/1/check/gate-grenade-dsvm-neutron/7d5ed7b/logs/grenade_localrc.txt.gz01:27
mriedemdims: ^01:27
mriedemi believe the stable/mitaka branch was created for grenade today01:27
*** Daisy has joined #openstack-infra01:28
mriedemthis was a good run yesterday, going from liberty to master (which was mitaka) http://logs.openstack.org/30/296630/1/check/gate-grenade-dsvm-neutron/6ba12a8/logs/grenade_localrc.txt.gz01:28
clarkbmaybe we copy pasta failed01:28
mriedemnow today it's going from stable/kilo to stable/mitaka http://logs.openstack.org/27/297127/1/check/gate-grenade-dsvm-neutron/7d5ed7b/logs/grenade_localrc.txt.gz01:28
mriedemthe job config in project-config looks normal01:28
clarkbyup01:28
armaxhttps://github.com/openstack-infra/devstack-gate/commit/be06eea9ec7d2b947373e9209f353e11da4e2d1101:28
armaxfound it01:28
clarkbbad copy pasta01:28
armaxthat kilo there01:28
armaxstinks01:29
*** fawadkhaliq has joined #openstack-infra01:29
armax;)01:29
clarkbif someone pushes a fix I can approve01:29
armaxI am on it01:29
*** Daisy_ has joined #openstack-infra01:29
*** sputnik13 has quit IRC01:29
mriedemhttp://logs.openstack.org/27/297127/1/check/gate-grenade-dsvm-neutron/7d5ed7b/logs/devstack-gate-setup-workspace-old.txt.gz#_2016-03-24_20_30_48_71201:30
*** Daisy_ has quit IRC01:30
*** Daisy_ has joined #openstack-infra01:30
mriedemdirty ol' diggity dauge01:31
armaxI wonder why this is hitting neutron only01:31
armaxI mean we suck, but still01:31
mriedemarmax: i'm assuming the regular job would be busted too01:32
*** Daisy_ has quit IRC01:32
armaxmriedem: on nova?01:32
*** Daisy has quit IRC01:32
mriedemi just don't think nova had anything on stable/mitaka between the time that was made and now01:32
mriedemwe had something land early this morning and that was it01:32
armaxmaybe01:32
openstackgerritArmando Migliaccio proposed openstack-infra/devstack-gate: Use the right stable branch  https://review.openstack.org/29748201:32
*** Daisy has joined #openstack-infra01:32
armaxclarkb: let’s be extra careful I got it right!01:33
armaxI would think so01:33
armaxbut one might never know01:33
clarkbya lgtm01:33
mriedemarmax: only other thing would maybe be if it's a pullup job for neutron and forward for nova01:34
armaxclarkb: thanks a lot!01:34
armaxmriedem: thank you too!01:34
armaxmriedem: I would have never suspected a busted copy and paste01:34
armaxI was already going down the rabbit hole01:35
mriedemgate-grenade-dsvm is all pullup01:35
mriedemarmax: np01:35
armaxmriedem: I am afraid I am not familar with the nomenclature01:35
armaxpullup as in children underpants?01:36
mriedemha, no01:36
mriedemsec01:36
mriedemhttps://github.com/openstack-infra/devstack-gate/blob/be06eea9ec7d2b947373e9209f353e11da4e2d11/devstack-vm-gate-wrap.sh#L29001:36
mriedemhttps://github.com/openstack-infra/devstack-gate/blob/be06eea9ec7d2b947373e9209f353e11da4e2d11/devstack-vm-gate-wrap.sh#L25801:37
mriedemalthough, in this case, it's apt01:37
armaxI see01:37
armaxthanks01:37
mriedemclarkb: thanks01:40
armaxmriedem: I wonder what happened if the upgrade from kilo to mitaka would have worked!01:40
mriedemlots of ops people would be cheering01:40
armax:)01:40
*** mriedem has quit IRC01:42
*** yamamoto_ has joined #openstack-infra01:45
*** piet has quit IRC01:45
*** Daisy has quit IRC01:45
*** Daisy has joined #openstack-infra01:45
*** yamahata has joined #openstack-infra01:49
*** Daisy has quit IRC01:50
*** Swami_ has joined #openstack-infra01:53
*** amitgandhinz has joined #openstack-infra01:57
*** Swami__ has quit IRC01:57
dimsclarkb : thanks! looks like you all figured out the kilo->mitaka upgrade issue01:58
openstackgerritMerged openstack-infra/project-config: fix stable acls for keystoneauth repository  https://review.openstack.org/29718201:58
*** tphummel has quit IRC01:59
*** EricGonczer_ has quit IRC01:59
*** esikachev has joined #openstack-infra02:00
*** yamamoto_ has quit IRC02:01
*** yamamoto_ has joined #openstack-infra02:02
*** esikachev has quit IRC02:04
*** persia has quit IRC02:06
*** dtantsur has quit IRC02:06
*** dtantsur has joined #openstack-infra02:06
*** mescanef has quit IRC02:06
*** dtantsur has quit IRC02:06
*** dtantsur has joined #openstack-infra02:06
*** mescanef has joined #openstack-infra02:06
*** yamahata has quit IRC02:06
*** woodster_ has quit IRC02:07
*** thorst has quit IRC02:07
fungipleia2: interested in a ptl co-op? i have one available at a low, low price ;)02:07
*** yamahata has joined #openstack-infra02:07
*** thorst has joined #openstack-infra02:07
*** persia has joined #openstack-infra02:09
*** amitgandhinz has quit IRC02:10
*** Daisy has joined #openstack-infra02:12
fungialso, so proud that infra has had an election now for the first time EVER02:14
fungiyou can't know that your governance is working unless you exercise it02:14
*** thorst has quit IRC02:16
*** SumitNaiksatam has joined #openstack-infra02:18
*** edmondsw has quit IRC02:22
openstackgerritMerged openstack-infra/project-config: Add multinode instances to rax  https://review.openstack.org/29727302:26
*** tphummel has joined #openstack-infra02:26
*** piet has joined #openstack-infra02:26
*** amrith is now known as _amrith_02:42
*** EricGonczer_ has joined #openstack-infra02:47
*** yamamoto_ has quit IRC02:49
*** gyee has quit IRC02:53
*** EricGonczer_ has quit IRC02:57
*** salv-orlando has joined #openstack-infra03:01
*** fawadkhaliq has quit IRC03:03
*** amitgandhinz has joined #openstack-infra03:07
*** rkukura has quit IRC03:07
*** sdake has joined #openstack-infra03:07
*** pfallenop has quit IRC03:08
*** pfallenop has joined #openstack-infra03:08
*** sambetts|afk has quit IRC03:11
*** chlong has quit IRC03:12
*** harlowja_at_home has quit IRC03:12
*** binbincong has quit IRC03:12
*** binbincong has joined #openstack-infra03:12
*** harlowja_at_home has joined #openstack-infra03:12
*** sambetts has joined #openstack-infra03:12
*** thorst has joined #openstack-infra03:14
*** fawadkhaliq has joined #openstack-infra03:14
*** chlong has joined #openstack-infra03:14
*** achanda has quit IRC03:15
*** amitgandhinz has quit IRC03:20
*** salv-orlando has quit IRC03:21
*** thorst has quit IRC03:21
*** roxanaghe has joined #openstack-infra03:25
*** fedexo has joined #openstack-infra03:27
*** ajmiller has joined #openstack-infra03:31
*** salv-orlando has joined #openstack-infra03:32
*** yuanying_ has joined #openstack-infra03:35
*** yuanying has quit IRC03:37
*** salv-orlando has quit IRC03:37
*** gongysh_ has quit IRC03:38
*** yuanying has joined #openstack-infra03:38
*** roxanaghe has quit IRC03:40
*** yuanyin__ has joined #openstack-infra03:40
*** yuanying_ has quit IRC03:40
*** roxanaghe has joined #openstack-infra03:41
*** Douhet has quit IRC03:42
*** salv-orlando has joined #openstack-infra03:43
*** yuanying has quit IRC03:43
*** yamamoto has joined #openstack-infra03:44
*** hichihara has joined #openstack-infra03:45
*** Nikolay_St has joined #openstack-infra03:46
*** ajmiller_ has joined #openstack-infra03:46
*** amitgandhinz has joined #openstack-infra03:47
*** salv-orlando has quit IRC03:47
*** yuanyin__ has quit IRC03:49
*** ajmiller has quit IRC03:49
*** yuanying has joined #openstack-infra03:51
*** gongysh has joined #openstack-infra03:52
openstackgerritMerged openstack-infra/devstack-gate: Use the right stable branch  https://review.openstack.org/29748203:55
*** gongysh has quit IRC03:56
*** yuanying has quit IRC03:59
*** esikachev has joined #openstack-infra04:00
*** amitgandhinz has quit IRC04:01
*** links has joined #openstack-infra04:01
*** yuanying has joined #openstack-infra04:02
*** esikachev has quit IRC04:05
*** yuanying has quit IRC04:07
*** Daisy has quit IRC04:09
*** Daisy has joined #openstack-infra04:10
*** Daisy has quit IRC04:18
*** achanda has joined #openstack-infra04:18
*** thorst has joined #openstack-infra04:19
*** gongysh has joined #openstack-infra04:22
*** treaki_ has joined #openstack-infra04:23
*** treaki__ has quit IRC04:24
*** thorst has quit IRC04:25
*** ajmiller_ has quit IRC04:28
*** Sukhdev has joined #openstack-infra04:29
*** IlyaG has quit IRC04:30
*** tphummel has quit IRC04:32
*** vgridnev has joined #openstack-infra04:33
*** jerryz has quit IRC04:33
*** rossella_s has quit IRC04:34
*** rossella_s has joined #openstack-infra04:35
*** asettle has joined #openstack-infra04:44
*** moravec has quit IRC04:45
*** Nikolay_St has quit IRC04:46
*** salv-orlando has joined #openstack-infra04:46
*** salv-orlando has quit IRC04:53
*** amitgandhinz has joined #openstack-infra04:57
*** Daisy has joined #openstack-infra04:57
*** salv-orlando has joined #openstack-infra05:04
*** salv-orlando has quit IRC05:08
*** amitgandhinz has quit IRC05:11
*** gongysh has quit IRC05:12
*** piet has quit IRC05:13
*** Daisy has quit IRC05:13
*** Daisy has joined #openstack-infra05:14
*** nikhil has quit IRC05:16
*** Daisy has quit IRC05:18
*** nikhil has joined #openstack-infra05:21
*** thorst has joined #openstack-infra05:24
*** Swami_ has quit IRC05:24
*** akshai_ has quit IRC05:25
*** Daisy has joined #openstack-infra05:29
*** thorst has quit IRC05:31
*** roxanaghe has quit IRC05:32
*** nadya has joined #openstack-infra05:32
*** roxanaghe has joined #openstack-infra05:36
*** binbincong has quit IRC05:38
*** Jeffrey4l has joined #openstack-infra05:39
*** Daisy has quit IRC05:41
*** Daisy has joined #openstack-infra05:41
*** nikil89_ has joined #openstack-infra05:42
*** nikil89_ is now known as naggappan05:42
*** links has quit IRC05:43
*** tphummel has joined #openstack-infra05:46
*** vgridnev has quit IRC05:47
*** roxanaghe has quit IRC05:47
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql: Update TODO.rst to point the StoryBoard  https://review.openstack.org/29752105:47
*** sdake has quit IRC05:50
*** binbincong has joined #openstack-infra05:51
*** gongysh has joined #openstack-infra05:54
*** |-paul-| has quit IRC05:57
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql: Add pypi and resource links to README.rst  https://review.openstack.org/29752405:59
*** cody-somerville has quit IRC06:00
*** tphummel has quit IRC06:00
*** cody-somerville has joined #openstack-infra06:00
*** cody-somerville has quit IRC06:00
*** cody-somerville has joined #openstack-infra06:00
*** yamahata has quit IRC06:04
*** fedexo has quit IRC06:04
*** yamahata has joined #openstack-infra06:06
*** amitgandhinz has joined #openstack-infra06:07
*** amotoki has joined #openstack-infra06:11
*** Daisy_ has joined #openstack-infra06:16
*** Daisy has quit IRC06:19
*** amitgandhinz has quit IRC06:21
openstackgerritwatanabe isao proposed openstack-infra/devstack-gate: Let BUILD_TIMEOUT in Ironic local.conf configurable  https://review.openstack.org/29753106:22
openstackgerritMerged openstack-infra/project-config: Revert "Allow test slaves to talk to themselves"  https://review.openstack.org/29747106:29
*** thorst has joined #openstack-infra06:29
*** salv-orlando has joined #openstack-infra06:31
*** salv-orlando has quit IRC06:34
*** thorst has quit IRC06:36
openstackgerritOpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/28884906:42
*** chlong has quit IRC06:45
*** yuanying has joined #openstack-infra06:46
*** salv-orlando has joined #openstack-infra06:52
*** nadya has quit IRC06:55
openstackgerritJane.zhang proposed openstack/diskimage-builder: Set tgtd not auto-start on OS boot time.  https://review.openstack.org/29754806:55
*** IlyaG has joined #openstack-infra06:56
*** sputnik13 has joined #openstack-infra06:58
*** skraynev has quit IRC06:59
*** salv-orlando has quit IRC06:59
*** IlyaG has quit IRC07:00
*** hichihara has quit IRC07:03
*** gongysh has quit IRC07:03
*** Nikolay_St has joined #openstack-infra07:06
*** e0ne has joined #openstack-infra07:06
*** gongysh has joined #openstack-infra07:13
*** e0ne has quit IRC07:15
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Make job networking-generic-switch-dsvm voting  https://review.openstack.org/29721807:15
*** amitgandhinz has joined #openstack-infra07:17
*** fawadkhaliq has quit IRC07:17
*** amitgandhinz has quit IRC07:22
*** kzaitsev_mb has joined #openstack-infra07:30
*** lezbar has joined #openstack-infra07:32
*** thorst has joined #openstack-infra07:33
*** pcaruana has joined #openstack-infra07:38
*** imcsk8_ has joined #openstack-infra07:40
*** thorst has quit IRC07:41
*** imcsk8 has quit IRC07:42
*** taron has quit IRC07:42
*** taron has joined #openstack-infra07:44
*** Sukhdev has quit IRC07:46
*** akaszuba has joined #openstack-infra07:48
*** Daisy_ has quit IRC07:49
*** Daisy has joined #openstack-infra07:52
*** cody-somerville has quit IRC07:55
*** Daisy has quit IRC07:57
*** salv-orlando has joined #openstack-infra07:58
*** skraynev has joined #openstack-infra08:03
*** baoli has quit IRC08:03
*** lezbar has quit IRC08:07
*** cody-somerville has joined #openstack-infra08:11
openstackgerrityolanda.robla proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675108:13
*** salv-orlando has quit IRC08:13
*** Jeffrey4l_ has joined #openstack-infra08:16
*** achanda has quit IRC08:16
*** bauzas is now known as bauwser08:16
*** Jeffrey4l has quit IRC08:17
*** amitgandhinz has joined #openstack-infra08:18
*** kzaitsev_mb has quit IRC08:19
*** yamahata has quit IRC08:19
*** kzaitsev_mb has joined #openstack-infra08:22
*** amitgandhinz has quit IRC08:22
*** sputnik13 has quit IRC08:23
openstackgerritMerged openstack-infra/project-config: Add support for debian-jessie  https://review.openstack.org/29741908:28
openstackgerritMerged openstack-infra/project-config: Refactor IPA post jobs to handle branches  https://review.openstack.org/29747408:32
*** vincentll has joined #openstack-infra08:32
openstackgerritMerged openstack-infra/project-config: Keystone eventlet job on stable branches only  https://review.openstack.org/29730908:34
*** rossella_s has quit IRC08:34
*** rossella_s has joined #openstack-infra08:34
*** thorst has joined #openstack-infra08:38
*** kzaitsev_mb has quit IRC08:39
openstackgerritMerged openstack-infra/system-config: Add pabelanger to statusbot  https://review.openstack.org/29725908:45
*** thorst has quit IRC08:46
*** rguillebert has joined #openstack-infra08:47
*** asettle has quit IRC08:49
*** nadya has joined #openstack-infra08:51
*** netsin has quit IRC08:53
*** netsin has joined #openstack-infra08:53
*** zhurong has quit IRC09:01
*** _skolekonov is now known as skolekonov09:01
*** achanda has joined #openstack-infra09:03
*** yaume has joined #openstack-infra09:05
*** ramishra has quit IRC09:05
*** ramishra has joined #openstack-infra09:07
*** openstackstatus has joined #openstack-infra09:08
*** ChanServ sets mode: +v openstackstatus09:08
*** salv-orlando has joined #openstack-infra09:09
*** esikachev has joined #openstack-infra09:11
zigoAJaeger: Hi there !09:12
zigoAJaeger: Do you have time for a quick talk about my plans for the Debian packaging on infra?09:12
zigoAJaeger: I'd like to make sure I'm going on a direction that your team will agree with.09:13
*** amitgandhinz has joined #openstack-infra09:18
*** electrofelix has joined #openstack-infra09:19
*** claudiub has joined #openstack-infra09:19
*** daemontool has joined #openstack-infra09:22
*** gongysh has quit IRC09:22
*** amitgandhinz has quit IRC09:23
*** Jeffrey4l_ is now known as Jeffrey4l09:23
*** ifarkas has joined #openstack-infra09:24
*** HeOS has joined #openstack-infra09:24
HeOSHello, infra-team, could you review please? https://review.openstack.org/#/c/297252/09:27
*** fernnest_ has joined #openstack-infra09:38
*** cody-somerville_ has joined #openstack-infra09:38
*** cody-somerville has quit IRC09:39
*** fernnest has quit IRC09:39
*** tsufiev has quit IRC09:39
*** mescanef has quit IRC09:39
*** achanda has quit IRC09:41
*** tsufiev has joined #openstack-infra09:41
*** thorst has joined #openstack-infra09:43
*** YorikSar_ has joined #openstack-infra09:43
*** YorikSar has quit IRC09:43
*** Jeffrey4l has quit IRC09:46
*** Jeffrey4l has joined #openstack-infra09:46
*** fabo has joined #openstack-infra09:50
*** thorst has quit IRC09:50
*** _degorenko|afk is now known as degorenko09:51
*** nikhil_k has joined #openstack-infra09:51
*** nikhil has quit IRC09:51
*** dtantsur has quit IRC09:51
*** dtantsur has joined #openstack-infra09:53
*** dtantsur has joined #openstack-infra09:53
*** Qiming has quit IRC10:03
*** yamamoto has quit IRC10:03
*** cody-somerville_ has quit IRC10:05
*** dtardivel has joined #openstack-infra10:06
*** sfinucan has joined #openstack-infra10:06
*** mescanef_ has joined #openstack-infra10:09
*** e0ne has joined #openstack-infra10:11
*** jed56 has quit IRC10:13
*** _amrith_ is now known as amrith10:15
*** sdague has joined #openstack-infra10:18
*** amitgandhinz has joined #openstack-infra10:19
*** mescanef_ has quit IRC10:23
*** amitgandhinz has quit IRC10:24
*** mescanef has joined #openstack-infra10:30
*** mescanef has quit IRC10:35
*** mescanef has joined #openstack-infra10:35
*** esikachev has quit IRC10:38
*** lmiccini has quit IRC10:39
*** mescanef has quit IRC10:40
*** mescanef has joined #openstack-infra10:40
*** lmiccini has joined #openstack-infra10:40
*** ociuhandu has quit IRC10:40
*** mescanef has quit IRC10:41
*** achanda has joined #openstack-infra10:41
*** esikachev has joined #openstack-infra10:43
*** thorst has joined #openstack-infra10:44
*** thorst has quit IRC10:47
*** thorst has joined #openstack-infra10:48
*** achanda has quit IRC10:50
*** binbincong has quit IRC10:51
*** thorst has quit IRC10:56
*** asettle has joined #openstack-infra10:56
*** asettle has quit IRC10:56
*** amrith is now known as _amrith_10:59
*** Qiming has joined #openstack-infra11:02
openstackgerritDavanum Srinivas (dims) proposed openstack/requirements: Updated from generate-constraints  https://review.openstack.org/28884911:03
*** kzaitsev_mb has joined #openstack-infra11:06
*** rguillebert has quit IRC11:07
*** Daisy has joined #openstack-infra11:14
*** sdague has quit IRC11:15
*** sdague has joined #openstack-infra11:16
*** yaume has quit IRC11:17
*** Daisy has quit IRC11:18
*** binbincong has joined #openstack-infra11:19
*** amitgandhinz has joined #openstack-infra11:20
*** mescanef has joined #openstack-infra11:21
*** kzaitsev_mb has quit IRC11:24
*** amitgandhinz has quit IRC11:25
*** jpr has joined #openstack-infra11:29
*** jpr1 has joined #openstack-infra11:30
*** jsavak has joined #openstack-infra11:32
*** jpr has quit IRC11:33
*** jpr has joined #openstack-infra11:33
*** yamamoto_ has joined #openstack-infra11:35
*** yamamot__ has joined #openstack-infra11:35
*** jpr1 has quit IRC11:37
*** kzaitsev_mb has joined #openstack-infra11:37
*** thorst has joined #openstack-infra11:37
*** yamamoto_ has quit IRC11:39
*** rhallisey has joined #openstack-infra11:41
*** yamamot__ has quit IRC11:42
*** rguillebert has joined #openstack-infra11:44
*** yamamoto_ has joined #openstack-infra11:46
*** jsavak has quit IRC11:52
*** yamamoto_ has quit IRC11:55
*** salv-orlando has quit IRC11:56
*** yamamoto_ has joined #openstack-infra11:56
*** salv-orlando has joined #openstack-infra11:56
*** yamamoto_ has quit IRC12:01
*** zhurong has joined #openstack-infra12:01
*** esikachev has quit IRC12:02
*** salv-orl_ has joined #openstack-infra12:03
*** claudiub|2 has joined #openstack-infra12:03
*** esikachev has joined #openstack-infra12:04
*** salv-orl_ has quit IRC12:04
*** salv-orlando has quit IRC12:05
*** claudiub has quit IRC12:05
*** _amrith_ is now known as amrith12:07
*** nadya has quit IRC12:10
*** akaszuba has quit IRC12:12
*** penguinolog has quit IRC12:21
*** amitgandhinz has joined #openstack-infra12:21
*** jaypipes has joined #openstack-infra12:22
*** amitgandhinz has quit IRC12:26
*** zeih has joined #openstack-infra12:28
*** jaypipes is now known as leakypipes12:29
*** alaski is now known as lascii12:32
*** signed8bit_Zzz is now known as signed8bit12:33
*** rossella_s has quit IRC12:34
*** oanson has joined #openstack-infra12:35
*** rossella_s has joined #openstack-infra12:35
openstackgerritDan Prince proposed openstack-infra/tripleo-ci: Metrics tracking for TripleO deployment tasks  https://review.openstack.org/29139312:37
openstackgerritDan Prince proposed openstack-infra/tripleo-ci: Add common bash functions to help track metrics.  https://review.openstack.org/29139212:37
*** nadya has joined #openstack-infra12:39
*** akaszuba has joined #openstack-infra12:44
*** david-lyle has quit IRC12:45
*** salv-orlando has joined #openstack-infra12:46
*** flaper87 has quit IRC12:46
*** flaper87 has joined #openstack-infra12:46
*** jsavak has joined #openstack-infra12:47
*** jed56 has joined #openstack-infra12:47
*** achanda has joined #openstack-infra12:47
*** moravec has joined #openstack-infra12:48
*** yamamoto has joined #openstack-infra12:49
*** oanson has quit IRC12:53
*** achanda has quit IRC12:53
*** ociuhandu has joined #openstack-infra12:56
*** treaki_ has quit IRC12:58
*** amitgandhinz has joined #openstack-infra12:58
*** zhurong has quit IRC12:58
*** amitgandhinz has quit IRC12:58
*** automagically has joined #openstack-infra12:58
pabelangerinfra-root: blue blox out of floatingips again. Cleaning them up now12:59
*** amitgandhinz has joined #openstack-infra12:59
fungipabelanger: thanks12:59
pabelangerthats twice in 12 hours12:59
pabelangerguess we need to debug why12:59
*** zeih has quit IRC13:00
fungiit's been happening for months, i think mordred had some theory but we lack low-level access to the systems there13:02
pabelangerright13:03
pabelangergoing to see if we can add something to grafana.o.o to output current floating IPs used13:03
*** piet has joined #openstack-infra13:04
pabelangerfungi: since you are around, care to help https://review.openstack.org/#/c/297283/ land? that will give us centos-7 across all clouds13:04
pabelangerfungi: and enough time to restart nodepool-builder before image builds today13:04
*** amotoki has quit IRC13:05
mordredfungi, pabelanger: I've actually been not caring to debug too much because when we land the (hopefully soon now) nodepool-shade patch the method we use to allocate floating ips changes to be one that I believe will not leak anymore13:06
mordredif we still leak after that, I think it's worth more debugging13:06
pabelangermordred: Ah, nice13:07
*** jsavak has quit IRC13:07
HeOSinfra-team, could you review this request, please? https://review.openstack.org/#/c/297252/13:09
*** rlandy has joined #openstack-infra13:10
*** jsavak has joined #openstack-infra13:10
*** edmondsw has joined #openstack-infra13:10
*** naggappan has quit IRC13:12
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675113:13
mordredmaybe that one will work13:13
Shrewsmordred: what did you change in that one?13:13
*** flepied has quit IRC13:14
mordredShrews: I added in a debugging print13:15
mordredShrews: to output the server dict when it throws the "can't find public ip" exception13:15
mordredShrews: I'm also going to hold the node that runs the next job13:15
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675113:15
Shrewsmordred: ^^^ that just sets the shade req to >=1.6.113:15
*** jsavak has quit IRC13:15
mordredShrews: good call13:16
*** jsavak has joined #openstack-infra13:16
*** edmondsw has quit IRC13:16
mordredShrews: I have confidence that today is the day nodepool-shade wins13:16
* Shrews crosses fingers and toes13:16
pabelangerHeOS: most are on PTO today and monday, so it will likely be slow over the next few days13:17
Shrewsmordred: pprint.pprint() doesn't actually return a thing, does it?13:18
*** yamamoto has quit IRC13:19
*** edmondsw has joined #openstack-infra13:21
*** yamamoto has joined #openstack-infra13:21
mordredShrews: bah. no. one sec13:22
mordredI meant pformat13:22
Shrewsmordred: also, pprint is already imported fwiw13:22
Shrewsmordred: and it looks better with server.toDict()13:22
Shrewsotherwise you just get an ugly munch13:23
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675113:23
*** yamamoto has quit IRC13:28
*** mriedem has joined #openstack-infra13:29
*** yamamoto has joined #openstack-infra13:29
*** treaki has joined #openstack-infra13:32
*** piet has quit IRC13:34
*** yamamoto has quit IRC13:34
*** piet has joined #openstack-infra13:34
HeOSpabelanger, thanks. :)13:36
HeOSI'll wait other scores.13:37
*** baoli has joined #openstack-infra13:43
*** nelsnelson has quit IRC13:43
openstackgerritMerged openstack-infra/system-config: Replace Wait(1) with Playback(silence/1)  https://review.openstack.org/23945513:43
*** ayoung has quit IRC13:44
*** zhurong has joined #openstack-infra13:44
*** yamamoto has joined #openstack-infra13:49
SpamapSmordred: so, shade, clouds.yaml ..13:52
SpamapSmordred: http://paste.openstack.org/show/491894/ <-- there's my clouds.yaml13:53
*** huzhj__ has joined #openstack-infra13:54
SpamapSmordred: http://paste.openstack.org/show/491895/  <-- and there is the traceback that happens over and over again in the shade functional test suite13:54
SpamapSmordred: FYI, 'openstack --os-cloud devstack catalog list' works fine13:56
*** huzhj_ has joined #openstack-infra13:56
SpamapSmordred: and this is not devstack btw, it's an arrrsula, trying to setup for running shade func tests.13:56
*** flepied has joined #openstack-infra13:57
fungiarrr!13:57
SpamapSavast ye cloud.13:58
openstackgerritKhai Do proposed openstack-infra/jenkins-job-builder: cmd: Add a config file fallback to the user's home directory  https://review.openstack.org/23769413:59
fungii need to find someone locally who repairs/restrings flagpoles. have a rather tall nautical flagpole in the yard but until it's strung again this oversized jolly roger is just folded up collecting dust on a shelf13:59
*** huzhj__ has quit IRC14:00
fungii'd try to restring the thing myself, but christine has forbidden me to climb it14:00
SpamapSperhaps now is the time to finally fulfill your dream of owning a trained monkey.14:02
*** piet has quit IRC14:02
*** asettle has joined #openstack-infra14:02
fungii could try to convince the cat to go up there, i suppose14:03
*** sigmavirus24_awa is now known as sigmavirus2414:03
*** knikolla has joined #openstack-infra14:04
SpamapSConvincing Cats is my new inspirational seminar.14:04
openstackgerritJim Rollenhagen proposed openstack-infra/project-config: Give ironic tempest-full job more "bare metal"  https://review.openstack.org/29747614:06
jrollsdague: ^ pushing on tempest-full here14:07
jrollpretty fast review if someone has a moment14:07
*** asettle has quit IRC14:07
*** yamamoto has quit IRC14:07
sdaguejroll: neat14:08
sdague+214:08
*** yamamoto has joined #openstack-infra14:09
*** rbrndt_ has joined #openstack-infra14:09
*** yamamoto has quit IRC14:09
jrollthanks14:09
openstackgerritMonty Taylor proposed openstack-infra/shade: Also add server interfaces for server get  https://review.openstack.org/29769414:10
SpamapSoh14:11
mordredShrews: looking14:11
mordredgah14:11
SpamapSmordred: the fail btw.. was caused because I was missing a cacert14:11
mordredSpamapS: looking14:11
SpamapSbut zomg was that not helpful14:11
mordredSpamapS: oh. nice14:11
SpamapSnow I have a whole other pile of fails14:11
SpamapSthat were much much slower14:11
SpamapSForbidden: You are not authorized to perform the requested action: identity:list_users (HTTP 403) (Request-ID: req-a3a13fd1-b8d9-4571-a072-3352b4d0b5e6)14:11
SpamapSseems it doesn't like my creds14:12
*** IlyaG has joined #openstack-infra14:12
mordredSpamapS: has the admin user been granted a role in the demo project?14:12
SpamapSoh probably not, that may be the wrong project for admin14:12
SpamapSyay14:13
* SpamapS changes to admin and some things start working14:13
SpamapSmordred: better fails now "no sensible image available"14:13
*** nelsnelson has joined #openstack-infra14:14
openstackgerritZhijiang Hu proposed openstack-infra/project-config: [new project] Create a OpenStack related project "daisycloud-core"  https://review.openstack.org/29611714:14
mordredSpamapS: woot14:15
*** nibalizer has quit IRC14:16
*** IlyaG has quit IRC14:17
*** ddieterly has joined #openstack-infra14:17
*** signed8bit is now known as signed8bit_Zzz14:18
mordredShrews: see shade patch above14:19
*** knikolla has quit IRC14:19
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675114:19
*** nibz has joined #openstack-infra14:19
*** ajmiller has joined #openstack-infra14:20
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675114:20
mordredShrews: ^^ and there is a workaround for the shade thing14:20
*** piet has joined #openstack-infra14:21
*** edmondsw has quit IRC14:22
jeblairomg it's another 20 patchsets14:23
* mnaser looks at a few days buffer14:24
mnasernot sure if the upload issue worked itself out, but we're doing changes to clean up those large image uploads14:24
mnaserit's relating to our qos+ceph cluster.. i'll update once those changes are put in place and hopefully image uploads start being a bit more sane14:25
*** tonytan4ever has joined #openstack-infra14:25
*** ayoung has joined #openstack-infra14:26
*** baoli has quit IRC14:27
clarkbmnaser: I have seen its not a 100% fail but they do still fail with that uuid/file not found pretty frequently. Thank you for the update. Do you still need access to that qcow2 file?14:27
mnaserclarkb: i do not, i have a copy of it here, it seems that when the ceph cluster is a bit slower than usual, glance poops out14:28
*** zz_dimtruck is now known as dimtruck14:29
*** ddieterly is now known as ddieterly[away]14:30
jeblairmordred: hey, so on patchset 60, i left a comment about how there was a needless change to the nodepool metadata14:30
*** hieulq has joined #openstack-infra14:30
jeblairmordred: i expected that to simply be reverted back to the way it was before14:30
mordredjeblair: yah. I haven't gotten to thinking about that yet, sorry14:31
jeblairmordred: but it's now patchset 83, and now it's just doing even weirder things with the nodepool metadata14:31
*** baoli has joined #openstack-infra14:31
jeblairmordred: well, it *has* changed since patchset 6014:31
jeblairso i don't understand why it's being messed with instead of just being put back the way it was14:31
openstackgerritMerged openstack-infra/project-config: Add centos-7 dib to all clouds  https://review.openstack.org/29728314:32
*** zhurong has quit IRC14:32
*** hieulq has quit IRC14:34
*** huzhj_ has quit IRC14:34
*** weshay has quit IRC14:34
*** hieulq has joined #openstack-infra14:34
*** ddieterly[away] is now known as ddieterly14:34
*** resker has quit IRC14:35
*** ddieterly is now known as ddieterly[away]14:35
jeblairmordred: ah, yolanda changed it somewhere between 62 and 76, i think you haven't touched it since then.14:35
*** keedya has joined #openstack-infra14:37
*** edmondsw has joined #openstack-infra14:37
jeblairmordred: i have reviewed the 62..83 diff.14:39
mordredjeblair: I'm about to push up the json thing14:39
mordredlemme go check your review14:39
*** ddieterly[away] is now known as ddieterly14:40
*** yamahata has joined #openstack-infra14:40
*** sdake has joined #openstack-infra14:41
*** yamamoto has joined #openstack-infra14:42
*** tonytan4ever has quit IRC14:42
*** tonytan4ever has joined #openstack-infra14:42
*** knikolla has joined #openstack-infra14:43
rossella_sfungi, jeblair hi guys! I imagine you are very busy...I need your help again. I'd really appreciate if you could have a quick look at https://review.openstack.org/#/c/284284/ when you have time. I just want to know if the general approach is fine with you, then I can go on and put that patch into shape. Thanks a lot in advance!!14:43
*** tonytan4ever has quit IRC14:45
anteayafungi: best of luck finding a flagpole repair person14:46
anteayafungi: I'm looking forward to pictures of the jolly roger in full sail14:46
*** baoli_ has joined #openstack-infra14:46
mordredjeblair: in reviewing/reverting this14:47
openstackgerritKATO Tomoyuki proposed openstack-infra/project-config: Add release notes translation scripts  https://review.openstack.org/29704514:47
mordredjeblair: how does this work today?14:47
jeblairrossella_s, fungi: i think i'm willing to try having the proposal bot have permissions to push to that specific ref...  i do wonder if we need to split the build step from the proposal step for security reasons though.  we should definitely get fungi and maybe others to weigh in on it.14:48
jeblairmordred: metadata is a string.  we json encode our data into that string.14:48
mordredjeblair: the old code also looks broken ... we do create_args['meta'] = dict(nodepool=json.dumps(nodepool_meta)) when we create the server14:48
mordredthat puts it into a key called nodepool in the metadata14:48
*** yaume has joined #openstack-infra14:48
mordredbut then in the consume code, we meta = server.get('metadata', {}) and then meta = json.loads(meta)14:48
*** yaume is now known as yaume[away]14:48
mordredjeblair: I feel like my eyes are missing something14:49
jeblairmordred: http://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/nodepool.py#n200014:49
jeblairmordred: meta = server.get('metadata', {}).get('nodepool')14:49
*** yaume[away] is now known as yaume14:49
mordredjeblair: oh - I read the reverting patch wrong14:49
mordredthank you14:49
jeblairnp14:49
mordredthat's what I was missing14:49
*** baoli has quit IRC14:49
mordredthat makes WAY more sense14:49
rossella_sjeblair, thanks for the answer! I can bother fungi now to get his feedback. Who else?14:49
jeblairyay!14:49
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675114:50
jeblairrossella_s: anyone who wants to pitch in :)14:50
*** achanda has joined #openstack-infra14:50
mordredjeblair: that should address the meta issue and your comments14:51
jeblairmordred: thanks!14:51
mordredjeblair: also, we missed a thing in the add_server_interfaces patch to shade - so I put up a shade patch to fix it14:51
mordredjeblair: but also included a workaround for that in this nodepool path14:51
mordredpatch14:51
mordredso that we do not need to wait for another shade release to make progress14:51
anteayattx: I'm all for helping folks learn how to listen to a group and moderate a discussion14:53
anteayattx: if there is anyway my participation in the discussion can use open source tools, I would be overjoyed14:53
jeblairmordred: +2.  yaaay!14:53
ttxanteaya: yeah. Alternative is everyone recors their snippets and someone (not me) having fun at video editing14:54
anteayattx: for instance I record using audacity all the time14:54
anteayaor just sound editing14:54
*** twm2016 has joined #openstack-infra14:54
rossella_sjeblair, thanks a lot! :)14:54
rossella_s anyone who pitches in will get a delicious Italian cookie from me in Austin...let's see if bribing works :)14:54
anteayanot sure why we need floating heads with various stages of hairstyles against a blank wall to sell the point of listening14:54
anteayaif we do just sound recording, I can edit with audacity14:55
*** achanda has quit IRC14:55
anteayaI don't have a tool I like for video editing, plus it is so much tougher14:55
*** yamahata has quit IRC14:55
fungirossella_s: jeblair: i think as long as it operates by running only released tools (e.g. dashboard creator) and scripts included in the project-config repo (not running arbitrary scripts from different projects' repos) then having it all happen on proposal.slave.openstack.org seems fine. if it needs to run scripts/tools from random places then splitting it into build and upload jobs on different14:55
fungiworkers is likely a good precaution14:55
*** yamahata has joined #openstack-infra14:55
anteayaas you have to edit for random nose wipes as opposed to just breathing patterns14:56
*** tonytan4ever has joined #openstack-infra14:56
rossella_sfungi jeblair it currently runs a script from the neutron repo. Moving this script to project-config repo is an option?14:57
clarkbinitially I thought it could just live in reviewday14:57
clarkband run along with reviewdays existing html generation stuff14:58
*** dasm has left #openstack-infra14:59
*** cody-somerville has joined #openstack-infra14:59
*** cody-somerville has quit IRC14:59
*** cody-somerville has joined #openstack-infra14:59
clarkbbut I am not sure what all the inputs are and if it makes sense there14:59
clarkbbut I think that os still a good option since we have this tool that produces these "dashboards" already15:00
*** angdraug has joined #openstack-infra15:00
jeblairyeah, i think all of those things are options -- in order of preference: 1) reviewday; 2) move script to project-config repo; 3) run script from neutron in separate job and copy output to proposal slave via tarballs.o.o15:00
fungiagreed15:01
rossella_sclarkb, jeblair , fungi thanks! then I will look better at how to integrate it in reviewday and come back to you15:01
anteayarossella_s: pleia2 has spent quite a bit of time with reviewday so might be a good person to ask if you have questions about it15:02
*** zeih has joined #openstack-infra15:03
rossella_santeaya, thanks a lot for the pointer, I will definitely need help :)15:03
anteaya:)15:03
anteayawelcome15:03
*** esker has joined #openstack-infra15:04
*** moravec has quit IRC15:06
*** Bobby_ has joined #openstack-infra15:07
krotscheckmordred, ttx: Hey, did either of you ever write any blog posts/emails vis-a-vis opinionated openstack and/or choosing boring technology?15:12
mordredkrotscheck: nope. never got around to it15:12
ttxkrotscheck: I don't think I did15:12
*** IlyaG has joined #openstack-infra15:13
*** imcsk8_ is now known as imcsk815:13
*** ifarkas has quit IRC15:13
ttxI wish I had more time for writing.15:14
ttxI should institute write-a-blog-post-friday again15:14
ttxwould change from things-are-on-fire-everyday15:14
*** IlyaG has quit IRC15:15
*** IlyaG has joined #openstack-infra15:15
anteayaha ha ha15:16
anteayathe asbestos wall for write-a-blog-post-friday15:16
*** zeih has quit IRC15:16
*** yamamoto has quit IRC15:17
*** Nikolay_St has quit IRC15:17
krotscheckttx, mordred: I'm a big favor of "Things not being on fire" friday.15:19
krotscheckttx, mordred: Righto, thanks for the answer. I'm collecing my thoughts on the x-project work I did for CORS in a post that's basically "oh good lord why is everything a snowflake", and I wanted some supporting arguments.15:20
openstackgerritDoug Hellmann proposed openstack-infra/project-config: set stable/mitaka permissions for senlin projects  https://review.openstack.org/29772115:20
sdakehow do I delete branches for deprecated branches15:20
sdakeicehosue/juno/kilo speicifically15:20
anteayasdake: you say what repo, what branch, and what the shas are for the branch tip of each branch15:21
sdakeanteaya kolla15:21
anteayaand some infra-root who has time will delete them for you15:21
sdakeanteaya cool thanks15:21
sdakeanteaya let me get back to you on branch deletion with an agreement from the community15:21
anteayawelcome15:21
anteayasdake: I agree that is a good place to start15:21
sdakei just wanted to make sure it was possible15:22
*** Daisy has joined #openstack-infra15:22
mordredsdake: we tend to add an eol tag when we delete old branches15:22
sdakebecause obviously gerrit locks it out15:22
mordredsdake: that points to the tip of what the old branch was15:22
mordredsdake: so you'll find things like grizzly-eol in nova15:22
mordredthat way people who want to find the thing that was your kilo branch can still get a git ref15:23
mordredbut it's clear it's not taking new work15:23
*** esker has quit IRC15:25
fungisdake: you likely also want to tag the final state of those branches something like icehouse-eol and also abandon any open reviews for them in gerrit first15:25
mordredfungi: jinx15:26
sdakefungi mordred ust said that thanks :)15:26
fungier, mordred also just said that, yep15:26
mordredI did leave out abandoning old reviews though15:26
fungiyeah, gerrit won't let us delete branches with open reviews15:26
*** Daisy has quit IRC15:26
*** nibz has quit IRC15:26
*** mriedem is now known as mriedem_meeting15:28
*** EricGonczer_ has joined #openstack-infra15:29
*** bpokorny has joined #openstack-infra15:30
*** asettle has joined #openstack-infra15:31
*** nibalizer has joined #openstack-infra15:32
*** david-lyle has joined #openstack-infra15:34
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675115:35
mordredjeblair, Shrews: ^^ that time when there is an 's' missing from a workaround15:36
*** asettle has quit IRC15:36
*** ddieterly is now known as ddieterly[away]15:38
*** ddieterly[away] is now known as ddieterly15:38
*** david-lyle_ has joined #openstack-infra15:38
*** david-lyle has quit IRC15:38
*** woodster_ has joined #openstack-infra15:39
jeblairmordred: A+++++2 best addition of an 's' i've seen in ages.  would add missing 's's again.15:39
*** david-lyle_ is now known as david-lyle15:39
jeblair[-2 box supposedly containing missing 's' actually contained bobcat]15:40
AJaegerlooking at status.o.o/zuul, I noticed that we have some jobs for long in the queue - seem to be waiting for fedora-23 nodes. Any problems with these nodes?15:41
anteayaAJaeger: yes clarkb reverted a patch yesterday: https://review.openstack.org/#/c/297471/15:43
anteayaAJaeger: because the updating iptables rule patch wasn't working on fedora-23 or centos715:44
anteayaI'm not sure if the revert propogated15:44
*** rhallisey has quit IRC15:45
fungiwell, also there's a bunch stuck building in rax-iad and so nodepool isn't trying to boot any more of them because it assumes those will be ready any moment to satisfy the job demand http://paste.openstack.org/show/491906/15:45
fungiwhenever we get a region taking too long to boot instances, you end up starved for uncommon types because they accumulate in a building state and nodepool considers them as satisfying the demand15:46
* AJaeger is not getting the full picture here , but thanks anteaya and fungi for investigating...15:47
mordredjeblair: haha15:47
anteayafungi: ah, that's more likely it15:47
AJaegerfungi, ah, now understanding it.15:47
fungiiad and ord looks like, actually15:47
openstackgerritRonald Bradford proposed openstack-infra/project-config: Remove kite configuration  https://review.openstack.org/29773815:48
*** dimtruck is now known as zz_dimtruck15:48
twm2016Hi everyone, I have an issue with devstack using the https proxy instead of the git proxy. It seems when devstack runs it creates files under src/<project name> to store git config and clone files. I think I need to modify the script creating those generated files to fix my issue.15:49
twm2016I have already done googling and tried the common answers to these problems, like setting git config variables15:50
jrollfungi: fyi, ord is having a bad day (delayed builds) but I haven't heard anything similar for iad15:50
twm2016and the GIT_BASE in stackrc15:50
*** moravec has joined #openstack-infra15:52
fungijroll: yep. most are in ord, though i see 4 in iad right now as well http://paste.openstack.org/show/491908/15:53
rossella_sclarkb, jeblair, fungi I looked at the code of reviewday...the core idea is to order all the reviews and assign them a score. A gerrit dashboard is different, you can use filters and have different sections.15:53
anteayatwm2016: the folks who take care of devstack spend most of their time in #openstack-qa15:53
twm2016anteaya: Thank you15:53
anteayatwm2016: you are more likely to have a better audience for your situation in that channel15:53
anteayatwm2016: welcome15:53
jrollfungi: yeah, that's odd15:53
*** twm2016 has quit IRC15:53
clarkbrossella_s: I think the idea behind reviewday is to provide reviewers more info. gerrit dashboards are part of that15:54
fungijroll: also we have much more quota in ord than iad at the moment, which could also explain why we see more in this state in ord15:54
jrollnod15:54
jrolljust giving you a heads up :)15:54
clarkbrossella_s: but reviewday provides a preexisting framework to get that info to your users15:54
* jroll takes his support hat back off15:54
fungijroll: across all our providers, only rax-iad and rax-ord are taking >10 minutes to boot instances (rax-dfw is fine even)15:54
fungijroll: yep, thanks for the heads up115:54
*** gyee has joined #openstack-infra15:55
anteayaI'm offline for a bit15:55
pabelangerAJaeger: fungi: Ya, fedora-23 just rebuilt, so uploads should happen in the next hour15:56
rossella_sclarkb, I can re-use part of the framework...but still...my goal was to show a restricted list of reviews...to do that I should change reviewday completely15:56
pabelangerAJaeger: fungi: fedora-23 will eventually work on blue-box15:56
mordredShrews, jeblair: ZOMG. I think the latest patch is maybe actually working!15:57
*** roxanaghe has joined #openstack-infra15:57
rossella_sclarkb, with a gerrit dashboard you can filter based on the user too, like filter out the patches that are yours15:57
rossella_sclarkb, these kind of capabilities are not enabled in reviewday...15:58
clarkbrossella_s: yes produce the dashboard links with reviewday15:59
clarkbisnt the issue here publishing them? reviewday can do that15:59
rossella_sclarkb, you mean just add the link in reviewday or am I missing something?15:59
AJaegerclarkb: Is the idea to use the reviewday framework - or just add the script to it so that it has a home?16:00
clarkbI think its both16:00
fungiclarkb: as an alternative to having something push them into gerrit you mean16:00
clarkbreviewday exists to provide this info16:00
clarkbfungi: yes16:00
rossella_sso like adding a section with project dashboard links in reviewday, right?16:00
clarkbrossella_s: ya16:00
rossella_sclarkb, great! I can do that! thanks :)16:01
clarkbbasically another view into the "this is what shpuld be reviewed" information reviewday is trying to share16:01
rossella_sclarkb, got you now ;)16:01
clarkbit could also possibly push them into gerrit16:02
*** HeOS_ has quit IRC16:02
*** keedya has quit IRC16:02
rossella_sclarkb, tbh for now just publishing the link would be fine. We can evolve that in future16:02
*** zz_dimtruck is now known as dimtruck16:03
rossella_sclarkb, the problem is that I need to update the link daily...how can I do that?16:03
*** Bobby_ has quit IRC16:03
clarkbyou could possibly even map the reviewday scoring onto the dashboards16:03
clarkbrossella_s: reviewday shpuld already update daily16:03
rossella_sclarkb, great! ok so let me get started...thanks a lot again!16:04
AJaegerrossella_s: puppet-reviewday setups a cron job16:05
*** nikhil_k is now known as nikhil16:05
*** kzaitsev_mb has quit IRC16:05
rossella_sAJaeger, thanks for the pointer...but you should be off today :p16:06
AJaegeryou could setup a second cron job as well ;)16:06
AJaegerrossella_s: ;)16:06
*** piet has quit IRC16:06
*** hieulq has quit IRC16:06
AJaegerrossella_s: if you tell me to go... ;)16:06
rossella_sAJaeger, no, don't go! :)16:06
*** EricGonc_ has joined #openstack-infra16:07
AJaegerrossella_s: I was on my way of leaving already :) This was just perfect timing from your side :)16:07
AJaegerUntil later...16:07
*** bpokorny has quit IRC16:07
*** apoorvad has joined #openstack-infra16:08
*** akaszuba has quit IRC16:08
*** bpokorny has joined #openstack-infra16:08
openstackgerritRonald Bradford proposed openstack-infra/project-config: Retiring kite and python-kitclient projects  https://review.openstack.org/29774616:10
*** EricGonczer_ has quit IRC16:11
*** pcaruana has quit IRC16:11
*** sc68cal has joined #openstack-infra16:12
rossella_sAJaeger, enjoy your holidays :)16:14
*** roxanaghe has quit IRC16:15
*** piet has joined #openstack-infra16:16
*** yamahata has quit IRC16:17
*** yamamoto has joined #openstack-infra16:17
*** roxanaghe has joined #openstack-infra16:18
*** Qiming has quit IRC16:20
*** roxanaghe has quit IRC16:22
*** roxanaghe has joined #openstack-infra16:24
sc`https://jenkins04.openstack.org/job/gate-ubuntu-trusty-cookbook-openstack-common-chef-rake-integration-nv/10/console - this worked last night and this morning, with no changes to the code. my centos7 gate passes without issue. i would presume that if /etc/nova wasn't there the converge would fail16:27
*** mriedem_meeting is now known as mriedem16:27
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675116:27
sc`converge completes without error, and the post install smoke tests suggest openstack is healthy16:27
*** tphummel has joined #openstack-infra16:27
*** nadya has quit IRC16:28
*** yamamoto has quit IRC16:28
sc`wait, no, never mind16:30
sc`i see it16:30
*** HeOS_ has joined #openstack-infra16:33
*** mylu has joined #openstack-infra16:33
*** esker has joined #openstack-infra16:40
*** jsavak has quit IRC16:40
*** jsavak has joined #openstack-infra16:41
*** sputnik13 has joined #openstack-infra16:41
*** salv-orl_ has joined #openstack-infra16:42
*** bryan_att has joined #openstack-infra16:42
*** yamahata has joined #openstack-infra16:43
*** vincentll has quit IRC16:44
*** esker has quit IRC16:44
*** esker has joined #openstack-infra16:44
*** ddieterly is now known as ddieterly[away]16:45
*** salv-orlando has quit IRC16:45
*** esker has quit IRC16:45
*** mrmartin has joined #openstack-infra16:46
*** esker has joined #openstack-infra16:46
*** nadya has joined #openstack-infra16:48
*** ddieterly[away] is now known as ddieterly16:48
*** oanson has joined #openstack-infra16:49
*** brad_behle has joined #openstack-infra16:50
*** mylu has quit IRC16:51
*** edmondsw has quit IRC16:52
*** ddieterly has quit IRC16:52
*** achanda has joined #openstack-infra16:53
*** Swami has joined #openstack-infra16:54
*** mylu has joined #openstack-infra16:55
*** jsavak has quit IRC16:57
*** oanson has quit IRC16:58
*** achanda has quit IRC16:59
*** sridhar_ram has joined #openstack-infra16:59
pleia2peaceful morning16:59
yolandahi mordred, i'm on holiday today but i was taking a look. Did you figure why nodepool functional testing failed? seems to be waiting until it times out16:59
*** jpr has quit IRC17:01
*** achanda has joined #openstack-infra17:02
*** rkukura has joined #openstack-infra17:03
*** jerryz has joined #openstack-infra17:04
*** tonytan4ever has quit IRC17:04
mordredyolanda: yah. I'm working on it now17:06
*** mrmartin has quit IRC17:11
*** SumitNaiksatam has quit IRC17:14
*** skolekonov is now known as skolekonov|away17:15
*** sigmavirus24 is now known as sigmavirus24_awa17:15
*** esikachev has quit IRC17:16
*** elo has quit IRC17:17
anteayapleia2: peaceful morning to you17:17
anteayapleia2: did you read the backscroll yet?17:17
pleia2anteaya: I meant right now :)17:17
pleia2contrast17:18
anteayaah17:18
anteayawe should have easter more often17:18
*** e0ne has quit IRC17:19
anteayaI thought you were offering us a benediction17:19
anteayaand I thought it was a nice one17:19
pleia2lol17:19
pleia2peace be with you!17:19
anteayathat works too17:19
anteayabut I liked how you were branching out there17:20
*** MarkAtwood has joined #openstack-infra17:20
*** jpr has joined #openstack-infra17:24
*** HeOS has quit IRC17:24
*** elo has joined #openstack-infra17:26
rcarrillocruzhappy easter to everyone!17:26
*** krtaylor has quit IRC17:26
*** elo has quit IRC17:27
* rcarrillocruz goes back to his ansibling terminal17:27
*** mrmartin has joined #openstack-infra17:27
*** pvaneck has joined #openstack-infra17:27
*** nadya has quit IRC17:28
*** Guest34499 has quit IRC17:28
anteayarcarrillocruz: happy easter to you too17:32
openstackgerritDoug Wiegley proposed openstack/requirements: Bump neutron-lib to 0.0.3 minimum  https://review.openstack.org/28539517:33
*** angdraug_ has joined #openstack-infra17:34
yolandarcarrillocruz, why are we working if it's holiday? :(17:35
rcarrillocruzcos we're damned workaholics17:35
rcarrillocruz:D17:36
yolandahappy easter everyone17:36
*** angdraug has quit IRC17:37
yolandamordred, i'm seeing some errors about public ip not being returned properly, have you found some issue?17:38
*** esker has quit IRC17:38
*** esker has joined #openstack-infra17:39
*** SumitNaiksatam has joined #openstack-infra17:40
mordredyolanda: yah - those I got fixed17:41
yolandathen now, just times out without error?17:42
mordredcurrently it's not picking up the snapshot image it's supposed to be making17:42
mordredI have not yet figured out why17:42
yolandai have some time to help17:43
yolandagoing to spin up some vm17:43
anteayayolanda: happy easter to you too17:43
mordredyolanda: you can see here: http://logs.openstack.org/51/226751/86/check/gate-dsvm-nodepool-src-shade/82550de/logs/screen-nodepool.txt.gz#_2016-03-25_16_59_58_45917:43
*** mrmartin has quit IRC17:43
mordredyolanda: it gets all the way to starting the image snapshot17:44
*** jsavak has joined #openstack-infra17:44
mordredyolanda: but then it never sees a successful image created17:44
yolandaand no error returned that causes to abort it?17:44
mordredno - nothing aborts17:45
mordredit's in the poll-for-image-to-be-ready portion17:45
mordredyolanda: so I think I need to try again with some debugging added17:46
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Retiring kite and python-kitclient projects  https://review.openstack.org/29774617:46
yolandai am spinning a vm to try that functional testing as well17:46
*** ayoung has quit IRC17:47
*** jsavak has quit IRC17:48
AJaegerredrobot: could you +1/-1 kite retirement, please? See https://review.openstack.org/#/c/29774617:49
*** jsavak has joined #openstack-infra17:49
anteayaAJaeger: do we have a link to the governance change?17:49
AJaegeranteaya: I haven't found one yet, let's ask for it17:50
jrollprometheanfire: I take it you don't package ironic yet? or asking about wsgi/py3 for other reasons?17:50
anteayaAJaeger: sounds good17:50
*** Volundr has quit IRC17:51
prometheanfireI'm not doing ironic yet17:51
*** signed8bit_Zzz is now known as signed8bit17:51
AJaegeranteaya: looking at the comments, kite is part of barbican - but nobody cares about it ;(17:51
prometheanfireI'm asking about py3/wsgi for packaging reasons17:51
*** asettle has joined #openstack-infra17:51
*** piet has quit IRC17:51
anteayaAJaeger: thanks17:51
jrollprometheanfire: right on17:51
anteayaAJaeger: yeah, I read the linked email thread, nice work keeping things linked to together so folks can get the whole picture17:52
*** claudiub|2 has quit IRC17:52
jrollhow does one find logs for a post job?17:52
*** sdague has quit IRC17:53
AJaegerjroll: get the sha of your change and then17:53
AJaegerhttp://logs.openstack.org/first-two-chars-of-sha/full-sha/17:53
jrollAJaeger: thanks!17:53
openstackgerritCedric Brandily proposed openstack-infra/shade: Support InsecureRequestWarning == None  https://review.openstack.org/29779117:53
*** asettle has quit IRC17:56
AJaegeranteaya: redrobot commented in email on the way forward, so I gave my +2.17:56
*** ybathia has joined #openstack-infra17:56
anteayaAJaeger: okay thanks17:58
*** whoops has joined #openstack-infra17:58
*** dimtruck is now known as zz_dimtruck17:59
anteayaAJaeger: do you want the governance change linked or just merge the project-config change18:00
*** whoops has quit IRC18:01
*** krtaylor has joined #openstack-infra18:01
*** whoops has joined #openstack-infra18:01
*** mrmartin has joined #openstack-infra18:01
*** sdague has joined #openstack-infra18:03
*** jpr has quit IRC18:04
*** mrmartin has quit IRC18:04
*** esikachev has joined #openstack-infra18:04
*** mrmartin has joined #openstack-infra18:05
pabelangerAJaeger: DIB uploads should be starting in 20mins, once the update fedora-23 dib is upload, the gate will improve18:07
mordredyolanda: I think I found it!18:07
pabelangerimage builds up to 4 hours now18:07
*** jpr has joined #openstack-infra18:07
pabelangerHowever, devstack-trusty will drop soon(tm)18:07
*** sdake_ has joined #openstack-infra18:07
pabelangerEmilienM: any side effects from ubuntu-trusty nodes?18:08
AJaegerpabelanger: great.18:08
AJaegeranteaya: I think we can just merge...18:08
*** sdake has quit IRC18:08
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675118:09
mordredyolanda: in nodepool-shade we use glanceclient to do image statues - before we used novaclient18:09
AJaegerpabelanger, anteaya, fungi: we currently test the bindep fallback with each and every project-config change, should we only run it if we change the list itself - and not run otherwise?18:10
mordredyolanda: so the code was looking for "ACTIVE" which is what nova returns. while glance is returning 'active'18:10
AJaegerOr do we want these three jobs - or one of them - continue to run each time?18:10
fungiAJaeger: yeah, probably sufficient. do we call into tox at all for that? might still want to test on tox.ini changes too if so18:11
AJaegerfungi, not calling into tox for it.18:11
AJaegerlet me prepare a change and double check...18:11
fungiAJaeger: keep in mind though, one of the reasons i added that job is because we discovered that there was a gap in our job skipping such that someone proposed a change to the file and no jobs ran. we got way too exclusive about which jobs we ran against that repo and when18:12
*** whoops has quit IRC18:12
*** daemontool has quit IRC18:12
pabelangerAJaeger: fungi: I'm good for testing only when fallback.txt changes18:13
AJaegerfungi, there should be another job that is always run but will double check.18:13
*** whoops has joined #openstack-infra18:13
*** piet has joined #openstack-infra18:14
*** edmondsw has joined #openstack-infra18:15
AJaegermmh, we have the fallback tests run on both bindep and project-config and we should continue to run it there. So, have to rename the tests ;(18:15
fungiAJaeger: yeah, the intent is to validate that project-config changes to the fallback list work with the version of bindep we're installing on workers, and that changes to bindep work with the version of the fallback list we're installing on workers18:15
fungicould be done with two differently-named jobs18:16
AJaegerfungi, agreed on both18:16
*** esikache1 has joined #openstack-infra18:16
*** esikachev has quit IRC18:16
fungiactually probably should be done with two differently-named jobs. i think i got lazy18:16
fungii was mostly focused on making sure we reused the same job macro that other jobs were using to install packages with bindep and the fallback list so that we got better coverage of those same code paths18:17
AJaegerfungi, on it, let's see whether you like my solution ;)18:18
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add experimental centos-7 to windmill  https://review.openstack.org/29780018:18
*** kzaitsev_mb has joined #openstack-infra18:18
*** flepied has quit IRC18:18
*** whoops has quit IRC18:18
*** whoops has joined #openstack-infra18:20
*** esikache1 has quit IRC18:21
pabelanger51 image uploads under way18:21
rcarrillocruzcentos-7 dib images pabelanger?18:21
pabelangerrcarrillocruz: yes, 12 are centos-718:22
*** sfinucan has quit IRC18:22
rcarrillocruzsweet18:22
pabelangerodd, 3 clouds are duped for centos-718:23
EmilienMpabelanger: not afik but I've been off until now18:23
pabelangerEmilienM: same, I've been in and out most of the day18:23
pabelangerkids sleeping ATM18:23
fungipabelanger: duped?18:23
*** yamahata has quit IRC18:24
pabelangerfungi: I see 2 bluebox-sjc1 image-list as building18:24
pabelangerfor centos718:24
fungipabelanger: oh, yeah that seems odd18:24
*** Sukhdev has joined #openstack-infra18:24
pabelangerbluebox, vexxhost and internap are duped18:24
pabelangerrest single18:24
clarkbI think that happened because we only had vhd and raw18:26
clarkbthen you add to qcow2 clouds whoch causes a new build and more uploads18:26
clarkb?18:26
pabelangernot sure, will check the logs18:27
*** dtardivel has quit IRC18:28
*** rbrndt_ has quit IRC18:28
cody-somerville\o_18:29
anteayaAJaeger: sorry I have company at the moment18:29
anteayaAJaeger: go ahead if you want to merge that patch18:29
*** zz_dimtruck is now known as dimtruck18:31
*** degorenko is now known as _degorenko18:31
*** angdraug_ has quit IRC18:31
openstackgerritRonald Bradford proposed openstack-infra/project-config: Retiring kite and python-kitclient projects  https://review.openstack.org/29774618:33
*** mylu has quit IRC18:33
*** pvaneck has quit IRC18:33
*** ayoung has joined #openstack-infra18:34
*** mylu has joined #openstack-infra18:36
*** abe_music has quit IRC18:38
AJaegeranteaya: no stress...18:38
*** abe_music has joined #openstack-infra18:38
pabelangerclarkb: Ya, I think we need to restart nodepool-builder we merge the centos-7 on all clouds as it was building images18:38
pabelangerand it is failing because no qcow2 image18:39
openstackgerritEmilien Macchi proposed openstack-infra/project-config: publish puppet-aodh in tarball for master  https://review.openstack.org/29746918:40
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Run bindep on project-config only if needed  https://review.openstack.org/29780918:43
AJaegerpabelanger, fungi, anteaya : Here's the change.18:43
AJaegerfungi, the layout check is run for each and every project-config change, so we should be fine.18:44
*** eil397 has joined #openstack-infra18:44
*** achanda has quit IRC18:45
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Fix grant_role docstring  https://review.openstack.org/29781018:45
rcarrillocruzmordred: we don't track bugs of shade in launchpad, do we?18:45
rcarrillocruzor Shrews18:45
mordredrcarrillocruz: we track them in our heads18:46
rcarrillocruz:D18:46
rcarrillocruzwhat i tought, thx18:46
mordredrcarrillocruz: I believe technically we track them in storyboard18:46
rcarrillocruzpushing change shortly for some error in os_image18:46
clarkbpabelanger: ya once its done uploading we can do that18:50
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675118:51
*** achanda has joined #openstack-infra18:52
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Import os module as it is referenced in line 2097  https://review.openstack.org/29781718:52
*** roxanaghe has quit IRC18:52
rcarrillocruzmordred, Shrews: you may want to tackle ^, os_image is broken18:53
rcarrillocruzhttp://paste.openstack.org/show/491937/18:53
AJaegerclarkb, can we merge the change to make gate-infra-puppet-apply-debian-jessie voting? Then I'll +2 now. It has your +2 already, just want to confirm timing...18:53
clarkbAJaeger: ya the experimental job worked so approving shpuld be fine18:54
mordredrcarrillocruz: thanks. +A18:54
rcarrillocruzand while at it, i'll prepare a PR on os_image docs, to state that filename is required if name of os_image is not pointing to a real file18:54
rcarrillocruznp18:55
AJaegerclarkb: could you +2 https://review.openstack.org/297317 - it sets devstack-trusty min-ready to 0. Or should we go with -1 directly?18:55
EmilienMpabelanger: now you're asking yes, some things weird happened18:55
EmilienMpabelanger: https://review.openstack.org/#/q/status:open++topic:puppet/mitaka18:55
EmilienMpabelanger: I did recheck and jobs are not in queue18:55
clarkbAJaeger: we shpuld start with 0, did anyone co firm the demand is gone?18:55
clarkbI have lunch now but can look i to that after18:56
*** sdake_ is now known as sdake18:56
AJaegerclarkb: I check that no jobs have a node: devstack-trusty (checked jenkins files localy)18:56
AJaegerclarkb: enjoy lunch!18:56
clarkbAJaeger: perfect18:56
pabelangerclarkb: AJaeger: Yup, devstack-trusty has been ready for 01:03:59:0518:56
AJaeger;)18:57
pabelangerno new builds in a day18:57
pabelangerEmilienM: checking18:57
pabelangerEmilienM: do you know which one didn't queue?18:57
EmilienMpabelanger: all18:58
EmilienMat least 1018:58
openstackgerritMerged openstack-infra/project-config: Give ironic tempest-full job more "bare metal"  https://review.openstack.org/29747618:58
Shrewsrcarrillocruz: did you track down what broke it?18:59
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add python-appcatalogclient repository  https://review.openstack.org/29739519:00
rcarrillocruziirc, monty pushed this cool change where you could just assume that if you create an image and don't pass a filename, it will just check current folder for the image name19:00
rcarrillocruzi guess the change just missed the import os19:00
Shrewsack. thx19:00
*** ociuhandu has quit IRC19:00
* mordred sucks19:01
openstackgerritMatthew Treinish proposed openstack-infra/devstack-gate: Add an option to isntall a tempest plugin repo before running tempest  https://review.openstack.org/29744619:02
pabelangerEmilienM: Hmm, something is going on19:02
pabelangerEmilienM: let me check zuul logs19:02
*** jed56 has quit IRC19:03
*** mylu has quit IRC19:03
* rcarrillocruz reviewed that change and sucked at spotting it19:03
EmilienMpabelanger: I don't see your upload in zuul19:04
pabelangerEmilienM: it was there and dropped19:05
rcarrillocruzShrews: will you tag a a release as soon as that merges?19:05
rcarrillocruzor there are some other you want to wait to merge prior to do that19:05
openstackgerritMerged openstack-infra/project-config: Make gate-infra-puppet-apply-debian-jessie to voting  https://review.openstack.org/29742019:05
rcarrillocruzi fixed in place on my ansible cm, but imho that should  be released soonish19:05
openstackgerrityolanda.robla proposed openstack-infra/shade: Also add server interfaces for server get  https://review.openstack.org/29769419:06
*** brad_behle has quit IRC19:07
pabelangerEmilienM: I think zuul is calculating the world19:07
EmilienM:-/19:07
openstackgerritLakshmi N Sampath proposed openstack-infra/project-config: Install Elasticsearch for searchlight  https://review.openstack.org/29422419:07
pabelangerEmilienM: so, give it a few minutes19:07
EmilienMwe also have weird unit tests failures but not related19:07
EmilienMsure, take time19:07
*** mrmartin has quit IRC19:08
openstackgerritLakshmi N Sampath proposed openstack-infra/project-config: Install Elasticsearch for searchlight  https://review.openstack.org/29422419:09
*** sridhar_ram has quit IRC19:10
pabelangerOh19:10
pabelangerI think zuul is out of memory19:10
pabelangerhttp://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=392&rra_id=all19:10
pabelangerinfra-root: I believe zuul is out of memory ^19:11
clarkbAJaeger: pabelanger I just approved the devstack-trusty to 0 change19:11
pabelangerclarkb: ack19:11
clarkbnice19:11
clarkbpabelanger: if zuul can make it to the change I just merged merging and getting applied then we can delete the remaining devstack-trusty slave and restart zuul and it won't reregister things19:11
clarkbactually we don't even need to delete that if the jobs are all updated19:12
clarkbI think we can just restart zuul whenever and it iwll pick up the changes19:12
pabelangerclarkb: okay, the lack of fedora-23 images is the current issue19:12
pabelangerthey are still uploading19:12
*** mrmartin has joined #openstack-infra19:13
Shrewsrcarrillocruz: i do not tag. ask mordred19:14
rcarrillocruzah, i thought you had release powerz19:14
pabelangercool, grab one19:15
mordredShrews, rcarrillocruz: I would like to also land the other patch I put up if we can19:15
mordredif we can19:16
rcarrillocruzyeah, providing is soonish19:16
openstackgerritMichael Johnson proposed openstack-infra/project-config: Update Octavia jobs for docs job and bitrot  https://review.openstack.org/29782319:16
mordredrcarrillocruz, Shrews: https://review.openstack.org/#/c/297694/19:16
rcarrillocruzhaven't seen any bugs reported on that yet19:17
rcarrillocruzsec19:17
mordredbut I agree19:17
mordredwe should get the releaes out soon19:17
rcarrillocruzoh yeah19:17
rcarrillocruzthe nodepool thing19:17
openstackgerritMerged openstack-infra/project-config: Set devstack-trusty to 0  https://review.openstack.org/29731719:18
*** yaume has quit IRC19:19
pabelangerclarkb: ^19:19
mordredwoot!19:19
Shrewsmordred: i am tracking another potential shade bug, too. so let me dig on that one before deciding on another release19:19
*** e0ne has joined #openstack-infra19:20
clarkbpabelanger: yay19:20
openstackgerritMatt Riedemann proposed openstack/requirements: Require at least python-neutronclient 4.1.1  https://review.openstack.org/29782619:20
mordredShrews: kk19:20
openstackgerritMatthew Treinish proposed openstack-infra/shade: Add wait support to create_image_snapshot()  https://review.openstack.org/28561519:23
mtreinishmordred, Shrews: ^^^ I think that should be close19:23
rcarrillocruzgotta go now19:23
mtreinishif not ready :)19:23
rcarrillocruzlater folks19:23
EmilienMpabelanger: should I just wait and recheck later?19:23
*** mrmartin has quit IRC19:23
pabelangerEmilienM: yes, we'll need to restart zuul to clear the memory19:24
EmilienMpabelanger: ok Sir19:24
EmilienMpabelanger: i'll recheck tonight19:24
pabelangerI haven't done it before, so holding off for clarkb and / or fungi19:24
*** mrmartin has joined #openstack-infra19:25
mordredmtreinish: awesome - I was actually just poking at the consumeing code for that in nodepool - so I've got the whole area paged in :)19:25
clarkbpabelanger: oh, are you interested in doing it if I help walk you through it?19:26
fungipabelanger: well, it has about a gigabyte of ram currently used for buffers/cache and isn't really paging heavily yet. i agree it should be restarted soon but we could probably still wait for a quiet time when it's not heavily impacting performance?19:26
clarkbfungi: oh in that case +119:26
fungionly 194mb swap in use19:26
pabelangerYa, WFM. And ya, don't have an issue getting a walkthough19:26
pabelangerfungi: Hmm, EmilienM was reporting zuul wasn't picking up rechecks for some of his patches19:27
pabelangerwasn't sure if it was related to the RAM19:27
mtreinishmordred: heh, I'm just trying to make my blog backup scripts more robust and fixing/adding stuff as I hit it (and remember that I have open patches)19:27
clarkbpabelanger: the basic process is you dump the queues into a script that loads them back in after a restart, then you stop start the service (if you use restart it will try to coalesce and take forever), then you load gate then check19:28
pabelangerclarkb: ack19:28
fungipabelanger: got it, so you were theorizing it could be due to ram consumption, but had no direct evidence19:28
pabelangerfungi: so the review in question is 297442 and the last log I see in zuul is19:29
pabelanger2016-03-25 19:05:14,100 DEBUG zuul.Scheduler: Adding merge complete event for build set: <BuildSet item: <QueueItem 0x7f721cccc650 for <Change 0x7f71aa4177d0 297442,2> in silent> #builds: 0 merge state: PENDING>19:29
Shrewsmordred: no bug in shade, just in my playbook. all is good19:31
*** Jeffrey4l_ has joined #openstack-infra19:33
mordredShrews: cool19:34
*** Jeffrey4l has quit IRC19:34
mordredmtreinish: I'm going to add a follow up patch to your patch, because you did enough of the work :)19:35
*** kzaitsev_mb has quit IRC19:35
*** nadya has joined #openstack-infra19:35
mtreinishmordred: cool, just be warned it will definitely need another respin, pep8...19:35
*** vgridnev has joined #openstack-infra19:36
mordredmtreinish: cool. I'll wait19:36
mtreinishwaiting for functional tests to come back to see if those work or not, don't have a way to test that locally19:36
mordredor, rather19:36
*** flepied has joined #openstack-infra19:36
mordredmtreinish: heh. you can run them against devstack ;)19:36
mordredmtreinish: bt I do the same thing19:37
openstackgerritJim Rollenhagen proposed openstack-infra/project-config: Defer bifrost tag ACLs to release team  https://review.openstack.org/29783419:37
*** nadya has quit IRC19:37
mtreinishmordred: heh, that assumes I have run devstack at all in like the past year :)19:37
openstackgerritMonty Taylor proposed openstack-infra/shade: Split waiting for images into its own method  https://review.openstack.org/29783619:38
mordredmtreinish: there's my follow up19:38
mordredmtreinish: feel free to squash into yours if you want - or ignore - or whatever19:38
mtreinishmordred: cool19:38
mordredclarkb: zomg. need to land one little patch to shade (which is going through tests right now) and when it does, I think nodepool-shade may be functional and stuff19:39
mtreinishmordred: shouldn't we switch create_image() to use that new method too?19:39
mordredmtreinish: well.... create_image is a bit different19:39
Shrewsi don't know how you guys do it. my devstack vm is put through the works almost every day19:39
mordredmtreinish: because v1 create_image is sync19:39
mordredmtreinish: and v2 polls on tasks19:39
mtreinishah, ok19:40
mordredmtreinish: maybe we should call it wait_for_image_snapshot?19:40
mordredmtreinish: since it does not, in fact, wait for images19:40
mtreinishwell it is actually waiting on images, it's just there isn't a likely state change in any other case19:40
mordredgood point19:41
*** nadya has joined #openstack-infra19:41
clarkbmordred: you can depends on to get early results on the nodepool side I think19:42
mtreinishmordred: does shade do image creates with an http url it would be useful in that case19:42
*** gyee has quit IRC19:42
mordredclarkb: yes, I can19:43
mordredclarkb: in fact, I'll do that - in the patch I'm about to do to remove the temporary workaround19:43
*** e0ne has quit IRC19:44
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675119:45
mordredclarkb: thanks. done19:45
*** e0ne has joined #openstack-infra19:46
*** achanda has quit IRC19:47
mordredI just want to point out that that's patchset 8919:48
mtreinishmordred: so at least another 20 revs before it lands?19:50
mordredmtreinish: heh19:51
clarkbmordred: it probably would've been easier after all to not switch it all at once?19:51
clarkbI dunno19:51
clarkbthe integration tests help a lot19:51
mordredclarkb: no - the fakes sitch gets really crazy19:51
mordredclarkb: but yes - the integration tests are really key for this one19:51
*** amitgandhinz has quit IRC19:51
mordredthey've been invaluable19:51
openstackgerritMatthew Treinish proposed openstack-infra/shade: Add wait support to create_image_snapshot()  https://review.openstack.org/28561519:54
mtreinishmordred: ^^ ok should be good to go now19:54
openstackgerritMichael Johnson proposed openstack-infra/project-config: Update Octavia jobs for docs job and bitrot  https://review.openstack.org/29782319:55
mordredmtreinish: looks great!19:56
*** ybathia has quit IRC19:56
openstackgerritMerged openstack-infra/shade: Import os module as it is referenced in line 2097  https://review.openstack.org/29781719:58
mtreinishmordred: I left a comment on your follow up patch, you missed a param on the new method19:59
*** apoorvad has quit IRC19:59
*** mylu has joined #openstack-infra20:00
mordredwoot!20:00
*** pvaneck has joined #openstack-infra20:04
*** signed8bit has quit IRC20:06
*** lucas-afk has quit IRC20:09
*** apoorvad has joined #openstack-infra20:11
*** bpokorny has quit IRC20:12
*** kevinsho_ has quit IRC20:13
*** sdake_ has joined #openstack-infra20:14
*** e0ne has quit IRC20:14
*** tqtran has joined #openstack-infra20:14
*** Nikolay_St has joined #openstack-infra20:14
*** |-paul-| has joined #openstack-infra20:15
*** eil397 has quit IRC20:16
*** sdake has quit IRC20:17
*** achanda has joined #openstack-infra20:17
*** lucasagomes has joined #openstack-infra20:17
openstackgerritMerged openstack-infra/shade: Also add server interfaces for server get  https://review.openstack.org/29769420:19
*** mrmartin has quit IRC20:19
*** asettle has joined #openstack-infra20:21
*** roxanaghe has joined #openstack-infra20:22
fungipabelanger: start searching forward chronologically through the zuul debug.log for 297442,2 and you'll see it processing the patchset-created event. i think the actual issue is:20:22
fungi2016-03-25 19:02:04,879 DEBUG zuul.IndependentPipelineManager: No jobs for change <Change 0x7f71aa4177d0 297442,2>20:22
fungiis it possible puppet-swift changes have overzealous skips such that changes which only modify .rst files run no jobs?20:23
fungias teams have gotten increasingly aggressive about skipping jobs, we've seen more and more situations where they leave holes such that some changes run no jobs and so can never be merged20:24
*** salv-orl_ has quit IRC20:25
clarkbya...20:26
*** asettle has quit IRC20:26
fungiit's a corner case zuul wasn't really designed to expect, so the end result is you get no feedback from it because it's been configured to do nothing in that situation20:27
fungithis is actually a semi-recent behavior change at the request of third-party ci operators who needed to be able to run jobs only under certain conditions, and so needed to _avoid_ reporting on changes where they intentionally ran no jobs20:28
fungiprevious zuul behavior was that it reported successfully having run nothing20:28
*** jpr has quit IRC20:31
*** annegentle has joined #openstack-infra20:34
*** piet has quit IRC20:35
*** achanda has quit IRC20:35
*** Sukhdev has quit IRC20:41
*** eil397 has joined #openstack-infra20:41
*** moravec has quit IRC20:45
*** moravec has joined #openstack-infra20:48
*** ociuhandu has joined #openstack-infra20:51
*** amitgandhinz has joined #openstack-infra20:52
anteayaso hard to make everyone happy20:54
*** Jeffrey4l_ has quit IRC20:56
*** ybathia has joined #openstack-infra20:56
*** amitgandhinz has quit IRC20:57
*** Sukhdev has joined #openstack-infra20:57
*** nelsnelson has quit IRC20:58
*** amitgandhinz has joined #openstack-infra21:00
AJaegerfungi, pabelanger, EmilienM, anteaya : I think I found it ;(21:02
AJaegerwe have :  name: ^gate-(puppet-.*-|tripleo-ci-f22).*$ with a skip if21:02
AJaegerThat catches *all* puppet gate jobs since those are named gate-puppet-XXX...21:02
AJaegerpatch coming...21:02
*** Sukhdev has quit IRC21:03
*** Sukhdev has joined #openstack-infra21:04
clarkbwe are down to 23 images building21:07
clarkbtrying to keep an eye on that so the builder can be restarted when done21:07
*** david-lyle_ has joined #openstack-infra21:08
*** david-lyle has quit IRC21:08
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Fix puppet skip-if  https://review.openstack.org/29786421:10
AJaegeranteaya, EmilienM, fungi, pabelanger, this should fix 297442 not running any jobs, please check carefully ^21:10
anteayaAJaeger: wow21:11
*** kzaitsev_mb has joined #openstack-infra21:11
anteayaAJaeger: nice detective work21:11
AJaegeranteaya: fungi did the detective work, I just figured out who to fix the regex ;)21:11
anteayafungi: nice detective work21:12
*** amrith is now known as _amrith_21:12
AJaegerlet's check the zuul output on whether I was successfull. Looking at zuul output, fungi is right.21:12
anteayaAJaeger: so when testing this regex, can you put a comment on the patch what jobs it should catch and what jobs it should not catch?21:12
anteayaso I know what I'm looking for21:13
AJaegeranteaya: I put the comment up that it should not catch releasenotes or docs21:13
AJaegerbut this is for all puppet jobs, so not easy to say. Let me add a review comment21:13
anteayathanks21:13
*** david-lyle has joined #openstack-infra21:13
pabelangerfungi: Ah, nice review. Thanks21:14
*** david-lyle_ has quit IRC21:14
openstackgerritThomas Herve proposed openstack-dev/pbr: Fix wsgiref script use with oslo.config  https://review.openstack.org/29606121:15
AJaegeranteaya: done21:16
*** nadya has quit IRC21:16
AJaegeranteaya, pabelanger: https://review.openstack.org/297834 and https://review.openstack.org/297721 are two release related ACL changes, could either of you review them, please?21:17
*** achanda has joined #openstack-infra21:17
AJaegeranteaya: your question on the skip if: The skip if skips certain jobs if only release notes are updated.21:19
AJaegerBut the regex for the jobs should not match the releasenotes job at all.21:19
anteayaI guess I haven't memorized all the jobs that run on puppet repos21:20
AJaegerIt's an end: For job  gate-puppet-swift-releasenotes, the regex will not pass - and thus the skip-if is not applied21:20
*** moravec has quit IRC21:20
AJaegeranteaya: check a zuul log output ;)21:20
AJaegerthat's what I did21:20
AJaegerjust grabbed a recent review and looked at the logging output21:20
* AJaeger waves good bye and wishes everybody a peacefull easter weekend21:23
anteayaAJaeger: enjoy easter21:23
anteayathanks21:23
*** thorst has quit IRC21:25
openstackgerritMerged openstack-infra/project-config: Retiring kite and python-kitclient projects  https://review.openstack.org/29774621:27
*** thorst has joined #openstack-infra21:28
openstackgerritLakshmi N Sampath proposed openstack-infra/project-config: Install Elasticsearch for searchlight  https://review.openstack.org/29422421:29
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: WIP: Add a OVB te-broker server  https://review.openstack.org/29524321:29
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Use instack-qcow2 from cache if available and appropriate  https://review.openstack.org/28525921:29
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Upload the instack qcow image after periodic jobs  https://review.openstack.org/28525821:29
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: [NO MERGY] Test a fake periodic job  https://review.openstack.org/22978921:29
*** thorst has quit IRC21:32
*** jsavak has quit IRC21:34
clarkbxenial final beta is apparently out now21:39
clarkbso if people want to work on dib images for that now is likely a good time?21:39
clarkbprobably not much will change between release and now21:39
*** EricGonczer_ has joined #openstack-infra21:39
anteayaif folks who do so are willing to track their work in this etherpad that would be great: https://etherpad.openstack.org/p/infra-operating-system-upgrades21:40
pabelangersee that today21:40
pabelangerwas going to see if it built21:41
*** jpr has joined #openstack-infra21:41
*** sridhar_ram has joined #openstack-infra21:41
*** EricGonc_ has quit IRC21:41
*** sdake has joined #openstack-infra21:41
*** IlyaG has quit IRC21:43
*** sdake_ has quit IRC21:44
*** roxanaghe has quit IRC21:44
*** roxanaghe has joined #openstack-infra21:47
*** thorst has joined #openstack-infra21:48
clarkbdown to 21 images21:49
*** amitgandhinz has quit IRC21:49
clarkband 2021:50
*** lascii is now known as alaski21:50
pabelangerfinal hump21:50
*** annegentle has quit IRC21:51
*** sdague has quit IRC21:51
pabelangerwonder if it will ever make sense to run nodepool-builder in each region, to help speed up upload21:52
clarkbpabelanger: the issue iwt that is then we lose consistent images across clouds21:52
*** thorst has quit IRC21:52
clarkbso its a matter of balancing speed of upload against consistency21:52
pabelangerright21:52
pabelangerdidn't think of that21:53
clarkbmordred: doesn't look like that nodepool change succeeded21:58
*** apoorvad has quit IRC21:59
*** krtaylor has quit IRC21:59
*** mylu has quit IRC21:59
*** mriedem has quit IRC22:00
clarkblooks like image building still broken22:02
clarkbtime to turn on storyboar demail notifications22:06
clarkblet the flood begin!22:06
anteayayay spam22:07
*** rlandy has quit IRC22:07
clarkbhow do I tell it which email addr to sed to?22:08
openstackgerritJoshua Harlow proposed openstack/requirements: Add pydotplus for taskflow testing  https://review.openstack.org/29787722:08
*** elo has joined #openstack-infra22:08
clarkbmy lp email and my preferred openstack email are different for raisins22:08
clarkbbut I can live with this to start22:08
mordredclarkb: is it set up to do depends-on right with shade patches?22:08
*** apoorvad has joined #openstack-infra22:08
mordredoh - nm. the job that runs against shade depends-on worked22:09
clarkbmordred: oh!22:09
clarkbmordred: I understand now22:09
mordredclarkb: the one that runs against released didn't22:09
pabelangerbasic xenial dib on ubuntu trusty works22:09
pabelangerDIB_RELEASE=xenial disk-image-create -x --no-tmpfs -o test ubuntu-minimal vm22:09
mordredpabelanger: woot!22:09
pabelangernow to see what happens with our manifests22:09
mordredpabelanger: before you do that22:09
mordredpabelanger: you might want to test adding simple-init element and seeing if you can boot that22:10
mordredpabelanger: glean + xenial is my biggest worry22:10
pabelangermordred: sure22:10
clarkbya the big test is the simple-init working22:10
*** cody-somerville has quit IRC22:10
*** cody-somerville has joined #openstack-infra22:10
*** cody-somerville has quit IRC22:10
*** cody-somerville has joined #openstack-infra22:10
*** annegentle has joined #openstack-infra22:11
clarkbwe should just close https://storyboard.openstack.org/#!/story/279309 ?22:14
anteayaclarkb: ah I don't know how to tell storyboard to use a selected email address22:14
clarkbyes pypi.python.org is a single point of failure when mirroring from a source of truth, don't know that you can fix that22:14
anteayaZara: perhaps you can take a look at clarkb's question after you have eastered22:14
*** moravec has joined #openstack-infra22:14
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Use shade for all OpenStack interactions  https://review.openstack.org/22675122:15
mordredclarkb: that ^^ should fix the unit tests in nodepool22:15
clarkbanteaya: Zara it isn't urgent22:15
mordredclarkb, Shrews: I have released shade 1.6.2 with the two urgent bugfixes22:16
*** annegentle has quit IRC22:16
mordredclarkb: if this comes through green, I think it'll be time to start talking about landing the change and rolling it out (obviously not friday afternoon)22:16
anteayaclarkb: no but it is a good question22:17
*** nadya has joined #openstack-infra22:17
clarkbmordred: that would probably be a good one for saturday or sunday morning when few iwll notice should anyhting go wrong22:17
mordredyah22:17
mordredI agree22:18
mordredit's likely there will be some weird small thing that we and our testing have somehow missed22:18
clarkband there is no db schema change so revert is easy22:18
mordredexactly22:18
mordredor - seeing it, fixing it and iterating forward22:18
mordredboth can potentialy be low impact22:18
*** leakypipes has quit IRC22:19
*** markvoelker has quit IRC22:21
*** annegentle has joined #openstack-infra22:22
*** nadya has quit IRC22:22
*** moravec has quit IRC22:26
*** annegentle has quit IRC22:26
clarkbdown to 14 images22:30
clarkbmordred: also did you watch the game yesterday?22:31
mordredclarkb: yup22:32
mordredclarkb: it was not pleasing to me22:32
clarkbThe oregon hate is fun22:32
*** vgridnev has quit IRC22:33
clarkbsomeone should just beat them already if they are so bad :)22:33
*** fawadkhaliq has joined #openstack-infra22:33
*** MarkAtwood has quit IRC22:33
clarkband down to 12, hopefully I can restart this service in the next hour or so22:33
*** moravec has joined #openstack-infra22:36
mordredclarkb: right? you could also tell they were pissed at the disrespect22:36
mordredwhereas I think duke was honestly amazed to have made it to the sweet 1622:36
mordredcause as short staffed as they were this year, losing in the first weekened could have been easy to do22:37
mordredI'm pretty sure oregon oklahoma is going to be a great game22:37
*** dhellmann-phone has joined #openstack-infra22:37
zigomordred: Hi there! I have a few questions for you.22:38
clarkbmordred: yup, should be fun to watch22:38
zigomordred: Was the 2 patches you talked about merged?22:38
*** annegentle has joined #openstack-infra22:38
*** dhellmann-phone has quit IRC22:38
zigomordred: 2nd, should I write a spec about my plans for Debian packaging on infra?22:38
clarkbanteaya: pleia2 do you know if I am subscribed to a project-group and a project-group member project gets a new story or has a story update if I will get email about that? or is it only if I subscribe directly to that project?22:38
zigoOr is it a waste of time to do so?22:38
mordredzigo: I think a spec would be great! I've also got other thoughts related that I need to write down to send to you22:39
mordredzigo: but this week has been ... fun :)22:39
zigomordred: Yeah, you guys seem sooooo busy... :P22:39
zigomordred: Ok, I'll write a spec then.22:40
mordredzigo: awesome.22:40
mordredzigo: I'm almost done with the project I've been working on for the last 6 months - so my brain should soon have space for new games22:40
zigo:)22:40
zigomordred: If you have time, you can still review that one: https://review.openstack.org/#/c/294022/22:40
mordredzigo: it's open in my gertty now22:41
anteayaclarkb: I do not know22:41
zigomordred: The scripts are tested with the infra's Debian image download I got from pabelanger & fungi22:41
anteayaclarkb: I'm not subscribed to anything so am not expecting any storyboard spam22:41
anteayaclarkb: hence I can't answer your question from experience22:42
*** annegentle has quit IRC22:42
*** sdake_ has joined #openstack-infra22:44
*** GonZo2000 has joined #openstack-infra22:44
*** GonZo2000 has quit IRC22:44
*** GonZo2000 has joined #openstack-infra22:44
*** sdake has quit IRC22:47
clarkband now down toe 1022:47
Clintis that a yoga pose22:48
pabelangerclarkb: most of the centos-7 ones will never upload22:48
clarkbClint: only when nodepool does yoga22:48
clarkbpabelanger: oh22:48
pabelangerclarkb: so we are at 7 I think22:48
pabelangeror 522:48
clarkbya 5 looks about right22:48
*** krtaylor has joined #openstack-infra22:49
clarkbor 6?22:49
clarkbsomething like that22:49
pabelangerYa, once centos-7 left, we should be good22:49
pleia2clarkb: I *think* you get a new story automatically without direct subscription, but I'm not positive22:49
*** annegentle has joined #openstack-infra22:50
pabelangerzigo: haven't looked yet. However, debian-jessie is on all the clouds now. So that must count for something22:50
*** amitgandhinz has joined #openstack-infra22:50
*** annegentle has quit IRC22:50
pleia2clarkb: yeah, quite sure, I'm not directly part of JJB but I got an email when a new story was created22:50
pleia2er, "subscribed to"22:51
* clarkb waits to see if he will get that same email22:51
clarkbits also possible that storyboard and gmail don't get along22:53
clarkbwhich is why I switch to nto gmail for most things22:53
*** fawadkhaliq has quit IRC22:53
*** dimtruck is now known as zz_dimtruck22:53
pleia2I'm using gmail too, but I don't get a lot of storyboard email just yet22:53
*** mylu has joined #openstack-infra22:54
pleia27 emails since it was turned on the 22nd22:54
pleia2a comment, 3 story creations and 3 task creations22:54
*** vgridnev has joined #openstack-infra22:55
zigopabelanger: Does it work well on rax?22:55
*** sridhar_ram1 has joined #openstack-infra22:55
*** sridhar_ram has quit IRC22:55
*** fawadkhaliq has joined #openstack-infra22:56
*** vgridnev has quit IRC22:56
*** mylu has quit IRC22:59
*** baoli_ has quit IRC23:01
*** baoli has joined #openstack-infra23:02
*** amitgandhinz has quit IRC23:04
zigoI'm trying to get tempest.conf to be generated correctly, therefore, I made my tempest package build-depends on packages which contains tempest plugins, like python-murano.23:04
pabelangerzigo: it works with our puppet modules, and jenkins. So, that is the minimal we usually go with. We also do some bindep testing, basically it is ready for projects to use23:04
*** fawadkhaliq has quit IRC23:05
zigoI'm expecting to get [service_available]/murano, but it's not happening, the option isn't there, even though I've added --namespace murano_tempest_tests.config23:05
zigoWhat am I missing?23:05
clarkbpabelanger: down to 3 images23:05
clarkbso close23:05
zigopabelanger: Are you talking about my tempest package here? :)23:06
*** piet has joined #openstack-infra23:06
clarkbzigo: about the debian-jessie images23:07
mordredclarkb: https://review.openstack.org/#/c/226751/ ALL GREEN!!!!!23:07
pabelangerclarkb: did you purge the centos-7? or did they just drop?23:07
pabelangerzigo: no sure, haven't seen it23:08
mordredjeblair, Shrews, yolanda: ^^23:08
zigopabelanger: Who can I ask for Tempest questions?23:08
*** sputnik13 has quit IRC23:08
clarkbpabelanger: they rotate on their own23:09
clarkbpabelanger: once its just centos-7 in one of the qcow2 clouds I/we/you can restart the builder23:09
pabelangerzigo: have you looked at the work EmilienM did with puppet-openstack-integration jobs? He have tempest running in the gate after puppet provisions everything23:09
clarkbwhy is new gerrit diff so bad?23:10
clarkbif you ^F and search it doesn't show you results in the old side23:10
mordredclarkb: because it hates happiness23:10
clarkbwhat a useless pos23:10
pabelangerclarkb: if its safe to restart, I can do it23:10
mordredclarkb: you're not supposed to want that23:10
clarkbpabelanger: not yet rax-iad still has image uploads23:10
mordredclarkb: try to be more cloud native in your thinking23:10
zigopabelanger: I have my own stuff which is doing exactly the same thing but with packages only, no puppet involved.23:10
clarkbmordred: the best part is my browser would do it for free if they just didn't interfere23:10
pabelangerclarkb: right, once they are done23:10
*** IlyaG has joined #openstack-infra23:10
zigopabelanger: When I was working with EmilienM, we were always doing that: 1st stage, only packages, 2nd stage, puppet.23:10
mordredclarkb: you should probably not use web browsers. they're not cloud native. you should probably be using snapchat23:11
*** annegentle has joined #openstack-infra23:11
zigopabelanger: I intend to re-do that, in a cleaner way, so we have nice gating for both packaging and puppet.23:11
clarkbpabelanger: yup the centos-7 uploads that are bad sould be counted as failures then when builder is back up with new config make a new image with qcow2s then they can upload23:11
zigopabelanger: My gating scripts for most server packages is already functional.23:11
clarkbmordred: wow23:11
mordredclarkb: I'm trying to be as absurd as I can - but I still can't actually get ot the level of absurdity of the things people tell us when we tell them something is broken23:11
zigopabelanger: I'm currrently trying to add things like murano, barbican, manila, designate ...23:12
anteayamordred: does snapchat know about control F?23:12
clarkbmordred: thats the thing I don't feel like any of this is controversial. ^F should find me all cases not just those in half the page23:12
mordredanteaya: it does if you take a video of control f23:12
clarkbmordred: and changes should know who their parents and children are23:12
anteayamordred: awesome23:12
*** mylu has joined #openstack-infra23:12
clarkbmordred: these are not controversial opinions I hope23:12
*** fawadkhaliq has joined #openstack-infra23:12
zigopabelanger: And this needs tempest.conf to include the fragments of conf included in the plugins in these server packages.23:12
mordredclarkb: yah.I agree with you. but I also agree with you that servers should have IPs23:12
*** fawadkhaliq has quit IRC23:12
pleia2mordred: grumpy old man23:12
mordredpleia2: :)23:12
pleia2:D23:13
mordredpleia2: THE NODEPOOL-SHADE PATCH IS GREEN23:13
pleia2the search thing does make me crazy23:13
*** fawadkhaliq has joined #openstack-infra23:13
mordredoh sorry23:13
anteayame too23:13
clarkbmordred: not sure I like https://review.openstack.org/#/c/226751/90/nodepool/config.py@175 simply beacuse it isn't related to the change23:13
mordreddidn't mean to yell - just excited23:13
anteayaI also would love to be able to control F in the gui23:13
pabelangerWoah.... Creating server with hostname ubuntu-xenial-oslab-1 in oslab from image ubuntu-xenial for node id: 123:13
pleia2mordred: yay!23:13
pabelangernow to see if SSH works23:13
anteayaI've taken to downloading the patch and searching through it locally23:13
clarkbmordred: you need a separate "cloud config is reuired now" change forthat23:13
mordredclarkb: the image format line? or the default for pool?23:13
clarkbmordred: the image format line23:14
*** moravec has quit IRC23:14
mordredclarkb: it'll be the same effect - it doesn't change behavior23:14
clarkbit bsaically requires cloud config which I don't think we do yet23:14
mordredI mean, I can pull it out23:14
clarkbis the concern23:14
mordredwe do - shade requires the library so we've had that for a while23:14
clarkbthe lib but not the actual config?23:14
mordredeven if you don't have any config, we create one for you earlier in the file23:15
clarkboh23:15
mordredclarkb: line 14423:15
clarkbok nevermind then23:15
pabelangerzigo: Ya, I hope to have some time by the summit to test out your work23:15
*** annegentle has quit IRC23:15
mordredclarkb: also - this shows the new floating ip flow happening: http://logs.openstack.org/51/226751/90/check/gate-dsvm-nodepool-src-shade/f3977af/logs/screen-nodepool.txt.gz#_2016-03-25_22_49_51_11423:16
zigopabelanger: So, down to my original question: any idea why oslo-config-generator isn't picking-up [service_available]murano=True ?23:17
mordredclarkb: which is "get me a server. get me the server's port. create a floating ip on the server's port"23:17
*** salv-orlando has joined #openstack-infra23:17
clarkbmordred: and then the delete is delete any floating ips on the port, delete port, delete server?23:17
mordredclarkb: just delete fips and then delete server23:18
mordredclarkb: because the port goes when you delete the server23:18
*** knikolla has quit IRC23:18
*** ybathia has left #openstack-infra23:20
*** piet has quit IRC23:21
*** _amrith_ is now known as amrith23:21
*** markvoelker has joined #openstack-infra23:21
*** eil397 has quit IRC23:22
zaroclarkb: wow, there's a significant performance improvement with packed-refs file instead of loose objects.23:22
*** annegentle has joined #openstack-infra23:22
clarkbzaro: yay23:22
clarkbpabelanger: down to one image23:23
mordredzaro: that's great news23:23
anteayagoing offline for the weekend23:24
clarkbmordred: line 933 https://review.openstack.org/#/c/226751/90/nodepool/nodepool.py is the negation there correct?23:24
zaronova clone went from 3m down to 0.6s23:24
anteayawell be around monday for the third party meeting23:24
clarkbit almost looks like the not is a holdover from the old code but it shouldn't be there now?23:24
anteayahappy easter everyone23:24
*** dhellmann has quit IRC23:24
clarkbzaro: nice23:24
zaroi'll report for everyone at next meeting.23:25
clarkbzaro: maybe write it up in an email response to the original thread so we can preview it?23:25
*** fawadkhaliq has quit IRC23:26
zarosure i can do that as well.  preview or review?23:26
*** markvoelker has quit IRC23:26
*** fawadkhaliq has joined #openstack-infra23:26
clarkbwell we can discuss it in the meeting but being abel to see the data before hand would be good23:26
zaroi see.23:27
*** nadya has joined #openstack-infra23:27
*** dhellmann has joined #openstack-infra23:27
*** sridhar_ram1 is now known as sridhar_ram23:28
*** abe_music has quit IRC23:28
mordredclarkb: yes. delete_keypair returns True if it deleted something, False if there was nothing to delete23:28
mordredclarkb: (general shade logic is if you ask us to delete sometihng, and it doesn't exist, that that's not an exception - but we do want to let you know in case it was unexpected)23:29
clarkbright so you want to remove the not23:29
clarkband have an else that logs "failed to delete keypair"23:29
clarkbI can write a comment in gerrit if it eps23:30
pabelangerokay, totally blind. How do we setup console password with diskimage-builder, figured DEV_USER element did it23:30
pabelangerdevuser*23:30
clarkbpabelanger: I htink devuser will do it23:31
clarkbit might default to pulling its password from the cloud init stuff ?23:31
*** nadya has quit IRC23:32
zigomordred: Andreas Jaeger suggests that I put my build scripts within a package, and install that package on every build. I'm all for that, and I would like to push the scripts within openstack-pkg-tools, however, I know no way to publish a package for that use currently, so how should I do?23:34
clarkbpabelanger: three are now building imges, should I restart or do you want to?23:34
pabelangerclarkb: you can restart23:35
pabelangerdigging into devuser23:35
clarkbmordred: another question about that change, it looks like we continue to keep an image and network cache in nodepool? do we need to do that with shade caching stuff?23:35
*** mriedem has joined #openstack-infra23:36
clarkbpabelanger: all done23:36
openstackgerritZhang Ni proposed openstack-infra/project-config: Conveyor focuses on cloning and migrating Openstack resources.  https://review.openstack.org/29695123:39
pabelangerclarkb: will nodepool kick off another build for the missing centos-7 dibs?23:40
mordredclarkb: not really - but I thought we could rip that out with a follow up23:40
*** jcooley_ has joined #openstack-infra23:40
*** baoli has quit IRC23:40
*** apoorvad has quit IRC23:40
clarkbmordred: ok23:40
*** fawadkhaliq has quit IRC23:41
clarkbmordred: for the keydelete were you going to fix that? should I leave a comment in gerrit?23:41
*** fawadkhaliq has joined #openstack-infra23:41
mordredclarkb: on the negation - the only thing it's doing is logging if it does delete something ... are you suggesting that we should log both cases23:41
mordredclarkb: yes please, leave comment23:41
clarkbmordred: you said it returns true if it does delete and false if it doesn't23:42
clarkbthat means it only logs "success" when it fails23:42
clarkbso I think you need to remove the not, and add an else23:42
fungii am entertaining visiting friends, but will note that gertty has a keyword search which works in diff view and does _not_ arbitrarily skip one version or the other23:43
clarkboh nice you added nodepool deletes for the two images23:44
clarkbin the integratio ntests23:44
*** edmondsw has quit IRC23:45
clarkbmordred: comment posted23:46
*** fawadkhaliq has quit IRC23:47
*** fawadkhaliq has joined #openstack-infra23:47
*** briancline has quit IRC23:48
*** briancline has joined #openstack-infra23:49
clarkbI am quickly fading so don't trust myself to review the really interesting bits in provider_manager23:49
clarkbtime to watch basketball and weekend23:49
mordredclarkb: kk. thanks!23:53
*** Sukhdev has quit IRC23:56
*** ajmiller has quit IRC23:58
*** annegentle has quit IRC23:58
*** hockeynut has quit IRC23:59
*** yamahata has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!