Monday, 2018-04-16

pabelangeryah, looks to be image_list.sh from devstack00:01
pabelangerso, if you run that on gentoo, it must be failing00:01
pabelangerI am guessing: http://git.openstack.org/cgit/openstack-dev/devstack/tree/tools/image_list.sh#n2100:02
*** bobh has joined #openstack-infra00:02
ianwwe really could skip that on platforms that are not targeted for devstack00:03
prometheanfirethe source?00:03
*** jamesmcarthur has joined #openstack-infra00:03
pabelangerianw: downside is we're not cache things like cirros, etc. We should first see if OSA uses it00:04
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove installed packages before pip install  https://review.openstack.org/56147900:04
pabelangerlooks like maybe cirros and etcd now00:05
ianwpabelanger: i doubt they would be, but i also doubt the jobs know where to look for the cached files too00:05
ianwthere's a bunch of vmdk's and other random images too00:06
ianwpabelanger: ^^^ that works to get a pip-10 enabled centos ... testing other platforms.  also found that since we dropped epel we weren't really doing what we thought we were doing installing/uninstall pip on centos anyway00:06
pabelangerianw: not random, as far as I see. Just cirros and etcd00:06
pabelangerbut we still want to call cache-devstack for things like get-pip.py and stackviz00:07
*** bobh has quit IRC00:07
openstackgerritMerged openstack-infra/project-config master: Remove apply of iptables rules for gentoo  https://review.openstack.org/56147800:07
*** eernst has joined #openstack-infra00:07
*** dingyichen has joined #openstack-infra00:08
*** d0ugal_ has quit IRC00:10
*** bobh has joined #openstack-infra00:11
*** bobh has quit IRC00:16
*** bobh has joined #openstack-infra00:23
*** d0ugal_ has joined #openstack-infra00:24
*** bobh has quit IRC00:28
*** owalsh_ has joined #openstack-infra00:29
*** bobh has joined #openstack-infra00:30
*** owalsh has quit IRC00:31
ianwhmm, ok, 561479 makes "virtualenv" create a python3 virtualenv by default, which has caused problems before00:33
*** lbragstad has joined #openstack-infra00:34
* prometheanfire is tired of 'just one more thing'00:35
*** bobh has quit IRC00:35
*** eernst has quit IRC00:36
ianwyou might like to get out of the software business then :)00:37
ianwthat said, i'm trying to knockdown and rebuild a house, and that's a constant source of physical "oh, guess what, one more thing"-isms00:38
*** slaweq has joined #openstack-infra00:39
*** dims has quit IRC00:42
prometheanfireyep00:42
*** slaweq has quit IRC00:44
*** bobh has joined #openstack-infra00:46
*** lbragstad has quit IRC00:49
*** bobh has quit IRC00:50
*** bobh has joined #openstack-infra00:52
*** bobh has quit IRC00:55
*** bobh has joined #openstack-infra00:55
*** edmondsw has joined #openstack-infra00:56
*** sambetts_ has quit IRC00:59
*** lbragstad has joined #openstack-infra00:59
*** sambetts_ has joined #openstack-infra01:00
*** salv-orl_ has joined #openstack-infra01:04
*** salv-orlando has quit IRC01:07
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: docs: add build status documentation  https://review.openstack.org/56148901:08
*** d0ugal__ has joined #openstack-infra01:08
*** d0ugal_ has quit IRC01:11
*** d0ugal has joined #openstack-infra01:14
*** lbragstad has quit IRC01:14
*** hongbin_ has joined #openstack-infra01:14
prometheanfirea 80G VM is too small for caching all the files :|01:14
ianwpabelanger: ohh, so now i'm seeing the consequences of fedora's new pip policy.  we've got /usr/bin/pip as verison 2 , and /usr/local/bin/pip as pip301:15
ianwpromethanfire: that can't be ... the images are about 12-15 gb or so?01:15
*** d0ugal__ has quit IRC01:16
prometheanfireianw: I build gentoo stages there too01:17
prometheanfire12G available01:17
*** sambetts_ has quit IRC01:19
*** sambetts_ has joined #openstack-infra01:21
ianwoh, well yeah if other stuff is building bets are off01:22
prometheanfire:D01:23
*** jamesmcarthur has quit IRC01:23
*** jamesmcarthur has joined #openstack-infra01:23
prometheanfireI still need to figure out what to do about the other fails01:23
prometheanfirewhy is it trying rpm01:23
*** owalsh_ has quit IRC01:29
*** owalsh has joined #openstack-infra01:29
*** edmondsw has quit IRC01:33
ianwprometheanfire: that looks like it's in "is_package_installed" and i would say the guessing is all completely wrong for gentoo01:33
*** edmondsw has joined #openstack-infra01:33
ianwi'd prefer to see us excise bits we don't need from cache-devstack element, rather than put hacks for gentoo into devstack when there's no interest in running things there01:33
prometheanfireianw: ya, I'm updating it now01:36
prometheanfireok, up to 34G on cleanup :D01:37
*** edmondsw has quit IRC01:38
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove installed packages before pip install  https://review.openstack.org/56147901:41
prometheanfireianw: I still don't like how I have to even touch the devstack code to not use devstack01:41
*** eernst has joined #openstack-infra01:45
ianwpromethanfire: you shouldn't.  we should be looking at 55-cache-devstack-repos and skipping running things in there01:46
ianwas a first though, probably just DIB_DEVSTACK_CACHE_DISABLE=1 and exit out if set01:46
*** jamesmcarthur has quit IRC01:49
*** VW has joined #openstack-infra01:51
*** eernst has quit IRC01:51
prometheanfirewell, I posted a devstack patch01:52
prometheanfirehttps://review.openstack.org/56149201:52
*** masuberu has joined #openstack-infra01:54
prometheanfireianw: I'm not sure that pabelanger would approve of that01:56
prometheanfireianw: I think once that devstack patch merges I should be able to test again though, I'm hoping all it wanted was to check if a package is installed, if not I'm probably screwed going that route and should just exit out of 55-cache-devstack-repos if DIB_DEVSTACK_CACHE_DISABLE=101:57
*** masber has quit IRC01:58
*** masber has joined #openstack-infra02:00
*** masuberu has quit IRC02:01
*** jbadiapa has quit IRC02:01
*** jbadiapa has joined #openstack-infra02:02
pabelangerprometheanfire: ianw: I was saying, if OSA is running tempest or anything other testing tools, we'll want to make sure cirros is cache on the gentoo images. Which today comes from cache-devstack element.  I also see some value in trying to keep all our images in sync as much as possible.02:03
*** gongysh has joined #openstack-infra02:06
ianwpabelanger: possibly, but the whole caching thing is really tied to devstack; in that it uploads the image into glance.  for example, we're not thinking about OSA or any external users when we bump the version being cached in there02:13
*** masber has quit IRC02:13
pabelangerianw: yah, understood. However projects are using those files since downloading them all the time from downloads.cirros-cloud.net can be flaky. If its not much work to add gentoo support for image-list.sh, I'd say we try other wise, disabling it would be 2nd choice02:19
prometheanfirepabelanger: do you know of what other than what I did in https://review.openstack.org/561492 I02:20
prometheanfirepabelanger: do you know of what other than what I did in https://review.openstack.org/561492 I'd have to do?02:20
pabelangerprometheanfire: ianw: why don't we just delete http://git.openstack.org/cgit/openstack-dev/devstack/tree/tools/image_list.sh#n21 running it locally it still works as excepted02:23
pabelangerI have no idea why we even source functions, I cannot see anything using it02:24
prometheanfirepabelanger: because the repo tool doesn't let me02:24
prometheanfirecache-openstack caches devstack from master02:24
pabelangerremote:   https://review.openstack.org/561495 Stop sourcing of functions02:25
pabelangerprometheanfire: ianw : ^02:26
pabelangersee what brakes, then backport to stable branches02:26
ianwpabelanger: if we're keeping this to allow external tools to poke into the devstack cache, then i'm not for that.  since like i said, it's not a generic cache of cirros; it's a cache of the version of cirros that devstack uploads into glance02:26
prometheanfiresure, I'm personally only concerned about master02:26
prometheanfirebut adding myself for cc02:27
ianwetcd is similar; i wouldn't like it if devstack bumps our versions of things then we start triggering failures in other places02:27
prometheanfirean independant cacher is needed it sounds like?02:28
pabelangerianw: right, just pointing out other projects besides devstack use those images today. So we likely want to refactor this into a more generic caching tool02:28
ianwdo they though?02:28
ianwI'm sure i may even have changes out for a more generic cacher, i've definitely hacked on it for something02:29
pabelangerhttp://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci-quickstart/config/testenv/multinode.yml#n2902:29
pabelangerhttp://git.openstack.org/cgit/openstack/puppet-openstack-integration/tree/run_tests.sh#n14702:31
pabelangerjust 2 examples02:31
*** rosmaita has joined #openstack-infra02:31
ianwthat's doesn't really make it right ... i've approved devstack changes to bump cirros before without any thought to that at all02:32
ianwnamespacing them probably would have helped i guess, putting in a devstack dir02:32
ianwi'm still coming down towards being fine with gentoo not having those cached files, and if required, we find a less fragile way to cache them02:33
*** Sukhdev has joined #openstack-infra02:34
pabelangeryah, I guess this is the first image coming online that won't be using devstack, which is a little surprising to me. I thought that was the goal, supporting devstack. If everybody is okay with that, then I guess we can skip cache-devstack element. But it will make gentoo a little different then all our other images, eg: also not install get-pip.py with pip-and-virtualenv element.02:38
*** psachin has joined #openstack-infra02:39
ianwi don't think they're tied together?02:40
ianwi don't mean skip all of the cache-devstack, just the image getting bit02:40
*** rosmaita has quit IRC02:41
prometheanfirepabelanger: ianw: I'm fine with eventually supporting devstack, it just wasn't my intention at this time02:43
prometheanfireusing gentoo to make a python3.7 tester could be nice02:43
*** janki has joined #openstack-infra02:45
pabelangerisn't that mostly what cache-devstack does these days? image caching?  sure we do pip / stackviz / zanatacli but I think the more we dive into it, we could split those 3 into a new generic cache element, then have gentoo drop cache-devstack all together. Then start work on our generic-cache element02:45
* prometheanfire would be happy with that02:47
ianwyou can just s/cache-devstack/cache-stuff/ really02:47
*** edmondsw has joined #openstack-infra02:48
ianwthe devstack bits is just the script in extras.d ... which writes out the sources file, which is read by the source-repository element02:48
ianwjust uploading for test, but i think i've sorted out the pip10 + centos + fedora27-magic situation on centos & fedora builds at least02:51
*** edmondsw has quit IRC02:52
*** wolverineav has quit IRC03:06
*** wolverineav has joined #openstack-infra03:06
*** bobh has quit IRC03:10
*** bobh has joined #openstack-infra03:11
*** wolverineav has quit IRC03:11
*** bobh has quit IRC03:15
*** VW has quit IRC03:17
*** dklyle has quit IRC03:18
*** bobh has joined #openstack-infra03:22
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove installed packages before pip install  https://review.openstack.org/56147903:26
ianwarrgh, i guess suse is in on that path too :/03:27
*** bobh has quit IRC03:27
prometheanfireianw: can you tell me why pip is installed in two locations (or whatever the problem is)03:30
prometheanfireI don't want gentoo falling in the same trap03:30
*** bobh has joined #openstack-infra03:30
ianwpromethanfire: in the fedora case, it's because they changed things with the path setup in python2 v python3 i believe in fedora27.  now it installs stuff in /usr/local first, previously it didn't03:31
prometheanfireah03:32
prometheanfirewe do some stuff with symlink switching between two default python versions03:32
prometheanfireeselect python set python3.603:32
prometheanfireor whatever03:32
prometheanfirelrwxrwxrwx 1 root root 31 Dec 20 17:57 /usr/bin/pip -> ../lib/python-exec/python-exec203:33
*** Sukhdev has quit IRC03:33
prometheanfirethis is the actual file https://gist.github.com/prometheanfire/8c7d7a9b4905a6dbe5ae8ae87231d67d03:34
*** bobh has quit IRC03:34
*** hongbin_ has quit IRC03:35
*** lpetrut has joined #openstack-infra03:36
ianwwell the whole thing is really just to make it so "pip" is python2, and "pip3" is python3, and "virtualenv" gives you a python2 env by default03:36
ianwif that's the situation, then things should be ok03:36
*** zhipeng has joined #openstack-infra03:37
prometheanfirewe still has pip2 and pip2.7 and so on links, but they are symlinks like the one above03:38
prometheanfireso I guess we are good03:38
prometheanfirereally we should be calling things by their python versions03:39
ianwyes, the only problem is for about 20 years people didn't do that :)03:39
prometheanfireyep03:39
*** bobh has joined #openstack-infra03:42
*** wolverineav has joined #openstack-infra03:42
*** ramishra has joined #openstack-infra03:45
*** bobh has quit IRC03:46
*** zhangfei has joined #openstack-infra03:47
*** lbragstad has joined #openstack-infra03:48
*** masber has joined #openstack-infra03:49
*** bobh has joined #openstack-infra03:52
*** bobh has quit IRC03:57
*** dhajare has joined #openstack-infra04:00
*** zhipeng has quit IRC04:03
*** bobh has joined #openstack-infra04:03
*** pbourke_ has quit IRC04:05
*** lpetrut has quit IRC04:05
*** pbourke_ has joined #openstack-infra04:05
*** dhajare has quit IRC04:07
*** bobh has quit IRC04:08
*** hrubi has quit IRC04:09
*** hrubi has joined #openstack-infra04:11
*** bobh has joined #openstack-infra04:18
*** caphrim007 has quit IRC04:19
*** jamesmcarthur has joined #openstack-infra04:20
*** caphrim007 has joined #openstack-infra04:20
*** bobh has quit IRC04:23
*** caphrim007 has quit IRC04:24
*** jamesmcarthur has quit IRC04:24
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove installed packages before pip install  https://review.openstack.org/56147904:24
ianwnow with even more switching for suse04:25
*** udesale has joined #openstack-infra04:28
*** bobh has joined #openstack-infra04:30
*** zhipeng has joined #openstack-infra04:32
*** ramishra has quit IRC04:33
*** dhajare has joined #openstack-infra04:33
*** bobh has quit IRC04:35
*** ramishra has joined #openstack-infra04:35
*** zhipeng has quit IRC04:35
*** edmondsw has joined #openstack-infra04:36
*** s-shiono has joined #openstack-infra04:39
*** ramishra has quit IRC04:39
*** edmondsw has quit IRC04:40
*** slaweq has joined #openstack-infra04:41
*** ramishra has joined #openstack-infra04:41
*** bobh has joined #openstack-infra04:44
*** slaweq has quit IRC04:45
*** bobh has quit IRC04:49
*** pgadiya has joined #openstack-infra04:50
prometheanfirestop sourcing passed04:51
*** bobh has joined #openstack-infra04:55
*** claudiub|2 has joined #openstack-infra04:55
*** bobh has quit IRC04:59
*** vivsoni has joined #openstack-infra05:00
*** ramishra has quit IRC05:00
*** wolverineav has quit IRC05:01
*** wolverineav has joined #openstack-infra05:01
*** bobh has joined #openstack-infra05:02
*** ramishra has joined #openstack-infra05:03
*** bobh has quit IRC05:07
*** dsariel has joined #openstack-infra05:08
*** gongysh has quit IRC05:09
*** gongysh has joined #openstack-infra05:12
*** bobh has joined #openstack-infra05:14
*** bobh has quit IRC05:19
*** gongysh has quit IRC05:24
*** bobh has joined #openstack-infra05:24
*** d0ugal has quit IRC05:27
*** bobh has quit IRC05:29
*** d0ugal has joined #openstack-infra05:29
*** bobh has joined #openstack-infra05:35
*** pgadiya has quit IRC05:36
*** dhajare has quit IRC05:36
*** bobh has quit IRC05:38
*** dpawlik has joined #openstack-infra05:39
*** dpawlik has quit IRC05:39
*** bobh has joined #openstack-infra05:44
*** ramishra has quit IRC05:44
*** gongysh has joined #openstack-infra05:45
*** ramishra has joined #openstack-infra05:46
*** e0ne has joined #openstack-infra05:49
*** dingyichen has quit IRC05:49
*** bobh has quit IRC05:49
*** dingyichen has joined #openstack-infra05:50
*** tojuvone has joined #openstack-infra05:50
*** tojuvone has left #openstack-infra05:50
*** dingyichen has quit IRC05:56
*** vivsoni has quit IRC05:56
*** dingyichen has joined #openstack-infra05:57
*** vivsoni has joined #openstack-infra05:57
*** zhangfei has quit IRC05:57
*** dingyichen has joined #openstack-infra05:59
*** ramishra has quit IRC06:00
*** ramishra has joined #openstack-infra06:02
*** AJaeger has quit IRC06:03
*** iranzo has joined #openstack-infra06:03
*** wolverineav has quit IRC06:08
*** iranzo has quit IRC06:08
*** wolverineav has joined #openstack-infra06:08
*** zhangfei has joined #openstack-infra06:10
*** bobh has joined #openstack-infra06:11
*** wolverineav has quit IRC06:12
*** iranzo has joined #openstack-infra06:14
*** iranzo has quit IRC06:14
*** iranzo has joined #openstack-infra06:14
*** bobh has quit IRC06:16
*** jogo has quit IRC06:18
openstackgerritMatthew Thode proposed openstack-infra/project-config master: enable the right iptables services on gentoo  https://review.openstack.org/56147206:20
*** wolverineav has joined #openstack-infra06:20
*** pgadiya has joined #openstack-infra06:20
*** pgadiya has quit IRC06:20
*** bobh has joined #openstack-infra06:21
*** pgadiya has joined #openstack-infra06:24
*** pgadiya has quit IRC06:24
*** edmondsw has joined #openstack-infra06:24
*** bobh has quit IRC06:25
*** aojea has joined #openstack-infra06:27
*** edmondsw has quit IRC06:28
*** lpetrut has joined #openstack-infra06:29
*** jchhatbar has joined #openstack-infra06:29
*** bobh has joined #openstack-infra06:30
*** salv-orlando has joined #openstack-infra06:31
*** salv-orl_ has quit IRC06:31
*** janki has quit IRC06:32
*** udesale_ has joined #openstack-infra06:34
*** bobh has quit IRC06:35
*** udesale_ has quit IRC06:35
*** aviau has quit IRC06:35
*** aviau has joined #openstack-infra06:35
*** udesale_ has joined #openstack-infra06:35
*** udesale has quit IRC06:38
*** sambetts_ has quit IRC06:38
*** vivsoni has quit IRC06:39
*** sambetts_ has joined #openstack-infra06:40
*** bhavik1 has joined #openstack-infra06:41
*** andreas_s has joined #openstack-infra06:41
*** wolverineav has quit IRC06:41
*** jtomasek has joined #openstack-infra06:46
*** florianf has joined #openstack-infra06:46
*** wolverineav has joined #openstack-infra06:48
*** vivsoni has joined #openstack-infra06:48
*** snapiri has joined #openstack-infra06:49
*** dhajare has joined #openstack-infra06:50
*** hashar has joined #openstack-infra06:50
*** wolverineav has quit IRC06:50
*** slaweq has joined #openstack-infra06:51
*** bobh has joined #openstack-infra06:52
*** armaan_ has joined #openstack-infra06:54
*** armaan has quit IRC06:54
*** rcernin has quit IRC06:56
*** bobh has quit IRC06:57
*** jpich has joined #openstack-infra06:59
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove installed packages before pip install  https://review.openstack.org/56147907:00
*** bobh has joined #openstack-infra07:02
*** bobh has quit IRC07:07
*** bobh has joined #openstack-infra07:13
*** pcaruana has joined #openstack-infra07:13
*** jogo has joined #openstack-infra07:15
*** jogo has joined #openstack-infra07:15
*** pgadiya has joined #openstack-infra07:17
*** pgadiya has quit IRC07:17
*** bobh has quit IRC07:18
*** jamesmcarthur has joined #openstack-infra07:20
*** tmorin has joined #openstack-infra07:21
*** tesseract has joined #openstack-infra07:21
*** jamesmcarthur has quit IRC07:25
*** tosky has joined #openstack-infra07:26
*** udesale__ has joined #openstack-infra07:32
*** tesseract has quit IRC07:33
*** udesale_ has quit IRC07:35
*** tesseract has joined #openstack-infra07:35
*** amoralej|off is now known as amoralej07:42
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Remove installed packages before pip install  https://review.openstack.org/56147907:44
*** ralonsoh has joined #openstack-infra07:44
*** dpawlik has joined #openstack-infra07:47
*** threestrands has quit IRC07:47
*** jpena|off is now known as jpena07:51
*** bobh has joined #openstack-infra07:54
*** pcichy has joined #openstack-infra07:55
*** evrardjp has joined #openstack-infra07:55
*** shardy has joined #openstack-infra07:56
*** ralonsoh_ has joined #openstack-infra07:56
*** ralonsoh has quit IRC07:58
*** migi has quit IRC07:59
*** migi has joined #openstack-infra07:59
*** migi has quit IRC08:00
*** sambetts_ has quit IRC08:09
*** lucas-afk is now known as lucasagomes08:10
*** gfidente has joined #openstack-infra08:10
*** gfidente has joined #openstack-infra08:10
*** jaosorior has joined #openstack-infra08:10
*** sambetts_ has joined #openstack-infra08:13
*** edmondsw has joined #openstack-infra08:13
*** edmondsw has quit IRC08:17
*** pblaho has joined #openstack-infra08:19
*** bhavik1 has quit IRC08:19
*** gongysh has quit IRC08:22
*** gongysh has joined #openstack-infra08:25
*** jlibosva has joined #openstack-infra08:26
*** derekh has joined #openstack-infra08:28
*** armaan has joined #openstack-infra08:34
*** armaan_ has quit IRC08:35
*** gongysh has quit IRC08:40
*** electrofelix has joined #openstack-infra08:40
*** gongysh has joined #openstack-infra08:43
*** dingyichen has quit IRC08:45
*** s-shiono has quit IRC08:47
*** kjackal has joined #openstack-infra08:54
openstackgerritBerezovsky Irena proposed openstack-infra/project-config master: Remove legacy job: legacy-install-dsvm-dragonflow-kuryr-kubernetes  https://review.openstack.org/56145908:54
*** ralonsoh__ has joined #openstack-infra09:02
*** larainema has joined #openstack-infra09:02
*** kjackal has quit IRC09:03
*** ralonsoh_ has quit IRC09:05
*** kjackal has joined #openstack-infra09:20
*** gfidente has quit IRC09:26
*** hrubi has quit IRC09:35
*** tmorin has quit IRC09:36
*** armaan has quit IRC09:41
*** zoli is now known as zoli|lunch09:47
*** zoli|lunch is now known as zoli09:47
*** gongysh has quit IRC09:51
*** ociuhandu has joined #openstack-infra09:56
*** kjackal_ has joined #openstack-infra09:56
*** ociuhandu has quit IRC09:58
*** pblaho has quit IRC09:59
*** kjackal has quit IRC09:59
*** gfidente has joined #openstack-infra10:00
*** gfidente has joined #openstack-infra10:00
*** krenczewski has joined #openstack-infra10:02
*** dpawlik has quit IRC10:05
*** dpawlik has joined #openstack-infra10:05
*** pbourke_ is now known as pbourke10:05
*** pblaho has joined #openstack-infra10:07
*** caphrim007 has joined #openstack-infra10:10
ianwclarkb / pabelanger : https://review.openstack.org/#/c/561479/ ready to review for dib pip10 fixes to centos/fedora/opensuse.  not aware of issues with xenial but lmn10:13
*** caphrim007 has quit IRC10:16
*** alexchadin has joined #openstack-infra10:16
dalvarezhi folks, can you pls take a look into: https://review.openstack.org/#/c/522609/ ?10:33
*** nicolasbock has joined #openstack-infra10:33
*** armaan has joined #openstack-infra10:35
*** nicolasbock has quit IRC10:39
*** stakeda has quit IRC10:42
*** gfidente has quit IRC10:44
*** armaan has quit IRC10:45
*** rkukura has quit IRC10:46
*** garyk has joined #openstack-infra10:52
garykanyone know why the following stable gate check fails - http://logs.openstack.org/22/561522/1/check/build-openstack-sphinx-docs/cd99af8/job-output.txt.gz10:52
garykall stable/queens seem to be broke. not sure what to do here10:52
*** efoley has joined #openstack-infra10:57
*** slagle has joined #openstack-infra10:57
*** lucasagomes is now known as lucas-hungry11:04
*** udesale__ has quit IRC11:05
*** sambetts_ is now known as sambetts11:06
*** caphrim007 has joined #openstack-infra11:07
*** caphrim007 has quit IRC11:11
*** zhangfei has quit IRC11:12
*** kjackal has joined #openstack-infra11:13
*** armaan has joined #openstack-infra11:13
*** kjackal_ has quit IRC11:16
openstackgerritMerged openstack-infra/zuul master: Remove docker instructions and build:docker helper command  https://review.openstack.org/56010511:17
*** nicolasbock has joined #openstack-infra11:17
fricklergaryk: might be related to https://review.openstack.org/553056 and recent changes to zuul to job inheritance. mordred or AJaeger might know more. "note:: TODO(mordred) ZOMG DELETE THIS" ... http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/roles/neutron-horizon-hack/README.rst11:20
fricklergaryk: actually the tools/tox_install.sh in stable for neutron-vpnaas seems to violate the "The script must allow invocation with the single ``constraints-file`` argument as well."11:21
*** jamesmcarthur has joined #openstack-infra11:22
garykfrickler: thanks. i wonder if we need to do all of these changes for the stable projects.11:25
*** jamesmcarthur has quit IRC11:26
garykfrickler: things were working on the 12th and something has broken us since then.11:27
fricklergaryk: do you have a pointer to a passing patch? for vpnaas I only found ones that seemed pretty old11:29
garykfrickler: FYI - https://review.openstack.org/#/c/560893/ - if you look on the 12th April gate was good. The rebase I did today will fail with Sphinx docs11:30
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: mqtt: add basic reporter  https://review.openstack.org/53554311:31
fricklergaryk: Oh, it seems that pip 10 has promoted "You must give at least one requirement to install (see "pip help install")" from warning to error, so it is now failing while the warning has always been in place earlier, but simply been ignored11:33
fricklergaryk: see your passing job: http://logs.openstack.org/93/560893/1/check/build-openstack-sphinx-docs/0732b59/ara-report/result/031b799e-a676-47f1-a8ff-c9c1a96b946d/11:34
fricklerinfra-root: ^^ any idea how to handle this?11:36
*** alexchadin has quit IRC11:37
garykfrickler: thanks. still not clear what we need to do. is this per project or something on the infra side?11:39
*** AJaeger has joined #openstack-infra11:40
fricklergaryk: difficult to decide. the basic error IIUC is per project, but it has been masked by pip < 10 because it was non-fatal. maybe we can cap pip < 10 as workaround like for devstack or other things as a workaround, but in the long run I think projects will have to be fixed11:41
fricklergaryk: or maybe the neutron-hack pre-run job needs fixing11:41
fricklerjust to confirm my claim above: http://paste.openstack.org/show/719293/11:42
garykfrickler: ok, thanks. in devstack we have capped it. i am not sure how to do this in the infra.11:43
*** ldnunes has joined #openstack-infra11:44
garykwhat is not clear is that it works in master but fails in stable.11:45
*** dbecker has joined #openstack-infra11:46
*** armaan has quit IRC11:46
*** armaan has joined #openstack-infra11:47
fricklergaryk: seems tools/tox-install.sh has been removed in master, so neutron-horizon-hack is skipped completely. it _may_ be a solution to backport this to stable, but I really don't know the intricacies involved here11:47
fricklergaryk: infra-root: maybe a fast workaround would be to just ignore errors here, will propose a patch http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/roles/neutron-horizon-hack/tasks/main.yaml#n2011:48
*** caphrim007 has joined #openstack-infra11:50
garykfrickler: thanks! much appreciated.11:50
*** armaan_ has joined #openstack-infra11:50
*** armaan has quit IRC11:50
openstackgerritJens Harbott (frickler) proposed openstack-infra/openstack-zuul-jobs master: Ignore errors from pip 10 in neutron-horizon-hack  https://review.openstack.org/56159311:52
*** tpsilva has joined #openstack-infra11:54
*** caphrim007 has quit IRC11:54
*** panda|roARver is now known as panda|rover|lnc11:58
*** dave-mcc_ has joined #openstack-infra11:59
*** markvoelker has joined #openstack-infra11:59
*** kjackal has quit IRC12:00
*** dbecker has quit IRC12:00
*** dave-mccowan has quit IRC12:01
*** lucas-hungry is now known as lucasagomes12:02
*** rfolco has joined #openstack-infra12:03
*** garyk has quit IRC12:06
*** amoralej is now known as amoralej|lunch12:07
*** kjackal has joined #openstack-infra12:07
*** jcoufal has joined #openstack-infra12:09
*** bobh has quit IRC12:09
*** rh-jelabarre has joined #openstack-infra12:09
*** armaan_ has quit IRC12:10
*** armaan has joined #openstack-infra12:11
*** d0ugal_ has joined #openstack-infra12:13
*** armaan has quit IRC12:15
*** d0ugal has quit IRC12:15
*** dsariel has quit IRC12:15
*** dmsimard is now known as dmsimard|off12:16
*** ramishra has quit IRC12:20
*** edmondsw has joined #openstack-infra12:21
*** ramishra has joined #openstack-infra12:21
*** jbadiapa has quit IRC12:21
*** jbadiapa has joined #openstack-infra12:23
*** udesale__ has joined #openstack-infra12:24
*** udesale__ has quit IRC12:26
*** udesale has joined #openstack-infra12:26
*** dims has joined #openstack-infra12:30
*** efoley has quit IRC12:33
*** alexchadin has joined #openstack-infra12:33
*** owalsh has quit IRC12:34
*** owalsh has joined #openstack-infra12:35
*** rlandy has joined #openstack-infra12:37
*** yamamoto has quit IRC12:38
*** amoralej|lunch is now known as amoralej12:41
*** VW has joined #openstack-infra12:42
*** owalsh has quit IRC12:42
*** owalsh has joined #openstack-infra12:42
*** armaan has joined #openstack-infra12:43
*** dbecker has joined #openstack-infra12:44
*** oanson has quit IRC12:49
*** lihi has quit IRC12:49
*** panda|rover|lnc is now known as panda|rover12:49
*** snapiri has quit IRC12:49
openstackgerritThomas Morin proposed openstack-infra/project-config master: migrate zuul project config into repository  https://review.openstack.org/56160612:52
*** trown|outtypewww is now known as trown12:53
*** kgiusti has joined #openstack-infra12:55
*** armaan has quit IRC12:55
*** armaan has joined #openstack-infra12:56
*** snapiri has joined #openstack-infra12:57
niedbalskiianw, ping12:57
*** oanson has joined #openstack-infra12:57
*** dsariel has joined #openstack-infra12:58
*** lihi has joined #openstack-infra12:59
*** dklyle has joined #openstack-infra13:00
*** armaan has quit IRC13:00
*** yamamoto has joined #openstack-infra13:01
*** Goneri has joined #openstack-infra13:02
*** caphrim007 has joined #openstack-infra13:04
*** armaan has joined #openstack-infra13:07
*** caphrim007 has quit IRC13:09
*** dklyle has quit IRC13:09
*** VW has quit IRC13:10
*** LAKUNI1 has joined #openstack-infra13:10
pabelangerniedbalski: I expect him to be EOD now13:11
*** LAKUNI1 has quit IRC13:11
niedbalskipabelanger, ok, .. do you what's his timezone by a chance?13:12
pabelangerniedbalski: UTC+1013:13
*** mriedem has joined #openstack-infra13:13
niedbalskipabelanger, thank you13:13
pabelangernp13:13
*** belliott has joined #openstack-infra13:16
*** jlibosva has left #openstack-infra13:18
fricklerpabelanger: could you take a look at https://review.openstack.org/561593 please to fix docs builds on stable branches? see backlog, too13:23
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck master: Add query for psutil install bug 1763966  https://review.openstack.org/56161713:25
openstackbug 1763966 in grenade "python-psutil dependency error on ubuntu 16.04.4" [Undecided,New] https://launchpad.net/bugs/176396613:25
*** dsariel has quit IRC13:26
*** jroll has quit IRC13:26
*** jroll has joined #openstack-infra13:27
*** mnencia_ has joined #openstack-infra13:27
*** mnencia has quit IRC13:27
*** mnencia_ is now known as mnencia13:27
*** zhipeng has joined #openstack-infra13:29
*** zhipeng has quit IRC13:29
openstackgerritBharat Kunwar proposed openstack/diskimage-builder master: Fix yaml dependency issue with dracut-regenerate for python3  https://review.openstack.org/55849713:30
pabelangerfrickler: can you link a failure again? Don't see which job is failing13:31
fricklerpabelanger: http://logs.openstack.org/22/561522/1/check/build-openstack-sphinx-docs/cd99af8/job-output.txt.gz13:31
fricklerpabelanger: pip 10 turned the previous warning into an error. see also http://logs.openstack.org/93/560893/1/check/build-openstack-sphinx-docs/0732b59/ara-report/result/031b799e-a676-47f1-a8ff-c9c1a96b946d/ and http://paste.openstack.org/show/719293/13:32
openstackgerritMerged openstack-infra/zuul master: Tell geard to use keepalives  https://review.openstack.org/42524813:33
fricklerpabelanger: in the long run we either need to get rid of the neutron-hack task or projects need to fix their tox-install.sh, but as a quick workaround I think just continuing to ignore the error should be fine13:34
*** superdan is now known as dansmith13:35
pabelangerfrickler: right, lets see what clarkb or fungi say. Give that pip10 is breaking on things that have been warnings or deprecated issues for the last few releases, maybe we want see how to fix them properly now the ignore errors.  Maybe we should start tracking all the pip10 issues in an etherpad so we can ensure fixes are being tracked13:36
fricklerpabelanger: that's a good point. took me the better part of the morning to get a grip on the status of fixes in devstack13:37
pabelangeryah13:38
fricklerpabelanger: I'll starting writing things up a bit13:38
pabelangerdoes pip install have a noop mode?13:38
pabelangerlet me get some coffee and see how we could check to see if pip install would fail, without actually running it13:39
*** pcichy has quit IRC13:39
*** pcichy has joined #openstack-infra13:39
*** d0ugal_ has quit IRC13:40
*** d0ugal has joined #openstack-infra13:41
*** d0ugal has quit IRC13:41
*** d0ugal has joined #openstack-infra13:41
*** esberglu has joined #openstack-infra13:42
*** ihar has joined #openstack-infra13:43
*** armaan has quit IRC13:45
*** pcichy has quit IRC13:45
mordredinfra-root: I'm in an all-day face-to-face meeting so likely will not be online most of the day13:45
*** pcichy has joined #openstack-infra13:45
fungii'm not against infra folk tracking pip 10 issues somewhere central but it's not entirely clear what that gets us. we have infra-specific pip 10 problems to iron out (e.g., breaking image builds) but for the most part what's broken by pip 10 is up to individual teams to fix or work around13:46
*** armaan has joined #openstack-infra13:46
*** jamesmcarthur has joined #openstack-infra13:46
fungiif we try to put in a central workaround (say, pin pip<10) then it suddenly _becomes_ our responsibility to track what was broken everywhere so that we know when it's safe to undo the pin13:47
*** psachin has quit IRC13:47
fungipinning in devstack makes sense, because it was breaking devstack generally and the devstack maintainers/qa team needs to work out a solution there and decide for themselves when it's safe to lift that pin13:48
pabelangerfungi: in this case, we are touching ozj, and adding workarounds for pip1013:48
mriedemi don't suppose anyone remembers why we needed this https://review.openstack.org/#/c/64898/13:49
fungion a per-job basis that might be fine as long as it's not up to us to figure out when those workarounds can be reverted13:49
fungibut we really need to get past the "only the infra team understands python packaging tools" misapprehension lots of teams seem to have13:49
*** eharney has joined #openstack-infra13:49
* corvus does not understand python packaging tools13:50
*** pcichy has quit IRC13:50
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck master: Revert "Tox allow install of lazr.authentication"  https://review.openstack.org/56162113:50
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck master: Add query for psutil install bug 1763966  https://review.openstack.org/56161713:50
openstackbug 1763966 in grenade "python-psutil dependency error on ubuntu 16.04.4" [Undecided,New] https://launchpad.net/bugs/176396613:50
*** pcichy has joined #openstack-infra13:50
pabelangersure, I was mostly concerned we are tracking in some location fixes / workarounds in a central place, so we can go back and fix / remove them13:50
pabelangertracking them*13:50
pabelangerhttps://review.openstack.org/561593 is the patch in question13:51
fricklerfungi: I agree, but I'm not sure that splitting https://etherpad.openstack.org/p/pip10-mitigation according to my infra-hat and my devstack-hat would help13:51
fungimriedem: i believe the issue was that lazr packages weren't published on pypi for a very long time and we had to specify non-pypi urls13:51
mriedemok i see it's on pypi now so should be ok to revert13:52
*** alexchadin has quit IRC13:52
fungimriedem: yes, worth trying anyway to make sure it's sane now13:52
*** gongysh has joined #openstack-infra13:53
fungimriedem: looking back at that change, yes that was a workaround for a deprecated pypi feature (having pypi index externally hosted packages) which i believe has since been disabled on pypi so there's pretty much no way it's needed any longer13:53
*** derekh has quit IRC13:54
*** armaan has quit IRC13:55
*** alexchadin has joined #openstack-infra13:55
*** armaan has joined #openstack-infra13:55
fungifrickler: coordinating tracking between qa and infra for this does make sense, i agree, we just need to acknowledge it's not up to the infra team to solve all pip 10 related issues13:55
*** derekh has joined #openstack-infra13:56
fungipabelanger: if the horizon team or someone with close ties to them is on the hook for deciding when 561593 can be reverted, then seems fine to me13:57
*** r-daneel has quit IRC13:57
fungibut odds are what's going to happen is that we pin it is that it will cease to be urgent for the people who need to root out and fix the various scripts at fault13:58
fungier, what's going to happen with ignoring errors from that task13:58
openstackgerritChris Dent proposed openstack-infra/project-config master: Rename API WG -> SIG on specs.openstack.org  https://review.openstack.org/56162513:58
fungi(not pinning in that case obviously)13:58
fungiand it _is_ likely to also mask other failures, making subsequent task breakage harder to spot13:59
fricklerfungi: right, I'm just not sure where the horizon team is involved when I read "note:: TODO(mordred) ZOMG DELETE THIS" in http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/roles/neutron-horizon-hack/README.rst14:00
fricklerfungi: otoh, iiuc the issue has been resolved in master by tools/tox-install.sh there having been removed from most projects, so it would also be a matter of time until this particular issue resolves itself14:02
fungifrickler: neutron or horizon teams i guess? but yeah, that todo is about switching to the tox-siblings stuff so we no longer have to run those per-project scripts14:02
fungiso either eventual revert of 561593 or complete removal of the neutron-horizon-hack role as appropriate14:03
fungijust saying we're not going to know if/when 561593 can be safely reverted14:03
pabelangerright, we have a task to get rid of tools/tox_install.sh too, so we can remove zuul-cloner from images14:04
pabelangerbut unsure if anybody other then AJaeger and mordred are working on that14:05
fricklerfungi: worst case it can be removed once queens is EOL, not sure if that's an acceptable time frame14:05
*** eernst has joined #openstack-infra14:06
*** jamesmcarthur has quit IRC14:06
*** jamesmcarthur has joined #openstack-infra14:07
*** udesale has quit IRC14:11
*** trown|brb has joined #openstack-infra14:11
*** trown has quit IRC14:11
*** udesale has joined #openstack-infra14:12
*** dsariel has joined #openstack-infra14:13
*** felipemonteiro has joined #openstack-infra14:15
*** neiloy has joined #openstack-infra14:16
*** bobh has joined #openstack-infra14:19
*** rkukura has joined #openstack-infra14:21
openstackgerritMerged openstack-infra/elastic-recheck master: Revert "Tox allow install of lazr.authentication"  https://review.openstack.org/56162114:27
openstackgerritMerged openstack-infra/elastic-recheck master: Add query for psutil install bug 1763966  https://review.openstack.org/56161714:27
openstackbug 1763966 in devstack "python-psutil dependency error on ubuntu 16.04.4" [Critical,Fix released] https://launchpad.net/bugs/1763966 - Assigned to hongbin (hongbin034)14:27
*** lpetrut_ has joined #openstack-infra14:28
*** lpetrut has quit IRC14:32
mtreinishfungi: if you get a sec can you check why the mosquitto config doesn't seem to have updated on firehose01.o.o14:38
*** VW has joined #openstack-infra14:38
*** VW has quit IRC14:38
*** rpioso|afk is now known as rpioso14:38
*** VW has joined #openstack-infra14:39
fungimtreinish: thanks for the reminder... should be able to check shortly14:39
mtreinishfungi: ok cool, thanks14:42
*** jamesmcarthur has quit IRC14:43
*** jamesmcarthur has joined #openstack-infra14:44
*** dpawlik has quit IRC14:46
*** dpawlik has joined #openstack-infra14:48
openstackgerritBharat Kunwar proposed openstack/diskimage-builder master: Fix yaml dependency issue with dracut-regenerate for python3  https://review.openstack.org/55849714:49
*** boden has joined #openstack-infra14:49
bodenhi… the vmware-nsx docs job is now failing on stable branches with what appears as a result of pip10 with the message “ERROR: You must give at least one requirement to install (see "pip help install")” (see http://logs.openstack.org/15/561615/1/check/build-openstack-sphinx-docs/809c142/job-output.txt.gz#_2018-04-16_13_40_15_312336).. I’m a bit confused as to where we’re supposed to fix this.. Any tips?14:51
*** mugsie has quit IRC14:53
*** armaan has quit IRC14:53
*** mugsie has joined #openstack-infra14:53
*** mugsie has quit IRC14:53
*** mugsie has joined #openstack-infra14:53
*** armaan has joined #openstack-infra14:53
*** alexchadin has quit IRC14:55
fungiboden: garyk started a thread on the -dev ml about it, but short answer is that it's known. you could fix the tools/tox_install.sh script in vmware-nsx to perform a no-op if passed a single parameter, or wait for a more general workaround or fix14:55
*** gcb has joined #openstack-infra14:56
bodenfungi ack, I didn’t realize he started a ML thread already. thanks14:58
*** ssbarnea_ has joined #openstack-infra14:58
*** felipemonteiro_ has joined #openstack-infra14:59
*** beekneemech is now known as bnemec14:59
*** rajinir has joined #openstack-infra14:59
*** hongbin_ has joined #openstack-infra14:59
*** trown|brb is now known as trown15:01
clarkbI'm making tea but next step was to try another fix for ironic using global virtualenvs15:02
clarkbanyone looking at pip10 breaking tox siblings yet?15:02
*** felipemonteiro has quit IRC15:02
clarkbmordred ^ we use private internal pip apis looks like15:02
*** r-daneel has joined #openstack-infra15:03
*** finucannot is now known as stephenfin15:03
openstackgerritFélix Bouliane proposed openstack-infra/project-config master: add publish-sphinx-doc to virtualpdu  https://review.openstack.org/56135115:04
* clarkb pulls up etherpad first to see if there is any data to add15:05
*** tmorin has joined #openstack-infra15:09
*** pcaruana has quit IRC15:09
tmorinhi infraroot, AJaeger, frickler: I've understood the requirement issue leading to networking-odl breaking networking-bgpvpn (see bug 1764371)15:10
openstackbug 1764371 in networking-bgpvpn "networking-odl not pip installable / breaks networking-bgpvpn CI" [Critical,In progress] https://launchpad.net/bugs/1764371 - Assigned to Thomas Morin (tmmorin-orange)15:10
tmorinthe best solution is, all things considered, to stop having networking-bgpvpn depends on networking-odl from git; ie. to remove networking-odl from networking-bgpvpn required-projects15:11
tmorinI thought about doing the change in project-config, then thought this was the opportunity to move these config settings into .zuul.yaml in the project  repo15:12
tmorinAJaeger, frickler, morded: see ^^, could you have a look at https://review.openstack.org/561606 which wil unblock networking-bgpvpn CI ?  (please :) )15:14
*** ralonsoh__ has quit IRC15:15
*** hashar is now known as hasharAway15:16
fungiclarkb: agreed, per that e-mail to the infra ml it looks like that is the case. codesearch tells me heat, poppy, rally, rally-openstack and zuul-jobs all rely on pip.req15:18
fungiin various places15:18
*** armaan has quit IRC15:20
*** armaan has joined #openstack-infra15:21
zulis pypi.org down for anyone else?15:21
imacdonnis that why my CI jobs started barfing? :/15:22
pabelangerzul: I seen something about rolling warehouse into production today15:22
zulim getting too many redirects when running pip15:22
*** tmorin has left #openstack-infra15:22
*** hrw has quit IRC15:23
dhellmannthe pypi folks just posted about the redirect thing on twitter; they're looking at it15:24
dhellmannthey're moving from the old pypi implementation to warehouse today and this seems like a blip in that migration15:25
pabelangerhttps://status.python.org/incidents/1y1f44q6srh215:25
pabelangerI guess https://pypi.org/ is the new URL, maybe we also need to update our configuration to use it15:27
*** caphrim007 has joined #openstack-infra15:27
*** caphrim007 has quit IRC15:27
*** caphrim007 has joined #openstack-infra15:27
dhellmannI wonder if that would help15:28
fungilooks like pbr's parse_requirements() implementation relies on pkg_resources.Requirement.parse() under the hood: http://git.openstack.org/cgit/openstack-dev/pbr/tree/pbr/packaging.py#n9915:29
fungii suppose we could temporarily try/except and import pip._internal.req instead but i wouldn't want to do that for very long15:30
dhellmannI think the PyPA folks recommend vendoring for the short term and adding APIs to the packaging project for the long term15:31
*** hrw has joined #openstack-infra15:31
dhellmannpbr may be a special case in that we wouldn't want to add a dep on the packaging project15:31
fungioh, right, i should also check whether packaging already has a parse_requirements() implementation15:31
dhellmannso unless pip pulls in packaging, we may want to just vendor15:31
pabelangerzul: is it http or https that is looped for redirects?15:32
dhellmannthere was some discussion of this on one of the pypa mailing lists in the past few days15:32
*** jchhatbar has quit IRC15:32
pabelangerfiles.pythonhosted.org is currently under maintenance to resolve redirect loops.15:32
zulpabelanger: seems to be fine for me now15:32
clarkbisn't pkg_resources a public api though?15:32
*** belliott has quit IRC15:33
clarkbits just pip.* that isn't15:33
dhellmannclarkb : oh, good point, yes15:33
fungidhellmann: "vendor" in this particular case is in the context of an ansible role15:33
*** jistr is now known as jistr|mtg15:33
fungiso, i mean, i guess we could carry pip source code in our ansible role definition but there are probably better alternatives15:34
dhellmannfungi : oh, yeah, I thought you were saying in pbr itself15:34
clarkbfor zuul-jobs I wonder if we can't use pkg_resources too15:34
fungidhellmann: nah, pbr has solved this long ago15:34
fungiclarkb: looking at what pbr does, there's a need for an iteration loop and error handling15:35
fungisince pkg_resources.Requirement.parse() seems to only be for interpreting a single requirement versionspec15:35
imacdonn"We've rolled out a fix for the redirect issue on files.pythonhosted.org for the new PyPI and are monitoring. "15:35
fungiimacdonn: yeah, seems to be working for me now too15:36
fungiso... looks like packaging has a requirements module15:36
fungihttps://packaging.pypa.io/en/latest/requirements/15:37
fungiseems we'd still need about the same amount of wrapper as pkg_resources.Requirement.parse() demands though15:37
*** agopi has joined #openstack-infra15:38
*** armaan has quit IRC15:38
*** armaan has joined #openstack-infra15:38
*** aojea has quit IRC15:38
fungii.e., no magic function for handling a list of requirements15:39
fungithough the api for packaging's Requirement class is a little nicer15:39
*** felipemonteiro_ has quit IRC15:40
*** andreas_s has quit IRC15:42
fungilooks like we could probably replace pip.req.req_file.parse_requirements() with a loop that builds a list (or tuple or set or similar type) of packaging.requirements.Requirement objects15:43
*** andreas_s has joined #openstack-infra15:43
*** myoung is now known as myoung|brb15:44
*** lucasagomes is now known as lucas-brb15:47
clarkbfungi: I haven't looked yet but is the output of that function necessary? maybe we can just get around it by relying on implicit pip behavior and ignoring the actual list of things installed?15:47
*** jpena is now known as jpena|brb15:47
clarkbnow that I am waiting on grenade results I guess I can go take a look15:48
clarkbfungi: ya looking at it maybe we can just rely on the output of pip freeze?15:49
clarkbI guess pip freeze breaks if you don't have a remote but we fixed that by adding remotes (pip doesn't appear to have taken my fix upstream)15:50
mgagne_pypi issue looks to not be fully solved for me, getting 404 now15:50
*** mgagne_ is now known as mgagne15:50
*** myoung|brb is now known as myoung15:50
dhellmannThe @pythonstatus twitter feed has links to the known issues. They're updating it as they work through them.15:52
dhellmannhttps://status.python.org is another good source of info (I think it's basically the same feed)15:52
mgagne+115:54
*** lihi has quit IRC15:55
*** lihi has joined #openstack-infra15:56
*** andreas_s has quit IRC15:57
fungiclarkb: i'm hesitant to make assumptions about what's sufficient there since it's zuul-jobs and not openstack-zuul-jobs. i assume we want to try and retain existing behaviors as much as possible because it's in zuul's stdlib15:59
fungiif we can be reasonably sure we don't need any fance pip freeze parser to get the same behavior even under unusual circumstances for not-openstack deployments of zuul, then i'm cool with that16:00
fungis/fance/fancy/16:00
*** andreas_s has joined #openstack-infra16:02
*** gcb has quit IRC16:02
*** derekh has quit IRC16:03
*** gongysh has quit IRC16:03
*** jistr|mtg is now known as jistr16:03
openstackgerritClark Boylan proposed openstack-infra/zuul-jobs master: Don't use pip internals  https://review.openstack.org/56165916:04
clarkbfungi: ^ I've thrown up a change to make it more concrete16:05
*** dpawlik has quit IRC16:05
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Add zuul-website-media project  https://review.openstack.org/56166016:05
*** dpawlik has joined #openstack-infra16:09
*** lihi has quit IRC16:10
*** neiloy has quit IRC16:11
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Add zuul-website-media project (2/2)  https://review.openstack.org/56166216:11
*** lihi has joined #openstack-infra16:12
*** gyee has joined #openstack-infra16:13
corvusclarkb: it looks like 561659 failed SF CI, but maybe due to one of the pypi issues i saw in scrollback?16:14
*** dpawlik has quit IRC16:14
corvusclarkb: https://softwarefactory-project.io/logs/59/561659/1/third-party-check/test-job-tox-f27/a9b6a20/ara/result/02cdc29a-16c3-4dc3-b224-c04eb81a7f10/16:14
clarkb:(16:14
zxiirooh phew you guys are getting hit by upstream too16:14
clarkbwe may have to let pypi get sorted out before we can reasonably check a lot of these fixes16:14
*** HeOS has quit IRC16:14
clarkbzxiiro: yea....16:14
zxiirowe're busted, even though we have a local python cache16:14
clarkbzxiiro: we are trying to fix things for pip10 changes and running into pypi is broken problems :)16:15
zxiiroseems Sonatype Nexus doesn't fallback on the cache if upstream is busted for some reason.16:15
* zxiiro goes to file a bug with sonatype16:15
openstackgerritFélix Bouliane proposed openstack/diskimage-builder master: Allow to pin ubuntu version rather than current  https://review.openstack.org/55916716:16
*** zoli is now known as zoli|gone16:16
*** zoli|gone is now known as zoli16:16
*** andreas_s has quit IRC16:20
*** jbadiapa has quit IRC16:21
*** trown is now known as trown|lunch16:21
*** jbadiapa has joined #openstack-infra16:22
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Add zuul-website-media project (1/2)  https://review.openstack.org/56166016:22
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Add zuul-website-media project (2/2)  https://review.openstack.org/56166216:22
*** lbragstad has quit IRC16:24
*** andreas_s has joined #openstack-infra16:25
*** hemna_ has joined #openstack-infra16:26
openstackgerritJeremy Stanley proposed openstack-infra/puppet-mosquitto master: Correct enable_tls_websocket in config template  https://review.openstack.org/56166416:28
fungimtreinish: i found it ^16:28
mtreinishfungi: ah cool, thanks16:29
*** derekh has joined #openstack-infra16:30
mtreinishfungi: +A16:30
*** jpich has quit IRC16:30
mtreinishfungi: I uploaded the js I wrote to leverage it to my blog's webserver: https://blog.kortar.org//firehose.html16:31
mtreinishso once that merges anyone can test it out16:31
*** udesale has quit IRC16:31
*** belliott has joined #openstack-infra16:32
*** jpena|brb is now known as jpena|off16:32
*** hemna_ has quit IRC16:32
fungii'll let you know once i notice the config file timestamp update16:33
mtreinishcool, thanks16:34
mtreinishI really need to get around to writing someting to listen to the ansible firehose stream and notify about that16:34
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Refactored endpoint to get summit push notifications  https://review.openstack.org/56166916:35
*** neiloy has joined #openstack-infra16:37
*** jrist has quit IRC16:39
*** jpena|off is now known as jpena16:39
*** lpetrut_ has quit IRC16:39
*** andreas_s has quit IRC16:39
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Test base job secrets  https://review.openstack.org/56103016:39
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Don't store references to secret objects from jobs  https://review.openstack.org/55359616:39
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Perform late validation of secrets  https://review.openstack.org/55304116:39
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Perform late validation of nodesets  https://review.openstack.org/55308816:39
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: late bind pipelines  https://review.openstack.org/55361816:39
*** ramishra has quit IRC16:40
*** yamamoto has quit IRC16:41
corvusmtreinish: speaking of -- i think everything you raised in https://review.openstack.org/535543 has been addressed, but do you want to confirm / re-review?16:42
*** kashyap has left #openstack-infra16:42
*** andreas_s has joined #openstack-infra16:44
*** yamamoto has joined #openstack-infra16:46
clarkb#status log increased AFS pypi mirror volume quota to 1800000000 kbytes (thats just under 1.8TB) as previous value of 1700000000 was nearing capacity16:46
openstackstatusclarkb: finished logging16:46
clarkbinfra-root ^ re that we may want to update bandersnatch to allow us to exclude large problematic packages from a mirroring perspective16:47
clarkbalso apparently at 2TB we have to split it into multiple volumes16:47
openstackgerritChris Dent proposed openstack-infra/project-config master: Rename API WG -> SIG on specs.openstack.org and in projects.yaml  https://review.openstack.org/56162516:47
fungiclarkb: 561659 seems to be passing its jobs... we probably need to depends-on it now from some change which was failing?16:48
openstackgerritMerged openstack-infra/openstackid-resources master: Refactored endpoint to get summit push notifications  https://review.openstack.org/56166916:48
clarkbfungi: ya also having tox-siblings operate against working setups would likely be a good test too16:49
clarkbfungi: do we know if it failed in our ci system at all?16:49
fungiclarkb: i actually don't know. it's possible it may be relying on preinstalled pip and our images haven't updated to 10 yet?16:50
*** hemna_ has joined #openstack-infra16:50
clarkbhrm no virtualenv will update pip to latest when run so tox should run virtualenv, get latest pip and then our tox siblings would fail I think16:50
*** yamamoto has quit IRC16:51
*** armaan has quit IRC16:52
*** HeOS has joined #openstack-infra16:53
*** panda|rover is now known as panda|rover|off16:56
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Remove extra words from gerrit setup docs  https://review.openstack.org/56167216:57
*** andreas_s has quit IRC16:58
fungiclarkb: given that openstack-zuul-jobs-linters uses tox-siblings and doesn't seem to be failing on other zuul-jobs changes today, i wonder what's protecting us from the failure mentioned on the infra ml16:58
clarkbfungi: that would be interesting to sort out16:59
*** bobh has quit IRC17:00
*** VW_ has joined #openstack-infra17:00
*** derekh has quit IRC17:01
*** jrist has joined #openstack-infra17:01
*** yamamoto has joined #openstack-infra17:01
*** VW_ has quit IRC17:01
*** VW_ has joined #openstack-infra17:01
fungiunfortunately we do pip freeze out to tox/linters-4.log which doesn't include the installed version of pip like pip list would17:02
clarkbfungi: do we log the virtualenv creation?17:02
clarkbthat should be where pip gets updated17:03
*** e0ne has quit IRC17:03
fungiyeah, but it's not very verbode17:03
fungiverbose17:03
fungisee tox/linters-0.log17:03
fungi"Installing setuptools, pip, wheel...done."17:03
fungio versions mentioned17:03
*** calebb has quit IRC17:04
fungier, no versions mentioned17:04
clarkbthinking about it more, is zuul-jobs self testing?17:04
clarkbI guess either way we would expect old code to break17:04
*** VW has quit IRC17:04
*** HeOS has quit IRC17:05
fungiright, i'm just going to upload a dnm change to get us some details17:05
openstackgerritMerged openstack-infra/puppet-mosquitto master: Correct enable_tls_websocket in config template  https://review.openstack.org/56166417:05
clarkbfungi: sounds good17:05
*** yamamoto has quit IRC17:06
*** HeOS has joined #openstack-infra17:06
*** dhajare has quit IRC17:07
openstackgerritJeremy Stanley proposed openstack-infra/zuul-jobs master: DNM: getting details on pip and virtualenv  https://review.openstack.org/56167517:07
fungiclarkb: ^17:07
clarkblooking at package sizes and working to reduce the cost of our bandersnatch mirroring tf-nightly and tf-nightly-gpu together come in at ~850MB per day17:08
fungiyeesh17:08
clarkbI wonder if tensorflow is even aware they are doing this17:08
fungii'm guessing that's not tinyfugue (which is what tf runs on my systems)17:08
clarkbfungi: tensorflow17:08
*** yamamoto has joined #openstack-infra17:11
*** yamamoto has quit IRC17:11
openstackgerritMerged openstack-infra/zuul master: Add Gerrit docs to Zuul From Scratch  https://review.openstack.org/55860017:12
openstackgerritMerged openstack-infra/zuul master: Add static driver doc to Zuul From Scratch  https://review.openstack.org/55880217:12
*** bobh has joined #openstack-infra17:13
fungiclarkb: hrm, stranger still... that reports we're using virtualenv 15.2.0 and that it's setting up the venv with pip 10.0.017:13
fungihttp://logs.openstack.org/75/561675/1/check/openstack-zuul-jobs-linters/b6dd59c/job-output.txt.gz#_2018-04-16_17_12_08_83597717:14
funginext i'll upload a new patchset which doesn't depend on your fix17:14
clarkbya we should see that one fail17:15
clarkband if not then time for confusion :)17:15
*** calebb has joined #openstack-infra17:15
openstackgerritJeremy Stanley proposed openstack-infra/zuul-jobs master: DNM: getting details on pip and virtualenv  https://review.openstack.org/56167517:15
fungifire in the hole17:15
*** electrofelix has quit IRC17:18
*** anteaya has joined #openstack-infra17:19
*** jpena is now known as jpena|off17:19
*** yamahata has quit IRC17:20
clarkbfor the record tf* (tensorflow) and frida* (some javascript thing) seem to be the large offendors filling up pypi17:21
*** felipemonteiro has joined #openstack-infra17:21
clarkbI expect at this point tf* has far outrun everyone else though at ~850MB per day17:21
*** jrist has quit IRC17:22
*** e0ne has joined #openstack-infra17:22
*** hemna_ has quit IRC17:23
clarkbhttps://pypi.org/project/tf-nightly-gpu/#history and https://pypi.org/project/tf-nightly-gpu/#files in particular17:24
clarkbhttps://bitbucket.org/pypa/bandersnatch/issues/96/methods-for-creating-partial-mirrors17:25
openstackgerritJeremy Stanley proposed openstack-infra/zuul-jobs master: DNM: getting details on pip and virtualenv  https://review.openstack.org/56167517:25
fungiclarkb: oh! i bet the reason tox-siblings isn't breaking for us is because it's not using the pip from the virtualenv ^17:25
fungimy money's on older pip installed globally17:25
fungibecause it's being executed by ansible, not by tox17:25
clarkbfungi: https://review.openstack.org/#/c/561659/1/roles/tox/library/tox_install_sibling_packages.py line 112 on old side of diff17:25
clarkbis that not going to find the pip in the venv due to using tox_python?17:26
*** kjackal has quit IRC17:26
*** kjackal has joined #openstack-infra17:26
fungipossibly not...17:27
clarkbfungi: I'll push an update to my change to get the version from tox_python -m pip17:28
clarkbor as a child change17:28
fungiclarkb: has less to do with what tox_python is17:29
fungiclarkb: the problem is that tox_install_sibling_packages.py is importing pip from whatever context ansible is executing in, i expect17:30
clarkboh!17:30
clarkbwhcih my change avoids (though I haven't removed teh import pip beacuse I thought it would be useful however knowing this I don't think it is because tox installs virtualenv which installs pip which should work in the venv always017:31
fungimmm, my attempt to fake out tox by invoking pip under a bash invocation didn't do what i wanted (presumably because of the envvars getting passed through)17:31
clarkbbut ya I htink you are right, its using outer pip to parse requirements emitted by inner pip17:32
openstackgerritFélix Bouliane proposed openstack/diskimage-builder master: Allow to pin ubuntu version rather than current  https://review.openstack.org/55916717:32
clarkband so my fix should just work (tM)17:32
clarkbat least with regards to that17:32
*** jrist has joined #openstack-infra17:32
*** jrist has quit IRC17:32
*** jrist has joined #openstack-infra17:32
clarkbare you good at this point if i push a new patchset up to clean out that import?17:32
fungiso anyway, if our image builds are broken/delayed, then we could certanily still be importing from pip 9.0.317:32
fungiyeah, push up whatever you need17:32
openstackgerritFélix Bouliane proposed openstack-infra/project-config master: add docs-on-readthedocs to virtualpdu  https://review.openstack.org/56135117:33
openstackgerritClark Boylan proposed openstack-infra/zuul-jobs master: Don't use pip internals  https://review.openstack.org/56165917:34
*** r-daneel has quit IRC17:34
clarkbmordred: ^ if you find time to review that during your meetings that woudl be helpful17:34
*** r-daneel has joined #openstack-infra17:35
*** jamesmcarthur has quit IRC17:35
*** trown|lunch is now known as trown17:36
clarkbfungi: subprocess.check_output will raise if pip returns non zero so I think that covers are error checking too (the job will fail)17:38
openstackgerritJeremy Stanley proposed openstack-infra/zuul-jobs master: DNM: trying to upgrade pip before running tox  https://review.openstack.org/56167517:38
fungiclarkb: trying to reproduce that way ^17:38
*** lbragstad has joined #openstack-infra17:43
*** vtapia has quit IRC17:44
*** felipemonteiro_ has joined #openstack-infra17:45
*** shardy has quit IRC17:45
*** lpetrut_ has joined #openstack-infra17:46
mtreinishcorvus: ok sure, I'll take a look17:47
openstackgerritMerged openstack-dev/hacking master: uncap eventlet  https://review.openstack.org/56049517:47
*** felipemonteiro has quit IRC17:48
*** wolverineav has joined #openstack-infra17:49
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Update encrypt_secret to be API aware  https://review.openstack.org/56168117:49
openstackgerritJeremy Stanley proposed openstack-infra/zuul-jobs master: DNM: trying to upgrade pip before running tox  https://review.openstack.org/56167517:50
*** jamesmcarthur has joined #openstack-infra17:54
*** yamahata has joined #openstack-infra17:54
*** neiloy has quit IRC17:54
fungiclarkb: bingo! http://logs.openstack.org/75/561675/5/check/openstack-zuul-jobs-linters/3344526/job-output.txt.gz#_2018-04-16_17_52_46_34616617:54
fungiclarkb: now i'll reparent that on your change and make sure it works17:55
clarkbfungi: ++17:55
*** diablo_rojo has joined #openstack-infra17:55
*** yamamoto has joined #openstack-infra17:57
*** VW_ has quit IRC17:57
*** VW has joined #openstack-infra17:58
*** VW has quit IRC17:59
openstackgerritJeremy Stanley proposed openstack-infra/zuul-jobs master: DNM: trying to upgrade pip before running tox  https://review.openstack.org/56167517:59
*** jamesmcarthur has quit IRC18:00
*** hemna_ has joined #openstack-infra18:01
*** yamamoto has quit IRC18:02
*** AR2018 has joined #openstack-infra18:02
fungiclarkb: however, this also confirms that we probably haven't run into a variety of pip 10 breakage yet since there are likely other places where globally preinstalled pip is getting used without upgrading, and as soon as our image builds are fixed things could get a lot more hairy18:02
clarkbya18:03
clarkbthe good news is I think I have a viable devstack + grenade + ironic set of fixes18:03
clarkbI don't know what else those changes will break but I'm sure they will break lost of things with move to global venv18:04
*** neiloy has joined #openstack-infra18:06
mtreinishfungi: has puppet updated the config on firehose.o.o? It's been about an hour since your patch merged18:06
fungiclarkb: success! the job fails but that's because my test change angers ansible-lint, so working the way it's supposed to it seems18:06
fungihttp://logs.openstack.org/75/561675/6/check/openstack-zuul-jobs-linters/991cfd9/job-output.txt.gz18:06
*** hemna_ has quit IRC18:07
fungimtreinish: oh, yep, updated at 17:45 so ~22 minutes ago18:07
clarkbfungi: http://logs.openstack.org/75/561675/6/check/openstack-zuul-jobs-linters/991cfd9/tox/linters-siblings.txt seems to have done a thing too18:07
mtreinishhmm, I'm still not able to connect over wss on 443. Do we need to kick mosquitto to take the updated config?18:07
openstackgerritMerged openstack-infra/zuul master: Add sample systemd service files.  https://review.openstack.org/55883018:08
fungiyeah, nothing's listening on 443/tcp (yet) and the mosquitto daemon start time was saturday18:08
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Update encrypt_secret to be API aware  https://review.openstack.org/56168118:08
clarkbfungi: probably the last thing that would be good to sort out is why mordred made that choice in teh first place18:08
clarkbfungi: but otherwise sf third party ci and our ci both seem to show it as not breaking stuff18:08
fungimtreinish: it's listening now!18:08
fungi#status log restarted the mosquitto service on firehose01.openstack.org to pick up a recent configuration change18:09
openstackstatusfungi: finished logging18:09
*** jamesmcarthur has joined #openstack-infra18:09
fungiclarkb: without knowing for sure, my guess is it was a preference for not implementing a hacky requirements file parser when there was a perfectly good one right there in pip18:11
mtreinishfungi: awesome \o/. It's working running that js locally in my browser18:11
mtreinishbut the copy I uploaded to my blog's webserver still isn't able to connect, I wonder what I screwed up there18:11
mtreinishheh, the code is the same :)18:11
fungimtreinish: maybe cross-origin policy something something...18:11
mtreinishoh, nope I apparently had a different version on my laptop and my desktop (forgot to git pull when I switched locations) and was just connecting without ssl on port 8018:13
mtreinishupdating the code to actually use 443 fails to connect too, so at least its consistent now18:14
clarkbI'm going to work on an update to our bandersnatch configuration18:16
mtreinishfungi: are there any errors or stuff in the logs, because I just get can't establish a wss connection error in the browser console18:17
*** wolverineav has quit IRC18:18
*** wolverineav has joined #openstack-infra18:18
mtreinishfungi: oh I think I see the issue, one sec18:18
clarkbhrm our bandersnatch is too old to blacklist18:19
fungiclarkb: and upgrading bandersnatch is a challenge for other reasons i forget off the top of my head (may need newer python?)18:20
fungimtreinish: yeah, i see it logging ssl handshake failures18:20
fungimtreinish: but that may be due to a publisher and not your client18:20
clarkbfungi: ya puppet-bandersnatch says we need python3.5 hwoever mirror-udpate is xenial now so I think we can use new bandersnatch18:21
openstackgerritMatthew Treinish proposed openstack-infra/puppet-mosquitto master: Actually listen to websockets on websockets tls listener  https://review.openstack.org/56168618:21
mtreinishfungi: ^^^18:21
fungigood catch!18:22
clarkbfungi: you don't happen to know off the top of your head how to install something using pip3 and puppet do you?18:22
fungiclarkb: we did something to create a pip3 on our servers18:23
fungiand still maintain a pip3 package provider, i think18:23
clarkbI'll look at zuul I guess18:23
fungiyeah, that's what it's using: http://git.openstack.org/cgit/openstack-infra/puppet-zuul/tree/manifests/init.pp#n9918:24
clarkbya so in this case provider should be pip3 I guess18:24
*** VW has joined #openstack-infra18:25
corvuspabelanger, clarkb, fungi: would be nice to get https://review.openstack.org/561660 moving if you have a sec18:26
pabelanger+218:27
*** amoralej is now known as amoralej|off18:28
fungimtreinish: i've hand-patched 561686 into the config on firehose01 if you want to try again18:29
mtreinishfungi: yay, yep it's working: https://blog.kortar.org//firehose.html18:31
mtreinishnow I can continue writing my blog post with that embedded in it :)18:31
mtreinishthanks for the help18:31
*** eharney has quit IRC18:32
fungimtreinish: sure... though that page isn't displaying any mqtt messages for me. should it be? i've waited a solid minute now18:32
mtreinishyeah it should be, the real time output of all topics should be printing in the box18:33
mtreinishand also printing in the browser's console too18:33
fungipossible one of my ultra-paranoid privacy extensions in firefox is blocking something18:33
mtreinishis there anything in your browser's console log about it?18:34
*** tesseract has quit IRC18:36
*** bobh has quit IRC18:37
funginope, just noting that blog.kortar.org was loaded18:37
*** bobh has joined #openstack-infra18:37
mtreinishhmm18:37
fungioh, maybe the javascript console is what i want18:37
fungi"Firefox can’t establish a connection to the server at wss://firehose.openstack.org/mqtt."18:38
mtreinishhmm, that's what I was getting before you hand patched the config fix18:38
fungi"Attempt to set a forbidden header was denied: Connection"18:38
openstackgerritMerged openstack-infra/project-config master: Add zuul-website-media project (1/2)  https://review.openstack.org/56166018:38
mtreinishI haven't seen that one. Maybe a cross-origin thing18:39
*** harlowja has joined #openstack-infra18:40
*** dhajare has joined #openstack-infra18:41
mtreinishfungi: do you get the same thing on a different browser?18:41
fungii don't currently have any other javascript-capable browsers installed18:41
openstackgerritClark Boylan proposed openstack-infra/puppet-bandersnatch master: Install bandersnatch under python3  https://review.openstack.org/56169118:42
openstackgerritClark Boylan proposed openstack-infra/puppet-bandersnatch master: Support for package blacklists  https://review.openstack.org/56169218:42
openstackgerritMerged openstack-infra/project-config master: Remove the job manila-ui-dsvm to move it in in-tree  https://review.openstack.org/55764518:42
*** bobh has quit IRC18:42
fungithough also firing up the javascript console seems to have totally broken my ability to interact with my browser18:42
fungithose forbidden header errors may be related to another tab since i closed the one for your blog and am still seeing them18:43
mtreinish:( sigh firefox. I've had that happen to me during openstack-health dev before18:44
fungi"TypeError: this.transport is null"18:45
mtreinishfwiw, I think you can build elinks with js support :)18:45
fungisort of18:45
fungiit's extremely limited in its js featureset18:45
*** eharney has joined #openstack-infra18:47
*** belliott_ has joined #openstack-infra18:48
mtreinishheh ok, I've never tried it before. I just was trying to guess the browsers you might have installed and remembered reading about js on elinks when I needed a terminal based browser last time18:48
mtreinishbut that doesn't really surprise me18:48
zer0c00lI am trying to test nodepool, it looks like one testcase is failing http://paste.openstack.org/show/719319/18:49
*** belliott has quit IRC18:49
zer0c00lAny idea why?18:49
*** belliott_ is now known as belliott18:49
openstackgerritClark Boylan proposed openstack-infra/system-config master: Deploy latest bandersnatch on python3  https://review.openstack.org/56169318:49
openstackgerritClark Boylan proposed openstack-infra/system-config master: Stop mirroring tensorflow pypi packages  https://review.openstack.org/56169418:49
pabelangercorvus: clarkb: thoughts on a new release of gear? maybe 0.12.0 to pick up https://review.openstack.org/540489/ and start publishing universal wheels?18:49
clarkbianw: uberjay ^ ok I think that should mostly work but hasn't been tested18:49
clarkbuberjay: sorry that was meant for fungi18:49
clarkbpabelanger: ^ you are probably interested in that as well18:50
clarkbI'm happy to help babysit that today if people want to review those changes. I broke it up so that we can get everything working under python3 then work to blacklist packages18:50
zer0c00lI was able to override NODEPOOL_ZK_HOST environment variable and get most of the testcases passing18:50
zer0c00lBut i am stuck on just this one testcase not passing http://paste.openstack.org/show/719319/18:50
*** iranzo has quit IRC18:51
pabelangerclarkb: are we able to purge them from bandersnatch?18:52
clarkbpabelanger: it will likely have to be manual but at least starting from now going forward we can stop pulling in 1GB per day of new packages18:53
*** hemna_ has joined #openstack-infra18:53
*** hemna_ has quit IRC18:53
pabelangerclarkb: ack18:53
*** hemna_ has joined #openstack-infra18:53
*** VW_ has joined #openstack-infra18:54
zer0c00lCrap, the zookeeper host is hardcoded there http://paste.openstack.org/show/719321/18:54
zer0c00lso even if i can make the other tests passing with overriding NODEPOOL_ZK_HOST env variable, that test will fail18:55
clarkbzer0c00l: that will do it, I think there is a magic string that you can replace localhost with that will get substituted by the test fixtures18:55
*** VW_ has quit IRC18:55
zer0c00lclarkb: i see18:55
*** VW_ has joined #openstack-infra18:56
zer0c00lAny idea what that magic string might be?18:56
mtreinishfungi: yeah, it doesn't work in elinks (I just compiled it with the js support) it doesn't like downloading the js lib from the external source and errors when trying to use paho18:56
zer0c00lNODEPOOL_ZK_HOST is seems to be one of those18:56
zer0c00lbut not for that particular test case18:56
zer0c00lnodepool/tests/test_shade_integration.py18:56
clarkbzer0c00l: ya look at nodepool/tests/fixtures/node.yaml18:56
*** VW_ has quit IRC18:57
zer0c00lhmm18:57
*** VW has quit IRC18:57
zer0c00li see {zookeeper_host} and {zookeeper_port}18:57
clarkbthats an actual bug in the test suite that should be fixed likely if you want to go ahead and push a fix up18:57
clarkbzer0c00l: yup those are the things to set18:58
*** VW has joined #openstack-infra18:58
clarkbzer0c00l: along with the chroot18:58
*** yamamoto has joined #openstack-infra18:58
clarkbbasically copy the zk config from my example to the one that your failing test is using18:58
zer0c00loh i see18:58
zer0c00li will try that18:58
zer0c00lThanks18:58
mtreinishfungi: ok, I just asked a few other people and it's working for them too. So I think it's safe to assume it's something you've got set locally in your browser19:00
clarkb"elinks (I just compiled it with the js support)" is going to be my quote of the day19:01
*** dpawlik has joined #openstack-infra19:01
openstackgerritMerged openstack-infra/puppet-mosquitto master: Actually listen to websockets on websockets tls listener  https://review.openstack.org/56168619:02
mtreinishclarkb: heh, is that so odd? :)19:02
*** yamamoto has quit IRC19:02
clarkbseems like a lot of effort for elinks :P19:02
mtreinishI was more disappointed that arch didn't have it built in by default. Because even when you build it with the js support it's off by default19:02
mtreinishheh, it only took like 2 mins and I was curious19:03
mtreinishthe page is super simple, it just dumps firehose output in a box19:03
mtreinishso I figured even elinks could handle it19:04
*** openstackgerrit has quit IRC19:05
*** dpawlik has quit IRC19:06
fungimtreinish: yeah, i'm painfully aware i'm overdue for blowing away my ancient ff profile and creating a fresh one. i just keep putting it off because i need to go back through my currently open tabs and close out all the ones i don't need any more so i can more easily build a list of the ones i want to reopen after i do that19:07
*** openstackgerrit has joined #openstack-infra19:10
openstackgerritColleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Add experimental puppet 4 apply-test jobs  https://review.openstack.org/56170019:10
openstackgerritColleen Murphy proposed openstack-infra/puppet-gerrit master: [DNM] Test puppet-4 puppet-apply jobs  https://review.openstack.org/55751519:11
*** rockyg has joined #openstack-infra19:12
*** bobh has joined #openstack-infra19:13
*** pblaho has quit IRC19:14
*** camunoz has joined #openstack-infra19:14
*** pcichy has quit IRC19:15
mtreinishfungi: heh, well I dunno I'm more impressed you've managed to keep firefox open long enough where that's a concern you can have19:16
mtreinishI have crashes occasionally where I lose my browser state so I've learned to not get attached to the current tabs because I'll likely lose them anyway19:17
anteayaha ha ha19:17
fungimtreinish: i've never had any trouble going to history and telling it to reopen the previously open set of tabs. maybe i'm just lucky19:18
*** rockyg has quit IRC19:18
openstackgerritClark Boylan proposed openstack-infra/puppet-bandersnatch master: Install bandersnatch under python3  https://review.openstack.org/56169119:18
openstackgerritClark Boylan proposed openstack-infra/puppet-bandersnatch master: Support for package blacklists  https://review.openstack.org/56169219:18
fungibut yes, i should stop relying on that and just keep a list of urls i need to check back on later rather than being lazy and letting them accumulate in open tabs19:18
*** neiloy has quit IRC19:19
mtreinishoh, yeah I guess restoring a previous session is a feature in the history. I just never use it I guess19:20
*** dhajare has quit IRC19:21
clarkbmtreinish: recent firefox is a lot more stable for it19:21
clarkbs/for it/for me/19:22
clarkbthe rustification of firefox seems to have helped19:22
*** dhill__ has joined #openstack-infra19:22
mtreinishoh, yeah it definitely has gotten better recently. But I still have the occasional crash, just a lot less frequently then I used to19:23
*** dpawlik has joined #openstack-infra19:23
*** dpawlik has quit IRC19:23
*** dpawlik has joined #openstack-infra19:24
*** dhill_ has quit IRC19:24
*** dhill__ has quit IRC19:25
*** dhill_ has joined #openstack-infra19:25
fungii still use the last esr which supported xul, since the main extension i rely on doesn't have a webobjects equivalent (a lot of the functionality they'd need just isn't exposed by the new api at all)19:26
openstackgerritColleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Add experimental puppet 4 apply-test jobs  https://review.openstack.org/56170019:28
clarkbvimperator?19:29
*** AR2018 has quit IRC19:32
dulekDoes this ring a bell for anyone: http://logs.openstack.org/99/537499/1/check/build-openstack-sphinx-docs/0f5e939/job-output.txt.gz#_2018-04-16_19_13_42_949753 ?19:33
fungiclarkb: close, pentadactyl19:34
*** imacdonn has quit IRC19:35
*** imacdonn has joined #openstack-infra19:35
dulekfungi: I use this extension: https://github.com/brookhong/Surfingkeys. It says that it works with Firefox as well, though I'm not sure how exactly it compares to Pendactyl.19:35
fungidulek: garyk started a discussion on the -dev ml about that. it can be fixed by making your tools/tox_install.sh skip invoking pip if it only has one argument to pass in19:35
* dulek looks into emails.19:36
fungidulek: ooh, thanks for the link--that one looks feature-wise very similar to what i use pentadactyl for19:37
fungimaybe now i can experiment with taking my browser into the modern era ;)19:38
dulekfungi: Yeah, I've found it one day totally by chance. I'm surprised it's not popular at all - it's much better than Chrome's most popular cVim.19:38
fungii'd probably spend forever adjusting the keybindings to match pentadactyl/vimperator's set, but i bet retraining my finger memory to its defaults wouldn't take me too long19:39
dulekProbably depends how hardcore functions of pendactyl you use are. :) I'm fine with just the basic moves + link opening.19:41
fungisame. i mostly just want to not have to use a pointer device (and not need to rely on keynav's pointer emulation any more than absolutely necessary)19:42
*** jamesmcarthur has quit IRC19:45
fungiheading out to grab some late, late lunch, then i'll be back to hopefully take a look at the limesurvey implementation19:45
*** tjgresha has joined #openstack-infra19:50
openstackgerritPaul Belanger proposed openstack-infra/gear master: Add --listen-address flag to geard  https://review.openstack.org/56170519:50
pabelangermrhillsman: corvus: ^CLI flag for --listen-address for geard19:51
*** jamesmcarthur has joined #openstack-infra19:51
openstackgerritClark Boylan proposed openstack-infra/puppet-bandersnatch master: Install bandersnatch under python3  https://review.openstack.org/56169119:51
openstackgerritClark Boylan proposed openstack-infra/puppet-bandersnatch master: Support for package blacklists  https://review.openstack.org/56169219:51
*** trown has quit IRC19:51
mrhillsmanpabelanger: lgtm19:53
*** wolverineav has quit IRC19:54
*** tjgresha has quit IRC19:54
*** tjgresha has joined #openstack-infra19:56
*** rockyg has joined #openstack-infra19:57
*** yamamoto has joined #openstack-infra19:58
*** VW has quit IRC20:00
*** e0ne has quit IRC20:00
*** edmondsw_ has joined #openstack-infra20:00
*** eernst has quit IRC20:01
*** r-daneel has quit IRC20:01
*** hasharAway has quit IRC20:01
*** lpetrut_ has quit IRC20:02
*** eernst has joined #openstack-infra20:02
*** VW has joined #openstack-infra20:03
*** edmondsw has quit IRC20:03
*** eernst has quit IRC20:03
*** eernst has joined #openstack-infra20:04
*** yamamoto has quit IRC20:04
*** wolverineav has joined #openstack-infra20:05
anteayafungi, enjoy lunch and thank you20:05
*** jamesmcarthur has quit IRC20:06
*** jamesmcarthur has joined #openstack-infra20:06
*** trown has joined #openstack-infra20:06
openstackgerritGaetan Semet proposed openstack-dev/pbr master: cmd: 'pbr boostrap' create setup.[cfg,py] automatically  https://review.openstack.org/55948420:07
openstackgerritJames E. Blair proposed openstack-infra/project-config master: Allow zuul-website-media to publish to the zuul website  https://review.openstack.org/56170820:10
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Update encrypt_secret to be API aware  https://review.openstack.org/56168120:10
openstackgerritMerged openstack-infra/project-config master: Add zuul-website-media project (2/2)  https://review.openstack.org/56166220:10
*** eharney has quit IRC20:11
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Don't store references to secret objects from jobs  https://review.openstack.org/55359620:12
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Perform late validation of secrets  https://review.openstack.org/55304120:12
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Perform late validation of nodesets  https://review.openstack.org/55308820:12
openstackgerritJames E. Blair proposed openstack-infra/zuul master: WIP: late bind pipelines  https://review.openstack.org/55361820:12
*** belliott has quit IRC20:14
pabelangerclarkb: fungi: if you'd also like to review: https://review.openstack.org/561705/ then see if we can tag 1.12.0 for gear20:16
*** r-daneel has joined #openstack-infra20:19
clarkbpabelanger: if my home networking would work I could leave a comment20:23
clarkbbut tldr is that isnt backward compat so -1. default should be None20:23
clarkbotherwise you may lose ipv6 connectivity20:23
*** florianf has quit IRC20:23
pabelangerclarkb: ah, good point20:24
openstackgerritClark Boylan proposed openstack-infra/puppet-bandersnatch master: Install bandersnatch under python3  https://review.openstack.org/56169120:25
openstackgerritClark Boylan proposed openstack-infra/puppet-bandersnatch master: Support for package blacklists  https://review.openstack.org/56169220:25
*** kgiusti has left #openstack-infra20:27
openstackgerritPaul Belanger proposed openstack-infra/gear master: Add --listen-address flag to geard  https://review.openstack.org/56170520:27
pabelangerclarkb: fungi: clarkb: mrhillsman: ^20:28
pabelangerthanks20:28
*** dklyle has joined #openstack-infra20:28
*** VW_ has joined #openstack-infra20:29
clarkb+220:30
*** tjgresha has quit IRC20:30
*** VW has quit IRC20:32
*** VW__ has joined #openstack-infra20:32
*** VW_ has quit IRC20:32
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul master: WIP: Make gearman calls async in ZuulWeb  https://review.openstack.org/56002620:32
openstackgerritColleen Murphy proposed openstack-infra/openstack-zuul-jobs master: Add experimental puppet 4 apply-test jobs  https://review.openstack.org/56170020:33
*** jamesmcarthur has quit IRC20:34
*** tjgresha has joined #openstack-infra20:35
*** hemna_ has quit IRC20:36
*** wolverineav has quit IRC20:42
*** eernst has quit IRC20:42
*** wolverineav has joined #openstack-infra20:42
*** eernst has joined #openstack-infra20:43
*** ssbarnea_ has quit IRC20:44
*** eernst has quit IRC20:44
*** eernst has joined #openstack-infra20:44
anteayaI've never seen so much snow in April20:45
*** jcoufal has quit IRC20:46
rockyganteaya, crazy weather.  We had rain, thunder/lightning, Ice in the hills (bay area), freezing rain, and earthquake today.20:48
anteayaoh my20:49
anteayaquite a monday20:49
anteayafreezing rain and an earthquake sounds like a bad combination20:49
rockygSmall quake.  But the ice/freezing rain was during commute hours.  Not good20:50
corvusrockyg: how about that -- a 3.8 near SJ.  i didn't know20:51
*** mtreinish has quit IRC20:51
rockygYup.  And I did my duty and reported it. Google Didyoufeelit and you'll see the usgs site.20:52
corvus++20:52
corvusi guess i should file a "nope" :)20:52
rockyg++20:53
anteayain my book there are no small quakes20:53
anteayaand freezing rain in any city is never good any hour of the day20:53
corvusi love that the dyfi web form has an omb control number20:54
* anteaya wonders whereelse she can spread some happiness20:54
rockygHey, just seeing you around makes me happy.20:54
*** harlowja has quit IRC20:55
anteayarockyg, awww you're too kind20:55
*** edmondsw_ has quit IRC20:56
*** mtreinish has joined #openstack-infra20:57
corvuspabelanger, fungi: can you look at https://review.openstack.org/561708 ?20:58
*** rockyg has quit IRC20:58
*** esberglu has quit IRC20:58
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul master: Make gearman calls async in ZuulWeb  https://review.openstack.org/56002620:58
pabelanger+220:59
*** edmondsw has joined #openstack-infra20:59
*** yamamoto has joined #openstack-infra21:00
*** rfolco is now known as rfolco|off21:01
*** sambetts is now known as sambetts|afk21:03
*** edmondsw has quit IRC21:03
*** Goneri has quit IRC21:05
*** yamamoto has quit IRC21:06
*** trown is now known as trown|outtypewww21:07
*** witek has quit IRC21:11
openstackgerritArun S A G proposed openstack-infra/nodepool master: Do not hardcode zookeeper host to localhost  https://review.openstack.org/56172921:12
*** dpawlik has quit IRC21:12
zer0c00lclarkb: https://review.openstack.org/#/c/561729/21:13
*** witek has joined #openstack-infra21:14
openstackgerritArun S A G proposed openstack-infra/nodepool master: Do not hardcode zookeeper host to localhost  https://review.openstack.org/56172921:14
*** ldnunes has quit IRC21:15
ianwclarkb: lmn if you want a hand with bandersnatch; i've fiddled it before and python3 / upgrade has been a long time todo waiting for an emergency breakage^W^W a convenient time :)21:15
openstackgerritMerged openstack-infra/project-config master: Allow zuul-website-media to publish to the zuul website  https://review.openstack.org/56170821:15
clarkbianw: I think I finally got puppet to pass testing (I suck at puppet) if yu want to start by reviewing the changes21:16
*** wolverineav has quit IRC21:16
clarkbI need to recheck the system-config changes now21:16
*** wolverineav has joined #openstack-infra21:16
*** jamesmcarthur has joined #openstack-infra21:16
corvuswow.  i barely calculated the number of summits i previously attended before the eventbrite timeout.21:17
corvusi don't know if i'll make it next time21:17
*** wolverineav has quit IRC21:17
*** wolverin_ has joined #openstack-infra21:17
anteayacorvus, I was thinking they need to rethink how they ask that question21:18
anteayaI had to phone a friend to get my right answer21:18
corvusanteaya: ++21:18
clarkbcorvus: dtroyer or dhellmann added a command to osc to do the math for you21:18
anteayaI was thinking they should associate them with major occurances21:19
anteayalike did you attend the summit when tim bell had his backpack stolen in a train station?21:19
openstackgerritMerged openstack-infra/zuul master: Support regex matching of github status  https://review.openstack.org/56117721:20
anteayaor the one where henry had his lifted from the dev lounge?21:20
anteayaor the one(s) where mordred ranted? that one is a trick question21:20
corvusanteaya: that matches the way my brain works, though i don't remember those specific events, so we'd need a pretty big database.21:20
anteayaha ha ha, indeed21:20
*** VW__ has quit IRC21:21
anteayatim bell was paris, and henry was atlanta21:21
corvusclarkb: that's pretty cool, i'll have to find that21:21
*** ihar has quit IRC21:21
*** dklyle has quit IRC21:22
openstackgerritMerged openstack-infra/gear master: Add --listen-address flag to geard  https://review.openstack.org/56170521:22
*** VW has joined #openstack-infra21:23
*** felipemonteiro_ has quit IRC21:23
dhellmanncorvus , anteaya , clarkb : https://github.com/dhellmann/openstack-summit-counter21:26
anteayadhellmann, always one step ahead :)21:26
*** jbadiapa has quit IRC21:26
dhellmanncheck the math, though, I think there's an off-by-one error21:27
*** jbadiapa has joined #openstack-infra21:27
dhellmannI think it counts the summit that has not yet happened21:27
dhellmannpatches welcome :-)21:27
corvusdhellmann: i can't stop loling at the fact that at the end of this, i need to "check the math" :)21:27
*** VW_ has joined #openstack-infra21:27
dhellmannyes, well21:28
dhellmannI suppose if I had taken the time to set up a repo on gerrit I would have had the code review I need :-)21:28
openstackgerritMerged openstack-infra/zuul master: docs: add build status documentation  https://review.openstack.org/56148921:28
dhellmannbut then the twitter joke wouldn't have been as funny21:28
corvusmy day has been considerably brightened :)21:29
*** VW has quit IRC21:31
*** VW_ has quit IRC21:32
openstackgerritGaetan Semet proposed openstack-dev/pbr master: pbr git-tag command  https://review.openstack.org/56173121:33
openstackgerritGaetan Semet proposed openstack-dev/pbr master: pbr git-tag command  https://review.openstack.org/56173121:35
openstackgerritClark Boylan proposed openstack-infra/puppet-bandersnatch master: Install bandersnatch under python3  https://review.openstack.org/56169121:37
openstackgerritClark Boylan proposed openstack-infra/puppet-bandersnatch master: Support for package blacklists  https://review.openstack.org/56169221:37
clarkbianw: ^ switched to installing current pini21:37
clarkb*pin21:37
corvusclarkb: it already supported that?  awesome!21:38
clarkbcorvus: as of last month in the release before the one I am installing21:38
clarkbvery recent but should hopefully make this much better for us21:38
clarkbhttps://review.openstack.org/#/c/561691/ https://review.openstack.org/#/c/561692/ https://review.openstack.org/#/c/561693/ and https://review.openstack.org/#/c/561694/ are all ready for review now I think21:39
clarkbI'd like to upgrade to new bandersnatch under python3 amke sure that is working as expected then add in the blacklist21:39
ianwi'd definitely run it manually first so we can recover from anything before it "vos releases" a bad volume21:41
clarkbif reviewrs want to +2 but not approve I can grab the lock on mirror-update before approving the python3 upgrade changes21:42
clarkbthen I can run it manually as ianw suggests21:42
*** esberglu has joined #openstack-infra21:42
*** kong is now known as lxkong21:45
ianwclarkb: lgtm, i'd say proceed with babysitting it21:45
clarkbreading changelog this will update the index pages for packages to be in line with warehouse21:47
clarkbit will also use sha256 by default going forward21:47
openstackgerritGaetan Semet proposed openstack-dev/pbr master: pbr git-tag command  https://review.openstack.org/56173121:48
clarkbI expect that it will only change things as it moves forward and old content will remain old21:48
clarkbwhich should be fine I think21:48
clarkbinfra-root anyone else willing to review https://review.openstack.org/#/c/561691 ?21:49
clarkbI can babysit if you won't want to approve (that gives me a chance to grab the lock on mirror-update as well21:49
*** salv-orlando has quit IRC21:50
*** dklyle has joined #openstack-infra21:50
*** rcernin has joined #openstack-infra21:51
*** aeng has joined #openstack-infra21:51
*** aeng_ has joined #openstack-infra21:52
clarkbcorvus: ianw thanks!21:52
*** aeng has quit IRC21:52
openstackgerritGaetan Semet proposed openstack-dev/pbr master: pbr git-tag command  https://review.openstack.org/56173121:52
openstackgerritNir Magnezi proposed openstack/diskimage-builder master: WIP: Do not use pip 10 or higher  https://review.openstack.org/56174021:52
openstackgerritGaetan Semet proposed openstack-dev/pbr master: cmd: 'pbr boostrap' create setup.[cfg,py] automatically  https://review.openstack.org/55948421:53
clarkbI've grabbed the bandersnatch lock on mirror-update.openstack.org. Approving those two changes now21:53
*** dpawlik has joined #openstack-infra21:54
openstackgerritGaetan Semet proposed openstack-dev/pbr master: Add leading 0 on alpha release in semver doc  https://review.openstack.org/55818121:56
clarkbit is running in a screen owned by my user21:56
clarkbI'll run run-bandersnatch there once puppet does its thing21:56
*** dpawlik has quit IRC21:58
*** yamamoto has joined #openstack-infra22:02
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoint to create new summit push notification  https://review.openstack.org/56174322:03
*** david-lyle has joined #openstack-infra22:06
*** dklyle has quit IRC22:08
*** yamamoto has quit IRC22:08
openstackgerritMerged openstack-infra/openstackid-resources master: Added endpoint to create new summit push notification  https://review.openstack.org/56174322:08
*** boden has quit IRC22:10
*** AJaeger has quit IRC22:10
*** david-lyle has quit IRC22:11
*** slaweq has quit IRC22:16
*** slaweq has joined #openstack-infra22:16
*** rpioso is now known as rpioso|afk22:18
*** tjgresha has quit IRC22:19
fungianteaya: i'm giving 557979 a shot on a 2gb virtual machine named survey01.openstack.org. i can add your ssh key once it's up so you can inspect the trial deployment and help figure out where we need to go next22:20
*** slaweq has quit IRC22:21
anteayafungi, oh thank you22:21
clarkbcorvus: I'm poking around bandersnatch to make sure that 2.2.0 should work with our existing config and that all looks fine. But I don't see how we enable the dir nesting that afs relies on. Is that just deafult now?22:22
*** AJaeger has joined #openstack-infra22:22
clarkbaha! its hash-index = true22:24
clarkbianw apparently got it upstream22:24
clarkbwith patch corvus wrote?22:24
corvusyeah, it's a setting and it merged upstream22:24
corvusclarkb: that's my understanding22:24
clarkbreading the changelog I think we are good then. The only reason they made 2.0 instead of 1.12 was the python3 requirement from what I can see22:25
clarkbbut I'll be manually running it either way22:25
*** tosky has quit IRC22:26
openstackgerritJames E. Blair proposed openstack-infra/zuul master: Update encrypt_secret to be API aware  https://review.openstack.org/56168122:27
ianwyeah i think the chronology is we got that in, then realised it needed >=py3.5 and so postponed an update for after xenial sprint22:27
ianwand today is that day :)22:27
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources master: Added missing summit fields  https://review.openstack.org/56174522:29
openstackgerritMerged openstack-infra/openstackid-resources master: Added missing summit fields  https://review.openstack.org/56174522:29
*** tpsilva has quit IRC22:31
openstackgerritMerged openstack-infra/puppet-bandersnatch master: Install bandersnatch under python3  https://review.openstack.org/56169122:33
openstackgerritMerged openstack-infra/system-config master: Deploy latest bandersnatch on python3  https://review.openstack.org/56169322:33
clarkbannoyingly that missed the 2230UTC puppet run start22:37
clarkbso I think I have to wait a little while for it to actually apply22:37
openstackgerritColleen Murphy proposed openstack-infra/system-config master: Fix puppet config for puppet 4  https://review.openstack.org/56174622:37
openstackgerritColleen Murphy proposed openstack-infra/puppet-gerrit master: [DNM] Test puppet-4 puppet-apply jobs  https://review.openstack.org/55751522:38
ianwclarkb: you're just a kick.sh away though :)22:38
clarkbianw: does kick.sh update the puppet modules too?22:39
openstackgerritJames E. Blair proposed openstack-infra/zuul-website-media master: Add license  https://review.openstack.org/56174722:39
*** dklyle has joined #openstack-infra22:40
*** tjgresha has joined #openstack-infra22:40
clarkbcmurphy: re ^ I was thinking about that in the context of infra's next priority effort likely being update infrastructure tooling (puppet4/5 being an option) and in addition to testing things using jobs we should also be able to update a single server at a time to puppet 4 right since we puppet apply on each server22:40
ianwclarkb: i'm 94.5% the ansible magic does22:40
fungidmsimard|off: looks like you left a production/group/survey.yaml uncommitted in the puppetmaster hiera git repo22:40
fungijust a heads up22:40
clarkbianw: ah yup22:41
fungiclarkb: it updates modules but does not update system-config22:41
clarkbfungi: ah22:41
clarkbso I'd need to wait anyways22:41
clarkbor otherwise update things without interferring with  the existing run22:41
fungibecause /opt/system-config/production is likely to be in use by an ongoing ansible run22:41
fungiright, that22:41
cmurphyclarkb: yeah i think one at a time is the way to go22:42
cmurphygotta work out some kinks in install_puppet and install_modules first though22:42
clarkbcmurphy: ya but at least that way we can have a relatively straight fowrard update things until it works then flip server foo over22:43
clarkbrinse and repeat22:43
cmurphyyep22:44
*** jamesmcarthur has quit IRC22:44
*** hemna_ has joined #openstack-infra22:44
*** dbecker has quit IRC22:46
openstackgerritJames E. Blair proposed openstack-infra/zuul-website-media master: Add license and zuul.yaml  https://review.openstack.org/56174722:46
*** jamesmcarthur has joined #openstack-infra22:49
*** salv-orlando has joined #openstack-infra22:50
anteayathis much snow at this time of the year is playing havoc with my senses22:51
anteayamy mind keeps telling me that based on the snow and the light it is about 3:30pm, rather than almost 7pm22:51
clarkbanteaya: that happens to me without the snow22:52
anteayaha ha ha22:52
clarkbI often wonder why I am so hungry22:52
anteayaha ha ha22:52
anteayaspeaking of which I have to go stir my soup some more22:52
openstackgerritJames E. Blair proposed openstack-infra/zuul-website master: Merge zuul-website-media when publishing site  https://review.openstack.org/56174922:54
*** hongbin_ has quit IRC22:55
openstackgerritJames E. Blair proposed openstack-infra/zuul-website master: Merge zuul-website-media when publishing site  https://review.openstack.org/56174922:55
*** salv-orlando has quit IRC22:56
openstackgerritJames E. Blair proposed openstack-infra/zuul-website-media master: Run zuul-website jobs  https://review.openstack.org/56175022:56
*** claudiub|2 has quit IRC22:57
*** dklyle has quit IRC22:58
*** andreas_s has joined #openstack-infra22:59
*** yamamoto has joined #openstack-infra23:04
fungianteaya: ianw: after rabbit-holing a bit on trying to find where that limesurvey module actually configured limesurvey to, like, connect to the database and stuff, and finding nothing, and then reading https://manual.limesurvey.org/Installation_using_a_command_line_interface_(CLI) i'm starting to come to the conclusion that we'll need to first manually install it using the interactive installer in23:04
fungiorder to figure out what parameters need to be set in the config.php template we put in puppet23:04
*** andreas_s has quit IRC23:04
clarkbhrm pabelanger has puppet disabled on mirror-update0123:04
clarkbdoes kick.sh work in that case?23:04
clarkbfungi: ianw ^ you seemed to know?23:04
fungilimesurvey's configuration documentation seems to boil down to "whatever the installer creates"23:05
fungiclarkb: yes, it should work23:05
clarkbpabelanger: also why is puppet disabled on mirror-update01? I don't want to run puppet there via kick.sh if it is going to break something23:05
clarkbI guess we may want to defer on this until pabelanger can explain why that node is in emergency?23:08
clarkb(I don't want to break something else)23:08
fungiyeah, i'd be hesitant to apply puppet on it not knowing why it was held. maybe the status log wiki makes mention23:08
clarkbthe most recent status update appears to be for bumping up to bionic afs on that server23:09
*** yamamoto has quit IRC23:09
openstackgerritMichael Johnson proposed openstack/diskimage-builder master: WIP: Do not use pip 10 or higher  https://review.openstack.org/56174023:09
fungiyeah, and some for the xenial upgrade23:10
funginothing which looks relevant23:10
*** dklyle has joined #openstack-infra23:13
*** jamesmcarthur has quit IRC23:14
*** bobh has quit IRC23:14
ianwfungi: ++ ... we could spend an eternity puppeting this out i think23:17
anteayafungi, oh my23:17
anteayaback from soup23:18
*** ianychoi has quit IRC23:18
anteayamy list of things that I want to spend eternity doing don't include anything to do with puppet23:18
anteayaor computers at all for that matter23:19
anteayamountains and beautiful skies however do factor heavily on my list23:19
anteayaand some water23:19
ianwclarkb: i think kick.sh works on emergency23:19
anteayasome kind of water23:19
clarkbianw: ya fungi said so too. Now my biggest concern is to run it and break something pabelanger is doing23:20
openstackgerritGaetan Semet proposed openstack-dev/pbr master: pbr git-tag command  https://review.openstack.org/56173123:21
clarkbianw: I'll pick it up in the morning if we don't hear from pabelanger before then23:23
clarkbI worry about dropping my lock if the host gets removed from the emergency file though so maybe I keep that held23:23
fungianteaya: i think probably won't be too hard to bootstrap a demo with no config, run the interactive installer, collect the resulting config.php and then create an erb template with the appropriate values stubbed out for replacement variables from puppet23:24
fungiseeing if i can at least get it to the first part now23:25
anteayago you23:25
*** ianychoi has joined #openstack-infra23:25
anteayaand yeah, I am willing to copy and paste anything into the patch, if you say that is what I should do23:25
fungiand then there's #limesurvey tomorrow if i don't get very far23:25
anteayaindeed23:26
anteayathanks for giving me this much of your time23:26
anteayaI'm grateful23:26
*** jaosorior has quit IRC23:26
*** jaosorior has joined #openstack-infra23:27
*** r-daneel has quit IRC23:29
*** jaosorior has quit IRC23:34
*** jaosorior has joined #openstack-infra23:34
*** rajinir has quit IRC23:34
openstackgerritMichael Johnson proposed openstack/diskimage-builder master: WIP: Do not use pip 10 or higher  https://review.openstack.org/56174023:36
*** d0ugal has quit IRC23:36
*** rlandy has quit IRC23:40
*** dklyle has quit IRC23:40
ianwcorvus: linaro has changed ip addresses for our builder etc; i'm about to update dns.  any particular thoughts on how zk etc will handle this?23:41
*** jroll has quit IRC23:42
ianwniedbalski: thanks, will update now23:43
*** gyee has quit IRC23:43
rm_workhey so, https://review.openstack.org/#/c/561049/7/zuul.d/jobs.yaml@7223:49
rm_workisn't that supposed to put a line into http://logs.openstack.org/49/561049/7/check/neutron-lbaasv2-dsvm-api-l7octavia/381bff3/logs/local.conf.txt.gz23:50
rm_work?23:50
openstackgerritKendall Nelson proposed openstack-infra/infra-manual master: Update Launchpad mentions to StoryBoard  https://review.openstack.org/56175323:51
*** salv-orlando has joined #openstack-infra23:51
*** d0ugal has joined #openstack-infra23:52
*** ianychoi has quit IRC23:55
clarkbrm_work: legacy-dsvm doesn't use the new devstack non legacy jobs right? in that case no23:55
clarkbrm_work: you need to use non legacy devstack/tempest for that to work. Otherwise its using the old devstack-gate based system which requires the env var for d-g to write into the localrc23:55
*** salv-orlando has quit IRC23:56
rm_workahh hmmm23:57
rm_workok23:57
openstackgerritMichael Johnson proposed openstack/diskimage-builder master: WIP: Do not use pip 10 or higher  https://review.openstack.org/56174023:57
rm_workso there IS a way to do it with the legacy jobs tho?23:57
rm_workjust not THIS way23:57
clarkbrm_work: ya you have to set the devstack-gate option to set that value if there is one or otherwise set it in the append to localrc var23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!