Monday, 2018-10-29

*** jimi|ansible has joined #zuul00:06
ianwjoin the club :)00:11
* Shrews grumbles more than usual00:42
*** snapiri has quit IRC00:44
*** snapiri has joined #zuul00:44
*** EvilienM is now known as EmilienM00:50
*** AJaeger has quit IRC03:05
*** AJaeger has joined #zuul03:05
*** bhavikdbavishi has joined #zuul03:06
*** chkumar|off is now known as chandankumar04:44
*** adam_g has quit IRC05:41
*** adam_g has joined #zuul05:41
tobiashShrews: +2 with comment on the port cleanup. We have leaked ports too so thanks :)06:35
openstackgerritMerged openstack-infra/zuul master: Use doc/requirements.txt  https://review.openstack.org/61379607:11
tobiashianw: when are you planning to do the next diskimage-builder release?07:26
*** pcaruana has joined #zuul07:46
openstackgerritTobias Henkel proposed openstack-infra/nodepool master: Rate limit updateNodeStats  https://review.openstack.org/61368007:51
*** AJaeger has quit IRC08:11
*** AJaeger has joined #zuul08:15
*** sshnaidm is now known as sshnaidm|ruck08:18
*** jpena|off is now known as jpena08:57
*** hashar has joined #zuul09:01
*** panda|off is now known as panda09:19
*** snapiri has quit IRC09:21
*** bhavikdbavishi has quit IRC09:45
*** bhavikdbavishi has joined #zuul09:46
*** nilashishc has joined #zuul10:02
*** sshnaidm|ruck is now known as sshnaidm|afk10:18
*** sshnaidm|afk has quit IRC10:23
*** bhavikdbavishi has quit IRC10:32
*** goern has quit IRC10:49
*** rfolco|rover has quit IRC11:10
*** rcarrillocruz has joined #zuul11:15
*** spsurya has quit IRC11:16
*** tflink has quit IRC11:16
*** zigo has quit IRC11:17
*** spsurya has joined #zuul11:18
*** tflink has joined #zuul11:22
ianwtobiash: ... soon.  i just added the zuulv3 native jobs, i'd like to look at the systemd image stuff proposed and after that.  couple of days; if needed can do sooner11:38
*** sshnaidm has joined #zuul11:51
*** rlandy has joined #zuul12:02
*** bhavikdbavishi has joined #zuul12:24
openstackgerritMerged openstack-infra/zuul-sphinx master: Use tox-docs directly  https://review.openstack.org/60225212:25
*** _ari_ has joined #zuul12:26
*** nilashishc has quit IRC12:28
*** rfolco has joined #zuul12:30
tobiashianw: thanks, that's fine for me :)12:37
dmsimardhttps://vespene.io is out12:37
dmsimardCI/CD from the guy that created Ansible12:37
*** bhavikdbavishi has quit IRC12:44
*** jpena is now known as jpena|lunch13:03
*** zigo has joined #zuul13:17
*** themroc has joined #zuul13:25
mordreddmsimard: "Unlike some other CI tools, pipelines in Vespene are easily and graphically configured, and there is no custom DSL (“Domain Specific Language”) to learn and debug."13:26
mordredEDONOTWANT13:26
SpamapSzomg13:33
SpamapSalso13:33
SpamapSdidn't somebody tell him he's not allowed to python anymore?13:34
rcarrillocruz...13:55
rcarrillocruzjust UI?13:55
rcarrillocruzwow...13:55
*** jpena|lunch is now known as jpena|mtg13:55
*** sshnaidm is now known as sshnaidm|ruck14:18
*** rfolco has quit IRC14:38
*** rfolco has joined #zuul14:49
*** jpena|mtg is now known as jpena14:59
*** quiquell has joined #zuul15:09
quiquellHello15:09
quiquellDo we have access to zuul job inheritance information from a runnin job at a running ansible task ?15:09
quiquellLike for example the running playboks at pre15:10
*** rfolco is now known as rfolco|rover15:10
mordredquiquell: yes - if you look, for instance, at this inventory file: http://logs.openstack.org/69/612169/5/check/nodepool-functional-py35/cdb60df/zuul-info/inventory.yaml15:11
*** irclogbot_3 has joined #zuul15:11
mordredquiquell: you can see the zuul._inheritance_path varialbe15:11
mordrednow - it's marked with a _ - so I wouldn't write a ton of logic based on it - it's mostly there for human debugging purposes15:12
*** goern has joined #zuul15:13
quiquellmordred: is ther eany way we can access te Job python model from the ansible tasks ?15:19
mordredquiquell: no, I do not believe so - what are you trying to do?15:20
quiquellmordred: we are reworking the reproducer we have a tripleo15:20
mordred(also, I may come and go for a bit - ton of phone calls today, so if I disappear for a minute, it's not personal)15:21
quiquellmordred: And wanted to try to get the info from pre runs for example15:21
mordredgotcha. I think this might overlap with the work people have been interested in in terms of tooling to locally run a zuul job. clarkb jhesketh I can't remember where discussion around that is, do you?15:22
clarkbmordred: in denver the OSA crew was going to fiddle with getting something going that relied on the jobs api to list out the bits you need. I think the api needed more work/info in it to make that possible and havent heard or seen that happening yet15:24
mordredclarkb: nod. so odyssey4me might be a better person to ping there15:25
clarkbya15:27
quiquellrlandy: ^15:29
*** bhavikdbavishi has joined #zuul15:38
*** sshnaidm|ruck is now known as sshnaidm|bbl16:13
kmallocdmsimard: wow, that makes me cringe =/16:15
kmallocSpamapS, mordred ++16:15
*** quiquell is now known as quiquell|off16:15
*** bhavikdbavishi has quit IRC16:34
*** bhavikdbavishi has joined #zuul16:35
ssbarneais the "files" section on jobs inhered from parent (merged) or if you define it in job, it will completely replace parent values?16:49
clarkbssbarnea: https://zuul-ci.org/docs/zuul/user/config.html#attr-job.files you inherit your parents value, but if you define a new value that overrides16:52
Shrewsclarkb: ianw: either of you want to push https://review.openstack.org/609829 (Cleanup down ports) through?16:58
ssbarneaclarkb : thanks. docs states clearly. so I need to copy/paste values from parent.17:00
ssbarneamake sense, a merge strategy could bring undesired behaviour for others. cannot make everyone happy.17:01
clarkbssbarnea: probably good to have ianw double check it again since ianw did a lotof the automation hacks around that17:03
clarkber Shrews ^17:03
clarkbsorry ssbarnea17:03
ssbarneaclarkb : not this is not in docs: If I list foo.bar into both files and irellevant-files, which one wins? I hope inclusion wins.17:03
clarkbShrews: mordred also should we filter by the port type to only cleanup the nova compute ports17:03
Shrewsclarkb: yeah sure17:03
clarkbssbarnea: I think that is an error, they have to be distinct lists iirc17:03
Shrewsclarkb: oh right! i forgot that17:04
AJaegerzuul cores, here's small change for zuul-jobs - please review https://review.openstack.org/61378517:04
Shrewsclarkb: i can't find that info you pasted in irc. still have it?17:06
clarkbShrews: let me see17:06
clarkbShrews: "The entity type that uses this port. For example, compute:nova (server instance), network:dhcp (DHCP agent) or network:router_interface (router interface)."17:07
clarkbShrews: from the neutron api port list/show docs17:07
Shrewsclarkb: device_owner, right?17:09
Shrewsok yep17:09
clarkbya device_owner17:10
*** themroc has quit IRC17:10
mordredclarkb: have we seen that set properly on the leaked ports?17:22
Shrewsclarkb: so, umm, that value doesn't appear to be consistent. For vexxhost, I get back device_owner = compute:ca-ymq-217:22
mordredI think it's "compute:{az}" - and 'nova' is the default az name17:22
Shrewsi mean, my server is in ca-ymq-117:23
Shrewsso... ????17:23
mordredShrews: does your server have anything in the az field?17:23
Shrewsgimme a sec to mod my script...17:23
clarkbmordred: it will either be None or set17:23
clarkbmordred: mostly I want to avoid deleting router ports17:24
mordredI'm just curious if there isa  ca-ymq-2 az there17:24
Shrewsmordred: yeah, ca-ymq-2, so that matches17:25
mordredof course, that makes it harder to filter out17:25
clarkbShrews: probably you can check if None or startswith compute:17:25
clarkbsince the compute: prefix is constant I think17:26
Shrewsclarkb: yeah, would have to be a manual filter instead of pushdown17:26
Shrewsclarkb: should we ignore None valued ports?17:26
Shrewsor include those in the delete list17:27
clarkbShrews: no I think you delete None valued device_owner ports17:27
Shrewsk17:27
openstackgerritBenoît Bayszczak proposed openstack-infra/zuul master: upgrade minimum Ansible version to 2.5.2  https://review.openstack.org/61399917:27
clarkbsince sometimes leaked ports don't get far neough to have a device_owner17:27
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Cleanup down ports  https://review.openstack.org/60982917:35
Shrewsthat should do it17:35
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Cleanup down ports  https://review.openstack.org/60982917:36
Shrews"computer ports" != "compute ports"17:37
Shrewsjust fyi17:37
openstackgerritClark Boylan proposed openstack-infra/zuul master: Small script to scrape Zuul job node usage  https://review.openstack.org/61367417:39
mordredShrews: additoin looks good17:52
*** jpena is now known as jpena|off18:07
openstackgerritClark Boylan proposed openstack-infra/zuul master: Small script to scrape Zuul job node usage  https://review.openstack.org/61367418:33
*** robcresswell has joined #zuul18:51
*** bhavikdbavishi has quit IRC18:55
openstackgerritTobias Henkel proposed openstack-infra/zuul-jobs master: Add prepare-workspace-git role  https://review.openstack.org/61303619:22
*** mrhillsman is now known as mrhillsman_lunch19:53
manjeetscorvus, is there any sample tenant_config that's point to /etc/zuul/main.yaml in zuul.conf here in docker-compose up example https://zuul-ci.org/docs/zuul/admin/quick-start.html20:55
manjeetsi changed gerrit pointers but having issues with gear connection20:55
clarkbmanjeets: http://git.zuul-ci.org/cgit/zuul/tree/doc/source/admin/examples/etc_zuul/main.yaml is the file used by the docker compose quick start20:56
clarkb(the end of the quickstart document points to this directory in the zuul repo for finding more info)20:57
manjeetsclarkb, thanks https://github.com/openstack-infra/zuul/blob/master/doc/source/admin/examples/etc_zuul/zuul.conf#L1120:58
*** robcresswell has quit IRC21:00
manjeetsI changed this pointer to point at main.yaml in etc_zuul/21:01
manjeetsclarkb, I am trying to post a comment using this docker-compose to ci-sandbox, once that works goals is to add a 3rdparty ci job using that21:02
*** mrhillsman_lunch is now known as mrhillsman21:04
clarkbyou'll need to add a project config repo somewhere too I think21:04
*** hashar has quit IRC21:12
manjeetsclarkb, I see in tenant config it asks config-projects ? that's config repo I have locally21:56
manjeets?21:56
*** pcaruana has quit IRC21:57
clarkbmanjeets: ya21:57
manjeetsI still can't understand how would the path to that repo will work21:57
clarkbthat is where you set up your base job and such21:57
manjeetsshould I just create zuul-config inside zuul ?21:57
manjeetsclarkb,  gerrit: config-projects: should I just project-config here ? since it will look for that project on gerrit host ?22:00
manjeetsshould I use project-config from openstack here ?22:00
clarkbmanjeets: no, because project-config is openstack infra's project-config repo and it has our secrets encrypted with our zuul's private keys and such22:00
clarkbmanjeets: you need your own project-config repo that has your own secrets and base job22:00
manjeetswhat kind of secrets are storing if it is okay to ask, would that just be certificates etc or ssh keys as well ?22:02
clarkbyes ssh keys for copying logs for example, afs credentials etc22:02
clarkbbasically you won't be able to use our base job with your zuul because our base job needs access to those secrets which requires running under our zuul for decryption22:03
manjeetsclarkb, sorry to bug again, I am getting weird errors with docker compose, its unable to find the paths that already exists23:06
manjeetsFileNotFoundError: [Errno 2] No such file or directory: '~/.ssh/id_rsa' while making a connection to gerrit23:07
manjeetsbut I checked many times it actually exists in the machine23:07
clarkbmanjeets: I think it tries to use the .ssh/id_rsa for the current user23:07
clarkbdoes the current user have that? sudo might make this weird23:07
manjeetsi created one for current user23:07
manjeetsand also Exception: Unable to read tenant config file at /home/ubuntu/zuul/doc/source/admin/examples/etc_zuul/main.yaml23:10
manjeetsI manually created that file and it exists23:10
manjeetsnot sure if docker-compose runs as a different user ?23:10
clarkbmanjeets: well you have torun it with sudo and then it bind mounts things so maybe that is affecting it?23:11
manjeetsclarkb, ok i think I got it, I ran docker compose with sudo so probably it's looking ~/.ssh for root user ?23:12
clarkbpossibly23:14
manjeetsclarkb, i created one for root but still the same issue, does the scripts create any specific user for running these containers, it could be looking from inside containers as well ?23:20
clarkbmanjeets: I don't know23:22
*** rlandy has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!