Tuesday, 2018-11-06

openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [wip] validate-host: retry network tests and include unbound logs  https://review.openstack.org/61569800:35
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [wip] validate-host: retry network tests and include unbound logs  https://review.openstack.org/61569800:39
*** rlandy has quit IRC01:09
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [wip] validate-host: retry network tests and include unbound logs  https://review.openstack.org/61569801:13
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: [wip] validate-host: retry network tests and include unbound logs  https://review.openstack.org/61569802:06
*** ianychoi has quit IRC02:10
*** ianychoi has joined #zuul02:10
*** toabctl has quit IRC02:19
*** toabctl has joined #zuul02:23
*** bhavikdbavishi has joined #zuul03:33
*** bhavikdbavishi has quit IRC03:35
openstackgerritIan Wienand proposed openstack-infra/zuul-jobs master: validate-host: retry network tests and include unbound logs  https://review.openstack.org/61569803:38
openstackgerritMerged openstack-infra/zuul master: Merger: automatically add new hosts to the known_hosts file  https://review.openstack.org/60845306:03
*** AJaeger_ has quit IRC07:15
*** AJaeger has joined #zuul07:26
*** pcaruana has joined #zuul07:36
*** themroc has joined #zuul08:26
*** jpena|off is now known as jpena08:47
*** sshnaidm|afk is now known as sshnaidm|rover09:45
openstackgerritTobias Henkel proposed openstack-infra/zuul master: Improve windows logging  https://review.openstack.org/61580409:53
*** electrofelix has joined #zuul10:10
*** bhavikdbavishi has joined #zuul10:37
tobiashjhesketh: do you have any idea how to mock logging tests for ^ ?11:01
tobiashjhesketh: if you can give me a hint I'm happy to add them11:02
*** bhavikdbavishi has quit IRC11:05
openstackgerritMerged openstack-infra/zuul master: Fix issue in Github connection with large diffs  https://review.openstack.org/61298911:30
jheskethtobiash: I haven't looked at the specifics, but it'd probably be tricky.. it might give us better ways of testing the callback module though if we find a way to do it11:55
jheskethI don't have anything off the top of my head though sorry11:55
tobiashjhesketh: for linux we do have the tox-remote tests but they won't work with windows11:56
jheskethright, I was more thinking a unit test that mocked out the CallbackModule11:56
tobiashthe problem is that this stuff is deep inside ansible mechanics so I wouldn't feel comfortable even if we had a mocked test11:57
jheskethright, agreed11:58
jheskethanyway, hence it was a nit in case there was a neat way of mocking it that I didn't know about11:58
tobiashthanks for review and the thoughts :)11:58
jheskethanytime :-)11:58
*** jpena is now known as jpena|lunch12:38
*** tobias-urdin has joined #zuul12:51
tobias-urdinsuper close to getting a job execution (not noop) in our internal zuul, just stuck on this final issue, nodepool does spawn a instance but executor fails with12:52
tobias-urdinhttp://paste.openstack.org/show/734247/12:52
tobias-urdinFileNotFoundError: [Errno 2] No such file or directory: 'bwrap': 'bwrap'12:52
tobias-urdinanybody has any pointers?12:52
tobias-urdinim is it searching for the zuul-bwrap command12:59
tobias-urdinhm12:59
*** rlandy has joined #zuul13:02
tobiashtobias-urdin: you need to install bwrap (bubblewrap)13:03
tobiashthat is used by zuul to run the jobs in a sandbox13:03
tobias-urdinon the zuul node or is that error from running inside the instance spawned for the job?13:04
tobiashon the host that runs the zuul-executor service13:04
tobias-urdintobiash: ok, do you have a link for that? can find it here https://github.com/openstack-infra/zuul/blob/master/tools/test-setup.sh#L5613:09
tobias-urdinor is that the official way to use it13:09
tobiashthat is a script that installs the binary dependencies during testing13:11
tobias-urdinwhats the official link to bubblewrap and how to install it?13:12
tobiashit should be included in most distros13:12
tobias-urdinah ty13:13
tobiashwhat distro are you using?13:13
tobias-urdinubuntu 18.04, just did a apt install bubblewrap, crossing fingers on the recheck now13:13
tobiashthat should be fine13:14
* tobias-urdin celebrates13:15
tobias-urdinfirst +1 job with zuul v3 :D13:15
tobiash:)13:15
tobias-urdinthanks tobiash, some struggle to understand how to set it up but i'm amazed on how well it works straight out of the box with zuul + nodepool13:16
tobiash:)13:16
tobiashtobias-urdin: there is now a docker-compose based all in one tutorial for testing too: https://zuul-ci.org/docs/zuul/admin/quick-start.html13:19
*** jpena|lunch is now known as jpena13:28
tobias-urdintobiash: yeah, i usually enjoy doing it manually though to understand all the moving parts, i have some stuff left to fix like web/fingergw and log collection but that'll be for another time13:32
tobias-urdinwill probably go crazy tonight and start converting all our jenkins to zuul, so excited heh13:33
tobias-urdinquick question though, i have my zuul main.yaml in /etc/zuul on the zuul machine, could i have a minimalistic main.yaml there that just configures the tenant, source and config-projects13:36
tobias-urdinthen reads untrusted-projects for my config-projects repo? so i can have that in our config repo in git13:37
tobiashyes, the main.yaml only contains the list of repos, no project config13:37
tobiashah you mean having a dynamic list of untrusted-repos?13:38
tobiashnot, that's currently not possible13:38
tobiashbut if it helps, the main.yaml also can be a script that outputs a complete tenant config with all repos13:39
tobias-urdinokok, it doesn't reload main.yaml automatically/on change/periodically like it does with config projects either right?13:40
tobiashno, but you can trigger a full reconfiguration that re-reads the tenant config13:40
tobias-urdincool, thanks for all the help!13:41
tobiashhttps://zuul-ci.org/docs/zuul/admin/components.html?highlight=reconfigure#operation13:41
* Shrews celebrates all the tobias's's's13:52
Shrewsfyi, i am having windows installed on my home today, so will likely be... distracted13:53
tobiashShrews: good luck with your windows13:54
Shrewstobiash: thx!13:58
*** hashar has joined #zuul13:58
sshnaidm|roverHi, I need to disable one of pipelines in zuul, how can I do it? I see  there is "pipeline.disabled" option, but not sure how to configure it: https://zuul-ci.org/docs/zuul/user/config.html14:02
tobiashsshnaidm|rover: I never disabled a pipeline but reading these docs I think the easiest way is to just remove the triggers14:04
sshnaidm|rovertobiash, as I read in triggers, it should be at least one14:05
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Add ignore_basepython_conflicts option to tox.ini  https://review.openstack.org/61588714:10
openstackgerritMonty Taylor proposed openstack-infra/zuul master: Add ignore_basepython_conflict option to tox.ini  https://review.openstack.org/61588714:17
mordredShrews: I'm jealous of your new windows. I would like new windows14:38
Shrewsmordred: the old ones were soooooo bad14:38
Shrewsand now i am surrounded by buzzsaws14:38
mordredShrews: that sounds pleasant14:39
Shrewsand the hammering. so much hammering14:40
Shrewsmordred: yes, about as pleasant as a wet angry cat in your lap14:41
openstackgerritMerged openstack-infra/zuul master: Don't do live streaming in loops  https://review.openstack.org/61565714:47
openstackgerritMerged openstack-infra/zuul master: Improve windows logging  https://review.openstack.org/61580414:49
corvussshnaidm|rover: i think you can have "triggers: []"15:45
sshnaidm|rovercorvus, ok, I left just one comment-trigger so that can run it on-demand, it's even better15:45
corvussshnaidm|rover: ++15:45
*** tflink has quit IRC15:56
*** tflink has joined #zuul15:58
*** tflink has quit IRC16:03
*** tflink has joined #zuul16:04
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool master: Revert "Revert "Cleanup down ports""  https://review.openstack.org/61437016:06
*** panda is now known as panda|ko16:06
*** hashar has quit IRC16:10
*** goern has quit IRC16:23
openstackgerritMerged openstack-infra/zuul master: Resume paused job with skipped children  https://review.openstack.org/61549316:30
*** panda|ko is now known as panda|off16:34
*** themroc has quit IRC16:43
mordredcorvus: https://review.openstack.org/#/c/615887/ - simple patch, but I thought I'd bring it to your attention as it's a thing we should keep our eyes out for across projects16:46
openstackgerritMonty Taylor proposed openstack-infra/nodepool master: Only set basepython once  https://review.openstack.org/61594216:49
*** chandankumar is now known as chkumar|pto16:59
dmsimardI remember discussions around making zuul jobs reproducible outside of a zuul/nodepool environment17:39
dmsimardIs that still a thing people are interested in ?17:39
*** sshnaidm|rover is now known as sshnaidm|afk17:56
tobiashdmsimard: everyone is interested in this ;)17:57
tobiashdmsimard: I think SpamapS shared some scripts that help with that a while ago17:57
*** jpena is now known as jpena|off18:05
*** caphrim007 has joined #zuul18:06
mordreddmsimard: also, I believe there was a discussion at the PTG about ways to do it that involved some amount of getting of info from the API18:08
mordreddmsimard: I keep forgetting who, other than jhesketh, was working on that18:08
clarkbmordred: odyssey4me and the osa team expressed an interest18:08
mordredyes! that's who it was18:09
clarkband I think tripleo is now looking at it too. We probably should try to get the different groups to collaborate more directly with zuul as na upstream18:09
mordredyah18:09
*** bhavikdbavishi has joined #zuul18:19
corvusyeah, odyssey4me &co were going to focus on the aspect of recording merger actions and playbooks to accomplish "what did this job do?".  jhesketh was going to focus on an api endpoint to answer "what will this job do for this project-branch?"18:25
corvustwo complimentary parts of the puzzle18:25
corvusmordred: thanks for the heads up18:26
odyssey4mehoping to, but all snowed under right now :/18:29
*** rfolco|ruck is now known as rfolco|doctor18:30
dmsimardclarkb: yes, I was asking due to tripleo actually18:35
dmsimardARA's scope doesn't include playbook execution (on purpose) but it has a lot of data, including the playbook and role files exactly as they ran18:39
dmsimardactually, nevermind.. zuul knows exactly which ref to pull and where to get it from18:41
*** jimi|ansible has quit IRC18:43
SpamapSdmsimard: I made a zuul-local that helped19:01
*** electrofelix has quit IRC19:14
*** rlandy is now known as rlandy|vote19:26
openstackgerritMerged openstack-infra/zuul master: Parallelize prime_installation_map  https://review.openstack.org/60787619:43
openstackgerritMerged openstack-infra/zuul master: Add ignore_basepython_conflict option to tox.ini  https://review.openstack.org/61588719:43
*** bhavikdbavishi has quit IRC19:57
*** rlandy|vote is now known as rlandy19:58
openstackgerritFabien Boucher proposed openstack-infra/zuul master: WIP - Pagure driver  https://review.openstack.org/60440420:11
*** rfolco|doctor is now known as rfolco|off20:16
dkehnIs there a way, or what is the way in the zuul.conf [connection <github>] to not use https? When connecting to the github system.21:03
dkehninstead use http://github……21:04
clarkbdkehn: the github driver in zuul has hardcoded https21:06
clarkbyou can disable ssl verification though21:06
dkehnclarkb: I saw that21:06
dkehnclarkb will try21:07
dkehnclarkb: thanks again21:07
openstackgerritJeremy Stanley proposed openstack-infra/nodepool master: Correct heading levels for Kubernetes config docs  https://review.openstack.org/61600721:11
fungidkehn: what's the use case? accessing github through a transparent proxy?21:12
dkehnfungi: durinng the bring up of the zuul the scheduler will https://github……. to getProtectedBranches, it returns a 404, I believe because we are using enterprise inside so only http is required21:16
dkehnclarkb: verify_ssl = False did not work, becuase of ^^^21:17
fungiaha21:17
clarkbdkehn: I am not sure if zuul has made a correct assumption that https should always be used. But I would guess you probably want to https even though its enterprise internal only21:18
fungii wonder if this is something tobiash has worked around (seems like they're using enterprise too?)21:18
clarkbfungi: my guess is bmw runs with https21:18
fungia reasonable guess21:18
fungidkehn: are you saying you have a github enterprise deployment with broken/disabled https and everyone is just using http?21:19
dkehnhtat would have been a reasonable guess here, will validate the ssl or no ssl to be sure, becuase to me it seems wacked that you wouldn’tr use ssl21:19
dkehnfungi: that maybe what I’m saying21:20
dkehnmy error we are using ssl, it maybe more of a network issues, any thoughts on how to get into the examples zuul-scheduler21:24
clarkbdkehn: you should be able to docker exec into it21:24
dkehnclarkb: docker exec -it <id> /bin/bash I get a not found21:25
clarkbdkehn: does docker ps -a show it?21:26
dkehnclarkb: yes: "exec: \"/bin/bash\": stat /bin/bash: no such file or directory"21:26
dkehnclarkb: thats the error21:26
clarkbah its not finding bash, try sh?21:27
dkehnah21:27
clarkbthese are minimal alpine python images21:27
clarkbnot sure if they have a bash21:27
dkehnclarkb: /bin/sh worked, thanks21:28
*** pcaruana has quit IRC21:31
tobiashdkehn: I guess you are using a technical zuul user  and not using github app auth?21:36
tobiashIf yes, that user needs to be admin on the repo to be able to query protected branches21:37
tobiashI'd strongly recommend github app auth21:37
dkehntobiash: I agree, but we initially went down that path, and was turned down, so in our repos we all have admin, makes sense no...21:52
tobiashdkehn: your decision, you just have to make sure zuul is also admin on the repo. Then it should be able to query protected branches. This is a requirement since ghe 2.12 afaik21:56
dkehntobiash: ack22:13
*** rfolco|off has quit IRC23:33

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!