Wednesday, 2019-01-16

*** studarus has joined #zuul00:10
openstackgerritIan Wienand proposed openstack-infra/nodepool master: Use bindep.txt with devstack  https://review.openstack.org/63089000:30
openstackgerritIan Wienand proposed openstack-infra/nodepool master: [wip] Use bionic for functional testing  https://review.openstack.org/63110200:30
* SpamapS flips desk over00:36
SpamapSAWS test works fine when run alone00:36
SpamapSbut fails when run via `tox -e py36`00:36
clarkbstale deps? you cna use -r to rebuild the venv00:38
clarkband if you are running the full suite that could indicate you've got leaky tests interacting iwth each other00:38
SpamapSjust did00:40
SpamapSthe thing is, the only test that causes this, is the first one that times out00:41
SpamapSI'm running with --analyze-isolation now00:41
SpamapSthat could take an hour or two :-P00:42
SpamapSAnd I'm not sure what it will say00:44
SpamapSbut hopefully it finds some kind of bad interaction00:44
SpamapSyep, no interaction found01:04
SpamapSwell it seems the problem is something with mock.patch and nodescan01:16
* SpamapS digs deeper01:16
*** studarus has quit IRC01:21
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/nodepool master: Amazon EC2 driver  https://review.openstack.org/53555801:35
SpamapStristanC: ^ and others ... rebased and fixed the test01:35
* SpamapS hopes we can get that driver landed01:35
fungiit's getting a mention in the zuul spotlight for the osf newsletter going out tomorrow (depending on where in the word you are, later today utc)02:00
fungis/word/world/02:01
openstackgerritMerged openstack-infra/nodepool master: Document default values of runtime arguments  https://review.openstack.org/63067902:04
*** threestrands has joined #zuul02:13
openstackgerritIan Wienand proposed openstack-infra/nodepool master: [wip] Use bionic for functional testing  https://review.openstack.org/63110202:57
ShrewstristanC: not sure if you saw the comment in here from corvus a few days ago, but waiting to approve 570667 once there is a follow up review for the image-pull doc02:59
tristanCShrews: oh, thanks for the reminder, i'll have a look soon03:06
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064903:26
sshnaidmtristanC, trying something like that ^^03:27
*** studarus has joined #zuul03:35
openstackgerritIan Wienand proposed openstack-infra/nodepool master: [wip] Use bionic for functional testing  https://review.openstack.org/63110203:41
*** threestrands has quit IRC03:42
*** studarus has quit IRC03:50
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064904:10
*** threestrands has joined #zuul04:11
*** threestrands has quit IRC04:11
*** bjackman_ has joined #zuul04:39
*** sshnaidm has quit IRC04:52
*** sshnaidm has joined #zuul04:55
*** bjackman__ has joined #zuul05:00
*** bjackman_ has quit IRC05:03
openstackgerritIan Wienand proposed openstack-infra/nodepool master: Switch devstack jobs to bionic  https://review.openstack.org/63110205:35
*** swest has quit IRC06:06
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064906:13
*** swest has joined #zuul06:20
*** pcaruana has joined #zuul07:12
*** quiquell|off is now known as quiquell07:13
*** gtema has joined #zuul07:36
*** AJaeger has quit IRC07:53
*** quiquell is now known as quiquell|brb07:58
*** gtema has quit IRC08:02
*** AJaeger has joined #zuul08:05
*** gtema has joined #zuul08:10
*** themroc has joined #zuul08:23
*** quiquell|brb is now known as quiquell08:23
*** gtema has quit IRC08:50
*** gtema has joined #zuul08:50
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064908:51
*** jpena|off is now known as jpena09:01
*** bjackman__ has quit IRC09:15
*** gtema has quit IRC10:01
*** gtema has joined #zuul10:03
*** hashar has joined #zuul10:08
*** electrofelix has joined #zuul10:09
openstackgerritMatthieu Huin proposed openstack-infra/zuul-jobs master: install-nodejs: add support for RPM-based OSes  https://review.openstack.org/63104910:16
openstackgerritMatthieu Huin proposed openstack-infra/zuul-jobs master: install-nodejs: add support for RPM-based OSes  https://review.openstack.org/63104910:20
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: WIP: Separate out executor server from runner  https://review.openstack.org/60707910:23
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: WIP: runner: implement prep-workspace  https://review.openstack.org/60708210:23
openstackgerritTristan Cacqueray proposed openstack-infra/zuul master: WIP: runner: add execute sub-command  https://review.openstack.org/63094410:23
*** sshnaidm is now known as sshnaidm|afk10:28
openstackgerritMatthieu Huin proposed openstack-infra/zuul-jobs master: install-nodejs: add support for RPM-based OSes  https://review.openstack.org/63104910:33
*** hashar has quit IRC10:53
*** panda|off is now known as panda11:13
openstackgerritTobias Urdin proposed openstack-infra/zuul-jobs master: Fix upload-puppetforge role  https://review.openstack.org/63119411:32
openstackgerritMatthieu Huin proposed openstack-infra/zuul-jobs master: install-nodejs: add support for RPM-based OSes  https://review.openstack.org/63104911:35
*** tobias-urdin has joined #zuul11:39
tobias-urdinis it possible to make a zuul post-run playbook separate from another one? like if i have:11:40
tobias-urdin- post-run:11:40
tobias-urdin    - play1.yml11:40
tobias-urdin    - play2.yml11:40
tobias-urdinif play1 fails it shouldn't skip play2 but still give POST_FAILURE11:40
*** gtema has quit IRC11:43
*** gtema has joined #zuul11:56
*** gtema has quit IRC12:02
*** gtema has joined #zuul12:04
tobiashtobias-urdin: I think zuul should behave exactly like that12:11
*** bjackman has joined #zuul12:18
*** panda is now known as panda|lunch12:31
*** jpena is now known as jpena|lunch12:35
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Add change message to Zuul vars in inventory  https://review.openstack.org/63120712:36
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Include PR title in change message  https://review.openstack.org/63120812:36
*** sshnaidm|afk is now known as sshnaidm12:41
*** avass has joined #zuul12:42
avasssetting submit: false for gerrit seems to throw an exception http://paste.openstack.org/show/742745/12:42
tobiashavass: submit is opt-in so if you just don't declare it you have the behavior you want12:45
tobiashbut I think catching this case might make sense12:46
avasstobiash: yeah i guessed as much, but seems like it would be better to ignore it if it's set to false12:46
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064912:51
*** electrofelix has quit IRC12:58
*** bjackman has quit IRC13:02
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Don't request node nodes for skipped child jobs  https://review.openstack.org/63121313:04
openstackgerritSimon Westphahl proposed openstack-infra/zuul master: Don't request nodes for skipped child jobs  https://review.openstack.org/63121313:05
*** bjackman has joined #zuul13:06
openstackgerritMatthieu Huin proposed openstack-infra/zuul-jobs master: install-nodejs: add support for RPM-based OSes  https://review.openstack.org/63104913:18
*** panda|lunch is now known as panda13:28
*** jpena|lunch is now known as jpena13:34
*** rlandy has joined #zuul13:39
*** bjackman has quit IRC13:45
openstackgerritFelix Schmidt proposed openstack-infra/zuul master: Add action to task result in zuul_json callback  https://review.openstack.org/63062213:46
openstackgerritFelix Schmidt proposed openstack-infra/zuul master: Add action to host results in zuul_json callback  https://review.openstack.org/63062214:10
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064914:37
*** quiquell is now known as quiquell|off14:39
*** ssbarnea|rover has quit IRC14:40
*** ssbarnea|rover has joined #zuul14:40
*** gtema has quit IRC14:47
*** snk has left #zuul14:48
*** gouthamr has quit IRC14:54
*** dmellado has quit IRC14:56
jlktobiash: maybe! I haven't been able to pay much attention there lately15:31
tobias-urdintobiash: ack, thanks for the input :)15:37
openstackgerritTobias Urdin proposed openstack-infra/zuul-jobs master: Fix upload-puppetforge role  https://review.openstack.org/63119415:39
*** avass has quit IRC15:52
openstackgerritMonty Taylor proposed openstack-infra/zuul-jobs master: Fix docker image password docstring  https://review.openstack.org/63126615:57
sshnaidmpabelanger, clarkb finally succeded to run "show server", but I don't see there userdata :( http://logs.openstack.org/49/630649/13/check/nodepool-functional-py35/476591d/job-output.txt.gz#_2019-01-16_15_19_12_84732816:13
*** gtema has joined #zuul16:14
sshnaidmpabelanger, clarkb is --os-cloud devstack-admin right credentials to see it?16:15
clarkbI wonder if osc doesn't show it (the api docs say it is included in the response to admin server GETs though)16:15
sshnaidmclarkb, what else can I try?16:17
openstackgerritMerged openstack-infra/zuul-jobs master: Add docker image promotion roles  https://review.openstack.org/63107816:17
clarkbsshnaidm: maybe nova client16:18
tobiashjlk: thanks :)16:19
pabelangersshnaidm: I also think we lay down clouds.yaml, so shouldn't need to use --os-username16:22
clarkbpabelanger: there are multiple users though16:22
sshnaidmpabelanger, what do you mean?16:22
clarkbone is the regular user and the other is admin iirc16:22
pabelangersshnaidm: actually, never mind. I see we are still using it for the nova keypair-add logic16:23
*** pcaruana has quit IRC16:25
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064916:32
mordredcorvus: I pushed up a doc fix to your docker roles: 63126616:35
mordredclarkb: ^^16:35
corvusmordred: approved16:38
*** gouthamr has joined #zuul16:45
openstackgerritTobias Urdin proposed openstack-infra/zuul-jobs master: Use PDK to build puppet module  https://review.openstack.org/62753416:57
openstackgerritMerged openstack-infra/zuul-jobs master: Fix docker image password docstring  https://review.openstack.org/63126617:01
openstackgerritTobias Urdin proposed openstack-infra/zuul-jobs master: Fix upload-puppetforge role  https://review.openstack.org/63119417:06
openstackgerritTobias Urdin proposed openstack-infra/zuul-jobs master: Use PDK to build puppet module  https://review.openstack.org/62753417:09
*** gtema has quit IRC17:18
* SpamapS starts the process of adapting AWS/EC2 driver to the config extraction17:27
ShrewsSpamapS: should be pretty straight forward. the changes to the openstack driver are a good model to follow: https://review.openstack.org/#/c/621642/4/nodepool/driver/openstack/config.py17:33
SpamapSShrews: yeah that's exactly what I'm doing17:37
SpamapSthanks17:37
SpamapS90% done I think17:37
SpamapSJust in time for my team to start investigating google cloud. ;)17:37
*** studarus has joined #zuul17:43
*** themroc has quit IRC17:44
tobiashJust in time for us to start investigating aws :)17:50
pabelangerSame, was planning on looking at it next week myself17:51
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/nodepool master: Amazon EC2 driver  https://review.openstack.org/53555817:51
SpamapS^^ should finally pass all CI17:52
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064917:54
tobiashI've created a small terraform script that spins up zuul test vm that runs the whole test suite in a minute.17:56
tobiashIs there interest for sharing it somewhere in the zuul repo?17:57
tobiashThat comes with a smal tox wrapper that rsyncs the workspace to the node, runs tox and copies back .stestr17:58
openstackgerritMerged openstack-infra/zuul master: Fix test_load_governor on large machines  https://review.openstack.org/63011818:00
*** jpena is now known as jpena|off18:03
ShrewsSpamapS: a small correction noted18:06
pabelangeryay, upgraded to nodepool 3.4.018:10
pabelangernow to try out new zuul exeuctor zones18:11
ShrewsSpamapS: oops, 2 now18:11
SpamapSShrews: thanks for reviewing!18:13
SpamapSgetting closer I hope18:13
corvusdmsimard, pabelanger, mordred: can you review https://review.openstack.org/630622  ?18:20
openstackgerritMerged openstack-infra/zuul master: tests: improve test_web to only provision events when needed  https://review.openstack.org/63057518:27
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064918:48
pabelangercorvus: +218:49
*** hashar has joined #zuul18:59
*** studarus has quit IRC19:14
*** gouthamr_ has joined #zuul19:16
*** dmellado has joined #zuul19:22
openstackgerritMerged openstack-infra/zuul master: Gracefully close db connections in tests  https://review.openstack.org/63047119:23
SpamapSI wonder if we could get Zuul to click the 'squash this' API action instead of the 'merge this'.20:01
SpamapS(for github)20:01
SpamapSI have a lot of users who are very trained to just tack on commits endlessly during reviews, and then use squash at the end. It actually is probably a much better workflow than force-push.20:01
SpamapSI don't see any practical reason it would invalidate the gating process. Ultimately the merge done in the gate and the squash done after would result in the same content in the repo.20:02
clarkbit might make correlating between github and zuul test jobs more difficult after the fact. And increases the amount of work to make zuul push the commits itself20:03
clarkbbut I don't think those are deal breakers20:03
pabelangerYay, I managed to deploy a zuul, from another zuul. zuul's all the way down20:05
tobiashSpamapS: we probalby should combine this with a squash merge method in the mergers20:11
tobiashThere is already a possibility to specify the merge mode in the project pipeline20:11
tobiashThis could be plumbed through to the reporter20:12
SpamapSYeah that'd be great.20:27
SpamapSclarkb: I'd love to implement it as part of zuul-pushes actually20:27
SpamapSBut yeah, either way, I think it's going to be needed, or github users will see Zuul as a workflow-impediment.20:28
SpamapSSince right now I have to ask people to force-push a squash, or we land a bunch of fixups.20:28
clarkbI was under the impression that was how github always did it fwiw. Didnt' realize they added feature to do it for you. Seems like I'm still occasionalyl asked to squash things20:29
SpamapSIt's a controversial feature.20:30
SpamapSYou can turn it off.20:30
SpamapSAnd many projects do.20:30
clarkbSpamapS: ya seems like people are mad that gerrit encourages that type of workflow so odd that github would do it for you too20:30
clarkbbut I guess  choice is the important thing there20:30
SpamapSbut generally, if you look next to the "Merge" button, there's a down arrow and you can choose "Squash and Merge"20:30
clarkbdoes it let you edit the commit message? or does it use the PR top comment?20:31
SpamapSThe commit message becomes the PR description.20:31
SpamapSIt might also add some stuff about the squashed stuff, I haven't used it in a while20:31
SpamapSIn general I find that github users are *very* confused that commit messages even exist.20:31
SpamapSIt's like "what, who cares? it's just a commit message"20:31
SpamapSAnd IMO that comes from the fact that they don't have inline comments on commit messgaes like Gerrit does, so it's just some side-metadata thing to them.20:32
clarkbah20:32
SpamapS(until they need to annotate... ;-)20:36
*** hashar has quit IRC21:03
*** rcarrillocruz has quit IRC21:35
fungizuul is in the spotlight for the osf newsletter which just went out: http://superuser.openstack.org/articles/inside-open-infrastructure-1-16/21:40
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064921:45
*** gouthamr has quit IRC21:56
*** gouthamr_ is now known as gouthamr21:56
*** studarus has joined #zuul22:06
sshnaidmclarkb, pabelanger wrt  https://review.openstack.org/#/c/630649/I tried nova request with debug, also to download metadata json, nothing shows "userdata": http://logs.openstack.org/49/630649/17/check/nodepool-functional-py35/e2fbac1/job-output.txt.gz#_2019-01-16_22_17_21_13386722:25
sshnaidmclarkb, pabelanger so I'm outta ideas how to test it..22:25
clarkbsshnaidm: https://developer.openstack.org/api-ref/compute/?expanded=show-server-details-detail is the docs for that22:26
clarkbsays it is OS-EXT-SRV-ATTR:user_data22:26
sshnaidmclarkb, damn! it's base64 encoded!22:28
clarkbyes and it is there22:28
sshnaidmclarkb, http://logs.openstack.org/49/630649/16/check/nodepool-functional-py35/28db36c/job-output.txt.gz#_2019-01-16_19_20_30_82031622:28
sshnaidmarghh, I looked for text22:29
clarkbuser data is always base64 in nova aiui22:29
clarkbthe client tooling helpfully doest he conversion for you22:29
sshnaidmclarkb, yeah, didn't realize that22:29
sshnaidmclarkb, great, thanks, now it's clear, so checking if we have anything is ok? or need to decode it?22:30
clarkbyou might want to decode it and check for some substring just to be sure it came from nodepool22:30
clarkb(also is the base64 data in the osc output?)22:30
*** threestrands has joined #zuul22:51
openstackgerritSagi Shnaidman proposed openstack-infra/nodepool master: Support userdata for instances in openstack  https://review.openstack.org/63064922:54
*** rlandy is now known as rlandy|bbl23:26
SpamapSclarkb: just tested and GitHub's squash+merge actually stops to let you edit the commit message.23:35
clarkbnice23:35
clarkb(that is how I would want it to work so good to see they give you that option)23:35
SpamapSspeaking of Gerrit23:38
SpamapSI just got a 38" ultra-wide curved monitor and... gertty diffs are *glorious*23:38
sshnaidmclarkb, pabelanger I maked: https://review.openstack.org/#/c/630649/23:43
sshnaidmready for review23:43
*** sshnaidm is now known as sshnaidm|afk23:43
jlkit's ... somewhat nice23:45
jlkbut it still changes the hash at merge time23:45
jlk(necessary), but there is no CI check for that23:46
clarkbjlk: ya that is a git behavior you can't get around23:47
SpamapSjlk: wouldn't be necessary if github would adopt the git-review/gerrit model for PR's. ;)23:48
clarkb(the new sha1)23:48
jlkyeah yeah23:48
jlkactually I think you can PREDICT what that hash would be before the merge happens23:48
SpamapSI'm surprised we haven't ever gotten around to zuul pushing directly.23:49
SpamapSWhich would allow us to control our destiny here.23:49
clarkbjlk: git accounts for the timestamp so if you fake the time you can23:49
clarkb(this is why cherry picking gives you a new sha1 too)23:49
mordredSpamapS: zuul pushing directly is a thing we've wanted to get to - it's also required for implemeting lock-step/circular depends23:55
mordredSpamapS: so I believe it's actually a thing we'll see in the not-too-distant future23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!