Wednesday, 2016-11-09

mordredpabelanger: yah - that syntax got deprecated in 2.0 in favor of something else00:04
pabelangermordred: Ya, found it in the release notes.  Surprisingly, I didn't see any deprecated warnings about it00:06
pabelangereither way, all good. Updating playbooks now00:06
mordredyay00:06
clarkbis it now becomes: root?00:07
clarkbor sudo: true? seems like there are 10 diffferent ways to do this thing depending on version00:07
mordredyah. it's all going to one way00:28
mordredclarkb: it's become: true - and then if you want to become a user that is not root, you use become_user: foo00:30
mordredhttp://docs.ansible.com/ansible/become.html#become-privilege-escalation00:30
*** bcoca has quit IRC04:58
*** saneax-_-|AFK is now known as saneax05:16
*** abregman has joined #zuul07:19
*** abregman has quit IRC08:26
*** abregman has joined #zuul08:28
*** abregman is now known as abregman|mtg08:38
*** bhavik1 has joined #zuul08:42
*** openstackgerrit has quit IRC08:48
*** openstackgerrit has joined #zuul08:49
*** hashar has joined #zuul08:52
*** abregman|mtg has quit IRC09:07
*** abregman has joined #zuul09:10
*** abregman is now known as abregman|mtg09:14
*** abregman|mtg is now known as abregman09:31
openstackgerritMerged openstack-infra/zuul: Re-enable the duplicate_pipeline test  https://review.openstack.org/38419209:42
*** saneax is now known as saneax-_-|AFK11:28
*** bhavik1 has quit IRC11:45
*** bcoca has joined #zuul12:52
*** hashar has quit IRC13:25
*** hashar has joined #zuul13:25
SpamapSWell I'm going to need a whole lot of coding to distract me today.... time to start knocking down the zuul todos.13:32
ShrewsSpamapS: geez you're up early13:47
SpamapSShrews: early flight. :-P13:48
openstackgerritClint 'SpamapS' Byrum proposed openstack-infra/zuul: Fix test_failed_change_in_middle to use tenants  https://review.openstack.org/39560713:57
SpamapSShrews: ^^ a fixed test!13:58
ShrewsSpamapS: so complex13:59
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_single_nonexistent_post_job test  https://review.openstack.org/39169214:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable 4 CRD unit tests  https://review.openstack.org/39349414:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable 3 disabled tests  https://review.openstack.org/39345214:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_file_head test  https://review.openstack.org/39395614:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_failed_change_in_middle test  https://review.openstack.org/39168714:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Move job running into own class  https://review.openstack.org/38596414:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_nonvoting_pipeline  https://review.openstack.org/38676914:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_merger_repack test  https://review.openstack.org/39395314:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_layered_templates test  https://review.openstack.org/39344514:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_job_from_templates_launched job  https://review.openstack.org/39341214:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_two_failed_changes_at_head test  https://review.openstack.org/39395014:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_can_merge unit test  https://review.openstack.org/39295314:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_queue_precedence test  https://review.openstack.org/39419114:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_statsd test  https://review.openstack.org/39347914:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_new_patchset_check / test_abandoned_check  https://review.openstack.org/39345814:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_source_cache unit test  https://review.openstack.org/39327814:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_one_job_project unit test  https://review.openstack.org/39330414:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable 4 disable tests  https://review.openstack.org/39346114:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_needed_changes_enqueue testing  https://review.openstack.org/39300114:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Lower the log level in tests  https://review.openstack.org/39561114:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Remove discover from test-requirements  https://review.openstack.org/39561214:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Ansible launcher: fix afs publisher  https://review.openstack.org/39561314:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Rename zuul_runner to command  https://review.openstack.org/39561414:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Use command module instead of zuul_runner  https://review.openstack.org/39561514:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Put script string in directly instead of in files  https://review.openstack.org/39561614:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Stop running commands with async  https://review.openstack.org/39561714:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Split playbook into vars, pre-playbook and playbook  https://review.openstack.org/39561814:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable pipelining for ansible-playbook  https://review.openstack.org/39561914:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Strip leading / from afs targets  https://review.openstack.org/39562014:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Ansible launcher: Fix afs publisher root detection  https://review.openstack.org/39562114:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Add a note to README.rst about contributing to Zuul v3  https://review.openstack.org/39562214:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Default test log level to DEBUG except for testr  https://review.openstack.org/39562314:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Revert "Put script string in directly instead of in files"  https://review.openstack.org/39562414:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Generate shell scripts as a sequence  https://review.openstack.org/39562514:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Ansible launcher: use sequence-uuid in shell scripts  https://review.openstack.org/39562614:01
pabelangerUm14:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Ansible launcher: import get_exception in ansible command  https://review.openstack.org/39562714:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Ansible launcher: don't close stdout in command module  https://review.openstack.org/39562814:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Add back timeout_var logic  https://review.openstack.org/39562914:01
Shrewsspammer!14:01
openstackgerritPaul Belanger proposed openstack-infra/zuul: Ansible launcher: remove keep_remote_files  https://review.openstack.org/39563014:01
pabelangerthat did go well14:01
mordredpabelanger: did ya submit to master instead of feature/v3 ?14:02
pabelangermordred: that should be feature/v314:02
mordredfascinating14:02
pabelangerlet me see what I did wrong14:02
mordredwell, I'm just going to assume you just wrote a LOT of code14:02
pabelangeris it possible the merge from master to feature/v2 got rewritten14:03
pabelangerhttps://review.openstack.org/#/c/389470/214:03
pabelangersome how I think my patches created new reviews14:04
pabelangerya, looks like it14:05
pabelangermordred: do you mind +3 on https://review.openstack.org/#/c/389470/2 merge from master into feature/v314:06
pabelangerthen I should be able to rebase properly again14:07
mordredpabelanger: done14:18
pabelangermordred: danke14:18
pabelangermordred: Hmm, 389470 still 'Needs Verified' even that jenkins has +1. Any ideas?14:26
mordredpabelanger: I don't see it running in zuul at all14:29
mordredpabelanger: or _any_ changes for zuul running in zuul14:29
mordredpabelanger: Needs Verified is becuase it needs the final +2 from the gate job - but best I can tell, the gate job has not run14:30
pabelangerAh, yes. Was confusing it with 'Needs Workflow'14:30
pabelangerlet me check zuul debug logs and see14:30
pabelangerhttp://paste.openstack.org/show/588559/14:32
pabelangerAh14:33
pabelangerlooks like we are missing a few commits14:34
pabelangerI mistakenly abandoned 38596414:34
openstackgerritPaul Belanger proposed openstack-infra/zuul: Move job running into own class  https://review.openstack.org/38596414:40
*** saneax-_-|AFK is now known as saneax15:03
*** saneax is now known as saneax-_-|AFK15:14
*** saneax-_-|AFK is now known as saneax15:14
openstackgerritPaul Belanger proposed openstack-infra/zuul: Merge remote-tracking branch 'origin/master' into feature/zuulv3  https://review.openstack.org/38947015:16
SpamapSpabelanger: oops, wrong branch?15:32
*** saneax is now known as saneax-_-|AFK15:32
pabelangerSpamapS: no, right branch, newer commits are breaking the feature/zuulv3 branch15:33
SpamapSoh n/m, my backscroll just caught up15:33
pabelangerat this point, I'm going to revert to the original merge attempt that jhesketh did15:33
*** saneax-_-|AFK is now known as saneax15:33
pabelangerokay, for now, I'm going to rebase enable-tests a top of TIP of feature/zuulv3. Until jhesketh is back online to help with 38947015:46
pabelangerapologies for the incoming spam, 18 patches15:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_single_nonexistent_post_job test  https://review.openstack.org/39169215:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable 4 CRD unit tests  https://review.openstack.org/39349415:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable 3 disabled tests  https://review.openstack.org/39345215:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_file_head test  https://review.openstack.org/39395615:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_failed_change_in_middle test  https://review.openstack.org/39168715:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_nonvoting_pipeline  https://review.openstack.org/38676915:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_merger_repack test  https://review.openstack.org/39395315:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_layered_templates test  https://review.openstack.org/39344515:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_job_from_templates_launched job  https://review.openstack.org/39341215:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_two_failed_changes_at_head test  https://review.openstack.org/39395015:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_can_merge unit test  https://review.openstack.org/39295315:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_queue_precedence test  https://review.openstack.org/39419115:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_statsd test  https://review.openstack.org/39347915:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_new_patchset_check / test_abandoned_check  https://review.openstack.org/39345815:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_source_cache unit test  https://review.openstack.org/39327815:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_one_job_project unit test  https://review.openstack.org/39330415:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable 4 disable tests  https://review.openstack.org/39346115:47
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_needed_changes_enqueue testing  https://review.openstack.org/39300115:47
pabelangerokay, that should make things green again15:47
pabelangerwould love some reviews on ^ to avoid the noise of rebasing15:48
*** abregman has quit IRC15:53
*** abregman has joined #zuul15:55
*** saneax is now known as saneax-_-|AFK16:01
*** saneax-_-|AFK is now known as saneax16:01
*** saneax is now known as saneax-_-|AFK16:03
*** hashar has quit IRC16:05
pabelangerabregman: I think we have a race condition in the test_duplicate_pipelines job16:06
pabelangerhttp://logs.openstack.org/79/393479/3/check/gate-zuul-python27-ubuntu-xenial/01dceb9/console.html#_2016-11-09_15_51_59_18480016:07
pabelangergoing to dig into it now16:07
*** saneax-_-|AFK is now known as saneax16:13
openstackgerritPaul Belanger proposed openstack-infra/zuul: Fix race in TestDuplicatePipeline test  https://review.openstack.org/39569416:14
pabelangerabregman: I believe ^ is our fix16:14
*** saneax is now known as saneax-_-|AFK16:22
*** saneax-_-|AFK is now known as saneax16:22
*** saneax is now known as saneax-_-|AFK16:23
*** saneax-_-|AFK is now known as saneax16:23
*** saneax is now known as saneax-_-|AFK16:33
*** saneax-_-|AFK is now known as saneax16:34
*** saneax is now known as saneax-_-|AFK16:37
*** saneax-_-|AFK is now known as saneax16:37
*** abregman_ has joined #zuul16:38
abregman_pabelanger: sorry had a mtg. looking now.16:38
abregman_pabelanger: what self.orderedRelease() is used for?16:40
pabelanger# Run one build at a time to ensure non-race order:16:40
*** saneax is now known as saneax-_-|AFK16:40
pabelangerwhich should be fine for this test, since we are making sure both pipelines right16:41
*** saneax-_-|AFK is now known as saneax16:41
pabelangernot which order they run in16:41
pabelangers/right/run16:41
pabelangerpipelines are right*16:41
*** abregman has quit IRC16:41
abregman_pabelanger: oh, cool. thanks16:43
*** abregman_ is now known as abregman16:43
*** saneax is now known as saneax-_-|AFK16:46
*** saneax-_-|AFK is now known as saneax16:46
*** saneax is now known as saneax-_-|AFK16:50
*** saneax-_-|AFK is now known as saneax16:50
*** saneax is now known as saneax-_-|AFK16:52
*** saneax-_-|AFK is now known as saneax16:53
*** saneax is now known as saneax-_-|AFK16:54
openstackgerritMerged openstack-infra/nodepool: Move kazooclient in to a fixture  https://review.openstack.org/38757717:02
openstackgerritMerged openstack-infra/zuul: Enable test_failed_change_in_middle test  https://review.openstack.org/39168717:03
openstackgerritMerged openstack-infra/zuul: Re-enable test_nonvoting_pipeline  https://review.openstack.org/38676917:05
jeblairpabelanger: see possible surprise -1 on 39169217:06
pabelangerjeblair: looking17:09
pabelangerack17:09
jeblairpabelanger: i'm looking at 393304 and wondering if we should delete that test too.  i think it may be fairly redundant at this point.17:12
pabelangerjeblair: I think so, we don't have anything that does a single job today.  But, so far all of our things do a merge first17:15
jeblairpabelanger: hrm.  i guess we could keep it for now.  :)17:18
openstackgerritJames E. Blair proposed openstack-infra/zuul: Remove v3 project template test  https://review.openstack.org/39572217:20
pabelangerokay, 391692 updated17:23
pabelangerpushing up changes17:23
openstackgerritPaul Belanger proposed openstack-infra/zuul: Delete test_single_nonexistent_post_job test  https://review.openstack.org/39169217:23
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable 4 CRD unit tests  https://review.openstack.org/39349417:23
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable 3 disabled tests  https://review.openstack.org/39345217:23
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_file_head test  https://review.openstack.org/39395617:23
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_merger_repack test  https://review.openstack.org/39395317:23
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_layered_templates test  https://review.openstack.org/39344517:24
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_job_from_templates_launched job  https://review.openstack.org/39341217:24
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_two_failed_changes_at_head test  https://review.openstack.org/39395017:24
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_can_merge unit test  https://review.openstack.org/39295317:24
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_queue_precedence test  https://review.openstack.org/39419117:24
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_statsd test  https://review.openstack.org/39347917:24
openstackgerritPaul Belanger proposed openstack-infra/zuul: Enable test_new_patchset_check / test_abandoned_check  https://review.openstack.org/39345817:24
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_source_cache unit test  https://review.openstack.org/39327817:24
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_one_job_project unit test  https://review.openstack.org/39330417:24
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable 4 disable tests  https://review.openstack.org/39346117:24
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_needed_changes_enqueue testing  https://review.openstack.org/39300117:24
SpamapSpabelanger: hey, can you please claim tests in https://storyboard.openstack.org/#!/story/200077317:28
SpamapSpabelanger: we have a number of people who want to fix tests, but it's a waste for us all to work on the same ones.17:28
jeblairah, if we're ready to start using that story, i will write a note in the etherpad17:30
pabelangerjeblair: I think we should land https://review.openstack.org/#/c/395694/ if possible too, fixes what seems to be a race condition on a recently enabled test17:30
pabelangerSpamapS: sure, now to see how to claim a storey17:31
pabelangerokay, I think I see how it works17:34
pabelangerokay, added a bunch of tests17:39
pabelangerNot sure how to avoid the very copy / paste of commit messages17:39
*** abregman has quit IRC17:42
pabelangerokay, I created 24 tasks17:47
jeblairpabelanger: yeah, let's not ammend the commit messages just to add task headers.  but maybe start using them going forward, and add them if we need another update for other reasons.18:01
pabelangerjeblair: Yup, I was planning on manually closing those 25 tasks over another spam attack18:01
pabelangeralso, this is called a 'kanban board' right?18:04
pabelangertrying to read up on some of these processes18:04
pabelangermordred: do you have a few moments to help land https://review.openstack.org/#/q/topic:enable-tests+status:open ?  Think we are in good shape, for it to merge now18:19
mordredpabelanger: sure! gimme just a sec18:21
mordredpabelanger: (my gertty is syncing)18:23
pabelangermordred: danke18:24
mordredpabelanger: that merge commit sure does look unhappy18:26
pabelangermordred: Ya, I opted to rebase away from it until jhesketh is online.  Hopefully with his guidance we can get it going again18:27
openstackgerritMerged openstack-infra/zuul: Delete test_single_nonexistent_post_job test  https://review.openstack.org/39169218:36
openstackgerritMerged openstack-infra/zuul: Re-enable test_can_merge unit test  https://review.openstack.org/39295318:36
openstackgerritMerged openstack-infra/zuul: Re-enable test_needed_changes_enqueue testing  https://review.openstack.org/39300118:38
openstackgerritMerged openstack-infra/zuul: Re-enable test_source_cache unit test  https://review.openstack.org/39327818:38
mordredpabelanger: ok - I merged all the ones that made sense - there are still 4 that jeblair still needs to review18:38
pabelangergreat!18:38
pabelangerthank you18:38
openstackgerritMerged openstack-infra/zuul: Re-enable test_one_job_project unit test  https://review.openstack.org/39330418:39
openstackgerritMerged openstack-infra/zuul: Re-enable test_job_from_templates_launched job  https://review.openstack.org/39341218:39
jeblairpabelanger, mordred: fyi i left a comment on (approved change) https://review.openstack.org/39346118:39
mordredjeblair: nod18:40
mordredjeblair: I was about to +A https://review.openstack.org/#/c/382077 and its ancestor - but wanted to make sure you'd seen jhesketh's final comment18:45
pabelangerjeblair: ack, I'll do that now18:45
mordredpabelanger: test unhappy fails18:46
pabelangermordred: jeblair: could also use a review on 395694 to fix a boucing test18:46
pabelangermordred: ya, that is 39569418:46
jeblairmordred: roger, thanks.18:47
mordredpabelanger: cool18:47
mordredpabelanger: I can see how that patch would be related to the other failure18:47
pabelangeryay for fixes18:48
clarkbpabelanger: the waitforsettles before it is redundant, and I think you may need to hold tests? or did we stop needing to make that explicit?18:49
clarkb(in practice a context switch between line 4675 and 4678 is likely uncommon but I think there is potentially a race there)18:50
pabelangerclarkb: looking18:51
clarkboh the wait there may not be redundant because the wait in orderedRelease happens at the end of the loop not the beginning18:51
clarkbbut I think still possible race there if context switches between those lines18:52
jeblairpabelanger, clarkb: ah, yeah, i think this test probably used to just have a count of the jobs run18:52
jeblairbut maybe switched to the new assertHistory method which is ordered by default18:52
pabelangerassertHistory is new for this test18:52
jeblairhowever, we can add 'ordered=False' to assertHistory, then the test shouldn't need to change18:52
jeblairso basically two choices: we can do what clarkb suggests and add the hold/sequencing stuff to assert that things happen in order.  or we could ignore ordering.18:53
pabelangerokay, either works for me18:53
jeblairsince this testing multiple pipelines with no relationship, i don't think we actually care about ordering18:54
jeblairso i lean toward ordered=False18:54
pabelangerk18:54
jeblair(if we validated ordering, it would essentially become a test of whether zuul ran pipelines in the same order all the time, which it will, for now, but that's not really a defined behavior)18:55
openstackgerritPaul Belanger proposed openstack-infra/zuul: Fix race in TestDuplicatePipeline test  https://review.openstack.org/39569418:56
clarkbjeblair: any idea why assertHistory doesn't just check if listA == listB? if thats doable then we can also use collections.Counter to do unordered comparisons easily (then that method becomes like 3 lines18:56
clarkbI guess you probably want assertEqual(list(inputA), list(inputB)) else assertEqual(Counter(inputA), Counter(inputB)) ?18:57
jeblairclarkb: it's comparing a dictionary with an object.  basically each key in the dictionary has to match a corresponding attribute on the object18:58
pabelangerclarkb: 395694 should be good now18:58
clarkboh I bet its because the elements are distinct objects so that direct comparison always fails? that would explain it18:58
jeblairclarkb: we could probably implement __eq__ methods on the object to make that work though?18:58
clarkbjeblair: ya, not sure if that trouble is worth it though (now that I understand what it is doing there)18:58
openstackgerritMerged openstack-infra/zuul: Add getProjectBranches to Source  https://review.openstack.org/38207618:59
*** harlowja has quit IRC18:59
openstackgerritMerged openstack-infra/zuul: Implement branch-specific in-repo job config  https://review.openstack.org/38207718:59
jeblairclarkb: can you aprv 395694 when you are done?19:00
clarkbyup just did19:00
openstackgerritMerged openstack-infra/zuul: Fix race in TestDuplicatePipeline test  https://review.openstack.org/39569419:02
openstackgerritMerged openstack-infra/zuul: Re-enable test_layered_templates test  https://review.openstack.org/39344519:07
openstackgerritMerged openstack-infra/zuul: Re-enable 3 disabled tests  https://review.openstack.org/39345219:08
pabelangerOh, hah19:09
pabelangerguess we did need to force history19:09
pabelangerhttp://logs.openstack.org/58/393458/6/gate/gate-zuul-python27-ubuntu-xenial/e9a217f/console.html#_2016-11-09_19_07_11_85033219:09
openstackgerritPaul Belanger proposed openstack-infra/zuul: First hold jobs for test_duplicate_pipelines  https://review.openstack.org/39577219:24
pabelangerclarkb: I _think_ that is what you first suggested right?^19:24
clarkbpabelanger: sort of, I think you still want to use orderedRelease() but ya the hold jobs thing at the beginning is what you need to make orderedRelease do what you want19:26
pabelangerah, okay19:26
pabelangerlet me add that back19:26
clarkbpabelanger: then you can remove the hold_jobs_in_build = False and the release()19:27
clarkbbasically swap ^ with orderedRelease()19:27
pabelangerAh, I understand now19:28
openstackgerritPaul Belanger proposed openstack-infra/zuul: First hold jobs / orderedRelease for test_duplicate_pipelines  https://review.openstack.org/39577219:29
jeblairpabelanger, clarkb: i'd rather make the message check unordered...19:47
jeblairsince i still think that testing that dup1 fires before dup2 isn't really something we want to do19:47
clarkbalso fine by me19:48
pabelangersure, let me see how we did it before19:48
jeblairi don't have a suggestion for a concise way of doing that, other than just a loop and some counters or something19:50
openstackgerritPaul Belanger proposed openstack-infra/zuul: test_duplicate_pipelines messages are also unordered  https://review.openstack.org/39577219:52
pabelangerjeblair: clarkb: ^ is how we did it in zuulv219:52
*** hashar has joined #zuul19:52
jeblairah yeah that.19:52
jeblairat some point, we should probably make a helper function for messages like assertHistory19:53
pabelangermakes sense19:53
hasharhello there :]19:57
hasharI am not much active nowadays, but was wondering what is the status of Zuul v2 / master branch.  I got a few patches that might be worth including19:58
openstackgerritMerged openstack-infra/zuul: test_duplicate_pipelines messages are also unordered  https://review.openstack.org/39577219:58
jeblairhashar: every now and then we look at important bugfixes we should merge, but generally are trying to keep it fairly stable while we focus on v3.20:00
hasharso v2/master is in maintenance mode really20:01
hasharI should find some time and actually look at v320:01
jeblairhashar: that would be great, but note that it doesn't do much useful yet.  :20:02
jeblairer :)20:02
hashar:D20:02
hasharmaybe I will rebase the few patches I have and hope eventually one will sneak approve them :D20:02
hasharon another topic, I welcome the meeting/sessions dedicated solely to Zuul20:03
hasharand will try to follow them20:03
jeblairhashar: oh cool.  how's the time for you?  or do you plan on reading logs?20:04
hasharI will probably catch the email announcement ahead of the meeting20:05
hasharthen depending on the topic attempt to join20:05
hasharbut iirc that is 22:00 UTC which is 11pm local20:05
hasharor a bit late when you get kids that wake you up at 7am no matter what!20:05
hasharthen your meetings have agenda, minutes and logs so it is easy to stay up to date. I just have to do it20:06
openstackgerritMerged openstack-infra/zuul: Enable test_new_patchset_check / test_abandoned_check  https://review.openstack.org/39345820:14
openstackgerritMerged openstack-infra/zuul: Re-enable 4 disable tests  https://review.openstack.org/39346120:22
openstackgerritMerged openstack-infra/zuul: Enable test_statsd test  https://review.openstack.org/39347920:23
openstackgerritMerged openstack-infra/zuul: Enable 4 CRD unit tests  https://review.openstack.org/39349420:23
openstackgerritMerged openstack-infra/zuul: Enable test_two_failed_changes_at_head test  https://review.openstack.org/39395020:23
openstackgerritMerged openstack-infra/zuul: Re-enable test_merger_repack test  https://review.openstack.org/39395320:24
openstackgerritMerged openstack-infra/zuul: Re-enable test_file_head test  https://review.openstack.org/39395620:24
openstackgerritMerged openstack-infra/zuul: Re-enable test_queue_precedence test  https://review.openstack.org/39419120:24
pabelangergreat20:24
pabelangerthat should be the stack now20:24
pabelangerlet me see what is left over20:25
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: Transition ZK API from dict to object model  https://review.openstack.org/39459220:27
openstackgerritPaul Belanger proposed openstack-infra/zuul: Add tenant support to zuul client  https://review.openstack.org/39385020:27
Shrewsjeblair: i think 394592 ^^^^ is mostly there now. I just want to run the builder by hand to test various things now before I un-WIP it.20:27
Shrewsturned out to be quite a large change, but simplifies the code and API considerably, I think20:28
pabelangerjeblair: mordred: 391681 enables webapp status again, if you wanted to check if the json format is what you expected20:28
openstackgerritPaul Belanger proposed openstack-infra/zuul: Remove includes and parameter functions  https://review.openstack.org/39464420:33
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: Transition ZK API from dict to object model  https://review.openstack.org/39459220:37
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: Transition ZK API from dict to object model  https://review.openstack.org/39459220:38
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: Transition ZK API from dict to object model  https://review.openstack.org/39459220:39
Shrewsgrr20:39
mordredShrews: grr indeed20:45
Shrewsi'm just trying to get my daily patch set count up to match pabelanger. i'm falling way behind20:47
mordredtell me about it20:48
pabelangerhappy to help with zuulv3!20:50
pabelangerjeblair: could use some guidance on race condition with test_live_reconfiguration.  I _think_ we actually have the race condition in zuulv2 too, but with zuulv3 looks like we are hitting it more often.  It looks like, the project-merge code is running as we reconfigure the scheduler, which ends up getting cancelled:20:55
pabelangerhttp://logs.openstack.org/88/393488/2/check/dev-zuul-coverage/14e24dd/console.html.gz#_2016-11-03_21_03_56_36875820:55
pabelangermy question is, should we self.gearman_server.hold_jobs_in_queue = True, reconfigure, then release20:56
pabelangeror account for the possible abort in the unit test20:57
clarkbpabelanger: maybe rework it so that the reconfiguration is additive and not subtractive (though we may want to test both thigns there hrm)20:58
jeblairpabelanger: i'm not sure that the old way of doing reconifuration makes sense20:58
jeblair(and yes, that's the process of replanting forests with conifurs)20:59
clarkbjeblair: you still have the case of any central job config updating right? I agree it makes less sense for project defined tests20:59
jeblairclarkb: yeah.  that is similar.  though i think instead of being triggered by an event, it maybe should just be triggered by a merge to that repo.21:00
jeblairclarkb: so maybe the change is really in the triggering, but still reloading the pipelines, etc, stays similar....21:01
jeblairso maybe we should proceed with this for now with that assumption, and see if it holds.21:01
jeblairclarkb, pabelanger: we shouldn't be running any ojebs during the reconfiguration in that test.21:02
jeblairoh, wait, it's 'hold build'21:03
jeblairso yeah, we should be running jobs21:03
jeblairthey should not be canceled though21:03
pabelangerYa, project-merge is getting run21:03
pabelangerokay, I'll see why it is cancelled21:03
jeblairShrews: looks wonderful!  i think that will set us up very nicely to reincorporate the builder now.21:12
jeblairShrews: we should rebase my patch series 3839620 through 383967 on that21:13
jeblairthen go from there21:13
Shrewssweeeeet21:14
pabelangerjeblair: correct me if I am wrong, but it looks like when we reconfigure the scheduler, we take the old tenant and reenqueue changes into the new tenant, which in doing so, cancels the original job?21:25
jeblairpabelanger: that's generally how it should work, aside from the canceling the build part.  it's supposed to say "oh, we should have a build of this job, and we do, so move the build over and attach it to the buildset for the item"21:27
jheskethMorning21:33
*** harlowja has joined #zuul21:49
pabelangerjeblair: Oh, I think it exposed a bug21:54
*** hashar has quit IRC22:16
openstackgerritPaul Belanger proposed openstack-infra/zuul: Re-enable test_live_reconfiguration test  https://review.openstack.org/39348822:16
pabelangerjeblair: okay, I believe ^ addresses the cancel job issue22:17
mordredpabelanger: it's neat when tests expose bugs!22:50
mordredjhesketh: morning!22:50
jhesketho/22:50
*** harlowja_ has joined #zuul23:08
*** harlowja has quit IRC23:12
*** saneax-_-|AFK is now known as saneax23:15

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!