| *** saneax is now known as saneax-_-|AFK | 00:00 | |
| *** agopi has joined #oooq | 00:03 | |
| rlandy | stable_release is not defined | 00:09 |
|---|---|---|
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-ci-centos-7-scenario001-multinode-oooq-container, gate-tripleo- (2 more messages) | 00:13 |
| *** myoung|ruck|afk is now known as myoung|ruck | 00:14 | |
| myoung|ruck | sshnaidm|rover: when do you want to swap ruck/rover? | 00:14 |
| rlandy | bbl | 00:16 |
| *** rlandy is now known as rlandy|bbl | 00:16 | |
| *** agopi has quit IRC | 00:19 | |
| *** dtrainor has quit IRC | 00:52 | |
| *** atoth has quit IRC | 01:59 | |
| rlandy|bbl | script fails | 02:01 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario003-multinode-oooq-container, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario004-multinode-oooq-container, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, (2 more messages) | 02:13 |
| *** rlandy|bbl has quit IRC | 02:16 | |
| *** gkadam has joined #oooq | 02:36 | |
| *** agopi has joined #oooq | 02:50 | |
| *** agopi has quit IRC | 02:54 | |
| *** agopi has joined #oooq | 02:58 | |
| *** gkadam has quit IRC | 03:07 | |
| *** agopi has quit IRC | 03:10 | |
| *** agopi has joined #oooq | 03:10 | |
| *** links has joined #oooq | 03:41 | |
| *** sanjay__u has joined #oooq | 04:03 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 04:13 |
| *** moguimar has quit IRC | 04:38 | |
| *** dtantsur|afk has quit IRC | 04:38 | |
| *** moguimar has joined #oooq | 04:39 | |
| *** jaosorior has quit IRC | 04:40 | |
| *** jaosorior has joined #oooq | 04:47 | |
| *** ykarel|away has joined #oooq | 04:50 | |
| *** saneax-_-|AFK is now known as saneax | 04:51 | |
| *** jaosorior has quit IRC | 04:54 | |
| *** jaosorior has joined #oooq | 05:02 | |
| *** udesale has joined #oooq | 05:11 | |
| *** ratailor has joined #oooq | 05:23 | |
| *** saneax is now known as saneax-_-|AFK | 05:23 | |
| *** jtomasek has joined #oooq | 05:36 | |
| *** marios has joined #oooq | 05:43 | |
| *** quiquell|off is now known as quiquell | 05:43 | |
| *** jfrancoa has joined #oooq | 06:03 | |
| *** pliu has quit IRC | 06:04 | |
| *** lucas-afk has quit IRC | 06:05 | |
| *** pliu has joined #oooq | 06:06 | |
| *** lucasagomes has joined #oooq | 06:07 | |
| *** moguimar has quit IRC | 06:11 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 06:13 |
| *** moguimar has joined #oooq | 06:13 | |
| quiquell | sshnaidm|rover: I see grafana kind of limiting to express some stuff | 06:15 |
| quiquell | https://github.com/grafana/grafana/issues/11418 | 06:15 |
| quiquell | Maybe we can try ELK (elasticsearch, logstash, kibana) | 06:15 |
| *** skramaja has joined #oooq | 06:26 | |
| *** udesale has quit IRC | 06:27 | |
| *** udesale has joined #oooq | 06:29 | |
| *** holser__ has joined #oooq | 06:33 | |
| *** chandankumar has quit IRC | 06:38 | |
| *** apetrich has quit IRC | 06:38 | |
| *** chandankumar has joined #oooq | 06:39 | |
| sshnaidm|rover | quiquell, ELK? for which purpose? | 06:39 |
| quiquell | For the ruck rover monitoring tool | 06:44 |
| *** saneax-_-|AFK is now known as saneax | 06:47 | |
| *** quiquell is now known as quiquell|afk | 06:49 | |
| *** apetrich has joined #oooq | 06:50 | |
| sshnaidm|rover | quiquell|afk, but for which task? what doesn't grafana support that elk does support? | 06:57 |
| *** udesale has quit IRC | 06:58 | |
| *** udesale has joined #oooq | 07:07 | |
| *** ccamacho has joined #oooq | 07:08 | |
| *** agopi has quit IRC | 07:17 | |
| *** tesseract has joined #oooq | 07:17 | |
| *** udesale has quit IRC | 07:19 | |
| *** ykarel|away is now known as ykarel | 07:19 | |
| *** udesale has joined #oooq | 07:24 | |
| *** zoli is now known as zoli|sickday | 07:26 | |
| *** zoli|sickday is now known as zoli | 07:27 | |
| *** quiquell|afk is now known as quiquell | 07:33 | |
| quiquell | sshnaidm|rover: coloring table rows only possible with int values | 07:33 |
| quiquell | We can bypass that without much effort | 07:34 |
| quiquell | Not big deal | 07:34 |
| *** florianf has joined #oooq | 07:34 | |
| sshnaidm|rover | quiquell, what do you want to use tables for? | 07:37 |
| quiquell | DLRN promoter history | 07:37 |
| quiquell | sshnaidm|rover: nevermind, found a solution | 07:37 |
| sshnaidm|rover | ok, great | 07:37 |
| *** tosky has joined #oooq | 07:38 | |
| sshnaidm|rover | quiquell, btw, we have elk in openstack: http://logstash.openstack.org/#/dashboard/file/logstash.json | 07:41 |
| sshnaidm|rover | quiquell, and it even works sometimes | 07:41 |
| sshnaidm|rover | quiquell, so generally speaking we can use it | 07:42 |
| *** agopi has joined #oooq | 07:43 | |
| quiquell | sshnaidm|rover: Cool, will take a look | 07:44 |
| *** kopecmartin has joined #oooq | 07:53 | |
| *** amoralej|off is now known as amoralej | 07:53 | |
| *** dalvarez has joined #oooq | 07:55 | |
| *** ykarel is now known as ykarel|lunch | 07:56 | |
| quiquell | sshnaidm|rover: https://review.openstack.org/#/c/567521/ ready for +2 ? | 08:07 |
| sshnaidm|rover | quiquell, will look | 08:08 |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-ci-centos-7-scenario001-multinode-oooq-container, gate-tripleo- (2 more messages) | 08:13 |
| *** ykarel|lunch is now known as ykarel | 08:37 | |
| *** agopi has quit IRC | 08:44 | |
| *** gkadam has joined #oooq | 08:53 | |
| *** links has quit IRC | 09:07 | |
| *** panda|bbl is now known as panda | 09:18 | |
| *** bogdando has joined #oooq | 09:23 | |
| *** links has joined #oooq | 09:24 | |
| quiquell | panda: Is this https://review.openstack.org/#/c/567521 missing something to have a +2 ? | 09:30 |
| quiquell | " | 09:30 |
| quiquell | Add python script to dynamically compose releases | 09:30 |
| quiquell | panda, sshnaidm|rover: It's possible to rebase a review that depends on other reviews not already merged ? | 09:33 |
| sshnaidm|rover | quiquell, yeah, and it will rebase all dependencies too | 09:34 |
| quiquell | git pull --rebase will do ? or do I have to fetch the latest refspecs ? | 09:34 |
| sshnaidm|rover | quiquell, you can rebase by clicking rebase button in gerrit | 09:38 |
| sshnaidm|rover | quiquell, if it has merge conflicts, then you need to fetch latest master, and rebase on it in the patch | 09:38 |
| sshnaidm|rover | quiquell, commented on review | 09:38 |
| quiquell | sshnaidm|rover: I mean doing for not merged dependencies | 09:39 |
| sshnaidm|rover | quiquell, when you rebase top patch, it will rebase also all dependencies | 09:39 |
| sshnaidm|rover | quiquell, what do you want to get? | 09:39 |
| quiquell | sshnaidm|rover: Want to rebase https://review.openstack.org/#/c/568285 to the lastest PS from its dependencies | 09:40 |
| quiquell | rebase is not ding that | 09:40 |
| sshnaidm|rover | quiquell, which dependencies? | 09:42 |
| quiquell | This review is done in top of other reviews | 09:42 |
| quiquell | Those reviews have newer PSs | 09:42 |
| quiquell | I want to do that | 09:42 |
| sshnaidm|rover | quiquell, oh, I see | 09:43 |
| sshnaidm|rover | quiquell, well, manual rebase | 09:43 |
| sshnaidm|rover | git rebase, git rebase --skip, git rebase , etc.. | 09:43 |
| *** dtantsur has joined #oooq | 09:43 | |
| quiquell | Ok... | 09:43 |
| quiquell | Thanks sshnaidm|rover | 09:43 |
| sshnaidm|rover | quiquell, yeah, it's not easy, especially if it has merge conflicts.. | 09:44 |
| panda | quiquell: you have to address sshnaidm|rover comments on that change | 09:47 |
| quiquell | panda: Yep, just found it after send it to you | 09:47 |
| panda | quiquell: and you can't +1 your own review :) It's like liking your own post on facebook | 09:48 |
| quiquell | panda: There is trown work there I was +1 his work | 09:48 |
| panda | quiquell: trown's ps was 12, you +1 PS 13. Anyway adding a comment helps understanding what you're +1 and why. | 09:50 |
| quiquell | panda: Ohh ok, will fix my +1 | 09:51 |
| quiquell | Thanks | 09:51 |
| quiquell | panda: Sagi's comment fixed, let's try to merge this thing https://review.openstack.org/#/c/567521/ | 10:11 |
| quiquell | Everything is in place now | 10:11 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 10:13 |
| panda | %mor | 10:15 |
| hubbot | panda: Error: "mor" is not a valid command. | 10:15 |
| panda | %more | 10:15 |
| hubbot | panda: Error: You haven't asked me a command; perhaps you want to see someone else's more. To do so, call this command with that person's nick. | 10:15 |
| panda | %more | adarazs | 10:15 |
| hubbot | panda: Error: I haven't seen |. | 10:15 |
| panda | %more adarazs | 10:15 |
| hubbot | panda: Error: I haven't seen adarazs. | 10:15 |
| quiquell | panda: Leave the pet alone | 10:16 |
| panda | quiquell: I'm giving the patch the big review. | 10:21 |
| quiquell | panda: \o/ !!!! | 10:21 |
| panda | quiquell: stay with me for a while | 10:21 |
| quiquell | bj you mean ? | 10:21 |
| panda | quiquell: not needed. IRC is fine | 10:22 |
| panda | quiquell: LONG_TERM_SUPPORT_RELEASE contains only queens | 10:23 |
| panda | quiquell: newton is also LTS, but I understand that it will not receive changes in the foreseeable future | 10:23 |
| panda | quiquell: still seems weeird we're not mentioning it | 10:24 |
| quiquell | panda: We are going to have more than one LTS relase ? | 10:25 |
| quiquell | s/relase/release/ | 10:25 |
| quiquell | Right now we are doing ffu from newton | 10:25 |
| panda | quiquell: that's the idea with LTS usually | 10:26 |
| *** jaganathan_ has quit IRC | 10:26 | |
| quiquell | panda: Wait... it says queens, but really is refering to newton | 10:27 |
| panda | quiquell: ... | 10:28 |
| quiquell | queens is the target, | 10:28 |
| panda | quiquell: ok, now bj is needed :) | 10:28 |
| quiquell | Sure | 10:28 |
| quiquell | https://bluejeans.com/7891065232 | 10:28 |
| *** links has quit IRC | 10:44 | |
| sshnaidm|rover | myoung|ruck, Containers multinode jobs fails on stable pike because of pacemaker https://bugs.launchpad.net/tripleo/+bug/1771551 | 10:52 |
| openstack | Launchpad bug 1771551 in tripleo "Containers multinode jobs fails on stable pike because of pacemaker" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 10:52 |
| sshnaidm|rover | myoung|ruck, https://bugs.launchpad.net/tripleo/+bug/1771549 https://bugs.launchpad.net/tripleo/+bug/1771549 | 10:52 |
| openstack | Launchpad bug 1771549 in tripleo "Containers multinode jobs fails on stable queens" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 10:52 |
| panda | quiquell: how do I test this ? just launch pytest on the current dir ? | 10:54 |
| quiquell | yep | 10:54 |
| quiquell | install the stuff at test-requirements.txt | 10:54 |
| quiquell | you can even run pytest directly under tripleo-ci/ | 10:54 |
| quiquell | It will discover all the tests | 10:55 |
| panda | 24 passed in 0.03 seconds | 10:55 |
| quiquell | We are good then | 10:57 |
| quiquell | Check the test suite | 10:57 |
| quiquell | To see if we cover all the cases | 10:57 |
| panda | I'll propose a patch to the jobs | 10:57 |
| quiquell | But we can check this out after merging it | 10:57 |
| quiquell | ok | 10:58 |
| *** links has joined #oooq | 10:58 | |
| panda | quiquell: why do you mean with "encapsulate" job in 567649 ? | 11:01 |
| quiquell | panda: I think zuul have the concept of base jobs, that you can inheritance from | 11:02 |
| quiquell | maybe we can put the filter expression there an inherit from the job | 11:02 |
| panda | quiquell: so you mean specifying the files paramter only once ? | 11:02 |
| quiquell | panda: Yep | 11:03 |
| *** lucasagomes is now known as lucas-hungry | 11:04 | |
| panda | quiquell: +2 | 11:08 |
| quiquell | Yipi !!! | 11:08 |
| quiquell | sshnaidm|rover: Give it another +2 :) https://review.openstack.org/#/c/567521 | 11:09 |
| panda | quiquell: I have a note for you | 11:13 |
| quiquell | panda, sshnaidm|rover: for the rebase of in-review changes 'git review -i' is your friend | 11:15 |
| quiquell | replacing manually the commit-id is working | 11:15 |
| sshnaidm|rover | quiquell, nice | 11:15 |
| sshnaidm|rover | quiquell, I can review only from python view, leaving the logic for sprint folks | 11:16 |
| quiquell | panda: Agree with the note, let's do a more declarative approach in a later refactoring | 11:17 |
| quiquell | sshnaidm|rover: So you cannot +2 | 11:17 |
| quiquell | Ok | 11:17 |
| sshnaidm|rover | I don't fully understand what happens there | 11:17 |
| quiquell | Let's wait for the other folks | 11:17 |
| panda | quiquell: regarding 567320, trown stated that using other method for the retries was breaking his persistence approach | 11:18 |
| panda | quiquell: and it may be not worth for such a small download | 11:18 |
| quiquell | I have rebase all the maze to the latest maze parts (I was not expecting that) | 11:19 |
| quiquell | panda: What persistence ? | 11:19 |
| panda | quiquell: was what not expecting ? | 11:19 |
| quiquell | panda: the git rebase -i command updating all the reviews | 11:20 |
| panda | quiquell: I'm not sure, you'll have to ask him. For me the patch is good enough. I really want to start testing as soon as possible | 11:20 |
| panda | tomorrow the latest | 11:20 |
| quiquell | panda: Agree with that, just feels weird to do a manual retry | 11:20 |
| quiquell | Let's get this merge I am going to add a +1 to state that | 11:21 |
| quiquell | panda: We can have this merge today, we are not going to break anything | 11:23 |
| *** jaosorior has quit IRC | 11:23 | |
| panda | quiquell: w/r/t 567936 | 11:24 |
| panda | quiquell: what's the goal of your comments ? | 11:25 |
| quiquell | panda: the +1 comment or the code comment ? | 11:26 |
| panda | quiquell: I see no +1 | 11:26 |
| quiquell | https://review.openstack.org/#/c/567936 | 11:26 |
| quiquell | Is there | 11:26 |
| panda | quiquell: ok, gertty synced now | 11:27 |
| *** quiquell is now known as quique|lunch | 11:32 | |
| weshay | sshnaidm|rover, morning https://review.openstack.org/#/c/568701/ | 11:33 |
| weshay | did it update the contentdir file correctly on both subnode0 and 1 for you? | 11:34 |
| sshnaidm|rover | weshay, didn't test it, but should | 11:34 |
| sshnaidm|rover | this role runs on all subnode | 11:35 |
| *** panda is now known as panda|lunch | 11:36 | |
| weshay | panda|lunch, for next sprint.. one of the goals should be to get the libvirt repro into ci.centos https://review.openstack.org/#/c/568701/ | 11:40 |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1771498 | 11:40 |
| openstack | Launchpad bug 1771498 in tripleo "libvirt reproducer script fails on yum var $contentdir" [High,Triaged] | 11:40 |
| *** jaosorior has joined #oooq | 11:42 | |
| *** gkadam has quit IRC | 11:43 | |
| *** gkadam has joined #oooq | 11:43 | |
| weshay | sshnaidm|rover, any further thoughts on the image corruption for the bm images? | 11:48 |
| sshnaidm|rover | weshay, running now https://review.openstack.org/#/c/568805/ | 11:49 |
| weshay | interesting.. on a new slave each run you think that would be an issue? | 11:50 |
| *** atoth has joined #oooq | 11:51 | |
| weshay | panda|lunch, https://bugs.centos.org/view.php?id=14786 | 11:58 |
| *** trown|outtypewww is now known as trown | 11:59 | |
| panda|lunch | weshay: you mean test reproducer itself | 12:06 |
| weshay | panda|lunch, yes sir | 12:06 |
| panda|lunch | https://trello.com/c/eRx0S8ip/763-add-job-to-test-libvirt-reproducer-in-cicentos | 12:07 |
| *** amoralej is now known as amoralej|lunch | 12:07 | |
| *** lucas-hungry is now known as lucasagomes | 12:09 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 (1 more message) | 12:13 |
| *** tcw has quit IRC | 12:21 | |
| *** rlandy has joined #oooq | 12:29 | |
| rlandy | panda: hello | 12:31 |
| rlandy | panda: I tried to do some integration testing last night | 12:31 |
| rlandy | weshay wanted us to investigate a bug with releases being passed | 12:31 |
| rlandy | https://review.openstack.org/#/c/568717/2/toci_gate_test-oooq.sh | 12:32 |
| rlandy | I added this ... | 12:32 |
| rlandy | to test | 12:32 |
| rlandy | we need to define the script location and output location | 12:33 |
| weshay | thanks rlandy | 12:34 |
| rlandy | also stable release | 12:34 |
| weshay | rlandy, I'm still a little bit on fire atm | 12:34 |
| rlandy | weshay: I understand | 12:34 |
| weshay | but if you need to chat, now is a decent time | 12:34 |
| *** panda|lunch is now known as panda | 12:34 | |
| weshay | or anyone | 12:34 |
| rlandy | weshay: I need to chat with panda now | 12:35 |
| rlandy | we will get back to you | 12:35 |
| rlandy | with output results | 12:35 |
| weshay | k.. thanks | 12:35 |
| panda | rlandy: hhmm | 12:41 |
| arxcruz | weshay: 1-1 moved to tomorrow ? | 12:41 |
| rlandy | panda: http://logs.openstack.org/17/568717/2/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/069525f/job-output.txt.gz#_2018-05-16_00_25_02_852971 | 12:41 |
| rlandy | we actually do know where the script will land | 12:42 |
| panda | rlandy: yes, I was trying to look at the script log | 12:42 |
| rlandy | and we can decide where the output will be | 12:42 |
| rlandy | also the definition of stable release is an issue | 12:42 |
| rlandy | I made some assumptions in the script | 12:42 |
| rlandy | another issue is that when the script fails, there is no error output | 12:42 |
| rlandy | as failing the script does not get log collected | 12:43 |
| rlandy | the rest works :) | 12:43 |
| panda | rlandy: what rest ? :) | 12:43 |
| rlandy | panda: the recognition of what fs we are using | 12:44 |
| rlandy | printing out the args | 12:44 |
| panda | rlandy: one problem at a time. What are your assumptions ? | 12:44 |
| rlandy | single sourcing them | 12:44 |
| rlandy | panda: ok - let's start at the top | 12:44 |
| rlandy | http://logs.openstack.org/17/568717/2/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/069525f/job-output.txt.gz#_2018-05-16_00_25_02_852971 | 12:45 |
| panda | rlandy: avil to chat if it's easier for you | 12:45 |
| rlandy | panda: ok - might be easier | 12:45 |
| *** tcw has joined #oooq | 12:45 | |
| panda | rlandy: I'm already in my channel and in your channel too | 12:46 |
| rlandy | joining your channel | 12:46 |
| *** Goneri has joined #oooq | 12:51 | |
| *** moguimar has quit IRC | 12:57 | |
| *** ratailor has quit IRC | 13:01 | |
| myoung|ruck | sshnaidm|rover: swap ruck/rover? | 13:02 |
| myoung|ruck | (caveat - we're all hands on deck anyway and this sprint the lines have been blurred anyway) | 13:03 |
| sshnaidm|rover | myoung|ruck, I don't know, I have a lot of things in progress.. maybe next week? | 13:03 |
| myoung|ruck | sshnaidm|rover: ok...as sprint ends in 6/7 days, I'm going to be working on some rfe/bugs as time allows in parallel then. Also need to make progress on rhos-12/rhos-13 TQ/TQE gates downstream. You do have a lot of critical things in progress. | 13:08 |
| myoung|ruck | it's been an exciting sprint in ruck/rover land :) | 13:08 |
| sshnaidm|rover | myoung|ruck, oh yeah)) | 13:08 |
| sshnaidm|rover | myoung|ruck, seem fine to me, I don't have time for downstream at all | 13:09 |
| myoung|ruck | weshay: do you want to sync with sshnaidm|rover and myself before the day get's long in the tooth? Feel like we're juggling quite a bit, and time/joules/calories/synapse_sparks are finite. | 13:10 |
| myoung|ruck | ^^ (briefly) | 13:10 |
| weshay | myoung|ruck, sshnaidm|rover I can chat in irc but on a 4hr manager call in blue atm | 13:11 |
| myoung|ruck | weshay: 4 hour manager meeting! Please know that you are in our thoughts and prayers. Stay the course. Be strong. | 13:12 |
| panda | rlandy: https://review.openstack.org/566565 upodated | 13:14 |
| rlandy | panda: cool - looking | 13:15 |
| sshnaidm|rover | myoung|ruck, weshay so latest possible solution for introspection is: https://review.openstack.org/568838 | 13:18 |
| ssbarnea | hi! i got a "brctl: command not found" on http://logs.openstack.org/89/568789/1/check/tripleo-ci-centos-7-undercloud-containers/9c8dce1/ara-report/ which seems totally unrelated to my first quickstart patch. is this caused by a known issue? | 13:19 |
| *** quique|lunch is now known as quiquell | 13:23 | |
| *** amoralej|lunch is now known as amoralej | 13:26 | |
| rlandy | panda: looks good - rebasing my patch on that | 13:27 |
| quiquell | rlandy, trown: By mistake (but it's a good thing) I have rebase all the maze commits | 13:28 |
| quiquell | You will see they are in top of the latest PS | 13:28 |
| rlandy | quiquell: works for me :) | 13:28 |
| quiquell | cool | 13:28 |
| trown | quiquell: ya I pushed the bottom one, just working on lots of unittests for later patches today | 13:29 |
| trown | mock mock mockety mock mock | 13:29 |
| myoung|ruck | sshnaidm|rover: looking | 13:29 |
| quiquell | trown: Looks like having fun :-) | 13:29 |
| quiquell | btw git rebase -i allow you to manually put the commit id | 13:30 |
| quiquell | This way you can rebase in-review dependencies | 13:30 |
| quiquell | trown: what do you think about runnign some integration testing with real featuresets and real output ? | 13:33 |
| quiquell | to test main | 13:33 |
| trown | quiquell: ya can always do `git commit -a --amend` before git review to manually put change id in | 13:33 |
| trown | quiquell: ya makes sense really, just need to put some "fixture" featuresets there to test with | 13:34 |
| quiquell | trown: this work when dependencencies are not merged ? | 13:34 |
| trown | quiquell: not exactly sure what you mean... but Change-Id is 1to1 mapping to gerrit review | 13:35 |
| trown | quiquell: so if I put up a totally unrelated change with the same change-id, it will put it up as a new patchset on that gerrit review | 13:35 |
| quiquell | trown: It doesn't fail ? | 13:36 |
| myoung|ruck | sshnaidm|rover: nice debug / proposed solution, I've updated the bug. Regarding the 'ts' issue, do we think that is a additional (discreet) issue (different LP needed?) https://bugs.launchpad.net/tripleo/+bug/1770972/comments/14 | 13:36 |
| openstack | Launchpad bug 1770972 in tripleo "CI: Images introspection fails in OVB jobs" [Critical,Triaged] - Assigned to Derek Higgins (derekh) | 13:36 |
| quiquell | trown: Damn so it was just easier argg | 13:36 |
| myoung|ruck | sshnaidm|rover: mentioned this bug at program call, and will talk in 1 hr at CIX call about it | 13:36 |
| quiquell | :-) | 13:36 |
| trown | quiquell: maybe if you have some bad dependency graph it will fail... like a loop | 13:36 |
| trown | quiquell: but as long as the change could merge, I think that always works | 13:37 |
| quiquell | trown: Cool, will try that next time instead of rebase -i and manual commit id | 13:37 |
| sshnaidm|rover | myoung|ruck, I suspect it's the reason for introspection failures | 13:37 |
| trown | rebase -i can still be useful with these big patch chains though | 13:37 |
| sshnaidm|rover | myoung|ruck, let's leave it in the same bug atm.. | 13:37 |
| myoung|ruck | sshnaidm|rover: ack, agreed | 13:37 |
| trown | quiquell: but I tend to just checkout the bottom patch, then cherry-pick one at a time to get to where I want to work | 13:38 |
| quiquell | trown: And also rebased the dependencies for free | 13:38 |
| quiquell | trown: noted | 13:38 |
| quiquell | Let's get the big patch merged | 13:38 |
| quiquell | Verified state already | 13:38 |
| quiquell | myoung|ruck, sshnaidm|rover: upstream check jobs are ok ? | 13:41 |
| myoung|ruck | quiquell: umm...define "ok" :) | 13:41 |
| quiquell | myoung|ruck: The commit to add the new script is failing at check | 13:42 |
| quiquell | That's kinda of a noop for them | 13:42 |
| myoung|ruck | quiquell: https://trello.com/c/c3U7NbsN/587-cixlp1770972tripleociproa-ci-images-introspection-fails-in-ovb-jobs is blocking OVB introspection across board... sshnaidm|rover has a patch that might resolve that | 13:42 |
| quiquell | %gatestatus | 13:42 |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 (1 more message) | 13:42 |
| quiquell | myoung|ruck: Ok, thanks | 13:42 |
| myoung|ruck | quiquell: (juggling) - link to patch you're talking about? | 13:43 |
| quiquell | myoung|ruck: https://review.openstack.org/#/c/567521 | 13:43 |
| myoung|ruck | thx...looking | 13:43 |
| sshnaidm|rover | quiquell, this may affect too: https://bugs.launchpad.net/tripleo/+bug/1771508 | 13:45 |
| openstack | Launchpad bug 1771508 in tripleo "Telemetry tests fail in scenario-001 and 002 jobs" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi) | 13:45 |
| sshnaidm|rover | myoung|ruck, ^^ | 13:45 |
| sshnaidm|rover | but the fix was merged | 13:45 |
| sshnaidm|rover | s/fix/workaround/ | 13:46 |
| quiquell | sshnaidm|rover: Can we bypass the check ? | 13:46 |
| myoung|ruck | quiquell: hrm http://logs.openstack.org/21/567521/14/check/tripleo-ci-centos-7-undercloud-containers/a4df2f9/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-05-16_10_35_04 | 13:46 |
| sshnaidm|rover | quiquell, check is only that checks :) | 13:46 |
| rlandy | panda: ok - let's see what https://review.openstack.org/#/c/567060/ does | 13:47 |
| rlandy | rebased, added the deps - made some changes for comments | 13:47 |
| *** jfrancoa has quit IRC | 13:48 | |
| quiquell | sshnaidm|rover: Without +1v the patch does not go to gate ? | 13:49 |
| myoung|ruck | quiquell, sshnaidm|rover: I don't recall seeing "create_swift_temp_url_key" error with docker yet...have you? | 13:49 |
| quiquell | myoung|ruck: Nope | 13:50 |
| myoung|ruck | hrm...this might be a new one. thanks for heads up quiquell, /me investigates and might have another LP coming | 13:50 |
| panda | quiquell: it's mandatory, the patch will need a +1v in checks before going to gates, but the gates will start automatically after the checks. | 13:50 |
| *** jfrancoa has joined #oooq | 13:50 | |
| quiquell | panda: So we are stuck at check :-/ | 13:50 |
| panda | quiquell: patience, young padawan | 13:51 |
| quiquell | panda: I have the worse or both worlds I am apadawan but I am not young :-) | 13:52 |
| myoung|ruck | rlandy, trown: I hate to interrupt during sprint, looking a a pile of stuff at once. Could you please glance at https://bugs.launchpad.net/tripleo/+bug/1771563 to quickly sanity check my usage? ovb reproducer is failing for me and I haven't had cycles to debug it yet. | 13:52 |
| openstack | Launchpad bug 1771563 in tripleo "ovb reproducer fails with "AnsibleUndefinedVariable: 'dict object' has no attribute 'ansible_host'"" [High,Triaged] | 13:52 |
| myoung|ruck | ^^ could be me doing things when I should be sleeping lol | 13:53 |
| rlandy | myoung|ruck: looking | 13:53 |
| *** udesale_ has joined #oooq | 13:55 | |
| *** moguimar has joined #oooq | 13:55 | |
| rlandy | trown: quiquell: just fyi ... we're testing the integration of the releases script into toci_quickstart now | 13:56 |
| quiquell | rlandy: It's working ? | 13:56 |
| quiquell | rlandy: Does it make sense to have a reproducer for the openstack-tox jobs ? | 13:58 |
| rlandy | quiquell: not quite - looking at the logs | 13:58 |
| rlandy | reproducer? | 13:58 |
| *** udesale has quit IRC | 13:58 | |
| rlandy | tox | 13:58 |
| rlandy | tox -e | 13:58 |
| rlandy | done | 13:58 |
| quiquell | rlandy: right | 13:58 |
| quiquell | :) | 13:58 |
| rlandy | panda: ok - we failed out | 13:59 |
| quiquell | rlandy, panda: Do you need two more eyes for the toci logs ? | 13:59 |
| rlandy | but hopefully with a log this time | 13:59 |
| rlandy | http://logs.openstack.org/60/567060/19/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/289354e/logs/emit_releases_file.txt.gz | 13:59 |
| rlandy | quiquell: panda" ^^ | 13:59 |
| myoung|ruck | sshnaidm|rover, chandankumar: I noticed overnight (day for you) we've merged a patch for skiplist (https://bugs.launchpad.net/tripleo/+bug/1771508) for telemetry tests | 13:59 |
| openstack | Launchpad bug 1771508 in tripleo "Telemetry tests fail in scenario-001 and 002 jobs" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi) | 13:59 |
| rlandy | ok - at least we captured the error now | 13:59 |
| myoung|ruck | yesterday late in day (night for you) we think root cause was found/fixed: https://bugs.launchpad.net/tripleo/+bug/1771435 | 14:00 |
| openstack | Launchpad bug 1771435 in tripleo "scenario001/002 failing on autoscaling with urllib3.exceptions.SSLError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579)" [Critical,Fix released] - Assigned to Alex Schultz (alex-schultz) | 14:00 |
| rlandy | not copied yet | 14:00 |
| quiquell | It's running before installing oooq ? | 14:00 |
| rlandy | No such file or directory: '/home/zuul/workspace/.quickstart/config/general_config/featureset050.yml' | 14:00 |
| rlandy | we need to pull it from a diff place | 14:00 |
| rlandy | we can fix that | 14:01 |
| panda | oooh | 14:01 |
| panda | wait | 14:02 |
| quiquell | Ahhh that's easy :-) we are still not horribly broken | 14:02 |
| panda | rlandy: hhmm | 14:02 |
| panda | rlandy: I think we can take it from $TRIPLEO_ROOT/tripleo-quickstart/config/general_config/featureset050.yml | 14:03 |
| panda | rlandy: yep that's what the other release approach is doing | 14:04 |
| panda | rlandy: line 137 of toci_gate for example | 14:04 |
| rlandy | panda: yep - that is the right thing | 14:05 |
| rlandy | can we make the change on your patch | 14:05 |
| rlandy | and I will rebase mine? | 14:05 |
| rlandy | {I guess that is why I had a testing patch originally to iterate on} | 14:05 |
| panda | rlandy: yeah, change your patch, it's quicker | 14:06 |
| rlandy | fine - will do | 14:06 |
| panda | rlandy: I expect this will not be the last iteration | 14:06 |
| rlandy | yeah - me neither | 14:07 |
| rlandy | hmm - here is the original def: FEATURESET_FILE="$LWD/config/general_config/$JOB_TYPE_PART.yml" | 14:09 |
| panda | rlandy: that works because this part is just preparing the argument for quickstart | 14:11 |
| *** ykarel is now known as ykarel|away | 14:12 | |
| rlandy | right I just need to switch out the dir | 14:12 |
| panda | yeah, it would be TRIPLEO_ROOT/tripleo-quickstart/config/general_config/$(basename $FEATURESET_FILE) | 14:12 |
| myoung|ruck | quiquell: looking at your check fail...do you have a sec to BJ? want to confirm something with ya and it'll be faster | 14:12 |
| myoung|ruck | ...than spamming here | 14:12 |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 (1 more message) | 14:13 |
| quiquell | myoung|ruck: 200~https://bluejeans.com/7891065232 | 14:13 |
| *** dtrainor has joined #oooq | 14:15 | |
| *** ykarel|away has quit IRC | 14:16 | |
| weshay | myoung|ruck, there is a skip list patch for the telemetry bugs? | 14:19 |
| weshay | there should not be | 14:19 |
| weshay | re: "when this get's promoted we can (try to) revert skiplist patch.. | 14:20 |
| weshay | " | 14:20 |
| weshay | sshnaidm|rover, should we just push this through? https://review.openstack.org/#/c/568701/ | 14:23 |
| weshay | anyone else try this patch to resolve the libvirt repro? | 14:24 |
| myoung|ruck | weshay: i'm reconstructing what happened at 3am :) | 14:24 |
| weshay | myoung|ruck, was a skip list patch posted? | 14:24 |
| weshay | I missed that | 14:24 |
| myoung|ruck | it was...was going thru LP updates this morning and flagged it...sec fetching link | 14:24 |
| weshay | myoung|ruck, have a link? | 14:25 |
| myoung|ruck | weshay: https://bugs.launchpad.net/tripleo/+bug/1771508 | 14:25 |
| openstack | Launchpad bug 1771508 in tripleo "Telemetry tests fail in scenario-001 and 002 jobs" [Critical,Triaged] - Assigned to Pradeep Kilambi (pkilambi) | 14:25 |
| myoung|ruck | weshay: https://review.openstack.org/#/c/568766/ | 14:26 |
| myoung|ruck | brb | 14:26 |
| weshay | https://review.openstack.org/#/c/568860/ | 14:26 |
| weshay | sshnaidm|rover, Alex did not want to see a skip list for this | 14:27 |
| weshay | rlandy, trown need a core https://review.openstack.org/#/c/568860/ | 14:28 |
| sshnaidm|rover | weshay, why not? | 14:29 |
| *** akrivoka has joined #oooq | 14:29 | |
| sshnaidm|rover | weshay, is it important enough to block gates? | 14:29 |
| weshay | sshnaidm|rover, go ask him.. but imho it's his call | 14:29 |
| weshay | sshnaidm|rover, pretty much | 14:29 |
| sshnaidm|rover | weshay, well | 14:29 |
| weshay | sshnaidm|rover, I asked him that upfront yesterday | 14:30 |
| weshay | sshnaidm|rover, should be fixed w/ the revert we put in | 14:30 |
| myoung|ruck | yeah...i had thought in this case we don't want to promote with this | 14:30 |
| * weshay gets | 14:30 | |
| sshnaidm|rover | weshay, but if you enable these tests, your patch will not pass checks :D | 14:30 |
| myoung|ruck | https://review.openstack.org/#/c/568700/ | 14:31 |
| weshay | sshnaidm|rover, if that is the case.. he can clear the gates for the patch that fixes it vs.. skips it | 14:31 |
| myoung|ruck | https://review.openstack.org/#/c/568699/ | 14:31 |
| * myoung|ruck jumps on CIX call | 14:31 | |
| sshnaidm|rover | weshay, why to do this so complex? | 14:31 |
| sshnaidm|rover | weshay, merging patch with fix, then reverting skip | 14:32 |
| weshay | sshnaidm|rover, https://review.openstack.org/#/c/568699/ | 14:32 |
| weshay | afaik should have fixed it | 14:32 |
| sshnaidm|rover | weshay, oh, so it's fixed, then we can revert of course | 14:33 |
| weshay | at least the check jobs are catching the revert of the revert https://review.openstack.org/#/c/568736/ | 14:33 |
| weshay | sshnaidm|rover, thank you | 14:33 |
| weshay | sshnaidm|rover, workflow that badboy | 14:33 |
| weshay | sshnaidm|rover, ^ | 14:33 |
| sshnaidm|rover | weshay, let's see jobs | 14:34 |
| quiquell | trown: Going to add PyYAML to "[WIP] Add CLI argument parser and YAML file parser" | 14:34 |
| quiquell | ok ? | 14:34 |
| quiquell | tox-py27 is not passing | 14:34 |
| trown | quiquell: sure... all of the stuff marked WIP is very WIP... | 14:36 |
| quiquell | trown: Cool pushin ps | 14:36 |
| panda | rlandy: mind if I push the change to your review ? | 14:38 |
| rlandy | got4it | 14:39 |
| rlandy | we got somewhere now ... | 14:40 |
| rlandy | http://logs.openstack.org/60/567060/20/check/tripleo-ci-centos-7-undercloud-upgrades/34d66ab/logs/emit_releases_file.txt.gz | 14:40 |
| quiquell | output release looks good for the releases | 14:42 |
| rlandy | yeah- we are getting there | 14:42 |
| panda | rlandy: you're still testing on 568717 ? | 14:42 |
| rlandy | panda: no - I will abandon that | 14:43 |
| *** ykarel|away has joined #oooq | 14:43 | |
| panda | rlandy: ah, ok | 14:43 |
| rlandy | we can work directly on https://review.openstack.org/#/c/567060/ | 14:43 |
| rlandy | panda: ^^ you can make you changes there | 14:44 |
| rlandy | you're fixing the current error? | 14:44 |
| panda | rlandy: ok, I didn't see new PS so I wondered if I should have pushed something, but we are good. | 14:44 |
| rlandy | panda: there is still an error | 14:44 |
| rlandy | are you fixing that no or should I? | 14:44 |
| rlandy | IOError: [Errno 2] No such file or directory: '/home/zuul/workspace/.quickstart/releases.sh' | 14:45 |
| quiquell | some directory missing | 14:45 |
| panda | yeah the local working | 14:45 |
| rlandy | we can out in tripleo | 14:45 |
| quiquell | It's not already created at this point ? | 14:45 |
| rlandy | or logs | 14:45 |
| quiquell | Yep | 14:45 |
| panda | because it's created only after we launch quickstart | 14:45 |
| rlandy | it's fine | 14:46 |
| rlandy | we can do the same as we have with the other files | 14:46 |
| panda | rlandy: directly on logs dir then ? | 14:46 |
| *** holser__ has quit IRC | 14:46 | |
| rlandy | panda: ack - why not? | 14:46 |
| quiquell | rlandy, panda: tox zuul job has detect a defect :-) they are already giving us somet hing | 14:46 |
| rlandy | quiquell? | 14:46 |
| rlandy | oh - nvm, I understand | 14:47 |
| rlandy | happy it helped | 14:47 |
| *** holser__ has joined #oooq | 14:47 | |
| panda | rlandy: you can put a patch, I would take longer me to do it at this point | 14:47 |
| rlandy | panda: sure - fixing | 14:47 |
| *** ykarel|away is now known as ykarel | 14:49 | |
| rlandy | and one more time | 14:49 |
| *** links has quit IRC | 14:58 | |
| *** jfrancoa has quit IRC | 15:05 | |
| *** jfrancoa has joined #oooq | 15:08 | |
| rlandy | closer ... one more patch | 15:09 |
| panda | rlandy: ? | 15:09 |
| rlandy | panda: I had to remove the copy line since we are placing the output in the logs dir anyways | 15:13 |
| rlandy | patch 22 testing now | 15:13 |
| *** skramaja has quit IRC | 15:28 | |
| *** quiquell is now known as quiquell|off | 15:32 | |
| rlandy | ok people ... here we are ... | 15:41 |
| panda | rlandy: are we happy ? | 15:42 |
| rlandy | I can see queens passed to undercloud install | 15:42 |
| rlandy | and master elsewhere | 15:42 |
| rlandy | looking promising | 15:42 |
| rlandy | http://zuul.openstack.org/stream.html?uuid=3ccc18c8f9bc4655bb4f11cfb08feaf3&logfile=console.log | 15:43 |
| rlandy | we're in rpogress | 15:43 |
| rlandy | progress | 15:43 |
| rlandy | I am updating the tox reviews in the mean time | 15:43 |
| *** bogdando has quit IRC | 15:53 | |
| *** ykarel is now known as ykarel|away | 15:54 | |
| *** tcw has quit IRC | 15:55 | |
| weshay | rlandy, trown, panda, quiquell|off sshnaidm|rover myoung|ruck arxcruz and finaly hrybacki http://lists.openstack.org/pipermail/openstack-dev/2018-May/130560.html | 16:01 |
| weshay | nice work hrybacki and trown :) | 16:01 |
| weshay | please comment in the thread if you have one | 16:02 |
| *** udesale_ has quit IRC | 16:02 | |
| trown | pretty cool | 16:02 |
| *** marios has quit IRC | 16:04 | |
| arxcruz | cool :) | 16:04 |
| myoung|ruck | \o/ | 16:05 |
| panda | Today openstack, tomorrow the linux foundation. | 16:06 |
| *** saneax is now known as saneax-_-|AFK | 16:06 | |
| rasca | myoung|ruck, can you give me a quick merge here: https://code.engineering.redhat.com/gerrit/#/c/138964/ this should fix OSP11 ospphase0 job | 16:08 |
| * myoung|ruck looks | 16:08 | |
| myoung|ruck | rasca: yay point releases. merged. | 16:09 |
| rasca | myoung|ruck, thanks man, it is related to https://bugzilla.redhat.com/show_bug.cgi?id=1569122 | 16:11 |
| openstack | bugzilla.redhat.com bug 1569122 in instack-undercloud "Undercloud installation fails with "Execution of '/bin/getcert list' returned 1: Error org.freedesktop.DBus.Error.TimedOut"" [High,New] - Assigned to jslagle | 16:11 |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 (1 more message) | 16:13 |
| *** Qubasa has joined #oooq | 16:18 | |
| *** Qubasa has quit IRC | 16:23 | |
| weshay | rasca, myoung|ruck that reminds me.. did we change osp jobs to use the phase1 osp release yet? | 16:23 |
| myoung|ruck | weshay: no, but that's on deck for this sprint | 16:24 |
| myoung|ruck | I'll post a patch this afternoon...it's a quickie | 16:24 |
| rlandy | ok we have some results ... | 16:24 |
| rlandy | panda: ^^ | 16:24 |
| rlandy | http://logs.openstack.org/60/567060/22/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/3ccc18c/logs/playbook_executions.txt.gz | 16:25 |
| rlandy | you can see the mix of queens and master | 16:25 |
| rlandy | quiquell|off: ^^ trown: | 16:25 |
| rlandy | we are getting there | 16:25 |
| rlandy | http://logs.openstack.org/60/567060/22/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/3ccc18c/logs/emit_releases_file.txt.gz | 16:26 |
| panda | mmhh | 16:26 |
| *** jfrancoa has quit IRC | 16:26 | |
| *** florianf has quit IRC | 16:26 | |
| rlandy | http://logs.openstack.org/60/567060/22/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/3ccc18c/logs/releases.sh | 16:27 |
| rlandy | we got our three files | 16:27 |
| panda | ah yeah this is undercloud only | 16:27 |
| rlandy | containerized-undercloud-upgrades | 16:27 |
| rlandy | export UNDERCLOUD_INSTALL_RELEASE="queens" | 16:27 |
| rlandy | export UNDERCLOUD_INSTALL_HASH="current-tripleo" | 16:27 |
| rlandy | export UNDERCLOUD_TARGET_RELEASE="master" | 16:27 |
| rlandy | export UNDERCLOUD_TARGET_HASH="current-tripleo" | 16:27 |
| rlandy | we have a failed upgrade | 16:28 |
| *** jfrancoa has joined #oooq | 16:28 | |
| rlandy | failed here as well ... http://logs.openstack.org/50/567550/8/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/922512b/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz | 16:30 |
| rlandy | maybe were good | 16:30 |
| rlandy | weshay: ^^ we have some initial test results | 16:31 |
| *** holser__ has quit IRC | 16:31 | |
| rlandy | will check other update/upgrage jobs | 16:32 |
| rlandy | upgrade | 16:32 |
| panda | rlandy: I think It's a starting point. It's testing time anyway | 16:32 |
| rlandy | panda: yep - waiting for the other update/upgrades tests to log stuff | 16:32 |
| rlandy | then we can analyze | 16:32 |
| rlandy | but we have a testing case now | 16:33 |
| panda | perfect | 16:33 |
| weshay | rlandy, you refering to Emilien's bug? | 16:35 |
| *** kopecmartin has quit IRC | 16:36 | |
| *** ccamacho has quit IRC | 16:37 | |
| *** panda is now known as panda|off | 16:37 | |
| panda|off | rlandy: If you debug, write some status in one of the validation cards, I'll follow up tomorrow | 16:38 |
| rlandy | panda|off: sure | 16:38 |
| rlandy | weshay: we're getting there | 16:38 |
| rlandy | we will have to test with a change to queen/master | 16:38 |
| rlandy | queens | 16:39 |
| rlandy | next up | 16:39 |
| weshay | rlandy, ah thanks | 16:39 |
| rlandy | but we have output of diff release files being passed | 16:39 |
| hrybacki | weshay: I like the idea of dedicating time at PTG for the docgen stuff. More of us will be there and we'll have more advance time to prep :) | 16:40 |
| weshay | hrybacki, thanks again for doing it | 16:41 |
| *** tcw has joined #oooq | 16:42 | |
| weshay | trown, rlandy this blocks the libvirt repro https://review.openstack.org/#/c/568701/ | 16:43 |
| weshay | well.. that fixes the blocker on the libvirt repo | 16:43 |
| weshay | I should say | 16:43 |
| myoung|ruck | weshay, hrybacki: if we have a time/place to discuss to docgen topics, how we're doing it today, what opportunities for improvement we've got, trade-offs, etc, I'm interested. I like what we have now, but have some ideas on how to improve it. | 16:43 |
| weshay | myoung|ruck, it's going to happen at the summit | 16:43 |
| weshay | hrybacki, will report back :) | 16:43 |
| myoung|ruck | hrybacki: (not today) but if you have time thursday or friday for a quick chat, happy to communicate | 16:44 |
| hrybacki | weshay: It sounds like (from the email thread) that we don't enough folks attending summit ? | 16:44 |
| weshay | no comment | 16:44 |
| rlandy | weshay: https://review.openstack.org/#/c/568701/ has tw +2 | 16:45 |
| rlandy | s already | 16:45 |
| trown | weshay: ya was going to say the same | 16:45 |
| * myoung|ruck does not have the summit flag in his status bitfield set | 16:45 | |
| weshay | rlandy, trown ya.. I just want to make sure you both are aware of how it broke.. just for your own info | 16:45 |
| rlandy | ok | 16:45 |
| trown | weshay: looks mergeable... unless there is some reason to not +W things right now | 16:45 |
| weshay | myoung|ruck, really? | 16:45 |
| trown | oh ok | 16:45 |
| weshay | myoung|ruck, austin? | 16:45 |
| myoung|ruck | weshay: I was just saying that I'm not attending summit this year in a dorky/geeky way | 16:46 |
| hrybacki | weshay: was that no comment for me? :P too in-tandem convos here | 16:46 |
| *** gkadam has quit IRC | 16:46 | |
| myoung|ruck | hrybacki: the implication being, if you want a few ideas for docgen futures prior to summit...happy to chat | 16:46 |
| weshay | hrybacki, re: summit attendence | 16:46 |
| hrybacki | ack | 16:46 |
| myoung|ruck | weshay: not making statements about have i been, or should i be there this year :) | 16:47 |
| weshay | trown, rlandy I don't know how.. but it would really neat if we could figure out a way to trigger that workflow in ci.centos | 16:47 |
| weshay | myoung|ruck, guess it's hard to figure out what you are saying :) | 16:47 |
| trown | weshay: those machines are not powerful enough | 16:47 |
| myoung|ruck | weshay, hrybacki: that's fair. my bad. is clear now? | 16:48 |
| weshay | trown, we could take it through the undercloud | 16:48 |
| weshay | that would validate the first setup part works.. | 16:48 |
| trown | weshay: ya that would probably work... maybe just use the undercloud-only featureset | 16:49 |
| weshay | trown, the rest is gated via the upstream | 16:49 |
| weshay | ya | 16:49 |
| weshay | but we'd have to do the whole bs.. of scp from the slave to the cico node | 16:49 |
| weshay | and kicking it remotely | 16:49 |
| weshay | I think | 16:49 |
| weshay | myoung|ruck, my thought would be to respond to email first off | 16:51 |
| *** links has joined #oooq | 16:54 | |
| *** dtantsur is now known as dtantsur|afk | 16:58 | |
| *** ykarel|away has quit IRC | 17:00 | |
| rasca | weshay, by the way, the 7.5 thing was related just to osp10/11 baremetal deployments, the other (12 and 13) are already using 7.5 | 17:04 |
| weshay | rasca, not sure what you are referring to.. | 17:05 |
| rasca | weshay, no worries, we're ok, it's enough :) | 17:05 |
| weshay | rasca, sorry buddy.. been busier than a one legged man in a butt kicking contest | 17:06 |
| rasca | weshay, ahaha | 17:06 |
| weshay | panda|off, have you scheduled some time to cover your "how do dev's install" finding? | 17:11 |
| *** trown is now known as trown|lunch | 17:11 | |
| *** links has quit IRC | 17:16 | |
| rasca | myoung|ruck, undercloud installation for osp11 fixed: https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/oooq-rhos-11-puddle-bmu-hac01-lab-float_nic_with_vlans/37/console if it pass the rest we'll be green again, with just a one char patch :D | 17:20 |
| myoung|ruck | rasca: that's great | 17:22 |
| *** amoralej is now known as amoralej|off | 17:25 | |
| *** tesseract has quit IRC | 17:27 | |
| *** sshnaidm|rover is now known as sshnaidm|off | 17:29 | |
| *** jfrancoa has quit IRC | 17:41 | |
| *** jfrancoa has joined #oooq | 17:42 | |
| weshay | rasca, you have anything that is running 13? | 17:53 |
| *** jfrancoa has quit IRC | 18:12 | |
| *** akrivoka has quit IRC | 18:12 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branch, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 (1 more message) | 18:13 |
| rlandy | weshay: sorry, I know you are super busy but do you happen to have that bug you linked yesterday? I closed the window and I'd like to test the scripts with the exact change | 18:20 |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1768997 | 18:22 |
| openstack | Launchpad bug 1768997 in tripleo "containerized-undercloud-upgrades: dlrn tasks don't run" [Critical,Triaged] | 18:22 |
| rlandy | ty | 18:22 |
| *** atoth has quit IRC | 18:42 | |
| *** trown|lunch is now known as trown | 18:44 | |
| weshay | myoung|ruck, sshnaidm|off would be really nice if we could debug and resolv this for the weirdo guys, like yatin as they do for us in tripleo https://trello.com/c/DLL665U8/592-rdophase1masterpackstackscenario001-ansible-playbook-failing-in-weirdo-master-scenario01 | 19:12 |
| myoung|ruck | weshay: will have a look | 19:13 |
| myoung|ruck | weshay: https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/oooq-rhos-13-puddle-bmu-had00-lab-float_nic_with_vlans/ | 19:13 |
| myoung|ruck | we still have some issues with virt jobs for 13 however..it's been starved thus far this sprint...but would like to have them running for gates | 19:14 |
| myoung|ruck | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/osp-director-promote-13-puddle/ | 19:14 |
| weshay | myoung|ruck, well this is certainly good news | 19:17 |
| weshay | myoung|ruck, this is rasca's job? | 19:17 |
| myoung|ruck | yes the BMU job | 19:18 |
| weshay | myoung|ruck, ok.. so ovb should work | 19:18 |
| myoung|ruck | it needed 7.5 base | 19:18 |
| weshay | rasca, I don't see where your validation is logged | 19:18 |
| myoung|ruck | weshay: we also have 13 jobs for tq/tqe gates defined | 19:19 |
| myoung|ruck | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/tripleo-ci-gates/job/tq-gate-rhos-13-ci-rhos-ovb-minimal-pacemaker-public-bond/ | 19:19 |
| myoung|ruck | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/tripleo-ci-gates/job/tqe-gate-rhos-13-ci-rhos-ovb-minimal-pacemaker-public-bond/ | 19:19 |
| myoung|ruck | current status is in sprint 13 etherpad | 19:19 |
| myoung|ruck | until container jobs blew up this afternoon my plan was to give them some love... | 19:20 |
| myoung|ruck | in theory FF the stable branches and we're done | 19:20 |
| myoung|ruck | or at least we'll get past what was the blocking issues (potentially) with hostnames | 19:20 |
| *** tosky has quit IRC | 19:20 | |
| myoung|ruck | looking at this packstack fail...will see if anything makes sense | 19:21 |
| rlandy | weshay: ping re: https://bugs.launchpad.net/tripleo/+bug/1768997 when you have a moment | 19:21 |
| openstack | Launchpad bug 1768997 in tripleo "containerized-undercloud-upgrades: dlrn tasks don't run" [Critical,Triaged] | 19:21 |
| rlandy | the dlrn build still does not trigger | 19:21 |
| rlandy | because the undercloud is installed with queens - still | 19:22 |
| rlandy | the change is on master | 19:22 |
| rlandy | master only gets passed later | 19:22 |
| rlandy | which seems correct | 19:24 |
| *** tosky has joined #oooq | 19:24 | |
| weshay | rlandy, right.. the upgrade playbook calls build-test so it should run then | 19:28 |
| * weshay gets | 19:28 | |
| rlandy | weshay: ok - well we will see when that runs | 19:28 |
| rlandy | the way the bug is written it looked like the expectation was for build to run on undercloud install | 19:29 |
| weshay | rlandy, hrm.. or maybe I'm confusing this w/ upgrade and we need a patch | 19:29 |
| weshay | note the diff | 19:29 |
| weshay | https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/multinode-overcloud-update.yml | 19:29 |
| weshay | https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/multinode-overcloud-upgrade.yml#L14 | 19:29 |
| weshay | I thought I saw it called and skipped though in the job I debugged for him | 19:30 |
| weshay | oh.. duh | 19:30 |
| weshay | it is an upgrade | 19:30 |
| weshay | I'm stupid | 19:30 |
| weshay | so ya | 19:30 |
| weshay | if we pass master and the upgrade role doesn't munge it.. I think it should just work | 19:30 |
| weshay | based on the work you guys are doing | 19:30 |
| rlandy | basically the line linked is the undercloud install | 19:31 |
| rlandy | that will never run on a master change | 19:31 |
| rlandy | for an undercloud upgrade/update | 19:31 |
| rlandy | we will have to make sure that role is called | 19:31 |
| rlandy | the bug is logged against undercloud upgrades | 19:32 |
| weshay | anyone :) https://review.openstack.org/#/c/568733/ | 19:33 |
| weshay | rlandy, right.. but it calls the upgrade role | 19:33 |
| weshay | rlandy, right? | 19:33 |
| weshay | rlandy, OH I have a patch on when: hostvars['undercloud']['compressed_gating_repo'] is defined and mixed_upgrade|default(false)|bool | 19:34 |
| rlandy | https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/multinode-undercloud-upgrade.yml#L12 | 19:34 |
| rlandy | the role is called | 19:34 |
| weshay | ah perfect | 19:35 |
| weshay | wait | 19:35 |
| rlandy | let's see what it does in the uundercloud-upgrade playbook | 19:35 |
| weshay | repo-setup does not get it done | 19:35 |
| rlandy | you can see what release files we pass | 19:35 |
| weshay | do you have a patch? | 19:35 |
| weshay | rlandy, we need - role: install-built-repo | 19:35 |
| rlandy | repo -setup vs dlrn-build | 19:35 |
| weshay | say wha? | 19:35 |
| rlandy | I'm trying to un-confuse my brain about what role call what | 19:36 |
| weshay | come on.. you got this | 19:36 |
| rlandy | - include: get-dlrn-hash.yml | 19:37 |
| weshay | that's not it | 19:37 |
| weshay | want to chat? | 19:37 |
| rlandy | right - so we are missing a call to the build role | 19:37 |
| weshay | \o/ | 19:37 |
| weshay | although let me look at the job | 19:37 |
| rlandy | http://zuul.openstack.org/stream.html?uuid=d030255b70574b23bf65652a1d352ae7&logfile=console.log runs now | 19:38 |
| rlandy | when the logs get printed, you will see the diff releases passed to diff playbooks | 19:38 |
| weshay | that's good | 19:39 |
| rlandy | the jobs are busy doing undercloud install now | 19:39 |
| rlandy | but top to bottom we are still missing the call to the build role | 19:39 |
| rlandy | I'll put up another patch and test that | 19:40 |
| rlandy | install-built-repo is nowhere in upgrades/updates role | 19:41 |
| rlandy | build-test-packages | 19:42 |
| weshay | rlandy, wes hayutin proposed openstack/tripleo-quickstart-extras master: execute the build / install of zuul changes in undercloud-upgrade https://review.openstack.org/568946 | 19:47 |
| rlandy | weshay: ok - adding deps to the test commit | 19:50 |
| *** holser__ has joined #oooq | 19:53 | |
| rlandy | watching tests | 19:53 |
| rlandy | http://zuul.openstack.org/stream.html?uuid=db9e4d3e13324683a9c531dd3041788f&logfile=console.log | 19:57 |
| *** dougbtv_ has joined #oooq | 20:11 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 20:13 |
| *** dougbtv_ has quit IRC | 20:17 | |
| *** holser__ has quit IRC | 20:51 | |
| *** trown is now known as trown|outtypewww | 21:05 | |
| *** Goneri has quit IRC | 21:14 | |
| rlandy | weshay: we have the first results | 21:23 |
| rlandy | http://logs.openstack.org/31/568931/2/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/db9e4d3/ | 21:24 |
| rlandy | http://logs.openstack.org/31/568931/2/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/db9e4d3/logs/playbook_executions.txt.gz | 21:24 |
| rlandy | ^^ what got called with what release | 21:24 |
| rlandy | playbooks/multinode-undercloud.yml gets called with master | 21:25 |
| rlandy | build-test-packages failure | 21:26 |
| weshay | 2018-05-16 20:37:55.770600 | primary | TASK [build-test-packages : Clone and build the specific DLRN projects] ******** | 21:26 |
| weshay | was skipped | 21:26 |
| weshay | 2018-05-16 20:42:26.571288 | primary | TASK [build-test-packages : Compress the repo] ********************************* | 21:26 |
| weshay | so that compressed_repo variable needs adjustment | 21:27 |
| weshay | it should not have skipped though | 21:29 |
| weshay | http://logs.openstack.org/31/568931/2/check/tripleo-ci-centos-7-containerized-undercloud-upgrades/db9e4d3/job-output.txt.gz#_2018-05-16_20_37_55_770600 | 21:29 |
| weshay | rlandy, right? | 21:29 |
| weshay | - name: Clone and build the specific DLRN projects | 21:29 |
| weshay | include: dlrn-build.yml artg_change={{ item }} | 21:29 |
| weshay | with_items: '{{ artg_change_list|default([]) }}' | 21:29 |
| weshay | when: | 21:29 |
| weshay | - item.project not in artg_skipped_projects | 21:29 |
| weshay | - release in item.branch | 21:29 |
| weshay | "artcl_txt_rename": true, | 21:30 |
| weshay | "artg_change_list": [ | 21:30 |
| weshay | { | 21:30 |
| weshay | "branch": "master", | 21:30 |
| weshay | "host": "https://git.openstack.org", | 21:30 |
| weshay | "project": "openstack/python-tripleoclient", | 21:30 |
| weshay | "refspec": "refs/changes/31/568931/2" | 21:30 |
| weshay | }, | 21:30 |
| weshay | { | 21:30 |
| weshay | "branch": "master", | 21:30 |
| weshay | "host": "https://git.openstack.org", | 21:30 |
| weshay | "project": "openstack/tripleo-quickstart-extras", | 21:30 |
| weshay | "refspec": "refs/changes/46/568946/1" | 21:31 |
| weshay | }, | 21:31 |
| weshay | { | 21:31 |
| weshay | "branch": "master", | 21:31 |
| weshay | "host": "https://git.openstack.org", | 21:31 |
| weshay | "project": "openstack-infra/tripleo-ci", | 21:31 |
| weshay | "refspec": "refs/changes/60/567060/22" | 21:31 |
| weshay | } | 21:31 |
| weshay | rlandy, ? | 21:37 |
| *** agopi has joined #oooq | 21:38 | |
| rlandy | well it errored | 21:39 |
| rlandy | "stderr": "tar (child): /home/stack/gating_repo.tar.gz: Cannot open: No such file or directory\ntar (child): Error is not recoverable: exiting now\ntar: | 21:39 |
| *** d0ugal_ has joined #oooq | 21:40 | |
| *** d0ugal has quit IRC | 21:41 | |
| rlandy | so yeah - it should not have skipped those tasks | 21:43 |
| weshay | ya.. they never got cloned or built | 21:45 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-3nodes-multinode, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens @ https://review.openstack.org/567224, stable/ocata: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, tripleo-ci-centos-7-undercloud-upgrades @ (2 more messages) | 22:13 |
| *** pliu has quit IRC | 22:14 | |
| *** rasca has quit IRC | 22:16 | |
| *** rnoriega has quit IRC | 22:16 | |
| *** jjoyce has quit IRC | 22:16 | |
| *** lhinds has quit IRC | 22:16 | |
| *** faceman has quit IRC | 22:16 | |
| *** jschlueter has quit IRC | 22:17 | |
| *** myoung|ruck has quit IRC | 22:17 | |
| *** weshay has quit IRC | 22:17 | |
| *** weshay has joined #oooq | 22:22 | |
| *** weshay has quit IRC | 22:26 | |
| rlandy | hmmm ... | 22:28 |
| *** rlandy is now known as rlandy|bbl | 22:28 | |
| *** jschlueter has joined #oooq | 22:34 | |
| *** weshay has joined #oooq | 22:34 | |
| *** faceman has joined #oooq | 22:35 | |
| *** myoung has joined #oooq | 22:35 | |
| *** pliu has joined #oooq | 22:35 | |
| *** lhinds has joined #oooq | 22:35 | |
| *** rasca has joined #oooq | 22:35 | |
| *** jjoyce has joined #oooq | 22:36 | |
| *** agopi has quit IRC | 22:37 | |
| *** rnoriega has joined #oooq | 22:37 | |
| *** agopi has joined #oooq | 22:38 | |
| *** d0ugal__ has joined #oooq | 22:40 | |
| *** d0ugal_ has quit IRC | 22:41 | |
| *** dougbtv_ has joined #oooq | 22:47 | |
| *** dougbtv_ has quit IRC | 23:00 | |
| *** lhinds has quit IRC | 23:16 | |
| *** pliu has quit IRC | 23:16 | |
| *** rnoriega has quit IRC | 23:16 | |
| *** weshay has quit IRC | 23:17 | |
| *** rasca has quit IRC | 23:17 | |
| *** myoung has quit IRC | 23:17 | |
| *** jschlueter has quit IRC | 23:18 | |
| *** faceman has quit IRC | 23:18 | |
| *** jjoyce has quit IRC | 23:18 | |
| *** rnoriega has joined #oooq | 23:21 | |
| *** weshay has joined #oooq | 23:21 | |
| *** rasca has joined #oooq | 23:21 | |
| *** pliu has joined #oooq | 23:21 | |
| *** myoung has joined #oooq | 23:23 | |
| *** faceman has joined #oooq | 23:23 | |
| *** jschlueter has joined #oooq | 23:23 | |
| *** lhinds has joined #oooq | 23:23 | |
| *** jjoyce has joined #oooq | 23:24 | |
| *** tosky has quit IRC | 23:34 | |
| *** myoung is now known as myoung|ruck | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!