| *** Goneri has quit IRC | 00:12 | |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 00:16 |
|---|---|---|
| *** rlandy has quit IRC | 00:46 | |
| *** ykarel|away has joined #oooq | 01:36 | |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 02:16 |
| *** ykarel|away is now known as ykarel | 02:27 | |
| *** ykarel is now known as ykarel|away | 02:36 | |
| *** ykarel|away has quit IRC | 02:40 | |
| *** jaosorior has quit IRC | 02:42 | |
| *** jaosorior has joined #oooq | 02:57 | |
| *** ykarel|away has joined #oooq | 03:47 | |
| *** ykarel|away is now known as ykarel | 04:02 | |
| *** udesale has joined #oooq | 04:12 | |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 04:16 |
| *** agopi has quit IRC | 04:59 | |
| *** ratailor has joined #oooq | 05:11 | |
| *** marios has joined #oooq | 05:14 | |
| *** marios has quit IRC | 05:15 | |
| *** marios has joined #oooq | 05:15 | |
| *** jaosorior_ has joined #oooq | 05:18 | |
| *** jaosorior has quit IRC | 05:21 | |
| *** links has joined #oooq | 05:26 | |
| *** udesale_ has joined #oooq | 05:32 | |
| *** pgadiya has joined #oooq | 05:33 | |
| *** pgadiya has quit IRC | 05:33 | |
| *** udesale_ has quit IRC | 05:34 | |
| *** udesale has quit IRC | 05:34 | |
| *** udesale_ has joined #oooq | 05:34 | |
| *** skramaja has joined #oooq | 05:34 | |
| *** udesale_ has quit IRC | 05:34 | |
| *** udesale has joined #oooq | 05:36 | |
| *** quiquell|off is now known as quiquell|ruck | 05:37 | |
| *** udesale has quit IRC | 05:41 | |
| *** udesale has joined #oooq | 05:43 | |
| *** jaosorior_ is now known as jaosorior | 05:48 | |
| *** skramaja has quit IRC | 05:54 | |
| *** skramaja has joined #oooq | 05:56 | |
| quiquell|ruck | zuul's tripleo gate is stuck | 06:10 |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 06:16 |
| *** jfrancoa has joined #oooq | 06:21 | |
| *** jfrancoa has joined #oooq | 06:22 | |
| quiquell|ruck | Hello, master promotion stuck, missing this https://review.openstack.org/#/c/562902/ | 06:38 |
| quiquell|ruck | Please it needs a +1w | 06:38 |
| ykarel | queens as well | 06:46 |
| quiquell|ruck | The fix for queens is already merge | 06:49 |
| quiquell|ruck | We have to wait for the periodic to kick in | 06:49 |
| quiquell|ruck | The queen's for the container build I mean | 06:49 |
| ykarel | yes, after that fs20 for queens will fail because of segments test | 06:50 |
| quiquell|ruck | Let's find someone that can do the +1w to get verified | 06:51 |
| quiquell|ruck | But openstack zuul tripleo gate are stuck | 06:52 |
| quiquell|ruck | 13 hours the oldest | 06:52 |
| quiquell|ruck | Step by step first https://review.openstack.org/#/c/562902/ to get merged | 06:52 |
| ykarel | hmm, but Emilien want to get segments enable on overcloud, so i proposed this as well:- https://review.openstack.org/#/c/562932/, but this is tht, so to fix queens it would require cherry-pick and that would take time | 06:54 |
| quiquell|ruck | Let's disable it first | 06:54 |
| quiquell|ruck | to unblock then fix it propertly | 06:54 |
| quiquell|ruck | What do you think | 06:54 |
| ykarel | yes, i think the same | 06:55 |
| quiquell|ruck | Let's find someone that can do the +1w | 06:55 |
| ykarel | yes | 06:55 |
| quiquell|ruck | Have to leave now, go back in a few | 06:56 |
| *** quiquell|ruck is now known as quique|ruck|afk | 06:56 | |
| *** bogdando has joined #oooq | 06:58 | |
| *** tesseract has joined #oooq | 07:12 | |
| *** tosky has joined #oooq | 07:17 | |
| *** ccamacho has joined #oooq | 07:34 | |
| *** quique|ruck|afk is now known as quiquell|ruck | 07:36 | |
| quiquell|ruck | Back | 07:36 |
| quiquell|ruck | ykarel: EmilienM is opposed to deactivate it ? | 07:37 |
| ykarel | quiquell|ruck, you mean skip test? | 07:39 |
| quiquell|ruck | yep | 07:39 |
| ykarel | EmilienM, wants to enable "segments" plugin instead, but if that takes time he can consider adding tests to skip list and do add of segments later | 07:40 |
| ykarel | i posted the discussion on review as well:- https://review.openstack.org/#/c/562902/ | 07:40 |
| quiquell|ruck | zuul's openstack tripleo gate is finishing jobs, the queue was huge | 07:42 |
| *** amoralej|off is now known as amoralej | 07:43 | |
| *** florianf has joined #oooq | 07:46 | |
| quiquell|ruck | ykarel: We got a +1w on it | 07:47 |
| ykarel | nice | 07:48 |
| quiquell|ruck | Let's way for +2v | 07:48 |
| ykarel | But i am still thinking how master promoted with fs20 failure | 07:50 |
| quiquell|ruck | Did it ? | 07:50 |
| ykarel | yes | 07:50 |
| quiquell|ruck | Let me check the promotion script to be sure that fs20 is there | 07:52 |
| ykarel | hmm it should not be there | 07:53 |
| ykarel | as per http://38.145.34.55/master.log-20180419 | 07:53 |
| ykarel | fs20 is not there in criteria, so promoter server has old ci-config | 07:54 |
| quiquell|ruck | yep | 07:54 |
| quiquell|ruck | We were testing the global locking thing | 07:54 |
| ykarel | Ok, it's fine as the failing test is only in fs20 and we don't have fs20 job running upstream | 07:55 |
| ykarel | so we are good | 07:55 |
| *** ykarel is now known as ykarel|lunch | 07:55 | |
| ykarel|lunch | so next run queens should also promote as instack-undercloud fix would be there | 07:56 |
| quiquell|ruck | yep, it's not a bug is a feature :-P | 07:57 |
| quiquell|ruck | but let check promoter it has to use the latest ci-config I think | 07:57 |
| quiquell|ruck | Yep, this is missing 375efe50cd2d29194754709fe2c14f0e79f9f554 | 08:00 |
| quiquell|ruck | ykarel|lunch: promoter rebased to get the laster master.ini | 08:07 |
| quiquell|ruck | latest | 08:07 |
| arxcruz | adarazs: EmilienM https://review.openstack.org/#/c/562155/ if you guys don't mind :) | 08:11 |
| *** lucas-afk is now known as lucasagomes | 08:12 | |
| *** holser__ has joined #oooq | 08:14 | |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 08:16 |
| *** panda|rover|off is now known as panda|rover | 08:21 | |
| panda|rover | quiquell|ruck: morning, what's up | 08:21 |
| panda|rover | quiquell|ruck: or better, what's down ? | 08:22 |
| quiquell|ruck | Let's go to bj | 08:22 |
| quiquell|ruck | panda|rover: That's a good one :-) | 08:22 |
| panda|rover | wow | 08:22 |
| quiquell|ruck | I mean itÂÂ's easier to talk it | 08:22 |
| quiquell|ruck | https://review.rdoproject.org/etherpad/p/ruckrover-sprint12 It's updated | 08:23 |
| arxcruz | panda|rover: https://review.openstack.org/#/c/562155/ | 08:24 |
| arxcruz | this is up | 08:24 |
| arxcruz | +2 before get's down :D | 08:24 |
| panda|rover | quiquell|ruck: I'm in your bj | 08:24 |
| quiquell|ruck | Ups sorry | 08:24 |
| quiquell|ruck | Going | 08:24 |
| quiquell|ruck | arxcruz: Have give you my sad +1, just for morale | 08:24 |
| arxcruz | quiquell|ruck: https://www.youtube.com/watch?v=NCtzkaL2t_Y | 08:25 |
| *** gkadam has joined #oooq | 08:30 | |
| *** ykarel|lunch is now known as ykarel | 08:38 | |
| bogdando | o/ folks. Do yuo know of the issue with reproduce script: resources.subnode_floating_ip: External network <...> is not reachable from subnet <...> Therefore, cannot associate Port <...> with a Floating IP ? | 08:38 |
| ykarel | bogdando, jaosorior Faced ^^ few days back, as per him it was transient issue | 08:40 |
| ykarel | quiquell|ruck, ack | 08:40 |
| bogdando | ykarel: oh, thanks, will retry then :) | 08:40 |
| ykarel | panda|rover, hi | 08:42 |
| panda|rover | arxcruz: reviewed | 08:42 |
| panda|rover | ykarel: hey | 08:42 |
| ykarel | panda|rover, please check: https://review.rdoproject.org/r/#/c/13401/ | 08:42 |
| panda|rover | ykarel: this is breaking job ? | 08:43 |
| arxcruz | panda|rover: didn't get it... | 08:44 |
| ykarel | just copy log, and jenkins shows fail due to this | 08:44 |
| ykarel | panda|rover, but success=true is sent to dlrn | 08:44 |
| arxcruz | if i put one if, it can fell in the else that is not needed | 08:44 |
| arxcruz | when tempest_overcloud is false, and release is not newton there's no need to set the public_net_id | 08:45 |
| panda|rover | arxcruz: so, a condition like "if tempest_overcloud|bool and release == 'newton'" would not work ? | 08:46 |
| arxcruz | panda|rover: nope | 08:46 |
| arxcruz | panda|rover: because will fell in else anyway | 08:47 |
| arxcruz | panda|rover: you have 4 conditions | 08:47 |
| panda|rover | ykarel: all the jobs are failing in jenkins ? | 08:47 |
| ykarel | panda|rover, -upload ones | 08:47 |
| arxcruz | tempest_overcloud & newton, tempest_overcloud & something_else, !tempest_overcloud & newton, !tempest_overcloud & something_else | 08:47 |
| panda|rover | ykarel: oh, yeah | 08:47 |
| panda|rover | ykarel: so that's not the correct location .. | 08:48 |
| ykarel | hmm | 08:49 |
| quiquell|ruck | Ok, let's merge promoter global lock | 08:50 |
| quiquell|ruck | +2 someone ? | 08:50 |
| quiquell|ruck | https://review.rdoproject.org/r/#/c/13429/ | 08:50 |
| quiquell|ruck | It have been working | 08:50 |
| ykarel | panda|rover, location is: /home/jenkins/.__repo_setup.sh.log as per my comment:- https://bugs.launchpad.net/tripleo/+bug/1762351/comments/1 | 08:52 |
| openstack | Launchpad bug 1762351 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-queens-upload is timeout in virt-customize step" [High,Triaged] - Assigned to Gabriele Cerami (gcerami) | 08:52 |
| ykarel | but would be good to check code | 08:52 |
| ykarel | script has, pushd $HOME, and working_dir: ./, so it should exist in $HOME only | 08:54 |
| panda|rover | arxcruz: where is public_net_id used ? | 08:54 |
| arxcruz | panda|rover: in containerized tempest | 08:55 |
| quiquell|ruck | !gatestatus | 08:57 |
| openstack | quiquell|ruck: Error: "gatestatus" is not a valid command. | 08:57 |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 08:57 |
| *** udesale_ has joined #oooq | 08:58 | |
| *** apetrich has quit IRC | 08:59 | |
| *** udesale has quit IRC | 08:59 | |
| *** jaosorior has quit IRC | 08:59 | |
| panda|rover | ykarel: the log is written to working_dir, and working dir is set to $WORKSPACE/.quickstart in those jobs AFAIK | 09:00 |
| panda|rover | that's why I put this there | 09:00 |
| ykarel | panda|rover, https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/tripleo-upstream/convert-upload-undercloud.sh#L28 | 09:00 |
| panda|rover | .... | 09:01 |
| panda|rover | yeah, let's create a playbook on the fly and override a bunch of variable, what could possibly go wrong ? | 09:01 |
| panda|rover | :( | 09:01 |
| panda|rover | what's ./ anyway ? | 09:02 |
| panda|rover | pushd $HOME .. | 09:02 |
| panda|rover | ok | 09:02 |
| ykarel | yes | 09:02 |
| quiquell|ruck | panda|rover: Global lock merged, going to put promoter pointing to muster | 09:03 |
| quiquell|ruck | s/muster/master/ | 09:03 |
| panda|rover | quiquell|ruck: thanks | 09:03 |
| panda|rover | ykarel: https://review.rdoproject.org/r/13452 | 09:05 |
| ykarel | panda|rover, Thanks | 09:06 |
| quiquell|ruck | panda|rover: You were looking at the cannot stat â/home/jenkins/workspace/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/.quickstart/.__repo_setup.sh.log ? | 09:20 |
| panda|rover | quiquell|ruck: ykarel looked at it, the fix should be just above | 09:21 |
| quiquell|ruck | Ok, going to open a bug for it | 09:24 |
| panda|rover | quiquell|ruck: no need | 09:25 |
| quiquell|ruck | Ok | 09:25 |
| quiquell|ruck | Is different from this one ? | 09:25 |
| quiquell|ruck | https://bugs.launchpad.net/tripleo/+bug/1762351 | 09:25 |
| openstack | Launchpad bug 1762351 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-queens-upload is timeout in virt-customize step" [High,Triaged] - Assigned to Gabriele Cerami (gcerami) | 09:25 |
| panda|rover | quiquell|ruck: https://bugs.launchpad.net/tripleo/+bug/1762419 | 09:27 |
| openstack | Launchpad bug 1762419 in tripleo "Collect logs task are not collecting the virt-customize logs from periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-$release-upload " [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 09:27 |
| quiquell|ruck | panda|rover: Upload job are not part of the promotion ? | 09:30 |
| arxcruz | quiquell|ruck: i think yes :) | 09:30 |
| quiquell|ruck | I don't see them in master.ini | 09:30 |
| quiquell|ruck | I see featureset002 but not featureset002-upload | 09:30 |
| quiquell|ruck | I am missing something for sure | 09:31 |
| quiquell|ruck | Last success from https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/ is three days ago | 09:32 |
| quiquell|ruck | But we have master promotions | 09:33 |
| *** jaganathan has quit IRC | 09:35 | |
| *** jaganathan has joined #oooq | 09:35 | |
| panda|rover | quiquell|ruck: it's the job type that counts, not the job name | 09:35 |
| panda|rover | quiquell|ruck: so periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/ still sends periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002 to dlrn api | 09:36 |
| quiquell|ruck | TOCI_TYPE ok | 09:36 |
| chandankumar | arxcruz: can you add yourself as a QE for this one https://trello.com/c/wwpJfjRA/695-tempest-run-should-take-less-than-5-min-in-tripleo-undercloud-jobs if you are free | 09:38 |
| chandankumar | ? | 09:38 |
| panda|rover | arxcruz: how do you export the public_net_id value to the container ? | 09:38 |
| arxcruz | panda|rover: it's not about export, the problem is, this public_net_id was being created in the cleanup-network.sh.js script, and so, it wasn't being passed to tempest_container.sh script that uses cat >> EOF, so i just change the place where public_net_id was being called to be called inside the EOF... that's all :) | 09:39 |
| panda|rover | oh, another cat << to create scripts on the fly that confuses me | 09:41 |
| arxcruz | panda|rover: i blame chandankumar | 09:42 |
| arxcruz | but in that case it's needed to run inside the docker | 09:42 |
| panda|rover | every time there's one, it's guaranteed that I get semething wrong | 09:42 |
| panda|rover | arxcruz: I don't see the EOF ... | 09:43 |
| arxcruz | panda|rover: haha, tricky question, i had the same | 09:44 |
| arxcruz | panda|rover: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/run-tempest.sh.j2#L39 | 09:44 |
| arxcruz | ¯\_(ツ)_/¯ | 09:44 |
| panda|rover | arxcruz: in configure-tempest.sh in your change, where's the EOF that closes the cat opened in line 68 ? | 09:45 |
| *** apetrich has joined #oooq | 09:46 | |
| panda|rover | arxcruz: I know yo've not changed it, but where is it ? | 09:46 |
| arxcruz | panda|rover: https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/run-tempest.sh.j2#L39 | 09:47 |
| arxcruz | just pointed to you | 09:47 |
| panda|rover | arxcruz: it's not a different template ? | 09:47 |
| panda|rover | arxcruz: it's ON | 09:47 |
| arxcruz | panda|rover: the eof it's in the run-tempest.sh template, that is being included in tempest-setup.sh in https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/templates/tempest-setup.j2#L12 | 09:48 |
| panda|rover | oh my | 09:50 |
| arxcruz | panda|rover: just trust me, i am an engineer :P | 09:50 |
| panda|rover | is it ok if I find this insane ? | 09:50 |
| panda|rover | I mean there's probably a reason | 09:50 |
| arxcruz | panda|rover: http://aviationhumor.net/wp-content/uploads/2014/10/trust-me-im-an-engineer.jpg | 09:50 |
| panda|rover | but how do you read it and understand it after 2 weeks > | 09:51 |
| panda|rover | ? | 09:51 |
| arxcruz | panda|rover: it was worse before https://review.openstack.org/#/c/551441/ | 09:51 |
| arxcruz | panda|rover: i'm in the matrix ;) | 09:51 |
| * panda|rover prepares a post for The daily WTF | 09:53 | |
| panda|rover | :) | 09:53 |
| arxcruz | :) | 09:53 |
| panda|rover | arxcruz: for what it's worth, +2 | 09:54 |
| arxcruz | panda|rover: ty | 09:54 |
| arxcruz | :) | 09:54 |
| panda|rover | arxcruz: ooooohhh | 09:55 |
| panda|rover | arxcruz: wait | 09:55 |
| panda|rover | I didn't see it | 09:55 |
| arxcruz | (╯°□°）╯︵ ┻━┻ | 09:55 |
| panda|rover | arxcruz: why did you move the INstall packages ? | 09:55 |
| arxcruz | panda|rover: shit | 09:56 |
| arxcruz | it's another patch that | 09:56 |
| panda|rover | oh also, I +2 only PS3 | 09:56 |
| panda|rover | so it doesn't count | 09:56 |
| panda|rover | arxcruz: -1 for you! | 09:57 |
| panda|rover | arxcruz: now I understand your method, you confuse reviewers with the triple include, so other issue may slip | 09:58 |
| panda|rover | arxcruz: I'm watching you ! | 09:59 |
| chandankumar | panda|rover: arxcruz It was a complete hack | 10:01 |
| chandankumar | panda|rover: arxcruz In future I will simplify that | 10:01 |
| *** florianf has quit IRC | 10:02 | |
| arxcruz | panda|rover: guilty :D | 10:03 |
| arxcruz | chandankumar: yup, no problem | 10:03 |
| *** zoli is now known as zoli|lunch | 10:06 | |
| arxcruz | panda|rover: done | 10:06 |
| *** udesale__ has joined #oooq | 10:12 | |
| *** udesale_ has quit IRC | 10:14 | |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 10:16 |
| *** pgadiya has joined #oooq | 10:17 | |
| *** pgadiya has quit IRC | 10:17 | |
| arxcruz | panda|rover: can i have your +2 now ? | 10:21 |
| panda|rover | arxcruz: too late | 10:21 |
| arxcruz | ┻━┻ ︵ \(°□°)/ ︵ ┻━┻ | 10:22 |
| quiquell|ruck | arxcruz it's on fire | 10:24 |
| *** udesale__ has quit IRC | 10:27 | |
| quiquell|ruck | arxcruz, chandankumar: This rings any bell ? | 10:32 |
| quiquell|ruck | CRITICAL tempest [-] NoOptionError: No option 'uri' in section: 'identity' | 10:32 |
| arxcruz | quiquell|ruck: logs or didn't happen | 10:32 |
| quiquell|ruck | Here here: https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-extras-gate-newton-delorean-full-minimal-5416/undercloud/home/stack/tempest_output.log.gz | 10:32 |
| panda|rover | ykarel: where's the error here ? https://review.rdoproject.org/jenkins/job/config-sanity-check/4649/console | 10:34 |
| ykarel | panda|rover, in python sanity-check.py | 10:35 |
| ykarel | amoralej, is fixing it | 10:35 |
| panda|rover | ykarel: ok thanks. | 10:35 |
| arxcruz | quiquell|ruck: open a bug, assign to me :) | 10:36 |
| ykarel | panda|rover, should be fixed, let me recheck | 10:36 |
| quiquell|ruck | arxcruz: ok | 10:36 |
| *** zoli|lunch has quit IRC | 10:47 | |
| quiquell|ruck | arxcruz: You got it https://bugs.launchpad.net/tripleo/+bug/1765669 | 10:48 |
| openstack | Launchpad bug 1765669 in tripleo "Failed check job jenkins-tripleo-quickstart-extras-gate-newton-delorean-full-minimal at No option 'uri' in section: 'identity'" [Medium,Triaged] - Assigned to Arx Cruz (arxcruz) | 10:48 |
| *** zoli has joined #oooq | 10:49 | |
| chandankumar | quiquell|ruck: yup few params got missing | 10:49 |
| *** apetrich has quit IRC | 10:51 | |
| quiquell|ruck | chandankumar: Will put more info in the bug | 10:51 |
| *** lucasagomes is now known as lucas-hungry | 11:23 | |
| *** jaosorior has joined #oooq | 11:29 | |
| *** kopecmartin has joined #oooq | 11:30 | |
| quiquell|ruck | panda|rover: https://bugs.launchpad.net/tripleo/+bug/1765680 | 11:32 |
| openstack | Launchpad bug 1765680 in tripleo "Missing ansible-playbook running reproducer-quickstart.sh " [Undecided,In progress] - Assigned to Gabriele Cerami (gcerami) | 11:32 |
| *** udesale has joined #oooq | 11:36 | |
| panda|rover | quiquell|ruck: how far can you get if you manually install ansible ? | 11:37 |
| panda|rover | quiquell|ruck: also what's ansible version in CSB | 11:37 |
| panda|rover | ? | 11:37 |
| quiquell|ruck | panda|rover: This is not the problem | 11:38 |
| quiquell|ruck | panda|rover: The tripleo-upgrade branch is wrongly set at toci_gate_test-oooq.sh | 11:38 |
| quiquell|ruck | If tripleo-upgrade is not gated and you are at tripleo-upgrade master banch it fails | 11:39 |
| quiquell|ruck | Take a look | 11:39 |
| quiquell|ruck | It's failing in the undercloud not in the place were you run the reproducer | 11:40 |
| *** jaganathan has quit IRC | 11:41 | |
| *** jaganathan has joined #oooq | 11:41 | |
| panda|rover | quiquell|ruck: so this is two bugs ? | 11:45 |
| quiquell|ruck | If the fail fast part is a bug | 11:46 |
| quiquell|ruck | Could be two bugs | 11:46 |
| weshay | quiquell|ruck, panda|rover before you fella's take off for the day.. I'd like to review where we are w/ the osp-12 gate | 11:49 |
| quiquell|ruck | weshay: Ok | 11:49 |
| arxcruz | weshay: https://review.openstack.org/#/c/562155/ | 11:52 |
| arxcruz | please :D | 11:52 |
| panda|rover | quiquell|ruck: so the bugs title is "ansible-playbook is missing". If the real problems is another, you should either rename the title, or add another bug | 11:53 |
| quiquell|ruck | panda|rover: Going to rename | 11:54 |
| chandankumar | weshay: hello | 11:57 |
| chandankumar | weshay: https://review.openstack.org/#/c/562563/ -> tripleo-ci-centos-7-undercloud-containers is taking 1 hr 18 mins | 11:58 |
| chandankumar | weshay: is there a way to reduce more time? | 11:58 |
| chandankumar | weshay: I want to bring to down to <1 hr | 11:59 |
| * weshay looks | 11:59 | |
| weshay | chandankumar, I was going to suggest we remove the idempotency reinstall check of the undercloud, but it's not doing it | 12:00 |
| chandankumar | weshay: you mean this one https://review.openstack.org/#/c/562563/1/config/general_config/featureset027.yml@39 | 12:01 |
| chandankumar | ? | 12:01 |
| weshay | chandankumar, 39 min to install the undercloud start to finish | 12:01 |
| weshay | 12 min to validate | 12:01 |
| weshay | http://logs.openstack.org/63/562563/1/check/tripleo-ci-centos-7-undercloud-containers/6351d4c/logs/ara_oooq/ | 12:02 |
| weshay | tempest execution is 9 min 22 seconds | 12:02 |
| weshay | which I believe meets the criteria that EmilienM set | 12:02 |
| weshay | under 10 min | 12:02 |
| chandankumar | weshay: yup | 12:03 |
| weshay | 35 min to install the undercloud | 12:03 |
| chandankumar | weshay: https://review.openstack.org/#/c/561838/ need +2 and workflow | 12:03 |
| weshay | chandankumar, it takes about 18min to just get into quickstart | 12:03 |
| chandankumar | weshay: how you are seeing the time breaks? | 12:04 |
| weshay | chandankumar, I suspect there isnt much more you can do | 12:04 |
| weshay | chandankumar, magic | 12:05 |
| weshay | I SEE EVERYTHING.. | 12:05 |
| weshay | http://logs.openstack.org/63/562563/1/check/tripleo-ci-centos-7-undercloud-containers/6351d4c/logs/ara_oooq/ | 12:05 |
| *** atoth has joined #oooq | 12:07 | |
| chandankumar | weshay: on heat side there are voting gates which takes more than 2 hours | 12:10 |
| chandankumar | weshay: but current deployment still works for undercloud there | 12:10 |
| weshay | panda|rover, quick question.. any idea why this update job has a subnode-2 and subnode-3? http://logs.openstack.org/53/562353/5/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/71165b4/job-output.txt.gz#_2018-04-19_20_09_22_853882 | 12:12 |
| weshay | panda|rover, /me looking at https://review.openstack.org/#/c/562353/ | 12:12 |
| chandankumar | weshay: one more help http://logs.openstack.org/63/562563/1/check/tripleo-ci-centos-7-undercloud-containers/6351d4c/job-output.txt.gz#_2018-04-19_13_03_31_248822 how to enable this part | 12:15 |
| chandankumar | it is getting skipped | 12:15 |
| *** ykarel is now known as ykarel|afk | 12:15 | |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 12:16 |
| weshay | chandankumar, http://paste.openstack.org/show/719622/ | 12:18 |
| weshay | chandankumar, it's not doing what you think it is 23 when: release in ['mitaka', 'liberty'] | 12:18 |
| *** rfolco|off is now known as rfolco|doctor | 12:18 | |
| weshay | chandankumar, if you need to enable something.. you'll need to adjust the undercloud.conf | 12:19 |
| chandankumar | weshay: yup sir | 12:21 |
| *** lucas-hungry is now known as lucasagomes | 12:23 | |
| chandankumar | weshay: EmilienM one more review https://review.openstack.org/#/c/560006/ | 12:24 |
| *** trown|outtypewww is now known as trown | 12:25 | |
| panda|rover | weshay: no idea, and it doesn't appear to be an error in log colletion, those are indeed 2 different nodes | 12:26 |
| panda|rover | and different from the undercloud too | 12:30 |
| weshay | panda|rover, ya.. should just be two nodes though | 12:31 |
| weshay | for the updates job | 12:31 |
| * weshay thinks | 12:31 | |
| *** rlandy has joined #oooq | 12:32 | |
| *** matbu has quit IRC | 12:38 | |
| *** matbu has joined #oooq | 12:39 | |
| *** ykarel|afk is now known as ykarel | 12:41 | |
| *** apetrich has joined #oooq | 12:46 | |
| rlandy | trown: hi - good morning | 13:02 |
| trown | rlandy: howdy | 13:02 |
| weshay | rlandy, howdy.. I had pushed out your 1-1 due to the upgrade meeting but it may get canned | 13:02 |
| rlandy | trown: I'm testing fs037 now | 13:02 |
| rlandy | where did it bail on you before? | 13:03 |
| weshay | trown, rlandy re: libvirt.. some interesting things from my end | 13:03 |
| trown | rlandy: k I hit the same (I think) networking issue during deploy | 13:03 |
| rlandy | weshay: that's fine | 13:03 |
| trown | rlandy: didnt look much into it, tried fs040 too... that worked up until upgrade which failed, but that might be a legit bug | 13:03 |
| weshay | I've found a ansible library that writes out ssh_config files for tunneling.. I've had to modify it a bit but it looks like it will simplify the inventory role quite a bit | 13:03 |
| rlandy | trown: I have not hot anything yet :) - just asking what to look out for | 13:03 |
| trown | rlandy: tried that from queens->master | 13:03 |
| rlandy | hit | 13:03 |
| trown | k... I am working on snapshot role | 13:04 |
| weshay | I had to do that because of the way the fake_nodepool.yml tasks are structured | 13:04 |
| rlandy | trown: two patches for your review | 13:04 |
| rlandy | https://review.openstack.org/#/c/562825/ | 13:05 |
| weshay | I'm noticing really terrible performance when sshing from laptop -> virthost -> nat'd addresses | 13:05 |
| rlandy | https://review.openstack.org/#/c/563102/ | 13:05 |
| weshay | although ansible -m ping -h host all works | 13:05 |
| weshay | two things on my end.. | 13:05 |
| weshay | to do | 13:05 |
| rlandy | weshay: terrible performace all the time - or just after reboot? | 13:06 |
| weshay | 1. figure our the inventory / hosts file now.. maybe a library would work well there too.. not conconvinced that is needed | 13:06 |
| weshay | rlandy, the ssh connection speed | 13:06 |
| rlandy | seems fine to me | 13:06 |
| weshay | rlandy, ur running from the virthost no? | 13:06 |
| rlandy | I am now but I wasn't before | 13:06 |
| trown | what is the downside of running from the virthost? | 13:06 |
| weshay | rlandy, how far were you getting w/ running from the laptop | 13:07 |
| rlandy | you have to setup the keys correctly | 13:07 |
| trown | I was fine with supporting both if it is not a huge effort... this seems like a huge effort | 13:07 |
| *** quiquell|ruck is now known as quique|ruck|food | 13:07 | |
| weshay | trown, well.. I'm still playing around with it... | 13:07 |
| rlandy | weshay: at that point things were failing for dns reasons | 13:07 |
| rlandy | but I will try again after this run | 13:07 |
| rlandy | it is in undercloud install phase | 13:07 |
| weshay | rlandy, I don't see how it could have gotten that far | 13:07 |
| rlandy | I tested sagi | 13:08 |
| trown | weshay: right just saying what problem is trying to be solved... | 13:08 |
| rlandy | 's poc that way | 13:08 |
| *** kopecmartin has quit IRC | 13:08 | |
| weshay | rlandy, ya.. sagi had a bridge, not just natted | 13:08 |
| trown | if we just document as "run from virthost"... I dont see what the issue with that is | 13:09 |
| weshay | trown, I think that is fine.. | 13:09 |
| weshay | trown, I prefer to run from my laptop so I don't have to setup gerrit etc.. on the virthost.. so I'm just poking really | 13:10 |
| trown | just setup an ssh key on your virthost :P | 13:10 |
| rlandy | I will restest from laptop to virthost after this run to confirm | 13:10 |
| trown | I submit patches from my virthost all the time :P | 13:10 |
| *** amoralej is now known as amoralej|lunch | 13:10 | |
| rlandy | I don't want to kill this run as it is fs037 | 13:10 |
| weshay | trown, ok.. so you seem to feel strongly about this | 13:10 |
| weshay | trown, you are suggesting I should stop and work on something else | 13:11 |
| trown | that takes about 3 minutes... what you are proposing is days of exploration and work | 13:11 |
| weshay | trown, well.. it's led to a couple cool things | 13:11 |
| trown | I am just trying to understand the motivation for the work | 13:11 |
| trown | because the motivation for the rest of the sprint work seems high impact | 13:11 |
| weshay | at the very least... I have a much better way atm.. to create the ssh.config.ansible file | 13:11 |
| trown | we have 2 people working on the sprint... with you as kind of flex... but now you are pulling rlandy into this other stuff | 13:12 |
| weshay | trown, sure.. I'm going to try the workflow w/ the current networks + a mvctap device on the undercloud box | 13:12 |
| trown | and kind of me as well | 13:12 |
| weshay | rlandy, does not need to go after this | 13:13 |
| weshay | I'll stop after today | 13:13 |
| weshay | first week I feel I still have room to poke around | 13:13 |
| weshay | well.. week +1 day | 13:13 |
| trown | ya... sorry for being cranky about it... just feel like we are perpetually underresourced | 13:13 |
| rlandy | why don't we just create another card - we can go after it when we are done with current cards? | 13:14 |
| weshay | trown, tell that to our old boss :) | 13:14 |
| trown | and our method of dealing with that was supposed to be a very narrow focus on the work we do | 13:14 |
| trown | I have ... repeatedly :P | 13:14 |
| weshay | :) | 13:14 |
| weshay | trown, ok.. so here's what I'm saying.. I'd like a few more hours and then I'll drop it | 13:14 |
| weshay | getting a few hours to work on something is uuuuge for me | 13:15 |
| trown | ya, go for it... its friday | 13:15 |
| trown | i was not saying drop it | 13:15 |
| *** apetrich has quit IRC | 13:15 | |
| trown | just dont make me review any of it :P | 13:15 |
| trown | at least until we accomplish main sprint goals | 13:16 |
| weshay | anyway.. if I continue to have some time due to the plentiful promotions.. I'll pick a card up | 13:16 |
| weshay | I'm in brno next week anyway.. :( | 13:16 |
| trown | I think we have a high chance of success on the sprint without any extra help on the cards | 13:16 |
| weshay | aye | 13:17 |
| trown | just need rlandy and I to be allowed to focus on the cards | 13:17 |
| weshay | ya... rlandy stay focused on working w/ trown .. ignore my work please | 13:17 |
| *** apetrich has joined #oooq | 13:17 | |
| * trown goes back to snapshotting | 13:18 | |
| * rlandy stays out of this arguments | 13:18 | |
| *** udesale has quit IRC | 13:20 | |
| *** udesale has joined #oooq | 13:20 | |
| *** udesale has quit IRC | 13:23 | |
| *** udesale has joined #oooq | 13:23 | |
| *** skramaja has quit IRC | 13:27 | |
| *** ratailor has quit IRC | 13:31 | |
| *** Goneri has joined #oooq | 13:31 | |
| *** quique|ruck|food is now known as quiquell|ruck | 13:37 | |
| *** atoth has quit IRC | 13:38 | |
| panda|rover | trown: you working on snapshot ? | 13:51 |
| trown | panda|rover: indeed | 13:51 |
| panda|rover | trown: ok, moved card to in progress | 13:51 |
| rlandy | trown: fs037 deploy hang at ''Check if kolla_config.yaml file exists' - is that what you see? | 13:53 |
| trown | rlandy: ya, and if you check... you cant ping across vxlan tunnel after that | 13:56 |
| *** atoth has joined #oooq | 13:57 | |
| *** agopi has joined #oooq | 13:59 | |
| *** links has quit IRC | 14:03 | |
| *** hrybacki has quit IRC | 14:06 | |
| *** hrybacki has joined #oooq | 14:06 | |
| weshay | rlandy, k.. ready | 14:10 |
| ykarel | quiquell|ruck, panda|rover FYI current failures in master pipeline would be fixed by:- https://review.rdoproject.org/r/#/q/branch:rpm-master+topic:neutron13.0.0 | 14:15 |
| quiquell|ruck | ykarel: Still waiting for the verification of the skip test review | 14:16 |
| ykarel | can get that in queens, | 14:16 |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 14:16 |
| quiquell|ruck | weshay: Are you good to talk about osp-12 ? | 14:18 |
| quiquell|ruck | ykarel: Hummm this is a different change ? | 14:19 |
| ykarel | yes new issue | 14:22 |
| quiquell|ruck | ykarel: You mean this fail ? | 14:23 |
| quiquell|ruck | https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-centos-7-master-containers-build/0a835eb/ | 14:23 |
| *** apetrich has quit IRC | 14:23 | |
| ykarel | quiquell|ruck, yes | 14:26 |
| quiquell|ruck | ok, yep that's new | 14:27 |
| *** panda|rover is now known as panda|rover|brb | 14:27 | |
| *** amoralej|lunch is now known as amoralej | 14:27 | |
| quiquell|ruck | Never ending this ruck thing | 14:27 |
| quiquell|ruck | ykarel: It will fail in queens too ? | 14:29 |
| ykarel | quiquell|ruck, nope | 14:29 |
| quiquell|ruck | ok | 14:29 |
| ykarel | queens containers-build passed | 14:30 |
| quiquell|ruck | Ok, didn't check yet | 14:30 |
| panda|rover|brb | sorry guys, problem at home. be back later | 14:33 |
| *** jaosorior has quit IRC | 14:37 | |
| quiquell|ruck | ykarel: This are the logs ? | 14:37 |
| quiquell|ruck | INFO:kolla.common.utils.neutron-base:[91mError: openstack-neutron-lbaas conflicts with 1:openstack-neutron-13.0.0-0.20180420001836.b6db5df.el7.centos.noarch | 14:37 |
| quiquell|ruck | INFO:kolla.common.utils.neutron-base:Error: python-neutron-fwaas conflicts with 1:python-neutron-13.0.0-0.20180420001836.b6db5df.el7.centos.noarch | 14:37 |
| quiquell|ruck | INFO:kolla.common.utils.neutron-base:Error: openstack-neutron-fwaas conflicts with 1:openstack-neutron-13.0.0-0.20180420001836.b6db5df.el7.centos.noarch | 14:37 |
| quiquell|ruck | INFO:kolla.common.utils.neutron-base:Error: python-neutron-lbaas conflicts with 1:python-neutron-13.0.0-0.20180420001836.b6db5df.el7.centos.noarch | 14:37 |
| quiquell|ruck | INFO:kolla.common.utils.neutron-base:[0m | 14:37 |
| ykarel | quiquell|ruck, yes | 14:38 |
| *** ykarel is now known as ykarel|away | 14:40 | |
| quiquell|ruck | ykarel|away: https://bugs.launchpad.net/tripleo/+bug/1765738 | 14:45 |
| openstack | Launchpad bug 1765738 in tripleo "Error installing kolla neutron-base" [Critical,In progress] - Assigned to Gabriele Cerami (gcerami) | 14:45 |
| ykarel|away | quiquell|ruck, ack | 14:46 |
| ykarel|away | just update that it's affecting master only | 14:46 |
| quiquell|ruck | ykarel|away: done | 14:52 |
| ykarel|away | Thanks | 14:52 |
| *** panda|rover|brb is now known as panda|rover | 14:54 | |
| panda|rover | oh joy | 14:54 |
| panda|rover | another pomotion blocker | 14:54 |
| *** apetrich has joined #oooq | 14:54 | |
| quiquell|ruck | panda|rover: Everything ok ? | 14:54 |
| quiquell|ruck | panda|rover: Yep another | 14:55 |
| quiquell|ruck | weshay: You there ? | 14:56 |
| weshay | quiquell|ruck, ya.. in 1-1 will be out in 5min | 14:56 |
| quiquell|ruck | weshay: Cool | 14:57 |
| *** rfolco|doctor is now known as rfolco | 15:01 | |
| quiquell|ruck | ykarel|away: the skipping of the test if going on a on in the zuul's queue a lot of stuff is being merge | 15:06 |
| ykarel|away | quiquell|ruck, ahh we can't control that, hoping to get it clear soon | 15:08 |
| quiquell|ruck | Yep, perfect friday :-/ | 15:08 |
| panda|rover | wel,, we can sorta control it. When it's really bad, PTLs usually abandon intentionally some of the changes in the queue | 15:11 |
| quiquell|ruck | Interesting | 15:12 |
| weshay | quiquell|ruck, k.. ready | 15:13 |
| weshay | https://bluejeans.com/u/whayutin/ | 15:13 |
| quiquell|ruck | Ok | 15:13 |
| *** ykarel|away has quit IRC | 15:21 | |
| *** quiquell|ruck is now known as quiquell|off | 15:42 | |
| *** jfrancoa has quit IRC | 15:50 | |
| *** jtomasek has quit IRC | 15:53 | |
| agopi | * | 15:55 |
| *** apetrich has quit IRC | 15:57 | |
| *** tesseract has quit IRC | 15:58 | |
| *** bogdando has quit IRC | 16:02 | |
| *** lucasagomes is now known as lucas-af | 16:05 | |
| *** lucas-af is now known as lucas-afk | 16:05 | |
| *** panda|rover is now known as panda|rover|off | 16:10 | |
| *** jtomasek has joined #oooq | 16:11 | |
| *** jtomasek has quit IRC | 16:12 | |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 16:16 |
| *** zoli is now known as zoli|gone | 16:22 | |
| *** zoli|gone is now known as zoli | 16:22 | |
| *** ykarel|away has joined #oooq | 16:22 | |
| *** gkadam has quit IRC | 16:42 | |
| *** holser__ has quit IRC | 16:47 | |
| *** rlandy is now known as rlandy|brb | 16:52 | |
| *** agopi is now known as agopi|lunch | 16:56 | |
| *** marios has quit IRC | 17:03 | |
| *** trown is now known as trown|lunch | 17:08 | |
| *** rlandy|brb is now known as rlandy | 17:14 | |
| *** amoralej is now known as amoralej|off | 17:19 | |
| *** trown|lunch is now known as trown | 18:06 | |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 18:17 |
| *** agopi|lunch is now known as agopi | 18:18 | |
| *** jaganathan has quit IRC | 18:24 | |
| *** ykarel|away has quit IRC | 18:29 | |
| *** udesale has quit IRC | 18:34 | |
| rfolco | rlandy, bad time for rdo2 related questions ? | 18:37 |
| rlandy | rfolco: never a bad time :) ... what's up? | 18:37 |
| rfolco | rlandy, better in bj, can you? | 18:38 |
| rlandy | k - switching displays - sec | 18:38 |
| rlandy | rfolco: k - you bj? | 18:40 |
| rfolco | https://bluejeans.com/5878458097 | 18:40 |
| *** jtomasek has joined #oooq | 18:44 | |
| *** agopi_ has joined #oooq | 19:26 | |
| *** agopi has quit IRC | 19:29 | |
| *** Goneri has quit IRC | 19:56 | |
| *** atoth has quit IRC | 19:58 | |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 20:17 |
| trown | rlandy: made some good progress on snapshotting and updated the card https://trello.com/c/3aSQKPt6/710-add-snapshotting-capabilites-to-the-workflow | 20:50 |
| rlandy | trown: nice! | 20:50 |
| trown | I have a couple approaches and I am not sure which is best, maybe we can discuss on monday with the rest of the group | 20:51 |
| trown | have a great weekend everyone | 20:52 |
| *** trown is now known as trown|outtypewww | 20:52 | |
| rlandy | trown|outtypewww: sounds good | 20:54 |
| rlandy | have some options on the reproducer as well to discuss on monday | 20:54 |
| *** agopi_ is now known as agopi|out | 21:12 | |
| *** rfolco is now known as rfolco|off | 21:15 | |
| *** agopi|out has quit IRC | 21:16 | |
| *** jtomasek has quit IRC | 21:21 | |
| *** rlandy has quit IRC | 21:53 | |
| *** agopi|out has joined #oooq | 21:55 | |
| hubbot | FAILING CHECK JOBS: gate-tripleo-ci-centos-7-container-to-container-upgrades-master-nv, tripleo-quickstart-extras-gate-newton-delorean-full-minimal | check logs @ https://review.openstack.org/472607 and fix them ASAP. | 22:17 |
| *** agopi|out has quit IRC | 23:11 | |
| *** tosky has quit IRC | 23:15 | |
| *** agopi|out has joined #oooq | 23:16 | |
| *** ykarel|away has joined #oooq | 23:38 | |
| *** ykarel|away has quit IRC | 23:46 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
