| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-ci- (2 more messages) | 00:53 |
|---|---|---|
| *** rlandy|bbl is now known as rlandy | 00:59 | |
| *** d0ugal has quit IRC | 01:48 | |
| *** d0ugal has joined #oooq | 01:51 | |
| *** apetrich has quit IRC | 02:15 | |
| *** rlandy has quit IRC | 02:22 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 02:53 |
| *** udesale has joined #oooq | 04:07 | |
| *** jaosorior has joined #oooq | 04:28 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 04:53 |
| *** ratailor has joined #oooq | 04:53 | |
| *** jbadiapa has quit IRC | 05:14 | |
| *** apetrich has joined #oooq | 05:32 | |
| *** quiquell has joined #oooq | 05:53 | |
| quiquell | Did we have a queens promotion with new jobs ? | 05:57 |
| *** jbadiapa has joined #oooq | 06:36 | |
| *** kopecmartin|off is now known as kopecmartin|ruck | 06:38 | |
| *** jfrancoa has joined #oooq | 06:49 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 06:53 |
| *** jtomasek has joined #oooq | 07:08 | |
| *** jfrancoa has quit IRC | 07:10 | |
| quiquell | ssbarnea: are you there ? | 07:11 |
| *** bogdando has joined #oooq | 07:32 | |
| ssbarnea_ | quiquell: morning! yep i am. | 07:34 |
| ssbarnea_ | quiquell: really pissed of on my inet, 6h downtime,firt in two years. | 07:35 |
| Tengu | heya! anyone can tell me how I can run a test with a tripleo-quickstart-extras modification? in my case, I'd like to run that change locally: https://review.openstack.org/#/c/608452/8 | 07:38 |
| quiquell | Tengu: You mean with the reproducer ? | 07:39 |
| Tengu | quiquell: I'd rather run it in a vagrant box on my own | 07:39 |
| quiquell | Tengu: I think you can trick quickstart.sh a little to do a git review -d or the like | 07:40 |
| quiquell | Tengu: Also having a ZUUL_CHANGES var will help | 07:40 |
| Tengu | hmm ok. is there any doc for that? | 07:41 |
| quiquell | Tengu: first try to export ZUUL_CHANGES as it is in the run jobs of the patchset | 07:42 |
| Tengu | hmm ok | 07:42 |
| quiquell | and run quickstart.sh, don't know if this will work | 07:43 |
| quiquell | Tengu: also you have reproducer libvirt | 07:43 |
| quiquell | ssbarnea_: Damn... I am trying to help with the fedora28 thingy | 07:43 |
| Tengu | yeah, but I'd rather avoid running it on my laptop or builder, as it will install things I don't really want on either of them ;). | 07:43 |
| ssbarnea_ | Tengu: please mention here or on open reviews related to f28, there are lots of them. | 07:44 |
| Tengu | ssbarnea_: hu? | 07:44 |
| *** skramaja has joined #oooq | 07:45 | |
| *** tosky has joined #oooq | 07:46 | |
| ssbarnea_ | https://review.openstack.org/#/q/topic:standalone-f28+(status:open+OR+status:merged) | 07:47 |
| Tengu | ah, not for me then ;). | 07:47 |
| *** skramaja has quit IRC | 07:48 | |
| *** skramaja has joined #oooq | 07:50 | |
| quiquell | ssbarnea_: Do you have the review with the fedora28 release file ? | 07:50 |
| Tengu | erf. there's still the issue with the resize using libvirt in quickstart -.- | 07:51 |
| Tengu | fuuuu | 07:52 |
| *** gkadam has joined #oooq | 07:57 | |
| ssbarnea_ | quiquell: Tengu : https://ci.centos.org/job/tripleo-quickstart-extras-gate-master-delorean-full-featureset052/829/console ? not sure what causes "Inject the gating repo (overcloud-full" failure | 08:02 |
| ssbarnea_ | gating_repo.tar.gz: No such file or directory | 08:02 |
| quiquell | ssbarnea_: I think I have a fix for this | 08:03 |
| ssbarnea_ | this would be great | 08:03 |
| quiquell | ssbarnea_: https://review.openstack.org/#/c/606012/ | 08:03 |
| quiquell | ssbarnea_: Someone has the same issue at #tripleo | 08:03 |
| quiquell | DonÂ't remember who | 08:03 |
| quiquell | ssbarnea_: I think the release file for fedora 28 has to be the parent of the other quickstart reviews | 08:04 |
| quiquell | ssbarnea_: Can I reparent ? | 08:04 |
| ssbarnea_ | i guess yes, i am still a bit afraid of too long dep chain. | 08:05 |
| quiquell | ssbarnea_: Now it's a mess already | 08:06 |
| ssbarnea_ | quiquell: btw you fix fail with something that looks identical with the problem I mentioned yesterday about installing older tq(e): https://ci.centos.org/job/tripleo-quickstart-gate-master-delorean-quick-basic/7222/console | 08:07 |
| quiquell | ssbarnea_: Could be I was fixing something else | 08:07 |
| *** dtantsur|afk is now known as dtantsur | 08:08 | |
| ssbarnea_ | damn, we cannot really do anything due to that bug, look for "Successfully uninstalled tripleo-quickstart-extras-2.1.1.dev1073" line | 08:08 |
| quiquell | yep | 08:08 |
| quiquell | ssbarnea: If we want to merge stuff I think we need to have the Depends-On: https://review.openstack.org/#/c/591652/ | 08:11 |
| quiquell | ssbarnea_: at the new job definition | 08:11 |
| ssbarnea_ | quiquell: i think that the one you mentioned should be kept separated and not made dependent on anything, as it should pass easy, one less in the chain. | 08:13 |
| ssbarnea_ | we should be able to adopt "{{ ansible_pkg_mgr }}" even without testing on f28, all we need to know for the moment is that it does pass the normal gates. | 08:13 |
| quiquell | ssbarnea_: So you are testing using the fedora release 28 review ? | 08:15 |
| ssbarnea_ | not so far, now I only trying to get few minutes to write the new yum install line. | 08:15 |
| quiquell | ssbarnea_: ack | 08:16 |
| ssbarnea_ | i wonder if there is a way to ask yum/dnf who installs pyyaml for the implicit python version | 08:19 |
| ssbarnea_ | whatprovides works well for tools that do install cli, but pyyaml (python[3]-yaml.rpm) does not install any script, is just a library. | 08:19 |
| ssbarnea_ | does anyone knows another channel where I am more likely to get a hint on that? | 08:20 |
| quiquell | ssbarnea_: maybe we can use an alternative to shyaml ? | 08:22 |
| quiquell | ssbarnea_: It's not enough with "$(package_manager) list installed |grep ..." ? | 08:25 |
| marios|rover | kopecmartin|ruck: can you remember to update https://review.rdoproject.org/etherpad/p/ruckrover-sprint20 please (just added https://bugs.launchpad.net/tripleo/+bug/1796710 you filed that) | 08:28 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 08:28 |
| kopecmartin|ruck | marios|rover, oh, sure | 08:28 |
| *** sshnaidm|afk is now known as sshnaidm | 08:29 | |
| quiquell | sshnaidm: o/ | 08:29 |
| sshnaidm | quiquell, hey | 08:29 |
| quiquell | sshnaidm: Looks like we have promote queens :-) | 08:29 |
| sshnaidm | quiquell, \o/ | 08:31 |
| ssbarnea_ | quiquell : see https://gist.github.com/ssbarnea/860c50ee73f5018ea3b2a92475401ccb | 08:31 |
| marios|rover | quiquell: nice :) | 08:31 |
| sshnaidm | quiquell, with new jobs, right? | 08:31 |
| quiquell | sshnaidm: btw, Looking at the ipsec and -tht jobs who can I help | 08:31 |
| quiquell | "who can I ask" I mean | 08:32 |
| quiquell | sshnaidm: yep | 08:33 |
| quiquell | sshnaidm: also, noop changes have legit failures | 08:33 |
| quiquell | sshnaidm: Let's expect we are not doing false positives | 08:33 |
| sshnaidm | quiquell, yeah, I too | 08:34 |
| marios|rover | kopecmartin|ruck: thanks i added a coule more that were in the prod chain board but on there :/ so looks like we ahve a few issues ... | 08:34 |
| sshnaidm | quiquell, wrt ipsec - they just need to run on specific changes | 08:34 |
| bogdando | o/ sshnaidm weshay , folks, please merge https://review.openstack.org/#/c/593103/ and https://review.openstack.org/#/c/576746/ | 08:34 |
| *** jfrancoa has joined #oooq | 08:35 | |
| quiquell | sshnaidm: you mean on changes of files at tht repo ? | 08:35 |
| sshnaidm | quiquell, yeah | 08:35 |
| *** chem` has joined #oooq | 08:35 | |
| bogdando | there is also https://review.openstack.org/#/c/603069/ please | 08:35 |
| quiquell | sshnaidm: we have this already at tripleo.yaml at config project | 08:36 |
| quiquell | sshnaidm: but it's openstack-check not experimental | 08:36 |
| kopecmartin|ruck | marios|rover, about the cards in the prod chain, someone will take them during the call? | 08:36 |
| *** chem has quit IRC | 08:37 | |
| kopecmartin|ruck | marios|rover, I'm asking if I'm supposed to update/edit them before the call , because i can't attend directly today :/ | 08:37 |
| marios|rover | kopecmartin|ruck: ack only if you have some new info update them , yeah i can take them on the call np | 08:37 |
| quiquell | sshnaidm: This would be enough https://review.rdoproject.org/r/16867 ? | 08:38 |
| kopecmartin|ruck | marios|rover, thanks, I'll be on IRC, I just can't be on the call during a lecture .. | 08:38 |
| marios|rover | kopecmartin|ruck: k np thanks for heads up | 08:38 |
| sshnaidm | quiquell, not sure we need "tht" now | 08:44 |
| sshnaidm | quiquell, so the idea was to run 042 on all changes in ipsec repo, but on specific files only in tht repo | 08:46 |
| ssbarnea_ | i wonder how much time we need to get rid of the dual toci_gate files... | 08:46 |
| sshnaidm | quiquell, if we can combine "files" and "irrelevant files" accordingly, we don't need tht suffix | 08:46 |
| quiquell | sshnaidm: yep | 08:46 |
| sshnaidm | quiquell, but maybe we can do it later in cleanup | 08:47 |
| quiquell | sshnaidm: I am asking at #tripleo | 08:47 |
| sshnaidm | quiquell, need also to add rocky job | 08:47 |
| ssbarnea_ | quiquell: can you please review https://gist.github.com/ssbarnea/860c50ee73f5018ea3b2a92475401ccb#proposed-install-code before I update the CR? | 08:49 |
| quiquell | ssbarnea_: sure sorry | 08:50 |
| quiquell | ssbarnea_: holy sh... we need that ? | 08:50 |
| ssbarnea_ | it looks ugly,... i was expecting that. | 08:50 |
| quiquell | ssbarnea_: whould be nice to toci_gate_test to be a tox instead of bash :-) | 08:51 |
| ssbarnea_ | https://bluejeans.com/2655417928 ? i can explain | 08:52 |
| quiquell | ssbarnea_: why do we need the which shyamlk at python2 ? it's clear that we haven't install it | 08:53 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 08:53 |
| sshnaidm | quiquell, in second thought it's too much to exclude in fs042 job.. so maybe let's leave it as is | 08:55 |
| sshnaidm | quiquell, let's just add rocky job there | 08:55 |
| ssbarnea_ | quiquell: shyaml requirement was added by someone else to the review (wes maybe?), i only kept it. | 08:55 |
| quiquell | sshnaidm: Let's wait for jaosorior confirmation | 08:56 |
| quiquell | sshnaidm: Maybe he has new requisites | 08:56 |
| sshnaidm | quiquell, I think it's fine :) | 08:56 |
| ssbarnea_ | quiquell: me wrong, it was there from begining. | 08:56 |
| quiquell | ssbarnea_: you mean requirements.txt >? | 08:57 |
| ssbarnea_ | no, look at https://review.openstack.org/#/c/595374/39/playbooks/tripleo-ci/templates/toci_gate_test.sh.j2 | 08:57 |
| ssbarnea_ | line49: is installing it. | 08:57 |
| quiquell | ssbarnea_: But you are going to replace that with the code you just showed to me | 08:58 |
| ssbarnea_ | quiquell: with code that also assures that we have shyaml installed at the end, right? | 08:58 |
| quiquell | ssbarnea_: I mean, you can remove wich from your gist | 08:59 |
| quiquell | ssbarnea_: also would say the pip install too | 08:59 |
| quiquell | ssbarnea_: And go only with rpm | 08:59 |
| ssbarnea_ | quiquell, ahh I prefer the which because makes execution much faster. -- also there is no shyaml rpm on centos7! | 09:00 |
| ssbarnea_ | so we NEED pip, at least until someone builds and releases it for centos7 | 09:00 |
| ssbarnea_ | as part of the default repos used. | 09:00 |
| quiquell | ssbarnea_: ack, then the gist is ok, but weird as hell | 09:01 |
| quiquell | ssbarnea_: This is only to be able to use shyaml ? | 09:01 |
| sshnaidm | bogdando, commented on https://review.openstack.org/#/c/593103/ | 09:01 |
| quiquell | ssbarnea_: we have this https://github.com/mikefarah/yq, it has no dependencies at all | 09:02 |
| ssbarnea_ | not sure, but we could simplify it if we get rpms sorted. | 09:02 |
| quiquell | ssbarnea_: Let's put in place your gist and parenting the reviews correctly so we can run the fedora28 job | 09:03 |
| ssbarnea_ | doing it now, just wanted to check before doing the change, as codes gets duplicated. | 09:04 |
| quiquell | ssbarnea_: cool | 09:04 |
| bogdando | sshnaidm: well spotted, thanks... updated! | 09:04 |
| *** panda has quit IRC | 09:22 | |
| *** panda has joined #oooq | 09:24 | |
| *** fhubik has joined #oooq | 09:31 | |
| *** fhubik has left #oooq | 09:35 | |
| quiquell | sshnaidm: we can workflow this to move eenvironment_type to base jobs in upstreams https://review.openstack.org/#/c/605689/ | 09:48 |
| sshnaidm | quiquell, done | 09:50 |
| quiquell | sshnaidm: cool | 09:50 |
| quiquell | sshnaidm: Replaced -tht jobs with normal ones https://review.rdoproject.org/r/16867 | 09:59 |
| quiquell | sshnaidm: Let's merge it | 09:59 |
| sshnaidm | quiquell, it won't work that way.. | 10:00 |
| quiquell | sshnaidm: Why ? | 10:00 |
| sshnaidm | quiquell, oops, sorry, looked at something different | 10:00 |
| arxcruz | sshnaidm: panda hey, can you take a look at https://review.openstack.org/#/c/605419/ ? | 10:01 |
| sshnaidm | quiquell, can you please add rocky job there? | 10:01 |
| quiquell | sshnaidm: Do we have too ? | 10:01 |
| sshnaidm | quiquell, of course, we need to run it on rocky branch | 10:02 |
| quiquell | sshnaidm: ack | 10:02 |
| sshnaidm | but need to define it firstly | 10:02 |
| quiquell | sshnaidm: Do we need rocky for fs053 there ? | 10:03 |
| sshnaidm | quiquell, not sure what it is | 10:03 |
| *** tosky has quit IRC | 10:04 | |
| *** tosky has joined #oooq | 10:04 | |
| quiquell | sshnaidm: ok now it is, with the Depends-On in place https://review.rdoproject.org/r/#/c/16867 | 10:08 |
| quiquell | jaosorior: Is this ok https://review.rdoproject.org/r/#/c/16867 ? | 10:08 |
| ssbarnea_ | i just remember about a FF bug I filed recently, https://bugzilla.mozilla.org/show_bug.cgi?id=1497037 -- if you agree, please vote for it. | 10:10 |
| openstack | Mozilla bug 1497037 in Internationalization "Default Firefox encoding should be Unicode (UTF-8) and not Western" [Normal,Unconfirmed] - Assigned to nobody | 10:10 |
| quiquell | ssbarnea_: Can I reparent reviews for f28 to run the job with the f28 release file ? | 10:10 |
| sshnaidm | quiquell, I think - why do we create now one job for branch? We can use now like branches:^(?!stable/(rocky|newton)).*$ | 10:10 |
| ssbarnea_ | quiquell: yep. | 10:11 |
| sshnaidm | quiquell, sorry, branches:^(?!stable/(rocky|queens)).*$ | 10:11 |
| quiquell | sshnaidm: Maybe they one the branch naame on the job name ? | 10:11 |
| sshnaidm | quiquell, and use only one job, and without these names in name | 10:11 |
| quiquell | sshnaidm: Agree | 10:11 |
| quiquell | sshnaidm: Let's do it, if they miss something we will know :-) | 10:11 |
| quiquell | sshnaidm: also the same applies for all the jobs that are not -branch | 10:12 |
| sshnaidm | quiquell, yeah.. well, we'll need to do a biiiiiig cleanup there | 10:12 |
| ssbarnea_ | does KeyError: 'resource_registry' ring any bells? | 10:13 |
| quiquell | ssbarnea_: yep... | 10:13 |
| quiquell | ssbarnea_: is OVB ? | 10:13 |
| quiquell | ssbarnea_: fix is in the gates | 10:13 |
| ssbarnea_ | ahh, ok. in this case should we prepare: https://review.openstack.org/#/c/591540/ for merge? | 10:14 |
| sshnaidm | quiquell, so for 042 we need something like ^(?!stable/(newton|ocata|pike)).*$ | 10:14 |
| quiquell | ssbarnea_: damn... failed the gates :-( | 10:14 |
| quiquell | sshnaidm: https://review.openstack.org/#/c/608589/ | 10:14 |
| quiquell | ssbarnea_: ^ | 10:14 |
| quiquell | sshnaidm, ssbarnea_: Change your nick names !!! | 10:14 |
| quiquell | sshnaidm: even master | 10:14 |
| sshnaidm | quiquell, this is excluding regex | 10:15 |
| sshnaidm | quiquell, do you think I didn't try to convince ssbarnea_ ?? :D | 10:15 |
| *** quiquell is now known as ssquique | 10:16 | |
| ssquique | Now we are three | 10:16 |
| ssbarnea_ | yep, but ssh is the cool prefix | 10:17 |
| ssquique | ssbarnea_: Agree | 10:17 |
| jaosorior | ssquique: so, this https://review.rdoproject.org/r/#/c/16868/2/zuul.d/ovb-jobs.yaml doesn't run on master anymore? | 10:17 |
| ssquique | sshnaidm -> dislexical versoin of ssh administrator | 10:17 |
| ssquique | jaosorior: There is tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset042-master | 10:18 |
| sshnaidm | ssquique, oh, no.. | 10:18 |
| sshnaidm | ssbarnea_, ssbarnea you are in two nicks, like it's not enough | 10:19 |
| ssbarnea_ | yes, long story,.. one of them is matrix server which is on intranet but since last week I didn't connect to the vpn anymore (had to reconfigure it). | 10:19 |
| *** ssquique is now known as quiquell | 10:22 | |
| quiquell | sshnaidm: Now is cleaner https://review.rdoproject.org/r/16867 | 10:23 |
| quiquell | ssbarnea_: Are you ok with this commit mess https://review.openstack.org/595374 ? | 10:29 |
| quiquell | ssbarnea_: so we chek the job from the review that defines it | 10:30 |
| ssbarnea_ | quiquell : i think you need to fix the commit message, you are not allowed to have newlines between meta data. | 10:31 |
| quiquell | ssbarnea_: Yep wait miss also a Depends-On | 10:31 |
| ssbarnea_ | quiquell : please confirm my comments from https://review.openstack.org/#/c/591540/46/quickstart.sh before I fix the code. | 10:31 |
| quiquell | ssbarnea_: done | 10:36 |
| quiquell | ssbarnea_: I think now we are good https://review.openstack.org/595374 | 10:41 |
| quiquell | ssbarnea_: Argg launcpad is assigning to me stuff | 10:47 |
| *** udesale has quit IRC | 10:52 | |
| marios | weshay: kopecmartin|ruck i removed alert promotion-blocker from https://bugs.launchpad.net/tripleo/+bug/1796764 see comment #5 please tell me if that is wrong thanks | 10:52 |
| openstack | Launchpad bug 1796764 in tripleo "OperationalError: (sqlite3.OperationalError) database is locked [SQL: "SELECT name FROM sqlite_master WHERE type='table' ORDER BY name"] (Background on this error at: http://sqlalche.me/e/e3q8)" [Critical,Triaged] | 10:52 |
| marios | sshnaidm: ^ | 10:53 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp- (2 more messages) | 10:53 |
| sshnaidm | marios, ack | 10:54 |
| quiquell | ssbarnea_: package_manager is missing | 10:59 |
| quiquell | ssbarnea_: ok fixed | 11:01 |
| quiquell | sshnaidm: Looks like centos does not have python2-requests python2-urllib3 :-( | 11:09 |
| *** amoralej is now known as amoralej|lunch | 11:14 | |
| quiquell | ssbarnea_: Change to 'python' as fallbcak is there is not python3 | 11:16 |
| quiquell | ssbarnea_: centos has no python2-requets package for example | 11:16 |
| quiquell | ssbarnea_: docker run -it centos yum install python2-requests | 11:17 |
| quiquell | sshnaidm: We have some trusted project issues to merge the tht changes, we cannot remove job definitions in the same go | 11:25 |
| quiquell | sshnaidm: First we create new ones without branch, merge it, and then we can merge config changes | 11:25 |
| sshnaidm | quiquell, ack | 11:25 |
| *** jrist has joined #oooq | 11:29 | |
| *** jrist has quit IRC | 11:36 | |
| ssbarnea_ | quiquell: using python2 instead of python is recommended by PEP-0394 - we should not use just "python" | 11:44 |
| quiquell | ssbarnea_: I mean package name | 11:45 |
| quiquell | ssbarnea_: We have to use python2 as command but python for package name | 11:45 |
| ssbarnea_ | quiquell: for package name the answer is even more complex due to aliases. i prefer to look at original package name and used that one as reference. | 11:46 |
| ssbarnea_ | btw, you removed pyyaml from last version and I believe this would make pip installation of shyaml to fail if library is not present. | 11:46 |
| sshnaidm | quiquell, https://review.rdoproject.org/r/#/c/16868 is merging | 11:47 |
| ssbarnea_ | quiquell: regarding missing python2-requests on centos7: this package exists in centos-openstack-* and n epel ... | 11:54 |
| quiquell | ssbarnea_: was failing at RDO | 11:54 |
| ssbarnea_ | isn't this enough? | 11:54 |
| quiquell | ssbarnea_: in the job | 11:54 |
| ssbarnea_ | quiquell: question is, which one should we use? | 11:55 |
| quiquell | ssbarnea_: Maybe we can just make a kind of fallback mechanism | 11:55 |
| quiquell | ssbarnea_: failure https://logs.rdoproject.org/74/595374/43/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/946c361/job-output.txt.gz#_2018-10-09_11_05_47_202919 | 11:55 |
| quiquell | ssbarnea_: Maybe we have to update RDO centos image ? | 11:57 |
| ssbarnea_ | quiquell: this is like cheating ;) if possible we fix our code, so it would work regardless this aspect. looking now for possible approach | 11:59 |
| quiquell | ssbarnea_: Yeah man... | 11:59 |
| quiquell | ssbarnea_: Trying to discover issues so we can have this thing working and put stuff in gates | 12:00 |
| quiquell | ssbarnea_: Also discover that we don't have ansible_pkg_mgr at RDO, maybe we are not gathering facts | 12:02 |
| *** zul has joined #oooq | 12:04 | |
| weshay | morning | 12:15 |
| ssbarnea_ | weshay: hi! how is going? | 12:16 |
| weshay | good :) | 12:17 |
| weshay | ssbarnea_, hey one thing I forgot to tell you | 12:17 |
| weshay | the guys that run ci.centos get pissed off if the inventory "cico" does not properly return nodes | 12:17 |
| weshay | I made a comment in your review about it.. afaict cico was failing because of the review | 12:18 |
| weshay | just a heads up :)) | 12:18 |
| *** chandankumar has joined #oooq | 12:19 | |
| ssbarnea_ | ok, i will find the comment bit later, not still trying to find a solution for the variable python rpm package name, we cannot use yum install python*-foo | 12:19 |
| weshay | ssbarnea_, the rpms we need are not avail? | 12:20 |
| ssbarnea_ | i need something to work like "python[2]?-foo" which obviously does not work as there is no support for regex. | 12:20 |
| ssbarnea_ | weshay is not that, is that their names are not really consistent, and we do want to install only the ones we need, avoiding the side effect of installing extra python due to wildcard use. | 12:21 |
| weshay | where do we use wild cards for dep installs? | 12:22 |
| weshay | quiquell, what was wrong w/ cockpit? | 12:23 |
| quiquell | weshay: The ansible explorer influxdb line is missing tags, and having other that are not optimal. | 12:25 |
| ssbarnea_ | weshay: it was on one f28 changes, python[3]-virtualenv | 12:26 |
| weshay | quiquell, ok.. but the data I'm looking at is sane? | 12:26 |
| weshay | quiquell, you need a review? | 12:26 |
| ssbarnea_ | weshay: look at https://gist.github.com/ssbarnea/860c50ee73f5018ea3b2a92475401ccb -- to get an idea about the "challenge" | 12:26 |
| weshay | marios, any ideas how to fix sqllite? | 12:27 |
| quiquell | weshay: data is sane, searching is insane :-) | 12:27 |
| weshay | from sqlalchemy import create_engine | 12:27 |
| weshay | e = create_engine("mysql://scott:tiger@localhost/test", pool_recycle=3600) | 12:27 |
| ssbarnea_ | so somehow I need to write a line that installs python-requests or python2-requests but not python3-requests. | 12:28 |
| *** trown|outtypewww is now known as trown | 12:28 | |
| weshay | marios, david simard may be interested in checking this out | 12:28 |
| quiquell | weshay: btw, helping a little at f28 I want tripleo stuff running at other opnestack project at my next ruck/rover :-) | 12:28 |
| weshay | quiquell, +10 | 12:28 |
| *** rlandy has joined #oooq | 12:28 | |
| weshay | quiquell, ssbarnea_ ya.. the f28 upstream job is a asap task | 12:29 |
| weshay | so +10 | 12:29 |
| rlandy | quiquell: hi ... do you need a merge on https://review.rdoproject.org/r/#/c/16867? | 12:33 |
| *** toure|biab is now known as toure | 12:33 | |
| *** chem` has quit IRC | 12:33 | |
| quiquell | rlandy: yep and the depends on | 12:34 |
| marios | weshay: not particularly but just digging into it now i thought it wasnt a bug until 10 mins ago :) | 12:34 |
| rlandy | quiquell: depends-on is merged - by sshnaidm | 12:34 |
| rlandy | I'll merge this one | 12:34 |
| quiquell | rlandy: Cool thanks, btw we have a queens promotion with our new stuff | 12:34 |
| quiquell | :-) | 12:34 |
| rlandy | quiquell: awesome - did it need more fixes from what ran last night? | 12:35 |
| *** apetrich has quit IRC | 12:35 | |
| rlandy | we restarted both promotion jobs last night | 12:35 |
| weshay | marios, k.. lol no worries | 12:36 |
| quiquell | rlandy: nope, also check is checking they have legit failures and noop are working as expeced | 12:36 |
| *** ratailor has quit IRC | 12:36 | |
| quiquell | rlandy: Let's hope we are not facing false positives | 12:36 |
| rlandy | quiquell: yep - can I move your two cards left in progress to done? | 12:37 |
| rlandy | we should track this stage fallout in a separate issue | 12:37 |
| quiquell | rlandy: moved the ipsec one | 12:37 |
| rlandy | cool | 12:37 |
| ssbarnea_ | I think I found two magic lines: yum install --exclude='python3*' 'python*-requests' | 12:37 |
| ssbarnea_ | dnf install --exclude='python2*' 'python*-requests' | 12:37 |
| rlandy | quiquell: I updated sova check | 12:37 |
| ssbarnea_ | mainly adding the exclude to yum/dnf to avoid getting ... more than the desired package. | 12:38 |
| rlandy | quiquell: looking as to why promotions are still tracking legacy | 12:38 |
| quiquell | sshnaidm: ^ sova issue | 12:38 |
| marios | weshay: also master gate http://logs.openstack.org/98/604298/29/check/tripleo-ci-centos-7-containers-multinode/8804f81/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-09_08_56_31_872 | 12:38 |
| marios | weshay: gate check check jobs that is | 12:39 |
| weshay | k | 12:39 |
| weshay | ya | 12:39 |
| rlandy | weshay: I'm closing this bug: https://bugs.launchpad.net/tripleo/+bug/1789294 | 12:39 |
| openstack | Launchpad bug 1789294 in tripleo "RDO Cloud jobs move to zuulv3 native is blocked by legacy dependencies" [High,Triaged] - Assigned to Ronelle Landy (rlandy) | 12:39 |
| weshay | marios, I was speaking to Alex about it yesterday.. since the upload is now multithreaded.. he thought we may have brought out a race in ara | 12:40 |
| weshay | rlandy++ | 12:40 |
| hubbot1 | weshay: rlandy's karma is now 27 | 12:40 |
| weshay | how'd we do w/ the jobs from last night? | 12:40 |
| weshay | kopecmartin|ruck, did your patch merge? | 12:40 |
| rlandy | weshay: quiquell said we got a queens promotion | 12:41 |
| kopecmartin|ruck | weshay, not yet, i had to recheck it couple of times | 12:41 |
| rlandy | weshay: I watched the jobs last night and the failures are ones we know about | 12:41 |
| kopecmartin|ruck | weshay, here are reasons why i had to recheck https://bugs.launchpad.net/tripleo/+bug/1796849 | 12:42 |
| openstack | Launchpad bug 1796849 in tripleo "Mirror/network issues at mirror.us-west-1.packethost.openstack.org" [Undecided,New] | 12:42 |
| *** apetrich has joined #oooq | 12:42 | |
| weshay | kopecmartin|ruck, marios|rover this may be helpful .. do you guys know how to use openstack health? http://status.openstack.org/elastic-recheck/data/others.html | 12:43 |
| ssbarnea_ | quiquell: please have a new look at https://gist.github.com/ssbarnea/860c50ee73f5018ea3b2a92475401ccb -- i think I found a solution. | 12:44 |
| weshay | kopecmartin|ruck, thanks looking | 12:44 |
| quiquell | ssbarnea_: This is the typical stuff that you forget after two weeks or so :-) | 12:45 |
| quiquell | ssbarnea_: Add it to toci_gate_test.sh | 12:46 |
| rlandy | sshnaidm: ping re: sova periodic | 12:46 |
| ssbarnea_ | quiquell: hopefully by that time we will have gates to prevent regression. doing the change now. | 12:46 |
| sshnaidm | rlandy, hi | 12:47 |
| *** amoralej|lunch is now known as amoralej | 12:47 | |
| quiquell | ssbarnea_: let's cross fingers | 12:47 |
| rlandy | sshnaidm: hey - sova is still tracking legacy periodics | 12:47 |
| rlandy | looks like it shoudl pick up the pipeline | 12:47 |
| ssbarnea_ | i wonder if there is a way to make it shorter, or less ugly. | 12:47 |
| ssbarnea_ | also lets hope py4 will not appear too soon.... | 12:47 |
| rlandy | sshnaidm: is there a refresh or did I miss an edit? | 12:47 |
| quiquell | ssbarnea_: shorter will mean more magic for sure | 12:48 |
| marios | weshay: thanks will check it more later | 12:48 |
| weshay | kopecmartin|ruck, marios|rover is theory ( if we could get a +2 ) we could add an elastic recheck query and see how often http://mirror.us-west-1.packethost.openstack.org:8080 is failing jobs | 12:48 |
| weshay | kopecmartin|ruck, I can show you how to do that, /me prepares a query | 12:48 |
| sshnaidm | rlandy, oh, I see.. you need to change it also in "promtest" branch for periodic jobs. Master branch is for check jobs - and it worked | 12:49 |
| rlandy | sshnaidm: oh - didn't know that | 12:49 |
| marios | weshay: ack tanks (done that but long time ago) | 12:49 |
| sshnaidm | rlandy, yeah, it's complicated.. | 12:49 |
| marios | weshay: heh 'long' time 1 year https://review.openstack.org/#/c/505574/ | 12:50 |
| marios | ancient history | 12:50 |
| weshay | marios, aye | 12:50 |
| weshay | kopecmartin|ruck, ^ | 12:50 |
| rlandy | sshnaidm: promtest gives a 404 | 12:50 |
| weshay | I'll build a query and share it | 12:50 |
| marios | thank you weshay | 12:50 |
| sshnaidm | rlandy, it's branch of "sova" repo | 12:50 |
| rlandy | https://github.com/sshnaidm/sova/blob/promtest | 12:51 |
| rlandy | ^^ 404 | 12:51 |
| sshnaidm | rlandy, https://github.com/sshnaidm/sova/tree/promtest | 12:51 |
| weshay | kopecmartin|ruck, it's helpful so you don't have to troll through logs by hand :) | 12:51 |
| rlandy | ah ok | 12:51 |
| quiquell | ssbarnea_: I don't see the typo here http://logs.openstack.org/74/595374/44/check/tripleo-ci-fedora-28-standalone/fee0cbe/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz | 12:52 |
| quiquell | weshay: Reproducer works for standalone ? | 12:53 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container- (2 more messages) | 12:53 |
| weshay | quiquell, agh.. brain.. I don't "think" so | 12:53 |
| quiquell | weshay: ack | 12:54 |
| weshay | quiquell, I think it fails on building the vxlan bridge | 12:54 |
| weshay | I have a patch out there to disable that for standalone | 12:54 |
| weshay | quiquell, so it works w/ patches right.. because I have it working w/ f28 | 12:54 |
| weshay | but the patches were not .. say.. ready for review :) | 12:54 |
| weshay | quiquell, there are solutions to all the issues you will hit.. but they need love | 12:55 |
| quiquell | weshay: Will take them little by little ok | 12:55 |
| weshay | :) | 12:55 |
| *** agopi has quit IRC | 12:57 | |
| weshay | kopecmartin|ruck, see now we have something we can take to infra | 13:00 |
| weshay | https://gist.github.com/weshayutin/5f7a2c9411aecd814211ad20c95987d3 | 13:00 |
| weshay | kopecmartin|ruck, can you create a review like marios has here? https://review.openstack.org/#/c/505574/ | 13:00 |
| weshay | ssbarnea_, hey.. 1-1 if you have time now | 13:02 |
| rlandy | sshnaidm: can I delete the ocata jobs? | 13:03 |
| rlandy | from sova periodic | 13:03 |
| kopecmartin|ruck | weshay, how exactly is the review connected to the elastic recheck? I've missed something, .. scrolling the chat again | 13:03 |
| sshnaidm | rlandy, there is BRACHES var in config.py I think | 13:03 |
| weshay | kopecmartin|ruck, if we get a query merged.. it will move from http://status.openstack.org/elastic-recheck/data/others.html | 13:04 |
| weshay | http://status.openstack.org/elastic-recheck/gate.html | 13:04 |
| weshay | to ^ | 13:04 |
| rlandy | sshnaidm: GERRIT_BRANCHES = ("master", "stable/ocata", "stable/pike", | 13:05 |
| rlandy | "stable/queens", "stable/rocky") | 13:05 |
| sshnaidm | rlandy, yep, just remove ocata | 13:05 |
| sshnaidm | rlandy, and from jobs list | 13:06 |
| rlandy | sshnaidm: ack | 13:06 |
| *** zul has quit IRC | 13:09 | |
| marios | weshay: wondering if it is related to https://github.com/openstack/tripleo-common/commit/92100d71d027c7d60311b27698bacad5fa0a4f9e#diff-8560374e944930d6964f07a21363eb30 i see " container_build_tool: docker" in http://logs.openstack.org/50/604750/3/gate/tripleo-ci-centos-7-containers-multinode/4405b2b/logs/undercloud/home/zuul/install-undercloud.log.txt.gz | 13:10 |
| *** udesale has joined #oooq | 13:13 | |
| *** panda has quit IRC | 13:13 | |
| rlandy | sshnaidm: pull request sent | 13:13 |
| sshnaidm | rlandy, cool, checking | 13:14 |
| *** panda has joined #oooq | 13:14 | |
| quiquell | weshay: Let's workflow on of the ssbarnea_ patches for f28 https://review.openstack.org/#/c/605843 | 13:15 |
| quiquell | There is a lot of stuff | 13:15 |
| *** agopi has joined #oooq | 13:16 | |
| *** quiquell is now known as quiquell|lunch | 13:16 | |
| weshay | kopecmartin|ruck, ssbarnea_ is going to the infra mtg.. https://bugs.launchpad.net/tripleo/+bug/1796849 may be a topic there | 13:17 |
| openstack | Launchpad bug 1796849 in tripleo "Mirror/network issues at mirror.us-west-1.packethost.openstack.org" [Undecided,New] | 13:17 |
| *** udesale has quit IRC | 13:21 | |
| kopecmartin|ruck | weshay, https://review.openstack.org/#/c/608968/ | 13:22 |
| weshay | kopecmartin|ruck, thanks | 13:23 |
| weshay | ssbarnea_, ^ | 13:23 |
| weshay | kopecmartin|ruck, have you been able to run it locally | 13:24 |
| weshay | ? | 13:24 |
| weshay | that's important.. and I can show you | 13:24 |
| kopecmartin|ruck | weshay, elastic-recheck? | 13:24 |
| weshay | ya | 13:24 |
| kopecmartin|ruck | weshay, no, I haven't tried, i've copied query from you :D | 13:24 |
| weshay | kopecmartin|ruck, https://github.com/openstack-infra/elastic-recheck | 13:25 |
| weshay | kopecmartin|ruck, virtenv.. python setup.py install | 13:25 |
| weshay | then elastic-recheck-query | 13:25 |
| weshay | then elastic-recheck-query $query | 13:25 |
| *** rlandy_ has joined #oooq | 13:26 | |
| *** rlandy has quit IRC | 13:26 | |
| *** vinaykns has joined #oooq | 13:28 | |
| *** chem` has joined #oooq | 13:29 | |
| *** quiquell|lunch is now known as quiquell | 13:36 | |
| *** vinaykns has quit IRC | 13:42 | |
| *** rlandy_ is now known as rlandy | 13:44 | |
| *** Vorrtex has joined #oooq | 13:46 | |
| *** Vorrtex has quit IRC | 13:46 | |
| *** Vorrtex has joined #oooq | 13:47 | |
| ssbarnea_ | weshay: regarding the mirror issue, i can add it to today topics but I am not sure about its details. if is unreliabity, I can just ask to see what can be done to avoid it. | 13:50 |
| *** Vorrtex has left #oooq | 13:51 | |
| weshay | kopecmartin|ruck, thanks ssbarnea_ | 13:52 |
| ssbarnea_ | weshay: done, added to https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting | 13:53 |
| *** fhubik has joined #oooq | 13:54 | |
| *** vinaykns has joined #oooq | 13:55 | |
| ssbarnea_ | btw, can someone explain me the difference between: yum install git and yum install /usr/bin/git ? is see the "git" one installs some* perl packages. | 13:56 |
| quiquell | ssbarnea_: maybe git is just a meta package that install different git packages | 13:57 |
| quiquell | ssbarnea_: but doing /usr/bin/git just install the one that have the file on it | 13:57 |
| *** zul has joined #oooq | 13:58 | |
| weshay | kopecmartin|ruck, ssbarnea_ fyi https://github.com/openstack-infra/system-config | 13:58 |
| weshay | https://github.com/openstack-infra/system-config/blob/master/modules/openstack_project/manifests/mirror.pp#L3 | 13:58 |
| ssbarnea_ | ok, so I guess that was why we had the one with file path in it (me not even knowing that that was possible) | 13:58 |
| weshay | mirror config | 13:58 |
| weshay | rlandy, sshnaidm quiquell this is all that is left for migration? https://tree.taiga.io/project/tripleo-ci-board/task/106?kanban-status=1447275 | 14:03 |
| ssbarnea_ | another small fact, I find command -v python3 || command -v python2 as an unreliable way of detecting the default python on a distro as we can have both installed at one time. i wonder if there is a more reliable way to detect it... | 14:03 |
| sshnaidm | weshay, I think the migration is actually finished | 14:04 |
| ssbarnea_ | i am speaking about bash only, on ansible we can rely on ansible_interpeter_version which should be a safe-enough assumption. | 14:04 |
| quiquell | sshnaidm, weshay: hardening ? | 14:04 |
| weshay | sshnaidm, rlandy quiquell where is the champagne? | 14:04 |
| sshnaidm | weshay, but we need to reconfigure everything to match upstream - templates, etc, that what I do now | 14:04 |
| weshay | k | 14:05 |
| sshnaidm | quiquell, should be fine, we moved ci-scripts | 14:05 |
| weshay | thanks sshnaidm | 14:05 |
| quiquell | sshnaidm: ack | 14:05 |
| weshay | nice work all :) | 14:05 |
| * weshay waits for a job to kick | 14:05 | |
| rlandy | weshay: there is still the rdoinfo work | 14:06 |
| quiquell | rlandy: btw, what does the rdoinfo jobs ? | 14:06 |
| sshnaidm | quiquell, rlandy please review: https://review.rdoproject.org/r/#/c/16872 | 14:06 |
| rlandy | quiquell: they belong to alfredo | 14:06 |
| rlandy | we decided to let them sit for the moment | 14:07 |
| quiquell | rlandy: But what they do ? | 14:07 |
| weshay | marios|rover, kopecmartin|ruck sshnaidm so.. I believe the ovb promotion jobs should run w/ https://review.openstack.org/#/q/topic:bug/1792872+(status:open+OR+status:merged) | 14:08 |
| rlandy | quiquell: they create temp repos to test with to check builds | 14:09 |
| marios | weshay: ack sshnaidm pointed to a trace earlier and was surprised to see it i thought it was all merged. i checked earlier and saw it merged in branches too | 14:09 |
| weshay | marios, ya.. what I'm not seeing sshnaidm rlandy is a recent periodic ovb job | 14:09 |
| weshay | to check this out | 14:09 |
| weshay | ah got it now | 14:10 |
| rlandy | weshay: you don;t see any new periodic job? | 14:10 |
| weshay | filter = pipeline openstack-periodic 0 | 14:10 |
| weshay | filter = pipeline openstack-periodic | 14:10 |
| quiquell | weshay: http://dashboard-ci.tripleo.org/d/FEdraO0ik/jobs-exploration?orgId=1&var-influxdb_filter=job_name%7C%3D~%7C%2Fperiodic%2F | 14:11 |
| weshay | quiquell, ah good point.. I could have used that | 14:11 |
| rlandy | weshay: sshnaidm just merge my pull request to sova to update that | 14:11 |
| sshnaidm | weshay, will take some time for update | 14:11 |
| weshay | nice.. | 14:11 |
| weshay | thanks all | 14:11 |
| weshay | aye | 14:11 |
| rlandy | weshay: also ... https://review.rdoproject.org/zuul/jobs.html - search periodic | 14:12 |
| weshay | marios, kopecmartin|ruck now we're hitting the ssl error https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-rocky/7133f78/job-output.txt.gz | 14:13 |
| weshay | https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-rocky/7133f78/job-output.txt.gz#_2018-10-09_07_51_09_278447 | 14:13 |
| * weshay gets patch | 14:13 | |
| marios | weshay: https://review.openstack.org/608589 | 14:14 |
| marios | tripleo meeting btw | 14:14 |
| marios | quiquell: want to say anything about the migration? | 14:14 |
| marios | queens promotion? | 14:14 |
| weshay | marios, ya | 14:14 |
| weshay | tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-masterSUCCESS in 2h 35m 26s | 14:15 |
| weshay | tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-pike-branchSUCCESS in 1h 41m 19s | 14:15 |
| weshay | tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens-branchSUCCESS in 1h 56m 23s | 14:15 |
| weshay | tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-masterSUCCESS in 2h 32m 09s | 14:15 |
| weshay | :) | 14:15 |
| weshay | \0/ | 14:15 |
| quiquell | I feel like transtion has make ovb jobs more stable | 14:15 |
| quiquell | make this any sense ? | 14:15 |
| marios | very nice | 14:16 |
| ssbarnea_ | quiquell weshay : does this approach makes sense: https://gist.github.com/ssbarnea/8324475f4599d36591bd149b44add716#file-some-sh-L26 ? | 14:17 |
| marios | quiquell++ | 14:17 |
| hubbot1 | marios: quiquell's karma is now 9 | 14:17 |
| marios | panda++ | 14:18 |
| hubbot1 | marios: panda's karma is now 5 | 14:18 |
| marios | rlandy++ | 14:18 |
| hubbot1 | marios: rlandy's karma is now 28 | 14:18 |
| weshay | marios, kopecmartin|ruck so fs001 is still failing even w/ the ironic patch.. twice in a row | 14:18 |
| weshay | we still have some issue there in the overcloud deployment | 14:18 |
| weshay | w/ the heat stack failing | 14:18 |
| weshay | marios, keep working on ara | 14:19 |
| rlandy | marios: you forgot sshnaidm in the ++ fest above :) | 14:19 |
| weshay | kopecmartin|ruck, you and I are going to debug this one | 14:19 |
| marios | weshay: damn. well it was a race condition so maybe we need ironic to look again | 14:19 |
| weshay | marios, it may be | 14:19 |
| weshay | https://review.openstack.org/#/c/608589/ | 14:19 |
| weshay | https://logs.rdoproject.org/89/608589/5/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/01c5f87/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 14:19 |
| weshay | https://logs.rdoproject.org/89/608589/5/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/39c402b/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 14:19 |
| quiquell | ssbarnea_: It depends where it points out the virtualenv executable to python2 or python3 ? | 14:19 |
| weshay | 2018-10-09 13:44:03 | 2018-10-09 13:42:51Z [0.Controller]: CREATE_FAILED ResourceInError: resources.Controller: Went to status ERROR due to "Message: No valid host was found. , Code: 500" | 14:19 |
| quiquell | ssbarnea_: It's possible that it tries to install both ? | 14:20 |
| weshay | overcloud.Controller]: CREATE_FAILED CREATE aborted (Task create from ResourceGroup "Controller" Stack "overcloud" [ff39ee96-69c8-4970-8299-0f2bc9533201] Timed out) | 14:20 |
| weshay | 2018-10-09 10:59:58 | 2018-10-09 10:59:35Z [overcloud.Controller]: UPDATE_FAILED Stack | 14:20 |
| rlandy | sshnaidm: pls rebase https://review.rdoproject.org/r/#/c/16872/ | 14:23 |
| rlandy | otherwise look sok | 14:23 |
| ssbarnea_ | quiquell: that is the idea to install only one but because rpm names can be different (not having py number), the exclusion assures only one is installed, not sure if is fool proof but it worked on my f28 and centos7 tests. | 14:23 |
| sshnaidm | rlandy, please look at https://review.rdoproject.org/r/16873 | 14:23 |
| rlandy | sshnaidm: +2 | 14:24 |
| quiquell | ssbarnea_: I don't see the exclusion there | 14:25 |
| ssbarnea_ | quiquell look inside the package_manager function, i moved it there, to make it general and reusable. | 14:26 |
| ssbarnea_ | i also put the -y there too, lucky for us we can put arguments before the command (install, uninstall..) | 14:26 |
| weshay | kopecmartin|ruck, bah.. https://logs.rdoproject.org/89/608589/5/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master/ecda694/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 14:26 |
| weshay | maybe a return code bug .. | 14:26 |
| weshay | 3 diff errors thus far on the overcloud deployment on one f.. patch | 14:27 |
| weshay | kopecmartin|ruck, fire up a recreate please.. | 14:27 |
| weshay | kopecmartin|ruck, w/ ovb https://logs.rdoproject.org/89/608589/5/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/01c5f87/logs/reproducer-quickstart.sh | 14:28 |
| weshay | kopecmartin|ruck, you have access to rdo-cloud? | 14:28 |
| kopecmartin|ruck | weshay, sure, once I'll be able to have the script running | 14:28 |
| kopecmartin|ruck | i have | 14:28 |
| weshay | kopecmartin|ruck, k.. ping the channel w/ any errors you get :) | 14:29 |
| quiquell | ssbarnea_: Ahhh cool cool, then we are all good I think | 14:29 |
| quiquell | ssbarnea_: Fixed stuff at release file for fedora | 14:29 |
| ssbarnea_ | quiquell: another "cool" thing: py3 version of virtualenv is installed as "virtualenv-3" command, but we can still call it as a module so we are ok, if we do it. | 14:30 |
| sshnaidm | weshay, rlandy sova has updated | 14:30 |
| agopi | sshnaidm, regarding this https://review.rdoproject.org/r/#/c/16872/2/zuul.d/tripleo.yaml i don't have enough knowledge about interaction with irrelevant files but ovb-fs053 template is being reused for THT and toci. however the irrelevant files section is different for those 2 projects | 14:31 |
| quiquell | ssbarnea_: It does not link it to virtualenv ? | 14:31 |
| quiquell | ssbarnea_: btw my "fix" of relase file is not working, do you know if we have to use python3-tripleoclient ? | 14:31 |
| kopecmartin|ruck | weshay, the script is not user friendly because i have to have another openstack instance to run the script from , however, the instance has to have the same credentials as my rdo-cloud, otherwise I'm getting this http://paste.openstack.org/show/731708/ | 14:31 |
| ssbarnea_ | quiquell: nope, the famous PEP i mentioned seems to be the root of all (evil) commands. | 14:32 |
| weshay | kopecmartin|ruck, not sure why we write instructions :) | 14:32 |
| sshnaidm | agopi, rlandy do we want to run 053 in THT repo on specific changes only..? | 14:32 |
| quiquell | ssbarnea_: Evil PEP !!! | 14:32 |
| weshay | https://docs.openstack.org/tripleo-docs/latest/contributor/reproduce-ci.html | 14:32 |
| rlandy | sshnaidm:no | 14:32 |
| weshay | kopecmartin|ruck ^ | 14:33 |
| rlandy | sshnaidm: 053 should run on browbeat, tripleo-ci, tq/tqe | 14:33 |
| rlandy | that's all | 14:33 |
| agopi | i added 053 to THT as well rlandy | 14:33 |
| weshay | kopecmartin|ruck, did you source rdo creds? | 14:33 |
| weshay | looks like you did not | 14:34 |
| rlandy | agopi: oh ok | 14:34 |
| *** fhubik is now known as fhubik|brb | 14:34 | |
| agopi | and sshnaidm i'm trying to point out that the irrelevant files section is varying for the different projects as it's different for THT and toci. | 14:34 |
| kopecmartin|ruck | weshay, of course, however as i said i run the script from a different instance in internal openstack which has different credentials and that might be the problem | 14:34 |
| agopi | but we're using same template for them both | 14:34 |
| agopi | just curious if it'd make a difference? | 14:34 |
| sshnaidm | agopi, of course | 14:35 |
| weshay | kopecmartin|ruck, ? | 14:35 |
| weshay | kopecmartin|ruck, why not run it from your workstation | 14:35 |
| weshay | ? | 14:35 |
| sshnaidm | agopi, let's define which files/irrelevant_files should we use for every project | 14:35 |
| sshnaidm | rlandy, ^^ | 14:35 |
| kopecmartin|ruck | weshay, why not? the script should be able to deploy the env wherever the credentials points, no? | 14:35 |
| agopi | i just reused the irrevelant files for the other jobs for same projects. | 14:36 |
| weshay | it should | 14:36 |
| agopi | when i added the job sshnaidm | 14:36 |
| rlandy | sshnaidm: agopi:^^ yeah, afaict should be the same as other jobs - really browbeat should only care about changes to the templates and what builds them | 14:37 |
| weshay | gd it | 14:37 |
| weshay | folco | 14:37 |
| sshnaidm | agopi, rlandy so is it ok to ignore all these changes? https://review.rdoproject.org/r/#/c/16873/2/zuul.d/project-templates.yaml | 14:38 |
| sshnaidm | agopi, rlandy or we choose something lighter | 14:38 |
| sshnaidm | like ignoring docs etc | 14:38 |
| sshnaidm | agopi, rlandy because this long list is for all ovb jobs actually - 001, 035, etc | 14:39 |
| agopi | yes rlandy that was my intention as well. I added comments sshnaidm pl lmk if it makes sense | 14:39 |
| quiquell | ssbarnea_: More tomorrow will look into the fedora's release file | 14:39 |
| *** quiquell is now known as quiquell|off | 14:39 | |
| rlandy | sshnaidm: we could use a consolidated list | 14:39 |
| rlandy | for all ovb jobs | 14:39 |
| sshnaidm | agopi, where? | 14:40 |
| agopi | https://review.rdoproject.org/r/#/c/16872/2 | 14:40 |
| agopi | sshnaidm, ^ | 14:40 |
| sshnaidm | rlandy, yeah, it could be next step | 14:40 |
| rlandy | sshnaidm:do fs053 would be included then | 14:40 |
| rlandy | so | 14:40 |
| ssbarnea_ | https://review.openstack.org/#/c/608589/ failed again, with more failures after recheck... | 14:41 |
| sshnaidm | weshay, no community meeting today? | 14:49 |
| weshay | https://bluejeans.com/u/whayutin/ | 14:49 |
| weshay | sorry.. folco did not give me the moderator code | 14:50 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container- (2 more messages) | 14:53 |
| ssbarnea_ | sshnaidm: should we just recheck https://review.openstack.org/#/c/608589/ ? | 14:54 |
| weshay | ssbarnea_, https://bugs.launchpad.net/tripleo/+bug/1796764 | 14:55 |
| openstack | Launchpad bug 1796764 in tripleo "undercloud install failing for containers-multinode in the gate "OperationalError: (sqlite3.OperationalError) database is locked "" [Critical,Triaged] | 14:55 |
| weshay | ooops | 14:55 |
| weshay | sshnaidm, https://bugs.launchpad.net/tripleo/+bug/1796764 | 14:55 |
| *** hamzy has quit IRC | 14:57 | |
| rlandy | bogdando: hi ... wrt https://review.openstack.org/#/c/602734/5/roles/container-prep/tasks/main.yml ... does my response resolve your objection? | 14:58 |
| rlandy | looking at http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/release/rhos-14.yml#n65 | 14:59 |
| rlandy | I don;t see where else get_build_command is used | 14:59 |
| bogdando | rlandy: makes sense thanks | 15:00 |
| weshay | sshnaidm, http://logs.openstack.org/50/604750/3/gate/tripleo-ci-centos-7-containers-multinode/4405b2b/logs/undercloud/etc/ansible/ansible.cfg.txt.gz | 15:00 |
| *** hamzy has joined #oooq | 15:01 | |
| *** jbadiapa has quit IRC | 15:02 | |
| rlandy | marios: I responded to your question on https://review.openstack.org/#/c/602734/ - you comfortable with that now? | 15:05 |
| *** skramaja has quit IRC | 15:05 | |
| *** fhubik|brb has left #oooq | 15:06 | |
| rlandy | weshay: pls core vote on this ... https://review.openstack.org/#/c/602734/ - required for rhos-13/14 | 15:22 |
| weshay | arxcruz, can you help out kopecmartin|ruck w/ the reproducer scripts please | 15:26 |
| arxcruz | weshay: sure | 15:26 |
| *** jfrancoa has quit IRC | 15:27 | |
| weshay | thanks | 15:27 |
| sshnaidm | agopi, rlandy, quiquell|off please review final version: https://review.rdoproject.org/r/#/c/16872/ | 15:28 |
| sshnaidm | rlandy, agopi do we need to run fs053 on oooq repo? or only on extras | 15:33 |
| marios | ack rlandy revoted | 15:34 |
| rlandy | sshnaidm:probably just extras except for the fs, nodes configs stuff related to that test | 15:34 |
| rlandy | marios: thank you | 15:34 |
| sshnaidm | rlandy, ok, let's change it in followup patch.. | 15:35 |
| agopi | looks good sshnaidm i just triggered to make sure it's working :) and i see tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053 in queue for https://review.openstack.org/#/c/608692/ | 15:36 |
| sshnaidm | agopi, ack | 15:36 |
| rlandy | sshnaidm: left a suggestion on naming - can remove -1 if urgent | 15:37 |
| agopi | sshnaidm, rlandy i fs053 is running on both oooq and extras currently :) | 15:38 |
| agopi | and sshnaidm's patch didn't change it from what i saw | 15:38 |
| *** Goneri has joined #oooq | 15:39 | |
| *** Goneri has quit IRC | 15:41 | |
| *** hamzy has quit IRC | 15:50 | |
| * marios out ttyl folks | 15:54 | |
| sshnaidm | rlandy, is it ok now? https://review.rdoproject.org/r/#/c/16872/ | 15:56 |
| rlandy | weshay: https://code.engineering.redhat.com/gerrit/#/c/152304/ - please | 15:58 |
| rlandy | sshnaidm: one question in https://review.rdoproject.org/r/#/c/16872 - pls see - otherwise I'll +2 | 16:01 |
| sshnaidm | rlandy, it depends, in browbeat repo it will run for all changes, in other repos - for all, excluding "irrelevant" | 16:02 |
| rlandy | sshnaidm: fine - accept that | 16:02 |
| sshnaidm | rlandy, I thought we need to run it always there | 16:02 |
| rlandy | sshnaidm: we do +2 | 16:02 |
| sshnaidm | rlandy, ok, now need to check that everything works as normal :) | 16:03 |
| * rlandy runs for cover | 16:03 | |
| weshay | rlandy, +2 | 16:06 |
| rlandy | now for the jobs | 16:07 |
| weshay | rdo jobs https://logs.rdoproject.org/88/605388/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/3289d2a/job-output.txt.gz#_2018-10-09_15_57_34_458498 | 16:14 |
| weshay | maybe sf was down for a minute? | 16:15 |
| weshay | happy bday rook :) | 16:22 |
| weshay | rlandy, when you have a minute, I'd like to sync for 5min | 16:23 |
| *** zul has quit IRC | 16:23 | |
| rlandy | weshay: sure | 16:23 |
| rlandy | weshay: whenever you are ready | 16:24 |
| weshay | k.. 3min | 16:25 |
| *** gkadam has quit IRC | 16:25 | |
| weshay | eek.. few more min | 16:27 |
| weshay | rlandy, sorry ready and in blue | 16:31 |
| *** panda has quit IRC | 16:34 | |
| *** panda has joined #oooq | 16:36 | |
| *** bogdando has quit IRC | 16:45 | |
| *** jbadiapa has joined #oooq | 16:47 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container- (2 more messages) | 16:53 |
| *** toure is now known as toure|biab | 16:58 | |
| *** dtantsur is now known as dtantsur|afk | 17:08 | |
| rook | weshay: thanks man | 17:11 |
| arxcruz | kopecmartin|ruck: weshay found the problem on reproduce script | 17:13 |
| *** vinaykns has quit IRC | 17:13 | |
| weshay | arxcruz, ah ya.. /me needs to get back to that | 17:14 |
| arxcruz | ansible is complaining because $NODES_FILE is empty, so it pass to ansible-playbook this for example: -e @/home/arxcruz/tmp/tripleo-quickstart/ | 17:14 |
| weshay | arxcruz, whats up | 17:14 |
| arxcruz | and ansible complains that it's a directory | 17:14 |
| arxcruz | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/create-reproducer-script/templates/reproducer-quickstart.sh.j2#L251 | 17:15 |
| arxcruz | if nodes_file variable is empty, it pass the -e @$WORKSPACE/tripleo-quickstart/ | 17:15 |
| arxcruz | and ansible complains that it's a directory | 17:15 |
| weshay | -e @/var/tmp/recreate/tripleo-quickstart/ | 17:16 |
| weshay | ya.. see that | 17:16 |
| *** trown is now known as trown|lunch | 17:19 | |
| *** zul has joined #oooq | 17:19 | |
| *** apetrich has quit IRC | 17:22 | |
| ssbarnea_ | what was the bugfix for gating_repo error? gating_repo.tar.gz: No such file or directory | 17:37 |
| ssbarnea_ | kopecmartin|ruck marios ^^ ? | 17:37 |
| *** toure|biab is now known as toure | 17:41 | |
| *** amoralej is now known as amoralej|off | 17:49 | |
| arxcruz | weshay: so, removing that line, the script continues | 17:53 |
| arxcruz | weshay: i'll ping kopecmartin|ruck tomorrow if he didn't saw these messages | 17:53 |
| kopecmartin|ruck | ssbarnea_, sorry, i don't know, I went through ruckrover etherpad and i don't see anything similar, we should ask marios tomorrow | 17:57 |
| kopecmartin|ruck | arxcruz, weshay I'm here, i was preparing dinner | 17:57 |
| * kopecmartin|ruck reading back | 17:57 | |
| *** gkadam has joined #oooq | 18:01 | |
| *** hamzy has joined #oooq | 18:05 | |
| rlandy | weshay: https://code.engineering.redhat.com/gerrit/152331 please check me - those jenkins file are a HUGE mess and it's been a while since I worked with them | 18:39 |
| rlandy | at some point, we need a mass clean up here | 18:39 |
| *** trown|lunch is now known as trown | 18:52 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container- (2 more messages) | 18:53 |
| ssbarnea_ | weshay : infra time | 19:02 |
| weshay | ssbarnea_, thanks.. dam that's late for u | 19:03 |
| *** hamzy_ has joined #oooq | 19:10 | |
| *** hamzy has quit IRC | 19:12 | |
| *** gkadam has quit IRC | 19:19 | |
| rlandy | rdo down? | 19:56 |
| *** hubbot1 has quit IRC | 19:57 | |
| *** gouthamr has quit IRC | 19:58 | |
| *** dmellado has quit IRC | 19:58 | |
| *** hamzy_ has quit IRC | 20:46 | |
| *** gouthamr has joined #oooq | 20:50 | |
| *** jfrancoa has joined #oooq | 20:52 | |
| *** dmellado has joined #oooq | 20:53 | |
| *** trown is now known as trown|outtypewww | 21:05 | |
| *** hubbot1 has joined #oooq | 21:05 | |
| weshay | rlandy, something keeps enabling all the gate jobs | 21:07 |
| weshay | on jenkins | 21:07 |
| weshay | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/ | 21:07 |
| weshay | rlandy, check the queue | 21:07 |
| * weshay clears it | 21:07 | |
| weshay | rlandy, can you sweep through the jjb and ensure all the gate jobs are disabled | 21:11 |
| *** jrist has joined #oooq | 21:14 | |
| *** jtomasek has quit IRC | 21:29 | |
| * rlandy looks | 21:42 | |
| rlandy | weshay: gate jobs as in ovb? | 21:44 |
| agopi | rlandy, weshay can either of you please invite me to the tripleo ci community meeting :) | 21:47 |
| agopi | thanks | 21:47 |
| rlandy | lol - not sure ho to - rfolco owns that meeting | 21:49 |
| rlandy | agopi: pls check - i sent an invite | 21:50 |
| agopi | got it rlandy thanks :) | 21:50 |
| rlandy | weshay: https://softwarefactory-project.io/r/#/c/13210/ - already done | 22:01 |
| rlandy | ha-utils already in sf | 22:02 |
| *** panda has quit IRC | 22:37 | |
| *** panda has joined #oooq | 22:39 | |
| *** jfrancoa has quit IRC | 22:52 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb- (2 more messages) | 22:54 |
| rlandy | sshnaidm: stilll around? | 23:13 |
| sshnaidm | rlandy, kinda | 23:13 |
| rlandy | sshnaidm: quick question ... | 23:13 |
| rlandy | why are there two ob definitions for 053 in https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/ovb-jobs.yaml? | 23:14 |
| rlandy | one with master and one w/o? | 23:14 |
| sshnaidm | rlandy, with "-master" is legacy and I remove it in cleanup patches: https://review.rdoproject.org/r/#/c/16876/ | 23:15 |
| *** tosky has quit IRC | 23:21 | |
| *** sshnaidm is now known as sshnaidm|afk | 23:32 | |
| *** agopi is now known as agopi|brb | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!