| *** bhagyashris has joined #oooq | 01:13 | |
| *** fmount has quit IRC | 01:58 | |
| *** fmount has joined #oooq | 01:59 | |
| *** rlandy|rover|bbl is now known as rlandy|rover | 02:15 | |
| *** rlandy|rover has quit IRC | 02:18 | |
| *** dsneddon has quit IRC | 03:25 | |
| *** rfolco has quit IRC | 03:27 | |
| *** gkadam has joined #oooq | 03:39 | |
| *** gkadam has quit IRC | 03:40 | |
| *** skramaja has joined #oooq | 03:42 | |
| *** dsneddon has joined #oooq | 03:44 | |
| *** raukadah is now known as chkumar|ruck | 04:03 | |
| *** ykarel has joined #oooq | 04:04 | |
| *** surpatil has joined #oooq | 04:14 | |
| *** ykarel is now known as ykarel|afk | 05:05 | |
| *** ykarel|afk has quit IRC | 05:10 | |
| *** jaosorior has quit IRC | 05:24 | |
| *** ykarel|afk has joined #oooq | 05:27 | |
| *** ykarel|afk is now known as ykarel | 05:29 | |
| *** gkadam has joined #oooq | 05:30 | |
| *** jfrancoa has joined #oooq | 05:31 | |
| *** udesale has joined #oooq | 05:33 | |
| *** ratailor has joined #oooq | 05:36 | |
| *** dsneddon has quit IRC | 05:36 | |
| *** surpatil has quit IRC | 05:37 | |
| chkumar|ruck | sshnaidm: Hello | 05:39 |
|---|---|---|
| chkumar|ruck | sshnaidm: please have a look at this issue https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/bdea4fa/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-08-12_16_46_35 | 05:39 |
| *** surpatil has joined #oooq | 05:41 | |
| *** dsneddon has joined #oooq | 05:56 | |
| *** marios has joined #oooq | 06:00 | |
| *** dsneddon has quit IRC | 06:01 | |
| *** surpatil has quit IRC | 06:05 | |
| *** jtomasek has joined #oooq | 06:26 | |
| *** dsneddon has joined #oooq | 06:30 | |
| *** surpatil has joined #oooq | 06:41 | |
| chkumar|ruck | marios: Good morning | 06:50 |
| chkumar|ruck | marios: https://review.opendev.org/#/c/675888/ please have a look when free, | 06:50 |
| marios | chkumar|ruck: ok | 06:53 |
| *** bogdando has joined #oooq | 07:09 | |
| *** surpatil has quit IRC | 07:10 | |
| *** surpatil has joined #oooq | 07:10 | |
| *** pierreprinetti has joined #oooq | 07:12 | |
| *** tesseract has joined #oooq | 07:17 | |
| *** ykarel is now known as ykarel|lunch | 07:25 | |
| *** saneax has joined #oooq | 07:27 | |
| *** d0ugal has joined #oooq | 07:27 | |
| *** pierreprinetti has quit IRC | 07:28 | |
| *** pierreprinetti has joined #oooq | 07:28 | |
| *** kopecmartin|off is now known as kopecmartin | 07:29 | |
| *** amoralej|off is now known as amoralej | 07:31 | |
| *** dtantsur|afk is now known as dtantsur | 07:32 | |
| *** tosky has joined #oooq | 07:37 | |
| *** jpena|off is now known as jpena | 07:39 | |
| *** Goneri has joined #oooq | 07:46 | |
| *** ccamacho has joined #oooq | 08:03 | |
| *** ccamacho has quit IRC | 08:03 | |
| *** ccamacho has joined #oooq | 08:03 | |
| *** yolanda has quit IRC | 08:07 | |
| *** soniya29 has joined #oooq | 08:21 | |
| *** derekh has joined #oooq | 08:24 | |
| *** jaosorior has joined #oooq | 08:26 | |
| *** ykarel|lunch is now known as ykarel | 08:31 | |
| chkumar|ruck | sshnaidm: please have a look https://github.com/sshnaidm/sova/pulls to fic sova alert jobs | 08:41 |
| *** pierreprinetti has quit IRC | 08:48 | |
| sshnaidm | chkumar|ruck, hi | 09:08 |
| *** dsneddon has quit IRC | 09:08 | |
| sshnaidm | chkumar|ruck, I'm aware of this issue, you can ignore it | 09:08 |
| *** ccamacho has quit IRC | 09:11 | |
| chkumar|ruck | sshnaidm: ack, thanks! | 09:11 |
| sshnaidm | chkumar|ruck, merging this https://review.rdoproject.org/r/#/c/21813/ | 09:12 |
| chkumar|ruck | sshnaidm: ack | 09:12 |
| *** suraj_ has joined #oooq | 09:18 | |
| *** suraj_ has quit IRC | 09:19 | |
| *** suraj_ has joined #oooq | 09:20 | |
| *** surpatil has quit IRC | 09:21 | |
| *** dsneddon has joined #oooq | 09:30 | |
| *** dsneddon has quit IRC | 09:35 | |
| *** suraj_ has quit IRC | 09:45 | |
| marios | arxcruz: looks like anchors are OK ... and we are going to use both inheritance and anchors... inheritance for the periodics, but anchors for the check https://review.rdoproject.org/r/#/c/21787/3/zuul.d/standalone-jobs.yaml | 09:54 |
| arxcruz | marios: okay, i'm having double feelings but i think it's fine | 09:57 |
| marios | arxcruz: yeah well if you have better suggestions (or anyone else) i'm up for it. problem is they have separate inheritance paths (the periodic vs the check) | 09:58 |
| arxcruz | yeah, you right... | 09:58 |
| marios | arxcruz: anyway grateful if you have comments, going to add the rest of them scens 2/4 check on next pass thanks for looking | 09:59 |
| arxcruz | np, thanks to you, i learn a lot :) | 10:00 |
| *** sshnaidm has quit IRC | 10:04 | |
| marios | arxcruz: thanks man... fwiw same for me i learn a lot on code reviews | 10:04 |
| marios | arxcruz: like i often find some new ansible or python thing i don't understand then i have to go learn about it | 10:05 |
| arxcruz | :) | 10:06 |
| *** sshnaidm has joined #oooq | 10:08 | |
| *** dsneddon has joined #oooq | 10:09 | |
| *** suraj_ has joined #oooq | 10:16 | |
| sshnaidm | marios, commented https://review.opendev.org/#/c/675868/ | 10:18 |
| marios | sshnaidm: ack thanks for confirm | 10:21 |
| *** bhagyashris has quit IRC | 10:31 | |
| *** suraj__ has joined #oooq | 10:33 | |
| *** suraj_ has quit IRC | 10:36 | |
| chkumar|ruck | sshnaidm: log urls now got changes in gerrit from today right now | 10:40 |
| chkumar|ruck | we need to make changes in sova and rrcockpit for the same | 10:40 |
| * marios food biab | 10:44 | |
| *** marios has quit IRC | 10:44 | |
| sshnaidm | chkumar|ruck, ack.. | 10:47 |
| sshnaidm | chkumar|ruck, do you have example? | 10:48 |
| chkumar|ruck | sshnaidm: https://review.opendev.org/#/c/675859/ | 10:49 |
| chkumar|ruck | check queue | 10:49 |
| *** ykarel is now known as ykarel|afk | 10:49 | |
| *** suraj_ has joined #oooq | 10:50 | |
| chkumar|ruck | Does this page works for anyone http://cistatus.tripleo.org/gates/ I mean just below success is there anything visible? | 10:52 |
| *** suraj__ has quit IRC | 10:52 | |
| jfrancoa | sshnaidm: hey Sagi, when you have a moment, could you please send me the logs of any of the rhel8 upstream 3rd party jobs, please? I would like to learn a little about it to create one for minor updates | 10:55 |
| sshnaidm | jfrancoa, I think we have them still failing' | 10:55 |
| sshnaidm | jfrancoa, like that: https://review.rdoproject.org/zuul/build/608a8bd88cd7487c9a129386528568f0 | 10:56 |
| jfrancoa | sshnaidm: thanks a lot, even though if it fails..I would like to see the logs, job definition, etc...at least to plan how could we make a full updates job | 10:56 |
| sshnaidm | jfrancoa, ok, definition of it: https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/standalone-jobs.yaml#L282 | 10:57 |
| jfrancoa | sshnaidm: cool, I think I have enough with this to start with. thank you very much | 10:59 |
| *** udesale has quit IRC | 11:03 | |
| *** jaosorior has quit IRC | 11:04 | |
| *** dsneddon has quit IRC | 11:13 | |
| *** suraj_ has quit IRC | 11:13 | |
| *** Goneri has quit IRC | 11:14 | |
| *** jpena is now known as jpena|lunch | 11:25 | |
| *** amoralej is now known as amoralej|lunch | 11:28 | |
| *** pierreprinetti has joined #oooq | 11:29 | |
| *** soniya29 has quit IRC | 11:33 | |
| *** soniya29 has joined #oooq | 11:38 | |
| *** dsneddon has joined #oooq | 11:44 | |
| *** Goneri has joined #oooq | 11:52 | |
| *** marios has joined #oooq | 11:57 | |
| *** soniya29 has quit IRC | 11:59 | |
| arxcruz | marios: so i'm thinking here, when we upgrade zuul, we still need to set the ansible version to 2.8, as it is right now, we would set to all the standalone jobs, not sure if that's what we want... | 12:02 |
| arxcruz | maybe yes | 12:02 |
| marios | arxcruz: you mean, we won't have to set the host vars anymore? | 12:09 |
| marios | arxcruz: or something else | 12:09 |
| marios | arxcruz: or wondering if we want to keep some jobs on 2.7 | 12:10 |
| arxcruz | marios: with ansible 2.8 we won't need to set the ansible_python_interpreter for rhel8 | 12:10 |
| arxcruz | marios: we can move everything to 2.8, i don't mind, but not sure how many bugs we will trigger | 12:10 |
| *** aakarsh has quit IRC | 12:18 | |
| marios | arxcruz: ack i mean do we have task is that something you're pushing this sprint? maybe bring it up on the next scrum, maybe worth considering leaving some jobs on 2.7... not clear to me what the benefit is yet | 12:18 |
| arxcruz | marios: i believe the goal is move to 2.8 at least on rdo side | 12:19 |
| arxcruz | so yeah, let's see what's going to happen :) | 12:19 |
| arxcruz | i already submit a ticket to rdo upgrade zuul to support 2.8 | 12:20 |
| *** jpena|lunch is now known as jpena | 12:22 | |
| *** rfolco has joined #oooq | 12:26 | |
| *** rlandy has joined #oooq | 12:37 | |
| *** rlandy is now known as rlandy|rover | 12:38 | |
| rlandy|rover | chkumar|ruck: hi | 12:40 |
| chkumar|ruck | rlandy|rover: Hello | 12:41 |
| rlandy|rover | chkumar|ruck: going to put in a support ticket to get rid of failed stacks | 12:41 |
| chkumar|ruck | rlandy|rover: yes sure | 12:41 |
| rlandy|rover | I couldn't get rid of them yesterday | 12:41 |
| rlandy|rover | by regular means :) | 12:41 |
| chkumar|ruck | rlandy|rover: post_failure is now getting taken care by prod chain team | 12:41 |
| rlandy|rover | chkumar|ruck: great | 12:41 |
| rlandy|rover | that is hitting us badly today | 12:42 |
| rlandy|rover | and gate failures :( | 12:42 |
| *** amoralej|lunch is now known as amoralej | 12:46 | |
| *** jaosorior has joined #oooq | 12:47 | |
| *** ratailor has quit IRC | 12:51 | |
| *** ykarel|afk is now known as ykarel | 12:51 | |
| rlandy|rover | zbr|flu: re: gate failures, we have added the two elastic-recheck queries, is there anything else we can do, infra-wise, to improve this situation? | 12:53 |
| rlandy|rover | we're sitting on 20+ gate failures | 12:53 |
| rlandy|rover | chkumar|ruck: ^^ | 12:53 |
| *** dsneddon has quit IRC | 12:55 | |
| panda | rfolco: pingpingpingpingping pachinko style | 12:58 |
| rfolco | panda, hi | 13:02 |
| panda | rfolco: hey, I saw your manifest notes on the card, nice. | 13:02 |
| panda | rfolco: did you try the pull test ? | 13:03 |
| rfolco | panda, yes, the idea is to create the test cases for it in the jo | 13:03 |
| rfolco | job | 13:03 |
| panda | rfolco: if youi pull a manifest, are you pulling the x64 image automatically in a x86 ? | 13:03 |
| rfolco | panda, pull works from both ppc and x86 | 13:03 |
| rfolco | panda, yes sir | 13:03 |
| panda | rfolco: you had a ppc arch to test the pull ? | 13:04 |
| rfolco | panda, of course. | 13:04 |
| panda | rfolco: also, do you have an idea now which file we need to touch to implement the multi arch | 13:04 |
| rfolco | panda, for rdo, mjturek is doing at the build containers role. | 13:05 |
| rfolco | panda, for docker.io, dlrn promoter | 13:05 |
| rfolco | panda, am I right? | 13:05 |
| panda | rfolco: yes but only the ansible part of the process I suppose | 13:07 |
| panda | rfolco: that's what I'm trying to be sure of, because if we are making the staging environment and multiarch at the same time, we may step on each other | 13:07 |
| rfolco | panda, I imagine we have to add a new task, not change the current workflow. | 13:08 |
| rfolco | panda, task or role | 13:08 |
| panda | rfolco: adding a task is changing the workflow a bit | 13:10 |
| rfolco | panda, of course not. Just add a role and not use it. | 13:10 |
| rfolco | call it from staging env only | 13:10 |
| panda | rfolco: in the staging environment spec, for example, line 86 | 13:10 |
| panda | rfolco: we need to parametrize the static list of containers we push, to inject a fake one | 13:11 |
| panda | rfolco: we'll change that part at least for the staging environment | 13:11 |
| panda | rfolco: even if you add a new role ... well we can discuss at the community meeting or in private | 13:11 |
| *** ade_lee__ has quit IRC | 13:12 | |
| chkumar|ruck | rlandy|rover: No idea, what we can do there, we have some timed out also | 13:12 |
| rlandy|rover | chkumar|ruck: yeah ... zbr|flu has some infra connections - so was just pinging him | 13:13 |
| rlandy|rover | reporting is one thing | 13:13 |
| rlandy|rover | but this can't just carry on | 13:13 |
| rfolco | panda, line 86 says | 13:14 |
| rfolco | - run the container pull/push in | 13:14 |
| rfolco | ci-config/containers-push/containers-push.yaml | 13:14 |
| rfolco | panda, I still think we can test it on a separate path/workflow | 13:15 |
| rfolco | panda, perhaps you can show us in the community mtg what conflicts you see between staging and production | 13:15 |
| rlandy|rover | chkumar|ruck: we're headlining here http://status.openstack.org/elastic-recheck/ :( | 13:15 |
| rlandy|rover | 3 and 8 | 13:16 |
| rfolco | making more coffee | 13:16 |
| *** aakarsh has joined #oooq | 13:16 | |
| rlandy|rover | maybe will bring it up in the community meeting | 13:16 |
| rlandy|rover | chkumar|ruck: we could raise it and a known issue in the tripleo meeting | 13:16 |
| rlandy|rover | we probably should | 13:16 |
| rlandy|rover | say we rae tracking it | 13:16 |
| rlandy|rover | contacting infra? | 13:17 |
| *** gkadam has quit IRC | 13:17 | |
| panda | rfolco: joining now your BJ | 13:19 |
| rlandy|rover | chkumar|ruck: any reason this isn't w+? https://review.rdoproject.org/r/#/c/21821/ | 13:24 |
| rlandy|rover | will W it | 13:24 |
| sshnaidm | rlandy|rover, seems like log server in rdo makes problems again | 13:24 |
| sshnaidm | jpena, ^^ | 13:24 |
| sshnaidm | it takes 20-30 mins to upload logs | 13:25 |
| rlandy|rover | sshnaidm: we may as well w+ the patch though | 13:25 |
| chkumar|ruck | sshnaidm: they are working on the log server by increading timedout | 13:25 |
| chkumar|ruck | rlandy|rover: +w it | 13:25 |
| sshnaidm | chkumar|ruck, interesting solution.. | 13:25 |
| rlandy|rover | done | 13:25 |
| rlandy|rover | that should be a temp solution | 13:25 |
| *** Vorrtex has joined #oooq | 13:26 | |
| rlandy|rover | we need a more permanent fix | 13:26 |
| *** vinaykns has joined #oooq | 13:26 | |
| rlandy|rover | chkumar|ruck: let | 13:26 |
| rlandy|rover | s join the community meeting | 13:26 |
| rlandy|rover | to discuss gate | 13:26 |
| chkumar|ruck | rlandy|rover: https://tree.taiga.io/project/morucci-software-factory/issue/2737 | 13:26 |
| *** udesale has joined #oooq | 13:30 | |
| rfolco | community mtg now | 13:31 |
| rfolco | https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 13:31 |
| rfolco | at https://bluejeans.com/5878458097 | 13:31 |
| rfolco | sshnaidm, arxcruz ping community mtg | 13:32 |
| chkumar|ruck | rlandy|rover: added here https://etherpad.openstack.org/p/tripleo-meeting-items | 13:41 |
| rlandy|rover | chkumar|ruck: thanks | 13:42 |
| *** ade_lee__ has joined #oooq | 13:47 | |
| *** ykarel is now known as ykarel|away | 14:00 | |
| ykarel|away | rlandy|rover, can u also bring pike plan in TripleO meeting, i need to leave now, wrt. my comment https://review.rdoproject.org/r/#/c/21165/ | 14:02 |
| ykarel|away | also would be better if any conclusion is posted to mailing list | 14:03 |
| rlandy|rover | ykarel|away: chkumar|ruck raised it in the etherpad | 14:03 |
| ykarel|away | rlandy|rover, Okk good, btw which etherpad? | 14:03 |
| rlandy|rover | ykarel|away: https://etherpad.openstack.org/p/tripleo-meeting-items | 14:04 |
| rlandy|rover | top of the page | 14:04 |
| ykarel|away | rlandy|rover, okk Thanks | 14:05 |
| ykarel|away | Thanks chkumar|ruck | 14:06 |
| * ykarel|away out | 14:06 | |
| *** dsneddon has joined #oooq | 14:08 | |
| *** dsneddon has quit IRC | 14:14 | |
| *** jaosorior has quit IRC | 14:15 | |
| *** ykarel|away has quit IRC | 14:25 | |
| chkumar|ruck | rlandy|rover: want to sync? | 14:31 |
| rlandy|rover | chkumar|ruck: k | 14:31 |
| chkumar|ruck | rlandy|rover: https://bluejeans.com/1571313919 | 14:32 |
| *** pierreprinetti has quit IRC | 14:38 | |
| sshnaidm | chkumar|ruck, commented on prev patch: https://review.opendev.org/#/c/675563/ | 14:42 |
| *** dsneddon has joined #oooq | 14:44 | |
| *** skramaja has quit IRC | 14:48 | |
| chkumar|ruck | sshnaidm: will take a look | 14:56 |
| chkumar|ruck | see ya tomorrow | 14:57 |
| *** chkumar|ruck is now known as raukadah | 14:57 | |
| rlandy|rover | raukadah: https://review.opendev.org/676214 Increase retries to get dlrn repo in emit_releases file | 15:10 |
| *** bogdando has quit IRC | 15:26 | |
| *** ykarel|away has joined #oooq | 15:30 | |
| *** jschluet is now known as jschlueter | 15:30 | |
| *** jbadiapa has joined #oooq | 15:35 | |
| rfolco | panda, what I told you about pulling the image is not true. I removed the --experimental flag and I am still able to pull images from different arch | 15:36 |
| panda | rfolco: you liar | 15:36 |
| rfolco | panda, :( | 15:36 |
| panda | rfolco: so what's that error that you saw ? | 15:38 |
| rfolco | panda, weird, I took notes on that issue at https://tree.taiga.io/project/tripleo-ci-board/task/1243?kanban-status=1447277 | 15:39 |
| rfolco | panda, trying to reproduce it somehow | 15:39 |
| *** Goneri has quit IRC | 15:39 | |
| panda | rfolco: good | 15:39 |
| rfolco | aah | 15:52 |
| rfolco | panda, | 15:52 |
| rfolco | docker pull ppc64le/hello-world | 15:52 |
| *** dsneddon has quit IRC | 15:52 | |
| rfolco | this ^ | 15:52 |
| panda | no matching manifest for unknown in the manifest list entries | 15:53 |
| rfolco | panda, then I pushed back to my namespace and it does not hit the issue | 15:53 |
| rfolco | sudo docker pull rfolco/hello-world:cc26d47faedf3643237cfb494d001d1add50267c_ppc64le | 15:53 |
| rfolco | same image, pushed to my namespace ^ | 15:54 |
| *** jfrancoa has quit IRC | 15:54 | |
| panda | rfolco: rfolco/hello-world:cc26d47faedf3643237cfb494d001d1add50267c_ppc64le is a manifest or an image | 15:56 |
| panda | ? | 15:56 |
| *** jpena is now known as jpena|off | 15:58 | |
| panda | rfolco: that's an image, not a manifest | 15:59 |
| panda | rfolco: rfolco/hello-world:cc26d47faedf3643237cfb494d001d1add50267c is the manifest | 15:59 |
| panda | rfolco: and contains both architectures | 16:00 |
| *** marios is now known as marios|out | 16:01 | |
| rfolco | panda, rfolco/hello-world:cc26d47faedf3643237cfb494d001d1add50267c_ppc64le is an image | 16:03 |
| rfolco | aaah | 16:03 |
| rfolco | are you saying ppc64le/hello-world is a manifest ? | 16:03 |
| rfolco | checking | 16:03 |
| panda | rfolco: yes it is | 16:04 |
| panda | rfolco: and it contains only ppc | 16:04 |
| rfolco | ok explained then | 16:04 |
| panda | rfolco: so it's saying "no match for you arch" | 16:04 |
| panda | rfolco: so if you want to doenload the ppc image you have to specify it explicitly | 16:04 |
| rfolco | panda, yep makes sense | 16:04 |
| rfolco | and it works | 16:04 |
| rfolco | ok | 16:05 |
| rfolco | panda, sorry for the confusion. explained. I'll update the task with this to avoid any confusion. | 16:05 |
| rlandy|rover | sshnaidm: we've got a lot of fs039 failures | 16:05 |
| panda | rfolco: you have to specify the digest docker pull ppc64le/hello-world@sha256:12cf9ef90835465316cb0b3729c36bfd8654d7f2f697e23432fddfaa7d7e31b5 | 16:05 |
| sshnaidm | rlandy|rover, link? | 16:05 |
| rlandy|rover | related to the patch you had yesterday to change the dns? | 16:05 |
| panda | rlandy|rover: and it will download the ppc | 16:05 |
| rlandy|rover | ogs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master/0ca9bf2/job-output.txt.gz | 16:06 |
| rfolco | panda, ok not sure we'll need negative tests like that | 16:06 |
| sshnaidm | rlandy|rover, patch is still on review: https://review.rdoproject.org/r/#/c/21665/ | 16:06 |
| rlandy|rover | sshnaidm: k - can merge it and try | 16:06 |
| rlandy|rover | sshnaidm: hmm - will that break ovb running downstream - if there are still jobs there? | 16:07 |
| sshnaidm | rlandy|rover, it's not related, but will help to remove trash from tenant faster | 16:07 |
| rlandy|rover | sshnaidm: merging - let's try it | 16:08 |
| sshnaidm | rlandy|rover, it shouldn't affect anything, hopefully | 16:08 |
| * rlandy|rover loves the 'hopefully' | 16:08 | |
| sshnaidm | rlandy|rover, in your link it's problems with introspection: http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master/0ca9bf2/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz | 16:08 |
| sshnaidm | rlandy|rover, seems like related to OVB in general | 16:08 |
| sshnaidm | rlandy|rover, trying to think positive! :D | 16:09 |
| sshnaidm | rlandy|rover, maybe it's worth to reduce a little bit max_stacks for rdo cloud.. seems like it can't handle big load | 16:10 |
| rlandy|rover | sshnaidm: thinking positive is not a natural trait for me | 16:10 |
| sshnaidm | rlandy|rover, as for any ruck/rover | 16:11 |
| * rlandy|rover looks for max-stacks | 16:11 | |
| rlandy|rover | sshnaidm: ^^ link? | 16:12 |
| *** dsneddon has joined #oooq | 16:13 | |
| sshnaidm | rlandy|rover, lemme look.. | 16:13 |
| rlandy|rover | software factory somewhere ... | 16:13 |
| sshnaidm | rlandy|rover, don't find it.. asking on #sf-ops | 16:17 |
| *** dsneddon has quit IRC | 16:17 | |
| sshnaidm | rlandy|rover, and we have 12 stacks failed to delete.. | 16:19 |
| rlandy|rover | sshnaidm: ack ... ticket to request admins to delete them: https://tickets.osci.io/rt/Ticket/Display.html?id=1975 | 16:19 |
| zbr|flu | fyi: i am alive, but managed to open the computer only two minutes ago, probably i will be back in bed very soon. | 16:19 |
| rlandy|rover | sshnaidm: maybe kforde is out | 16:20 |
| rlandy|rover | been pinging him for two days | 16:20 |
| sshnaidm | rlandy|rover, oops, it's max-servers | 16:20 |
| rlandy|rover | alhernan is afk | 16:20 |
| sshnaidm | nodepool/rdo-cloud.yaml in sf-config | 16:21 |
| rlandy|rover | thanks | 16:21 |
| sshnaidm | rlandy|rover, https://softwarefactory-project.io/r/16030 | 16:22 |
| sshnaidm | rlandy|rover, and max_stacks it's configuration on rhops side of rdo-cloud, confused between all these limits | 16:24 |
| rlandy|rover | sshnaidm: https://softwarefactory-project.io/r/#/c/16030/1/nodepool/rdo-cloud.yaml | 16:24 |
| rlandy|rover | ^^ don;t think that's enough of a reduction | 16:25 |
| rlandy|rover | and I am not sure it's the right setting | 16:25 |
| rlandy|rover | I think it is stacks | 16:25 |
| sshnaidm | rlandy|rover, feel free to change it | 16:25 |
| rlandy|rover | it's on our tenent | 16:25 |
| sshnaidm | rlandy|rover, well, max servers adjusts overall servers for job, some of these servers start ovb stacks | 16:25 |
| rlandy|rover | correct | 16:26 |
| sshnaidm | rlandy|rover, maybe problem is that we run too much rdo jobs.. for example rhel8 standalone that anyway always fails | 16:27 |
| rlandy|rover | sshnaidm: I think we run way too many jobs | 16:27 |
| rlandy|rover | if I had my way, we would run JUST fs001 | 16:27 |
| *** dsneddon has joined #oooq | 16:27 | |
| rlandy|rover | until it was stable | 16:27 |
| rlandy|rover | then add jobs until we hit unstable | 16:27 |
| rlandy|rover | imho less that we trust is better | 16:28 |
| rlandy|rover | this is a waste of time | 16:28 |
| rlandy|rover | nobody even cares | 16:28 |
| rlandy|rover | rhel-8 is diff because it's under dev | 16:28 |
| sshnaidm | rlandy|rover, maybe, I don't know if we need 053 at all | 16:28 |
| *** amoralej is now known as amoralej|off | 16:29 | |
| sshnaidm | rlandy|rover, I think we can limit rhel8 to tripleo-ci only or kind of | 16:29 |
| rlandy|rover | when weshay gets back I am going to siggest we scale down | 16:29 |
| *** dtantsur is now known as dtantsur|afk | 16:29 | |
| rlandy|rover | ugh - so many issues atm | 16:29 |
| *** marios|out has quit IRC | 16:29 | |
| sshnaidm | rlandy|rover, I'll handle rhel8 reducing.. | 16:29 |
| rlandy|rover | sshnaidm: k - | 16:29 |
| rlandy|rover | because I guess that's also sprint team | 16:30 |
| rlandy|rover | let's leave stacks for the moment | 16:30 |
| rlandy|rover | biab - lunch | 16:30 |
| *** ykarel|away has quit IRC | 16:33 | |
| *** dsneddon has quit IRC | 16:35 | |
| *** udesale has quit IRC | 16:43 | |
| *** tesseract has quit IRC | 16:43 | |
| *** kopecmartin is now known as kopecmartin|off | 16:44 | |
| rlandy|rover | back | 16:54 |
| *** derekh has quit IRC | 17:00 | |
| rlandy|rover | sshnaidm: pls vote on https://review.opendev.org/#/c/676214/ | 17:11 |
| sshnaidm | rlandy|rover, +2 | 17:11 |
| *** jbadiapa has quit IRC | 17:12 | |
| sshnaidm | rlandy|rover, last ovb check jobs look not bad | 17:14 |
| rlandy|rover | sshnaidm: yep - was thinking the same | 17:14 |
| rlandy|rover | let's see if these changes help | 17:15 |
| rlandy|rover | thanks for your patches | 17:15 |
| rlandy|rover | failure rate is down from over 50% to the 40's | 17:15 |
| rlandy|rover | also increased log timeout helped | 17:15 |
| sshnaidm | rlandy|rover, yeah, cool | 17:16 |
| *** dsneddon has joined #oooq | 17:22 | |
| *** ykarel|away has joined #oooq | 17:38 | |
| sshnaidm | raukadah, why did you rebase https://review.opendev.org/#/c/675859 ? it was about to merge | 17:44 |
| raukadah | sshnaidm: nope, check was failing, so rebased | 17:45 |
| raukadah | oh no, sorry missed the last zuul comment | 17:45 |
| sshnaidm | raukadah, check passed, it went to gate: Patch Set 1: -Verified Starting gate jobs. | 17:45 |
| *** saneax has quit IRC | 17:54 | |
| *** hamzy has quit IRC | 17:54 | |
| rlandy|rover | with any luck master might promote | 18:13 |
| *** ykarel|away has quit IRC | 18:22 | |
| *** hamzy has joined #oooq | 18:30 | |
| *** hamzy has quit IRC | 18:51 | |
| *** hamzy has joined #oooq | 18:51 | |
| *** Vorrtex has quit IRC | 20:02 | |
| *** Vorrtex has joined #oooq | 20:02 | |
| *** Vorrtex has quit IRC | 20:06 | |
| *** ade_lee__ has quit IRC | 20:33 | |
| *** sshnaidm is now known as sshnaidm|afk | 20:46 | |
| *** jtomasek has quit IRC | 20:48 | |
| *** ade_lee__ has joined #oooq | 21:13 | |
| *** ade_lee__ has quit IRC | 21:37 | |
| *** ade_lee__ has joined #oooq | 21:37 | |
| *** hamzy has quit IRC | 21:58 | |
| *** tosky has quit IRC | 22:27 | |
| *** aakarsh has quit IRC | 22:42 | |
| *** vinaykns has quit IRC | 22:48 | |
| *** saneax has joined #oooq | 22:54 | |
| *** dtrainor has quit IRC | 23:30 | |
| *** dtrainor has joined #oooq | 23:32 | |
| *** rlandy|rover has quit IRC | 23:46 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!