| rlandy | expecting pike, queens to fail - need to backport the change | 00:00 |
|---|---|---|
| rlandy | back later to backport change and run again | 00:04 |
| *** rlandy is now known as rlandy|bbl | 00:04 | |
| *** tosky has quit IRC | 00:07 | |
| *** agopi|brb is now known as agopi | 00:56 | |
| *** thrash is now known as thrash|g0ne | 01:53 | |
| *** rlandy|bbl is now known as rlandy | 01:54 | |
| rlandy | ugh - rebase time | 01:54 |
| weshay | rlandy, is that osp-13 | 02:14 |
| weshay | OH | 02:15 |
| weshay | removal of lagacy playbook | 02:15 |
| rlandy | which part? | 03:12 |
| rlandy | multinode is legacy work finally moving along | 03:12 |
| *** rlandy has quit IRC | 03:13 | |
| *** skramaja has joined #oooq | 03:27 | |
| *** gkadam has joined #oooq | 03:31 | |
| *** jaganathan has quit IRC | 04:14 | |
| *** ykarel|away has joined #oooq | 04:17 | |
| *** ratailor has joined #oooq | 05:15 | |
| *** ykarel|away is now known as ykarel | 05:18 | |
| *** ykarel has quit IRC | 05:26 | |
| *** udesale has joined #oooq | 05:38 | |
| *** gkadam_ has joined #oooq | 05:41 | |
| *** gkadam has quit IRC | 05:43 | |
| *** ykarel has joined #oooq | 05:45 | |
| *** gkadam__ has joined #oooq | 05:45 | |
| *** quiquell has joined #oooq | 05:46 | |
| quiquell | chandankumar: good morning | 05:47 |
| *** gkadam_ has quit IRC | 05:47 | |
| chandankumar | quiquell: Good morning :-) | 05:51 |
| quiquell | What role do you want to do the first half ? | 05:56 |
| quiquell | ruck or rover ? | 05:56 |
| chandankumar | quiquell: ruck will be ok, in 2nd week we can switch the roles | 05:58 |
| quiquell | chandankumar: ack | 05:58 |
| *** quiquell is now known as quiquell|rover | 05:58 | |
| *** chandankumar is now known as chkumar|ruck | 05:58 | |
| *** marios|rover has quit IRC | 06:02 | |
| *** kopecmartin has joined #oooq | 06:08 | |
| *** udesale has quit IRC | 06:29 | |
| *** jtomasek has joined #oooq | 06:33 | |
| *** apetrich has quit IRC | 06:48 | |
| *** sshnaidm|off is now known as sshnaidm | 07:06 | |
| *** quiquell|rover has quit IRC | 07:06 | |
| *** quiquell has joined #oooq | 07:07 | |
| *** quiquell has quit IRC | 07:07 | |
| *** quiquell has joined #oooq | 07:12 | |
| *** quiquell has quit IRC | 07:13 | |
| *** quiquell has joined #oooq | 07:13 | |
| *** quiquell has quit IRC | 07:13 | |
| *** ccamacho has joined #oooq | 07:14 | |
| *** quiquell has joined #oooq | 07:14 | |
| *** quiquell has quit IRC | 07:14 | |
| *** quiquell has joined #oooq | 07:15 | |
| *** quiquell is now known as quiquell|rover | 07:16 | |
| *** jfrancoa has joined #oooq | 07:26 | |
| *** udesale has joined #oooq | 07:27 | |
| *** ssbarnea|bkp2 has quit IRC | 07:27 | |
| quiquell|rover | sshnaidm: Doing small changes at dashbaord-ci to reduce the notification noisce to RDO admins | 07:29 |
| quiquell|rover | sshnaidm: workflowing them | 07:29 |
| *** ssbarnea|bkp has joined #oooq | 07:40 | |
| *** tosky has joined #oooq | 07:41 | |
| *** holser_ has joined #oooq | 07:44 | |
| quiquell|rover | ssbarnea|bkp, marios: The last ruck rover etherpad is updated ? | 07:59 |
| marios | quiquell|rover: i was updating this one https://review.rdoproject.org/etherpad/p/ruckrover-sprint18 | 08:00 |
| marios | quiquell|rover: really the main issue last night was the bug on the queens scn 4 job at https://bugs.launchpad.net/tripleo/+bug/1790857 | 08:00 |
| openstack | Launchpad bug 1790857 in tripleo "Queens tripleo-ci-centos-7-scenario004-multinode-oooq-container failing tempest manila_tempest_tests.tests.api.test_shares.SharesCephFSTest " [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 08:00 |
| quiquell|rover | Let me know when you finish to create the new one whit the content | 08:00 |
| quiquell|rover | marios: ack | 08:01 |
| marios | quiquell|rover: all of the ones on the etherpad are crossed out/means fix committed so they should be good | 08:01 |
| marios | quiquell|rover: i think we will do a call with weshay later (he emailed us ) to do a status/handover | 08:02 |
| quiquell|rover | marios: So everything is at UPDATES FROM RUCK/ROVER SPRINT 18 ? | 08:02 |
| quiquell|rover | ok | 08:02 |
| marios | quiquell|rover: yeah but sec i have something which might help for now | 08:02 |
| quiquell|rover | marios: ok, just let me know when you finish | 08:02 |
| marios | quiquell|rover: where is the 'right place' i mean its teh first time i did ruck/rover | 08:03 |
| marios | quiquell|rover: should i add notes to there ? https://review.rdoproject.org/etherpad/p/ruckrover-sprint18 | 08:03 |
| quiquell|rover | marios: Let's do one thing, just add the an update from today here https://review.rdoproject.org/etherpad/p/ruckrover-sprint19 | 08:04 |
| quiquell|rover | So chkumar|ruck and I have the latest | 08:05 |
| quiquell|rover | Humm we don't have a noop change for rocky ? | 08:05 |
| quiquell|rover | sshnaidm: ^ ? | 08:05 |
| marios | quiquell|rover: does it help :) | 08:11 |
| marios | ? | 08:11 |
| marios | quiquell|rover: its just the main things i was looking at yesterday, as the 'main ongoing issues' | 08:11 |
| marios | quiquell|rover: only one of them is an actual bug in progress | 08:11 |
| marios | quiquell|rover: ssbarnea|bkp ^^^ please update too for any other stuff you were looking at (I think fs35 you were poking at yesterday too) | 08:12 |
| quiquell|rover | marios: Depends have different is main from rocky right now | 08:12 |
| quiquell|rover | marios: Thanks so much | 08:12 |
| marios | quiquell|rover: i have no idea how to parse that sentense | 08:12 |
| marios | 11:12 < quiquell|rover> marios: Depends have different is main from rocky right now | 08:12 |
| marios | what did he mean by this | 08:12 |
| quiquell|rover | I mean having a noop change to test rocky, only make sense if rocky is very different from master | 08:13 |
| marios | quiquell|rover: ack | 08:13 |
| *** ratailor_ has joined #oooq | 08:14 | |
| *** ratailor has quit IRC | 08:17 | |
| quiquell|rover | marios, ssbarnea|bkp: Any suggestion for the dashboard-ci now that you have finish your task ? | 08:24 |
| ssbarnea|bkp | quiquell|rover marios : i updated the ruckrover document yesterday, crossing all fixe dbugs. | 08:24 |
| quiquell|rover | ssbarnea|bkp: Can you look at the sprint19 to see if nothing is missing ? https://review.rdoproject.org/etherpad/p/ruckrover-sprint19 | 08:25 |
| ssbarnea|bkp | quiquell|rover : yep, its size grew too much and it puts Safari to its knees (100%cpu), better to start splitting it multiple boards, interlinked. | 08:25 |
| marios | quiquell|rover: i really like it so far but was only using the check/gate fails list and the % for now | 08:25 |
| *** dtantsur|afk is now known as dtantsur | 08:25 | |
| marios | quiquell|rover: super useful anyway | 08:26 |
| quiquell|rover | marios, ssbarnea|bkp: Any suggestion or idea can be added here https://trello.com/c/dyvGWJps/890-dashboards-maintenance?menu=filter&filter=label:Sprint%2017%20CI | 08:26 |
| ssbarnea|bkp | also found few links that go nowhere, which can be confusing. but overall the dashboard is AWESOME ! | 08:26 |
| quiquell|rover | cool | 08:26 |
| ssbarnea|bkp | i hope it will replace the other ones, by implementing their features. I like the idea of using grafana instead of creating a new product from zero. | 08:27 |
| ssbarnea|bkp | it should be easier to upgrade and maintain, i guess. | 08:27 |
| quiquell|rover | ssbarnea|bkp: If you have some free brain cycle, would nice to point it to the broken links in the trello card | 08:28 |
| sshnaidm | quiquell|rover, we don't, need to make rocky gate check | 08:28 |
| quiquell|rover | sshnaidm: Ok, going too, ok ? | 08:28 |
| sshnaidm | quiquell|rover, sure | 08:28 |
| quiquell|rover | sshnaidm: Similar to queens is good enoough ? or we need something new ? | 08:28 |
| ssbarnea|bkp | i don't right now, but be sure I will try in the future. having too many dashboards is not good. | 08:28 |
| quiquell|rover | ssbarnea|bkp: ack, thanks. | 08:29 |
| sshnaidm | quiquell|rover, is https://review.openstack.org/#/c/589448/ ready ot merge? | 08:29 |
| quiquell|rover | sshnaidm: Has just rebased it, let's wait for CI, but it shoudl be, also the WIP with Ronelle's rebase is working fine too | 08:29 |
| sshnaidm | quiquell|rover, ok.. let's try to merge it today | 08:30 |
| quiquell|rover | sshnaidm: Agree | 08:30 |
| quiquell|rover | marios: ^ we will need your core help to merge the bash to ansible commit | 08:31 |
| quiquell|rover | marios: To deliver it today | 08:31 |
| *** sshnaidm is now known as sshnaidm|afk | 08:31 | |
| *** udesale has quit IRC | 08:47 | |
| *** udesale has joined #oooq | 08:47 | |
| *** udesale has quit IRC | 08:48 | |
| *** udesale has joined #oooq | 08:48 | |
| *** d0ugal has joined #oooq | 08:49 | |
| chkumar|ruck | marios: quiquell|rover https://review.rdoproject.org/etherpad/p/ruckrover-sprint19 l18 tempest issue is fixed na? | 08:49 |
| quiquell|rover | sshnaidm|afk: hubbot has unregistered user, he is living at #openstack-unregistered now... :-/ | 08:50 |
| marios | chkumar|ruck: well queens @ tripleo-ci-centos-7-scenario004-multinode-oooq-container https://review.openstack.org/#/c/567224/100 still failed last time did it all merge already? | 08:51 |
| chkumar|ruck | marios: the fix got merged but not yet picked up this review | 08:52 |
| marios | manila_tempest_tests.tests.api.test_shares.SharesCephFSTest chkumar|ruck yeah | 08:52 |
| marios | chkumar|ruck: ^^ http://logs.openstack.org/24/567224/100/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/f225f42/job-output.txt.gz#_2018-09-06_02_14_08_185160 | 08:52 |
| chkumar|ruck | marios: i checked it from here http://logs.openstack.org/24/567224/100/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/f225f42/logs/undercloud/var/log/extra/rpm-list.txt.gz | 08:52 |
| marios | chkumar|ruck: so thats the one was watching anyway well find out on next run | 08:52 |
| marios | chkumar|ruck: ack | 08:53 |
| chkumar|ruck | quiquell|rover: please pass me the ruckrover dashboard link or better we can add it to channel topic | 08:55 |
| quiquell|rover | dashboard-ci.tripleo.org | 08:56 |
| quiquell|rover | chkumar|ruck: Cannot change the topic | 08:57 |
| quiquell|rover | I am not an operator | 08:57 |
| quiquell|rover | sshnaidm|afk: I have no rights to add rocky noop https://review.openstack.org/#/c/600387/ to hubbot | 09:00 |
| *** udesale has quit IRC | 09:16 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:16 | |
| sshnaidm | quiquell|rover, I'll look at it | 09:16 |
| quiquell|rover | sshnaidm: Have create the patch for rocky, it's a matter of add it at hubbot, it's living at #openstack-unregistered | 09:17 |
| quiquell|rover | sshnaidm: Also register the hubbot user, and add the logic to login | 09:17 |
| quiquell|rover | sshnaidm: But most important part is to register the Change-Id for rocky I9c40e97a9fbc850962605b2a46420e6c645d5c23 | 09:18 |
| sshnaidm | quiquell|rover, yeah, I tried to bring it back yesterday. I've already registered it, but didn't know they want real mail to confirm it :) | 09:18 |
| sshnaidm | now need to re-register it to different mail.. | 09:18 |
| quiquell|rover | sshnaidm: We can use the ruck/rover gmail | 09:18 |
| sshnaidm | quiquell|rover, what is it? | 09:18 |
| quiquell|rover | tripleo.ci.ruck.rover@gmail.com | 09:18 |
| quiquell|rover | created for the dashboard-ci | 09:18 |
| sshnaidm | quiquell|rover, cool, and pass? | 09:19 |
| quiquell|rover | sshnaidm: It's at the passwords doc | 09:19 |
| sshnaidm | quiquell|rover, ack | 09:19 |
| quiquell|rover | sshnaidm: What's the best place to change gating_repo priority ? | 09:37 |
| quiquell|rover | build-test-packages ? | 09:37 |
| sshnaidm | quiquell|rover, change to what? | 09:38 |
| quiquell|rover | sshnaidm: To have more priority than delorean-current | 09:38 |
| sshnaidm | quiquell|rover, it has priority 1, the highest | 09:39 |
| sshnaidm | quiquell|rover, what it the problem? | 09:39 |
| quiquell|rover | sshnaidm: https://bugs.launchpad.net/tripleo/+bug/1756936 | 09:39 |
| openstack | Launchpad bug 1756936 in tripleo "rdo jobs ignore depends-on tripleo-common" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:39 |
| quiquell|rover | Trying the Alex approach | 09:40 |
| sshnaidm | quiquell|rover, it always had the highest priority, the problem was there that we just didn't apply our build patches in CI | 09:41 |
| quiquell|rover | sshnaidm: Yesterday I read that you fixed it ? | 09:42 |
| sshnaidm | quiquell|rover, because zuul automatically rebases patches in CI we should always have the higher version than in delorean-current | 09:42 |
| quiquell|rover | so maybe this is closed ? | 09:42 |
| sshnaidm | quiquell|rover, yeah, now I think we can close it.. | 09:42 |
| quiquell|rover | Do you have the review with the fix ? | 09:42 |
| quiquell|rover | Want to try it | 09:42 |
| sshnaidm | quiquell|rover, it's shortest patch in the world :) https://review.openstack.org/#/c/598089/ | 09:43 |
| quiquell|rover | yu kidding me | 09:44 |
| quiquell|rover | :-) | 09:44 |
| sshnaidm | yeah, little "s" blocked CI for 2 weeks | 09:44 |
| quiquell|rover | clazzzy | 09:44 |
| quiquell|rover | And the u ? | 09:45 |
| quiquell|rover | Don't remeber what the u mod do | 09:45 |
| quiquell|rover | sshnaidm: So we can close it ' | 09:46 |
| quiquell|rover | ? | 09:46 |
| sshnaidm | quiquell|rover, I'd ask @bandini if he has still the problem before | 09:47 |
| quiquell|rover | sshnaidm: ack | 09:47 |
| quiquell|rover | bandini: Do you still suffer from https://bugs.launchpad.net/tripleo/+bug/1756936 | 09:47 |
| openstack | Launchpad bug 1756936 in tripleo "rdo jobs ignore depends-on tripleo-common" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:47 |
| ssbarnea|bkp | sshnaidm thanks for merging https://review.rdoproject.org/r/#/c/15914/ -- seeing ANSI on console really improves my workday :) | 09:48 |
| sshnaidm | ssbarnea|bkp, glad to help | 09:48 |
| *** panda has quit IRC | 09:48 | |
| bandini | quiquell|rover: I don't (but I have not done a lot of work where I would trigger it lately). feel free to close it and I can reopen if I stumble on it | 09:49 |
| quiquell|rover | bandini: ack, will do | 09:49 |
| bandini | thanks | 09:49 |
| ssbarnea|bkp | i wonder if we do have a way to perform a gate-check on jenkins jobs because they do not vote and is too easy to miss checking them, not to mention that is hard to spot an empty CR in the logs. | 09:50 |
| *** d0ugal has quit IRC | 09:51 | |
| *** udesale has joined #oooq | 09:53 | |
| ssbarnea|bkp | can someone explain me the purpose of the "Verify Sphinx build" task? | 09:57 |
| *** quiquell|rover is now known as quiquell|rover|a | 09:57 | |
| *** quiquell|rover|a is now known as quique|rover|afk | 09:57 | |
| *** d0ugal has joined #oooq | 10:02 | |
| cgoncalves | sshnaidm, hi. could you please revisit https://review.openstack.org/#/c/596428 ? | 10:11 |
| sshnaidm | cgoncalves, will look | 10:12 |
| sshnaidm | cgoncalves, I need to know what is running there too, can you please add full command and output? it should be in _quickstart.log in directory you run from | 10:13 |
| sshnaidm | cgoncalves, because I didn't meet such problem ever | 10:13 |
| cgoncalves | sshnaidm, yeah, weshay was also puzzled when he connected to my box. I even reinstalled the OS just to be sure | 10:14 |
| *** d0ugal has quit IRC | 10:14 | |
| sshnaidm | cgoncalves, ok, waiting for you output then | 10:17 |
| sshnaidm | cgoncalves, I also don't understand this fix - ansible "copy" copies from local host to remote, shell "cp" copies files on the remote host, it's not equivalent at all | 10:18 |
| *** quique|rover|afk is now known as quiquell|rover | 10:19 | |
| ssbarnea|bkp | marios i found interesting bug: getting user id fails just after succesfull creation of user, see https://ci.centos.org/job/tripleo-quickstart-extras-gate-master-delorean-quick-basic/341/consoleFull "https://ci.centos.org/job/tripleo-quickstart-extras-gate-master-delorean-quick-basic/341/consoleFull" | 10:22 |
| *** d0ugal has joined #oooq | 10:23 | |
| ssbarnea|bkp | files as https://bugs.launchpad.net/tripleo/+bug/1791053 | 10:26 |
| openstack | Launchpad bug 1791053 in tripleo "delorean: Get the non-root user UI fails after user is created" [Undecided,New] | 10:26 |
| marios | ssbarnea|bkp: ack i'm looking at failing scen 1 on rocky gate check fails like http://logs.openstack.org/16/599216/2/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/3d16b52/logs/subnode-2/var/log/extra/errors.txt.gz#_2018-09-06_03_27_18_028 | 10:26 |
| marios | 2018-09-06 03:27:18.028 ERROR /var/log/containers/ceilometer/agent-notification.log: 28 ERROR ceilometer.publisher.gnocchi [-] fail to retrieve filtered project : NoUniqueMatch: ClientException | 10:26 |
| ssbarnea|bkp | sure, i am digging on mine for now. | 10:27 |
| *** ratailor__ has joined #oooq | 10:27 | |
| *** ratailor_ has quit IRC | 10:30 | |
| quiquell|rover | marios, ssbarnea|bkp: Do you know why we don't have master promotions ? | 10:37 |
| marios | quiquell|rover: no should have clear on promotion blockers afaik | 10:38 |
| marios | quiquell|rover: or its another issue | 10:38 |
| quiquell|rover | no promotion to phase1 | 10:38 |
| quiquell|rover | at master | 10:38 |
| marios | quiquell|rover: pointer jobs/logs? | 10:38 |
| quiquell|rover | Just looking at grafan's promotions | 10:39 |
| marios | quiquell|rover: k am looking at some other issue now (rocky scen 1 fail) | 10:39 |
| marios | quiquell|rover: i need to find at least one more of it to file a bug :) | 10:40 |
| quiquell|rover | marios: No worries let me dig deeper | 10:40 |
| *** ratailor has joined #oooq | 10:41 | |
| *** ratailor__ has quit IRC | 10:41 | |
| *** ratailor has quit IRC | 10:42 | |
| chkumar|ruck | weshay: myoung sprint-19 tempest topics https://etherpad.openstack.org/p/tripleo-tempest-sprint19 can we do the planning meeting a little early today as I need to catch the flight | 10:53 |
| quiquell|rover | ykarel: Do you know when is the next run for https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo_trunk-promote-master-current-tripleo/ ? | 10:59 |
| ykarel | quiquell|rover, when centos7-master/current-tripleo updates | 11:00 |
| quiquell|rover | ykarel: humm, but we have change promoter to bypass one job... so there is no change at tripleo-current | 11:01 |
| quiquell|rover | we have to wait for a tripleo-current promotion ? | 11:01 |
| *** kopecmartin has quit IRC | 11:01 | |
| *** kopecmartin has joined #oooq | 11:02 | |
| ykarel | quiquell|rover, do u want to test some fix? | 11:03 |
| quiquell|rover | ykarel: We commented phase1 promote job at master.ini in promoter | 11:03 |
| ykarel | okk, so? | 11:04 |
| quiquell|rover | ykarel: To be able to have a phase1 promotion that fix a problem with virtualbmc | 11:04 |
| quiquell|rover | btw tripleo-current is not promoteion because of this https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-master/26c2305/job-output.txt.gz#_2018-08-29_19_00_26_038672 | 11:04 |
| quiquell|rover | marios, ssbarnea|bkp: Did you find something similar in previous sprint ? | 11:04 |
| ykarel | quiquell|rover, but still don't get why u wanted to rerun rdo_trunk-promote-master-current-tripleo | 11:06 |
| ssbarnea|bkp | quiquell|rover first time when I see this error, | 11:06 |
| ykarel | quiquell|rover, as phase 1 would have been promoted by skipping that job in master.ini | 11:07 |
| *** ccamacho has quit IRC | 11:07 | |
| quiquell|rover | ykarel: https://bugs.launchpad.net/tripleo/+bug/1790969 | 11:07 |
| openstack | Launchpad bug 1790969 in tripleo "Could not find the requested service virtualbmc: host" [Critical,Fix released] - Assigned to Quique Llorente (quiquell) | 11:07 |
| quiquell|rover | ykarel: The fix https://review.rdoproject.org/r/#/c/16158/1 is not running | 11:08 |
| marios | quiquell|rover: new for me too | 11:08 |
| quiquell|rover | ykarel: Because there have not being any change at tripleo-current even with phase1 behind tripleo-current is not re-running ? | 11:08 |
| ykarel | then probably issue in promoter, looking http://38.145.34.55/master.log | 11:10 |
| ykarel | quiquell|rover, is https://review.rdoproject.org/r/#/c/16158/1 applied on promoter server? | 11:10 |
| ykarel | because as per logs it's not | 11:11 |
| quiquell|rover | ykarel: ack, let me check | 11:11 |
| marios | quiquell|rover: ssbarnea|bkp i rechecked the rocky gate check | 11:14 |
| marios | that was so satisfying to write | 11:14 |
| quiquell|rover | marios: sshnaidm is activating it in hubbot so we have it automatically | 11:14 |
| marios | quiquell|rover: sshnaidm i didn't know that | 11:14 |
| marios | quiquell|rover: thanks | 11:15 |
| quiquell|rover | marios: Next I will add it to dashboard-ci | 11:15 |
| marios | quiquell|rover: ssbarnea|bkp anyway the point is i was looking into the failing rocky-scen1 fail: http://logs.openstack.org/16/599216/2/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/3d16b52/ | 11:15 |
| marios | quiquell|rover: ssbarnea|bkp and went digging but in the end i see the fails were all from yesterday. Today it passes at master gate check https://review.openstack.org/#/c/560445/133 has green tripleo-ci-centos-7-scenario001-multinode-oooq-containerSUCCESS in 3h 03m 58s BUT patchset 132 had failed tripleo-ci-centos-7-scenario001-multinode-oooq-container TIMED_OUT in 3h 20m 36s | 11:16 |
| quiquell|rover | sshnaidm: Someone has change rocky.ini config manually at the promoter | 11:16 |
| marios | quiquell|rover: hence why i wanted to recheck @ rocky to see if that deals with it | 11:16 |
| quiquell|rover | sshnaidm: that's why is not updating :-( | 11:16 |
| sshnaidm | quiquell|rover, heh... | 11:16 |
| sshnaidm | quiquell|rover, can you see in logs who did it? | 11:16 |
| quiquell|rover | centos user :-( | 11:17 |
| sshnaidm | quiquell|rover, ok.. need to block centos user from ssh.. | 11:17 |
| marios | quiquell|rover: sshnaidm why is the upstream check displaying noop | 11:17 |
| marios | does it mean no fails? or probably something wrong? | 11:18 |
| marios | cos our stats are going down :/ | 11:18 |
| marios | sshnaidm: quiquell|rover so it was working earlier | 11:20 |
| quiquell|rover | sshnaidm: agree | 11:20 |
| marios | i mean dashboard | 11:20 |
| quiquell|rover | marios: context | 11:20 |
| *** abishop has joined #oooq | 11:21 | |
| marios | quiquell|rover: so is ther something wrong with http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1 now sshnaidm | 11:21 |
| *** abishop has quit IRC | 11:21 | |
| marios | ? | 11:21 |
| marios | looks like it to me? | 11:21 |
| marios | i already tried refreshing | 11:21 |
| quiquell|rover | marios: What's happening ? | 11:22 |
| marios | like it only shows failing gates from 2018-09-05 | 11:22 |
| marios | nothing from today | 11:22 |
| marios | and nothing in faling check jobs | 11:22 |
| quiquell|rover | marios: shoot you are right no upstream gate jobs ... | 11:24 |
| marios | quiquell|rover: is it working ok for you? | 11:24 |
| quiquell|rover | marios: let me check | 11:24 |
| marios | quiquell|rover: it was working earlier | 11:24 |
| marios | sshnaidm: ^ | 11:24 |
| quiquell|rover | sshnaidm: It make sense that promoter not updating if there is some manual changes ? | 11:26 |
| quiquell|rover | sshnaidm: The git command fails, but maybe it's a good thing | 11:26 |
| sshnaidm | quiquell|rover, need to check if it has "force" in git | 11:26 |
| *** kopecmartin has quit IRC | 11:27 | |
| sshnaidm | quiquell|rover, possibly not.. | 11:27 |
| *** ratailor has joined #oooq | 11:27 | |
| quiquell|rover | cd ~/ci-config; git pull >/dev/null | 11:27 |
| quiquell|rover | sshnaidm: Let's do it right, going to put the manual changes into git | 11:28 |
| sshnaidm | quiquell|rover, yes, it won't update with local changes | 11:29 |
| quiquell|rover | sshnaidm: that's good or bad ? | 11:29 |
| quiquell|rover | from a workflow perspective | 11:29 |
| ykarel | sshnaidm, can we take https://review.openstack.org/#/c/579406/, seems it's affecting phase 1 as well | 11:29 |
| sshnaidm | quiquell|rover, let's just change it to git reset --hard origin/master && git pull | 11:29 |
| quiquell|rover | sshnaidm: chicken/egg thing, we need to do it first manually | 11:30 |
| sshnaidm | quiquell|rover, yeah, np | 11:30 |
| sshnaidm | ykarel, do you know why rdo jobs failed there? | 11:31 |
| ykarel | sshnaidm, u mean phase1 | 11:31 |
| sshnaidm | ykarel, seems like infra again.. | 11:31 |
| sshnaidm | ykarel, no, I mean in the patch | 11:31 |
| ykarel | hmm those are infra ones | 11:32 |
| sshnaidm | marios, quiquell|rover seems like data is stuck in grafana, opened it just now | 11:32 |
| ykarel | recenlty ops fixed some infra issues related to metadata, so jobs should be good now | 11:32 |
| sshnaidm | ykarel, great | 11:32 |
| quiquell|rover | sshnaidm: https://review.rdoproject.org/r/#/c/16166/ | 11:35 |
| *** hubbot1 has joined #oooq | 11:36 | |
| sshnaidm | hubbot1, thanks god you're here | 11:36 |
| hubbot1 | sshnaidm: Error: "thanks" is not a valid command. | 11:36 |
| sshnaidm | %gatestatus | 11:37 |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7 (3 more messages) | 11:37 |
| quiquell|rover | good | 11:37 |
| quiquell|rover | our old friend | 11:37 |
| quiquell|rover | sshnaidm++ | 11:37 |
| hubbot1 | quiquell|rover: sshnaidm's karma is now 5 | 11:37 |
| sshnaidm | hubbot1++ | 11:37 |
| hubbot1 | sshnaidm: hubbot1's karma is now 1 | 11:37 |
| quiquell|rover | %config | 11:38 |
| hubbot1 | quiquell|rover: (config <name> [<value>]) -- If <value> is given, sets the value of <name> to <value>. Otherwise, returns the current value of <name>. You may omit the leading "supybot." in the name if you so choose. | 11:38 |
| quiquell|rover | %config plugins.GateStatus.changeIDs | 11:38 |
| hubbot1 | quiquell|rover: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab If12c8fe9bd0bea98a4842f279399285344f22246 | 11:38 |
| quiquell|rover | %config plugins.GateStatus.changeIDs I9c40e97a9fbc850962605b2a46420e6c645d5c23 I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab If12c8fe9bd0bea98a4842f279399285344f22246 | 11:39 |
| hubbot1 | quiquell|rover: Error: You don't have the owner capability. If you think that you should have this capability, be sure that you are identified before trying again. The 'whoami' command can tell you if you're identified. | 11:39 |
| quiquell|rover | sshnaidm: ^ | 11:39 |
| quiquell|rover | sshnaidm: /etc/telegraf directory has disappear from rrcockpit infra server | 11:49 |
| quiquell|rover | :-/ | 11:49 |
| marios | quiquell|rover: woo looks like rocky gate check scen 1 is green on recheck | 11:49 |
| marios | ssbarnea|bkp: ^ | 11:49 |
| *** chem has quit IRC | 11:49 | |
| quiquell|rover | marios: what's the CI Seals ? | 11:50 |
| quiquell|rover | chkumar|ruck: Do we have to assis the CI Seals Daily ? | 11:50 |
| marios | quiquell|rover: am watching zuul but undercloud-containers fails | 11:50 |
| marios | quiquell|rover: added comment at https://review.openstack.org/#/c/599216/2 zuul didn't finish yet | 11:50 |
| marios | quiquell|rover: oh | 11:50 |
| marios | quiquell|rover: its a call 4 times/week | 11:50 |
| marios | quiquell|rover: they use https://trello.com/b/j4IcIomh/production-chain-escalation | 11:51 |
| marios | quiquell|rover: yes ruck/rover both attend and might have to talk about things. there should be nothing in there that you dn't already know about (i mean because there was a lp bug for it) or it is d/stream only so not your issue | 11:52 |
| quiquell|rover | marios, ssbarnea|bkp: Anything we have to say there ? | 11:52 |
| marios | quiquell|rover: see previous message ^T | 11:52 |
| quiquell|rover | marios: ack | 11:52 |
| marios | quiquell|rover: might want to check out the cards which have LP on them already | 11:52 |
| marios | quiquell|rover: like open the bug see what status is/what merged didn't etc | 11:52 |
| marios | quiquell|rover: so basically you should know about anything there that has 'LP' on it ! | 11:53 |
| quiquell|rover | Damn forgot to check CIX :-/ | 11:53 |
| marios | :) | 11:53 |
| sshnaidm | quiquell|rover, I'll configure them in hubbot.conf | 11:53 |
| marios | quiquell|rover: rhwy fo critical first | 11:53 |
| marios | they go | 11:53 |
| *** rfolco has joined #oooq | 11:53 | |
| sshnaidm | quiquell|rover, but telegraf runs from container, does it need /etc/telegraf? how could it disappear.. | 11:53 |
| quiquell|rover | sshnaidm: Ahh silly me | 11:54 |
| chkumar|ruck | quiquell|rover: yes | 11:54 |
| weshay | quiquell|rover, chkumar|ruck hey guys :) | 11:54 |
| sshnaidm | quiquell|rover, what is change ID for rocky? | 11:55 |
| weshay | is rdo cloud still down? | 11:55 |
| quiquell|rover | sshnaidm: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 | 11:55 |
| quiquell|rover | weshay: is all green https://semaphore.cloud.upshift.engineering.redhat.com/ | 11:55 |
| sshnaidm | quiquell|rover, it's queens | 11:56 |
| quiquell|rover | sshnaidm: wait | 11:56 |
| sshnaidm | quiquell|rover, found - If12c8fe9bd0bea98a4842f279399285344f22246 | 11:56 |
| quiquell|rover | I9c40e97a9fbc850962605b2a46420e6c645d5c23 | 11:56 |
| quiquell|rover | Ahh ssbarnea|bkp you already had it :-) | 11:57 |
| sshnaidm | quiquell|rover, yeah, and it's already in config.. | 11:57 |
| quiquell|rover | Ahh cool cool | 11:58 |
| quiquell|rover | Will update the dashboard-ci later | 11:58 |
| sshnaidm | quiquell|rover, no, it's not good | 11:59 |
| sshnaidm | ssbarnea|bkp, you created patch with same change id | 11:59 |
| weshay | sshnaidm, did you get ara working? | 12:00 |
| sshnaidm | weshay, not yet | 12:00 |
| sshnaidm | quiquell|rover, I'll use your patch | 12:00 |
| quiquell|rover | sshnaidm: ack | 12:00 |
| *** trown|outtypewww is now known as trown | 12:00 | |
| marios | sshnaidm: quiquell|rover so do we know what the problem with dashboard is ? | 12:01 |
| sshnaidm | quiquell|rover, and we need now to remove both ssbarnea|bkp patch and create different pike patch :/ | 12:01 |
| quiquell|rover | sshnaidm: Then let just create a new one for pike and use ssbarnea|bkp for rocky | 12:01 |
| sshnaidm | quiquell|rover, we can't, it has same change ID as myoungs patch for pike | 12:02 |
| sshnaidm | quiquell|rover, hubot doesn't work with patches with same change ID :( | 12:02 |
| quiquell|rover | That's why we do a new one for pike | 12:02 |
| quiquell|rover | with new change ID | 12:02 |
| quiquell|rover | that's all | 12:02 |
| quiquell|rover | that will work ? | 12:03 |
| sshnaidm | quiquell|rover, yea, but need also new patch for rocky | 12:03 |
| quiquell|rover | ok take rocky | 12:03 |
| sshnaidm | %gatestatus | 12:03 |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7 (3 more messages) | 12:03 |
| ssbarnea|bkp | sshnaidm not sure what was wrong, I only did a cherry pick of the gate-check CR to another branch where I didn't see it. | 12:06 |
| quiquell|rover | marios: Any news on https://trello.com/c/MbcQXQ5g/717-cixlp1789416tripleociproa-stable-queens-no-image-with-the-name-bm-deploy-kernel-found-make-sure-you-have-uploaded-boot-images ? | 12:07 |
| sshnaidm | ssbarnea|bkp, yeah, it's what we shouldn't do | 12:08 |
| marios | quiquell|rover: not from me ssbarnea|bkp filed that one | 12:09 |
| marios | quiquell|rover: but lemme check (reviews merged i think?) | 12:09 |
| marios | quiquell|rover: i don't think we are seeing this issue anymore though? afaics | 12:10 |
| marios | quiquell|rover: one of the 2 reviews merged | 12:10 |
| marios | ssbarnea|bkp: thisis about https://bugs.launchpad.net/tripleo/+bug/1789416 | 12:10 |
| openstack | Launchpad bug 1789416 in tripleo "stable/queens: No image with the name 'bm-deploy-kernel' found - make sure you have uploaded boot images."" [Critical,Fix released] - Assigned to wes hayutin (weshayutin) | 12:10 |
| quiquell|rover | marios: ack | 12:10 |
| quiquell|rover | For next seal session | 12:11 |
| marios | quiquell|rover: cool so you survived then ;) ? | 12:11 |
| quiquell|rover | Don't know | 12:12 |
| *** ratailor_ has joined #oooq | 12:13 | |
| *** ratailor__ has joined #oooq | 12:14 | |
| *** ratailor has quit IRC | 12:15 | |
| marios | quiquell|rover: if you get stuck just plead the 5th | 12:17 |
| marios | always works in the movies | 12:17 |
| *** ratailor_ has quit IRC | 12:17 | |
| quiquell|rover | marios: and this ? https://trello.com/c/4UoWap3v/725-cixlp1790199tripleociproa-fs035-openstack-overcloud-deploy-returns-error-code-without-any-signs-or-error | 12:22 |
| quiquell|rover | ssbarnea|bkp: ^ ? | 12:23 |
| *** kopecmartin has joined #oooq | 12:23 | |
| ssbarnea|bkp | i need to recheck the fs035 one, to see what happens now. | 12:24 |
| *** chem has joined #oooq | 12:24 | |
| quiquell|rover | ssbarnea|bkp: So in progress | 12:24 |
| ssbarnea|bkp | in fact close it, unable to reproduce. | 12:24 |
| *** thrash|g0ne is now known as thrash | 12:26 | |
| quiquell|rover | fewww... | 12:30 |
| quiquell|rover | Was not prepare for this new seal stuff | 12:30 |
| quiquell|rover | thanks ssbarnea|bkp | 12:30 |
| ssbarnea|bkp | i keep seeing the ""The conditional check 'update_containers and update_containers_append_tag is undefined' failed.", can someone give me a hint regarding why? https://ci.centos.org/job/tripleo-quickstart-gate-master-delorean-quick-basic/6902/console | 12:31 |
| ssbarnea|bkp | is this caused by lack of promotion on masteR? | 12:32 |
| chkumar|ruck | quiquell|rover: I will be there from monday | 12:34 |
| quiquell|rover | chkumar|ruck: no worries | 12:34 |
| marios | ssbarnea|bkp: sounds like https://launchpad.net/bugs/1789881 ? | 12:35 |
| openstack | Launchpad bug 1789881 in tripleo "tripleo-quickstart fails to generate /home/stack/containers-default-parameters.yaml" [Medium,In progress] - Assigned to yatin (yatinkarel) | 12:35 |
| marios | ssbarnea|bkp: oh no | 12:35 |
| marios | ssbarnea|bkp: not the same actually | 12:35 |
| quiquell|rover | is different | 12:36 |
| weshay | chkumar|ruck, you have a link to the log that has this error? | 12:36 |
| weshay | https://bugs.launchpad.net/tripleo/+bug/1790857/comments/1 | 12:36 |
| openstack | Launchpad bug 1790857 in tripleo "Queens tripleo-ci-centos-7-scenario004-multinode-oooq-container failing tempest manila_tempest_tests.tests.api.test_shares.SharesCephFSTest " [Critical,In progress] - Assigned to chandan kumar (chkumar246) | 12:36 |
| weshay | chkumar|ruck, also.. when opening promotion blockers, please only use logs from promotion / periodic jobs. | 12:36 |
| chkumar|ruck | weshay: http://logs.openstack.org/24/567224/99/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/5fdb110/logs/subnode-2/var/log/containers/manila/manila-scheduler.log.txt.gz#_2018-09-05_02_04_56_115 | 12:36 |
| weshay | you have a check job listed in that bug.. which raises doubts whether it's a promotion job or simply a bad review | 12:37 |
| weshay | chkumar|ruck, thanks | 12:37 |
| chkumar|ruck | weshay: the above job was broken from last week i think, when it made to tempest, it failed on mistral | 12:37 |
| *** ccamacho has joined #oooq | 12:38 | |
| *** ccamacho has quit IRC | 12:38 | |
| *** rlandy has joined #oooq | 12:38 | |
| weshay | chkumar|ruck, k k | 12:38 |
| weshay | chkumar|ruck, I don't see the same error https://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/f70676c/logs/subnode-2/var/log/containers/manila/manila-scheduler.log.txt.gz | 12:38 |
| *** ccamacho has joined #oooq | 12:38 | |
| weshay | chkumar|ruck, https://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/f70676c/logs/tempest.html.gz | 12:38 |
| holser_ | marios Can you reply on my PM? | 12:39 |
| chkumar|ruck | weshay: the above job failed in queens noop job | 12:39 |
| weshay | chkumar|ruck, ah.. I see why you would use that :) | 12:40 |
| weshay | chkumar|ruck, still .. when creating a promotion blocker, it's best to use a periodic job | 12:40 |
| weshay | chkumar|ruck, if that is still confusing.. let me know | 12:40 |
| chkumar|ruck | weshay: yes , noted | 12:40 |
| *** ykarel is now known as ykarel|away | 12:41 | |
| weshay | chkumar|ruck, thanks for running down the fix | 12:41 |
| marios | holser_: sorry missed it | 12:41 |
| weshay | chkumar|ruck, well done | 12:41 |
| weshay | chkumar|ruck++ | 12:41 |
| hubbot1 | weshay: chkumar|ruck's karma is now 1 | 12:41 |
| rlandy | marios: hello ... | 12:44 |
| rlandy | marios: so it looks like the parameters were passed | 12:45 |
| holser_ | marios np | 12:45 |
| holser_ | just wanted to sort out before Retro | 12:45 |
| weshay | chkumar|ruck, is arx pto? | 12:45 |
| quiquell|rover | weshay: Now we have the CIX thing everyday ? | 12:45 |
| weshay | kopecmartin, we're going to have tempest planning w/ ci this morning | 12:45 |
| weshay | quiquell|rover, I'm doing my best to kill that | 12:46 |
| weshay | quiquell|rover, not having much luck | 12:46 |
| quiquell|rover | weshay: ack, no problem | 12:46 |
| chkumar|ruck | weshay: nope, | 12:46 |
| rlandy | marios: if you look at the results from http://logs.openstack.org/22/596422/35/check/tripleo-ci-centos-7-scenario009-multinode-oooq/80c5d95/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-09-06_04_34_51 | 12:46 |
| *** ykarel|away has quit IRC | 12:47 | |
| chkumar|ruck | weshay: I think he is not in this channel | 12:47 |
| kopecmartin | weshay, sorry, i can't attend, wifi in bus is not fast enough for a call :/ | 12:47 |
| rlandy | marios: I agree that the top level params are not needed though | 12:48 |
| *** arxcruz has joined #oooq | 12:48 | |
| rlandy | looking at how bridge_name was passed | 12:48 |
| arxcruz | weshay: hi | 12:50 |
| weshay | arxcruz, there you are | 12:50 |
| weshay | :) | 12:50 |
| arxcruz | i left the channel, no idea why... :/ | 12:50 |
| weshay | chkumar|ruck, https://etherpad.openstack.org/p/tripleo-ci-squad-meeting line 63 | 12:58 |
| weshay | arxcruz, sleep walking again? | 12:58 |
| arxcruz | no, for some reason i left the channel automatically, dunno why... i'm still in the other channels :/ | 12:59 |
| weshay | myoung, please make me the owner on all the mtgs you have.. or shared owner | 13:01 |
| *** ratailor__ has quit IRC | 13:01 | |
| weshay | rlandy, mtg | 13:02 |
| weshay | chkumar|ruck, ^ | 13:02 |
| weshay | https://bluejeans.com/7050859455/ | 13:02 |
| tosky | I lost track... what is it still missing to fix the scenario004 (aka manila) tempest test in queens? | 13:08 |
| tosky | I thought that the relevant packages were backported | 13:08 |
| myoung | weshay: ack, will do | 13:10 |
| *** skramaja has quit IRC | 13:10 | |
| myoung | weshay: they are (nearly) all on the RHOS calendar, so all changes should be made to the events on that calendar and the individuals' calendar events are then automagically updated. | 13:10 |
| tbarron | tosky: chkumar|ruck - yeah, I thought updating the manila-tempest-plugin to include vkmc's default share type creation would do the trick | 13:13 |
| vkmc | tbarron, chkumar|ruck, tosky, I can work on the backport | 13:14 |
| tbarron | tosky: chkumar|ruck vkmc - but we're still seeing emails re. scenario004 and the manila-api logs on subnode2 still show tracebacks for lack of default share type | 13:14 |
| quiquell|rover | marios, sshnaidm: Looking at dashboard-ci issue... running it locally works fine | 13:15 |
| tosky | vkmc: but the version with the fix is already marked to be used in queens | 13:15 |
| tosky | vkmc: so no need to backport anything (and where would you backport it? There were no branches) | 13:16 |
| weshay | tbarron, tosky https://review.rdoproject.org/r/#/c/16148/2 | 13:16 |
| tosky | weshay: yes, and we still get failures | 13:16 |
| tbarron | vkmc: ^^^ | 13:17 |
| weshay | you have the right package installed? | 13:17 |
| weshay | maybe it's not through the system | 13:17 |
| tosky | I don't know, it's marked to be used on queens, so the CI should do the magic, right? :) | 13:17 |
| tbarron | weshay: yeah, I'm thinking the job is still running with the old package, where does it say which it uses? | 13:17 |
| tosky | you can check the packages installed from the logs | 13:17 |
| * tosky checks | 13:18 | |
| vkmc | yeah, in the environment logs | 13:18 |
| tbarron | ETOOMANY different log formats in my life | 13:18 |
| dtrainor | I'm using reproducer to verify a bug (http://logs.openstack.org/14/590214/4/check/tripleo-ci-centos-7-undercloud-containers/84d7e84/logs/reproducer-quickstart.sh) and though it appears to deploy successfully and my undercloud gets created in rdocloud, I see no reference to the files mentioned in the change (e.g. validations/library/ssl_certificate.py) | 13:18 |
| tosky | tbarron: in logs/undercloud/var/log/extra there is a rpm-list.txt.gz | 13:19 |
| tosky | still the old version apparently | 13:19 |
| tosky | uhm | 13:19 |
| tbarron | tosky: ty, and that makes sense of the data | 13:19 |
| tosky | let's move to #rdo | 13:19 |
| tbarron | even if it doesn't make sense that the old pkg is being used | 13:19 |
| *** kopecmartin has quit IRC | 13:20 | |
| *** vinaykns has joined #oooq | 13:24 | |
| marios | rlandy: ack sorry i was afk before the call will check/we can discuss after | 13:27 |
| *** dtrainor has quit IRC | 13:28 | |
| *** dtrainor has joined #oooq | 13:31 | |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike- (3 more messages) | 13:36 |
| dtrainor | if i run reproducer from what's part of a check for a changeset, then i should expect to see all the bits of the changeset in what reproducer deploys, right? | 13:38 |
| quiquell|rover | sshnaidm: Found the issue my end_time from gerrit is breaking it... going to revert | 13:39 |
| sshnaidm | quiquell|rover, ok | 13:39 |
| tosky | oh, quiquell|rover and chkumar|ruck - are you the one in charge of the CI issues right now? | 13:39 |
| quiquell|rover | tosky: Damn you discover us :-) | 13:40 |
| quiquell|rover | yes we are ruck-> find and report, rover-> fix broken stuff | 13:40 |
| tosky | quiquell|rover: ah! | 13:40 |
| tosky | quiquell|rover: so, did you read the discussion here ~20 minutes ago and on #rdo ? | 13:41 |
| quiquell|rover | tosky: will do | 13:41 |
| tosky | basically a certain job on stable/queens is failing and it's apparently using the result of the promotion | 13:41 |
| tosky | the questions are a) is it the case (it's using current-passed-ci) and b) what is it missing for a promotion on queens? | 13:42 |
| quiquell|rover | tosky: talking about tripleo-ci-testing -> current-tripleo ? | 13:43 |
| quiquell|rover | to promoter to current-tripleo you have to pass the following kind of jobs at periodic | 13:43 |
| tosky | quiquell|rover: to be honest I lost track about the names of the tagged releases, so I don't know :) | 13:43 |
| quiquell|rover | tosky: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/queens.ini#L16-L25 | 13:43 |
| tosky | my only goal is: have manila-tempest-plugin 0.1.0 used for queens jobs | 13:44 |
| tosky | that's it | 13:44 |
| quiquell|rover | if one of those toci_jobtypes does not pass we don't have a promotion | 13:44 |
| *** chkumar|ruck is now known as chkumar|out | 13:44 | |
| quiquell|rover | tosky: you mean periodics ? | 13:44 |
| tosky | quiquell|rover: one of the job that reported failures is http://logs.openstack.org/15/562215/5/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/574dcb1/job-output.txt.gz#_2018-09-06_13_02_07_121317 | 13:45 |
| tosky | that does not seem the periodic queue | 13:45 |
| quiquell|rover | tosky: what featureset includes scenario004 ? let's check | 13:45 |
| quiquell|rover | tosky: so this job has this toci_jobtypemultinode-1ctlr-featureset019 | 13:46 |
| quiquell|rover | tosky: and this is included in the promotion criteria | 13:46 |
| quiquell|rover | tosky: for sure we have a counterpart job in periodics | 13:47 |
| quiquell|rover | tosky: this is the periodic job failing at queens execution scenario004 https://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/213c32d | 13:47 |
| *** sshnaidm is now known as sshnaidm|mtg | 13:49 | |
| tosky | quiquell|rover: last run was one week ago | 13:49 |
| rlandy | marios: pls - just another 5 mins to check back- we got some working results yesterday | 13:50 |
| quiquell|rover | tosky: Could not be let me check | 13:50 |
| tosky | at least from the log timestamp | 13:50 |
| quiquell|rover | tosky: maybe we have a problem in the promoter | 13:51 |
| rlandy | dtrainor: yes - you should see your change in the reproducer undercloud env - we are in meeting atm so response may be slow | 13:51 |
| quiquell|rover | tosky: this is the last http://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/f70676c/ | 13:53 |
| tosky | quiquell|rover: and it's failing because the package that should have been there is not there | 13:55 |
| dtrainor | rlandy, all good, just wanted to get the dialogue going. | 13:56 |
| tosky | quiquell|rover: uhm, wait a minute, http://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/f70676c/logs/undercloud/var/log/extra/rpm-list.txt.gz says that it used python2-manila-tests-tempest-0.1.0-0.20180905135747.f6bc6fa.el7.noarch | 13:56 |
| tosky | so that's the correct package | 13:57 |
| quiquell|rover | So it's failing for other reason ? | 13:57 |
| tosky | vkmc: can you please take a look at the logs of that job? It should use the correct manila tempest plugin | 13:57 |
| myoung | https://trello.com/c/2y2BVXgO/726-ideas-brainstorm-resulting-from-testing-in-sprint-12 | 14:03 |
| *** d0ugal has quit IRC | 14:05 | |
| *** d0ugal has joined #oooq | 14:10 | |
| quiquell|rover | tosky: so the version is not the problem ? | 14:18 |
| quiquell|rover | tosky: so the manila tempest plugin version is not the issue ? | 14:21 |
| tosky | quiquell|rover: it seems not, but vkmc is the export | 14:22 |
| tosky | so I leave it to her :) | 14:22 |
| quiquell|rover | tosky: this is tempest talking with ceph ? | 14:24 |
| marios | quiquell|rover: dashboard looks to be working again now | 14:26 |
| marios | quiquell|rover: at least shows fails from 6th | 14:26 |
| tosky | quiquell|rover: it's a manila test | 14:28 |
| quiquell|rover | marios: I revert some "improvement" I did :-/ | 14:28 |
| quiquell|rover | tosky: this is the error http://logs.openstack.org/24/567224/99/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/5fdb110/logs/subnode-2/var/log/containers/manila/manila-scheduler.log.txt.gz#_2018-09-05_02_04_56_115 | 14:29 |
| marios | quiquell|rover: cool it is now much improved! | 14:29 |
| tbarron | quiquell|rover: tosky vkmc I still see python2-manila-tests-tempest-0.0.1 r/t 0.1.0 in | 14:35 |
| tbarron | http://logs.openstack.org/24/567224/99/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/5fdb110/logs/undercloud/var/log/extra/rpm-list.txt.gz | 14:35 |
| quiquell|rover | tbarron: we are looking at the periodic job, that fails in the same point | 14:35 |
| quiquell|rover | tbarron: it has the correct one | 14:35 |
| quiquell|rover | tbarron: http://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/f70676c/logs/undercloud/var/log/extra/rpm-list.txt.gz | 14:35 |
| tbarron | quiquell|rover: i just looked from your last link above, looking at this one now | 14:36 |
| quiquell|rover | tbarron: Have talk to soo, the error does not appear at manila manager in periodic, pero the tempest fail is the same | 14:38 |
| quiquell|rover | tbarron: manila-scheduler in periodic is ok http://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/f70676c/logs/subnode-2/var/log/containers/manila/manila-scheduler.log.txt.gz | 14:39 |
| tbarron | quiquell|rover: tosky vkmc yeah, the | 14:40 |
| tbarron | quiquell|rover: tosky vkmc yeah the 'no default share type' error is gone | 14:40 |
| tbarron | quiquell|rover: vkmc tosky so there's a new reason for failure to investigate ... | 14:40 |
| quiquell|rover | tbarron: yep... http://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset019-queens/f70676c/logs/undercloud/home/zuul/tempest/tempest.html.gz | 14:40 |
| quiquell|rover | tbarron: where can we look ? | 14:41 |
| ssbarnea|bkp | quiquell|rover : shoudn't this have a an alert or promotion-blocker label to it? https://bugs.launchpad.net/tripleo/+bug/1786106 | 14:42 |
| openstack | Launchpad bug 1786106 in tripleo "containers-prep fails w/ update_containers is undefined due to lack of default" [High,In progress] - Assigned to Sorin Sbarnea (ssbarnea) | 14:42 |
| quiquell|rover | ssbarnea|bkp: promotion-blocker at least | 14:44 |
| ssbarnea|bkp | thanks. | 14:44 |
| quiquell|rover | ssbarnea|bkp: Do you want me to continue with it ? | 14:45 |
| tbarron | quiquell|rover: vkmc we'll lok at the other logs under /var/log/containers/manila on subnod2 for clues | 14:45 |
| ssbarnea|bkp | quiquell|rover it would be great if you do, i got few other changes hitting it. | 14:45 |
| quiquell|rover | ssbarnea|bkp: Will re-assign it then | 14:45 |
| *** d0ugal has quit IRC | 14:50 | |
| *** d0ugal has joined #oooq | 14:53 | |
| rlandy | marios: hi - pls ping me when you are ready to go over the THT review - thanks | 14:55 |
| *** ratailor has joined #oooq | 14:57 | |
| quiquell|rover | chkumar|out, weshay: Looks like RDO jobs are broken here https://logs.rdoproject.org/16/563616/12/openstack-check/legacy-tripleo-ci-centos-7-container-to-container-upgrades-queens/b9cbc5f/logs/undercloud/home/zuul/vxlan_networking.sh.log.txt.gz | 14:58 |
| weshay | hrm | 14:58 |
| weshay | k | 14:58 |
| * weshay looks | 14:58 | |
| quiquell|rover | I think this is new | 14:58 |
| * quiquell|rover opens a lp | 14:59 | |
| weshay | quiquell|rover, hrm.. openvswitch 2.0 | 14:59 |
| weshay | quiquell|rover, I think I have a bug on it | 14:59 |
| weshay | no? | 14:59 |
| weshay | quiquell|rover, just check, I opened two last night.. I think one may have this trace | 14:59 |
| chkumar|out | quiquell|rover: weshay fs20 queens periodic job is also broken https://review.openstack.org/599355 | 15:00 |
| chkumar|out | i need some help in jinja templates | 15:00 |
| weshay | arxcruz, btw.. txt me when you land in denver | 15:00 |
| weshay | chkumar|out, k.. how can I help | 15:00 |
| chkumar|out | weshay: https://review.openstack.org/#/c/599355/4/roles/validate-tempest/defaults/main.yml@70 | 15:01 |
| chkumar|out | check ssbarnea|bkp last comment | 15:01 |
| quiquell|rover | chkumar|out, weshay: openned https://bugs.launchpad.net/tripleo/+bug/1791115 you can mark it at duplicate if necessary, have to leave now | 15:02 |
| openstack | Launchpad bug 1791115 in tripleo "[ERROR] /opt/stack/new/devstack/functions-common:Detected fatal at RDO jobs" [Critical,New] - Assigned to Quique Llorente (quiquell) | 15:02 |
| weshay | chkumar|out, thanks for sending me that email... I just missed it :) | 15:02 |
| quiquell|rover | jfrancoa: ^ | 15:02 |
| *** quiquell|rover has quit IRC | 15:02 | |
| jfrancoa | thanks quiquell | 15:02 |
| weshay | chkumar|out, http://jinja.quantprogramming.com/ | 15:03 |
| arxcruz | weshay: sunday 6pm | 15:03 |
| *** hamzy has quit IRC | 15:04 | |
| weshay | chkumar|out, you can't do what you are trying to in jinja | 15:06 |
| weshay | {%- else -%}network-feature-enabled.api_extensions: dvr | 15:07 |
| weshay | is not ok | 15:07 |
| arxcruz | chkumar|out: why not create two variables ? | 15:07 |
| weshay | tempest_conf_removal: >- | 15:09 |
| weshay | {% if release is in ['queens'] -%} | 15:09 |
| weshay | {{ tempest_conf_removal_queens }} | 15:09 |
| weshay | {%- else -%} | 15:09 |
| weshay | network-feature-enabled.api_extensions: dvr | 15:09 |
| weshay | {%- endif -%} | 15:09 |
| weshay | chkumar|out, arxcruz that works according to the linter | 15:09 |
| weshay | arxcruz, chkumar|out sent you both an email | 15:11 |
| arxcruz | weshay: cool, what's this tool ? | 15:12 |
| weshay | arxcruz, http://jinja.quantprogramming.com/ | 15:12 |
| arxcruz | awesome | 15:12 |
| weshay | nice right | 15:12 |
| weshay | arxcruz, there is src for it.. we could host it too | 15:13 |
| weshay | arxcruz, it goes down from time to time | 15:13 |
| ssbarnea|bkp | quite useful bookmark, thanks. | 15:14 |
| chkumar|out | arxcruz: weshay thanks :-) | 15:15 |
| weshay | chkumar|out, I didn't think defining a var in the jinja if would work | 15:16 |
| weshay | it does there.. | 15:16 |
| weshay | hopefully it will work in reality too | 15:16 |
| weshay | chkumar|out, that opens up a lot of potential if it does work | 15:16 |
| chkumar|out | weshay: tempest_whitelist_old tempest_whitelist_new implementation works | 15:16 |
| chkumar|out | weshay: http://git.openstack.org/cgit/openstack/tripleo-quickstart/tree/config/general_config/featureset005.yml#n65 | 15:18 |
| *** sshnaidm|mtg is now known as sshnaidm | 15:20 | |
| *** d0ugal has quit IRC | 15:21 | |
| chkumar|out | weshay: arxcruz we need discussion on tempest deployer input conf file at ptg https://bugzilla.redhat.com/show_bug.cgi?id=1619247 bugs/RFE started poping up | 15:24 |
| openstack | bugzilla.redhat.com bug 1619247 in python-tripleoclient "Support adding entries based on heat template parameters to tempest-deployer-input.conf" [High,New] - Assigned to rhos-maint | 15:24 |
| weshay | chkumar|out, ah yes | 15:25 |
| weshay | chkumar|out, so...... alex wants to kill that file | 15:25 |
| arxcruz | weshay: tosky already talked with alex about it | 15:25 |
| chkumar|out | weshay: pull tosky in that he will help you | 15:25 |
| arxcruz | we just didn't have the time to implement | 15:25 |
| tosky | weshay: and again, the idea is that there should be more details, not less | 15:26 |
| tosky | my fault is that I didn't find the time to implement a way to get the data from tripleo and write them down | 15:26 |
| marios | rlandy: sure gimme 4 mins | 15:26 |
| tosky | weshay: also, last time I spoke with alex he told me that the way I was told originally (mistral workflow) was not the correct one | 15:27 |
| *** hamzy has joined #oooq | 15:27 | |
| weshay | tosky, chkumar|out this is not a CI thing | 15:28 |
| weshay | this is a project thing | 15:28 |
| chkumar|out | weshay: it needs calloboration from tempest side | 15:28 |
| tosky | weshay: sure, it's a project (tripleo) thing | 15:28 |
| tosky | weshay: but again, its removal is not a CI thing either | 15:29 |
| weshay | chkumar|out, tempest is a consumer of that file right? So the tempest crew could give requirements | 15:29 |
| weshay | tosky, right.. I have no dog in this fight | 15:29 |
| weshay | tosky, chkumar|out I just see Alex wanted it gone | 15:29 |
| tosky | weshay: you could land some resources :D | 15:29 |
| chkumar|out | weshay: this file is consumed by tempest but totally depending on deployment tool | 15:30 |
| weshay | tosky, why is it important to me to lend resources | 15:30 |
| weshay | not saying no | 15:30 |
| weshay | just asking | 15:30 |
| weshay | chkumar|out, I know what it is | 15:30 |
| chkumar|out | at the end tests are failing coming back on tempest | 15:30 |
| tosky | weshay: because for the past history I suspect that no one in tripleo "proper" is interested in that part of testing | 15:30 |
| sshnaidm | weshay, rlandy can you review please another fix for reproducer? https://review.openstack.org/#/c/599460/ | 15:30 |
| rlandy | looking | 15:30 |
| tosky | weshay: while people here have the interest for doing it properly, in a way that benefit CI greatly | 15:31 |
| weshay | tosky, chkumar|out I think we're all interested in quality tests working well | 15:31 |
| weshay | tosky, I recall these discussions w/ david | 15:31 |
| rlandy | sshnaidm: I looked at this before... we discussed pasting results from a reproducer ... | 15:32 |
| rlandy | Patch Set 1: Code-Review+1 | 15:32 |
| rlandy | will +2 when there are reproducer results to review | 15:32 |
| weshay | tosky, chkumar|out let me ask you this.. | 15:32 |
| *** ssbarnea|bkp has quit IRC | 15:32 | |
| rlandy | do you have those results, if not will need to run that to verify | 15:32 |
| weshay | is the storage deployment info you are seeking available in the hiera config? or ansible config | 15:32 |
| tosky | weshay: if tripleo deployed it, it knows about it | 15:33 |
| weshay | tosky, right.. which means it's in hiera | 15:33 |
| tosky | yep | 15:33 |
| weshay | tosky, so why not just parse that | 15:33 |
| weshay | doc that | 15:33 |
| tosky | yes | 15:33 |
| tosky | but | 15:33 |
| weshay | why have something in tripleo common? | 15:33 |
| tosky | I was told to do it with a mistral workflow | 15:33 |
| tosky | last time Alex told me it was not the correct way | 15:33 |
| weshay | tosky, or generalize this... | 15:33 |
| weshay | take all the heira data.. and dump it to a known location | 15:34 |
| tosky | but you don't want that, you may have more information than needed | 15:34 |
| tosky | extra local settings | 15:34 |
| weshay | tosky, are you at ptg? | 15:34 |
| tosky | you want someone in the middle, on the tripleo side, that gives you only what you need | 15:34 |
| tosky | yes | 15:34 |
| *** d0ugal has joined #oooq | 15:34 | |
| tosky | I am | 15:34 |
| sshnaidm | rlandy, yep, tested it and this works | 15:35 |
| weshay | k.. chkumar|out I'm inclined to close the bug as written | 15:35 |
| rlandy | sshnaidm: pls paste any output and I'll +2 | 15:35 |
| weshay | and open an RFE | 15:35 |
| *** udesale has quit IRC | 15:35 | |
| chkumar|out | weshay: sure | 15:35 |
| * tosky needs to leave, bbl | 15:35 | |
| weshay | tosky, k | 15:35 |
| weshay | chkumar|out, tosky let's figure this out on monday | 15:35 |
| hubbot1 | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens, tripleo-ci-centos-7-scenario004-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb- (3 more messages) | 15:36 |
| tosky | I will be in the sahara room, in case ping me | 15:36 |
| *** tosky has quit IRC | 15:36 | |
| sshnaidm | rlandy, http://paste.openstack.org/show/729617/ | 15:36 |
| *** ccamacho has quit IRC | 15:38 | |
| rlandy | marios: also - I'll need to backport those chnages to pike queens ocata rocky | 16:03 |
| *** sshnaidm is now known as sshnaidm|off | 16:10 | |
| rlandy | marios: this should cover your suggested changes: https://review.openstack.org/#/c/599739/ | 16:11 |
| rlandy | will modify again when I get Alex's response | 16:11 |
| *** ccamacho has joined #oooq | 16:12 | |
| *** verdurin has quit IRC | 16:13 | |
| *** ssbarnea|bkp has joined #oooq | 16:14 | |
| *** verdurin has joined #oooq | 16:18 | |
| *** gouthamr has joined #oooq | 16:19 | |
| *** ccamacho has quit IRC | 16:22 | |
| *** ratailor has quit IRC | 16:23 | |
| *** jfrancoa has quit IRC | 16:32 | |
| myoung | rlandy: are you around / free? | 16:37 |
| *** ykarel|away has joined #oooq | 16:42 | |
| rlandy | myoung: ack | 16:46 |
| *** trown is now known as trown|lunch | 16:47 | |
| dtrainor | hey there rlandy, do you have a moment to revisit why my reproducer is not working as expected? | 16:48 |
| *** dtantsur is now known as dtantsur|afk | 16:49 | |
| *** apetrich has joined #oooq | 16:55 | |
| *** holser_ has quit IRC | 16:56 | |
| *** jaosorior has quit IRC | 17:00 | |
| *** jaosorior has joined #oooq | 17:01 | |
| *** ccamacho has joined #oooq | 17:05 | |
| *** gkadam__ has quit IRC | 17:09 | |
| ssbarnea|bkp | revoting after rebase: https://review.openstack.org/#/c/588587/ arxcruz marios | 17:14 |
| *** vinaykns has quit IRC | 17:16 | |
| *** ChanServ sets mode: -rf | 17:18 | |
| sshnaidm|off | weshay, can you take a look pls: https://review.openstack.org/#/c/599460 | 17:22 |
| *** ykarel|away has quit IRC | 17:30 | |
| rfolco | sshnaidm|off, if you around, could you please point me to the log where a standalone job applied testenv/multinode.yml config at https://review.openstack.org/#/c/589448/ ? | 17:31 |
| rfolco | how to ensure the symlinks work? https://review.openstack.org/#/c/589448/31/toci-quickstart/config/testenv/standalone.yml | 17:32 |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7-containers-multinode-upgrades-pike- (3 more messages) | 17:36 |
| *** links has joined #oooq | 17:38 | |
| *** links has quit IRC | 17:38 | |
| ssbarnea|bkp | It seems that my UID fix passed https://review.openstack.org/#/c/600407/ -- ready to review | 17:43 |
| *** saneax has quit IRC | 17:58 | |
| *** vinaykns has joined #oooq | 17:59 | |
| weshay | rlandy, k.. back | 18:02 |
| weshay | rlandy, looking at https://bluejeans.com/u/whayutin/ | 18:02 |
| *** links has joined #oooq | 18:02 | |
| rlandy | weshay: sec - just putting in a review to address alex's comments - | 18:02 |
| rlandy | be there in a few | 18:03 |
| *** links has quit IRC | 18:11 | |
| rfolco | weshay, how do I ensure in this standalone run http://logs.openstack.org/48/589448/31/check/tripleo-ci-centos-7-standalone/f42ab97/ that this has been used as extra-vars https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/config/testenv/multinode.yml ? | 18:13 |
| *** brault has joined #oooq | 18:23 | |
| weshay | rfolco, not sure what you mean | 18:24 |
| rfolco | weshay, the change uses a symlink to the real config multinode.yml for standalone singlenode and multinode jobs | 18:26 |
| rfolco | http://logs.openstack.org/48/589448/31/check/tripleo-ci-centos-7-standalone/f42ab97/job-output.txt.gz#_2018-09-06_10_03_48_378241 | 18:26 |
| rfolco | https://review.openstack.org/#/c/589448/31/toci-quickstart/config/testenv/standalone.yml | 18:26 |
| *** jaosorior has quit IRC | 18:27 | |
| rfolco | pls see my last comment on 589448 | 18:27 |
| *** brault has quit IRC | 18:27 | |
| *** ccamacho has quit IRC | 18:28 | |
| rfolco | apparently jobs are working fine, but the symlink magic doesn't look right to me | 18:28 |
| weshay | rfolco, oci-quickstart/config/testenv/standalone.yml is a symlink to multinode? | 18:29 |
| rfolco | exactly | 18:29 |
| rfolco | singlenode too | 18:29 |
| weshay | rfolco, ya.. I suspect the file was not created properly.. I would have to mess w/ git | 18:30 |
| weshay | rfolco, I need to focus on rlandy's patches atm | 18:30 |
| rfolco | weshay, np | 18:30 |
| *** trown|lunch is now known as trown | 18:57 | |
| *** jtomasek has quit IRC | 19:20 | |
| *** hamzy has quit IRC | 19:34 | |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, (3 more messages) | 19:36 |
| *** tosky has joined #oooq | 20:19 | |
| *** rfolco has quit IRC | 21:00 | |
| *** rfolco has joined #oooq | 21:00 | |
| *** trown is now known as trown|outtypewww | 21:12 | |
| rlandy | weshay: https://github.com/search?q=org%3Aopenstack+%2Fetc%2Fnodepool%2Fprimary_node_private&type=Code | 21:17 |
| rlandy | ^^ check of where else /etc/nodepool is referenced | 21:17 |
| weshay | rlandy, ya.. you sent that earlier | 21:19 |
| rlandy | weshay: yeah I did :) | 21:19 |
| rlandy | but it got lost in conversation.... | 21:19 |
| rlandy | do we care about nova etc.? | 21:20 |
| weshay | rlandy, help me understand the point you are trying to make | 21:20 |
| weshay | we don't run nova jobs | 21:20 |
| rlandy | kolla-ansible? | 21:20 |
| rlandy | if not, then ignore me | 21:20 |
| rlandy | that is all | 21:20 |
| weshay | nope | 21:24 |
| weshay | we just use the same tools to build containers atm | 21:24 |
| rlandy | fine | 21:24 |
| weshay | rlandy, :) | 21:33 |
| rlandy | arxcruz: still around? | 21:33 |
| *** sshnaidm|off has quit IRC | 21:36 | |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, (3 more messages) | 21:36 |
| rlandy | nvm - kicking again to get logs | 21:39 |
| myoung | weshay, rascasoft: regarding https://trello.com/c/HXhx4FEA/921-fix-rdo-phase-2-executors-storage-cleanup, 5 of the executors are back online. that virthost is extremely storage overprovisioned and the storage .raw files needed shrinking. | 21:56 |
| myoung | ^^ details in card. | 21:57 |
| myoung | I'll sort the remaining 2 executors tomorrow | 21:57 |
| *** myoung is now known as myoung|off | 21:57 | |
| myoung|off | weshay, rascasoft, rlandy: kicked pipelines to look at results tomorrow: rocky, master, 13, 14 | 22:01 |
| *** vinaykns has quit IRC | 22:01 | |
| *** myoung|off has quit IRC | 22:01 | |
| rlandy | I have one of the bm machine running rhos-13 right now | 22:02 |
| weshay | rlandy, rfolco https://review.rdoproject.org/r/16174 | 22:17 |
| rlandy | weshay: the instances not associated with stacks were nodepool or te-broker instances? | 22:41 |
| rlandy | the ones I saw were nodepool | 22:41 |
| rlandy | and we can't delete those | 22:41 |
| weshay | rlandy, aye | 22:42 |
| rlandy | so there were te-broker? | 22:43 |
| rlandy | ugh - that change did not work :( | 22:43 |
| rlandy | The Parameter (ZuulSubnodeIndex) was not provided. | 22:44 |
| rlandy | it worked before :( | 22:47 |
| rlandy | weshay: ^^ not good | 22:50 |
| rlandy | undercloud deploy hitting this | 22:50 |
| rlandy | was not a problem when we did define it actual file | 22:50 |
| rlandy | openstack undercloud install | 22:51 |
| rlandy | we don;t pass anything in particular there | 22:51 |
| *** tosky has quit IRC | 22:59 | |
| *** dsneddon has quit IRC | 23:14 | |
| rlandy | weshay: ok - I think I accept the mock solution now. | 23:18 |
| rlandy | we remove all references in out own code and the leave the mock for outside references | 23:18 |
| weshay | rlandy, the mock? | 23:21 |
| weshay | w/ etc/nodepool? | 23:22 |
| weshay | rlandy, based on the results? | 23:22 |
| * weshay looks | 23:22 | |
| rlandy | weshay: still have not gotten tht to work - you can follow the fun on #tripleo | 23:22 |
| rlandy | waiting on any more direction | 23:22 |
| rlandy | but this is complex | 23:23 |
| weshay | rlandy, ok | 23:25 |
| weshay | rlandy, you want to chat on irc or blue | 23:25 |
| *** thrash is now known as thrash|g0ne | 23:29 | |
| rlandy | weshay: ok - let's bj for a few - probably quicker | 23:29 |
| *** brault has joined #oooq | 23:29 | |
| *** brault has quit IRC | 23:34 | |
| weshay | rlandy, ah k | 23:36 |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, tripleo-quickstart-extras-gate-master-delorean-full-featureset052, (3 more messages) | 23:36 |
| weshay | rlandy, https://bluejeans.com/4113567798 | 23:36 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!