| *** agopi has joined #oooq | 00:00 | |
| rfolco | weshay, periodic-tripleo-centos-7-master-containers-build-push is what marios added recently perhaps | 00:06 |
|---|---|---|
| rfolco | periodic-tripleo-centos-7-master-containers-build and periodic-tripleo-fedora-28-master-containers-build are the build jobs | 00:06 |
| *** agopi has quit IRC | 00:12 | |
| *** tosky has quit IRC | 00:19 | |
| kmrchdn | weshay: rlandy|bbl https://review.openstack.org/#/c/638159/ dstat stuff for standalone +2 and +w | 00:44 |
| *** rascasoft has joined #oooq | 00:46 | |
| *** rascasoft has quit IRC | 00:50 | |
| *** agopi has joined #oooq | 01:26 | |
| *** apetrich has quit IRC | 03:14 | |
| *** saneax has joined #oooq | 03:25 | |
| *** skramaja has joined #oooq | 03:29 | |
| *** udesale has joined #oooq | 03:51 | |
| *** saneax has quit IRC | 04:11 | |
| *** jbadiapa has quit IRC | 04:38 | |
| *** jbadiapa has joined #oooq | 04:38 | |
| *** jtomasek has joined #oooq | 05:09 | |
| *** ratailor has joined #oooq | 05:40 | |
| *** saneax has joined #oooq | 05:45 | |
| *** agopi has quit IRC | 05:49 | |
| *** kmrchdn is now known as chandankumar | 06:01 | |
| *** quiquell|off is now known as quiquell | 06:50 | |
| chandankumar | quiquell: \o/ | 07:03 |
| chandankumar | quiquell: thanks for merging dstat patch | 07:03 |
| quiquell | marios: commented https://review.openstack.org/#/c/638212 | 07:04 |
| quiquell | chandankumar: GM no problem was good stuff | 07:04 |
| quiquell | chandankumar: have closed merged lps | 07:04 |
| chandankumar | who is the new ruck/rover? | 07:04 |
| quiquell | Didn't check telemetry | 07:05 |
| quiquell | chandankumar: no clue | 07:05 |
| chandankumar | quiquell: telemetry passed last night on check job | 07:05 |
| quiquell | Let's just prepare de new etherpad for them | 07:05 |
| marios | quiquell: thanks looking | 07:05 |
| marios | quiquell: chandankumar i don't know if i am or not | 07:05 |
| marios | i checked the etherpad | 07:05 |
| marios | but didn't say there | 07:05 |
| quiquell | Let's do etherpad either way | 07:06 |
| quiquell | Is just copy paste of last day | 07:06 |
| chandankumar | quiquell: https://logs.rdoproject.org/49/18749/13/check/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/c3084fb/logs/tempest.html | 07:06 |
| chandankumar | quiquell: just copy paste from last day | 07:06 |
| marios | quiquell: thanks man replied but we still need it for scen 4 https://github.com/openstack-infra/tripleo-ci/blob/master/roles/run-test/tasks/main.yaml#L16 | 07:07 |
| quiquell | chandankumar: queen fixed too? | 07:07 |
| *** jfrancoa has joined #oooq | 07:07 | |
| chandankumar | quiquell: patches in review | 07:07 |
| quiquell | marios: why is scn004 not changed to podman? | 07:08 |
| chandankumar | quiquell: https://review.openstack.org/#/c/638191/ needs to fix it | 07:08 |
| quiquell | chandankumar: ack will close master | 07:08 |
| chandankumar | marios: o/ | 07:08 |
| chandankumar | marios: https://review.rdoproject.org/r/#/c/18928/ | 07:08 |
| marios | quiquell: cos manila doesn't like it | 07:08 |
| marios | quiquell: they might fix for T/edge work but for now scen4 stays in pacemaker | 07:09 |
| quiquell | marios: ack then +2 | 07:09 |
| marios | https://review.openstack.org/#/c/636563/ quiquell see comment tom barron @ | 07:09 |
| chandankumar | quiquell: marios https://review.openstack.org/#/c/635152/2 enabling neutron tempest plugin | 07:10 |
| quiquell | marios: you have -1 the review we have to wait for 004? | 07:10 |
| marios | chandankumar: ack will check | 07:11 |
| marios | quiquell: no was knee-jerk reaction to your comment i was gonna remove then remembered | 07:11 |
| quiquell | Hahaha | 07:11 |
| quiquell | Ok I will workflow the thing | 07:12 |
| quiquell | New word knee-jerk | 07:12 |
| marios | quiquell: :) thx | 07:12 |
| marios | quiquell: actually that isn't even doing anything like yeah we need it but mostly is for prevent confusion | 07:12 |
| marios | quiquell: cos emilien patch from commit message already overriding/setting that | 07:12 |
| quiquell | I know its override Emilien told me so | 07:13 |
| quiquell | But FS override is polemic enough so better reduce the use | 07:13 |
| * chandankumar go and grab some food & coffee | 07:14 | |
| quiquell | marios: w'ed | 07:14 |
| marios | thanks quiquell | 07:15 |
| marios | enjoy chandankumar ! | 07:15 |
| marios | omnomnom | 07:15 |
| *** kopecmartin|off is now known as kopecmartin | 07:19 | |
| *** quiquell is now known as quiquiell|brb | 07:30 | |
| *** apetrich has joined #oooq | 07:33 | |
| *** rlandy|bbl is now known as rlandy | 07:44 | |
| *** quiquiell|brb is now known as quiquell | 07:59 | |
| *** rascasoft has joined #oooq | 08:05 | |
| *** jaosorior has quit IRC | 08:08 | |
| *** ccamacho has quit IRC | 08:18 | |
| *** tosky has joined #oooq | 08:26 | |
| *** dsneddon has quit IRC | 08:26 | |
| *** jpena|off is now known as jpena | 08:29 | |
| *** bogdando has joined #oooq | 08:30 | |
| *** saneax has quit IRC | 08:37 | |
| *** amoralej|off is now known as amoralej | 08:40 | |
| *** dtantsur|afk is now known as dtantsur\ | 08:53 | |
| *** dtantsur\ is now known as dtantsur | 08:53 | |
| quiquell | marios: I am debugging periodic-tripleo-centos-7-master-containers-build-push | 08:54 |
| quiquell | marios: It's ok ? | 08:54 |
| marios | quiquell: cool yeah did it run then it wasn't last night | 08:54 |
| marios | quiquell: /me checking too how badly is it broken :D ? | 08:54 |
| quiquell | marios: let me take a look to change brain context | 08:55 |
| *** chem has quit IRC | 08:56 | |
| marios | quiquell: ack thanks i might be ruck don't know yet :D so maybe you take over | 08:57 |
| marios | quiquell: we swap | 08:57 |
| quiquell | chandankumar: created new etherpad for next rr https://review.rdoproject.org/etherpad/p/ruckrover-unisprint6 | 08:58 |
| quiquell | chandankumar: put there whatever you find is missing | 08:58 |
| *** dsneddon has joined #oooq | 09:00 | |
| marios | quiquell: where man https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic&job_name=tripleo-ci-base-singlenode-rdo-containers-build-push https://softwarefactory-project.io/zuul/t/rdoproject.org/builds?job_name=tripleo-ci-base-singlenode-rdo-containers-build-push | 09:00 |
| marios | nope | 09:00 |
| quiquell | marios: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-centos-7-master-containers-build-push/11dc160/job-output.txt.gz#_2019-02-20_22_31_13_344364 | 09:03 |
| quiquell | But let me take a look | 09:03 |
| marios | quiquell: thanks \o/ | 09:04 |
| marios | quiquell: yeah sure man just looking been waiting for this for days! | 09:04 |
| quiquell | marios: I think I know the issue | 09:07 |
| quiquell | marios: env is never None | 09:08 |
| marios | quiquell: it didn't get very far its th elogin which fails | 09:08 |
| marios | quiquell: which env | 09:08 |
| *** holser_ has joined #oooq | 09:08 | |
| *** ccamacho has joined #oooq | 09:09 | |
| *** dsneddon has quit IRC | 09:09 | |
| *** ccamacho has quit IRC | 09:10 | |
| *** ccamacho has joined #oooq | 09:11 | |
| *** chem has joined #oooq | 09:13 | |
| quiquell | marios: REGISTRY_USERNAME are there only for debugging or zuul is setting somewhere ? | 09:19 |
| marios | quiquell: well, see https://codesearch.rdoproject.org/?q=REGISTRY_(USERNAME%7CPASSWORD)&i=nope&files=&repos= | 09:20 |
| bogdando | my repro script fails here http://git.openstack.org/cgit/openstack/tripleo-quickstart/tree/roles/libvirt/setup/overcloud/tasks/libvirt_nodepool.yml#n18 , what magic shall I invoke to get one? | 09:20 |
| marios | quiquell: (via https://tree.taiga.io/project/tripleo-ci-board/task/711?kanban-status=1538166 ) | 09:20 |
| bogdando | I don't have that key | 09:20 |
| marios | quiquell: so looks to me like they never set username only password | 09:20 |
| marios | quiquell: so i did same | 09:21 |
| quiquell | marios: ack | 09:23 |
| bogdando | perhaps some automation should be done for the repro script to add misssing steps: | 09:25 |
| bogdando | eval $(ssh-agent) | 09:25 |
| bogdando | ssh-keygen -b 1024 -t rsa -f ~/.ssh/id_rsa.agent -N "" -q | 09:25 |
| bogdando | ssh-keygen -yf ~/.ssh/id_rsa.agent > ~/.ssh/id_rsa.pub.agent | 09:25 |
| bogdando | weshay: ^^ | 09:25 |
| marios | bogdando: ack i added a review here at least about the PEM https://review.openstack.org/638140 (but gerrit down ) | 09:25 |
| marios | bogdando: tht is just the readme | 09:26 |
| quiquell | marios: I think bogdando is talking about old repro | 09:26 |
| marios | bogdando: but we are very much in the improve/feedback stage | 09:26 |
| marios | bogdando: ah | 09:26 |
| quiquell | marios: the PEM stuff if for zuul repro | 09:26 |
| marios | quiquell: k sorry bogdando for confusion | 09:26 |
| bogdando | quiquell: old? just took that the CI produces in job logs :S | 09:26 |
| marios | bogdando: we are likely abandon that one | 09:26 |
| bogdando | sigh | 09:26 |
| marios | bogdando: reall soon now (tm) | 09:26 |
| bogdando | :) | 09:26 |
| quiquell | marios: ... well, bogdando wich one ? | 09:26 |
| quiquell | bogdando: could be an early bird | 09:27 |
| bogdando | quiquell: http://logs.openstack.org/61/635161/4/check/tripleo-ci-centos-7-standalone/98e6c4f/logs/reproducer-quickstart.sh | 09:27 |
| quiquell | ahh ok old one | 09:27 |
| bogdando | :( | 09:27 |
| quiquell | bogdando: I mean you are ok there | 09:27 |
| quiquell | bogdando: remove from your brain whatever we have said here now | 09:27 |
| quiquell | :-) | 09:27 |
| marios | bogdando: you can find new one in the logs too | 09:28 |
| marios | bogdando: see the http://logs.openstack.org/98/604298/242/check/tripleo-ci-centos-7-scenario001-standalone/4c8a97c/logs/README-reproducer-zuul-based-quickstart.html | 09:28 |
| marios | bogdando: try it if you have time we are in debug phase though | 09:28 |
| * bogdando cracks with his brains to remove things | 09:28 | |
| marios | bogdando: before sharing it more | 09:28 |
| bogdando | thanks | 09:29 |
| marios | bogdando: should just be do the stuff it says in setting up (keys and clouds.yaml) then download tar untar and run | 09:29 |
| marios | (tm) | 09:29 |
| quiquell | bogdando: there be dragons! be careful with it | 09:29 |
| marios | bogdando: yeah you might want to grab a box/vm somewhere not your laptop | 09:30 |
| marios | bogdando: i had selinux alerts first time i ran it | 09:30 |
| marios | :D | 09:30 |
| marios | but it was long ago it is better now with the scripting in the logs i pointed at | 09:30 |
| chandankumar | quiquell: looks good on etherpad | 09:31 |
| marios | bogdando: kudos goes to quiquell++ he is the granfather of that work | 09:31 |
| quiquell | chandankumar: ack | 09:31 |
| quiquell | hubbot has die | 09:31 |
| marios | gerrit down ? | 09:31 |
| *** derekh has joined #oooq | 09:31 | |
| marios | ah no back now | 09:31 |
| *** bogdando has quit IRC | 09:32 | |
| marios | quiquell: what was the ehter you were using for ruck rover last sprint i should review in case | 09:37 |
| quiquell | marios: there is a ref in the new one | 09:37 |
| quiquell | marios: to the old one | 09:37 |
| marios | quiquell: thx finding | 09:37 |
| marios | ruck/rover handoff: https://review.rdoproject.org/etherpad/p/ruckrover-sprint26 | 09:39 |
| marios | quiquell: empty ^ | 09:39 |
| quiquell | marios: new etherepad https://review.rdoproject.org/etherpad/p/ruckrover-unisprint6 | 09:41 |
| quiquell | marios: ref is ok there | 09:41 |
| marios | ;τηανκ υοθ | 09:41 |
| marios | quiquell: oops thank you | 09:41 |
| *** bogdando has joined #oooq | 09:45 | |
| zbr | rfolco: hi! can you please rebase 636160 on top of 638108 ? | 09:52 |
| quiquell | marios: If I encrypt rdo registry password with software factory | 09:54 |
| quiquell | marios: it's different than https://github.com/rdo-infra/review.rdoproject.org-config/blob/b883feda83d9ae1b0777a9a57027d453675ff0cd/zuul.d/secrets.yaml#L647 | 09:54 |
| quiquell | I think this is the issue | 09:54 |
| marios | quiquell: hm so we need to create a new secret | 09:54 |
| *** panda|off is now known as panda | 09:54 | |
| marios | quiquell: signed with their key | 09:54 |
| quiquell | marios: well don't know who use rdo_registry | 09:54 |
| quiquell | marios: did this encrypt_secret.py --tenant rdoproject.org --infile secret https://softwarefactory-project.io/zuul/ config | 09:55 |
| quiquell | secret contains the password | 09:55 |
| marios | quiquell: yeah and it fetches the key of the zuul you point to | 09:55 |
| marios | quiquell: and uses that | 09:55 |
| quiquell | I think it has being encrypte with review.rdoproject.org zuul | 09:55 |
| marios | quiquell: this is what i mean ^ | 09:55 |
| marios | 11:54 < marios> quiquell: hm so we need to create a new secret | 09:56 |
| marios | 11:54 < marios> quiquell: signed with their key | 09:56 |
| quiquell | marios: I think I am doing something wrong encrypting with the other zuul is also different | 09:57 |
| *** jaosorior has joined #oooq | 09:57 | |
| panda | what's with the keys ? | 09:58 |
| quiquell | panda: I may be doing something wrong | 09:59 |
| quiquell | panda: was debuging the new container push job | 09:59 |
| quiquell | panda: encrypted RDO registry passowrd with software factory zuul and is different from https://github.com/rdo-infra/review.rdoproject.org-config/blob/b883feda83d9ae1b0777a9a57027d453675ff0cd/zuul.d/secrets.yaml#L647 | 10:00 |
| panda | quiquell: you were debugging locally ? | 10:02 |
| marios | quiquell: i think sshnaidm added the current one we are trying to use he may also be able to help | 10:02 |
| marios | quiquell: but the idea is that the script fetches the key from the server you point to and uses that for the encrypt | 10:02 |
| marios | quiquell: later that server can use their own private key to decrypt and use the secret when runtime | 10:02 |
| panda | and the key can be used only by the project that defines it | 10:03 |
| panda | but in this case it's all in config | 10:03 |
| quiquell | panda: not locally no | 10:03 |
| quiquell | panda: encrypting stuff | 10:03 |
| panda | quiquell: so the new container build job is failing to push to rdoregistry because of wrong key ? | 10:04 |
| quiquell | panda: authorization issue | 10:04 |
| panda | quiquell: logs ? | 10:04 |
| quiquell | panda: I am just running the playbook manually with good passwrod and error is different | 10:04 |
| quiquell | panda: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-centos-7-master-containers-build-push/11dc160/job-output.txt.gz#_2019-02-20_22_31_13_344364 | 10:05 |
| quiquell | panda: running the playbook with good password I get | 10:05 |
| quiquell | panda: Logging into trunk.registry.rdoproject.org for user unused failed - 500 Server Error: Internal Server Error ("Get https://trunk.registry.rdoproject.org/v2/: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)") | 10:05 |
| quiquell | I will talk with sshnaidm though | 10:05 |
| quiquell | Ahh could be the timeout | 10:06 |
| marios | panda: we're not even pushing yet | 10:08 |
| marios | panda: we have it disabled in fact | 10:08 |
| marios | panda: in the job | 10:08 |
| panda | marios: ok, just logging in | 10:08 |
| marios | panda: but this is a task which logs in right | 10:08 |
| panda | marios: is fact caching on in rdosf ? | 10:09 |
| marios | panda: we need this bit right before we try to push ;D | 10:09 |
| marios | panda: dono | 10:09 |
| panda | marios: you're logging in in aplaybook, then doing other stuff in another | 10:09 |
| quiquell | panda: for encryption project is conig or rdo-jobs ? | 10:10 |
| marios | panda: there are options in the login which do that | 10:10 |
| marios | panda:at least thats how the current behaviour is with the kolla role | 10:10 |
| marios | panda: sec | 10:10 |
| panda | ok, but it's even failing to login | 10:11 |
| quiquell | panda: secret is not ok, everyting around is find in the role | 10:11 |
| quiquell | panda: in the playbook | 10:11 |
| quiquell | panda: unused username and the like | 10:11 |
| quiquell | marios, panda: rdo_registry secret was already use by the old job ? | 10:11 |
| quiquell | I think so | 10:11 |
| panda | quiquell: yes | 10:12 |
| panda | is docker_loging module available in the executor ? | 10:12 |
| marios | quiquell: see notes in https://tree.taiga.io/project/tripleo-ci-board/task/711?kanban-status=1538166 | 10:12 |
| panda | ah, I see the logs from tristan | 10:13 |
| quiquell | panda: yep | 10:13 |
| marios | https://github.com/rdo-infra/review.rdoproject.org-config/blob/176da92effd178918131a1ed4a8317c4969f5d0c/playbooks/tripleo-ci-periodic-base/containers-push-registry-login.yaml#L14-L15 https://docs.ansible.com/ansible/latest/modules/docker_login_module.html | 10:13 |
| marios | panda: ^ | 10:13 |
| marios | panda: so it updates local config with th ereauthorize | 10:13 |
| marios | panda: allowing docker push | 10:13 |
| marios | panda: but yeah | 10:14 |
| marios | panda: it fails even for the secret still | 10:14 |
| quiquell | marios, panda: I am testing it like this ansible-playbook -vvvv -e @vars.yaml playbooks/tripleo-ci-periodic-base/containers-push-registry-login.yaml | 10:14 |
| quiquell | at vars I have the secret at correct place | 10:14 |
| quiquell | ANd it goes beyond authentication | 10:14 |
| quiquell | So maybe zuul is not decrypting the thing I see secrets in the job though | 10:15 |
| marios | quiquell: cool. we wont be able to test what panda is saying until we try a push anyway but cool thanks | 10:15 |
| panda | marios: are we importing the secret in the job ? | 10:16 |
| panda | marios: yes I see it | 10:16 |
| quiquell | marios, panda: Is in the base job, could this be an issue ? | 10:16 |
| marios | quiquell: is what in the base job? secrets? no | 10:16 |
| quiquell | Humm nah same thing at dlrnapi | 10:16 |
| quiquell | yep secrets | 10:17 |
| quiquell | marios: whell but secret is not in the same place as the playbook | 10:17 |
| quiquell | I don't know if this could be an issue | 10:17 |
| quiquell | Humm looking at wrong stuff yep it is | 10:18 |
| marios | quiquell: panda dono guys i may make many mistakes there we never ran it cos it needed to merge. that just happened | 10:22 |
| marios | quiquell: panda we already know one thing missing the hash | 10:22 |
| quiquell | marios: Maybe totally unrelated but | 10:23 |
| quiquell | marios: Jobs with secrets have required-projects: | 10:23 |
| quiquell | - config | 10:23 |
| quiquell | marios: Does not have to be it | 10:23 |
| panda | quiquell: or it's possibile that being parented from a job in tripleo-ci, that job is not allowed to use rdosf secrets. | 10:25 |
| quiquell | panda: could be, let's do a mini test like the stuff we did with files and periodics | 10:25 |
| marios | panda: so who is ruck rover by the way | 10:26 |
| marios | am i it? | 10:26 |
| marios | panda: was it decided upon | 10:26 |
| panda | marios: probably not | 10:26 |
| marios | late in the twighlight hours | 10:26 |
| marios | while the rest of us slept | 10:26 |
| marios | somewhere | 10:26 |
| marios | a plan was formed | 10:26 |
| panda | marios: yes, we'll discuss rock/rover again. But chance is you're not going to do it. | 10:27 |
| quiquell | marios: there is nothing in the squad etherpad ? | 10:27 |
| quiquell | panda: btw, what task are good to take ? | 10:27 |
| quiquell | I was just helping with the error here | 10:27 |
| panda | quiquell: I too was helping, but now I will fill the sprint 6 board. We'll have to discuss on planning, but for now is good to debug what we know we need to move forward. | 10:28 |
| quiquell | panda: ack thanks | 10:29 |
| panda | and this is one of thye top priorities | 10:30 |
| panda | ohno ykarel is not here | 10:41 |
| * panda panics | 10:41 | |
| quiquell | good look next rr :-P | 10:42 |
| quiquell | sshnaidm: any news on rrcockpit.tripleo.org ? | 10:50 |
| arxcruz | panda: didn't get that task arx mvp reproducer libvirt | 10:53 |
| panda | marios: can I move this to done ? https://tree.taiga.io/project/tripleo-ci-board/issue/584?kanban-status=2048307 | 10:54 |
| panda | arxcruz: we are assigning the whole reproducer to you | 10:55 |
| arxcruz | hold my beer | 10:55 |
| panda | no, keep it, you'll need it, that and many more. | 10:55 |
| *** jaosorior has quit IRC | 10:55 | |
| marios | panda: yes | 10:55 |
| panda | marios: thanks | 10:55 |
| panda | ok, Sprint Board for Unisprint 6 is ready, except for the tempest stuff | 11:01 |
| panda | arxcruz: this sprint the reproducer work will be on hold, and the only task is gathering feedback from the team. You need to try it and report your experience. | 11:05 |
| arxcruz | panda: ack | 11:05 |
| zbr | who is rdo expert around? i have a job upstream with a depends-on on rdo-jobs which adds extra job. rdo is triggered but it does not trigger the new job, why? | 11:09 |
| zbr | mainly I would want to see that rdo-jobs definition is correct before merging it. | 11:10 |
| panda | zbr: rdo-jobs is untrusted project. You can run it before merging it | 11:12 |
| *** jaosorior has joined #oooq | 11:15 | |
| zbr | panda: i think i am missing something. please take a look at https://review.openstack.org/#/c/636160/ --- and its depends-on rdo. | 11:15 |
| sshnaidm | quiquell, yeah, started to work on that | 11:16 |
| zbr | the triggered job https://review.rdoproject.org/zuul/status?636160 does not contain the build containers job. | 11:16 |
| quiquell | sshnaidm: so we are going to bypass zuul secrets ? | 11:17 |
| sshnaidm | quiquell, you mean a reproducer? | 11:17 |
| sshnaidm | quiquell, what is the context? | 11:18 |
| quiquell | sshnaidm: Humm the secret for rdoregistry was the context | 11:18 |
| quiquell | sshnaidm: for the push job | 11:18 |
| quiquell | sshnaidm: so you are working on be able to reproduce it ? | 11:18 |
| panda | zbr: tripleo-ci doesn't container rdo-job in its required-projects, and I'm not sure even anything from rdoproject is imported in upstream CI. | 11:20 |
| panda | contain* | 11:20 |
| panda | zbr: also you're trying to import a change in the zuul configuration and make it work. I don't think openstack zuul integrates the changes with that at all. | 11:21 |
| zbr | panda: not sure about the definition of required, clearly it does not need it to run, but this also means that we cannot use depends-on? | 11:21 |
| sshnaidm | quiquell, not sure I understand.. | 11:22 |
| zbr | panda: this has nothing to do with upstream zuul, it has to do with downstream/rdo one. | 11:22 |
| zbr | i want to see the job run on rdo, triggered by a change on tripleo-ci in this case. | 11:22 |
| zbr | panda: so how can I trigger the rdo fedora-28 before merging that change? | 11:23 |
| sshnaidm | quiquell, bluejeans? | 11:23 |
| *** udesale has quit IRC | 11:26 | |
| panda | zbr: you need to add the job in rdo to the openstack-check pipeline | 11:26 |
| quiquell | 11:02 <marios> quiquell: i think sshnaidm added the current one we are trying to use he may also be able to help | 11:27 |
| quiquell | 11:02 <marios> quiquell: but the idea is that the script fetches the key from the server you point to and uses that for the encrypt | 11:27 |
| quiquell | 11:02 <marios> quiquell: later that server can use their own private key to decrypt and use the secret when runtime | 11:27 |
| quiquell | 11 | 11:27 |
| quiquell | sshnaidm: ^ | 11:27 |
| sshnaidm | quiquell, reading back.. | 11:27 |
| sshnaidm | quiquell, can you join https://bluejeans.com/u/sshnaidm/ please? It will be faster | 11:29 |
| panda | zbr: something like this https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo.yaml#L324 | 11:29 |
| quiquell | sshnaidm: ack | 11:29 |
| zbr | panda: thanks. so my mistake was to use "check" pipeline instead of "openstack-check" one at https://review.rdoproject.org/r/#/c/18913/5/zuul.d/build-containers.yaml | 11:30 |
| panda | zbr: I'm not sure you can set up third party CI in untrusted projects | 11:31 |
| panda | zbr: you may need to add that in config, not in rdo-jobs | 11:32 |
| panda | zbr: because you need to specify which project to check too. | 11:39 |
| quiquell | panda, marios: Running fake jobs with similar stuff for the loing in the repro | 11:40 |
| zbr | panda: but the list of required-projects is already defined at parent levels | 11:40 |
| quiquell | to test authentication | 11:40 |
| panda | zbr: required project defines which project the job uses, not which project to watch for change that triggers them | 11:41 |
| *** ratailor has quit IRC | 11:42 | |
| quiquell | panda: Did you say something about python-docker at zuul-executor ? | 11:44 |
| panda | quiquell: I was wondering if the module was installed | 11:51 |
| panda | quiquell: but tristan was showing logs from the registry itself | 11:51 |
| quiquell | panda: is failing on me in the reproducer and failure is different | 11:51 |
| panda | quiquell: meaning that the module was contacting the registry already and faialing | 11:51 |
| quiquell | panda: yep is doing stuff | 11:51 |
| quiquell | panda: also using this same playbook with good password works fine | 11:51 |
| quiquell | panda: is something with the secrets | 11:51 |
| marios | lunch biab | 11:53 |
| sshnaidm | quiquell, seems like we can't use different host for grafana.. https://community.grafana.com/t/multiple-root-urls-for-grafana/6562/3 | 11:53 |
| sshnaidm | quiquell, http://cockpit-ci.tripleo.org:8080/ | 11:54 |
| quiquell | If you host grafana under subpath make sure your grafana.ini root_path setting includes subpath | 11:54 |
| quiquell | maybe this ? | 11:54 |
| *** jpena is now known as jpena|lunch | 11:56 | |
| sshnaidm | quiquell, it's for cases like http://doo.bar/something/grafana/ | 11:57 |
| quiquell | sshnaidm: ok :-( | 11:57 |
| sshnaidm | quiquell, I'll look, maybe rewrite rules.. | 11:57 |
| quiquell | sshnaidm: ugly url is then | 11:57 |
| sshnaidm | quiquell, I mean rewriting all requests from cockpit to "dashboard-ci.." | 11:58 |
| *** holser_ is now known as holser|lunch | 12:00 | |
| quiquell | sshnaidm: let's try it | 12:00 |
| sshnaidm | quiquell, ha! http://cockpit-ci.tripleo.org:8080/ | 12:01 |
| sshnaidm | quiquell, seems like this is the only option, grafana won't serve something from different domain | 12:02 |
| sshnaidm | quiquell, is it ok to have such redirect? | 12:02 |
| quiquell | nicer | 12:02 |
| quiquell | I think | 12:02 |
| quiquell | we cannot bypass port ? | 12:02 |
| sshnaidm | quiquell, yeah, 8080 is just for test | 12:04 |
| quiquell | ack then is all good | 12:04 |
| sshnaidm | ok | 12:04 |
| quiquell | if url is ugly later on no problem | 12:04 |
| *** quiquell is now known as quiquell|lunch | 12:05 | |
| zbr | marios: you asked to be pinged about update of https://review.openstack.org/#/c/637212/ :) | 12:06 |
| *** jfrancoa has quit IRC | 12:17 | |
| *** jfrancoa has joined #oooq | 12:32 | |
| *** saneax has joined #oooq | 12:40 | |
| marios | zbr: ack | 12:53 |
| rfolco | zbr, your tripleo-ci change depends-on rdo change ?? shouldn't be the opposite? | 13:00 |
| zbr | rfolco: not sure, afaik we can use deps in any direction | 13:01 |
| zbr | rfolco: and for sure I do not want to merge the upstream job without seeing a fedora-28 job being run | 13:01 |
| rfolco | zbr, sure but it does not make sense to me... You chnage the playbook and role in tripleo-ci... then in rdo you define the job and depends-on upstream change to run your rdo job | 13:02 |
| rfolco | zbr, we are missing 2 kolla patches still as I said. I talked to Alex. | 13:02 |
| rfolco | zbr, I'll review and we can sync | 13:03 |
| zbr | rfolco: i will be happy if the only thing broken would be inside kolla. | 13:03 |
| zbr | for the moment I am trying to trigger the job on rdo. so we have somethign to compare with | 13:04 |
| rfolco | zbr, yesteday that was the case | 13:04 |
| zbr | rfolco: already made new discoveries: https://logs.rdoproject.org/13/18913/9/check/tripleo-build-containers-fedora-28/9412866/job-output.txt.gz | 13:05 |
| zbr | the rdo fedora-28 nodes are different than the upstream ones, so it chockes | 13:05 |
| *** trown|outtypewww is now known as trown | 13:06 | |
| weshay | sshnaidm you guys moving the cockpit? | 13:09 |
| *** quiquell|lunch is now known as quiquell | 13:10 | |
| quiquell | weshay: short the url | 13:14 |
| quiquell | weshay: old url is still working | 13:14 |
| quiquell | weshay: it can be shared as cockpit-ci.tripleo.org too | 13:14 |
| quiquell | weshay: is nicer | 13:14 |
| *** jpena|lunch is now known as jpena | 13:15 | |
| zbr | it seems that using rdo-fedora-28 nodeset was wrong, i guess i need to use single-upstream-fedora-28-node | 13:18 |
| weshay | panda do mind putting my public key in ~/.ssh/whayutin on 38.145.33.166 | 13:19 |
| weshay | ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs/fvCoMm/bOLehNLGEhWnMZfJndO4rK2Q8OOrYOAGKpMT5xiWZsPgxGai4vieZ2HmdyXBB2DX5g1FjwGJUWuxPRYT5vAQlseOfyTLqhkHaSmuWcpH6HuP+KvxWO9epyXP8pl7uZLsbVEr5207ER4bYLIg2bk2LRQqxnysG3t4VqbAV0V+YKrkkwwErsHDbLJyz2sqtJielpKZOCF+vFnzrUR3dmORZ4bchBnmf67CFAJqPd1zSU9Hn0fWZ5nVxJMk1o/bxqwIZ6E7a9Yw5bJl3ziGP5WfcSfati4LKGWI503SNwSWLOuL03 | 13:19 |
| weshay | j2LaLO3GgLSVFUo9eGT6KhN3dogWeaWXDDFvx+O0RfdZFL0+mRFl2Rz83QsJGFBm1JW2H1/W0vUxtXmZhUXFagSt75zh2AQPoatsYgUOCpC4qFSVRXFyZR0a1Q5JnqmtFrYDuIoMovdfelgKEnJ5xBNhmGLpJlRmSIiv4tRNYUvaU4fKnt/yLTtZNT+D7zM4KMUzNy8pqEbUugAGGxMlCs1YfzwOL4+OHxrDX5A5TlvTnjNBHmBWXDQJncXTewjTf1+6oLkGKHMSd8UsGjYTLWX1JepFcHUj5+SF5arVKz/gThvQlelpPzXZgK9MNUSKfU9GHQ79T14Kng9Cfx/BcUYsZmFmCg | 13:19 |
| weshay | zj2M1neFD7M3kOFQ8PV2ow== whayutin@thinkdoe | 13:19 |
| panda | weshay: any place where I can wget this ? IRC is breaking it up | 13:21 |
| panda | weshay: nevermind, try now | 13:22 |
| weshay | https://github.com/weshayutin.keys | 13:23 |
| weshay | hrm.. that's odd.. permission denied | 13:23 |
| weshay | I'm in | 13:24 |
| panda | ok | 13:24 |
| weshay | thanks | 13:24 |
| weshay | panda the cleanup script should live there right? | 13:25 |
| panda | weshay: yes | 13:25 |
| panda | weshay: /opt/stack/ci-config/ci-scripts/infra-cleanup/ovb-tenant-cleanup.sh | 13:25 |
| *** holser|lunch is now known as holser_ | 13:26 | |
| weshay | hrm.. it's not in cron | 13:26 |
| rfolco | zbr, I don't think this is the right approach. In rdo you define the job, so you should depend on upstream job. We need to sync. | 13:26 |
| weshay | how is that running | 13:26 |
| panda | weshay: as root, crontab -l | 13:26 |
| weshay | thanks | 13:27 |
| * weshay wonders why we have it as root, doesn't matter not a big deal | 13:27 | |
| quiquell | sshnaidm: grafana version is older than stuff in the code :-/ | 13:27 |
| zbr | rfolco: i agree with you, that we need to declare job on rdo and use parent from upstream. that is the goal. i will probably remove the other depends-on. | 13:27 |
| quiquell | sshnaidm: Did we did something in the rrcockpit node ? | 13:28 |
| panda | weshay: probably because it's the common neutral user you can reach in a single sudo -i | 13:28 |
| sshnaidm | quiquell, weshay yep, moved things, should work now | 13:28 |
| quiquell | sshnaidm: grafana has being downgraded to 5.2.2 | 13:29 |
| quiquell | sshnaidm: at rrcockpit | 13:29 |
| weshay | chandankumar howdy | 13:31 |
| sshnaidm | quiquell, yeah, it has an old docker-compose file.. | 13:32 |
| panda | weshay: moved user stories to Unified Sprint 6, except fro tempest. I don't know which to move, I suppose it will be done during tempest planning. | 13:32 |
| quiquell | sshnaidm: so next ansible-pull will fix it ? | 13:32 |
| sshnaidm | quiquell, yeah, fixing.. | 13:35 |
| quiquell | panda: was thinking on trying to take this task https://tree.taiga.io/project/tripleo-ci-board/task/761?kanban-status=1447274 | 13:37 |
| quiquell | panda: to learn a little tempest | 13:37 |
| rfolco | marios, can you please explain me how -push jobs work ? how do you get the built containers and just push to registry in a separate job ? | 13:38 |
| quiquell | panda: or it has a owner already ? | 13:38 |
| marios | quiquell: any idea http://pastebin.test.redhat.com/719366 marios@ibm-x3650m4-01-vm-05 ~]$ ssh-keyscan -t ssh-rsa -p 29418 review.openstack.org read (review.openstack.org): Network is unreachable | 13:38 |
| marios | quiquell: but review.rdoproject.org OK | 13:38 |
| marios | rfolco: containers are built in upstream | 13:38 |
| marios | rfolco: want to have a blue? | 13:38 |
| rfolco | sure | 13:39 |
| rfolco | one min | 13:39 |
| marios | rfolco: make it 5 gets coffee | 13:39 |
| marios | and we contienue into sprint | 13:39 |
| *** rlandy has joined #oooq | 13:40 | |
| quiquell | marios: checking | 13:41 |
| marios | rfolco: https://redhat.bluejeans.com/7661925373/ whenever you're ready me join now | 13:42 |
| quiquell | marios: can you ping review.openstack.org ? | 13:42 |
| quiquell | marios: the other day at the office It didn't work to me either | 13:42 |
| marios | PING review01.openstack.org (104.130.246.32) 56(84) bytes of data. | 13:43 |
| marios | ^^64 bytes from review01.openstack.org (104.130.246.32): icmp_seq=1 ttl=47 time=65.6 ms | 13:43 |
| marios | quiquell: yah looks like | 13:43 |
| marios | quiquell: ack will try later talking folco now thanks | 13:43 |
| quiquell | ack | 13:43 |
| quiquell | marios: maybe you hace something weird at your known_hosts | 13:43 |
| marios | quiquell: had couple of issues to get here but nothing major | 13:44 |
| marios | quiquell: looks like reproducer getting stable | 13:44 |
| marios | rlandy:++ trying your scripts | 13:44 |
| quiquell | marios: \o/ happy to hear, let's see if it is even usefull hehe | 13:45 |
| rlandy | marios: happy it's working for someone outside the immediate team that worked on it :) | 13:45 |
| zbr | ruck: i see multiple failures upstream: seem random but enough to block merges https://review.openstack.org/#/c/638108/ | 13:46 |
| panda | zbr: checking | 13:48 |
| panda | zbr: anything other than tripleo-ci-centos-7-containers-multinode failing ? | 13:48 |
| rfolco | zbr, https://redhat.bluejeans.com/7661925373/ | 13:49 |
| rfolco | zbr, pls join us - me and marios | 13:49 |
| zbr | look at prev execution failure, another job, totally unrelated to the change. | 13:49 |
| zbr | it failed gate, it failed check after, different place and unrelated to that change. clearly it needs to pass zuul twice to merge. just bad luck? | 13:50 |
| marios | zbr: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/jobs.yaml#L497 | 13:53 |
| marios | rfolco: ^ | 13:53 |
| rfolco | sprint planning marios, quiquell, sshnaidm, weshay, panda, rlandy, arxcruz, mwhahaha, rfolco, chkumar, ssbarnea, kopecmartin | 14:01 |
| rlandy | rfolco: we're meeting in arx's bluejeans? | 14:01 |
| rfolco | no... why? | 14:01 |
| rlandy | that's in the meeting invite | 14:01 |
| zbr | me an rlandy are in the documented meeting..... just us | 14:01 |
| rfolco | https://bluejeans.com/5878458097 | 14:01 |
| *** jaosorior has quit IRC | 14:08 | |
| *** vinaykns has joined #oooq | 14:09 | |
| marios | panda: https://www.youtube.com/watch?v=l7ZlSHGFfdc | 14:13 |
| marios | panda: "time is now " ;) | 14:13 |
| *** panda is now known as panda|ruck | 14:16 | |
| vinaykns | sshnaidm: hey..! do we have a successful deployment of tls everywhere with quickstart..? | 14:18 |
| sshnaidm | vinaykns, I prepared a patch that should fix last breakages: https://review.openstack.org/#/c/638306/ | 14:19 |
| sshnaidm | vinaykns, please try to use it with the latest code | 14:19 |
| vinaykns | okay..what are the arguments that you've given..? | 14:20 |
| *** udesale has joined #oooq | 14:22 | |
| *** jaosorior has joined #oooq | 14:30 | |
| panda|ruck | sshnaidm: if https://tree.taiga.io/project/tripleo-ci-board/us/668?milestone=220350 is already done, I'll move it back as done on Sprint 5 | 14:42 |
| marios | quiquell: 652 is containers push job | 14:42 |
| sshnaidm | panda|ruck, yeah, it's done | 14:43 |
| panda|ruck | sshnaidm: ok thanks moved | 14:46 |
| marios | panda|ruck: rfolco wdyt && fyi https://review.openstack.org/#/c/638363/ | 14:56 |
| *** dsneddon has joined #oooq | 15:01 | |
| panda|ruck | marios: so you're not focusing on the meeting ? :) | 15:02 |
| *** skramaja has quit IRC | 15:04 | |
| sshnaidm | arxcruz, chandankumar do you know what's problem with tempest? DuplicateOptError: duplicate option: barbican http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset030-master/4a01bd0/job-output.txt.gz | 15:04 |
| sshnaidm | seems like in a lot of promotion jobs | 15:04 |
| *** jaosorior has quit IRC | 15:08 | |
| *** saneax has quit IRC | 15:08 | |
| arxcruz | sshnaidm: ill take a look | 15:08 |
| *** dsneddon has quit IRC | 15:11 | |
| *** dsneddon has joined #oooq | 15:12 | |
| *** dsneddon has quit IRC | 15:18 | |
| chandankumar | sshnaidm: we have seen these issues yesterday might be some pluign is screwing it | 15:18 |
| chandankumar | sshnaidm: but not able to dig into it | 15:18 |
| *** dsneddon has joined #oooq | 15:19 | |
| marios | panda|ruck: yes | 15:20 |
| *** holser_ has quit IRC | 15:20 | |
| marios | rlandy: weshay fyi https://review.openstack.org/#/c/638140/ minor note in the reproducer doc | 15:21 |
| rlandy | marios: responded - F28 should work | 15:23 |
| panda|ruck | marios: fedora28 worked for me | 15:24 |
| *** dsneddon has quit IRC | 15:24 | |
| *** dsneddon has joined #oooq | 15:25 | |
| *** holser_ has joined #oooq | 15:26 | |
| marios | rlandy: thanks | 15:33 |
| marios | panda|ruck: thanks | 15:33 |
| marios | rlandy: panda|ruck mine was like http://pastebin.test.redhat.com/718378 | 15:34 |
| marios | rlandy: panda|ruck no docker dockerrrot groups | 15:34 |
| *** apetrich has quit IRC | 15:36 | |
| rlandy | marios: did you have the latest? https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/create-zuul-based-reproducer/templates/reproducer-zuul-based-quickstart.sh.j2#L200? | 15:38 |
| marios | rlandy: i used doc in http://logs.openstack.org/98/604298/239/check/tripleo-ci-centos-7-scenario001-standalone/fada7a1/logs/README-reproducer-zuul-based-quickstart.html | 15:39 |
| rlandy | marios: yeah, I think we need to default DG | 15:39 |
| marios | rlandy: yeah i think so (thats the code that fails here what you're pointing at) | 15:39 |
| rlandy | marios: yep - that's probably a bug in a clean system with no docker | 15:40 |
| *** apetrich has joined #oooq | 15:41 | |
| rlandy | weshay: fyi ... $DG lands up empty | 15:42 |
| arxcruz | chandankumar: sshnaidm i'm setting up an env to debug this | 15:46 |
| chandankumar | arxcruz: sure, let me know if you need any help | 15:46 |
| arxcruz | chandankumar: ack | 15:46 |
| *** jaosorior has joined #oooq | 15:46 | |
| chandankumar | arxcruz: do you know why we have two packages published related to stackviz on tarballs.openstack.org ? | 15:47 |
| arxcruz | chandankumar: no idea | 15:47 |
| chandankumar | arxcruz: http://tarballs.openstack.org/package-stackviz-element/ | 15:47 |
| chandankumar | arxcruz: and this http://tarballs.openstack.org/stackviz/dist/ | 15:47 |
| arxcruz | chandankumar: both seems to be the same, honestly, i don't know | 15:49 |
| chandankumar | arxcruz: nope | 15:49 |
| chandankumar | arxcruz: package-stackviz has html files but other has only py files | 15:49 |
| chandankumar | arxcruz: i was trying to fix os_tempest deps | 15:49 |
| chandankumar | there I was blocked | 15:49 |
| chandankumar | it leads me to rdo stackviz package | 15:50 |
| arxcruz | chandankumar: i'm seeing similar content in both tarballs | 15:50 |
| chandankumar | gulp html stuff missing | 15:51 |
| chandankumar | let me fpaste all the output of both tarball | 15:51 |
| *** tosky has quit IRC | 15:53 | |
| *** tosky has joined #oooq | 15:54 | |
| marios | zbr: https://github.com/openstack-infra/tripleo-ci/blob/master/roles/ceph-loop-device/tasks/main.yml | 15:56 |
| zbr | marios: looks simple | 15:57 |
| chandankumar | arxcruz: http://paste.openstack.org/show/745627/ | 15:57 |
| arxcruz | chandankumar: no idea... | 15:58 |
| chandankumar | arxcruz: will look tomorrow | 15:58 |
| panda|ruck | marios: it was you after a two hours meeting | 16:06 |
| marios | panda|ruck: no i'm getting better come one | 16:06 |
| panda|ruck | also me a little | 16:06 |
| marios | panda|ruck: :D | 16:06 |
| marios | i didn't complain once | 16:06 |
| panda|ruck | I'll need extra chocolate | 16:06 |
| quiquell | rfolco: new etherpad with pending issues https://review.rdoproject.org/etherpad/p/ruckrover-unisprint6 | 16:07 |
| quiquell | panda|ruck: ^ | 16:07 |
| *** rfolco is now known as rfolco|rover | 16:07 | |
| quiquell | But there is not much there | 16:07 |
| panda|ruck | quiquell: because you already solved everything ? | 16:07 |
| quiquell | panda|ruck: well chandankumar did | 16:08 |
| quiquell | panda|ruck: I was like the sidekick | 16:08 |
| panda|ruck | then we don't need rucks this sprint | 16:08 |
| panda|ruck | \o/ | 16:08 |
| quiquell | go to your chocolate | 16:08 |
| panda|ruck | brb chocolate | 16:08 |
| chandankumar | if someone want to mess I have one old bug handly | 16:08 |
| rfolco|rover | uhuu | 16:08 |
| chandankumar | can someone parcel me so many beers | 16:08 |
| chandankumar | ? | 16:08 |
| chandankumar | but not irish beers | 16:09 |
| quiquell | chandankumar: so there is not much to hand over I think | 16:09 |
| chandankumar | quiquell: yes | 16:09 |
| quiquell | chandankumar: like for sure now is all broken for different reasons | 16:09 |
| quiquell | so we don't care :-) | 16:09 |
| chandankumar | panda|ruck: rfolco|rover https://bugs.launchpad.net/tripleo/+bug/1805102 if you have time , feel free to take a look at this bug | 16:09 |
| openstack | Launchpad bug 1805102 in tripleo "[master][rocky][fs02] ERROR! Unexpected Exception, this is probably a bug: No module named tripleo_common in upload job while converting image" [Critical,Triaged] | 16:09 |
| chandankumar | it is still seen | 16:10 |
| quiquell | chandankumar: looks like queens backport at gnocci merged | 16:10 |
| quiquell | chandankumar: so this is close too | 16:10 |
| chandankumar | quiquell: yes only rdo stuff pending | 16:10 |
| chandankumar | quiquell: need to wait for yatin to clear -1 | 16:11 |
| quiquell | chandankumar: ack, can you add the RDO review to the etherpad ? | 16:11 |
| *** udesale has quit IRC | 16:11 | |
| chandankumar | quiquell: sure | 16:11 |
| quiquell | Have to drop | 16:12 |
| quiquell | panda|ruck, rfolco|rover: I can do more sync tomorrow if you need | 16:12 |
| *** quiquell is now known as quiquell|off | 16:13 | |
| *** hamzy has quit IRC | 16:15 | |
| chandankumar | panda|ruck: rfolco|rover added gnocchi fixes, I will take care of that | 16:16 |
| chandankumar | panda|ruck: rfolco|rover we have tested the fix, it is working now! | 16:16 |
| chandankumar | let us know if you need any help, I have added ovn patches, not sure it will break stuff | 16:18 |
| chandankumar | but good to keep an eye on | 16:18 |
| rfolco|rover | thx chandankumar quiquell|off | 16:20 |
| chandankumar | :-) | 16:23 |
| panda|ruck | rfolco|rover: can't access 38.145.32.196 | 16:27 |
| rfolco|rover | panda|ruck, what is it ? | 16:27 |
| panda|ruck | rfolco|rover: taigacli | 16:28 |
| rfolco|rover | panda|ruck, 38.145.32.227/taigacli | 16:32 |
| rfolco|rover | panda|ruck, add to your hosts | 16:32 |
| *** kopecmartin is now known as kopecmartin|off | 16:33 | |
| * chandankumar clears telemetry tempest plugin release upstream for queens and rocky | 16:34 | |
| panda|ruck | rfolco|rover: why do I see the other IP in the dashboard ? o_O | 16:35 |
| rfolco|rover | not sure where you see it... I recorded here https://tree.taiga.io/project/tripleo-ci-board/task/699?kanban-status=1447277 | 16:35 |
| rfolco|rover | panda|ruck, if I put the wrong ip somwehere I beg your forgiveness Lord Panda | 16:36 |
| rfolco|rover | your magesty | 16:36 |
| rfolco|rover | majesty | 16:36 |
| panda|ruck | rfolco|rover: you may raise. | 16:37 |
| panda|ruck | rfolco|rover: no wait, a little bit more; | 16:37 |
| panda|ruck | rfolco|rover: anyway it's not you, it's horizon | 16:37 |
| rfolco|rover | haha | 16:38 |
| rfolco|rover | ok | 16:38 |
| panda|ruck | rfolco|rover: in tripleo-infra tenant, I see a taigacli with folco-station keypair, and the ip I mentioned | 16:38 |
| rfolco|rover | horizon is a joker | 16:39 |
| *** hamzy has joined #oooq | 16:40 | |
| rfolco|rover | panda|ruck, you should choose better your friendships | 16:40 |
| rfolco|rover | brb lunch | 16:40 |
| chandankumar | panda|ruck: rfolco|rover https://review.openstack.org/#/c/635152/ this is good to go lets enable it | 16:44 |
| chandankumar | is there some issue with http://logs.openstack.org/29/637729/8/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/1d75d3b/ in check job | 16:46 |
| chandankumar | it got failed at two places | 16:46 |
| chandankumar | http://logs.openstack.org/29/637729/8/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/1d75d3b/job-output.txt.gz#_2019-02-20_22_19_36_356464 | 16:46 |
| chandankumar | IOError: [Errno 26] Text file busy: '/home/zuul/workspace/.quickstart/bin/python2' -> race condition | 16:46 |
| panda|ruck | rfolco|rover: nova agrees with horizon | 16:46 |
| *** jfrancoa has quit IRC | 16:51 | |
| panda|ruck | rfolco|rover: 40644b8f-a37b-4f46-95d4-c292e5b70d86 | taigacli | ACTIVE | - | Running | private=192.168.100.20, 38.145.32.196 | 16:53 |
| panda|ruck | zbr: do you have the tripleo-ci taiga user password again ? | 16:57 |
| marios | weshay: please see pvt when you have a minute | 16:59 |
| *** vinaykns has quit IRC | 17:01 | |
| chandankumar | arxcruz: I think I have solved the os_tempest dependency issue patches | 17:05 |
| chandankumar | arxcruz: https://review.openstack.org/#/q/topic:os_tempest_deps+(status:open+OR+status:merged) | 17:05 |
| chandankumar | need to wait for finish the recheck | 17:06 |
| *** vinaykns has joined #oooq | 17:06 | |
| *** bogdando has quit IRC | 17:12 | |
| vinaykns | sshnaidm: any workaround for this http://pastebin.test.redhat.com/719637 | 17:12 |
| sshnaidm | vinaykns, can you paste your home/guest/.quickstart/ssh.config.ansible ? | 17:16 |
| sshnaidm | vinaykns, do you use quickstart with this patch? https://review.openstack.org/#/c/638306/ | 17:16 |
| vinaykns | sshnaidm: http://pastebin.test.redhat.com/719641 | 17:18 |
| vinaykns | sshnaidm: I guess I forgot to specify -n flag | 17:18 |
| sshnaidm | vinaykns, you don't use this patch | 17:18 |
| sshnaidm | vinaykns, get it into quickstart, it will solve your problem | 17:19 |
| vinaykns | yeah I forgot to add the "-n" flag i believe | 17:19 |
| *** dtantsur is now known as dtantsur|afk | 17:29 | |
| *** ccamacho has quit IRC | 17:36 | |
| *** trown is now known as trown|lunch | 17:38 | |
| *** amoralej is now known as amoralej|off | 17:44 | |
| *** panda|ruck is now known as panda|ruck|off | 17:48 | |
| zbr | @oooq I am going to invite you to 1Password where I keep shared credentials. no need to install any client, you can access the team vault online. | 18:13 |
| weshay | k | 18:20 |
| *** jpena is now known as jpena|off | 18:29 | |
| rfolco|rover | zbr, I liked it, looking for a simple password manager for a while. Thanks! | 18:32 |
| weshay | rfolco|rover here's an opportunity to fix a tempest issue https://bugs.launchpad.net/tripleo/+bug/1817154 | 18:34 |
| openstack | Launchpad bug 1817154 in tripleo " DuplicateOptError: duplicate option: barbican" [Critical,Triaged] | 18:34 |
| rfolco|rover | weshay, barbican, I can't | 18:35 |
| rfolco|rover | </joke> | 18:35 |
| zbr | rfolco|rover: gave you access to the redhat vault. i need to do this manually after confirming each account. you should see there 3 credentials. | 18:35 |
| weshay | chandankumar++ | 18:36 |
| weshay | quiquell++ | 18:36 |
| *** trown|lunch is now known as trown | 18:52 | |
| *** holser_ has quit IRC | 18:55 | |
| *** ccamacho has joined #oooq | 19:31 | |
| zbr | weshay: https://docs.google.com/spreadsheets/d/1e-kk-6kMkk4mbrk5AtVsx2tmsGyk15yW9kO_nsaMJmc/edit#gid=0 | 20:04 |
| rlandy | weshay; pls review/vote on https://review.openstack.org/#/c/636763/ https://review.rdoproject.org/r/#/c/18833/ - these jobs may need to be fixed but will help us iterate downstream | 20:37 |
| rlandy | zbr: ^^ | 20:37 |
| weshay | k | 20:46 |
| weshay | rlandy the nodeset is ovb-centos-7-primary? | 20:49 |
| weshay | ya.. I see why | 20:49 |
| rlandy | weshay: really it's just a base job | 20:50 |
| rlandy | to override | 20:50 |
| rlandy | it will probably need to change | 20:50 |
| weshay | rlandy but why do we need anything defined in rdo? | 20:50 |
| rlandy | but we wont know until we get started | 20:50 |
| rlandy | weshay: sdlrn reporting | 20:50 |
| rlandy | pre and post | 20:50 |
| weshay | wait.. the reporting would be from internal post | 20:51 |
| rlandy | I could redefine those in internal | 20:51 |
| weshay | ya.. I dont see why rdo is in the mix | 20:51 |
| rlandy | perioidc | 20:51 |
| rlandy | I would have to copy the playbooks for reporting | 20:51 |
| weshay | should we chat? | 20:52 |
| weshay | probably should | 20:52 |
| rlandy | pre-run: playbooks/tripleo-ci-periodic-base/pre.yaml | 20:52 |
| rlandy | post-run: playbooks/tripleo-ci-periodic-base/post.yaml | 20:52 |
| rlandy | yea - we can | 20:52 |
| rlandy | been chatting with nhicher the whole afternoon re:job definitions | 20:53 |
| rlandy | bj? | 20:53 |
| weshay | aye | 20:53 |
| weshay | I'm in | 20:53 |
| rlandy | joining | 20:54 |
| *** dsneddon has quit IRC | 21:11 | |
| *** brault has joined #oooq | 21:28 | |
| *** dsneddon has joined #oooq | 21:32 | |
| *** trown is now known as trown|outtypewww | 22:07 | |
| *** hamzy has quit IRC | 22:21 | |
| vinaykns | http://pastebin.test.redhat.com/719808 any workaround..? | 22:27 |
| *** jtomasek has quit IRC | 22:37 | |
| weshay | vinaykns ya.. so if your virthost has ipv6 enabled I've seen that issue.. | 22:48 |
| weshay | because the name resolution does not work | 22:48 |
| weshay | vinaykns another fix is to https://github.com/openstack/tripleo-quickstart/blob/master/config/environments/default_libvirt.yml#L13 | 22:49 |
| weshay | turn off nameserver_from_virthost if name resolution is a problem | 22:50 |
| rlandy | weshay: well, that was fun :) | 22:51 |
| weshay | rlandy heh | 22:51 |
| weshay | vinaykns you could make a similiar change in your config https://review.openstack.org/#/c/636073/3/toci-quickstart/config/testenv/multinode.yml | 22:52 |
| weshay | vinaykns basically get on your undercloud and see if name resolution is working | 22:52 |
| weshay | probably isn't | 22:52 |
| vinaykns | weshay: yeah undercloud isn't giving out name if I ping with an address | 23:00 |
| vinaykns | weshay: well I could see address list if I do nslookup | 23:05 |
| *** rascasoft has quit IRC | 23:10 | |
| *** tosky has quit IRC | 23:11 | |
| weshay | vinaykns would be interesting to see what you have in /etc/resolv.conf | 23:15 |
| weshay | when you hit the issue | 23:15 |
| vinaykns | I have nameserver 192.168.23.10 | 23:15 |
| weshay | k.. can you resolve the ntp servers in /etc/chrony? | 23:17 |
| weshay | http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/deployment/timesync/chrony-baremetal-ansible.yaml#n124 | 23:17 |
| weshay | chronyc waitsync 20 | 23:17 |
| weshay | is failing | 23:17 |
| weshay | because of your nameserver | 23:17 |
| weshay | if you add 1.1.1.1 you should be ok | 23:18 |
| vinaykns | so i could do undercloud_undercloud_nameserver-1.1.1.1 | 23:19 |
| vinaykns | as argument to quickstart.sh ..? | 23:19 |
| weshay | I would use an array, but yes | 23:19 |
| weshay | vinaykns you can manually try it | 23:19 |
| weshay | get on your undercloud | 23:19 |
| weshay | run chronyc waitsync 20 | 23:20 |
| weshay | see if it fails | 23:20 |
| weshay | probably will | 23:20 |
| vinaykns | okay | 23:20 |
| weshay | add an additional name server | 23:20 |
| weshay | 1.1..1.1 in addtion to 192.168. | 23:20 |
| weshay | and rerun chronyc waitsync 20 | 23:20 |
| weshay | should work | 23:20 |
| vinaykns | yeah..now it worked | 23:21 |
| vinaykns | so how did it work..? | 23:22 |
| weshay | because you have a working name server now | 23:22 |
| vinaykns | even with 192.168.. I could get try: 1, refid: 0A10FF01, correction: 0.000010568, skew: 0.021 | 23:24 |
| vinaykns | on UC | 23:24 |
| vinaykns | I have the issue on OC...even adding nameserver 1.1.1.1 doesn't work for me | 23:28 |
| vinaykns | gotcha..issue is in /etc/chrony.conf the server is poo.ntp.org | 23:46 |
| vinaykns | i have changed it to one present in the UC..which is clock.redhat.com | 23:47 |
| vinaykns | weshay: thx.!! | 23:47 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!