| *** sanjayu_ has quit IRC | 00:20 | |
| *** trungnv has quit IRC | 00:35 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024, tripleo-ci-centos-7 (3 more messages) | 00:37 |
|---|---|---|
| *** dtrainor has quit IRC | 01:04 | |
| *** dtrainor has joined #oooq | 01:05 | |
| *** rlandy|bbl is now known as rlandy | 01:09 | |
| *** dtrainor has quit IRC | 01:24 | |
| *** huynq has joined #oooq | 02:02 | |
| *** agopi has joined #oooq | 02:13 | |
| *** apetrich has quit IRC | 02:16 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb- (3 more messages) | 02:37 |
| *** dtrainor has joined #oooq | 02:42 | |
| *** vinaykns has quit IRC | 03:40 | |
| *** ykarel|away has joined #oooq | 03:54 | |
| *** ykarel|away is now known as ykarel | 03:54 | |
| *** saneax has joined #oooq | 03:58 | |
| *** jaganathan has quit IRC | 03:58 | |
| *** udesale has joined #oooq | 04:27 | |
| *** ykarel has quit IRC | 04:30 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000 (3 more messages) | 04:37 |
| *** ykarel has joined #oooq | 04:49 | |
| *** ratailor has joined #oooq | 04:58 | |
| *** jaganathan has joined #oooq | 05:10 | |
| *** jfrancoa has joined #oooq | 05:27 | |
| *** rlandy has quit IRC | 05:31 | |
| *** jaganathan has quit IRC | 06:09 | |
| *** jaganathan has joined #oooq | 06:27 | |
| *** kopecmartin|off is now known as kopecmartin | 06:34 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000 (3 more messages) | 06:37 |
| jfrancoa | chandankumar: Hello, by any chance, do you know why the tempest tests are failing in the stable/queens tripleo-common patches: https://review.openstack.org/611329 ? | 06:39 |
| jfrancoa | chandankumar: this is what I see in the tempest log: http://logs.openstack.org/29/611329/3/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/38cfc40/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-10-24_18_08_26 | 06:40 |
| jfrancoa | chandankumar: ok, I think I found a hint: http://logs.openstack.org/29/611329/3/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/38cfc40/logs/subnode-2/var/log/containers/nova/nova-compute.log.txt.gz#_2018-10-24_18_09_10_044 | 06:41 |
| chandankumar | jfrancoa: yes correct | 06:44 |
| sshnaidm|ruck | quiquell|off, hola | 06:45 |
| chandankumar | jfrancoa: check with #tripleo channel, It might be a selinux issue or something else | 06:45 |
| jfrancoa | chandankumar: thanks a lot | 06:46 |
| *** quiquell|off is now known as quiquell | 06:49 | |
| quiquell | sshnaidm|ruck: Helo there | 06:49 |
| quiquell | s/Helo/Hello/ | 06:49 |
| sshnaidm|ruck | quiquell, I added table of noop jobs in grafana, maybe better to keep eye on them instead of points | 06:50 |
| sshnaidm|ruck | quiquell, but don't remember how to export to review, can you please write a little readme about it? | 06:50 |
| quiquell | sshnaidm|ruck: sure, let me finish a proto for the Wes email about TIMED_OUT, tell me if you like the idea | 06:51 |
| ykarel | sshnaidm|ruck, is this issue known:- ERROR! Unexpected Exception, this is probably a bug: No module named tripleo_common | 06:54 |
| ykarel | 2018-10-25 02:25:27.422608 | primary | to see the full traceback, use -vvv | 06:54 |
| ykarel | seeing in master upload job: https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/a509ff3/job-output.txt.gz | 06:55 |
| sshnaidm|ruck | ykarel, no, didn't see it before | 06:58 |
| sshnaidm|ruck | ykarel, will look closer, weird thing | 06:58 |
| ykarel | sshnaidm|ruck, hmm similar job in pike passed, so strange | 06:58 |
| ykarel | sshnaidm|ruck, do you know what fixed ovb jobs, i see good number of passes recently | 06:59 |
| *** apetrich has joined #oooq | 07:00 | |
| *** ccamacho has joined #oooq | 07:09 | |
| quiquell | sshnaidm|ruck: Added little readme https://review.rdoproject.org/r/17114 | 07:36 |
| sshnaidm|ruck | ykarel, I think it's fixes in rdo cloud | 07:43 |
| sshnaidm|ruck | ykarel, no other reasons to fail for them | 07:43 |
| ykarel | sshnaidm|ruck, ack | 07:51 |
| ykarel | ssbarnea|bkp2, it looks like failures in third party jobs are related to ur patch, can u check and block the merge if true:- https://review.openstack.org/#/c/610491/ | 07:53 |
| *** chem_gone is now known as chem | 07:55 | |
| ssbarnea|bkp2 | ykarel looking now. | 07:56 |
| *** ratailor_ has joined #oooq | 07:56 | |
| *** ratailor has quit IRC | 07:57 | |
| *** ykarel is now known as ykarel|lunch | 07:59 | |
| ssbarnea|bkp2 | ykarel: i am courious where do"pycommand" and "pytbasename" come from? clearly not from any change I made. | 08:00 |
| quiquell | ssbarnea|bkp2: about ansible and fedora28, the issue is that it provides ansible-playbook-3 but not ansible-playbook | 08:00 |
| quiquell | ssbarnea|bkp2: I will adapt to it to make it production wise | 08:00 |
| quiquell | ssbarnea|bkp2: thanks for the reviewing | 08:00 |
| *** ccamacho has quit IRC | 08:00 | |
| *** ccamacho has joined #oooq | 08:01 | |
| ssbarnea|bkp2 | damn, the shenanigans about 3 suffix keeps growing....when is going to stop, are we going to appen it to any command? | 08:01 |
| quiquell | ssbarnea|bkp2: Don't know but it's pain in the ass | 08:02 |
| quiquell | ssbarnea|bkp2: Do you know if we can talk with ansible guys to fix the RPM ' | 08:02 |
| ssbarnea|bkp2 | ansible can also be called as a module, if i remember, not as nice as other tools but probably much better than adding new variable. | 08:02 |
| quiquell | ssbarnea|bkp2: I want to have the tracer bullet first | 08:03 |
| ssbarnea|bkp2 | obviously that we can try, but be prepare to be able to answer the quetion: what if we have both installed. | 08:03 |
| quiquell | ssbarnea|bkp2: then we productify the changes | 08:03 |
| ssbarnea|bkp2 | please do, I will support it | 08:03 |
| ssbarnea|bkp2 | at least tox does not need a tox-3 | 08:03 |
| quiquell | ssbarnea|bkp2: With means have a passing f28 job then do the changes production wise | 08:03 |
| quiquell | ssbarnea|bkp2: Maybe I go back to using pip and we fix that later on | 08:04 |
| quiquell | ssbarnea|bkp2: If not I have to adapt to ansible-plabook-3 | 08:04 |
| ssbarnea|bkp2 | first, create bugzilla for it and when you implement the change, put a comment with a link to the bug. also post it here, so I can send my comments on it. | 08:04 |
| ssbarnea|bkp2 | you have to do both, but start with bug creation, always. | 08:05 |
| quiquell | ssbarnea|bkp2: Going to ask at #ansible first | 08:05 |
| quiquell | ssbarnea|bkp2: Maybe they are already fixing stuff I found the same for openstackclient | 08:05 |
| ssbarnea|bkp2 | this is packaging issue, ansible installed with pip does not make this issue. | 08:05 |
| *** amoralej|off is now known as amoralej | 08:06 | |
| quiquell | ssbarnea|bkp2: Humm you are right | 08:06 |
| ykarel|lunch | ssbarnea|bkp2, sorry, i didn't connect ur reply against my comment in https://review.openstack.org/#/c/610491/ | 08:06 |
| ykarel|lunch | ykarel: i am courious where do"pycommand" and "pytbasename" come from? clearly not from any change I made. | 08:07 |
| ykarel|lunch | ^^ one | 08:07 |
| ykarel|lunch | the issue i mentioned is ansible_user_dir=/root | 08:07 |
| ykarel|lunch | which probably being set with ur patch | 08:07 |
| ykarel|lunch | so i asked to confirm it block the patch | 08:08 |
| ssbarnea|bkp2 | ykarel|lunch : i don't see anything related to that change in the failure | 08:09 |
| ykarel|lunch | ssbarnea|bkp2, i suspect https://review.openstack.org/#/c/610491/10/roles/undercloud-setup/tasks/package_installs.yml | 08:10 |
| ykarel|lunch | is ansible_user_dir set with gather_subset: min | 08:10 |
| ykarel|lunch | ? | 08:10 |
| ykarel|lunch | if yes then this is affecting | 08:10 |
| ykarel|lunch | if no can check other parts | 08:11 |
| * ykarel|lunch going for lunch, will be back in some time | 08:11 | |
| ssbarnea|bkp2 | i found https://hagbarddenstore.se/posts/2015-11-11/ansible-gotcha-playbook-sudo-vs-task-sudo/ going to test it recent ansible, article is very old. | 08:13 |
| ssbarnea|bkp2 | but it raises interesting questions,... to be correct challenges. | 08:13 |
| quiquell | ssbarnea|bkp2: going to remove ansible from tq requirements.txt, that's correct ? | 08:18 |
| quiquell | ssbarnea|bkp2: we are suppose to install it using RPMs | 08:18 |
| ssbarnea|bkp2 | quiquell: no way! ansible is a requirement of ours, installing it from rpm does not excuse us from listing it. probably we want to benefit from the system one by creating the venv using --use-system-packages | 08:21 |
| quiquell | ssbarnea|bkp2: But we always execute the pip install -r with it we will also have to exclude it from that ? | 08:22 |
| ssbarnea|bkp2 | we will always need to be able to install another version of ansible than the system one, using rpm does not mean we remove it from reqs. | 08:22 |
| quiquell | ssbarnea|bkp2: or --use-system-package will do it for us ? | 08:22 |
| ssbarnea|bkp2 | quiquell: kind of, it will create venv with all system packages, so it will have ansible if it was already installed on the system. | 08:22 |
| quiquell | ssbarnea|bkp2: And will not try to install the one specified at requirements.txt ? | 08:23 |
| quiquell | Damn this is so difficult to have it right | 08:23 |
| ssbarnea|bkp2 | quiquell: it will try only if version mentioned by us is does not match system one. | 08:24 |
| ssbarnea|bkp2 | this was always like this. | 08:24 |
| ssbarnea|bkp2 | quiquell make a change that makes that default and lets see how it goes | 08:25 |
| quiquell | ssbarnea|bkp2: Will try my best | 08:25 |
| ssbarnea|bkp2 | i have some news for ykarel and quiquell related to the use of "setup" and altering of ansible_user_dir | 08:26 |
| ssbarnea|bkp2 | it will make it /root only when setup is run with become: yes, and we do not do that. | 08:27 |
| ssbarnea|bkp2 | but I am afraid that if "become" is specified at another upper level (block,include, playbook) it would endup using become, as it is inheritable. | 08:28 |
| ssbarnea|bkp2 | for our specific case, I could say "become: no" to override it and will probably work. | 08:28 |
| quiquell | ssbarnea|bkp2: What calls are you refering too the ones that use ansible_user_dir ? | 08:29 |
| ssbarnea|bkp2 | still, this makes the use of an entire set of variables unreliable overall, as we never know for sure if they were gathered via become or not, especially as this step usually happens in a place outside your role | 08:29 |
| ssbarnea|bkp2 | i don't know the call, but i suppose is one happening later in the role | 08:30 |
| ssbarnea|bkp2 | or I can do something else, maybe better, I will use filter to get only this fact and nothing else. | 08:31 |
| ssbarnea|bkp2 | this fact is not user dependent so it does not matter. | 08:31 |
| *** ykarel|lunch is now known as ykarel | 08:34 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000 (3 more messages) | 08:37 |
| ykarel | ssbarnea|bkp2, see https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/ovb-setup.yml#L16-L20 | 08:40 |
| ykarel | this is the playbook been run there | 08:40 |
| ykarel | and u have done gather_subset in undercloud-setup role | 08:40 |
| ykarel | is this causing: ansible_user_dir to be set to /root when running https://github.com/openstack/tripleo-quickstart-extras/blob/master/playbooks/ovb-setup.yml#L46 | 08:40 |
| ykarel | i didn't dig much but this seems related | 08:41 |
| ssbarnea|bkp2 | https://github.com/ansible/ansible/issues/47603 | 08:41 |
| ssbarnea|bkp2 | ykarel: working now on making a change to avoid setting the user_dir, i am sure we will see this bug again and again. | 08:42 |
| ykarel | ssbarnea|bkp2, ack | 08:42 |
| quiquell | ykarel: Can we change the spec file of ansible-python3 RPM ? | 08:44 |
| quiquell | ykarel: As we do with openstackclient ? | 08:44 |
| ykarel | quiquell, we build ansible from fedora | 08:44 |
| ykarel | and we package openstackclient in RDO so they do differ from management perspective | 08:45 |
| ssbarnea|bkp2 | ykarel i found the solution, .... after many attempts: gather_subset: '!min,pkg_mgr' | 08:45 |
| ssbarnea|bkp2 | if i do not pot !min, it will get user_dir too! as is included in min. | 08:46 |
| ykarel | ssbarnea|bkp2, cool | 08:46 |
| ssbarnea|bkp2 | my original implementation was using gather facts only when this was not defined, but we run into a weird problem,... probably that one | 08:47 |
| ssbarnea|bkp2 | i didn't test with our ansible, i hope it has this feature, locally i am using 2.7 | 08:48 |
| ykarel | and in ci which version is there? | 08:49 |
| ykarel | in tq repos | 08:49 |
| ykarel | i think 2.5.7? | 08:49 |
| ykarel | which we install in venv | 08:49 |
| *** ccamacho has quit IRC | 08:54 | |
| *** ccamacho has joined #oooq | 08:55 | |
| *** bogdando has joined #oooq | 09:01 | |
| ssbarnea|bkp2 | i had some attempts to bump ansible but got stuck, but if I remember well first version on ansible officialy supporting python3 and shipped as rpm is 2.7 ! so we may need to work on some bumping. | 09:01 |
| ssbarnea|bkp2 | sshnaidm|ruck maybe you can help here? as you know the subject better https://review.openstack.org/#/c/596282/ -- maybe starting to test with newer should be done ASAP in order to discover what challenges we face. | 09:03 |
| ykarel | ok so we have 2.5.7 in venv: https://github.com/openstack/tripleo-quickstart/blob/master/requirements.txt#L3 | 09:04 |
| ykarel | and thate gather_subset: '!min,pkg_mgr' seems working with 2.5.7 | 09:04 |
| sshnaidm|ruck | ssbarnea|bkp2, what is the question? how to test it? | 09:04 |
| ssbarnea|bkp2 | i wonder which other files I need to touch to make it run all jobs, I don't think is a good idea to run only current set of jobs when the reqs.txt is touched. | 09:04 |
| ssbarnea|bkp2 | is that file on exclude list, to me seems like kind of file that can break everything, wanting to rebuild anything when is touched. | 09:05 |
| sshnaidm|ruck | ssbarnea|bkp2, create some dummy changes with random files changing and depend on this patch | 09:06 |
| ssbarnea|bkp2 | sshnaidm|ruck: why it didn't run only 3 jobs upstream? i would prefer not to have to create a dummy change. can't I fix the zuul filters? | 09:06 |
| sshnaidm|ruck | ssbarnea|bkp2, well, I think we can exclude requirements.txt from this, it's pretty important file and we don't change it so much | 09:07 |
| ssbarnea|bkp2 | i found!, i will remove reqs.txt from the irrelevant list. | 09:07 |
| ssbarnea|bkp2 | sshnaidm|ruck ++ | 09:08 |
| ssbarnea|bkp2 | doing it now | 09:08 |
| *** dtantsur|afk has joined #oooq | 09:09 | |
| *** dtantsur|afk is now known as dtantsur | 09:09 | |
| ykarel | ssbarnea|bkp2, a typo in https://review.openstack.org/#/c/610491/11 | 09:12 |
| ssbarnea|bkp2 | thanks fixing now, meanwhile please review https://review.openstack.org/#/c/613250/ <-- sshnaidm|ruck quiquell | 09:13 |
| sshnaidm|ruck | ssbarnea|bkp2, be aware that you change it for all jobs in all tripleo projects | 09:14 |
| ssbarnea|bkp2 | sshnaidm|ruck: yep I am aware but I still support it. i do find these files critical for any python project. if someone ones to mess with one, these are the best places to mess with ;) | 09:15 |
| *** tosky has joined #oooq | 09:16 | |
| *** jaganathan has quit IRC | 09:17 | |
| quiquell | ssbarnea|bkp2: installation of virtualenv will fail at fedora28 in upstream I | 09:18 |
| quiquell | ssbarnea|bkp2: at upstream CI | 09:18 |
| quiquell | ssbarnea|bkp2: I don't think we are going to run tempest right now there | 09:18 |
| quiquell | ssbarnea|bkp2: We are not suppose to install RPMs for virtualenv/pip/setuptools at upstream CI | 09:20 |
| ykarel | quiquell, why will fail? | 09:20 |
| ssbarnea|bkp2 | quiquell: i will test now on f28, but TBH I would be very happy to see that task failing upstream, it would mean that deployment succeeded! and we are very far from reaching tempest step now. | 09:20 |
| quiquell | ykarel: fedora28 nodsets at upstream CI has excludes at dnf.conf | 09:20 |
| ykarel | quiquell, so why nod remove the excludes? | 09:21 |
| quiquell | ssbarnea|bkp2: You have to do it at zuuls fedora28 nodesets | 09:21 |
| quiquell | ssbarnea|bkp2: or with their changes at dnf.conf (It's how I am emulating it at my hacked repro) | 09:21 |
| quiquell | ykarel: It's done by design | 09:21 |
| quiquell | ykarel: https://tree.taiga.io/project/tripleo-ci-board/task/248?kanban-status=1447276 | 09:22 |
| *** ratailor has joined #oooq | 09:22 | |
| quiquell | ykarel: ianw tell me so | 09:22 |
| ykarel | quiquell, but for our requirement we need that, in poi i did like: https://github.com/openstack/puppet-openstack-integration/blob/master/playbooks/prepare-node-common.yaml#L15-L30 | 09:23 |
| quiquell | ykarel: they create cooked images with virtualenv/pip/setuptools already installed so we don't mess with that | 09:23 |
| *** ratailor_ has quit IRC | 09:23 | |
| quiquell | ykarel: It's already install there we have to check if it's already install will be my next iteartion at https://review.openstack.org/612633 | 09:23 |
| ssbarnea|bkp2 | quiquell : too much messing with the those vms, how can I get ssh on such a node to use it for manual testing? | 09:23 |
| quiquell | ssbarnea|bkp2: Best you can do is access to the image and start it up at a vm | 09:24 |
| ssbarnea|bkp2 | it seems that using my f28 images is no longer enough, as we have a pretty well tained image | 09:24 |
| quiquell | ssbarnea|bkp2: ^ That's it :-( | 09:24 |
| ssbarnea|bkp2 | quiquell: is that image on rdo cloud? | 09:24 |
| quiquell | ssbarnea|bkp2: Upstream CI not RDO | 09:24 |
| quiquell | ssbarnea|bkp2: Don't remember where but we can download it | 09:25 |
| quiquell | ykarel: maybe you know it ? | 09:25 |
| quiquell | ssbarnea|bkp2: Let me ask at openstack-infra | 09:25 |
| ssbarnea|bkp2 | going to infra to ask... | 09:25 |
| quiquell | ssbarnea|bkp2: ok | 09:25 |
| ykarel | quiquell, nope, but iirc u guys used some days ago similar image in ur testing | 09:25 |
| ykarel | nodepool in name | 09:25 |
| ykarel | and some id | 09:26 |
| quiquell | ykarel: what do you mean ? | 09:26 |
| ykarel | quiquell, i remember that few days back ssbarnea|bkp2 was using some fedora image from upstream ci | 09:27 |
| ykarel | but i can't recall much now | 09:27 |
| quiquell | ykarel: I think it was vanilla fedora | 09:27 |
| *** ccamacho has quit IRC | 09:27 | |
| ykarel | may be but i remember the name of the image does't sound like vanila image | 09:28 |
| quiquell | ykarel: I don't remember fedora images has being like that from long ago | 09:28 |
| quiquell | ykarel: upstream CI ones I mean | 09:29 |
| ykarel | so https://nb01.openstack.org/images/fedora-28-0000005118.qcow2 was image used that time | 09:31 |
| ykarel | so i suspected it's from upstream infra | 09:32 |
| ykarel | quiquell, ^^ got from patch: https://review.openstack.org/#/c/591540/40/config/environments/standalone_fedora_libvirt.yml | 09:33 |
| quiquell | ykarel: If dns.conf is not changed there maybe the do so at some role at zuul pre stuff | 09:34 |
| ykarel | dnf.conf created during build image afaik | 09:35 |
| ykarel | via diskimage-builder | 09:35 |
| *** panda|off has quit IRC | 09:35 | |
| *** kopecmartin is now known as kopecmartin|afk | 09:38 | |
| *** panda has joined #oooq | 09:38 | |
| *** ratailor_ has joined #oooq | 09:43 | |
| ssbarnea|bkp2 | quiquell: damn. rdo does not allow me to upload image by url | 09:45 |
| ssbarnea|bkp2 | and I cannot use my ADSL to upload a 7.6GB file,... it will never end. | 09:45 |
| quiquell | ssbarnea|bkp2: Just startup at your laptop | 09:46 |
| quiquell | ssbarnea|bkp2: Good enough to run part of the flow | 09:46 |
| *** ratailor has quit IRC | 09:46 | |
| ssbarnea|bkp2 | quiquell: well, when it will finish downloading, at ~1MB/s | 09:47 |
| quiquell | ssbarnea|bkp2: Maybe you can use it at quickvm | 09:48 |
| quiquell | ykarel: about the ansible-python3 package is there any channel here to ask about it ? | 09:49 |
| quiquell | ykarel: I know I can open a bugzilla and all, but want to ask a little first | 09:50 |
| ykarel | quiquell, #fedora, #fedora-devel | 09:52 |
| ykarel | good to check the maintainer first | 09:52 |
| ykarel | for that package | 09:52 |
| *** jbadiapa has quit IRC | 10:02 | |
| panda | marios: ping | 10:03 |
| quiquell | ssbarnea|bkp2, ykarel: Found the issue with ansible-python3 https://src.fedoraproject.org/rpms/ansible/blob/master/f/ansible.spec#_301 | 10:04 |
| quiquell | ansible-playbook is not in the list | 10:04 |
| quiquell | :-( | 10:04 |
| *** jbadiapa has joined #oooq | 10:04 | |
| marios | panda: pong | 10:05 |
| ykarel | quiquell, yes that was rule when shipping both python2 and python3 binaries, to ship unversioned with python2 binary | 10:05 |
| ykarel | fedora rule | 10:05 |
| ykarel | but with fedora 30 it should ship only python3 binaries, let me find linke | 10:06 |
| *** holser_ has joined #oooq | 10:11 | |
| quiquell | ykarel: But they are doing what we expect for ansible command why not for ansible-playbook command ? | 10:11 |
| ykarel | old rules: https://fedoraproject.org/wiki/Packaging:Python_Old#Naming | 10:12 |
| ykarel | quiquell, really? checking | 10:12 |
| ykarel | rule should be same | 10:12 |
| quiquell | ykarel: https://src.fedoraproject.org/rpms/ansible/blob/master/f/ansible.spec#_322 | 10:13 |
| quiquell | ykarel: wrong line wait | 10:13 |
| quiquell | ykarel: this https://src.fedoraproject.org/rpms/ansible/blob/master/f/ansible.spec#_301 | 10:13 |
| quiquell | ykarel: only ansible-connection and ansible | 10:13 |
| quiquell | ykarel: I going to put a patch and see if they accept it | 10:13 |
| ykarel | quiquell, (openstack_venv) [ykarel@yatinkarel puppet-openstack-integration]$ rpm -qpl https://trunk.rdoproject.org/fedora/stable-base/latest/Packages/ansible-python3-2.7.0-1.fc28.noarch.rpm |grep "/usr/bin" | 10:14 |
| ykarel | i can't see unversioned ansible command | 10:14 |
| quiquell | ykarel: This line should create them https://src.fedoraproject.org/rpms/ansible/blob/master/f/ansible.spec#_306 | 10:15 |
| quiquell | ykarel: Maybe I have read it wrong | 10:15 |
| quiquell | ykarel: "Fedora 29+ and RHEL larger than 7 no python2, python3 default" | 10:16 |
| quiquell | ykarel: They don't cosidere fedora 28 a python3 default one | 10:16 |
| quiquell | ykarel: Ahh... fedora28 has 'with_python2' and 'with_python3' | 10:17 |
| ykarel | yup | 10:18 |
| quiquell | ykarel: we are testing at fedora28 because is more similar to future centos8 than fedora29 ? | 10:18 |
| quiquell | ykarel: nah we have to deal with ansible-playbook-3 | 10:19 |
| ykarel | ok so from f29 ansible itself provides ansible-python3 and is py3 by default | 10:20 |
| ykarel | ansible-python3 required only for f28 | 10:20 |
| quiquell | ykarel: f29 provides ansible-playbook pointing to ansible-playbook-3 | 10:22 |
| quiquell | ykarel: f28 does not | 10:22 |
| ykarel | i can't find ansible-playbook-3: (openstack_venv) [ykarel@yatinkarel puppet-openstack-integration]$ rpm -qpl https://kojipkgs.fedoraproject.org//packages/ansible/2.7.0/1.fc29/noarch/ansible-2.7.0-1.fc29.noarch.rpm|grep ansible-playbook | 10:23 |
| quiquell | ykarel: the package is ansible-python3 | 10:24 |
| quiquell | ykarel: ansible package is ansible for python2 at f28 | 10:25 |
| quiquell | ykarel: very messy | 10:25 |
| ykarel | quiquell, may be these explains: | 10:25 |
| ykarel | https://koji.fedoraproject.org/koji/buildinfo?buildID=1151617 | 10:25 |
| ykarel | and https://koji.fedoraproject.org/koji/packageinfo?packageID=13842 | 10:26 |
| ykarel | builds from f28 and f29 | 10:26 |
| *** jaganathan has joined #oooq | 10:26 | |
| ykarel | sorry https://koji.fedoraproject.org/koji/buildinfo?buildID=1151617 and https://koji.fedoraproject.org/koji/buildinfo?buildID=1151616 | 10:27 |
| ssbarnea|bkp2 | last time i checked ansible was installing 3-4 executables | 10:27 |
| quiquell | ykarel: weird f28 has ansible-python3 package | 10:28 |
| quiquell | ykarel: It's not suppose to be ther ? | 10:28 |
| quiquell | Humm ah nothing | 10:28 |
| quiquell | f29 only has ansible package | 10:29 |
| quiquell | That it's ansible python3 only | 10:29 |
| quiquell | f28 has ansible and ansible-python3 | 10:29 |
| quiquell | Why don't we test fedora29 feels simpler | 10:29 |
| ykarel | yes correct, ansible-python3 bulid only for f28 | 10:30 |
| quiquell | No python2 packages there | 10:30 |
| quiquell | At f29 | 10:30 |
| *** udesale has quit IRC | 10:36 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000 (3 more messages) | 10:37 |
| ssbarnea|bkp2 | quiquell : this reminded of my previous incomplete work https://github.com/ansible/ansible/pull/39253 | 10:39 |
| *** marios has quit IRC | 10:45 | |
| quiquell | ssbarnea|bkp2: What was the option to pass to pip to use system wide stuff instead of installing from requirements ? | 10:49 |
| ssbarnea|bkp2 | quiquell it does not work for ansible, this is what I tried to fix back in april but didn't finish | 10:52 |
| ssbarnea|bkp2 | is doable, but needs some effort because ansible has multiple executables | 10:53 |
| ssbarnea|bkp2 | and we do not have time now, now i am doing somethign else, writing an ansible role that detects and declares portable commands. | 10:53 |
| ssbarnea|bkp2 | i already started, as we need this in many places. | 10:54 |
| ssbarnea|bkp2 | for the moment just use existing approach of testing python_version | 10:54 |
| ssbarnea|bkp2 | is good enough | 10:54 |
| quiquell | weshay: About release file we need the new packages from openstackclient I think they are not at that hash | 10:56 |
| quiquell | ssbarnea|bkp2: ^ | 10:56 |
| panda | rfolco|rover: we may need to postpone the scrum by one hour | 10:58 |
| panda | rfolco|rover: because of the all hands | 10:58 |
| ssbarnea|bkp2 | i just discovered molecule, look quite cool | 10:59 |
| quiquell | ssbarnea|bkp2: Yep, would be nice to use it to test our roles | 10:59 |
| ssbarnea|bkp2 | i am trying it now for testing my micro role on multiple platforms | 11:00 |
| arxcruz | panda: rfolco|rover i have a doctor appointment today, so i'll not participate :( | 11:05 |
| *** ccamacho has joined #oooq | 11:07 | |
| rfolco|rover | panda, arxcruz ack | 11:10 |
| rfolco|rover | moved | 11:11 |
| *** amoralej is now known as amoralej|lunch | 11:14 | |
| quiquell | ssbarnea|bkp2: changed https://review.openstack.org/612290 | 11:14 |
| quiquell | sshnaidm|ruck: Are we far from having master promotions ? | 11:16 |
| sshnaidm|ruck | ssbarnea|bkp2, did you see something like that before? http://logs.openstack.org/66/613166/1/check/openstack-tox-pep8/5872b24/job-output.txt.gz#_2018-10-24_23_56_40_190769 | 11:16 |
| sshnaidm|ruck | quiquell, very far ( | 11:16 |
| quiquell | sshnaidm|ruck: damn it :-( | 11:17 |
| sshnaidm|ruck | quiquell, with current state of rdo cloud I don't believe we'll have it at all | 11:17 |
| *** marios has joined #oooq | 11:18 | |
| ssbarnea|bkp2 | sshnaidm|ruck no but I know few things: flake8 had a new release this week, after 1 year! | 11:24 |
| sshnaidm|ruck | ssbarnea|bkp2, and we don't hardcode its version? | 11:24 |
| ssbarnea|bkp2 | it did break few projects but is fixable, i was not able to find a bug in flake8 itself. | 11:24 |
| ssbarnea|bkp2 | hacking is supposed to do that, now i do not know about this specific case. | 11:25 |
| sshnaidm|ruck | hacking..? | 11:25 |
| ssbarnea|bkp2 | not sure how linting is run on this, if using hacking for linting it should pin flake8. still, I would just fix the issue in a CR and be back to other more interesting things ;) | 11:27 |
| marios | panda: i can't create a new story? | 11:27 |
| marios | i mean in sprint 21 | 11:27 |
| marios | https://tree.taiga.io/project/tripleo-ci-board/taskboard/sprint-21-175 | 11:27 |
| marios | how do you add story i can add a task to a story but not new story? | 11:27 |
| sshnaidm|ruck | ssbarnea|bkp2, it's not the issue with code, it's flakes problem.. well, let's just ignore this error then | 11:28 |
| panda | marios: you go to the backlog and drag&drop the story | 11:33 |
| marios | panda: thanks | 11:34 |
| marios | panda: also on the epic apparently (you can add a related user story ) https://tree.taiga.io/project/tripleo-ci-board/epic/5 | 11:42 |
| *** ratailor_ has quit IRC | 12:01 | |
| weshay | sshnaidm|ruck, you got the seals covered? | 12:01 |
| weshay | I need to 1-1 w/ ssbarnea|bkp2 | 12:01 |
| sshnaidm|ruck | weshay, I'm on the meeting | 12:01 |
| weshay | see you .. thank you :) | 12:02 |
| *** quiquell is now known as quiquell|lunch | 12:05 | |
| rfolco|rover | sshnaidm|ruck, ping ideas on Run tripleo-container-image-prepare | 12:09 |
| sshnaidm|ruck | rfolco|rover, in 20 mins, on mtg now | 12:09 |
| weshay | kopecmartin|afk, you available to chat today? | 12:09 |
| rfolco|rover | sshnaidm|ruck, thx | 12:10 |
| *** amoralej|lunch is now known as amoralej | 12:11 | |
| kopecmartin|afk | weshay, I am, but I'd rather later, in few hours (in EU evening) | 12:13 |
| weshay | kopecmartin|afk, that probably works out well for my schedule | 12:14 |
| kopecmartin|afk | weshay, great, I'll ping you in advance | 12:14 |
| weshay | https://tree.taiga.io/project/tripleo-ci-board/task/7?kanban-status=1447275 | 12:16 |
| sshnaidm|ruck | rfolco|rover, closed https://bugs.launchpad.net/tripleo/+bug/1797918 | 12:16 |
| openstack | Launchpad bug 1797918 in tripleo "teclient returns failures when attempting to provision a stack in rdo-cloud" [Critical,Fix released] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 12:16 |
| *** zul has joined #oooq | 12:19 | |
| rascasoft | sshnaidm|ruck, can we workflow +1 this https://review.openstack.org/#/c/612649/ ? | 12:20 |
| rfolco|rover | sshnaidm|ruck, nice | 12:20 |
| *** rlandy has joined #oooq | 12:27 | |
| sshnaidm|ruck | rfolco|rover, ok, let's talk? | 12:28 |
| *** ykarel is now known as ykarel|afk | 12:28 | |
| rfolco|rover | sshnaidm|ruck, pls give me 3 min and will connect to bj | 12:29 |
| sshnaidm|ruck | rfolco|rover, sure | 12:29 |
| sshnaidm|ruck | rfolco|rover, https://bluejeans.com/2162375722 | 12:30 |
| rfolco|rover | joining | 12:32 |
| *** ykarel|afk has quit IRC | 12:33 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000 (3 more messages) | 12:37 |
| *** quiquell|lunch is now known as quiquell | 12:43 | |
| panda | marios: when is the all-hands ? | 12:43 |
| panda | marios: I don't see it in my calendar | 12:44 |
| *** ykarel has joined #oooq | 12:50 | |
| panda | marios: nevermind, seeing it now, was looking at the wrong day | 12:52 |
| marios | panda: k | 12:52 |
| marios | panda: i see rfolco|rover already updated the event anyway | 12:52 |
| marios | i mean scrum | 12:53 |
| rlandy | all hands and scrum clash | 12:54 |
| rlandy | marios: hey - left some comments on your review and the card https://tree.taiga.io/project/tripleo-ci-board/us/53 | 12:55 |
| rlandy | maybe I am missing some card links | 12:55 |
| marios | rlandy: thanks, fyi we changed it a bit with panda earlier | 12:55 |
| rlandy | marios: ok - so I am behind then we can talk at meeting | 12:55 |
| marios | rlandy: so the overall epic i.e. that review istracked here https://tree.taiga.io/project/tripleo-ci-board/epic/5 | 12:55 |
| marios | rlandy: and i made the stories on that epic be those steps, the first is the variables and that is for this sprint | 12:56 |
| marios | rlandy: so we scope it out a bit | 12:56 |
| marios | rlandy: make sense? | 12:56 |
| marios | rlandy: we can talk about on scrum in 1 hour also | 12:56 |
| marios | rlandy: yeah re the clash rfolco|rover rescheduled the call to +1 hr | 12:57 |
| panda | rlandy: scrum was postponed 1 hour | 12:57 |
| rfolco|rover | quiquell, sshnaidm|ruck ssbarnea|bkp2 weshay panda arxcruz chandankumar rlandy marios --> scrum moved to +1h due to all hands mtg | 12:58 |
| rfolco|rover | be aware | 12:58 |
| quiquell | rfolco|rover: ack | 12:58 |
| ssbarnea|bkp2 | fungi: i was not able to find any version based conditions, ok | 12:58 |
| weshay | rfolco|rover, ya.. I have a conflict unfortunately | 12:58 |
| arxcruz | rfolco|rover: ack, but i'll not be able to join, have doctor appointment | 12:58 |
| panda | arxcruz: bring the doctor too, he can come | 13:00 |
| rlandy | cool - thanks | 13:00 |
| rlandy | just chatting with infra | 13:00 |
| arxcruz | panda: :) i'll check with him | 13:00 |
| arxcruz | rlandy: did work the job? | 13:00 |
| rlandy | arxcruz: awesome - it's GREEN!!!! | 13:01 |
| panda | martian jobs | 13:01 |
| weshay | panda, would you like to go to the all-hands or catch up w/ me for a few? | 13:03 |
| arxcruz | rfolco|rover: sshnaidm|ruck so, the https://trello.com/c/qiKrS3Nc/783-cixlp1797931tripleociproa-tempest-pip-install-fails-on-rocky-minimal-config is fixed, just need to have the code merged | 13:03 |
| arxcruz | rlandy: if you can comment on https://tree.taiga.io/project/tripleo-ci-board/issue/244 | 13:03 |
| panda | weshay: why do you even ask ? let's meet. | 13:04 |
| rlandy | yep | 13:04 |
| sshnaidm|ruck | arxcruz, I +w it, let's check in promotion jobs | 13:04 |
| weshay | panda, you had me at hello :) | 13:04 |
| arxcruz | sshnaidm|ruck: ack | 13:04 |
| rlandy | weshay: for your morning smile .. green master bm ... https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/tripleo-quickstart-master-baremetal-dell_fc430_envB-single_nic_vlans/ | 13:05 |
| *** weshay has quit IRC | 13:05 | |
| *** rascasoft has quit IRC | 13:05 | |
| *** rascasoft has joined #oooq | 13:11 | |
| rascasoft | rlandy, weshay wow, that good to know that somewhere a bm env is working | 13:11 |
| rlandy | rascasoft: something to be grateful for | 13:11 |
| rlandy | we have wokring rhos-14 on bm as well | 13:12 |
| rascasoft | rlandy, I wonder where and who take care about those jobs | 13:12 |
| rascasoft | rlandy, because I was told to put bm inside internal phase3 | 13:12 |
| *** agopi has quit IRC | 13:12 | |
| rascasoft | rlandy, so I'm really interested in understand where are those jobs | 13:13 |
| rlandy | rascasoft: we have a plan to use bm for more current-tripleo work | 13:13 |
| rlandy | but weshay can comment more on that | 13:13 |
| rlandy | rascasoft: we can talk more after meetings | 13:13 |
| rascasoft | rlandy, we should talk more in general I think :) | 13:14 |
| *** rascasoft has quit IRC | 13:15 | |
| quiquell | panda, sshnaidm|ruck, rlandy, marios: we need reviews for the f28 stuff https://review.openstack.org/#/c/610491 | 13:18 |
| *** irclogbot_0 has joined #oooq | 13:20 | |
| marios | quiquell: ack noted for next run | 13:20 |
| rlandy | will look later | 13:21 |
| *** huynq has quit IRC | 13:22 | |
| *** irclogbot_0 has quit IRC | 13:22 | |
| *** irclogbot_0 has joined #oooq | 13:24 | |
| *** rnoriega has quit IRC | 13:31 | |
| *** d0ugal has quit IRC | 13:33 | |
| *** rascasoft has joined #oooq | 13:34 | |
| *** d0ugal has joined #oooq | 13:34 | |
| *** irclogbot_0 has quit IRC | 13:37 | |
| *** rnoriega has joined #oooq | 13:38 | |
| *** irclogbot_0 has joined #oooq | 13:38 | |
| *** weshay has joined #oooq | 13:40 | |
| weshay | rfolco|rover, can you join my blue for a minute | 13:40 |
| *** agopi has joined #oooq | 13:40 | |
| rfolco|rover | weshay, k | 13:40 |
| *** d0ugal has quit IRC | 13:49 | |
| *** weshay has quit IRC | 13:49 | |
| *** d0ugal has joined #oooq | 13:51 | |
| *** vinaykns has joined #oooq | 13:55 | |
| *** jfrancoa has quit IRC | 13:56 | |
| *** jfrancoa has joined #oooq | 13:58 | |
| sshnaidm|ruck | quiquell, need to see CI jobs finish firstly | 14:01 |
| quiquell | sshnaidm|ruck: ACK | 14:02 |
| quiquell | ack | 14:02 |
| rfolco|rover | panda, rlandy marios sshnaidm|ruck ssbarnea|bkp2 quiquell arxcruz chandankumar ping scrum | 14:04 |
| rfolco|rover | kopecmartin|afk, ^ | 14:04 |
| panda | I think the all-hands is running over because it started late | 14:04 |
| *** irclogbot_0 has quit IRC | 14:07 | |
| *** ykarel is now known as ykarel|away | 14:08 | |
| marios | rfolco|rover: othe call just finished, joining | 14:08 |
| marios | anyone else having issues loading etherpad.openstack.org? | 14:13 |
| marios | https://downforeveryoneorjustme.com/etherpad.openstack.org hm | 14:14 |
| marios | (just very slow) | 14:14 |
| *** irclogbot_0 has joined #oooq | 14:18 | |
| *** irclogbot_0 has quit IRC | 14:22 | |
| *** saneax has quit IRC | 14:31 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000 (3 more messages) | 14:37 |
| -openstackstatus- NOTICE: Zuul and Nodepool services are being restarted to migrate them to a new Zookeeper cluster. THis brings us an HA database running on newer servers. | 14:38 | |
| *** kopecmartin|afk is now known as kopecmartin | 14:46 | |
| *** weshay has joined #oooq | 14:49 | |
| kopecmartin | weshay, I'm ready from now, we can chat when you're free | 14:50 |
| weshay | k.. thanks i'm in a meeting for at least another 10 min | 14:50 |
| jfrancoa | hello folks, is there any issue in the CI infra? I'm getting NODE_FAILURE error in all the triggered jobs | 14:51 |
| * jfrancoa re-reading the (notice) | 14:52 | |
| weshay | jfrancoa, upstream or rdo? | 14:53 |
| jfrancoa | weshay: upstream. I guess it has something to do with the restart of Zuul and Nodepool | 14:54 |
| *** holser_ has quit IRC | 14:55 | |
| *** jtomasek has quit IRC | 15:01 | |
| *** holser_ has joined #oooq | 15:03 | |
| *** ccamacho has quit IRC | 15:05 | |
| marios | sshnaidm|ruck: rfolco|rover big issue in ci? (: NODE_FAILURE all the things at https://review.openstack.org/#/c/604768/) | 15:05 |
| sshnaidm|ruck | marios, zuul was restarted | 15:06 |
| marios | sshnaidm|ruck: thanks, so i can just recheck? | 15:06 |
| sshnaidm|ruck | NOTICE: Zuul and Nodepool services are being restarted to migrate them to a new Zookeeper cluster. THis brings us an HA database running on newer servers. | 15:06 |
| marios | sshnaidm|ruck: ah maybe not if its ongoing thanks | 15:06 |
| sshnaidm|ruck | marios, I think so | 15:06 |
| *** irclogbot_0 has joined #oooq | 15:06 | |
| marios | rlandy: should i schedule call for tomorrow, like normal scrum time or later? do you want to schedule it so it suits you timewise | 15:07 |
| marios | rlandy: i will also improve the cards in the meantime wrt descriptions etc | 15:08 |
| marios | rlandy: (at least the current ones) | 15:08 |
| rlandy | marios: any time that works for you is fine | 15:11 |
| rlandy | marios: I will comment on the nodepool command today | 15:11 |
| rlandy | marios: one question - is how we determine the parents - or if we have to | 15:12 |
| rlandy | or if we can pull enough info from the zuul vars to avoid needing to know what the parents are | 15:12 |
| quiquell | rlandy, marios: Maybe make sense to create some kind of partial zuul config prser | 15:12 |
| rlandy | that form part of getting vars | 15:12 |
| quiquell | rlandy, marios: that get you variables pre/run/post | 15:13 |
| marios | rlandy: right thats what i was saying about 'zuul handles the inheritance' we have to explicitly run the parent pres. I was hoping to include those from the zuul variables | 15:13 |
| rlandy | there are multiple parents going on | 15:13 |
| rlandy | we might not need to walk that chain | 15:14 |
| rlandy | all we need to know is what playbooks to run | 15:14 |
| marios | rlandy: sent | 15:15 |
| quiquell | marios: thanks | 15:17 |
| *** jfrancoa has quit IRC | 15:18 | |
| rlandy | marios: is your day over? | 15:20 |
| rlandy | or you still have a few minutes? | 15:20 |
| marios | rlandy: not quite sure | 15:20 |
| marios | rlandy: sorry, i meant, not quite over, and sure have time | 15:21 |
| *** quiquell is now known as quiquell|off | 15:21 | |
| *** irclogbot_0 has quit IRC | 15:21 | |
| rlandy | marios: ok - few minutes to discuss comments on the review and where to start work? | 15:21 |
| marios | rlandy: sure lets use the bluejeans on the invite for tomorrow? | 15:21 |
| marios | rlandy: joining | 15:21 |
| rlandy | k | 15:21 |
| rlandy | joined | 15:22 |
| sshnaidm|ruck | weshay, aren't you in #tripleo? | 15:27 |
| -openstackstatus- NOTICE: The Zuul and Nodepool database transition is complete. Changes updated during the Zuul outage may need to be rechecked. | 15:29 | |
| *** jaganathan has quit IRC | 15:32 | |
| *** ccamacho has joined #oooq | 15:38 | |
| *** apetrich has quit IRC | 15:45 | |
| weshay | kopecmartin, omg.. k ready if you are still here | 15:50 |
| weshay | https://bluejeans.com/u/whayutin/ | 15:50 |
| kopecmartin | weshay, sure | 15:51 |
| weshay | kopecmartin, https://bluejeans.com/u/whayutin/ | 15:52 |
| *** sshnaidm|ruck is now known as sshnaidm|bbl | 15:54 | |
| rlandy | is taiga killing anybody else's browers/laptops? | 15:58 |
| panda | every tool we use ends up overloaded by us | 15:59 |
| panda | we are really too much for everything | 15:59 |
| *** vinaykns has quit IRC | 16:03 | |
| *** vinaykns has joined #oooq | 16:13 | |
| *** ccamacho has quit IRC | 16:15 | |
| *** vinaykns has quit IRC | 16:21 | |
| *** dtantsur is now known as dtantsur|afk | 16:22 | |
| *** trown is now known as trown|lunch | 16:32 | |
| *** vinaykns has joined #oooq | 16:33 | |
| *** bogdando has quit IRC | 16:36 | |
| *** amoralej is now known as amoralej|off | 16:37 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000 (3 more messages) | 16:37 |
| weshay | sshnaidm|bbl, rfolco|rover ugh.. we need the fs002 upload job to fucking work | 16:38 |
| weshay | 2018-10-25 08:28:02.876289 | primary | ERROR | 16:38 |
| weshay | 2018-10-25 08:28:02.876467 | primary | { | 16:38 |
| weshay | 2018-10-25 08:28:02.876569 | primary | "msg": "SSH Error: data could not be sent to remote host \"38.145.35.142\". Make sure this host can be reached over ssh", | 16:38 |
| weshay | 2018-10-25 08:28:02.876632 | primary | "unreachable": true | 16:38 |
| *** panda is now known as panda|off | 16:38 | |
| weshay | https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/a2d2ed4/job-output.txt.gz#_2018-10-25_08_28_02_876569 | 16:38 |
| weshay | then we could promote and update the containers in master | 16:38 |
| ssbarnea|bkp2 | please read https://github.com/tox-dev/tox/issues/1072 and advise on how to proceed, it concerns us and it will become a bigger issue soon, because ansible dropped support for py34. | 16:42 |
| ssbarnea|bkp2 | while we have centos-7 trying to run tox with basepython=python3 would be a total failure if ansible package is involved, it will fail to install. | 16:43 |
| sshnaidm|bbl | weshay, it's pure network issue | 16:54 |
| weshay | ya | 16:54 |
| sshnaidm|bbl | weshay, let's exclude it from criteria | 16:54 |
| weshay | sshnaidm|bbl, we can't | 16:54 |
| weshay | it uploads the images | 16:54 |
| sshnaidm|bbl | oh, right | 16:55 |
| weshay | sshnaidm|bbl, I added some notes in rh-ops however either we upload images manually, escalate this one issue.. or pray | 16:56 |
| weshay | not sure which is the best course atm | 16:56 |
| sshnaidm|bbl | weshay, manually is complicated, always forget something.. | 16:57 |
| sshnaidm|bbl | weshay, better just copy old ones to new hash directory | 16:58 |
| sshnaidm|bbl | images update doesn't take a long | 16:58 |
| sshnaidm|bbl | container update - that what kills us | 16:58 |
| weshay | sshnaidm|bbl, true | 16:58 |
| weshay | sshnaidm|bbl, scenario001 failed in the latest master | 16:59 |
| weshay | could use the run prior | 17:00 |
| weshay | \/rdo/centos7/c4/89/c489cde400bcbc45741f8c15dcbbb85f7db9dd9e_195e4c7e | 17:01 |
| *** chandankumar is now known as chkumar|off | 17:02 | |
| *** ccamacho has joined #oooq | 17:02 | |
| weshay | rfolco|rover, you test the log rotate? | 17:04 |
| rfolco|rover | weshay, not yet, was trying to add timestamp to yum_update | 17:05 |
| rfolco|rover | weshay, do we dstat for undercloud install ? | 17:05 |
| weshay | rfolco|rover, yes.. /var/log/extras | 17:05 |
| rfolco|rover | k if we can add timestamp to yum_update we can exclude network and disk bottlenecks from the table | 17:06 |
| rfolco|rover | weshay, unless sshnaidm|bbl has done it already and I didn't see ...? | 17:07 |
| sshnaidm|bbl | rfolco|rover, nope, I didn't | 17:13 |
| sshnaidm|bbl | rfolco|rover, weshay I'm off tomorrow (Fri), have a nice weekend guys | 17:14 |
| weshay | sshnaidm|bbl, aye.. thanks brotha. | 17:15 |
| weshay | you too | 17:15 |
| *** sshnaidm|bbl is now known as sshnaidm|off | 17:15 | |
| rfolco|rover | sshnaidm|bbl, thanks have a good one | 17:15 |
| rfolco|rover | sshnaidm|off, ;) | 17:15 |
| weshay | ssbarnea|bkp2, don't you have a similiar patch? https://review.openstack.org/#/c/610468/ | 17:17 |
| *** apetrich has joined #oooq | 17:17 | |
| *** apetrich has quit IRC | 17:17 | |
| *** apetrich has joined #oooq | 17:18 | |
| rfolco|rover | weshay, these timestamps are out of sync ? http://logs.openstack.org/87/610087/4/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/2e409e1/logs/undercloud/var/log/extra/dstat.html.gz | 17:19 |
| rfolco|rover | 3:35 | 17:19 |
| rfolco|rover | http://logs.openstack.org/87/610087/4/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/2e409e1/logs/undercloud/home/zuul/install-undercloud.log.txt.gz#_2018-10-25_03_12_54_691 | 17:20 |
| rfolco|rover | 3:12... | 17:20 |
| weshay | rfolco|rover, your message / question is unclear to me | 17:23 |
| rfolco|rover | weshay, I think the question is that dstat starts a bit later | 17:29 |
| rfolco|rover | 2018-10-25 02:37:35.809332 | Job console starting... | 17:29 |
| rfolco|rover | while dstat 2:59 | 17:29 |
| weshay | rfolco|rover, so you are saying they are off by 22 min? | 17:31 |
| rfolco|rover | move the zoom box at the top to the start http://logs.openstack.org/87/610087/4/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/2e409e1/logs/undercloud/var/log/extra/dstat.html.gz | 17:32 |
| rfolco|rover | here is the console http://logs.openstack.org/87/610087/4/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/2e409e1/job-output.txt.gz | 17:32 |
| rfolco|rover | weshay, ignore me | 17:33 |
| rfolco|rover | sorry | 17:33 |
| ssbarnea|bkp2 | weshay : i think this is the official one. | 17:38 |
| ssbarnea|bkp2 | i have two important changes waiting at the gate (of hell), one those land, i will cleanup the list. | 17:39 |
| ssbarnea|bkp2 | weshay or anyone else curious about how molecule could be used, please clone https://github.com/ssbarnea/ansible-six and run "make" (not tox). it should be self-explanatory. | 17:42 |
| ssbarnea|bkp2 | this is a sample role I created, and make would test it using both centos-7 and fedora-28 docker containers. | 17:43 |
| ssbarnea|bkp2 | i already found some bugs, but the fact that at the end of the month it will become an official ansible sub-project gives it more credit. | 17:44 |
| ssbarnea|bkp2 | i see a huge potential there, for testing. | 17:44 |
| rfolco|rover | chkumar|off, arxcruz weshay panda|off the only time I found in cal was monday after scrum for tempest planning talk | 17:44 |
| *** holser_ has quit IRC | 17:47 | |
| *** trown|lunch is now known as trown | 17:54 | |
| *** apetrich has quit IRC | 18:07 | |
| weshay | ssbarnea|bkp2, ya.. thanks! I will be reading through that :) | 18:16 |
| *** apetrich has joined #oooq | 18:20 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset022 @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb- (3 more messages) | 18:37 |
| *** dsneddon__ has quit IRC | 18:43 | |
| *** dsneddon__ has joined #oooq | 18:43 | |
| *** dtrainor has quit IRC | 18:45 | |
| *** dtrainor has joined #oooq | 18:45 | |
| *** ykarel|away has quit IRC | 19:11 | |
| *** rlandy is now known as rlandy|brb | 19:13 | |
| *** holser_ has joined #oooq | 19:15 | |
| *** irclogbot_0 has joined #oooq | 19:24 | |
| *** rlandy|brb is now known as rlandy | 19:31 | |
| *** irclogbot_0 has quit IRC | 19:51 | |
| *** irclogbot_0 has joined #oooq | 20:01 | |
| vinaykns | hello channel...how to change the ntp server in quickstart..I have tried undercloud_ntp_servers and ntp-servers as extra args but it didn't workout | 20:04 |
| *** irclogbot_0 has quit IRC | 20:22 | |
| rlandy | vinaykns: undercloud_undercloud_ntp_servers as in https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-deploy/templates/undercloud.conf.j2#L100 | 20:31 |
| vinaykns | rlandy: yes, I haven't tried with undercloud twice as extra_arg in the deployment...I'll try using that..! | 20:35 |
| vinaykns | rlandy: thx.! | 20:35 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (3 more messages) | 20:37 |
| *** holser_ has quit IRC | 20:53 | |
| *** irclogbot_0 has joined #oooq | 21:15 | |
| *** trown is now known as trown|outtypewww | 21:15 | |
| *** dsneddon__ has quit IRC | 21:39 | |
| *** dsneddon__ has joined #oooq | 21:40 | |
| *** kopecmartin is now known as kopecmartin|off | 21:43 | |
| weshay | rfolco|rover, new error can you bring up a reproducer please https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-master-upload/f5a7df5/logs/undercloud/var/log/extra/errors.txt.gz | 21:48 |
| *** vinaykns has quit IRC | 22:29 | |
| *** dtrainor has quit IRC | 22:35 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (3 more messages) | 22:37 |
| *** tosky has quit IRC | 22:45 | |
| *** rlandy has quit IRC | 23:23 | |
| *** agopi is now known as agopi|brb | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!