| *** oanson has joined #openstack-kolla | 00:01 | |
| *** masber has joined #openstack-kolla | 00:03 | |
| *** jtriley has joined #openstack-kolla | 00:10 | |
| hawi | hi there. question: after reconfiguring neutron it seems that machines have ip-s configured, but they boot up slow because there is no network | 00:14 |
|---|---|---|
| *** hieulq has quit IRC | 00:21 | |
| *** duonghq has quit IRC | 00:22 | |
| *** daidv has quit IRC | 00:22 | |
| *** schwicht has joined #openstack-kolla | 00:27 | |
| *** daidv has joined #openstack-kolla | 00:35 | |
| *** duonghq has joined #openstack-kolla | 00:36 | |
| *** hieulq has joined #openstack-kolla | 00:36 | |
| *** tonanhngo has joined #openstack-kolla | 00:36 | |
| *** tonanhngo has quit IRC | 00:40 | |
| *** tonanhngo has joined #openstack-kolla | 00:42 | |
| *** goldyfruit has joined #openstack-kolla | 00:42 | |
| *** awiddersheim has quit IRC | 00:45 | |
| *** awidders_ has joined #openstack-kolla | 00:46 | |
| *** tonanhngo has quit IRC | 00:49 | |
| *** oanson has quit IRC | 00:54 | |
| *** oanson has joined #openstack-kolla | 00:56 | |
| *** manheim has joined #openstack-kolla | 01:00 | |
| *** manheim has quit IRC | 01:04 | |
| *** unicell has quit IRC | 01:05 | |
| sbezverk | Jeffrey4l ping | 01:07 |
| Jeffrey4l | sup sbezverk | 01:08 |
| sbezverk | Jeffrey4l could you please review this ps https://review.openstack.org/481858 it is kind of a blocker for me.. | 01:08 |
| Jeffrey4l | np. checking. | 01:09 |
| sbezverk | Jeffrey4l thanks a lot | 01:09 |
| *** kevzha01 has joined #openstack-kolla | 01:09 | |
| *** vhosakot has quit IRC | 01:10 | |
| *** tovin07_ has joined #openstack-kolla | 01:10 | |
| *** MarginHu has joined #openstack-kolla | 01:10 | |
| *** kevzha01 is now known as kevinz | 01:13 | |
| Jeffrey4l | sbezverk, what's the different with iscsid images? | 01:14 |
| Jeffrey4l | seems the packages installed is almost the some. | 01:14 |
| sbezverk | iscsid image is just a transport used for nova-compute | 01:14 |
| sbezverk | and it runs iscsid process | 01:14 |
| sbezverk | target image loads target kernel driver and serving to store all targets | 01:15 |
| sbezverk | it replaces tgtd | 01:15 |
| sbezverk | as we used tgtadm iscsi_helper for lioadm I need to load module | 01:15 |
| sbezverk | so I cannot use iscsid | 01:16 |
| Jeffrey4l | when using iscsi-target, is there any process should run? | 01:16 |
| sbezverk | no, there are three components 1 - on container start load saved targets, 2 - on container end save targets 3 - load iscsi_target_mod, it will automatically create X.X.X.X:3260 portals for each targte | 01:18 |
| sbezverk | on k8s side I basically run sleep, just to keep container alive | 01:19 |
| Jeffrey4l | sbezverk, so the main usage of this image is: modprobe iscsi_target_mod, right? | 01:21 |
| sbezverk | Jeffrey4l yes | 01:21 |
| Jeffrey4l | sbezverk, why not try to load this module when needed. like "load it when starting cinder-volume"? | 01:21 |
| sbezverk | Jeffrey4l I thought about that, but are trying to keep things separate | 01:23 |
| Jeffrey4l | separate patches? of separate container? | 01:24 |
| sbezverk | not to hit any possible upgrade/update issues when too many components in the same container | 01:24 |
| sbezverk | separate containers | 01:24 |
| sbezverk | iscsi is not the only possible backend | 01:25 |
| Jeffrey4l | sbezverk, check this https://github.com/openstack/kolla/blob/master/docker/ironic/ironic-conductor/extend_start.sh#L3 | 01:25 |
| Jeffrey4l | sbezverk, you can add a environment variable to load the module dynamic. | 01:25 |
| sbezverk | putting everything into the same cinder-volume could make it more complex than needed | 01:25 |
| sbezverk | Jeffrey4l right but then I need to add conditions | 01:26 |
| Jeffrey4l | i do not think add a sleep infinity container, and just load a kernel module is a good idea. | 01:26 |
| Jeffrey4l | sbezverk, just reuse cinder_volume? | 01:26 |
| Jeffrey4l | is there any upgrade issue for this? | 01:26 |
| *** ansmith has joined #openstack-kolla | 01:26 | |
| sbezverk | cinder-volume container can be used with other backends | 01:26 |
| Jeffrey4l | tbh, i do not see any issue. | 01:26 |
| sbezverk | ceph, iscsis etc | 01:27 |
| sbezverk | do I add all there? | 01:27 |
| sbezverk | do not think it is right approach | 01:27 |
| sbezverk | btw we use sleep a lot on k8s side | 01:27 |
| Jeffrey4l | sbezverk, how about this http://paste.openstack.org/show/614974/ | 01:28 |
| *** vhosakot has joined #openstack-kolla | 01:28 | |
| *** Teck7 has joined #openstack-kolla | 01:29 | |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Add vlan tenant network support https://review.openstack.org/474416 | 01:29 |
| sbezverk | Jeffrey4l I agree it is possible solution, please comment then and we will need to discuss on k8s side if this approach does not break anything for us | 01:30 |
| Jeffrey4l | sleep is only use when you need a running env. but it is a little waste to use a sleep container load a kernel module. | 01:30 |
| Jeffrey4l | ok. | 01:30 |
| sbezverk | we try to keep clean and not cram everything to the same container | 01:30 |
| sbezverk | so what you suggest goes against a bit our strategy, but we can discuss | 01:31 |
| Jeffrey4l | understand. thanks. | 01:31 |
| *** Teck72 has quit IRC | 01:32 | |
| sbezverk | one last thing, it will break the logic we have with tgtd, since it is a separate container | 01:34 |
| sbezverk | people might get confused | 01:34 |
| Jeffrey4l | doesn't tgtd have a process? | 01:34 |
| Jeffrey4l | running in container? | 01:34 |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Add block_device_allocate_retries config option https://review.openstack.org/479119 | 01:36 |
| *** MarginHu has quit IRC | 01:38 | |
| *** MarginHu has joined #openstack-kolla | 01:38 | |
| *** ansmith has quit IRC | 01:40 | |
| *** cu5 has quit IRC | 01:41 | |
| vhosakot | sbezverk: if you do Jeffrey4l's approach (not use a sleeping helper container just to modprobe iscsi_target_mod) and conditionally do it in the extend_start.sh of cinder-volume container, will it get hit for other backends like ceph? | 01:41 |
| *** jtriley has quit IRC | 01:42 | |
| sbezverk | vhosakot : I do not think we will go with cinder-volume approch, I think we just get a special image in k8s | 01:42 |
| sbezverk | then | 01:42 |
| vhosakot | sbezverk: ah ok cool | 01:43 |
| Jeffrey4l | vhosakot, what's mean by " it get hit for other backends like ceph?" | 01:43 |
| vhosakot | Jeffrey4l: meaning, will "modprobe iscsi_target_mod" done/ executed for ceph backend too? | 01:43 |
| sbezverk | vhosakot : nope, it will not be loaded | 01:44 |
| *** unicell has joined #openstack-kolla | 01:44 | |
| Jeffrey4l | when using condition load, it will not load. | 01:44 |
| vhosakot | sbezverk: cool cool | 01:44 |
| *** cu5 has joined #openstack-kolla | 01:44 | |
| Jeffrey4l | on the other hand, load the mod is not a big deal when using ceph only. | 01:44 |
| sbezverk | that is what we want to avoid, adding backend speific logic to cinder-volume | 01:45 |
| vhosakot | right, an extra (unused) module won't be a bug deal for ceph, at the same time, I do get that avoiding backend-based if-else conditions in cinder-volume is good. | 01:46 |
| vhosakot | bug==big* | 01:46 |
| *** dixiaoli has joined #openstack-kolla | 01:47 | |
| Jeffrey4l | the benefit of "cinder-volume soltuion" is once "iscsi_target_mod" is unload, simplely restart cinder_volume works. | 01:48 |
| vhosakot | Jeffrey4l: have you run upgrade with stable/ocata? | 01:48 |
| *** unicell has quit IRC | 01:48 | |
| openstackgerrit | shaofeng cheng proposed openstack/kolla-ansible master: Add VMware DataStore support to cinder https://review.openstack.org/452131 | 01:50 |
| *** caoyuan has joined #openstack-kolla | 01:50 | |
| sbezverk | Jeffrey4l would you be ok at least for the change to cinder-volume? if I make is as a separate change? | 01:51 |
| *** schwicht has quit IRC | 01:51 | |
| Jeffrey4l | vhosakot, upgrade from ocata? or to ocata? | 01:52 |
| Jeffrey4l | sbezverk, yep. i like that approach. | 01:52 |
| *** iniazi_ has joined #openstack-kolla | 01:52 | |
| vhosakot | Jeffrey4l: upgrade to Ocata.. I meant, have you run N-->O? doung and I are implementing O-->P upgrade now... tha last upgrade I ran was N-->O and some services were not upgraded successfully. | 01:53 |
| sbezverk | Jeffrey4l cool, then for now I will make a separate patch just for cinder-volume | 01:53 |
| Jeffrey4l | continue the benefit: "sleep solution" container may be run after cinder-volume, which may cause issues. | 01:53 |
| Jeffrey4l | vhosakot, i ran successfully. which services failed? mariadb? | 01:54 |
| vhosakot | Jeffrey4l: yes, mariadb and metadata agent too. | 01:54 |
| Jeffrey4l | i am not surprise about mariadb. but metadata agent should be OK. | 01:55 |
| *** iniazi has quit IRC | 01:56 | |
| vhosakot | Jeffrey4l: ok, I'll check again | 01:56 |
| *** schwicht has joined #openstack-kolla | 01:56 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla master: Adding python-rtslib to cinder-volume for lioadm support https://review.openstack.org/482375 | 01:57 |
| sbezverk | Jeffrey4l here you go ^^^ | 01:57 |
| sbezverk | by the way cinder volume does not have target bits | 01:58 |
| Jeffrey4l | sbezverk, are u want to use cinder_volume to sleep infinity? or load dynamic? | 01:58 |
| sbezverk | Jeffrey4l no I do not want use cinder-volume for this | 02:00 |
| sbezverk | cinder-volume change is needed because the code uses rts lib when lioadm is used as iscsi helper | 02:00 |
| *** schwicht has quit IRC | 02:01 | |
| sbezverk | I still want to use a separate container for target things | 02:01 |
| sbezverk | but I will check with kfox1111 about it tomorrow | 02:01 |
| *** Teck72 has joined #openstack-kolla | 02:03 | |
| *** zhurong has joined #openstack-kolla | 02:03 | |
| *** dixiaoli_ has joined #openstack-kolla | 02:04 | |
| *** Teck7 has quit IRC | 02:06 | |
| *** dixiaoli has quit IRC | 02:07 | |
| *** jtriley has joined #openstack-kolla | 02:10 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla master: Adding new iscsi-target image to support lioadm https://review.openstack.org/481858 | 02:11 |
| sbezverk | Jeffrey4l you mentioned that this PS would be ok by you, right? https://review.openstack.org/482375 | 02:12 |
| Jeffrey4l | yep. +2ed. | 02:13 |
| *** Teck7 has joined #openstack-kolla | 02:14 | |
| *** Teck72 has quit IRC | 02:17 | |
| *** Teck72 has joined #openstack-kolla | 02:18 | |
| vhosakot | sbezverk: +2'ed too | 02:21 |
| *** jtriley has quit IRC | 02:22 | |
| *** Teck7 has quit IRC | 02:22 | |
| *** Teck7 has joined #openstack-kolla | 02:22 | |
| *** Teck72 has quit IRC | 02:25 | |
| *** jtriley has joined #openstack-kolla | 02:26 | |
| sbezverk | Jeffrey4l would it be ok to ported to newton, wehn cinder-volume change gets merged? | 02:26 |
| Jeffrey4l | sbezverk, yes. I think so. | 02:26 |
| sbezverk | Jeffrey4l thanks | 02:27 |
| *** emccormickva has joined #openstack-kolla | 02:27 | |
| Jeffrey4l | np. | 02:30 |
| *** Teck72 has joined #openstack-kolla | 02:30 | |
| *** emccormick has quit IRC | 02:31 | |
| *** rfxn has joined #openstack-kolla | 02:32 | |
| *** Teck7 has quit IRC | 02:33 | |
| *** Teck72 has quit IRC | 02:35 | |
| *** Teck7 has joined #openstack-kolla | 02:38 | |
| *** rfxn has quit IRC | 02:41 | |
| openstackgerrit | Merged openstack/kolla master: Fix zun log dir permissions https://review.openstack.org/480961 | 02:46 |
| *** ducttape_ has joined #openstack-kolla | 02:46 | |
| *** caoyuan_ has joined #openstack-kolla | 02:51 | |
| *** caoyuan has quit IRC | 02:54 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add Swift backend support to Glance https://review.openstack.org/452059 | 02:55 |
| *** Teck72 has joined #openstack-kolla | 02:57 | |
| *** kbaegis has joined #openstack-kolla | 02:59 | |
| *** kolla-slack has quit IRC | 03:00 | |
| *** kolla-slack has joined #openstack-kolla | 03:00 | |
| *** Teck7 has quit IRC | 03:01 | |
| openstackgerrit | jimmygc proposed openstack/kolla-ansible master: Add Swift backend support to Glance https://review.openstack.org/452059 | 03:06 |
| *** jamesbenson has joined #openstack-kolla | 03:10 | |
| *** kbaegis1 has joined #openstack-kolla | 03:15 | |
| *** jamesbenson has quit IRC | 03:15 | |
| *** kbaegis has quit IRC | 03:18 | |
| *** schwicht has joined #openstack-kolla | 03:20 | |
| *** ducttape_ has quit IRC | 03:20 | |
| *** schwicht has quit IRC | 03:27 | |
| *** vhosakot has quit IRC | 03:33 | |
| *** goldyfruit has quit IRC | 03:34 | |
| *** kbaegis1 has quit IRC | 03:35 | |
| *** kbaegis has joined #openstack-kolla | 03:35 | |
| *** dixiaoli has joined #openstack-kolla | 03:38 | |
| *** dixiaoli_ has quit IRC | 03:39 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Do Not Merge, kolla-kubernetes gate tests https://review.openstack.org/461063 | 03:47 |
| *** dixiaoli has quit IRC | 03:49 | |
| *** schwicht has joined #openstack-kolla | 03:52 | |
| spsurya | morning all | 03:57 |
| sdake | hi spsurya | 03:57 |
| sdake | how ya been | 03:57 |
| *** schwicht has quit IRC | 03:57 | |
| *** dave-mccowan has quit IRC | 04:00 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support https://review.openstack.org/481690 | 04:03 |
| *** mdnadeem has joined #openstack-kolla | 04:10 | |
| openstackgerrit | Merged openstack/kolla master: Adding python-rtslib to cinder-volume for lioadm support https://review.openstack.org/482375 | 04:19 |
| spsurya | sdake: sup | 04:33 |
| *** jrist has quit IRC | 04:33 | |
| spsurya | good | 04:33 |
| spsurya | Hope you also good | 04:34 |
| MarginHu | I want to set docker_common_options parameter but find its type is dictionary. why? | 04:35 |
| masber | good afternoon, how can I start the nova_api container that has been stopped? | 04:50 |
| masber | I am using kolla-ansible | 04:52 |
| masber | I was thinking to do kolla-ansible deploy but I was wondering whether there is a better way to do it | 04:53 |
| MarginHu | docker restart nova_api | 04:54 |
| masber | MarginHu, the container is stopped | 04:55 |
| masber | *deleted sorry | 04:56 |
| *** kristian__ has joined #openstack-kolla | 05:01 | |
| *** kristian__ has quit IRC | 05:06 | |
| openstackgerrit | Merged openstack/kolla master: Replace http with https https://review.openstack.org/481975 | 05:06 |
| *** dixiaoli has joined #openstack-kolla | 05:17 | |
| *** lpetrut has joined #openstack-kolla | 05:41 | |
| openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Fix option api_v1 in tempest.cof https://review.openstack.org/482408 | 05:42 |
| zhubingbing_ | Hi guys | 05:42 |
| *** skramaja has joined #openstack-kolla | 05:44 | |
| spsurya | sup zhubingbing_ | 05:45 |
| zhubingbing_ | https://review.openstack.org/482408 | 05:45 |
| *** kristian__ has joined #openstack-kolla | 05:47 | |
| *** manheim has joined #openstack-kolla | 05:54 | |
| *** jamesbenson has joined #openstack-kolla | 05:57 | |
| openstackgerrit | zhubingbing proposed openstack/kolla-ansible master: Fix option api_v1 in tempest.conf https://review.openstack.org/482408 | 05:57 |
| *** manheim has quit IRC | 05:57 | |
| *** jamesbenson has quit IRC | 06:01 | |
| *** vincent_vdk has joined #openstack-kolla | 06:03 | |
| *** pcaruana has joined #openstack-kolla | 06:04 | |
| *** kristian__ has quit IRC | 06:18 | |
| *** kristian__ has joined #openstack-kolla | 06:18 | |
| *** karimb has joined #openstack-kolla | 06:23 | |
| masber | hi, is there a date for the 4.0.1 images release? | 06:24 |
| MarginHu | I found I failed to wget https://tarballs.openstack.org/kolla/images/centos-source-registry-ocata.tar.gz | 06:26 |
| *** kevinz has quit IRC | 06:33 | |
| *** lpetrut has quit IRC | 06:39 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Pull cinder cephx keyring only when enable_cinder is true in nova https://review.openstack.org/481793 | 06:39 |
| *** zhurong has quit IRC | 06:40 | |
| *** zhurong has joined #openstack-kolla | 06:45 | |
| *** hieulq has quit IRC | 06:50 | |
| *** daidv has quit IRC | 06:51 | |
| *** tovin07_ has quit IRC | 06:52 | |
| *** duonghq has quit IRC | 06:53 | |
| *** emccormickva has quit IRC | 06:56 | |
| *** jamesbenson has joined #openstack-kolla | 06:59 | |
| *** tovin07_ has joined #openstack-kolla | 07:01 | |
| *** jamesbenson has quit IRC | 07:03 | |
| *** daidv has joined #openstack-kolla | 07:05 | |
| *** duonghq has joined #openstack-kolla | 07:05 | |
| *** hieulq has joined #openstack-kolla | 07:05 | |
| *** gfidente has joined #openstack-kolla | 07:06 | |
| *** gfidente has quit IRC | 07:06 | |
| *** gfidente has joined #openstack-kolla | 07:06 | |
| *** shardy has joined #openstack-kolla | 07:11 | |
| *** athomas has joined #openstack-kolla | 07:28 | |
| *** zhurong has quit IRC | 07:30 | |
| *** tovin07__ has joined #openstack-kolla | 07:31 | |
| *** openstackgerrit has quit IRC | 07:33 | |
| *** tovin07_ has quit IRC | 07:33 | |
| *** rmart04 has joined #openstack-kolla | 07:37 | |
| *** reidrac has joined #openstack-kolla | 07:38 | |
| *** karimb has quit IRC | 07:43 | |
| *** egonzalez has joined #openstack-kolla | 07:44 | |
| *** hieulq has quit IRC | 07:44 | |
| *** duonghq has quit IRC | 07:45 | |
| *** tovin07__ has quit IRC | 07:45 | |
| *** daidv has quit IRC | 07:45 | |
| *** janki has joined #openstack-kolla | 07:49 | |
| *** serlex has joined #openstack-kolla | 07:52 | |
| *** duonghq has joined #openstack-kolla | 08:01 | |
| *** hieulq has joined #openstack-kolla | 08:02 | |
| *** daidv has joined #openstack-kolla | 08:03 | |
| *** tovin07_ has joined #openstack-kolla | 08:10 | |
| *** jascott1 has quit IRC | 08:13 | |
| *** manheim has joined #openstack-kolla | 08:14 | |
| *** jascott1 has joined #openstack-kolla | 08:14 | |
| *** openstackgerrit has joined #openstack-kolla | 08:14 | |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: [WIP] Implement Keystone zero-downtime upgrade https://review.openstack.org/480081 | 08:14 |
| *** lyang__ has left #openstack-kolla | 08:15 | |
| *** karimb has joined #openstack-kolla | 08:18 | |
| *** jascott1 has quit IRC | 08:18 | |
| duonghq | spsurya, ping | 08:23 |
| *** zhurong has joined #openstack-kolla | 08:27 | |
| *** sambetts|afk is now known as sambetts | 08:30 | |
| *** karimb has quit IRC | 08:30 | |
| *** karimb has joined #openstack-kolla | 08:33 | |
| *** jamesbenson has joined #openstack-kolla | 08:43 | |
| *** mgoddard_ has joined #openstack-kolla | 08:43 | |
| *** jamesbenson has quit IRC | 08:48 | |
| *** tvignaud has quit IRC | 08:58 | |
| *** jamesbenson has joined #openstack-kolla | 09:04 | |
| *** lpetrut has joined #openstack-kolla | 09:04 | |
| *** jamesbenson has quit IRC | 09:08 | |
| *** tvignaud has joined #openstack-kolla | 09:10 | |
| spsurya | duonghq: hi.. | 09:12 |
| spsurya | wasn't around | 09:12 |
| spsurya | regarding this https://review.openstack.org/#/c/480081/ | 09:13 |
| spsurya | ? | 09:13 |
| reidrac | anyone using Oracle Linux that would like to look at this? https://review.openstack.org/#/c/467219/ | 09:19 |
| reidrac | TL;DR: replacing the not-so-good td-agent RPM with a fluentd RPM maintained by CentOS SiG. Looks good for CentOS/RHEL, and it'd be best to use it on Oracle Linux too so all three distros use the same | 09:21 |
| *** jamesbenson has joined #openstack-kolla | 09:25 | |
| egonzalez | reidrac, pbourke may help with oracle | 09:27 |
| pbourke | morning, yes Im looking at it right now :) | 09:27 |
| *** zhurong has quit IRC | 09:27 | |
| pbourke | reidrac: I think in general its preferable to keep the rpm based distros as similar as possible | 09:28 |
| pbourke | reidrac: so Im in favor of doing the same for centos/rhel/oraclelinux | 09:28 |
| reidrac | yes, it makes sense | 09:28 |
| pbourke | reidrac: only concern I have is Id love to see the 'gem install' go away | 09:28 |
| *** jamesbenson has quit IRC | 09:29 | |
| openstackgerrit | Merged openstack/kolla master: Fix wrong extra name for glance_store https://review.openstack.org/481493 | 09:30 |
| pbourke | reidrac: as soon as we add this we require operators to have gem mirrors to build this image without internet access. Im just looking at the moment and it seems many of the plugins we're installing are deprecated now. Is there a reason we are installing them for centos but not for rhel? | 09:30 |
| reidrac | pbourke: I guess those plugins could be cooked into an RPM, right? | 09:30 |
| reidrac | to be honest, fluentd is a bit of a mess; I've been doing some work to port it to SUSE and I'm not happy | 09:30 |
| pbourke | yeah | 09:31 |
| reidrac | and upstream doesn't seem to be too helpful | 09:31 |
| egonzalez | pbourke, updating the deprecated plugins means upgrade fluentd version too iirc | 09:32 |
| reidrac | but stable is still 0.12.36? | 09:32 |
| pbourke | hmm yes seems to be | 09:33 |
| pbourke | how heavily do we depend on these plugins | 09:33 |
| egonzalez | guess we fully depend on them, grok, grep, elasticsearch, rewrite, etc. all are settings used in config | 09:34 |
| egonzalez | anybody know where is the fluentd-distgit repo files? | 09:35 |
| reidrac | packaging those plugins in a RPM and submitting that to CentOS SiG repo should be possible | 09:36 |
| reidrac | pbourke: build the image without inet access? I thought in those cases it'd better to distribute the images directly | 09:37 |
| pbourke | actually it seems we already gem install those plugins so it's not necessarily your problem ;) | 09:37 |
| pbourke | in some cases but a lot of companies need to build from internal mirrors | 09:37 |
| reidrac | OK, got you; still that's a lot of mirrors :) | 09:38 |
| reidrac | I like the change as it is; it can be refined later | 09:38 |
| reidrac | just removing td-agent and having a sane RPM is a Win | 09:39 |
| pbourke | reidrac: yes it seems good - if you can just make it the same for rhel/centos/oraclelinux (as much as possible) then that would be great | 09:39 |
| pbourke | reidrac: and maybe in the future we can look into changing fluentd ;) | 09:40 |
| reidrac | pbourke: is not my change; but the guy in changer seems open to criticism | 09:40 |
| reidrac | *in charge | 09:40 |
| pbourke | reidrac: ah sorry I thought it was yours | 09:40 |
| reidrac | pbourke: nope, I'm just advocating it after my bad experience with td-agent (and because it is really unlikely it'll work on SUSE, and that would block my kolla port from being merged I think) | 09:41 |
| egonzalez | some fluentd gem plugins are present is opstools repo https://buildlogs.centos.org/centos/7/opstools/x86_64/logging/ | 09:41 |
| reidrac | egonzalez: perhaps we can ask the guy to explore that in a different PR; I wouldn't like him to give up on it | 09:42 |
| egonzalez | reidrac, wfm, i'd only wait for merge all rpm distros with same config | 09:43 |
| reidrac | egonzalez: +1 | 09:43 |
| egonzalez | reidrac, re suse, does differ too much config from all other rpm with suse? at the very end, suse is just another rpm distro (except the package manager) | 09:44 |
| reidrac | egonzalez: there are few suse-isms re: integration with YaST | 09:45 |
| reidrac | but so far the changes are minimal | 09:45 |
| *** karimb has quit IRC | 09:46 | |
| reidrac | I have keystone and dependencies + the vagrant dev enviroment | 09:46 |
| reidrac | if I get fluentd to work in SUSE, I'll submit those changes | 09:46 |
| reidrac | because at the moment I have to run fluentd in a centos container, and that's not ideal | 09:47 |
| egonzalez | note my ignorance about suse, but changing the macros install to use zypper instead of yum may work(over simplifying ofc) | 09:47 |
| reidrac | egonzalez: ansible has tiny changes; docker images a bit more | 09:47 |
| reidrac | eg. crond binary is actually cron | 09:47 |
| reidrac | don't ask me why | 09:48 |
| reidrac | few images don't require changes other than using zypper | 09:48 |
| reidrac | in other cases the package games are different; but as I said I tried to keep it minimal and it is just few branches on Dockerfiles | 09:49 |
| reidrac | *package names | 09:49 |
| *** karimb has joined #openstack-kolla | 09:49 | |
| reidrac | my only blocker is td-agent; and although I've been exploring the possibility of a fluentd package, it has few required gems that aren't packaged for SUSE so I may need time to get all that sorted | 09:50 |
| *** wahnsinn has quit IRC | 09:53 | |
| egonzalez | reidrac, most gems are also not packaged for centos, will need to use the geminstall too | 09:56 |
| reidrac | egonzalez: yes, I'm exploring that as an option; thanks | 09:57 |
| *** dixiaoli has quit IRC | 10:00 | |
| egonzalez | we need to take care of merging the change in kolla, ansible gates will be broken until we rework common role | 10:00 |
| masber | good afternoon all, I am using ceph as a data plane, is it possible to connect ceph with the object storage service? it is required by ironic to download the images for deployment. I am using centos binary 4.0.0 images | 10:01 |
| *** caowei has quit IRC | 10:03 | |
| egonzalez | masber, swift or radosgw? | 10:04 |
| hawi | is there any good known way to resinstall fluentd container? | 10:04 |
| *** caoyuan_ has quit IRC | 10:05 | |
| masber | egonzalez, radosgw | 10:05 |
| *** kristia__ has joined #openstack-kolla | 10:05 | |
| *** daidv has quit IRC | 10:06 | |
| *** hieulq has quit IRC | 10:06 | |
| egonzalez | masber, enable_ceph_rgw: yes | 10:06 |
| *** duonghq has quit IRC | 10:07 | |
| egonzalez | hawi, by reinstall means replace with newer version? | 10:07 |
| hawi | no, with same version - it tends to fail in some cases | 10:07 |
| *** tovin07_ has quit IRC | 10:08 | |
| hawi | i'm running 4.0.0 - can't update it. the thing is that i cant reconfigure some things because fluentd fails on one controller and playbook doesnt want to continue: {"failed": true, "msg": "The conditional check 'container_state.Running == false' failed. The error was: error while evaluating conditional (container_state.Running == false): 'dict object' has no attribute 'Running'"} | 10:08 |
| hawi | something like this | 10:08 |
| *** kristian__ has quit IRC | 10:09 | |
| masber | egonzalez, sorry I ment I currently have "ceph_rgw: yes" but I don't have endpoint for object storage. i need object storage endpoint to create a temporary url https://docs.openstack.org/ironic/latest/install/configure-glance-swift.html | 10:14 |
| egonzalez | masber, need to enable_ceph_rgw_keystone: yes to create swift endpoints | 10:15 |
| egonzalez | is not enabled by default when enabling rgw | 10:16 |
| masber | thank you, I guess this option should be in enable_ceph_rgw_keystone right? | 10:18 |
| egonzalez | masber, yep | 10:18 |
| *** MarginHu has quit IRC | 10:18 | |
| hawi | after adding designate i cant add any floating ips: https://pastebin.com/5ikgcq9C | 10:19 |
| masber | I don't need enable_swift: "yes" right? (just double checking) | 10:19 |
| *** ducttape_ has joined #openstack-kolla | 10:22 | |
| egonzalez | masber, no, swift should be disabled, deploy will check that before create endpoint | 10:22 |
| egonzalez | hawi, have you followed designate guide? there are some manual steps | 10:22 |
| egonzalez | hawi, https://github.com/openstack/kolla-ansible/blob/master/doc/designate-guide.rst#neutron-and-nova-integration | 10:22 |
| egonzalez | neutron need to know to which domain create floating ips | 10:23 |
| egonzalez | s/neutron/designate | 10:23 |
| *** ducttape_ has quit IRC | 10:26 | |
| *** hieulq has joined #openstack-kolla | 10:26 | |
| *** daidv has joined #openstack-kolla | 10:28 | |
| *** daidv has quit IRC | 10:31 | |
| jbadiapa | egonzalez, have you got a minute? | 10:35 |
| egonzalez | jbadiapa, sure | 10:35 |
| jbadiapa | egonzalez, it's to ask about the last comment about the https://review.openstack.org/#/c/467219 ? | 10:36 |
| jbadiapa | about the breaking the ansible gates | 10:36 |
| egonzalez | jbadiapa, yeah, installing fluentd package rather than tg will change binary | 10:36 |
| egonzalez | ansible gates use tg-agent.conf and tg-agent binary to start fluentd | 10:36 |
| egonzalez | not sure if more changes are needed, or what differs in the config file | 10:37 |
| jbadiapa | egonzalez, the only thing to change is the path/name of the files , the rest of the things should be the same | 10:39 |
| jbadiapa | maybe a symbolic link will do the work, need to test it | 10:40 |
| *** schwicht has joined #openstack-kolla | 10:40 | |
| egonzalez | I would prefer maintain configuration in ansible repo, similar cases is with python paths, ubuntu != centos and need conditionally names in templates | 10:42 |
| jbadiapa | egonzalez, thx for the warning | 10:42 |
| egonzalez | jbadiapa, another question, redhat fluentd rpm have gem plugins installed or as dependency? | 10:43 |
| jbadiapa | egonzalez, Nope, the plugins need to be installed as rpm | 10:46 |
| *** daidv has joined #openstack-kolla | 10:46 | |
| reidrac | jbadiapa: and centos requires a gem install? what is the difference? | 10:47 |
| egonzalez | opstools repo does not have all required plugins as rpm | 10:47 |
| egonzalez | fluentd wont work in that case(at least in ansible) which requires grok, elasticsearch, parser and grep | 10:48 |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla-ansible master: Improve Swift ring setup sample script https://review.openstack.org/482508 | 10:48 |
| *** schwicht has quit IRC | 10:48 | |
| reidrac | jbadiapa: does rhel install ops tools repo from centos? | 10:53 |
| reidrac | where is fluentd package coming? :) | 10:55 |
| reidrac | *from | 10:55 |
| jbadiapa | reidrac, well, I need to verify but yes. | 10:57 |
| *** magicboiz has quit IRC | 10:58 | |
| *** magicboiz has joined #openstack-kolla | 10:59 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible stable/ocata: Update simple_cell_setup to manual creation https://review.openstack.org/482513 | 11:00 |
| openstackgerrit | Merged openstack/kolla master: Use monasca master tarballs https://review.openstack.org/481118 | 11:03 |
| *** hieulq has quit IRC | 11:05 | |
| *** daidv has quit IRC | 11:05 | |
| *** dave-mccowan has joined #openstack-kolla | 11:09 | |
| *** kristian__ has joined #openstack-kolla | 11:11 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Make glance filesystem_store_datadir configurable. https://review.openstack.org/452094 | 11:14 |
| *** kristia__ has quit IRC | 11:15 | |
| *** daidv has joined #openstack-kolla | 11:19 | |
| *** hieulq has joined #openstack-kolla | 11:19 | |
| *** rwallner has joined #openstack-kolla | 11:27 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix designate-api listen interface https://review.openstack.org/482238 | 11:29 |
| *** eaguilar has quit IRC | 11:49 | |
| *** karimb has quit IRC | 11:50 | |
| *** daidv has quit IRC | 11:51 | |
| *** hieulq has quit IRC | 11:51 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Test fluentd kolla change https://review.openstack.org/482528 | 11:55 |
| egonzalez | jbadiapa, ^^ this change may work(not tested) | 11:56 |
| egonzalez | jbadiapa, what im not sure is the behaviour while upgrading changing /var/run/<td-agent/fluentd> | 11:57 |
| *** daidv has joined #openstack-kolla | 12:05 | |
| *** hieulq has joined #openstack-kolla | 12:05 | |
| *** schwicht has joined #openstack-kolla | 12:09 | |
| *** caoyuan has joined #openstack-kolla | 12:10 | |
| openstackgerrit | Flavio Percoco proposed openstack/kolla-ansible master: Allow for running standalone Ironic w/o keystone https://review.openstack.org/476927 | 12:11 |
| *** ansmith has joined #openstack-kolla | 12:11 | |
| *** hieulq has quit IRC | 12:16 | |
| *** daidv has quit IRC | 12:17 | |
| *** awidders_ has quit IRC | 12:23 | |
| sean-k-mooney | o/ are there issues with the ci currectly? specifcally with tarballs.openstack.org? | 12:23 |
| *** awiddersheim has joined #openstack-kolla | 12:24 | |
| egonzalez | sean-k-mooney, yep, yesterday was a overload in network pulling tarballs and infra disabled it | 12:26 |
| sean-k-mooney | egonzalez: ah ok running the command locally semed to work but wget -q -c -O /tmp/centos-binary-registry-master.tar.gz http://tarballs.openstack.org/kolla/images/centos-binary-registry-master.tar.gz was failing in the gate | 12:27 |
| sean-k-mooney | egonzalez: is the ci still overloaded or is it fine to kick off a recheck? | 12:28 |
| egonzalez | sean-k-mooney, inc0 is working on a proxy cache for tarballs | 12:28 |
| sean-k-mooney | egonzalez: ok just asking for https://review.openstack.org/#/c/408872/12, the ci wont actully execute the code i wrote so not sure its worth a recheck but the red is bugging me | 12:29 |
| egonzalez | i'm still seeing some jobs failing because cannot download the registry | 12:29 |
| egonzalez | if is a kolla gate is fine, but ansibles soma fails | 12:29 |
| *** hrw has quit IRC | 12:30 | |
| sean-k-mooney | egonzalez: ya its ansible as i said the review is for a contrib playbook so the ci wont run the code anyway so ill leave it for now. | 12:31 |
| *** hrw has joined #openstack-kolla | 12:32 | |
| *** hieulq has joined #openstack-kolla | 12:32 | |
| *** daidv has joined #openstack-kolla | 12:32 | |
| manheim | Hi guys | 12:33 |
| manheim | i've manged to reproduce the metadata agent issue i had yesterday | 12:33 |
| manheim | now it's on my env and i can play around with it | 12:33 |
| egonzalez | manheim, what metadata issue? | 12:34 |
| manheim | so my VM does not got the metadata stuf, like a key | 12:34 |
| manheim | logs incoming | 12:34 |
| manheim | http://paste.ubuntu.com/25067985/ | 12:35 |
| manheim | http://paste.ubuntu.com/25067990/ | 12:36 |
| manheim | the second log is neutron-metadata-agent | 12:36 |
| manheim | the first one is the neutron-ns-metadata-proxy | 12:36 |
| masber | hi all, sorry another question, I am getting a none authorized 401 error from glance when ironic is trying to push the image to the machine, I am looking into the ceph logs to see if I can find the reason of the error but they are empty (/var/lib/docker/volumes/kolla_logs/_data) is there any other place to find the logs? | 12:36 |
| egonzalez | manheim, mind sharing nova compute log too? | 12:37 |
| manheim | sure thing, this is all kvm so no hyperv | 12:37 |
| manheim | nova-api? | 12:38 |
| *** iniazi has joined #openstack-kolla | 12:38 | |
| egonzalez | nova-compute | 12:38 |
| egonzalez | manheim, recently show metadata errors caused by a recent change in nova, was fixed last week iirc | 12:39 |
| manheim | so now i have master code with 4.0.0 images, yesterday i had stable/ocata | 12:39 |
| sean-k-mooney | masber: some logs can be seen via docker logs <glance container name> | 12:40 |
| *** caoyuan_ has joined #openstack-kolla | 12:41 | |
| *** caoyuan has quit IRC | 12:41 | |
| egonzalez | manheim, sorry, metadata is handled by nova-api | 12:41 |
| *** iniazi_ has quit IRC | 12:41 | |
| egonzalez | should be in nova-api logs | 12:41 |
| manheim | sure, let me reboot a vm | 12:41 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Test fluentd kolla change https://review.openstack.org/482528 | 12:46 |
| *** openstackgerrit has quit IRC | 12:47 | |
| *** karimb has joined #openstack-kolla | 12:48 | |
| *** emccormick has joined #openstack-kolla | 12:51 | |
| *** IRC-Source_14475 has joined #openstack-kolla | 12:52 | |
| *** ansmith has quit IRC | 12:52 | |
| IRC-Source_14475 | Hi all, i am getting the following error when running "kolla-ansible genconfig" : | 12:52 |
| *** IRC-Source_14475 has quit IRC | 12:53 | |
| *** IRC-Source_13808 has joined #openstack-kolla | 12:53 | |
| IRC-Source_13808 | https://thepasteb.in/p/zmh8VVwAEoNtZ | 12:53 |
| IRC-Source_13808 | any ideas? | 12:54 |
| gema | IRC-Source_13808: from the error you are missing ansible_eth0 config | 12:54 |
| manheim | egonzalez hmm nothing interesting in nova-api logs | 12:55 |
| IRC-Source_13808 | Will try to do some googling and get back to it, thanks gema! | 12:56 |
| *** goldyfruit has joined #openstack-kolla | 12:57 | |
| *** markus-k has quit IRC | 12:59 | |
| *** markus-k has joined #openstack-kolla | 12:59 | |
| egonzalez | manheim, ansible or k8s? is memcached running fine? | 12:59 |
| manheim | ansible | 12:59 |
| egonzalez | manheim, when were images build? | 13:00 |
| manheim | i pulled them | 13:01 |
| manheim | same for the stable/ocata env | 13:01 |
| *** rhallisey has joined #openstack-kolla | 13:02 | |
| *** IRC-Source_13808 has quit IRC | 13:02 | |
| *** pradk has quit IRC | 13:04 | |
| rwellum | egonzalez: https://review.openstack.org/#/c/482217 - this is to address the CI issue? | 13:06 |
| egonzalez | rwallner, guess yes, not sure what exactly does | 13:07 |
| *** hmedhioub has quit IRC | 13:07 | |
| rwellum | egonzalez: rwellum no rwallner - he gets a lot of my replies :) | 13:08 |
| rwallner | haha yep, no worries :) | 13:09 |
| egonzalez | sorry one more time rwallner :) | 13:09 |
| *** karimb has quit IRC | 13:09 | |
| manheim | shouldn't there be a nova-metadata service? | 13:10 |
| *** karimb has joined #openstack-kolla | 13:10 | |
| *** mdnadeem has quit IRC | 13:10 | |
| *** ansmith has joined #openstack-kolla | 13:11 | |
| egonzalez | manheim, nope, nova-api is the proxy between neutron metadata and nova | 13:12 |
| egonzalez | nova-matadata was with nova-network iirc | 13:12 |
| *** trozet has joined #openstack-kolla | 13:15 | |
| jbadiapa | egonzalez, thx for the changereview | 13:15 |
| *** jascott1 has joined #openstack-kolla | 13:16 | |
| *** hieulq has quit IRC | 13:17 | |
| *** daidv has quit IRC | 13:17 | |
| *** jascott1 has quit IRC | 13:21 | |
| masber | when kolla-ansible installs ceph, does it generates a STORE_KEY? | 13:22 |
| masber | that STORE_KEY is later used by glance and swift | 13:22 |
| rwellum | ping sbezverk | 13:25 |
| manheim | hah, fount the issue | 13:25 |
| manheim | found* | 13:25 |
| sbezverk | rwellum : hey what is up? | 13:25 |
| *** openstackgerrit has joined #openstack-kolla | 13:26 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support https://review.openstack.org/481690 | 13:26 |
| manheim | there is a issue with a config in metadata_agent.in | 13:27 |
| manheim | “nova_metadata_host” should be “nova_metadata_ip" | 13:27 |
| manheim | misspelled config option | 13:27 |
| manheim | i've changed the config name and works | 13:27 |
| egonzalez | manheim, metadata host is only present in neutron master code | 13:29 |
| egonzalez | is ansible/docker images in same release? | 13:29 |
| manheim | they are 4.0.0 | 13:29 |
| manheim | i see | 13:29 |
| manheim | should have built new ones for current release | 13:29 |
| manheim | right? | 13:29 |
| egonzalez | ansible ocata(4.0.0) should not have metadata_host option | 13:30 |
| *** mmehan has joined #openstack-kolla | 13:30 | |
| egonzalez | kolla-ansible and kolla should be in same release, so they share correct config | 13:30 |
| manheim | i see | 13:31 |
| manheim | so there is not an issue per se, it's just that i mixed the releases | 13:31 |
| *** mmehan has quit IRC | 13:31 | |
| rwellum | sbezverk: so I tried again this morning and no issues with neutron-openvswitch | 13:32 |
| *** mmehan has joined #openstack-kolla | 13:32 | |
| rwellum | I did use a new VM. | 13:33 |
| *** hieulq has joined #openstack-kolla | 13:33 | |
| *** daidv has joined #openstack-kolla | 13:33 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla stable/ocata: Adding python-rtslib to cinder-volume for lioadm support https://review.openstack.org/482564 | 13:33 |
| sbezverk | rwellum : good news :) | 13:34 |
| egonzalez | manheim, yep, just deployed and it works | 13:35 |
| sbezverk | egonzalez I needed a backport of 482564 which is already merged into master | 13:35 |
| egonzalez | sbezverk, btw in k8s is cinder-api running under apache or serverlet? | 13:37 |
| sbezverk | egonzalez : servlet | 13:38 |
| egonzalez | sbezverk, cinder-api was not working in .deb distros because they removed systemd service in ocata, we moved config to apache only for ubuntu in ocata in current master all are running under apache | 13:39 |
| egonzalez | *missing only one change in ansible side | 13:39 |
| rwellum | sbezverk: check out: https://github.com/RichWellum/k8s - looks at the sample output bottom section of the readme. That was from this morning. My tool is working well I think. | 13:40 |
| sbezverk | egonzalez : thanks for heads up, so far we did not see any issues, but I guess because we do not test with debian | 13:41 |
| egonzalez | sbezverk, ubuntu binary should be failing too due missing cinder-api command in 4.0.0 | 13:42 |
| manheim | kolla-build --base ubuntu --base-tag 16.04 --type source | 13:43 |
| manheim | is this ok for image building if I have the latest code? | 13:43 |
| egonzalez | umm, I see, gates run with 3.0.2 | 13:43 |
| *** skramaja has quit IRC | 13:44 | |
| *** jtriley has quit IRC | 13:44 | |
| manheim | egonzalez that ok? | 13:44 |
| egonzalez | manheim, base-tag is not needed, 16.04 is default, maybe you want to push to a registry and also give a namespace | 13:44 |
| sbezverk | egonzalez : I will double check but I have not seen failures | 13:45 |
| manheim | ok, so it's ok, ty | 13:45 |
| sbezverk | egonzalez if you could ack the backport, that would be great | 13:45 |
| egonzalez | sbezverk, done, lets wait gates | 13:45 |
| sbezverk | egonzalez thanks a lot | 13:45 |
| *** hieulq has quit IRC | 13:46 | |
| sbezverk | rwellum : you built another tool :) man, so many of these | 13:46 |
| *** daidv has quit IRC | 13:46 | |
| rwellum | sbezverk: Mines unique :) | 13:46 |
| sbezverk | rwellum : of course!! | 13:47 |
| spsurya | sbezverk: rwellum hi..... | 13:47 |
| spsurya | sbezverk: i tested this tool | 13:47 |
| spsurya | :) | 13:47 |
| rwellum | I started it before I knew about the playbooks, shell-script etc. | 13:47 |
| rwellum | Yeah some people have found it the only one that works for them on a vm. | 13:47 |
| spsurya | from development perspective it is good IMO | 13:48 |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix option api_v1 in tempest.conf https://review.openstack.org/482408 | 13:48 |
| *** karimb has quit IRC | 13:48 | |
| sbezverk | spsurya I absolutely was not saying it was bad, just stating the fact that there are so many. The more important that it gets supported longer than just the time to develop it.. | 13:54 |
| *** dklyle has quit IRC | 13:55 | |
| *** david-lyle has joined #openstack-kolla | 13:55 | |
| spsurya | sbezverk: yes agree | 13:56 |
| *** ducttape_ has joined #openstack-kolla | 13:57 | |
| *** jistr is now known as jistr|call | 13:58 | |
| spsurya | brad and jascott tools also there | 14:00 |
| *** daidv has joined #openstack-kolla | 14:01 | |
| *** ducttape_ has quit IRC | 14:01 | |
| *** hieulq has joined #openstack-kolla | 14:01 | |
| spsurya | ansible approaches almost like they are heading towards production level | 14:01 |
| *** hongbin has joined #openstack-kolla | 14:03 | |
| manheim | i have another question | 14:04 |
| manheim | let's say i have stable/ocata with 4.0.0 and I want to do an upgrade | 14:04 |
| manheim | to let's say 5.0.0, i know it not yet released but follow my idea | 14:04 |
| manheim | i edit the release version in globals and d othe upgrade | 14:05 |
| manheim | but what about the kolla and kolla-ansible code? | 14:05 |
| manheim | i just pip uninstall kolla, git pull and install again? | 14:06 |
| *** jtriley has joined #openstack-kolla | 14:06 | |
| *** tovin07 has joined #openstack-kolla | 14:08 | |
| egonzalez | manheim, if using git repo, just checkout master and ./tools/kolla-ansible, if using pip, pip install -U kolla-ansible(does not work with master) | 14:09 |
| manheim | this bofore or after the upgrade? or does not matter | 14:12 |
| manheim | this should be specified in the docs imho | 14:12 |
| egonzalez | before | 14:14 |
| *** pradk has joined #openstack-kolla | 14:16 | |
| *** ducttape_ has joined #openstack-kolla | 14:17 | |
| manheim | and from them on i should always use ./tools/kolla-ansible | 14:17 |
| manheim | i usually like to use git | 14:17 |
| *** pbourke has quit IRC | 14:18 | |
| *** pbourke has joined #openstack-kolla | 14:20 | |
| egonzalez | manheim, if use git better use local commands from tools, is cleaner about dependency and conflicts with pbr | 14:24 |
| egonzalez | pbourke, i'm thinking about the glance+swfit issue, probably missing python-swift in glance images | 14:25 |
| pbourke | egonzalez: perhaps, not sure | 14:25 |
| egonzalez | with source should works because swift store is installed | 14:26 |
| manheim | ok cool, i'm doing an upgrade right now. ty | 14:26 |
| egonzalez | manheim, in multinode will fail due mariadb upgrade to master issue | 14:26 |
| manheim | i'm doing aio atm | 14:27 |
| manheim | want to see only the workflow | 14:27 |
| pbourke | egonzalez: im using source | 14:27 |
| pbourke | egonzalez: it feels a bit like a conf issue as I got the same error even before I noticed glance-swift.conf wasn't been copied over correctly | 14:27 |
| *** jamesbenson has joined #openstack-kolla | 14:28 | |
| *** schwicht has quit IRC | 14:28 | |
| *** eaguilar has joined #openstack-kolla | 14:29 | |
| *** lrensing has joined #openstack-kolla | 14:35 | |
| jamesbenson | morning all :-) | 14:36 |
| *** cuongnv has joined #openstack-kolla | 14:44 | |
| *** cuongnv has left #openstack-kolla | 14:44 | |
| rwellum | morning jamesbenson | 14:45 |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Test fluentd kolla change https://review.openstack.org/482528 | 14:47 |
| *** openstackgerrit has quit IRC | 14:48 | |
| *** lrensing has left #openstack-kolla | 14:48 | |
| *** hieulq has quit IRC | 14:51 | |
| *** daidv has quit IRC | 14:51 | |
| *** openstackgerrit has joined #openstack-kolla | 14:51 | |
| *** nonor has quit IRC | 14:53 | |
| *** vhosakot has joined #openstack-kolla | 14:56 | |
| rwellum | spsurya: if you look at the output of my tool - I've significantly enhanced it with a progress meter etc. | 14:56 |
| spsurya | rwellum: sure, I will check tomorrow | 14:58 |
| *** mattmceuen has joined #openstack-kolla | 15:00 | |
| *** daidv has joined #openstack-kolla | 15:06 | |
| *** hieulq has joined #openstack-kolla | 15:06 | |
| *** rmart04 has quit IRC | 15:10 | |
| *** dklyle has joined #openstack-kolla | 15:11 | |
| *** david-lyle has quit IRC | 15:11 | |
| *** dklyle is now known as david-lyle | 15:15 | |
| *** caoyuan_ has quit IRC | 15:20 | |
| *** jistr|call is now known as jistr | 15:22 | |
| rwellum | hey sbezverk - don't laugh - I'm playing with kolla mitaka release. I am seeing images missing although they are in the kolla release page. | 15:23 |
| rwellum | 5m2m5kubelet, ubuntuk8sspec.initContainers{initialize-ovs-db}WarningFailedFailed to pull image "docker.io/kolla/centos-source-openvswitch-db-server:2.0.3": rpc error: code = 2 desc = Tag 2.0.3 not found in repository docker.io/kolla/centos-source-openvswitch-db-server | 15:23 |
| sean-k-mooney | o/ QQ is there any documentation for the mariadb_recovery playbook. other then the mariardb contaiers are stopped is there any other requirement to run this? | 15:23 |
| *** hieulq has quit IRC | 15:24 | |
| *** daidv has quit IRC | 15:24 | |
| *** YuYangWang has quit IRC | 15:30 | |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla master: Tweaks to allow Horizon dev mode https://review.openstack.org/474598 | 15:32 |
| *** daidv has joined #openstack-kolla | 15:40 | |
| *** hieulq has joined #openstack-kolla | 15:41 | |
| manheim | shouldn't kolla-build only build images from services that are enabled in globals.yml? | 15:42 |
| manheim | i have 4.0.2 and it built like all services | 15:43 |
| pbourke | manheim: kolla-build doesn't read globals.yml | 15:43 |
| pbourke | manheim: globals.yml is for the ansible side | 15:43 |
| manheim | oh, it's only for pull | 15:43 |
| reidrac | kolla-build.conf has some bits; but other than providing a list of regex names on the cli on kolla-build; there's no other way of limiting which images are built | 15:44 |
| sean-k-mooney | manheim: you can use the profiles in kolla build to define what should be used or pass a regex as the last postional argument to kolla-build | 15:44 |
| manheim | yes, i remember now | 15:45 |
| reidrac | yes, what sean-k-mooney said way clearer than me :) | 15:45 |
| manheim | ty, i confused pull with build for a moment there | 15:45 |
| sbezverk | pbourke: do you mind ack this one please? https://review.openstack.org/482564 | 15:45 |
| sean-k-mooney | manheim: i have done that too. its also take a while to realist that in multinode you need to run pull before deploy id you rebuilt your images | 15:46 |
| inc0 | good morning | 15:46 |
| sean-k-mooney | o/ good morning inc0 | 15:47 |
| manheim | hello | 15:47 |
| inc0 | damn I couldn't wake up today :/ | 15:47 |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable proxy cache for tarballs download https://review.openstack.org/482217 | 15:47 |
| pbourke | sbezverk: is there any context on that? I saw several patches today in this area and dont feel I understand fully | 15:47 |
| sean-k-mooney | inc0: on the proxies would you have an issue later with introducing some proxy containers in kolla to speed up builds. its been on my todo list for a while to automate | 15:49 |
| sbezverk | pbourke: it is backport | 15:50 |
| sbezverk | from master | 15:50 |
| inc0 | sean-k-mooney: you mean setup apt/yum mirror with docker for builds later? | 15:50 |
| pbourke | sbezverk: in that case I dont see any cherry-picked from msg | 15:50 |
| sbezverk | we need rts-lib in cinder-volume | 15:50 |
| sbezverk | I accidently removed it :( | 15:50 |
| sbezverk | while modifying the commit message | 15:51 |
| sbezverk | but you can see it is merged in master | 15:51 |
| sean-k-mooney | inc0: ya as an optional part of the boot strap playbook. it wont help in the gate but its usefull as a dev | 15:51 |
| inc0 | https://github.com/ThomasSteinbach/docker/tree/master/apt-mirror <- stuff like that already exists | 15:52 |
| inc0 | I'd be reluctant to do it in kolla | 15:52 |
| sean-k-mooney | inc0: i set apt and pypi caches up interally on our cloud to hide the latency of our internal network | 15:52 |
| sean-k-mooney | inc0: ya i just used container form the docker hub | 15:53 |
| inc0 | yeah that's fine | 15:53 |
| jamesbenson | morning inc0 | 15:54 |
| *** dciabrin has quit IRC | 15:54 | |
| *** dciabrin has joined #openstack-kolla | 15:55 | |
| *** tonanhngo has joined #openstack-kolla | 15:55 | |
| *** lpetrut has quit IRC | 15:56 | |
| vhosakot | one minute to noon here already :) | 15:59 |
| *** krtaylor_ has quit IRC | 16:00 | |
| *** jascott1 has joined #openstack-kolla | 16:01 | |
| *** krtaylor has joined #openstack-kolla | 16:01 | |
| *** egonzalez has quit IRC | 16:02 | |
| *** janki has quit IRC | 16:03 | |
| *** rmart04 has joined #openstack-kolla | 16:05 | |
| *** jascott1 has quit IRC | 16:06 | |
| *** jascott1 has joined #openstack-kolla | 16:06 | |
| dmsimard | inc0: Could you please point me in the right direction as to how the logs are ending up in a file per image here: http://logs.openstack.org/90/479890/2/check/gate-kolla-dsvm-build-centos-binary-centos-7-nv/9e9fa9d/logs/build/ | 16:08 |
| dmsimard | It looks like it's from https://github.com/openstack/kolla/blob/master/tests/test_build.py | 16:08 |
| dmsimard | Which would not be available from a "pure" kolla-build command ? | 16:08 |
| inc0 | I'm pretty sure it's config | 16:09 |
| inc0 | let me find it | 16:09 |
| *** rmart04 has quit IRC | 16:09 | |
| inc0 | https://github.com/openstack/kolla/blob/master/kolla/common/config.py#L252 <- try this | 16:12 |
| *** emccormick has quit IRC | 16:12 | |
| *** jascott1 has quit IRC | 16:12 | |
| dmsimard | inc0: looking | 16:13 |
| vhosakot | dmsimard: gate sets "logs_dir = /tmp/logs/build" in /etc/kolla/kolla-build.conf before building images --> http://logs.openstack.org/18/481118/1/check/gate-kolla-dsvm-build-centos-binary-centos-7-nv/faf8732/console.html#_2017-07-11_08_00_19_763337 | 16:16 |
| *** jascott1 has joined #openstack-kolla | 16:16 | |
| vhosakot | dmsimard: which is then tarred by this code in https://github.com/openstack/kolla/blob/master/tools/gate_run.sh#L71-L73. | 16:17 |
| *** jascott1 has quit IRC | 16:17 | |
| *** jascott1 has joined #openstack-kolla | 16:17 | |
| inc0 | vhosakot: we should submit talk today | 16:17 |
| inc0 | wanna do the honors? | 16:18 |
| vhosakot | inc0: I know... got few meetings for the next 2 hrs... ready after that... | 16:18 |
| rwellum | inc0: vhosakot I was looking at the two ethers today. | 16:18 |
| rwellum | Need to combine abstracts and pick a title :) | 16:18 |
| rwellum | I numbered the title - care to vote? | 16:18 |
| vhosakot | inc0: rwellum we have a lot of text in the ethers... just need to compress/find the best lines | 16:18 |
| rwellum | inc0: you have time to do a first pass of combining? | 16:19 |
| inc0 | yes, give me few minutes to get something heavy on caffeine | 16:20 |
| rwellum | I'll be happy to correct any Penglish. | 16:20 |
| rwellum | sure | 16:20 |
| inc0 | yeah, I know that I need to Polish my English;) | 16:21 |
| vhosakot | lol | 16:21 |
| inc0 | can you link second etherpad? | 16:21 |
| rwellum | https://etherpad.openstack.org/p/kolla-sydney-gate-talk | 16:22 |
| *** dciabrin has quit IRC | 16:22 | |
| *** dciabrin has joined #openstack-kolla | 16:23 | |
| sbezverk | inc0: do you want to add k8s gates portion ;) ?? | 16:23 |
| inc0 | sbezverk: it's mostly about building tho | 16:24 |
| *** athomas has quit IRC | 16:24 | |
| sbezverk | inc0: ok, got it | 16:24 |
| *** tovin07 has left #openstack-kolla | 16:25 | |
| vhosakot | kfox1111: sbezverk: aren't you submitting any k8s talks? | 16:25 |
| vhosakot | I meant about kolla-k8s | 16:25 |
| sbezverk | vhosakot : not that I am aware of, I will go to summit as a tourist, hurray!! | 16:26 |
| *** hieulq has quit IRC | 16:27 | |
| *** daidv has quit IRC | 16:27 | |
| vhosakot | sbezverk: :) yeah, if we're doing that any of us think is useful for the community, ops, cloud users, good to submit it as a talk IMO... although, yeah, I love tourism the best :) | 16:27 |
| vhosakot | inc0: I'm almost done the upgrade talk's etherpad. | 16:28 |
| sbezverk | vhosakot : nobody came up with any good ideas for k8s talks | 16:28 |
| vhosakot | sbezverk: you can extend Boston's sleep optimization talk and show how kolla-k8s further allows ops to sleep happily more :) | 16:29 |
| rwellum | sbezverk: seriously? Hottest technology around. | 16:29 |
| rwellum | How about the push towards release 1.0? | 16:29 |
| sbezverk | rwellum : sure I am really bad with coming up with ideas like that | 16:29 |
| rwellum | Ceph integration. Upgrades. Presentation on the resilience. Even a project-update. | 16:30 |
| inc0 | I'm doing project update | 16:31 |
| inc0 | but that's for all of kolla, not just k8s | 16:31 |
| rwellum | inc0: for kolla-k8s too? | 16:31 |
| rwellum | Ah | 16:31 |
| rwellum | We have two ansible playbook solutions in very good shape. | 16:32 |
| *** kristia__ has joined #openstack-kolla | 16:34 | |
| *** kristia__ has quit IRC | 16:34 | |
| rwellum | BTW this looks like a nice free kubernetes training: https://www.linux.com/news/kube-mooc/2017/7/new-kubernetes-online-course-now-open-sign-free | 16:35 |
| *** reidrac has quit IRC | 16:35 | |
| rwellum | sbezverk: regarding the no-one came up with any good ideas - was it discussed - like kolla weekly meeting. Just wondering if I missed the conversation. | 16:36 |
| sbezverk | inc0: rwellum : what do you think if I submit kolla-k8s current state overview? | 16:36 |
| *** kristian__ has quit IRC | 16:36 | |
| sbezverk | rwellum : I probably missed that meeting | 16:37 |
| inc0 | we didn't have meeting like that | 16:37 |
| inc0 | I'll add it to tomorrows agenda | 16:37 |
| sbezverk | inc0: ahh ok, sure | 16:37 |
| inc0 | don't forget that summit is in Nov | 16:38 |
| sbezverk | kind of cutting it too close | 16:38 |
| sbezverk | to the dead line | 16:38 |
| inc0 | well meeting is about summarize of who submits talks at all | 16:38 |
| rwellum | sbezverk: I think that's a great idea. It would compliment what inc0 is going to go over. | 16:38 |
| inc0 | talk submissions is responsibility of submitters | 16:38 |
| *** iniazi_ has joined #openstack-kolla | 16:38 | |
| rwellum | sbezverk: close but all we need are titles and abstracts. | 16:39 |
| inc0 | and presenters;) | 16:40 |
| rwellum | yeah true. I may have to be a stowaway on a boat or something just to get there. | 16:40 |
| *** iniazi has quit IRC | 16:42 | |
| rwellum | Sounds like sbezverk is going though - not sure about kfox1111 , and vhosakot and you inc0 too, so plenty of presenters? | 16:42 |
| *** daidv has joined #openstack-kolla | 16:42 | |
| *** hieulq has joined #openstack-kolla | 16:42 | |
| sbezverk | rwellum : man , I cannot miss the opportunity to cross the equator ;) | 16:43 |
| sbezverk | never been in south hemisphere | 16:43 |
| rwellum | sbezverk: same. Lots of relatives there though. | 16:44 |
| inc0 | I wanna try kangaroo steak. | 16:45 |
| vhosakot | yeah, I'm looking froward to the trip :) | 16:46 |
| vhosakot | inc0: so, is there a plan to do a kolla/kolla-k8s workshop like you did in Boston. that was great actually? | 16:46 |
| *** shardy has quit IRC | 16:49 | |
| inc0 | people liked it a lot | 16:49 |
| *** tonanhngo has quit IRC | 16:50 | |
| inc0 | but I'm not doing one again, I'll be happy to help on the site tho;) | 16:50 |
| *** schwicht has joined #openstack-kolla | 16:52 | |
| *** kbaegis has joined #openstack-kolla | 16:52 | |
| manheim | so i have a 4.0.2 deployment and I want to upgrade to master | 16:53 |
| manheim | so first i did git checkout master | 16:53 |
| inc0 | manheim: build master images | 16:54 |
| manheim | and I want to build the new master images | 16:54 |
| manheim | but | 16:54 |
| inc0 | just git checkout master and kolla-build | 16:54 |
| manheim | the build execitable is still from stable/ocata | 16:54 |
| manheim | i mean what about the code, not images | 16:54 |
| rwellum | inc0: kangeroo steak *shudder* | 16:55 |
| manheim | i just run kolla-build? | 16:55 |
| inc0 | did you run pip install -U . | 16:55 |
| inc0 | ? | 16:55 |
| manheim | nope | 16:55 |
| manheim | forgot this :D | 16:55 |
| *** kristian__ has joined #openstack-kolla | 16:55 | |
| *** hieulq has quit IRC | 17:00 | |
| *** daidv has quit IRC | 17:01 | |
| *** manheim has quit IRC | 17:01 | |
| hawi | what is actually needed to have all-in-one as fully functional? i in somehow can't create any volumes there, just dont remember, how it worked for me before | 17:02 |
| inc0 | hawi: remember that cinder is not enabled by default | 17:03 |
| hawi | i enabled it, still nothing | 17:03 |
| *** mgoddard_ has quit IRC | 17:04 | |
| inc0 | ceph too? | 17:06 |
| hawi | no ceph | 17:06 |
| inc0 | what storage backend then | 17:06 |
| inc0 | ? | 17:06 |
| *** kristian__ has quit IRC | 17:06 | |
| *** kristian__ has joined #openstack-kolla | 17:07 | |
| hawi | is there some way to give disk from same machine? | 17:07 |
| inc0 | well, I don't think so | 17:07 |
| openstackgerrit | Merged openstack/kolla stable/ocata: Adding python-rtslib to cinder-volume for lioadm support https://review.openstack.org/482564 | 17:08 |
| hawi | then the only way is to enable ceph as well? | 17:08 |
| inc0 | ceph or lvm/iscsi | 17:08 |
| inc0 | or some other backend | 17:08 |
| *** itlinux has joined #openstack-kolla | 17:09 | |
| *** kristian__ has quit IRC | 17:11 | |
| *** kristian__ has joined #openstack-kolla | 17:11 | |
| *** schwicht has quit IRC | 17:13 | |
| *** schwicht has joined #openstack-kolla | 17:14 | |
| *** daidv has joined #openstack-kolla | 17:16 | |
| *** hieulq has joined #openstack-kolla | 17:16 | |
| *** kristian__ has quit IRC | 17:18 | |
| *** lpetrut has joined #openstack-kolla | 17:19 | |
| *** kristian__ has joined #openstack-kolla | 17:19 | |
| *** sambetts is now known as sambetts|afk | 17:21 | |
| *** kristian__ has quit IRC | 17:24 | |
| *** krtaylor has quit IRC | 17:30 | |
| jamesbenson | to stop using tls, do you have to destroy and redeploy or just comment it out and deploy? | 17:30 |
| *** YuYangWang has joined #openstack-kolla | 17:30 | |
| inc0 | comment it out and reconfigure should do the trick | 17:31 |
| *** tonanhngo has joined #openstack-kolla | 17:34 | |
| jamesbenson | cool, and enabling it is just kolla-ansible certificates and kolla_enable_tls_external=yes, right? | 17:35 |
| *** tonanhngo has quit IRC | 17:35 | |
| *** tonanhngo has joined #openstack-kolla | 17:36 | |
| jamesbenson | ah I think I found what I was missing.. | 17:37 |
| inc0 | gates are misbehaving | 17:39 |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Do not merge! Testing gate https://review.openstack.org/482648 | 17:41 |
| *** mgoddard_ has joined #openstack-kolla | 17:41 | |
| serlex | jamesbenson...is that used to enable https for horizon/ | 17:41 |
| serlex | I have such requirement, but not sure kolla_enable_tls_external is what I need | 17:42 |
| inc0 | serlex: it does | 17:42 |
| inc0 | it'll enable https for all of public endpoints | 17:42 |
| inc0 | it's really just haproxy conf | 17:42 |
| serlex | ok cool, I will give it a try now, any specific requriements for certificate file? ie permissions/ | 17:45 |
| inc0 | serlex: check tls docs | 17:46 |
| *** kbaegis has quit IRC | 17:46 | |
| *** manheim has joined #openstack-kolla | 17:46 | |
| inc0 | I'm not great at that piece of code tbh | 17:46 |
| serlex | ok roger | 17:48 |
| *** manheim has quit IRC | 17:50 | |
| *** lpetrut has quit IRC | 17:51 | |
| *** manheim has joined #openstack-kolla | 17:53 | |
| *** kbaegis has joined #openstack-kolla | 17:55 | |
| jamesbenson | sorry serlex, I was away for a moment... | 17:55 |
| *** kbaegis has quit IRC | 17:57 | |
| jamesbenson | yes, be sure to enable kolla_external_fqdn | 17:57 |
| *** kbaegis has joined #openstack-kolla | 17:57 | |
| *** hieulq has quit IRC | 18:03 | |
| *** daidv has quit IRC | 18:04 | |
| *** ducttape_ has quit IRC | 18:12 | |
| *** ducttape_ has joined #openstack-kolla | 18:13 | |
| *** lpetrut has joined #openstack-kolla | 18:13 | |
| jamesbenson | why does my openstack service list | grep horizon come back empty? | 18:16 |
| inc0 | horizon doesn't have endpoint | 18:16 |
| *** krtaylor has joined #openstack-kolla | 18:16 | |
| *** manheim has quit IRC | 18:17 | |
| jamesbenson | :-( sorry about that. | 18:17 |
| jamesbenson | lol | 18:17 |
| *** manheim has joined #openstack-kolla | 18:17 | |
| inc0 | :D | 18:17 |
| inc0 | horizon *is* an endpoint;) | 18:17 |
| *** ducttape_ has quit IRC | 18:17 | |
| jamesbenson | I'm getting an Internal Server Error, deployed without issue, tried with TLS and without and getting an error like this: http://paste.openstack.org/show/615060/ | 18:18 |
| inc0 | logs man | 18:18 |
| jamesbenson | roger | 18:18 |
| *** daidv has joined #openstack-kolla | 18:19 | |
| *** hieulq has joined #openstack-kolla | 18:19 | |
| jamesbenson | http://paste.openstack.org/show/615061/ | 18:19 |
| *** ggillies_ has quit IRC | 18:19 | |
| inc0 | ahh I've seen this | 18:20 |
| inc0 | it's fixed now, might need to rebuild horizon | 18:20 |
| jamesbenson | yeah, this was in 4.0.0 | 18:21 |
| *** ggillies has joined #openstack-kolla | 18:21 | |
| jamesbenson | I could try to do an upgrade to 4.0.2? | 18:21 |
| inc0 | you'd need to build, but yeah | 18:22 |
| inc0 | fresh stable build won't have this issue | 18:22 |
| jamesbenson | yeah, of course, I'm a pro at that now. | 18:22 |
| jamesbenson | 4.0.2 not sure? | 18:22 |
| jamesbenson | I did manually build the 4.0.0 images ... | 18:22 |
| *** ducttape_ has joined #openstack-kolla | 18:23 | |
| inc0 | https://bugs.launchpad.net/kolla/+bug/1686830 | 18:24 |
| openstack | Launchpad bug 1686830 in kolla pike "tzdata missing from upstream ubuntu docker images" [High,Fix released] - Assigned to Eduardo Gonzalez (egonzalez90) | 18:24 |
| inc0 | 4.0.2 has this fix | 18:24 |
| jamesbenson | cool | 18:24 |
| *** ducttape_ has quit IRC | 18:27 | |
| *** kristian__ has joined #openstack-kolla | 18:29 | |
| *** ducttape_ has joined #openstack-kolla | 18:32 | |
| jamesbenson | inc0, do you want me to recheck this bug? https://review.openstack.org/#/c/481224/1 | 18:32 |
| inc0 | jamesbenson: qq, did it really fix it? | 18:33 |
| *** jbrooks has joined #openstack-kolla | 18:33 | |
| jamesbenson | it did fix the ceph time sync issue. My other problem was something else however. | 18:33 |
| inc0 | and for sure there was ceph sync issue right?;P | 18:33 |
| *** kristian__ has quit IRC | 18:34 | |
| inc0 | ;) | 18:34 |
| inc0 | I mean it wasn't network problem all along? | 18:34 |
| jamesbenson | yes | 18:34 |
| jamesbenson | well there were multiple things. | 18:34 |
| jamesbenson | :-/ | 18:34 |
| jamesbenson | but this did sync the clocks correctly. | 18:34 |
| jamesbenson | which is needed for ceph | 18:34 |
| jbrooks | Hi all, I'm using kolla-ansible to pull the newton images from the docker hub on a CentOS 7 machine, and I'm getting an "Unknown status message" failure, even though the image was pulled. I assume it's because I'm using centos' docker and not the docker-engine docker, I'm guessing the centos docker gives a different status message | 18:35 |
| jamesbenson | jbrooks: try building your own images | 18:35 |
| jamesbenson | master isn't on the hub | 18:35 |
| inc0 | jbrooks: docker --version please | 18:35 |
| jbrooks | I don't really care about master, I was just going to try w/ newton | 18:36 |
| inc0 | also what jamesbenson said, it's better to build | 18:36 |
| inc0 | even for newton | 18:36 |
| jbrooks | OK, I figured I'd save myself some time | 18:36 |
| jbrooks | Docker version 1.12.6, build 88a4867/1.12.6 | 18:36 |
| inc0 | 1.12 should be fine | 18:36 |
| inc0 | I'm not sure about this unknown status message tho | 18:37 |
| *** kbaegis has quit IRC | 18:37 | |
| inc0 | all images are present and accounded for? | 18:37 |
| jbrooks | I can see that the image was in fact pulled | 18:37 |
| jbrooks | It fails after the first one | 18:37 |
| inc0 | kolla-ansible is newton too? | 18:37 |
| jbrooks | inc0, Ah, I didn't specify | 18:38 |
| jbrooks | I installed w/ pip | 18:38 |
| inc0 | then it's ocata | 18:38 |
| inc0 | and it might try to download images that didn't exist in newton | 18:38 |
| *** kbaegis has joined #openstack-kolla | 18:38 | |
| inc0 | brb need to hunt for some food | 18:39 |
| jbrooks | I guess I'll just build | 18:40 |
| inc0 | that's best tbh | 18:40 |
| inc0 | just make sure to install kolla and kolla-ansible newton | 18:41 |
| inc0 | because ocata will build ocata | 18:41 |
| inc0 | on the bright note, we're working on publishing images daily | 18:41 |
| *** Mannheim has joined #openstack-kolla | 18:47 | |
| *** lpetrut has quit IRC | 18:47 | |
| *** krtaylor has quit IRC | 18:48 | |
| *** mgoddard_ has quit IRC | 18:50 | |
| rwellum | inc0: so if switching between tags 3.x and 4.x, we need to specify different versions of kolla and kolla-ansible. Does that apply to kolla-kubernetes too? | 18:51 |
| rwellum | sbezverk: ping | 18:52 |
| sbezverk | inc0: if a change is in stable ocata, which tag for the image should be used? | 18:53 |
| sbezverk | rwellum pong | 18:53 |
| rwellum | sbezverk: does kolla-kubernetes change per tag? | 18:54 |
| rwellum | sbezverk: https://releases.openstack.org/teams/kolla.html | 18:54 |
| *** rwallner has quit IRC | 18:54 | |
| *** krtaylor has joined #openstack-kolla | 18:56 | |
| *** rwallner has joined #openstack-kolla | 18:59 | |
| sbezverk | rwellum : the same kolla-kubernetes can work with different tags with some minor modification in the way it is deployed | 19:00 |
| rwellum | ok that's what I thought but the conversation above worried me. | 19:00 |
| sbezverk | this is covered by the gate jobs . | 19:00 |
| *** tonanhngo has quit IRC | 19:00 | |
| rwellum | sbezverk: are the gates running 2.x? | 19:01 |
| jamesbenson | sbezverk: stable ocata is 4.0.2 | 19:01 |
| jamesbenson | master will be tagged 4.0.3 | 19:01 |
| rwellum | 4.0.2 doesn't work for me though - not kolla-k8s anyway. | 19:03 |
| jamesbenson | can't comment on k8s | 19:03 |
| *** serlex has quit IRC | 19:06 | |
| inc0 | sbezverk: if it was released already as tag, 4.0.2 | 19:06 |
| inc0 | if you build top of the branch 4.0.3 | 19:06 |
| sbezverk | rwellum : gate runs 2.0.X, 3.0.X and 4.0X | 19:08 |
| sbezverk | inc0: can we update 4.0.2 tagged image at the hub? | 19:09 |
| inc0 | sbezverk: can we use tarballs please? | 19:09 |
| sbezverk | inc0: none of the gate jobs uses tarbals | 19:10 |
| sbezverk | I do not mind to use it, just do not know if it is possible atm.. | 19:11 |
| inc0 | we need to start using them. | 19:11 |
| inc0 | it should be | 19:11 |
| inc0 | it's just registry issue | 19:11 |
| *** kristian__ has joined #openstack-kolla | 19:12 | |
| inc0 | we deploy k8s in gates with kubeadm right? | 19:12 |
| *** gfidente has quit IRC | 19:13 | |
| sbezverk | inc0: yep | 19:14 |
| inc0 | so insecure registry is going to be pita... | 19:14 |
| *** kbaegis has quit IRC | 19:15 | |
| *** kbaegis has joined #openstack-kolla | 19:15 | |
| *** mgoddard_ has joined #openstack-kolla | 19:18 | |
| vhosakot | yes, kolla 4.0.2 is stable/ocata https://review.openstack.org/#/c/475014/. | 19:18 |
| *** kristian__ has quit IRC | 19:19 | |
| sbezverk | inc0: I understand we should do it, but I have a specific need to upload updated 4.0.2 cinder-volume | 19:20 |
| sbezverk | image | 19:20 |
| *** kristian__ has joined #openstack-kolla | 19:20 | |
| inc0 | 4.0.2 was tagged already... | 19:20 |
| inc0 | also we backported your change to stable/ocata? | 19:21 |
| *** ducttape_ has quit IRC | 19:23 | |
| *** ducttape_ has joined #openstack-kolla | 19:23 | |
| *** kristian__ has quit IRC | 19:24 | |
| sbezverk | inc0: yep | 19:25 |
| sbezverk | it was done this morning | 19:25 |
| Mannheim | http://paste.ubuntu.com/25070163/ | 19:25 |
| Mannheim | this was during an upgrade from 4.0.2 to master 5.0.0 images | 19:26 |
| Mannheim | have you seen this before? | 19:26 |
| inc0 | no:/ | 19:28 |
| *** kristian__ has joined #openstack-kolla | 19:28 | |
| Mannheim | kolla==5.0.0.0b3.dev114 & kolla-ansible==5.0.0.0b3.dev183 | 19:31 |
| jbrooks | How would I install the newton version of kolla-ansible? | 19:31 |
| jbrooks | I don't see it in pip or see a tag or branch for it in git | 19:32 |
| inc0 | jbrooks: in newton there was just kolla | 19:32 |
| inc0 | we've split kolla and kolla-ansible in ocata | 19:32 |
| jbrooks | ah | 19:32 |
| inc0 | in newton playbooks lives in ansible dir | 19:32 |
| jbrooks | I just tweaked the kolla_docker.py a bit to be happy w/ the message centos' docker gives | 19:36 |
| *** kbaegis1 has joined #openstack-kolla | 19:44 | |
| vhosakot | jbrooks: yes, I keep getting forgetting that kolla-ansible has existed since Ocata, I was searching for newton too the other day | 19:45 |
| *** kbaegis1 has quit IRC | 19:46 | |
| *** kbaegis1 has joined #openstack-kolla | 19:47 | |
| *** kbaegis has quit IRC | 19:47 | |
| *** itlinux has quit IRC | 19:47 | |
| *** kbaegis has joined #openstack-kolla | 19:49 | |
| *** kbaegis has quit IRC | 19:49 | |
| *** hieulq has quit IRC | 19:50 | |
| *** daidv has quit IRC | 19:50 | |
| *** kbaegis1 has quit IRC | 19:51 | |
| *** kbaegis has joined #openstack-kolla | 19:53 | |
| vhosakot | Mannheim: if the rabbitmq container is up, you should see more info when you run "docker exec -t rabbitmq /usr/local/bin/rabbitmq_get_gospel_node" | 19:53 |
| vhosakot | docker exec -t rabbitmq "/usr/sbin/rabbitmqctl eval 'rabbit_clusterer:status().' | 19:54 |
| *** kbaegis has quit IRC | 20:00 | |
| *** kbaegis has joined #openstack-kolla | 20:01 | |
| Mannheim | http://paste.ubuntu.com/25070379/ | 20:04 |
| *** schwicht has quit IRC | 20:04 | |
| *** schwicht has joined #openstack-kolla | 20:07 | |
| *** rwallner has quit IRC | 20:07 | |
| vhosakot | Mannheim: yeah, so looks like rabbit cluster is down and gospel node cannot be found. | 20:10 |
| *** rwallner has joined #openstack-kolla | 20:10 | |
| vhosakot | Mannheim: I've seen this issue when my /etc/hosts is screwed up, or rabbit host's hostname cannot be resolved | 20:10 |
| *** itlinux has joined #openstack-kolla | 20:10 | |
| vhosakot | inc0 is our rabbit expert :) | 20:11 |
| Mannheim | hmm, it's an AIO and the management IP of the node is in /etc/hosts | 20:11 |
| vhosakot | Mannheim: https://www.google.com/#q=rabbitmq+hostname+mismatch "rabbitmq hostname mismatch" is a famous topic on google :) | 20:11 |
| Mannheim | hah, cool, ty, do not have much exp with rabbitmq | 20:12 |
| vhosakot | Mannheim: I think the fqdn must be reachable/resolved by rabbit | 20:12 |
| *** rwallner has quit IRC | 20:14 | |
| Mannheim | it's the fqdn in hosts | 20:14 |
| Mannheim | and the host and the rabbit container have the same fqdn | 20:16 |
| vhosakot | Mannheim: can you ping your fqdn/hostname? | 20:16 |
| Mannheim | yes i can | 20:18 |
| vhosakot | Mannheim: this is how inc0 fixed this issue in our gate --> https://review.openstack.org/#/c/294713/ | 20:20 |
| vhosakot | "getent hosts" was fialing at gate | 20:21 |
| Mannheim | ok, net me se what I can do on this | 20:22 |
| vhosakot | Mannheim: good luck | 20:24 |
| Mannheim | if i do the thing in the bootstrap playbook, i run upgrade after or do I have to redeploy? | 20:27 |
| *** jtriley has quit IRC | 20:29 | |
| *** mgoddard_ has quit IRC | 20:32 | |
| *** rhallisey has quit IRC | 20:33 | |
| *** hieulq has joined #openstack-kolla | 20:33 | |
| *** daidv has joined #openstack-kolla | 20:35 | |
| *** ducttape_ has quit IRC | 20:36 | |
| *** unicell has joined #openstack-kolla | 20:38 | |
| *** daidv has quit IRC | 20:38 | |
| *** unicell has quit IRC | 20:42 | |
| *** unicell has joined #openstack-kolla | 20:42 | |
| *** ansmith has quit IRC | 20:43 | |
| *** ducttape_ has joined #openstack-kolla | 20:46 | |
| *** krtaylor has quit IRC | 20:46 | |
| Mannheim | i'll see on it, anyways, thanks for the help | 20:48 |
| inc0 | Mannheim: yeah for multinode rabbitmq you need hostnames to resolve | 20:49 |
| Mannheim | i have an AIO | 20:49 |
| inc0 | still has to resolve hostname to IP from api_interface | 20:50 |
| Mannheim | yep, it's in hosts | 20:50 |
| Mannheim | i did a prechecks before deploy | 20:51 |
| Mannheim | i think that checks that | 20:51 |
| Mannheim | hah, think i got it | 20:52 |
| Mannheim | i put the fqdn on the 127.0.0.1 line | 20:52 |
| Mannheim | now it passed | 20:52 |
| Mannheim | getent hosts {{ hostvars[item]['ansible_hostname'] | 20:53 |
| Mannheim | andthat is localhost | 20:53 |
| *** daidv has joined #openstack-kolla | 20:53 | |
| Mannheim | so I put the fqdn on the line where localhost is also, 127.0.01 that is | 20:53 |
| Mannheim | I also did a bootstrap-servers now, on the first deploy I did not do it | 20:54 |
| Mannheim | so it may be that | 20:54 |
| *** jtriley has joined #openstack-kolla | 20:54 | |
| inc0 | bootstrap handles hostnames | 20:54 |
| Mannheim | but precheck also passed with no bottstrap | 20:55 |
| Mannheim | so i thought i is ok | 20:55 |
| inc0 | it might have been, nto sure | 20:55 |
| inc0 | check if upgrade works now | 20:55 |
| Mannheim | it's upgrading | 20:56 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support https://review.openstack.org/481690 | 20:56 |
| Mannheim | btw, this can handle upgrades from releases to 2 releases ahead, e.g newton->pike? | 20:57 |
| inc0 | no | 20:58 |
| inc0 | that particular upgrade won't work for example | 20:58 |
| inc0 | becasue during ocata nova requires one more step - creating database for cells | 20:58 |
| inc0 | and we added this step in ocata and removed in pike | 20:58 |
| Mannheim | i see | 20:59 |
| inc0 | which means n->p won't have this step and it won't work | 20:59 |
| Mannheim | i see, it's dependent on future implemented features | 21:00 |
| Mannheim | you cannot know them now | 21:00 |
| Mannheim | wooo, it worked | 21:00 |
| Mannheim | so f awesome | 21:00 |
| Mannheim | never thought i will do a OS upgrade in this life | 21:01 |
| *** tonanhngo has joined #openstack-kolla | 21:01 | |
| inc0 | lol | 21:02 |
| inc0 | that surprise says a lot about OpenStack;) | 21:03 |
| Mannheim | :D | 21:03 |
| *** kristian__ has quit IRC | 21:03 | |
| inc0 | one of most important benefits of using Kolla is upgrade | 21:03 |
| inc0 | s | 21:03 |
| *** jtriley has quit IRC | 21:04 | |
| Mannheim | is there a backup mechanism for the containers? | 21:05 |
| inc0 | containers - no, images will be there until removed | 21:05 |
| *** tonanhngo has quit IRC | 21:06 | |
| Mannheim | hmm, do you intend to so something like that? | 21:06 |
| inc0 | containers aren't really reasonable to backup | 21:07 |
| inc0 | there is nothing saved in them | 21:07 |
| inc0 | data we care about are in volumes | 21:07 |
| inc0 | and backuping that is easy and out of scope of Kolla imho | 21:07 |
| Mannheim | the currnet state of the cloud | 21:07 |
| inc0 | cp -R /var/lib/docker/volumes | 21:07 |
| inc0 | state of cloud is hard to define:) | 21:08 |
| Mannheim | yes, but it would be nice to have something built it, integrated | 21:08 |
| Mannheim | think it will make it more atractable as a technologie | 21:08 |
| inc0 | well, it's also prone to feature creep | 21:08 |
| *** jtriley has joined #openstack-kolla | 21:08 | |
| inc0 | really dangerous place to be imho | 21:08 |
| *** bmace has quit IRC | 21:12 | |
| *** bmace has joined #openstack-kolla | 21:12 | |
| Mannheim | well, i guess you can docker commit the containers | 21:13 |
| *** jascott1 has quit IRC | 21:13 | |
| *** jascott1 has joined #openstack-kolla | 21:13 | |
| *** jascott1 has quit IRC | 21:14 | |
| inc0 | no point really, it won't save anything meaningful | 21:14 |
| inc0 | no database snapshot or vms | 21:14 |
| Mannheim | hmm, my point is, is kolla is so easily manageble coz of the containers, maybe something like this can be implemented | 21:16 |
| Mannheim | bu you may be right, think i don't yet see the big picture | 21:16 |
| Mannheim | on this topic | 21:16 |
| inc0 | what I'm saying is it would be *really* hard to properly implement | 21:16 |
| inc0 | as in, it could be project on it's own | 21:17 |
| inc0 | easily | 21:17 |
| Mannheim | ok | 21:17 |
| Mannheim | yeah, that is not an easy animal | 21:17 |
| Mannheim | it's an industry in itself | 21:18 |
| inc0 | and it could be (and should be) written in a manner that could be used by most openstack installers, not just Kolla | 21:19 |
| inc0 | so good idea in general, just not really easy to implement | 21:19 |
| Mannheim | sure | 21:20 |
| Mannheim | anyways, on upgrade docs | 21:20 |
| Mannheim | think that the code part should be in the docs, what do you do with the running code | 21:21 |
| Mannheim | now it covers only the images | 21:21 |
| Mannheim | i'll do a commit on this maybe | 21:21 |
| Mannheim | if you think this is the case | 21:21 |
| *** pcaruana has quit IRC | 21:23 | |
| *** jascott1 has joined #openstack-kolla | 21:32 | |
| *** jtriley has quit IRC | 21:36 | |
| *** ansmith has joined #openstack-kolla | 21:39 | |
| *** eaguilar has quit IRC | 21:41 | |
| *** ducttape_ has quit IRC | 21:41 | |
| *** jtriley has joined #openstack-kolla | 21:43 | |
| *** kbaegis has quit IRC | 21:49 | |
| *** emccormick has joined #openstack-kolla | 21:55 | |
| *** ducttape_ has joined #openstack-kolla | 21:58 | |
| *** jtriley has quit IRC | 21:58 | |
| *** jamesbenson has quit IRC | 21:59 | |
| *** denaitre has quit IRC | 22:03 | |
| *** dave-mccowan has quit IRC | 22:14 | |
| *** kolla-slack1 has joined #openstack-kolla | 22:20 | |
| *** kolla-slack has quit IRC | 22:20 | |
| *** kristian__ has joined #openstack-kolla | 22:20 | |
| *** jemcevoy has joined #openstack-kolla | 22:24 | |
| *** denaitre has joined #openstack-kolla | 22:25 | |
| *** kristian__ has quit IRC | 22:25 | |
| *** jbadiapa_ has joined #openstack-kolla | 22:29 | |
| *** pradk has quit IRC | 22:29 | |
| *** jtriley has joined #openstack-kolla | 22:29 | |
| *** Mannheim has quit IRC | 22:30 | |
| *** kbaegis has joined #openstack-kolla | 22:30 | |
| *** kbaegis has joined #openstack-kolla | 22:30 | |
| *** jbadiapa has quit IRC | 22:31 | |
| *** emccormick has quit IRC | 22:32 | |
| *** goldyfruit has quit IRC | 22:40 | |
| *** aagate has joined #openstack-kolla | 22:46 | |
| *** brad[] has quit IRC | 22:46 | |
| *** manheim has quit IRC | 22:48 | |
| *** manheim has joined #openstack-kolla | 22:48 | |
| *** brad[] has joined #openstack-kolla | 22:49 | |
| *** iniazi_ has quit IRC | 22:49 | |
| jemcevoy | inc0: Are you going to the Cloud Native PDX meeting tomorrow? | 22:52 |
| *** jtriley has quit IRC | 22:53 | |
| inc0 | jemcevoy: I might | 22:53 |
| *** manheim has quit IRC | 22:53 | |
| inc0 | depends if my better half would need help with her volunteering | 22:53 |
| jemcevoy | It is close to my place if you wanna park here and walk over. | 22:53 |
| inc0 | cool thanks for heads up | 22:54 |
| inc0 | I'll let you know tomorrow | 22:54 |
| jemcevoy | K | 22:54 |
| inc0 | jascott1: ^ | 22:54 |
| *** ducttape_ has quit IRC | 22:55 | |
| *** mmehan has quit IRC | 22:57 | |
| *** manheim has joined #openstack-kolla | 22:57 | |
| *** iniazi has joined #openstack-kolla | 22:59 | |
| *** iniazi has quit IRC | 23:01 | |
| *** iniazi has joined #openstack-kolla | 23:01 | |
| *** tonanhngo has joined #openstack-kolla | 23:03 | |
| *** tonanhngo has quit IRC | 23:08 | |
| *** itlinux has quit IRC | 23:10 | |
| *** kbaegis has quit IRC | 23:24 | |
| *** jtriley has joined #openstack-kolla | 23:25 | |
| *** hongbin has quit IRC | 23:29 | |
| *** tonanhngo has joined #openstack-kolla | 23:30 | |
| *** jtriley has quit IRC | 23:31 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding alternative iscsi_helper support https://review.openstack.org/481690 | 23:32 |
| *** manheim has quit IRC | 23:35 | |
| *** tonanhngo has quit IRC | 23:35 | |
| *** tonanhngo has joined #openstack-kolla | 23:42 | |
| *** kbaegis has joined #openstack-kolla | 23:43 | |
| *** tonanhngo has quit IRC | 23:48 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: Install net-tools for neutron-base container https://review.openstack.org/481798 | 23:51 |
| *** tonanhngo has joined #openstack-kolla | 23:51 | |
| *** krtaylor has joined #openstack-kolla | 23:51 | |
| *** tonanhngo has quit IRC | 23:55 | |
| *** mattmceuen has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!