*** tonanhngo_ has quit IRC | 00:02 | |
*** zhurong has quit IRC | 00:03 | |
*** williamcaban has quit IRC | 00:04 | |
*** williamcaban has joined #openstack-kolla | 00:05 | |
*** liyifeng has quit IRC | 00:10 | |
*** HyperJohnGraham_ has joined #openstack-kolla | 00:15 | |
*** sdake_ is now known as sdake | 00:22 | |
*** ediardo has quit IRC | 00:23 | |
*** ediardo has joined #openstack-kolla | 00:23 | |
*** yingjun has joined #openstack-kolla | 00:25 | |
*** zhubingbing has joined #openstack-kolla | 00:25 | |
*** sogabe has joined #openstack-kolla | 00:26 | |
*** zhubingbing has quit IRC | 00:28 | |
*** tonanhngo has joined #openstack-kolla | 00:30 | |
*** bachp has quit IRC | 00:30 | |
*** ssurana has quit IRC | 00:36 | |
*** bachp has joined #openstack-kolla | 00:37 | |
*** Pavo_ has joined #openstack-kolla | 00:42 | |
*** sdake has quit IRC | 00:46 | |
*** Pavo_ has quit IRC | 00:47 | |
*** tovin07 has joined #openstack-kolla | 00:47 | |
*** haplo37 has quit IRC | 00:47 | |
*** g3ek has quit IRC | 00:48 | |
*** mgoddard has joined #openstack-kolla | 00:54 | |
*** haplo37 has joined #openstack-kolla | 00:54 | |
*** g3ek has joined #openstack-kolla | 00:55 | |
*** zhubingbing has joined #openstack-kolla | 01:00 | |
*** sdake has joined #openstack-kolla | 01:01 | |
*** phuongnh has joined #openstack-kolla | 01:03 | |
*** duonghq has joined #openstack-kolla | 01:11 | |
*** zhurong has joined #openstack-kolla | 01:12 | |
*** mgoddard has quit IRC | 01:17 | |
*** duonghq has quit IRC | 01:25 | |
*** hieulq_ has quit IRC | 01:25 | |
*** phuongnh has quit IRC | 01:25 | |
*** tovin07 has quit IRC | 01:25 | |
*** phuongnh has joined #openstack-kolla | 01:26 | |
*** tovin07 has joined #openstack-kolla | 01:27 | |
*** zhubingbing has quit IRC | 01:29 | |
*** duonghq has joined #openstack-kolla | 01:30 | |
duonghq | morning | 01:30 |
---|---|---|
duonghq | RC2 is coming? | 01:30 |
*** hieulq_ has joined #openstack-kolla | 01:31 | |
*** mtaylor22 has quit IRC | 01:32 | |
*** bachp has quit IRC | 01:32 | |
*** kklimonda has quit IRC | 01:32 | |
*** zhubingbing has joined #openstack-kolla | 01:34 | |
duonghq | hi zhubingbing | 01:37 |
zhubingbing | hi | 01:37 |
duonghq | nice to see you | 01:37 |
zhubingbing | me too | 01:37 |
duonghq | which base distro are you using? | 01:38 |
*** kklimonda has joined #openstack-kolla | 01:38 | |
duonghq | *base image | 01:38 |
duonghq | centos, ubuntu....? | 01:38 |
*** kklimonda is now known as Guest67032 | 01:38 | |
*** MarMat_ has quit IRC | 01:38 | |
zhubingbing | centos | 01:39 |
*** bachp has joined #openstack-kolla | 01:39 | |
duonghq | have you build image today? | 01:40 |
duonghq | *built | 01:40 |
duonghq | zhubingbing | 01:41 |
zhubingbing | yes | 01:42 |
zhubingbing | you can try koala-build kolla-toolbox | 01:42 |
duonghq | did you get 404 not found? | 01:42 |
duonghq | e.g: | 01:43 |
duonghq | INFO:kolla.image.build.base:http://mirror01.idc.hinet.net/EPEL/7/x86_64/repodata/1152a964d852a5213e19396a9ba49a9aaea9821a88a64a3fb2f21ba6308a1d92-primary.sqlite.xz: [Errno 14] HTTP Error 404 - Not Found | 01:43 |
*** mtaylor22 has joined #openstack-kolla | 01:43 | |
zhubingbing | em | 01:46 |
zhubingbing | me too | 01:46 |
zhubingbing | Not Found 404 | 01:46 |
*** Guest50630 has quit IRC | 02:03 | |
*** zigo has joined #openstack-kolla | 02:05 | |
*** zigo is now known as Guest59427 | 02:06 | |
*** JianqingJiang has joined #openstack-kolla | 02:07 | |
*** MarMat_ has joined #openstack-kolla | 02:12 | |
*** unicell has quit IRC | 02:12 | |
*** jtriley has quit IRC | 02:19 | |
duonghq | zhubingbing: seem that epel is updated yesterday | 02:20 |
duonghq | maybe mirrors is not fully synchronized | 02:20 |
zhubingbing | yes | 02:21 |
*** jtriley has joined #openstack-kolla | 02:23 | |
*** JianqingJiang has quit IRC | 02:25 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: DO NOT MERGE: test eth1 https://review.openstack.org/385238 | 02:29 |
*** huikang has joined #openstack-kolla | 02:38 | |
*** yuanying has quit IRC | 02:48 | |
*** sdake has quit IRC | 02:57 | |
*** yuanying has joined #openstack-kolla | 02:58 | |
*** ssurana has joined #openstack-kolla | 02:58 | |
*** yuanying has quit IRC | 03:02 | |
*** jrich523 has quit IRC | 03:05 | |
*** jrich523 has joined #openstack-kolla | 03:07 | |
*** sdake has joined #openstack-kolla | 03:18 | |
*** williamcaban has quit IRC | 03:24 | |
openstackgerrit | renminmin proposed openstack/kolla: Hyperlink is expired https://review.openstack.org/385246 | 03:29 |
*** unicell has joined #openstack-kolla | 03:29 | |
*** yuanying has joined #openstack-kolla | 03:30 | |
*** unicell has joined #openstack-kolla | 03:30 | |
*** yuanying has quit IRC | 03:33 | |
*** yuanying has joined #openstack-kolla | 03:36 | |
sdake | hey peeps | 03:39 |
sdake | Jeffrey4l_ did you try kolla without epel? | 03:39 |
sdake | Jeffrey4l_ if not i guess i'll give that a go now | 03:39 |
*** ayoung has quit IRC | 03:40 | |
Jeffrey4l_ | sdake, yes. https://review.openstack.org/385104 | 03:43 |
Jeffrey4l_ | but got some error. some container need epel. | 03:43 |
Jeffrey4l_ | like tgtd http://logs.openstack.org/04/385104/1/check/gate-kolla-dsvm-build-centos-source-centos-7-nv/f6cc1d8/console.html#_2016-10-11_19_34_40_038972 | 03:44 |
sdake | ya was concerned of that | 03:44 |
sdake | anything else beyond tgtd? | 03:44 |
*** yuanying has quit IRC | 03:45 | |
sdake | put epel in the containers that need them | 03:45 |
Jeffrey4l_ | sdake, http://logs.openstack.org/04/385104/1/check/gate-kolla-dsvm-build-centos-source-centos-7-nv/f6cc1d8/console.html#_2016-10-11_19_34_39_036790 | 03:45 |
sdake | surprised barbiaacn-base failed | 03:46 |
sdake | oh this is centos source | 03:46 |
sdake | what is story on cinder-volume failure? | 03:46 |
sdake | i would expect all those containers to fail to build without epel but cinder-volume | 03:46 |
sdake | http://logs.openstack.org/04/385104/1/check/gate-kolla-dsvm-build-centos-source-centos-7-nv/f6cc1d8/console.html#_2016-10-11_19_34_40_650258 | 03:47 |
Jeffrey4l_ | sdake, http://logs.openstack.org/04/385104/1/check/gate-kolla-dsvm-build-centos-source-centos-7-nv/f6cc1d8/console.html#_2016-10-11_19_34_40_662928 | 03:48 |
sdake | tgtd-daemon | 03:48 |
Jeffrey4l_ | it is scsi-target-utils. | 03:48 |
sdake | right | 03:48 |
sdake | is there a way to keep epel in the repo but install the proper kvm package? | 03:48 |
sdake | I got impression from apevec there was | 03:48 |
Jeffrey4l_ | if scsi is needed in cinder ( no other better alternative ) it should be added into SIG | 03:49 |
*** yuanying has joined #openstack-kolla | 03:49 | |
sdake | yuanying what you up to these days | 03:49 |
sdake | Jeffrey4l_ i'll speak with apevec about that tomorrow | 03:50 |
Jeffrey4l_ | cool | 03:51 |
sdake | Jeffrey4l_ however that isn't going to happen for newton i suspect | 03:51 |
*** haplo37 has quit IRC | 03:51 | |
sdake | so we will have to live with what we have now availabale to us | 03:51 |
*** g3ek has quit IRC | 03:51 | |
Jeffrey4l_ | yes. | 03:51 |
sdake | so lets figure that out - seems like two options | 03:52 |
sdake | sort out how to instal lqemu-kvm (the proper one) | 03:52 |
sdake | or sort out how to put epel into the containers that depend on it | 03:52 |
Jeffrey4l_ | sdake, i have installed the proper one. it is called qemu-kvm not qemu-system-x86 ( this come from epel ) | 03:53 |
sdake | what installed qemu-system-x86? | 03:53 |
sdake | was that hardcoded in the dockerfile? | 03:53 |
Jeffrey4l_ | sdake, this PS have fix this issue. and i have already tested it . it works. | 03:53 |
Jeffrey4l_ | https://review.openstack.org/385102 | 03:53 |
Jeffrey4l_ | sdake, check this ^^ | 03:53 |
sdake | ok lets just go with that for now Jeffrey4l_ | 03:53 |
Jeffrey4l_ | ya | 03:54 |
*** haplo37 has joined #openstack-kolla | 03:57 | |
*** g3ek has joined #openstack-kolla | 03:58 | |
*** zhubingbing has quit IRC | 04:03 | |
*** Jeffrey4l_ has quit IRC | 04:05 | |
*** huikang has quit IRC | 04:06 | |
*** MarMat_ has quit IRC | 04:07 | |
duonghq | sdake: we use keepalived as VIP failover solution on its own? | 04:18 |
*** Jeffrey4l has joined #openstack-kolla | 04:26 | |
*** zhubingbing has joined #openstack-kolla | 04:33 | |
*** tovin07 has quit IRC | 04:36 | |
*** jtriley has quit IRC | 04:40 | |
*** bachp has quit IRC | 04:44 | |
*** unicell has joined #openstack-kolla | 04:51 | |
*** bachp has joined #openstack-kolla | 04:51 | |
sdake | duonghq right | 04:54 |
sdake | Jeffrey4l boy we get alot of invalid bugs | 04:55 |
sdake | Jeffrey4l i think when things settle down weneed to take a hard look at those invlaid bugs and ssee if there are any patterns that can be documented | 04:56 |
sdake | Jeffrey4l you sort out the patterns - I'll document em - after usmmit :) | 04:56 |
Jeffrey4l | sdake, good idea. | 04:56 |
Jeffrey4l | sdake, ok. np. | 04:56 |
sdake | what is the story on this one: https://bugs.launchpad.net/kolla/+bug/1564773 | 04:57 |
openstack | Launchpad bug 1564773 in kolla mitaka "Continously restarting rabbitmq container for CentOS" [High,Confirmed] | 04:57 |
sdake | and why is it not critical | 04:57 |
Jeffrey4l | sdake, no idea now. i think it should be wrong configuration. but still not get the point. | 04:58 |
sdake | Jeffrey4l iddy ou fix ubuntu upgrade? | 05:01 |
sdake | and did centos upgrade bug merge? | 05:01 |
*** salv-orlando has joined #openstack-kolla | 05:01 | |
Jeffrey4l | sdake, no https://review.openstack.org/384598 | 05:02 |
sdake | Jeffrey4l pbourke just wants the commit log to document the deicsion | 05:03 |
sdake | that seems easy enough | 05:03 |
Jeffrey4l | ok. | 05:04 |
*** Jeffrey4l has quit IRC | 05:09 | |
*** salv-orlando has quit IRC | 05:11 | |
*** Jeffrey4l has joined #openstack-kolla | 05:11 | |
sdake | Jeffrey4l 19 bugs fixed so far in rc2 ;) | 05:12 |
sdake | man your on fire | 05:12 |
sdake | thats mor ethen 1 bug a day! | 05:12 |
*** Jeffrey4l has quit IRC | 05:12 | |
*** Jeffrey4l has joined #openstack-kolla | 05:13 | |
*** Jeffrey4l has quit IRC | 05:13 | |
*** Jeffrey4l_ has joined #openstack-kolla | 05:13 | |
* Jeffrey4l_ is back | 05:14 | |
*** MarMat has joined #openstack-kolla | 05:15 | |
*** jtriley has joined #openstack-kolla | 05:19 | |
*** bachp has quit IRC | 05:21 | |
*** salv-orlando has joined #openstack-kolla | 05:25 | |
*** bachp has joined #openstack-kolla | 05:27 | |
*** jtriley has quit IRC | 05:27 | |
sdake | Jeffrey4l_ any thoughts on htis problem: https://bugs.launchpad.net/kolla/+bug/1583655 | 05:29 |
openstack | Launchpad bug 1583655 in kolla "rabbitmq setup from secondary IP" [Critical,Confirmed] | 05:29 |
sdake | man rabbitmq is a pain in the ass | 05:29 |
* Jeffrey4l_ is checking. | 05:29 | |
Jeffrey4l_ | yes.. | 05:29 |
*** msimonin has joined #openstack-kolla | 05:31 | |
Jeffrey4l_ | sdake, leave a comment. seem a misconfigured in his env. | 05:35 |
*** tonanhngo has quit IRC | 05:36 | |
*** tonanhngo has joined #openstack-kolla | 05:36 | |
*** skramaja has joined #openstack-kolla | 05:37 | |
sdake | Jeffrey4l_ thanks | 05:39 |
*** Jeffrey4l_ has quit IRC | 05:41 | |
*** Jeffrey4l_ has joined #openstack-kolla | 05:52 | |
*** Jeffrey4l_ has quit IRC | 05:57 | |
*** Jeffrey4l_ has joined #openstack-kolla | 05:58 | |
*** zhubingbing has quit IRC | 06:01 | |
*** unicell1 has joined #openstack-kolla | 06:02 | |
*** unicell has quit IRC | 06:02 | |
*** zhubingbing has joined #openstack-kolla | 06:03 | |
*** zhubingbing has quit IRC | 06:05 | |
*** Jeffrey4l_ has quit IRC | 06:06 | |
sdake | yo cat | 06:07 |
sdake | s | 06:07 |
sdake | so - our deadline is 12th for rc2 | 06:07 |
sdake | after rc2, only critical bugs should be fixed | 06:08 |
sdake | our deadline for rc3 is the 18th | 06:08 |
sdake | thats a total drop dead hard deadline | 06:08 |
sdake | so if your not working on a critical bug at this point, recommend getting on it :) | 06:08 |
sdake | if your working on something inprogress, thats good too | 06:08 |
sdake | all high and lower bugs will be moved to ocata on 18th | 06:08 |
*** ssurana has quit IRC | 06:17 | |
*** jtriley has joined #openstack-kolla | 06:17 | |
*** Jeffrey4l_ has joined #openstack-kolla | 06:19 | |
*** Jeffrey4l_ has quit IRC | 06:23 | |
*** Jeffrey4l_ has joined #openstack-kolla | 06:23 | |
*** msimonin has quit IRC | 06:23 | |
*** jtriley has quit IRC | 06:27 | |
duonghq | roger | 06:27 |
*** rkrum has quit IRC | 06:33 | |
*** mtaylor22 has quit IRC | 06:34 | |
*** haplo37 has quit IRC | 06:34 | |
*** cristicalin has joined #openstack-kolla | 06:38 | |
bjolo__ | sdake, Jeffrey4l_ please see my thoughts on https://bugs.launchpad.net/kolla/+bug/1583655 | 06:39 |
openstack | Launchpad bug 1583655 in kolla "rabbitmq setup from secondary IP" [Critical,Confirmed] | 06:39 |
Jeffrey4l_ | ok | 06:40 |
*** zhubingbing has joined #openstack-kolla | 06:41 | |
bjolo__ | morning btw :) | 06:42 |
bjolo__ | rc2 tag day | 06:42 |
*** zhubingbing has quit IRC | 06:43 | |
*** haplo37 has joined #openstack-kolla | 06:44 | |
Jeffrey4l_ | yes. tag should be make at 23:50 utc+0 | 06:44 |
sdake | Jeffrey4l_ that is when tag will be submitted | 06:51 |
sdake | i can't guarnatee when it will be made | 06:51 |
sdake | and it will be thereabouts | 06:51 |
sdake | i got kids and dinner and stuff to sort out along the day :) | 06:51 |
Jeffrey4l_ | roger. | 06:52 |
sdake | also not sure when the branch willbe made | 06:52 |
sdake | but i will find out once rc2 is tagged | 06:52 |
sdake | rc2 has to be tagged before a stable branch can e made | 06:52 |
*** tonanhngo has quit IRC | 06:54 | |
*** unicell1 has quit IRC | 06:55 | |
*** zhurong_ has joined #openstack-kolla | 06:55 | |
*** unicell has joined #openstack-kolla | 06:55 | |
*** zhurong has quit IRC | 06:57 | |
*** zhubingbing has joined #openstack-kolla | 06:58 | |
*** tonanhngo has joined #openstack-kolla | 07:01 | |
*** jmccarthy has quit IRC | 07:01 | |
*** tonanhngo has quit IRC | 07:02 | |
*** jmccarthy has joined #openstack-kolla | 07:04 | |
Jeffrey4l_ | bjolo__, sound a good idea. Could u push a PS for this? | 07:07 |
sdake | bjolo__ i am pretty sure /etc/hosts file in container comes from /etc/hosts bindmount of os | 07:10 |
sdake | Jeffrey4l_ ^^ | 07:10 |
Jeffrey4l_ | sdake, no. try this `docker run -it --add-host a:8.8.8.8 --net host centos:7 bash` | 07:10 |
*** cristicalin has quit IRC | 07:11 | |
sdake | ```tooo tired | 07:11 |
sdake | sorry Jeffrey4l_ | 07:11 |
Jeffrey4l_ | if we specified --add-host, the hosts file will be not the same with host OS | 07:12 |
*** msimonin has joined #openstack-kolla | 07:12 | |
Jeffrey4l_ | without --add-host, /etc/hosts in container will be the same with host OS. | 07:12 |
*** matrohon has joined #openstack-kolla | 07:12 | |
Jeffrey4l_ | never minder. this is the test result ^^ | 07:12 |
sdake | i see - wasn't aware of htis option | 07:12 |
bjolo__ | not me either | 07:12 |
sdake | that may not be in 10.0.z | 07:13 |
bjolo__ | working with computers one thing is for sure. you learn something new every day :) | 07:13 |
Jeffrey4l_ | but with --add-host, it will override the host OS hosts file. no idea whether this will cause any issue. | 07:13 |
*** b_bezak has joined #openstack-kolla | 07:13 | |
*** coolsvap has joined #openstack-kolla | 07:13 | |
sdake | not sure but i've hit the wall | 07:14 |
sdake | kids running me ragged | 07:14 |
sdake | solo dad for 3 weeks = rough | 07:14 |
sdake | night all | 07:14 |
Jeffrey4l_ | how old are they? | 07:15 |
bjolo__ | night sdake | 07:15 |
Jeffrey4l_ | night ;) | 07:15 |
bjolo__ | cya in my afternoon :) | 07:15 |
bjolo__ | so Jeffrey4l_ you suggest that we should only do a special start for the rabbitmq containers? | 07:15 |
Jeffrey4l_ | bjolo__, yes. it will solve the issue i think. | 07:16 |
bjolo__ | and not generate a hosts file that we copy into the container using the config.json | 07:16 |
bjolo__ | ok, im just thinking about copy_always and copy_once | 07:17 |
Jeffrey4l_ | bjolo__, copy it is not enough. because when host os hosts file change, the container will not be updated. | 07:17 |
*** jtriley has joined #openstack-kolla | 07:17 | |
bjolo__ | forget the hosts /etc/hosts file | 07:17 |
*** tonanhngo has joined #openstack-kolla | 07:17 | |
Jeffrey4l_ | i am thinking, whether there is a parameter, in which we can append some item in /etc/hosts/ | 07:18 |
Jeffrey4l_ | bjolo__, how about --add-host? | 07:18 |
Jeffrey4l_ | btw, we can also specify the hostname in container --hostname | 07:19 |
*** tonanhngo has quit IRC | 07:19 | |
bjolo__ | the add-host means that we need to generate new containers when something changes since the start parameters will change right | 07:19 |
bjolo__ | no matter what the copy policy is | 07:20 |
*** MarMat has quit IRC | 07:20 | |
Jeffrey4l_ | bjolo__, should we need add all items in /etc/hosts to --add-host? | 07:20 |
bjolo__ | for rabbit, does the cluster hostname have to match the "real" hostname | 07:20 |
Jeffrey4l_ | bjolo__, i do not think it is matter. | 07:21 |
bjolo__ | so anything will work in hosts file and rabbitmq cluster setup as long as it resolves to right IP | 07:22 |
Jeffrey4l_ | use a virtual hostname should be fine. like rabbit1 rabbit2 rabbit3 | 07:22 |
bjolo__ | cool | 07:22 |
*** sdake has quit IRC | 07:22 | |
Jeffrey4l_ | oh wait. | 07:22 |
bjolo__ | ok so a few options on how to get that into the containers /etc/hosts file | 07:22 |
Jeffrey4l_ | hostname matter if we do not change the container's hostname. | 07:22 |
bjolo__ | ? | 07:23 |
Jeffrey4l_ | hostname matter if we do not change the container's hostname through --hostname parameter. | 07:23 |
Jeffrey4l_ | so we need `docker run --add-host {{ ansible_hostname }}:{{ api_interface_address }} --add-host <node2> | 07:24 |
*** msimonin1 has joined #openstack-kolla | 07:24 | |
*** msimonin has quit IRC | 07:25 | |
*** msimonin1 has left #openstack-kolla | 07:26 | |
*** awebber has joined #openstack-kolla | 07:26 | |
*** jtriley has quit IRC | 07:27 | |
*** shardy has joined #openstack-kolla | 07:27 | |
*** williamcaban has joined #openstack-kolla | 07:28 | |
bjolo__ | ok | 07:29 |
bjolo__ | but the drawback of this approach is that we break the copy_always policy in the sense that a container restart should load the right config. If a new rabbit container is added, we need to regenerate all rabbit containers right | 07:30 |
Jeffrey4l_ | yes. another approach is copying hosts though set_config.py feature. | 07:32 |
*** Guest59427 is now known as zigo | 07:33 | |
bjolo__ | hmm let me tinker with it a bit | 07:33 |
Jeffrey4l_ | it will solution your concern. | 07:35 |
*** awebber has quit IRC | 07:36 | |
Jeffrey4l_ | but both of these two solution have a drawback: it blocked the host OS's hosts file. no idea wheter it will cause any other issue. | 07:36 |
*** mnasiadka has joined #openstack-kolla | 07:39 | |
*** mkoderer has joined #openstack-kolla | 07:41 | |
*** tonanhngo has joined #openstack-kolla | 07:42 | |
*** awebber has joined #openstack-kolla | 07:42 | |
*** rmart04 has joined #openstack-kolla | 07:43 | |
*** tonanhngo has quit IRC | 07:44 | |
*** williamcaban has quit IRC | 07:45 | |
awebber | when does inc0 normally come online :) | 07:47 |
openstackgerrit | zhubingbing proposed openstack/kolla: change source to . in gnocchi-base dockerfile https://review.openstack.org/385328 | 07:54 |
openstackgerrit | zhubingbing proposed openstack/kolla: change source to . in gnocchi-base dockerfile https://review.openstack.org/385328 | 07:56 |
*** salv-orlando has quit IRC | 07:59 | |
*** ankush has joined #openstack-kolla | 07:59 | |
*** Serlex has joined #openstack-kolla | 08:02 | |
*** awebber has quit IRC | 08:03 | |
bjolo__ | hmmm you are right | 08:10 |
*** zhubingbing has quit IRC | 08:11 | |
bjolo__ | Jeffrey4l_, but the /etc/hosts in the container is only a copy of the hosts /etc/hosts right. It does not look like a bind mount | 08:15 |
*** athomas has joined #openstack-kolla | 08:16 | |
*** jtriley has joined #openstack-kolla | 08:17 | |
bjolo__ | so if we generate the hosts entries needed for rabbitmq and append those to the containers /etc/hosts | 08:19 |
*** jtriley has quit IRC | 08:22 | |
openstackgerrit | Zeyu Zhu proposed openstack/kolla: Visit target nodes without password. https://review.openstack.org/368524 | 08:27 |
*** bjolo__ is now known as bjolo | 08:27 | |
openstackgerrit | Zeyu Zhu proposed openstack/kolla: Visit target nodes without password. https://review.openstack.org/368524 | 08:30 |
*** berendt has joined #openstack-kolla | 08:31 | |
*** williamcaban has joined #openstack-kolla | 08:42 | |
*** williamcaban has quit IRC | 08:46 | |
*** mkoderer has quit IRC | 08:49 | |
*** mkoderer has joined #openstack-kolla | 08:50 | |
*** janem has joined #openstack-kolla | 08:55 | |
janem | Im trying to build centos images on my Ubuntu host.. there are issues with aufs? | 08:56 |
janem | having problems building some of the base images. | 08:56 |
pbourke | janem: http://docs.openstack.org/developer/kolla/image-building.html#known-issues | 08:59 |
*** zhubingbing has joined #openstack-kolla | 09:01 | |
*** shardy is now known as shardy_mtg | 09:04 | |
*** hieulq_ has quit IRC | 09:05 | |
*** hieulq_ has joined #openstack-kolla | 09:06 | |
*** jtriley has joined #openstack-kolla | 09:11 | |
janem | pbourke: thanks | 09:12 |
*** awebber has joined #openstack-kolla | 09:13 | |
*** gfidente has joined #openstack-kolla | 09:15 | |
*** gfidente has quit IRC | 09:15 | |
*** gfidente has joined #openstack-kolla | 09:15 | |
*** tovin07 has joined #openstack-kolla | 09:15 | |
*** jtriley has quit IRC | 09:15 | |
*** matrohon has quit IRC | 09:23 | |
*** shardy_mtg is now known as shardy | 09:27 | |
*** salv-orlando has joined #openstack-kolla | 09:30 | |
*** salv-orlando has quit IRC | 09:34 | |
*** haplo37 has quit IRC | 09:37 | |
*** g3ek has quit IRC | 09:37 | |
*** yingjun has quit IRC | 09:42 | |
*** g3ek has joined #openstack-kolla | 09:47 | |
*** haplo37 has joined #openstack-kolla | 09:47 | |
*** zhubingbing has quit IRC | 09:48 | |
*** duonghq has quit IRC | 10:00 | |
*** tovin07 has quit IRC | 10:00 | |
*** zhurong_ has quit IRC | 10:01 | |
*** tonanhngo has joined #openstack-kolla | 10:03 | |
*** jtriley has joined #openstack-kolla | 10:05 | |
*** tonanhngo has quit IRC | 10:05 | |
*** amaged__ has quit IRC | 10:06 | |
openstackgerrit | Vladislav Belogrudov proposed openstack/kolla: Prechecks fail if using separate api interface https://review.openstack.org/385375 | 10:07 |
*** amaged__ has joined #openstack-kolla | 10:09 | |
*** bachp has quit IRC | 10:11 | |
*** msimonin has joined #openstack-kolla | 10:12 | |
*** bachp has joined #openstack-kolla | 10:12 | |
*** salv-orlando has joined #openstack-kolla | 10:15 | |
*** jtriley has quit IRC | 10:15 | |
*** mgoddard has joined #openstack-kolla | 10:16 | |
openstackgerrit | Merged openstack/kolla: Fix the failure to launch instance when enabled Ceph https://review.openstack.org/385102 | 10:22 |
*** tonanhngo has joined #openstack-kolla | 10:23 | |
*** tonanhngo has quit IRC | 10:26 | |
*** Serlex has quit IRC | 10:33 | |
*** tonanhngo has joined #openstack-kolla | 10:44 | |
*** tonanhngo has quit IRC | 10:45 | |
*** haplo37_ has quit IRC | 10:59 | |
*** haplo37_ has joined #openstack-kolla | 11:01 | |
*** jtriley has joined #openstack-kolla | 11:04 | |
*** jtriley has quit IRC | 11:09 | |
*** jtriley has joined #openstack-kolla | 11:10 | |
*** shardy is now known as shardy_lunch | 11:12 | |
*** jtriley has quit IRC | 11:15 | |
*** mkoderer has quit IRC | 11:19 | |
*** msimonin has quit IRC | 11:20 | |
*** mkoderer has joined #openstack-kolla | 11:20 | |
*** dwalsh_ has joined #openstack-kolla | 11:23 | |
*** salv-orlando has quit IRC | 11:23 | |
awidders_ | so I noticed when I install Kolla using pip using git as the source it doesn't fully install into the /usr/share/kolla directory | 11:31 |
awidders_ | git+https://github.com/openstack/kolla.git@3.0.0.0rc1#egg=kolla | 11:31 |
awidders_ | for example | 11:31 |
awidders_ | am I missing something | 11:32 |
awidders_ | have to go then run setup.py install manually | 11:32 |
awidders_ | thought that was just supposed to happen | 11:32 |
*** phuongnh has quit IRC | 11:33 | |
awidders_ | ah nm | 11:37 |
awidders_ | figured it out | 11:37 |
*** jtriley has joined #openstack-kolla | 11:40 | |
*** eaguilar has joined #openstack-kolla | 11:42 | |
*** kproskurin has joined #openstack-kolla | 11:43 | |
*** Serlex has joined #openstack-kolla | 11:47 | |
*** salv-orlando has joined #openstack-kolla | 11:51 | |
*** narasimha_SV has joined #openstack-kolla | 11:54 | |
narasimha_SV | https://bugs.launchpad.net/kolla/+bug/1632677 | 11:54 |
openstack | Launchpad bug 1632677 in kolla "ironic-conductor container missing iscsci_tcp module" [Undecided,New] | 11:54 |
narasimha_SV | getting this issue while trying to pxe boot of a server using pxe_ipmitool | 11:54 |
*** matrohon has joined #openstack-kolla | 12:07 | |
*** awidders_ has quit IRC | 12:07 | |
*** awiddersheim has joined #openstack-kolla | 12:07 | |
*** jtriley has quit IRC | 12:09 | |
*** awiddersheim has quit IRC | 12:11 | |
*** awiddersheim has joined #openstack-kolla | 12:11 | |
*** zhurong has joined #openstack-kolla | 12:13 | |
*** zhubingbing has joined #openstack-kolla | 12:14 | |
*** awidders_ has joined #openstack-kolla | 12:15 | |
*** awiddersheim has quit IRC | 12:15 | |
*** zhubingbing has quit IRC | 12:16 | |
*** rhallisey has joined #openstack-kolla | 12:20 | |
*** sdake has joined #openstack-kolla | 12:21 | |
*** sdake has quit IRC | 12:22 | |
*** zhubingbing has joined #openstack-kolla | 12:22 | |
*** sdake has joined #openstack-kolla | 12:23 | |
sdake | morning peeps | 12:24 |
sdake | tag day!! | 12:24 |
sdake | hows the release looking | 12:24 |
*** shardy_lunch is now known as shardy | 12:28 | |
*** williamcaban has joined #openstack-kolla | 12:30 | |
*** mgoddard has quit IRC | 12:31 | |
sbezverk_ | sdake: good morning | 12:31 |
zhubingbing | guys | 12:32 |
zhubingbing | tag day!! | 12:32 |
zhubingbing | feel so excited | 12:33 |
*** tonanhngo has joined #openstack-kolla | 12:33 | |
*** prithiv has joined #openstack-kolla | 12:34 | |
*** tonanhngo has quit IRC | 12:35 | |
*** lamt has quit IRC | 12:37 | |
awebber | awidders_ i use the following container to build kolla - https://gist.github.com/andrewwebber/abcb2f07e27c8227a3bd2aaf1f8c51bf | 12:46 |
*** jheroux has joined #openstack-kolla | 12:46 | |
*** quasar__ is now known as quasar | 12:48 | |
*** haplo37 has quit IRC | 12:49 | |
*** zhubingbing has quit IRC | 12:50 | |
*** g3ek has quit IRC | 12:51 | |
*** g3ek has joined #openstack-kolla | 12:51 | |
*** haplo37 has joined #openstack-kolla | 12:52 | |
sean-k-mooney | on issue that may be out of our hands it it appears that http://download.ceph.com is down | 12:52 |
sean-k-mooney | as a result you cannot build the base image | 12:52 |
*** salv-orlando has quit IRC | 12:53 | |
sean-k-mooney | actully it looks like ceph.com and all its subdomains are down | 12:54 |
sdake | morning sbezverk_ | 12:54 |
sdake | sean-k-mooney GRAN | 12:55 |
sdake | GROAN | 12:55 |
sdake | sean-k-mooney this is just ubuntu right? | 12:56 |
sdake | our ceph images don'tcome from ceph.com | 12:56 |
sean-k-mooney | its been down for a while. they were down yesterday evening when we were talking about my rabbitmq issues. i assumed they would be back up today but im just getting operat timed out issues so maybe they are under a ddos | 12:56 |
sdake | on centos | 12:57 |
sdake | are you usingcentos? | 12:57 |
*** dave-mccowan has joined #openstack-kolla | 12:57 | |
*** bachp has quit IRC | 12:57 | |
sean-k-mooney | am good question. dose centos package jewel in an rpm | 12:57 |
*** bachp has joined #openstack-kolla | 12:57 | |
sdake | ya centos packages jewel in rpms | 12:59 |
sdake | in the storage sig | 12:59 |
sdake | which we install | 12:59 |
sdake | if we are installing a ceph repo at the same time - that is wrong | 12:59 |
sean-k-mooney | no looking at the base dockerfile downloads.ceph.com is only used on ubuntu | 13:00 |
sean-k-mooney | the storage sig is beeing used on centos as you said https://github.com/openstack/kolla/blob/master/docker/base/Dockerfile.j2#L84 | 13:00 |
sean-k-mooney | i wonder if there is a mirror list that we can use on ubuntu | 13:01 |
sean-k-mooney | actully now that ubunut 16.04 uses systemd centos containers work correct | 13:02 |
sean-k-mooney | yes the regional mirros are up got to love google cache fro viewing things when they are down. | 13:04 |
awebber | eu.ceph.com is up - "deb http://eu.ceph.com/debian-jewel/ xenial main" was my work around to build from source | 13:05 |
*** zhurong has quit IRC | 13:06 | |
sean-k-mooney | yep just checked that. am is there documetation for how to overdide the sources list in the kolla build? | 13:06 |
sean-k-mooney | i know the variable is there but have never seen someone use it | 13:06 |
*** zhubingbing has joined #openstack-kolla | 13:07 | |
awebber | i am currently building master but with patches to build for ceph hammer. That source was a life saver | 13:08 |
*** prithiv has quit IRC | 13:09 | |
*** zhubingbing has quit IRC | 13:09 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla-kubernetes: Workflow Gate Testing https://review.openstack.org/382021 | 13:10 |
*** zhubingbing has joined #openstack-kolla | 13:10 | |
*** lamt has joined #openstack-kolla | 13:11 | |
*** mnasiadka has quit IRC | 13:11 | |
openstackgerrit | Mick Thompson proposed openstack/kolla: Add register to upgrade.yml to create correct endpoint https://review.openstack.org/385465 | 13:11 |
sdake | sean-k-mooney our friends in #rdo have said ceph may be part of the dreamhost outage which is here: | 13:14 |
sdake | http://www.dreamhoststatus.com/2016/10/11/dreamcompute-us-east-1-cluster-service-disruption/ | 13:14 |
awebber | sdake ironic that ceph.com is down because the backend ceph is down :) | 13:24 |
*** kproskurin has quit IRC | 13:26 | |
*** mewald has joined #openstack-kolla | 13:26 | |
openstackgerrit | Christian Berendt proposed openstack/kolla: Install MySQL-python with pip in openstack-base container (type source) https://review.openstack.org/384938 | 13:26 |
mewald | Hey guys, it looks like keepalived is not working well … I look at the VIPs every once in a while and usually see that two of my hosts have the same VIP. Anyone with similar problems? | 13:27 |
*** inc0 has joined #openstack-kolla | 13:30 | |
*** sogabe has quit IRC | 13:31 | |
openstackgerrit | Merged openstack/kolla: Fix 'Address already in use' for barbican-api https://review.openstack.org/384771 | 13:31 |
inc0 | good morning | 13:31 |
*** ankush has quit IRC | 13:31 | |
inc0 | how's my favorite project team doing? | 13:31 |
openstackgerrit | Merged openstack/kolla: Enable keystone authentication for Barbican https://review.openstack.org/384161 | 13:31 |
sdake | awebber lol | 13:32 |
*** zhurong has joined #openstack-kolla | 13:34 | |
awebber | inc0 in relation to getting kolla working with ceph-hammer these are the changes i have currently made - https://github.com/openstack/kolla/compare/master...andrewwebber:ceph-hammer?expand=1 | 13:34 |
awebber | inc0 i am testing external ceph and would be grateful if you could tell me if im going in the right direction | 13:35 |
inc0 | awebber, you can make these changes locally (without affecting kolla code) by using this mechanism: http://docs.openstack.org/developer/kolla/image-building.html#dockerfile-customisation | 13:36 |
*** zhubingbing has quit IRC | 13:36 | |
inc0 | once we can get this up and running, that would actually be great thing to have in docs | 13:36 |
awebber | inc0 yes this is probably the elegant approach but i am just spiking if this integration with hammer is even possible | 13:36 |
inc0 | so I dont think we can make hammer and jewel coexist in trunk | 13:37 |
inc0 | if clients aren't backward compatible (which is duh) | 13:37 |
awebber | inc0 i am not looking to submit a merge request | 13:38 |
sdake | inc0 i'm pretty sure we dont know if there is backwards copmatibillity or not in the protocol clients | 13:38 |
awebber | inc0 would this be A correct approach to test using an older client version? | 13:38 |
awebber | inc0 if so i could imagine the templates being extended to allow the admin to define a ceph version | 13:40 |
inc0 | awebber, so we have a rule to not configure building images based on deploy | 13:44 |
inc0 | I think best solution for situation like that is to use template override mechanism | 13:44 |
inc0 | and document it in kolla docs | 13:44 |
inc0 | at least until we figure out something better | 13:45 |
awebber | inc0 sure | 13:45 |
inc0 | (in fact, I might have an idea already;)) | 13:45 |
awebber | inc0 i just thought with the templates one could specify the ceph version - kolla-build --ceph-version 0.94.4. This would propergate to the Dockerfile templates | 13:46 |
inc0 | so we can't possibly do something like this for every service we have | 13:47 |
inc0 | it would be impossible to maintain | 13:47 |
awebber | inc0 this seems only applicable to external ceph... | 13:47 |
*** ankush has joined #openstack-kolla | 13:47 | |
inc0 | exactly, but code would have to be there nonetheless | 13:47 |
awebber | inc0 ceph the first external service candidate? | 13:47 |
inc0 | today its ceph, tomorrow rabbitmq | 13:47 |
inc0 | no, we have more | 13:47 |
awebber | inc0 how are they versioned | 13:47 |
inc0 | in fact, with careful config generation you can make pretty much every service external | 13:48 |
inc0 | we'll help with few, but it's possible | 13:48 |
inc0 | but what I was thinking about is to have contrib dir in kolla with our own override files for different situation | 13:49 |
inc0 | like kolla-build --template-override contrib/ceph-version-hammer.j2 | 13:49 |
inc0 | I think having stuff like this would be helpful, we'd first need to support multiple override files | 13:50 |
awebber | inc0 yes | 13:51 |
awebber | inc0 that would be awesome, currently i am merging a folked repro post fetching the kolla repro | 13:51 |
inc0 | something to think about in Ocata, awebber ceph hammer would be great start, would you be willing to share override file if you make it work? | 13:52 |
inc0 | well you can put it all into override file - no merging required | 13:52 |
awebber | inc0 no problem, i am spiking with my patches for now, then i will refactor them (if they work) into a template override | 13:52 |
inc0 | for us that's only matter to gather few of these files into one dir | 13:52 |
inc0 | wonderful, thank you good sir | 13:53 |
bjolo | mewald, https://bugs.launchpad.net/kolla/+bug/1627275 | 13:53 |
openstack | Launchpad bug 1627275 in kolla "docker stop keepalived does not release VIPs" [High,Triaged] | 13:53 |
*** jtriley has joined #openstack-kolla | 13:53 | |
inc0 | bjolo, I don't think it's possible | 13:53 |
inc0 | to fix | 13:53 |
*** MarMat has joined #openstack-kolla | 13:53 | |
bjolo | ok | 13:54 |
inc0 | if you kill -9 keepalived (no docker involved) it wont remove ip as well | 13:54 |
inc0 | because..there will be no process to do it | 13:54 |
bjolo | but i did a docker stop keepalived | 13:54 |
inc0 | well I guess keepalived doesn't handle SIGKILL in a way that removes IP:) | 13:55 |
bjolo | mewald, whats your use case? | 13:55 |
inc0 | arguably it shouldn't | 13:55 |
bjolo | i did google it a bit, and it seemed doable, but it was a race condition on shutdown that caused. Need to find the URLs again | 13:56 |
narasimha_SV | ironic-condcutor is unable to talk to iscsid container build | 13:56 |
*** bjolo is now known as bjolo-afk | 13:56 | |
narasimha_SV | because of that it is unable to proceed the pxe booting after deploying deploy_ramdisk | 13:56 |
*** mgoddard has joined #openstack-kolla | 13:56 | |
narasimha_SV | are there any specific configurations I need to keep for these so that it talks to iscsid container ??? | 13:57 |
bjolo-afk | inc0, it is a serious issue for ops tho. having same IP on two hosts will cause a lot of issues | 13:57 |
inc0 | yes I know | 13:57 |
inc0 | there are more situations like that | 13:58 |
inc0 | when keepalived will cause problems | 13:58 |
inc0 | again, that's one of main issues I'd like to move on HA session | 13:58 |
bjolo-afk | HA session? | 13:58 |
*** papacz has joined #openstack-kolla | 13:59 | |
*** liyifeng has joined #openstack-kolla | 13:59 | |
*** ankush has quit IRC | 14:00 | |
*** tonanhngo has joined #openstack-kolla | 14:08 | |
*** tonanhngo has quit IRC | 14:12 | |
sdake | narasimha_SV - sean-k-mooney is working on bmaas in Ocata | 14:15 |
sdake | narasimha_SV pretty sure its not operational now | 14:15 |
sdake | narasimha_SV Jeffrey4l_ indicated ironic bmaas is operational for pxe+ssh | 14:15 |
sdake | narasimha_SV BMAAS not to e confused with our integration with bifrost for openstack deployment | 14:16 |
sdake | narasimha_SV if you have a problem there, please reach out to sean-k-mooney - we need that working reliably for everyone | 14:16 |
sean-k-mooney | narasimha_SV: actully if its on the ironic wznoinsk is looking at that more then i. | 14:19 |
sean-k-mooney | narasimha_SV: if its birfrost then agent_ipmitool and agent_ssh were the two drivers i was testing | 14:21 |
narasimha_SV | ok | 14:22 |
sean-k-mooney | wznoinsk: https://bugs.launchpad.net/kolla/+bug/1632677 this is cause by the fact the kernel module is not loaded correct? | 14:22 |
openstack | Launchpad bug 1632677 in kolla "ironic-conductor container missing iscsci_tcp module" [Undecided,Invalid] | 14:22 |
narasimha_SV | sean-k-mooney: when I am using agent_ipmitool nova-scheduler itself unable to select the host | 14:22 |
narasimha_SV | which is working with pxe_ipmitool | 14:23 |
*** mark-casey1 has joined #openstack-kolla | 14:23 | |
sean-k-mooney | narasimha_SV: interesting. i know that we have the pxe_ipmitool driver working for ironic as a service in our lab | 14:23 |
narasimha_SV | yes but in kolla now what I am facing is it is unable to talk to iscsid container because the command is executing from ironic-condutor | 14:23 |
narasimha_SV | i think that you lab is with normal deployment right not over containers ? | 14:24 |
*** salv-orlando has joined #openstack-kolla | 14:24 | |
narasimha_SV | that launchpad bug which I raised is invalid as I can see the iscsi_tcp module in iscsi contianer deployed | 14:26 |
narasimha_SV | so now as of my environment I can see that ironic-conductor is trying to execute the command from it but when I try the same command form iscsi container it is working | 14:27 |
*** salv-orlando has quit IRC | 14:29 | |
sdake | narasimha_SV - ironic-conductor needs ipc shared if it is to use iscsi tgtd | 14:31 |
sdake | narasimha_SV i'm pretty sure when that work was implemented ipc sharing wasn't available in kolla | 14:31 |
sdake | narasimha_SV so - that needs to be added | 14:31 |
narasimha_SV | sdake: i am new to this could you please explain more | 14:31 |
narasimha_SV | ok how to add ipc sharing now ? | 14:31 |
sdake | narasimha_SV file bug i'll add commentary there | 14:31 |
narasimha_SV | ok sure | 14:31 |
sdake | narasimha_SV with bmaas, you are going to continue to run into problems :) | 14:32 |
sdake | it hasn't been shaken out yet | 14:32 |
openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla: Unmount Ceph OSD disks as part of destroy https://review.openstack.org/380028 | 14:32 |
sdake | pbourke why the -2 on https://review.openstack.org/#/c/380028/3/tools/cleanup-host | 14:33 |
sdake | seems like a high severity bug to me | 14:33 |
pbourke | sdake: hmm I didnt think so | 14:34 |
pbourke | we can always get better at cleanup | 14:34 |
inc0 | Jeffrey4l_, sdake where are we in upgrade permission crysis? | 14:34 |
sdake | inc0 everything is blocked | 14:34 |
sdake | inc0 ceph has major outage | 14:35 |
inc0 | how so? | 14:35 |
inc0 | what? | 14:35 |
sdake | open a webbrowser to ceph.com | 14:35 |
sdake | http://www.dreamhoststatus.com/2016/10/11/dreamcompute-us-east-1-cluster-service-disruption/ | 14:35 |
inc0 | ahh...we can't build shit then | 14:35 |
sdake | right | 14:35 |
sdake | we are tagging today anyway | 14:36 |
sdake | we are releasing rc3 on 18th | 14:36 |
sdake | and branching todayish (when release team can do so) | 14:36 |
inc0 | yes, we'll backport all these bugfixes | 14:36 |
sdake | rc3 is critical bugso only | 14:36 |
inc0 | to stable | 14:36 |
*** jtriley has quit IRC | 14:36 | |
sdake | 3.0.0 will be tagged from rc3 on 18th | 14:36 |
inc0 | but apart from not able to build shit, do we have reviews up? | 14:36 |
sdake | inc0 we can build centos | 14:37 |
sdake | we can't build ubuntu | 14:37 |
sdake | hard to test without something to test against... | 14:37 |
sdake | so no | 14:37 |
*** snoyes_ has joined #openstack-kolla | 14:37 | |
sdake | i have jerked around with getting a vm of ubuntu 16.04 going tho | 14:37 |
*** jtriley has joined #openstack-kolla | 14:38 | |
sdake | inc0 i need to be able to see inside the containers to understand how to change permissions for ubuntu | 14:38 |
sdake | and not being able to build them is a problem :) | 14:38 |
inc0 | yeah | 14:38 |
inc0 | well I have prebuilt containers | 14:39 |
inc0 | so I'll try to work on it | 14:39 |
inc0 | I have built 3.0 and 2.0 can be pulled from dockerhub | 14:40 |
*** b_bezak has quit IRC | 14:41 | |
narasimha_SV | sdake: https://bugs.launchpad.net/kolla/+bug/1632738 | 14:46 |
openstack | Launchpad bug 1632738 in kolla "ironic-conductor container unable to talk to iscsid container" [Undecided,New] | 14:46 |
*** steve-noyes has joined #openstack-kolla | 14:47 | |
*** mark-casey1 has quit IRC | 14:47 | |
*** liyifeng has quit IRC | 14:48 | |
openstackgerrit | Merged openstack/kolla: Add register to upgrade.yml to create correct endpoint https://review.openstack.org/385465 | 14:48 |
*** mark-casey1 has joined #openstack-kolla | 14:48 | |
*** liyifeng has joined #openstack-kolla | 14:50 | |
NachoDuck | Is there a strategy for adding new hosts to a Kolla deployment, preferably with minimal downtime? | 14:50 |
*** athomas has quit IRC | 14:50 | |
*** bachp has quit IRC | 14:50 | |
Serlex | Hi, what does enable_tempest actually enable/install? | 14:52 |
*** snoyes_ has quit IRC | 14:53 | |
*** tonanhngo has joined #openstack-kolla | 14:53 | |
mark-casey1 | fyi there is a k8s 1.4 Ask Me Anything webcast today with team members from Google, Deis, CoreOS, and a few others. looks like new features rundown plus audience questions https://www.brighttalk.com/webcast/14601/227905 | 14:54 |
mewald | bjolo-afk: I just let all keepaliveds running and after a while I have duplicate IPs | 14:54 |
sdake | narasimha_SV triaged thanks for filing a bug :) | 14:54 |
narasimha_SV | thanks sdake. I was struggling on this from past 2 days | 14:55 |
*** bachp has joined #openstack-kolla | 14:56 | |
narasimha_SV | sdake: in my kolla ipc_mode: "host" this is already there | 14:57 |
sdake | narasimha_SV for the play for ironic? | 14:57 |
*** zhubingbing has joined #openstack-kolla | 14:59 | |
narasimha_SV | yes in iscsi start.yml file i have ipc_mode: "host" | 15:00 |
rhallisey | NachoDuck, I believe you can add hosts to your inventory file and re run | 15:02 |
sdake | is that what play is failing? | 15:02 |
rhallisey | NachoDuck, I'll have to test that strategy though. Otherwise you can have your inventory file with only the new hosts | 15:02 |
rhallisey | that will scale up | 15:03 |
narasimha_SV | no the container is running | 15:03 |
narasimha_SV | when i run the command which is failing in conductor the same command is working from that container | 15:04 |
NachoDuck | rhallisey: Ok thanks, I tried it with a reconfigure yesterday but it failed when it couldn't find heka on the new host, which makes sense | 15:04 |
narasimha_SV | i think it didn't put the confs related to iscsi on the host | 15:04 |
NachoDuck | I guess rerunning the deploy is the correct move | 15:05 |
*** sdake has quit IRC | 15:05 | |
*** zhubingbing has quit IRC | 15:05 | |
*** sdake has joined #openstack-kolla | 15:06 | |
narasimha_SV | sdake: i am rebuilding the iscsi contianer again | 15:07 |
narasimha_SV | let me check | 15:07 |
*** mark-casey1 has quit IRC | 15:07 | |
*** mark-casey1 has joined #openstack-kolla | 15:08 | |
rhallisey | NachoDuck, ya re configure won't do it | 15:09 |
rhallisey | NachoDuck, a re deploy with new hosts will land those containers there | 15:09 |
NachoDuck | Ok cool, I'll give it a go now | 15:09 |
rhallisey | NachoDuck, I don't think there is a doc for this, but if you have success with it the community would love for you to share :) | 15:09 |
rhallisey | could right a doc or something | 15:10 |
sdake | narasimha_SV if the ironic container is using iscsi internally (which i htink itis0 it needs that ipc sharing | 15:10 |
sdake | the grep in there was an exmaple of how its done | 15:10 |
NachoDuck | rhallisey, hehe sure wouldn't mind doing that at all | 15:10 |
narasimha_SV | ok | 15:11 |
rhallisey | NachoDuck, awesome! | 15:11 |
*** mewald has quit IRC | 15:13 | |
*** bachp has quit IRC | 15:15 | |
narasimha_SV | sdake: how to identify that iscsi is runing on ipc-mode : host ? | 15:15 |
*** msimonin has joined #openstack-kolla | 15:16 | |
wznoinsk | narasimha_SV: sean-k-mooney sorry, busy atm, I can't say for sure about iscsi_tcp as my xenial had iscsid on the host installed and accidentally started on host startup | 15:20 |
*** bachp has joined #openstack-kolla | 15:21 | |
*** janem has quit IRC | 15:21 | |
*** salv-orlando has joined #openstack-kolla | 15:21 | |
narasimha_SV | wznoinsk: i think this is issue with iscsi container | 15:21 |
narasimha_SV | as per sdake mentioned this iscsi contianer should have run on host mode | 15:22 |
sdake | narasimha_SV docker insepct will tell you | 15:23 |
narasimha_SV | ok | 15:23 |
*** bachp has quit IRC | 15:26 | |
*** rmart04 has quit IRC | 15:27 | |
*** zhurong has quit IRC | 15:28 | |
*** hieulq has joined #openstack-kolla | 15:30 | |
*** jtriley has quit IRC | 15:34 | |
*** duonghq has joined #openstack-kolla | 15:35 | |
*** lrensing has joined #openstack-kolla | 15:37 | |
*** bachp has joined #openstack-kolla | 15:37 | |
*** mewald has joined #openstack-kolla | 15:38 | |
*** fguillot has quit IRC | 15:40 | |
*** hieulq has quit IRC | 15:43 | |
*** janem has joined #openstack-kolla | 15:43 | |
*** matrohon has quit IRC | 15:44 | |
*** hieulq has joined #openstack-kolla | 15:44 | |
narasimha_SV | sdake: http://paste.openstack.org/show/585482/ after redeploying th iscsi container | 15:46 |
*** david-lyle has joined #openstack-kolla | 15:46 | |
narasimha_SV | getting this issue | 15:46 |
sdake | narasimha_SV not sure how many timems I have to say ironic is busted in master and it will be addressed in ocata | 15:46 |
sdake | but i'll say it once more :) | 15:46 |
narasimha_SV | yes but the problem is my task in org is this I have enable ironic with kolla | 15:47 |
sdake | narasimha_SV oh your a dev | 15:48 |
sdake | i see | 15:48 |
narasimha_SV | yes | 15:48 |
sdake | ok - well why didn't you say so - i thought you were trying to deploy ironic for operatonal purposes :) | 15:49 |
narasimha_SV | no i am doing for the org where i work | 15:49 |
sdake | ok - in that case, wznoinsk (I htink) is handling that work - can you sync up with him and join forces? | 15:49 |
narasimha_SV | you cant even think I am working on this from more than a month | 15:49 |
narasimha_SV | sure | 15:49 |
sdake | narasimha_SV working together is a big part of kolla - we split work up all the time | 15:49 |
narasimha_SV | yes that's a good part | 15:50 |
narasimha_SV | because of that I am getting help from you all to get this into this stage atleast now | 15:50 |
Jeffrey4l_ | sdake, check this https://bugs.launchpad.net/kolla/+bug/1616268/comments/41 | 15:51 |
openstack | Launchpad bug 1616268 in kolla mitaka "Stale namespace removal causing "RTNETLINK answers: Invalid argument" errors" [Critical,Confirmed] | 15:51 |
sdake | 41 comments | 15:51 |
sdake | ugh | 15:51 |
Jeffrey4l_ | i think the namespace issue can be fixed now. | 15:51 |
*** david-lyle has quit IRC | 15:52 | |
sdake | Jeffrey4l_ so you are planning to ust mount /run? | 15:52 |
inc0 | Jeffrey4l_, thats good news | 15:52 |
*** mkoderer has quit IRC | 15:52 | |
sdake | i htink /run/netns is a seprate filesystem | 15:52 |
sdake | which is why it is mounted separately | 15:52 |
Jeffrey4l_ | sdake, no use proper /run/xxx file rather than /run direct. | 15:52 |
sdake | Jeffrey4l_ the nyou miss out on all the stuff that is needed in /run | 15:53 |
sdake | is this for the nova container? | 15:53 |
Jeffrey4l_ | for example in neutron_dhcp_agent, we use -v /run/openvswitch:/ru/openvswitch -v /run/netns:/run/netns:shared | 15:53 |
sdake | do you mean mount the run systemd files directly? | 15:53 |
*** vhosakot has joined #openstack-kolla | 15:53 | |
Jeffrey4l_ | sdake, we only need one of folder in /run in most container. | 15:54 |
Jeffrey4l_ | like neutron_dhcp_agent need access openvswitch socks in /run/openvswitch/ folder. | 15:54 |
sdake | Jeffrey4l_ yup agree - although be careful with that change (test upgrades) | 15:54 |
Jeffrey4l_ | sdake, yep. | 15:54 |
sdake | because some things need sockets directly in /run | 15:54 |
inc0 | 5min till meeting | 15:54 |
sdake | Jeffrey4l_ nice job sorting that out :) | 15:54 |
Jeffrey4l_ | ;) | 15:55 |
*** kproskurin has joined #openstack-kolla | 15:56 | |
*** kproskurin_ has joined #openstack-kolla | 15:57 | |
rhallisey | 15:58 | |
sdake | sup rhallisey | 15:58 |
rhallisey | super | 15:58 |
rhallisey | sdake, hey | 15:58 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix wrong mongodb address variable in ceilomter bootstrap https://review.openstack.org/385533 | 15:58 |
*** jtriley has joined #openstack-kolla | 15:59 | |
*** egonzalez90 has joined #openstack-kolla | 15:59 | |
mewald | folks my keystone.token table if growing to infinity. Is it possible we're not using memcache for keystone tokens? | 15:59 |
*** hrito has joined #openstack-kolla | 16:01 | |
*** kproskurin has quit IRC | 16:01 | |
*** athomas has joined #openstack-kolla | 16:01 | |
*** zhubingbing has joined #openstack-kolla | 16:02 | |
*** david-lyle has joined #openstack-kolla | 16:06 | |
wznoinsk | narasimha_SV: I got the kolla ironic couple on mitaka working, I'll try to help you there | 16:06 |
wznoinsk | narasimha_SV: long show is /dev maybe mounted from host to ironic-conductor container so conductor sees the iscsi devices discovered | 16:06 |
wznoinsk | s/show/shot | 16:06 |
*** steve-noyes has quit IRC | 16:15 | |
*** lrensing has quit IRC | 16:17 | |
*** eaguilar has quit IRC | 16:18 | |
*** neilus has joined #openstack-kolla | 16:25 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements https://review.openstack.org/385127 | 16:26 |
openstackgerrit | Mark Duggan proposed openstack/kolla: Parameterising iscsi_helper and setting default value https://review.openstack.org/385553 | 16:29 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix keystone fernet file exchange via ssh https://review.openstack.org/369418 | 16:29 |
*** lrensing has joined #openstack-kolla | 16:30 | |
*** lrensing has quit IRC | 16:32 | |
*** HyperJohnGraham_ has quit IRC | 16:38 | |
*** tonanhngo has quit IRC | 16:39 | |
sdake | pbourke you were fast on that -2 :) | 16:39 |
*** tonanhngo has joined #openstack-kolla | 16:39 | |
awebber | sdake inc0 based upon our conversation yesterday about integration with ceph hammer i can confirm that external ceph integration works with the master branch. I can successfully launch instances from CEPH and upload images to glance (stored in CEPH). I will test cinder tomorrow. I had to of course make some changes. They can be found here http://pastebin.com/raw/Ut8Mmcq0 | 16:48 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: [wip]Fix Stale namespace removal issue https://review.openstack.org/385559 | 16:48 |
sdake | awebber external ceph hammer that is? | 16:49 |
awebber | sdake ceph version 0.94.3 (95cefea9fd9ab740263bf8bb4796fd864d9afe2b) | 16:50 |
*** tonanhngo has quit IRC | 16:51 | |
*** ssurana has joined #openstack-kolla | 16:52 | |
*** jtriley has quit IRC | 16:52 | |
*** msimonin has quit IRC | 16:53 | |
*** unicell1 has joined #openstack-kolla | 16:54 | |
*** unicell has quit IRC | 16:56 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix Stale namespace removal issue https://review.openstack.org/385559 | 16:57 |
Jeffrey4l_ | hey guys, please review this PS: https://review.openstack.org/#/c/385559/ | 16:58 |
*** ssurana has quit IRC | 16:58 | |
Jeffrey4l_ | i removed lots of /run in some containers. ( i really do not know which specified folder should be use ) | 16:58 |
Jeffrey4l_ | please review it and add some comments. | 16:59 |
*** ssurana has joined #openstack-kolla | 16:59 | |
Jeffrey4l_ | sdake, inc0 pbourke berendt ^^ | 16:59 |
*** egonzalez90 has quit IRC | 17:00 | |
*** zhubingbing has quit IRC | 17:00 | |
*** haplo37_ has quit IRC | 17:02 | |
*** unicell1 has quit IRC | 17:04 | |
inc0 | rhallisey, so whats up with summit? | 17:04 |
*** haplo37_ has joined #openstack-kolla | 17:04 | |
*** unicell has joined #openstack-kolla | 17:04 | |
*** unicell has quit IRC | 17:05 | |
rhallisey | inc0, in the etherpad I'll order them in the times based on what how I think they should be orderd | 17:05 |
sdake | ci at 9am for one thing | 17:05 |
*** shardy has quit IRC | 17:05 | |
inc0 | already switched with osic review | 17:06 |
sdake | nice | 17:06 |
sdake | reset looks good to me | 17:06 |
sdake | inc0 looking at the most recnt schedule, etherpad links are missing for all of the sessions | 17:07 |
inc0 | ah, I forgot to add them, will do it no | 17:08 |
inc0 | w | 17:08 |
berendt | i have to leave for today, see you tomorrow | 17:09 |
rhallisey | inc0, https://etherpad.openstack.org/p/kolla-o-summit-schedule | 17:09 |
rhallisey | something like that | 17:09 |
sdake | inc0 re ta at friday 11:30 - have you synced up with hyakuhei to make sure that time works for the security team? | 17:09 |
rhallisey | that's rough estimate I need to 2x my conflicts | 17:09 |
inc0 | you want documentation as fishbowl? | 17:09 |
sdake | rhallisey thats not how fishbowls work ;) | 17:10 |
inc0 | and roadmap planning for ocata as last session in friday?;) | 17:10 |
*** papacz has quit IRC | 17:10 | |
rhallisey | first on frida | 17:10 |
inc0 | first | 17:10 |
*** awebber has quit IRC | 17:10 | |
inc0 | but I think it should be fb | 17:10 |
rhallisey | which of those slots of FB | 17:11 |
rhallisey | and design session | 17:11 |
inc0 | all 3 in Wed | 17:11 |
inc0 | are FB | 17:11 |
rhallisey | oh | 17:11 |
inc0 | rest are design | 17:11 |
rhallisey | :/ | 17:11 |
rhallisey | well then O road map well have to be on wed | 17:11 |
inc0 | yup | 17:11 |
*** hieulq has quit IRC | 17:12 | |
rhallisey | thursday will be the loaded day | 17:13 |
*** Serlex has quit IRC | 17:13 | |
inc0 | that it will | 17:13 |
rhallisey | that's perfect | 17:13 |
rhallisey | firday everyone is tired | 17:13 |
inc0 | hence relatively easy going sessions there | 17:14 |
rhallisey | ya I live that | 17:14 |
rhallisey | HA at 1:50 | 17:14 |
rhallisey | right after lunch | 17:14 |
rhallisey | inc0, what do you think | 17:15 |
inc0 | rhallisey, double check my changes plz https://wiki.openstack.org/wiki/Design_Summit/Ocata/Etherpads#Kolla | 17:15 |
inc0 | 3rd party plugins will be equally ahrd | 17:15 |
rhallisey | ya I haven't updated that bit yet | 17:15 |
inc0 | I just did | 17:15 |
rhallisey | inc0, ya that will follow HA | 17:15 |
rhallisey | ok | 17:15 |
inc0 | CI is less technical more "stuff we need to do" | 17:16 |
inc0 | and Distro requirements is pure discussion | 17:16 |
rhallisey | inc0, I don't see your changes | 17:16 |
inc0 | I switched sessions in Thu - osic with ci | 17:16 |
rhallisey | inc0, right, 9am is perfect for that | 17:16 |
inc0 | added fishbowl - goals for ocata | 17:17 |
rhallisey | I was thinking about that too, but that session is a big woot | 17:17 |
inc0 | and comunity roadmap planning | 17:17 |
inc0 | good to get us going | 17:17 |
inc0 | a little brag;) | 17:17 |
inc0 | and we need to discuss publishing it | 17:17 |
inc0 | and work with results | 17:18 |
inc0 | we need to parse data before thoi | 17:18 |
inc0 | I'll do it but I would ask others to review results too | 17:18 |
inc0 | I might miss something important | 17:18 |
rhallisey | brb need to grab lunch | 17:19 |
rhallisey | inc0, switch around what you want in the etherpad and we can discuss when I'm back | 17:19 |
inc0 | so this is what I came up with - look at actual sched and wiki | 17:19 |
*** NachoDuck has quit IRC | 17:22 | |
*** neilus has quit IRC | 17:23 | |
*** hrito has quit IRC | 17:23 | |
*** NachoDuck has joined #openstack-kolla | 17:24 | |
*** karlamrhein has quit IRC | 17:24 | |
*** karlamrhein has joined #openstack-kolla | 17:27 | |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adds Fluentd docker image required for kolla-kube https://review.openstack.org/375615 | 17:28 |
*** jtriley has joined #openstack-kolla | 17:28 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix rabbitmq upgrade permission issue https://review.openstack.org/384598 | 17:28 |
*** dwalsh_ has quit IRC | 17:28 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: DO NOT MERGE: TEST MASTER BRANCH https://review.openstack.org/326307 | 17:31 |
sean-k-mooney | on a different topic i was trying to use the source_list overide in the kolla-build.conf | 17:31 |
*** neilus has joined #openstack-kolla | 17:31 | |
sean-k-mooney | looking at the build.py https://github.com/openstack/kolla/blob/master/kolla/image/build.py#L615 it is coping the file to sources.list | 17:32 |
openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adds Fluentd docker image required for kolla-kube https://review.openstack.org/375615 | 17:32 |
sean-k-mooney | but looking at the docker file it is expecting sources.list.{{base_distro}} | 17:32 |
sean-k-mooney | https://github.com/openstack/kolla/blob/master/docker/base/Dockerfile.j2#L217 | 17:32 |
*** unicell has joined #openstack-kolla | 17:32 | |
sean-k-mooney | im going to quickly hack it to confim but i belive the current behavor is broken but i could be doing something wrong | 17:33 |
inc0 | yeah, seems like a bug | 17:33 |
*** papacz has joined #openstack-kolla | 17:33 | |
inc0 | so I was thinking of moking sources.list as j2 tpl | 17:34 |
inc0 | so we can use our override mechanism there too | 17:34 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: DO NOT MERGE: test eth1 https://review.openstack.org/385238 | 17:34 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: DO NOT MERGE: TEST MITAKA BRANCH https://review.openstack.org/299182 | 17:35 |
sean-k-mooney | well that would be resonably easy to do. should i submit a patch to correct the current mismatch in filenames or wait for the template change | 17:35 |
inc0 | submit it plz, this is bug today | 17:35 |
inc0 | we can still merge it | 17:36 |
inc0 | j2 will be ocata thingy | 17:36 |
*** lrensing has joined #openstack-kolla | 17:36 | |
*** jtriley has quit IRC | 17:36 | |
sean-k-mooney | ok ill test locally and push soon. will i mark with trival fix or do you want a bug to tack it? | 17:36 |
inc0 | trivial is ok imho | 17:37 |
sdake | yup ceph still MIA | 17:37 |
sean-k-mooney | sdake: http://eu.ceph.com/ is working | 17:37 |
sean-k-mooney | but ya since you cant overdie the sources.list in the build that dose not help much unless you use the docker custimiations to modify the default sources.list | 17:38 |
*** mag009 has quit IRC | 17:39 | |
sdake | hence why we need mirrors for this stuff in openstack infra ;) | 17:42 |
*** eaguilar has joined #openstack-kolla | 17:42 | |
sean-k-mooney | i was wondering that in the back of my mind so i take it we dont have a ceph mirror in infra | 17:43 |
*** duonghq has quit IRC | 17:43 | |
rhallisey | inc0, where did you make changes? | 17:44 |
rhallisey | don't see them in the etherpad or on wiki | 17:44 |
inc0 | wiki is updated.. | 17:45 |
mewald | Guys, can you please check your keystone.token tables? How big are they? If there is anything more than 0 rows in it, please tell me why we are using sql backend for tokens. | 17:56 |
inc0 | sbezverk_, rhallisey wirehead_ kfox1111 summit k8s talk meeting:) | 18:00 |
*** dwalsh_ has joined #openstack-kolla | 18:02 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Choose node with largest seqno number for mariadb recovery https://review.openstack.org/384247 | 18:02 |
sean-k-mooney | inc0: the issue with the sources list is a little bigger then i taught. | 18:09 |
sean-k-mooney | inc0: it looks like none of the config options that are part of https://github.com/openstack/kolla/blob/master/kolla/common/config.py#L143-L152 are being parsed | 18:09 |
openstackgerrit | Bartłomiej Daca proposed openstack/kolla: Add external rabbitmq https://review.openstack.org/374525 | 18:12 |
*** eaguilar has quit IRC | 18:13 | |
*** satya_ has joined #openstack-kolla | 18:16 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Move graphviz dependency to test stage https://review.openstack.org/385581 | 18:16 |
*** neilus has quit IRC | 18:18 | |
satya_ | I am using template_override method to integrate third party plugin with latest trunk neutron code. I am getting the following error while deploying neutro-server container | 18:18 |
satya_ | ImportError: No module named neutron-master.setup | 18:18 |
satya_ | Did any one get this error? | 18:18 |
sean-k-mooney | does i havent tried that but are you installing neutron as part of your template overide? | 18:19 |
satya_ | yes i am installing third party plugin in neutron-server container | 18:20 |
*** fguillot has joined #openstack-kolla | 18:20 | |
sean-k-mooney | yes but are you installing neurtron as part of the code or jsut the thirdparty plugin. there is no module called neutron-master so im wondering is that coming form your code. | 18:23 |
*** jtriley has joined #openstack-kolla | 18:24 | |
*** lrensing has quit IRC | 18:27 | |
*** msimonin has joined #openstack-kolla | 18:28 | |
satya_ | the third party plugin code is added to the existing neutron-server service | 18:28 |
mewald | is something wrong with gerrit? "git review" just hangs | 18:29 |
satya_ | it can be an issue with third party plugin code also | 18:29 |
*** eaguilar has joined #openstack-kolla | 18:29 | |
openstackgerrit | Mathias proposed openstack/kolla: Use memcache for keystone token persistence https://review.openstack.org/385586 | 18:31 |
*** msimonin has quit IRC | 18:32 | |
*** narasimha_SV has quit IRC | 18:38 | |
sean-k-mooney | Jeffrey4l_: is the kolla-build.conf intended to still be used as https://github.com/openstack/kolla/commit/620d610eaaf03217f3a038c031fe28ce43132166#diff-6c850feeb9eb952c01303c97d6efb343L735 seams to have stoped it working. | 18:39 |
*** neilus has joined #openstack-kolla | 18:39 | |
sean-k-mooney | as far as i can tell on master the kolla-build.conf is not read but i am using it for seting some values such as source or distro type https://github.com/openstack/kolla/blob/078b08acfa0f15aecfbc0619efa1b2f4855c8b40/kolla/image/build.py#L941 | 18:40 |
*** Guest67032 has quit IRC | 18:40 | |
*** kklimonda has joined #openstack-kolla | 18:41 | |
*** HyperJohnGraham_ has joined #openstack-kolla | 18:42 | |
*** lrensing has joined #openstack-kolla | 18:42 | |
*** neilus has quit IRC | 18:44 | |
*** msimonin has joined #openstack-kolla | 18:44 | |
*** tonanhngo has joined #openstack-kolla | 18:46 | |
*** HyperJohnGraham_ has quit IRC | 18:47 | |
*** mewald has quit IRC | 18:48 | |
*** salv-orlando has quit IRC | 18:51 | |
*** mewald has joined #openstack-kolla | 18:51 | |
*** satya_ has quit IRC | 18:56 | |
*** williamcaban has quit IRC | 19:01 | |
*** neilus has joined #openstack-kolla | 19:05 | |
*** msimonin has quit IRC | 19:09 | |
*** neilus has quit IRC | 19:10 | |
*** liyifeng has quit IRC | 19:10 | |
*** liyifeng has joined #openstack-kolla | 19:11 | |
*** pbourke has quit IRC | 19:11 | |
*** pbourke has joined #openstack-kolla | 19:11 | |
*** msimonin has joined #openstack-kolla | 19:18 | |
*** lrensing has quit IRC | 19:19 | |
*** eaguilar has quit IRC | 19:24 | |
openstackgerrit | sean mooney proposed openstack/kolla: read kolla-build.conf by default https://review.openstack.org/385601 | 19:24 |
sean-k-mooney | inc0: Jeffrey4l_ ^ that should fix the sources list issue and also fix reading form the kolla-build.conf in general. | 19:25 |
*** eaguilar has joined #openstack-kolla | 19:26 | |
sdake | sean-k-mooney groan... | 19:29 |
sdake | how important is this change? | 19:30 |
sean-k-mooney | sdake: ill leave that up to us to decide but without it the kolla-build.conf seams to be ignored. | 19:31 |
sean-k-mooney | sdake: as a result if the paramter you want to change is not a commandline option to build.py it cannot be changed. | 19:31 |
sean-k-mooney | sdake: that is basically just https://github.com/openstack/kolla/blob/078b08acfa0f15aecfbc0619efa1b2f4855c8b40/kolla/common/config.py#L143-L152 | 19:31 |
sean-k-mooney | sdake: i belive you can use the template overide to change these now but that would not be an option for mitaka | 19:32 |
sdake | sean-k-mooney i'd feel more comfortable with this change after 3.0.0 in a zstream backport | 19:33 |
sdake | after it has some soak time | 19:33 |
sean-k-mooney | ok though looking at https://github.com/openstack/kolla/blob/078b08acfa0f15aecfbc0619efa1b2f4855c8b40/docker/base/Dockerfile.j2#L212-L218 it would not be that easy to trivaly replace the sources.list with a template overide | 19:34 |
sdake | well we aren't merging in rc2 - i can tell ya that :) | 19:35 |
sdake | if the cores wnt to merge in master and backport we can do that | 19:35 |
sdake | i really don't want to touch build.py :) | 19:35 |
sean-k-mooney | ok that makes sense but i am basically reverting some of Jeffrey4l_ changes he made in https://github.com/openstack/kolla/commit/620d610eaaf03217f3a038c031fe28ce43132166#diff-6c850feeb9eb952c01303c97d6efb343L735 | 19:36 |
sean-k-mooney | sdake: im not really i know i must be missing somethig because i dont know how this could be broken since january and no on noticed. | 19:37 |
sean-k-mooney | s/im not really// | 19:38 |
sdake | ok well if jeffrey acks it that wfm :) | 19:38 |
sdake | but not for rc2 | 19:38 |
sdake | but it does need a bug id to be backported | 19:38 |
sdake | so i'd add that | 19:38 |
sdake | and it has to be critical to be backported | 19:38 |
sdake | this may be critical - not sure | 19:38 |
sean-k-mooney | ok will do. are we still supporting kolla-build.conf by they way? | 19:39 |
*** eaguilar has quit IRC | 19:39 | |
sean-k-mooney | i alway configure my build via /etc/kolla/kolla-build.conf but i cant see how the current code on master reads from it | 19:40 |
sean-k-mooney | at least without the change i proposed. | 19:40 |
*** lrensing has joined #openstack-kolla | 19:40 | |
sean-k-mooney | sdake: ill open a bug for this then in anycase and ill let ye decide if it warrents a backport | 19:41 |
sean-k-mooney | sdake: on the pluse side now that i have this locally i have been able to rebuild my rabbitmq container and at least single node works for me now | 19:42 |
sdake | sean-k-mooney nice! | 19:42 |
*** eaguilar has joined #openstack-kolla | 19:46 | |
*** salv-orlando has joined #openstack-kolla | 19:47 | |
*** jtriley has quit IRC | 19:50 | |
sdake | sean-k-mooney yes kolla-build.conf is a feature | 19:54 |
sdake | sean-k-mooney that is why this may be critical | 19:54 |
sdake | sean-k-mooney i want to give folks an opportunity to test out our rc2 without regressions | 19:54 |
sdake | and any changes to build.py make me super nervous ;) | 19:54 |
sean-k-mooney | yep i understand. i was really happy to c that ctrl-c now kills build.py again | 19:58 |
sean-k-mooney | or rather ctrl-c twice kills it now | 19:58 |
*** msimonin has quit IRC | 20:03 | |
*** msimonin has joined #openstack-kolla | 20:06 | |
*** msimonin has quit IRC | 20:07 | |
*** MarMat_ has joined #openstack-kolla | 20:08 | |
*** MarMat has quit IRC | 20:08 | |
*** sean-k-mooney is now known as sean-k-mooneyAFK | 20:10 | |
wznoinsk | hi, anyone seen this https://bugs.launchpad.net/kolla/+bug/1632840 ? Jeffrey4l_ ? | 20:11 |
openstack | Launchpad bug 1632840 in kolla "ldlinux.c32 File not found in ironic_pxe" [Undecided,New] - Assigned to Waldemar Znoinski (wznoinsk) | 20:11 |
*** msimonin has joined #openstack-kolla | 20:11 | |
*** jtriley has joined #openstack-kolla | 20:12 | |
*** msimonin has quit IRC | 20:16 | |
*** msimonin has joined #openstack-kolla | 20:16 | |
*** eaguilar has quit IRC | 20:18 | |
openstackgerrit | Waldemar Znoinski proposed openstack/kolla: copy ldlinux.c32 to /tftpboot in ironic_pxe https://review.openstack.org/385612 | 20:22 |
*** eaguilar has joined #openstack-kolla | 20:28 | |
*** eaguilar has quit IRC | 20:32 | |
*** lrensing has left #openstack-kolla | 20:32 | |
openstackgerrit | Waldemar Znoinski proposed openstack/kolla: setting basic structures for iscsi container https://review.openstack.org/381942 | 20:38 |
*** salv-orl_ has joined #openstack-kolla | 20:43 | |
*** salv-orlando has quit IRC | 20:46 | |
*** awebber has joined #openstack-kolla | 20:57 | |
*** rhallisey has quit IRC | 20:57 | |
*** jtriley has quit IRC | 20:58 | |
*** jtriley has joined #openstack-kolla | 21:06 | |
*** salv-orl_ has quit IRC | 21:07 | |
*** jtriley has quit IRC | 21:10 | |
*** mark-casey11 has joined #openstack-kolla | 21:12 | |
*** janem_ has joined #openstack-kolla | 21:13 | |
*** salv-orlando has joined #openstack-kolla | 21:13 | |
*** rbbratta has quit IRC | 21:15 | |
*** rbbratta has joined #openstack-kolla | 21:15 | |
*** zigo_ has joined #openstack-kolla | 21:17 | |
*** irtermit- has joined #openstack-kolla | 21:18 | |
*** haplo37- has joined #openstack-kolla | 21:18 | |
*** hieulq__ has joined #openstack-kolla | 21:18 | |
*** dwalsh_ has quit IRC | 21:19 | |
*** athomas has quit IRC | 21:19 | |
*** janem has quit IRC | 21:19 | |
*** bachp has quit IRC | 21:19 | |
*** mark-casey1 has quit IRC | 21:19 | |
*** haplo37 has quit IRC | 21:19 | |
*** jheroux has quit IRC | 21:19 | |
*** zigo has quit IRC | 21:19 | |
*** irtermite has quit IRC | 21:19 | |
*** hyakuhei has quit IRC | 21:19 | |
*** haplo37- is now known as haplo37 | 21:19 | |
*** jmccarthy1 has joined #openstack-kolla | 21:19 | |
*** awebber_ has joined #openstack-kolla | 21:20 | |
*** hyakuhei- has joined #openstack-kolla | 21:20 | |
*** mark-casey11 has quit IRC | 21:20 | |
*** janem_ has quit IRC | 21:20 | |
*** hieulq_ has quit IRC | 21:20 | |
*** jmccarthy has quit IRC | 21:20 | |
*** awebber has quit IRC | 21:20 | |
*** liyifeng has quit IRC | 21:21 | |
*** liyifeng has joined #openstack-kolla | 21:21 | |
*** gfidente has quit IRC | 21:21 | |
MarMat_ | sean-k-mooney not sure whether i'm following what you mean but there is --config-file PATH param for build.py, doesn't this solve what you need? | 21:22 |
*** hyakuhei- has quit IRC | 21:23 | |
*** wirehead_ has quit IRC | 21:23 | |
*** macsz has quit IRC | 21:23 | |
*** jidar has quit IRC | 21:23 | |
*** awebber_ has quit IRC | 21:23 | |
*** dave-mccowan has quit IRC | 21:24 | |
*** athomas has joined #openstack-kolla | 21:25 | |
*** bachp has joined #openstack-kolla | 21:25 | |
*** hyakuhei- has joined #openstack-kolla | 21:28 | |
*** wirehead_ has joined #openstack-kolla | 21:28 | |
*** macsz has joined #openstack-kolla | 21:28 | |
*** jidar has joined #openstack-kolla | 21:28 | |
*** macsz has quit IRC | 21:28 | |
*** zigo_ is now known as zigo | 21:28 | |
*** macsz has joined #openstack-kolla | 21:33 | |
*** Jeffrey4l__ has joined #openstack-kolla | 21:34 | |
*** Jeffrey4l_ has quit IRC | 21:35 | |
*** macsz is now known as macsz_ | 21:37 | |
*** portdirect has joined #openstack-kolla | 21:39 | |
*** inc0 has quit IRC | 21:46 | |
*** neilus has joined #openstack-kolla | 21:55 | |
*** neilus has quit IRC | 22:00 | |
*** fguillot has quit IRC | 22:05 | |
*** mtaylor22 has joined #openstack-kolla | 22:10 | |
mtaylor22 | Jeffrey4l__: good find man | 22:10 |
mtaylor22 | re: RTNETLINK isue | 22:10 |
mtaylor22 | :) | 22:11 |
*** vhosakot has quit IRC | 22:17 | |
*** eaguilar has joined #openstack-kolla | 22:18 | |
*** unicell has quit IRC | 22:20 | |
*** lamt has quit IRC | 22:22 | |
*** papacz has quit IRC | 22:23 | |
*** mgoddard has quit IRC | 22:25 | |
*** HyperJohnGraham_ has joined #openstack-kolla | 22:27 | |
*** mewald has quit IRC | 22:28 | |
*** msimonin has quit IRC | 22:30 | |
*** salv-orlando has quit IRC | 22:30 | |
sdake | where is the summit etherpad schedule | 22:32 |
*** HyperJohnGraham_ has quit IRC | 22:34 | |
*** HyperJohnGraham_ has joined #openstack-kolla | 22:40 | |
Pavo | evening peeps | 22:54 |
Pavo | wanna see my new toy I got today? | 22:54 |
harlowja | adult-safe? | 22:55 |
harlowja | sfw? | 22:55 |
harlowja | lol | 22:55 |
Pavo | ofc | 22:55 |
Pavo | https://www.dropbox.com/s/l3fow3upj53qg85/49800443060__3B9B4073-C938-40E6-9616-1DBBD7739AA5.JPG?dl=0 | 22:55 |
*** athomas has quit IRC | 22:55 | |
harlowja | lol | 22:55 |
harlowja | nice | 22:55 |
Pavo | yeah 2 HP Proliant DL560 with 4x Intel® Xeon® E5-4657L v2, 32Tb storage, 384Gb RAM, Cisco 3650 switch and Cisco 4300 ISR Router and Gigaview tap | 22:56 |
Pavo | this is what I brought home from work to work on Kolla with | 22:58 |
*** kproskurin_ has quit IRC | 23:01 | |
*** HyperJohnGraham_ has quit IRC | 23:08 | |
mtaylor22 | harlowja: looks tasty. | 23:13 |
mtaylor22 | i mean, Pavo | 23:13 |
Pavo | yeah its a beast | 23:13 |
sdake | wznoinsk triaged | 23:17 |
sdake | wznoinsk nobody has really got ironic working yet | 23:17 |
sdake | harlowja could you do me a favor (code review) | 23:17 |
harlowja | sureee | 23:18 |
harlowja | i do all the favors | 23:18 |
sdake | harlowja be careful with that, i've got a smuggling gig going on too :) | 23:18 |
harlowja | only 1 smuggle per day | 23:18 |
sdake | https://review.openstack.org/#/c/385601/ | 23:19 |
sdake | harlowja if you could follow it to conclusion (merge) would be appreciated :) | 23:19 |
sdake | really don't want to change anything in build.py | 23:19 |
sdake | pavo did your gig pay for that or did you? | 23:20 |
Pavo | ofc gig, I can't afford this shit | 23:21 |
Pavo | lol | 23:21 |
Pavo | opps mybad | 23:21 |
Pavo | sry language | 23:21 |
sdake | any idea what the sticker price was (if thats not confidential) | 23:21 |
sdake | pavo it happens | 23:21 |
Pavo | close to $250K | 23:21 |
sdake | yikes | 23:21 |
Pavo | yeah I am stoked | 23:22 |
Pavo | 192 cpus, 32Tb SAS SSDs, 386GB ram | 23:22 |
Pavo | combined ofc | 23:22 |
sdake | i've got a 10 node cluster at work with 256 ram per and 24 disks and whatnot | 23:23 |
Pavo | gonna use it to continue our development with packstack and also get kolla for prime time | 23:24 |
Pavo | nice | 23:24 |
sdake | two ask9k switches in redundancy mode | 23:24 |
*** zhurong has joined #openstack-kolla | 23:24 | |
jascott1 | hmm kolla-ansible deploy is crashing out during 'starting heka container' and I can see that its trying to hit my local registry Get https://10.64.142.93:4000/v1/_ping | 23:26 |
jascott1 | but im not running https on my registry | 23:27 |
*** HyperJohnGraham_ has joined #openstack-kolla | 23:28 | |
jascott1 | is there a place to tell kolla-ansible deploy to use http? | 23:29 |
jascott1 | or is https registry required? | 23:29 |
jascott1 | idk if it matters but I am running registry v2 which I assume is backwards compatible | 23:30 |
Pavo | https registry is for runing a secure registry which uses certs | 23:32 |
Pavo | the certs need to be on all nodes | 23:32 |
jascott1 | Pavo so running local registry w https is required you are saying? | 23:34 |
Pavo | afaik it is with kolla but I could be wrong | 23:34 |
jascott1 | or rather 'if you run a local registry it must use https' | 23:34 |
jascott1 | i get all the cert requirements (I was trying to avoid it all for what I am doing) | 23:34 |
Pavo | you can run a unsecure registry | 23:34 |
sbezverk_ | jascott1: you should probably check you docker configuration | 23:35 |
Pavo | but I don't know if kolla will use a unsecure registry | 23:35 |
sbezverk_ | for registry | 23:35 |
*** HyperJohnGraham_ has quit IRC | 23:35 | |
jascott1 | i have the insecure flag for the daemon | 23:35 |
sbezverk_ | other_args="--insecure-registry 192.168.80.240:4000" | 23:35 |
jascott1 | i have pushed images alreay so I know docker and local registry are jiving | 23:36 |
jascott1 | pushed images via kolla-build | 23:36 |
*** zhurong has quit IRC | 23:37 | |
jascott1 | its seems like kolla-ansible deploy is either hard coded to https or I missed a config option | 23:37 |
*** HyperJohnGraham_ has joined #openstack-kolla | 23:38 | |
Pavo | kolla-build only builds images, didn't think it pushed them | 23:38 |
jascott1 | it does with --push and --registry flag | 23:38 |
sbezverk_ | jascott1: I do not think deploy directly pulls images, everything is done via docker interface | 23:38 |
sbezverk_ | can you paste the error you are seeing? | 23:38 |
sbezverk_ | also when you start deploy please use -vvvv | 23:39 |
sbezverk_ | for more logs | 23:39 |
jascott1 | TASK [common : Starting heka container] | 23:39 |
jascott1 | APIError: 500 Server Error: Internal Server Error (\"{\"message\":\"Get https://10.64.142.93:4000/v1/_ping: EOF | 23:39 |
jascott1 | there is no https on my registry | 23:40 |
sbezverk_ | jascott1: use paste bin | 23:40 |
jascott1 | oops sorry | 23:40 |
jascott1 | that was it tho | 23:40 |
sdake | jascott1 a tls enabled registry is not required | 23:40 |
jascott1 | sdake ok thanks | 23:40 |
sdake | pavo kolla-ansible --push ;-) | 23:41 |
Pavo | yeah thats what I thought, not kolla-build | 23:41 |
sdake | jascott1 please run ps -ef |grep kolla | 23:41 |
sdake | pavo sorry kolla-build --push --registry will getyou there | 23:41 |
sdake | not kolla-ansible... | 23:41 |
Pavo | yeah but not by default | 23:41 |
Pavo | you have to push the images yourself | 23:42 |
sdake | jascott1 please run ps -ef | grep docker | 23:42 |
sdake | pavo kollab-uild will build all images it pushes if you specify those two flags with correct options | 23:42 |
sdake | e.g. kolla-build --registry 192.168.1.103:4000 --push is what I use for centos rdo | 23:42 |
jascott1 | sdake /usr/bin/dockerd --dns 8.8.8.8 --dns 8.8.4.4 --insecure-registry 10.64.142.93:4000 --raw-logs | 23:42 |
sdake | jascott1 kolla-build and kolla itself use different mechanisms for communicating with docker registry | 23:43 |
sdake | jascott1 looksgood | 23:43 |
sdake | jascott1 - ok paste globals.yml pls | 23:43 |
Pavo | yeah I understand that, I was just saying to jascott1 that it doesn't push images to your local registry on building unless you tell it to | 23:43 |
sdake | pavo good point - jascott1 did you use the --push option? | 23:43 |
sdake | jascott1 run docker ps -a | grep registry pls | 23:43 |
jascott1 | i did use the push option | 23:44 |
jascott1 | globals http://paste.openstack.org/show/585521/ | 23:44 |
sdake | ceph.com is back | 23:44 |
jascott1 | yay! | 23:44 |
jascott1 | i changed a couple params to eu.ceph.com earlier and it worked but glad to hear | 23:45 |
jascott1 | rough days at dreamhost :/ | 23:45 |
sdake | jascott1 run docker --version pls | 23:45 |
sdake | and docker ps -a | grep registry | 23:46 |
jascott1 | sdake registry line: 3d7fdc60fa3d registry:2 "/entrypoint.sh /etc/" 2 days ago Up 23 minutes 0.0.0.0:4000->5000/tcp registry | 23:46 |
sdake | jascott1 that looks good | 23:46 |
jascott1 | Docker version 1.12.1, build 23cf638 | 23:46 |
jascott1 | :D | 23:46 |
sdake | ok - 1.12.1 | 23:46 |
sdake | this is bleeding edge | 23:46 |
sdake | can you downgrade your version of docker? | 23:46 |
jascott1 | its stable release afaik but yes I can try that | 23:47 |
jascott1 | what ver? | 23:47 |
sdake | moment before we go down that rabbit hole | 23:47 |
sdake | pip show jinja2 | 23:47 |
sdake | and pip show kolla | 23:47 |
sdake | and pip show ansible | 23:47 |
jascott1 | jinja2 is 2.8 | 23:47 |
jascott1 | kolla is 3.0.0.0rc2.dev300 | 23:48 |
sdake | good | 23:48 |
jascott1 | ansible is 2.1.2.0 | 23:48 |
sdake | jascott1 when you work with master you should not pip install | 23:48 |
sdake | latest version we have tested with ansible is 2.1.1.0 | 23:48 |
jascott1 | ooohh | 23:48 |
sdake | lets solve one problem at a time | 23:48 |
sdake | first pip remove kolla | 23:48 |
Pavo | 4000:5000 sure thats tls? | 23:49 |
jascott1 | it is not tls | 23:49 |
jascott1 | Im not running tls | 23:49 |
sdake | pavo that maps port 4000 outside to 5000 in the registry container | 23:49 |
Pavo | ah yeah thats right you using non secure registry mybad | 23:49 |
Pavo | little lit right now | 23:49 |
sdake | ya i'm beat myself :) | 23:49 |
Pavo | not beat, getting drunk lol | 23:49 |
Pavo | and setting servers up at the same time | 23:50 |
Pavo | probably bad idea | 23:50 |
Pavo | lol | 23:50 |
sdake | i work from home so dont drink where i work ;) | 23:50 |
jascott1 | oh noes! | 23:50 |
jascott1 | no drinking at home? | 23:50 |
Pavo | oh btw my surgery went well | 23:50 |
jascott1 | sorry | 23:50 |
jascott1 | glad to hear | 23:50 |
sdake | i make up for it on the road ;-) | 23:50 |
Pavo | almost fully recovered | 23:50 |
jascott1 | haha | 23:50 |
jascott1 | pip uninstall kolla - no files were found to uninstall | 23:51 |
Pavo | did you install kolla from git? | 23:51 |
sdake | how did you pip install kolla | 23:51 |
jascott1 | dev isntall from the docs | 23:51 |
Pavo | oh btw wanted to ask, anyone here a jenkins expert? | 23:52 |
jascott1 | looking | 23:52 |
jascott1 | sudo pip install --editable . | 23:53 |
jascott1 | iirc thats what I did from here http://docs.openstack.org/developer/kolla-kubernetes/host-setup.html | 23:53 |
jascott1 | "Development Install" | 23:53 |
Pavo | --editable is an option not a package | 23:54 |
jascott1 | . is local dir | 23:54 |
jascott1 | sdake did you want me to downgrade something? | 23:55 |
sdake | jascott1 not yet | 23:56 |
sdake | jascott1 are you trying to install kolla-kubernetes? | 23:56 |
sdake | or kolla | 23:56 |
jascott1 | kolla-kubernetes | 23:56 |
jascott1 | my ultimate goal is to help with the ansible workflows | 23:57 |
jascott1 | but I am still trying to get multinode k8s with kolla-kuberenetes going | 23:57 |
sdake | jascott1 i can't help wit hthe -e option on the pip install | 23:58 |
sdake | jascott1 that doesn't jive with my understanding of how things should be working | 23:58 |
sdake | jascott1 fwiw kfox1111 who wrote those directions deploys 2.0.2 images from the docker hub | 23:58 |
sdake | rhallisey sbezverk_ or kfox1111 can help you get going though | 23:58 |
jascott1 | i really appreciate the pointers | 23:58 |
sdake | jascott1 what i would recommend for now is not using a registry at all | 23:59 |
sdake | and use the 2.0.2 images | 23:59 |
sdake | and follow the rest of the kolla-kubernetes directions | 23:59 |
sdake | (from docker hub) | 23:59 |
sdake | to do that, comment out the registry line | 23:59 |
sdake | then the docker images will automatically come from the hub | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!