| *** unicell has joined #openstack-kolla | 00:02 | |
| *** unicell has quit IRC | 00:06 | |
| *** unicell has joined #openstack-kolla | 00:07 | |
| klindgren_ | sdake_, ping? | 00:10 |
|---|---|---|
| *** klindgren_ is now known as klindgren | 00:10 | |
| *** sdake_ is now known as sdake | 00:10 | |
| *** huzhengchuan has joined #openstack-kolla | 00:10 | |
| sdake | wound me | 00:10 |
| klindgren | On the kolla containers, why not make it so where every container is started the exact same way? | 00:10 |
| sdake | klindgren could you provide an example where that is not hte case | 00:11 |
| klindgren | So you have to pass in the command to run in the config.json | 00:11 |
| klindgren | to start the container | 00:11 |
| *** salv-orlando has quit IRC | 00:11 | |
| klindgren | IE keystone is: "command": "/usr/sbin/{{ keystone_cmd }}", | 00:11 |
| sdake | right - so that json is the API - each container started in a standard way? | 00:12 |
| klindgren | why not encapsulate the starting shenanigans in the container and just have it be kolla-start? or something similar? | 00:12 |
| klindgren | that way we dont have to know whats running in the container to start it, everything gets called by the same "kolla_container_start_command" which takes care of the real command needed. | 00:13 |
| sdake | klindgren sounds like a good topic for tomorrow's meeting at 16:00 UTC | 00:13 |
| harlowja | sdake niceee move there ;) | 00:13 |
| harlowja | :) | 00:13 |
| sdake | harlowja how do you mean? | 00:14 |
| sdake | harlowja i can't unilaterally make that decision for the rest of the community | 00:14 |
| harlowja | no i know | 00:14 |
| harlowja | nm, i was sorta joking, lol | 00:14 |
| harlowja | joke fail | 00:15 |
| harlowja | lol | 00:15 |
| * harlowja runs away | 00:15 | |
| klindgren | sorry - I was asking you because I assumed that some discussion had happened around that. | 00:15 |
| klindgren | but I coudn't find any in my brief searching | 00:16 |
| kfox1111 | klindgren: sometimes you may need to override the settings passed to the command. | 00:19 |
| klindgren | kfox1111, can you give an example where you would want a container to start with different options thats those were done at container build time? | 00:20 |
| klindgren | I assume this could also be where if command exists in config do that, otherwise do y by default. | 00:21 |
| kfox1111 | klindgren: the tgtd container for example has a listen address in its commandline. | 00:21 |
| *** yingjun has joined #openstack-kolla | 00:22 | |
| kfox1111 | its configured in /etc/kolla/global.yaml and generated into tgtd's config.json. | 00:22 |
| kfox1111 | so, its really a config thing. | 00:22 |
| kfox1111 | yeah, the config.json stuff could be done as a default if not passed. but wasn't done that way. not sure why. | 00:23 |
| *** saneax-_-|AFK is now known as saneax | 00:24 | |
| klindgren | also - one more question. How does one handle starting two different containers say glance-api and glance-registry. Using the same config directory and different command-varriables in config.json? | 00:25 |
| klindgren | in a manner that wont die in a fire when parrallelism is applied. | 00:26 |
| *** Pavo has joined #openstack-kolla | 00:27 | |
| klindgren | Or nova-scheduler, nova-conductor? | 00:27 |
| sdake | kfox1111 the reason it wasn't donew that way was to provide flexibility and reduce duplication | 00:27 |
| sdake | klindgren i understand your question - in k8s we use an emptyDir construct which is a per pod temp dir | 00:28 |
| sdake | klindgren in ansible on bare metal there is no such thing available | 00:28 |
| sdake | klindgren i think the emptydir construct could be simulated fairly easily however | 00:29 |
| klindgren | I mean I could generate a set of configs per service, instead of having everything pointing at /etc/glance/ | 00:29 |
| klindgren | but that seams.... rough. | 00:29 |
| sdake | klindgren right bare metal comes with a different set of challenges especially for large scale operator environments that you have | 00:30 |
| sdake | klindgren if Jeffrey4l is around perhaps he has a clever idea for ya :) | 00:30 |
| harlowja | sdake u are using k8s now to :) | 00:31 |
| * harlowja didn't know u were on that train | 00:31 | |
| klindgren | I assume that if I pass the command option in via docker - that is going to cause the the container to not run the kolla-start stuff? | 00:32 |
| klindgren | on startup | 00:32 |
| sdake | harlowja my goal is to get kolla-kubernetes into the same level of completeness as kolla-ansible | 00:34 |
| harlowja | cool | 00:34 |
| sdake | harlowja gotta dream big ;-) | 00:34 |
| sdake | harlowja YOLO and al lthat | 00:34 |
| harlowja | ya, fair | 00:34 |
| sdake | harlowja we have a solid team to deliver all of our deliverables and inc0 is on board with leading us to victory :) | 00:35 |
| harlowja | lol | 00:35 |
| harlowja | nice | 00:35 |
| *** adrian_otto has joined #openstack-kolla | 00:38 | |
| kfox1111 | klindgren: correct. when I override command I end up calling kolla_start at the end. | 00:38 |
| openstackgerrit | Borne Mace proposed openstack/kolla-kubernetes master: WIP: Added support for containerized dev bringup https://review.openstack.org/429295 | 00:39 |
| klindgren | kfox1111, how do you do that? | 00:40 |
| *** david-lyle has quit IRC | 00:42 | |
| bmace_ | sdake: almost there. made a bunch of changes to ceph_workflow_service but there are some odd bits in there, like i think the keystone stuff is getting the wrong admin address for remote calls and i dropped out of my container by mistake so need to test out some of the other wait areas. will hopefully finish it tomorrow and put a doc page together w/ the review and take out of WIP mode. | 00:43 |
| bmace_ | sdake: i'll let you know when it is ready to try end to end. | 00:44 |
| *** tovin07 has joined #openstack-kolla | 00:49 | |
| openstackgerrit | Duong Ha-Quang proposed openstack/kolla-ansible master: Change Barbican default secret store to pkcs11 https://review.openstack.org/430137 | 00:50 |
| *** zhurong has joined #openstack-kolla | 00:51 | |
| sdake | bmace_ its not the wrong admin address - the admin address is not exposed | 00:54 |
| sdake | bmace_ sounds good duede ;) | 00:54 |
| bmace_ | the keystone admin address is exposed in the default setup.. if it isn't exposed how else is a remote host (the dev container) supposed to talk to it? | 00:54 |
| sdake | bmace_ have no idea - its not exposed in the defualt setup - i can gaurantee you | 00:54 |
| bmace_ | sdake: well, i didn't change that setting, just ran it, and kubectl get services -a --namespace kolla shows the exposed ip / port, and i was able to hit it. | 00:55 |
| sdake | bmace_ the problem with that setup is that the cloud cannot be bootstrapped (e.g. images loaded, networks created, flavors created, etc) | 00:55 |
| sdake | it shows a port of 35357? | 00:55 |
| bmace_ | yup | 00:55 |
| sdake | wierd, I had to change it in my setup to enable the port | 00:55 |
| sdake | maybe someone changed the default after my compalining :) | 00:56 |
| *** sharon_so has left #openstack-kolla | 00:56 | |
| sdake | btw as a shortcut you can to -n kolla | 00:56 |
| sdake | to cut down on typing ;) | 00:56 |
| sdake | to/do | 00:56 |
| *** tonanhngo has quit IRC | 00:57 | |
| bmace_ | sdake: i do need to set up some aliases too, i think mark does kk to kubectl -n kolla so you can just like kk get services, etc.. | 00:57 |
| SamYaple | klindgren: thats actually the opposite approach to the direction things should be going (RE: bake in the start command) | 00:59 |
| SamYaple | klindgren: the startup scripts and things are best moved out of the containers and into the deployment tools now. each deployment tool will need those start commands to be slightly different | 00:59 |
| *** cuongnv has joined #openstack-kolla | 01:00 | |
| SamYaple | additionally, it makes testing much more difficult if you need to change any command, you have to post a review in kolla, then make sure kolla-ansible and kolla-kubernetes (and kolla-*) work still. that doesnt account for any other project that might use the kolla images (official or not) | 01:00 |
| klindgren | SamYaple, can you explain the philosophy behind that statement? It seems like the containers should have the ability to stand on their own? | 01:01 |
| SamYaple | klindgren: as a statement about containers themselves, i tend to agree. that said, the "stand on thier own" part in _most_ contaienrs requires ENV vars to function properly | 01:02 |
| SamYaple | something kolla doesnt do (for a long list of reasons) | 01:02 |
| klindgren | if I am deploying keystone - which now has to be fronted by something running wsgi instead of event let. Should I have to know that the command to make that container work is /usr/sbin/httpd assuming the container was built via centos? | 01:02 |
| SamYaple | klindgren: the deployment tool needs to know this. yea | 01:03 |
| *** zhubingbing_ has joined #openstack-kolla | 01:03 | |
| klindgren | but both the deployment tool and the container creation tool need to know this, seems like its duplicated information? | 01:03 |
| SamYaple | so the part you are leaving out is config. | 01:03 |
| SamYaple | how do you get the config in there? | 01:03 |
| klindgren | volume mount? | 01:03 |
| SamYaple | ok. what reads that? | 01:03 |
| SamYaple | where do you mount it? | 01:03 |
| SamYaple | what format should it be in? | 01:04 |
| *** david-lyle has joined #openstack-kolla | 01:04 | |
| SamYaple | we dont bind host directly to container, /etc/keystone/keystone.conf:/etc/keystone/keystone.conf isnt bound that way | 01:04 |
| SamYaple | the entrypoint is going to be a bit of duplication anywhere. what ENV vars do you need to set? any other params? | 01:05 |
| openstackgerrit | Anh Tran proposed openstack/kolla master: Typo fix: serivce => service https://review.openstack.org/429529 | 01:06 |
| SamYaple | its really a tricky thing. so the mariadb:10.1 image upstream docker has enough for a _basic_ database. setup a user, database, permissions, and thats about it | 01:06 |
| SamYaple | enough to hook into for the lifecycle of the container | 01:07 |
| SamYaple | past that, it is recommened you override... the entrypoint script! | 01:07 |
| klindgren | I am not exactly sure what you are getting at? The service it self dictates where config files needs to be mounted. For most openstack services they all take the exact same startup commands. | 01:07 |
| SamYaple | and kolla is "past that" | 01:07 |
| SamYaple | klindgren: what paramaters do you hard code for neutron? | 01:08 |
| SamYaple | ml2_conf.ini or openvswitch.ini? | 01:08 |
| SamYaple | or brocade.ini? | 01:08 |
| SamYaple | which one are you hard coding? | 01:08 |
| klindgren | meh thats the easy part. plugin.ini symlinked to whatever ml2 plugin you want | 01:08 |
| SamYaple | what sets up that symlink? | 01:09 |
| *** duonghq has joined #openstack-kolla | 01:09 | |
| duonghq | morning guys | 01:09 |
| klindgren | you do in the external config? | 01:09 |
| klindgren | just like how I did it before I had kolla or any containers | 01:09 |
| SamYaple | so you have to know about the internal workings of the container to put in the config, no? | 01:09 |
| klindgren | You are blowing this way out of proportion. lets change this around a little bit. I take a distro say centos and install rdo on it | 01:10 |
| klindgren | I start the glacne stuff via systemctl start glance. | 01:10 |
| klindgren | I dont haveto know all this extra stuff. the specific are in the init script | 01:10 |
| klindgren | and each service has its own | 01:10 |
| klindgren | instead a single common file that I needed to overide the "start command" in | 01:11 |
| SamYaple | you do absolutely need ot know things. you have to configure glance | 01:11 |
| klindgren | before I start the serivce | 01:11 |
| klindgren | *starting* glance is complelty different from configuring glance to work the way I want it to in my env. | 01:11 |
| SamYaple | its not in docker thoguh, because no configuring can be done before you _start_ the contaienr | 01:12 |
| SamYaple | container starts and it must do some initial prep, including move config files into place and set proper permissions | 01:12 |
| klindgren | I dont see what running something in docker vs's running it as a baremetal service actually changes anything? | 01:14 |
| *** hfu has quit IRC | 01:14 | |
| klindgren | I mean the way things are setup right now its impossible for me to paralelize start multiple services of the same type at the same time, because the start command comes from config.json | 01:15 |
| klindgren | where it seems like aside from a few services, the start command is fairly well known | 01:15 |
| klindgren | those services typically being system services where you are controlling the bind ip's/ports via command line options. | 01:16 |
| kfox1111 | klindgren: we start kolla-kubernetes in parallel. | 01:16 |
| SamYaple | klindgren: can you give an example of what you are doing? | 01:16 |
| kfox1111 | config.json comes from a configmap. | 01:16 |
| klindgren | SamYaple, start on the same host at the same time glance-api and glance-registry | 01:16 |
| *** Pavo has quit IRC | 01:17 | |
| SamYaple | the container creation and configuration has to occur. what does that? | 01:17 |
| klindgren | or nova-api and nova-scheduler and nova-cells and nova-conductor | 01:17 |
| kfox1111 | klindgren: just use a different config.json for each. | 01:17 |
| kfox1111 | the files don't have to be the same filename. | 01:17 |
| *** tonanhngo has joined #openstack-kolla | 01:17 | |
| klindgren | kfox1111, how on baremetal? | 01:17 |
| SamYaple | klindgren: what do you mean how? | 01:17 |
| klindgren | doesn;t kolla expect config.json as the entry point? | 01:18 |
| kfox1111 | how are you trying to start them. with docker run? | 01:18 |
| klindgren | roughly via docker run - but jsut using the native ansible tooling | 01:18 |
| kfox1111 | ah. | 01:18 |
| klindgren | roughly via docker run - but jsut using the native ansible docker tooling | 01:18 |
| klindgren | docker_container | 01:18 |
| kfox1111 | so, normlally, the configs for a container are in /etc/kolla/<containername>/* | 01:18 |
| klindgren | right but I am trying to retrofit kolla into an existing baremetal environment | 01:19 |
| klindgren | where openstack had them under /etc/service/ | 01:19 |
| klindgren | /etc/<service>/ rather | 01:19 |
| SamYaple | ah i see klindgren. i think i may be the only person thats done a conversion like that | 01:19 |
| kfox1111 | and its done with an eqiv of docker run -it .... -v /etc/kolla/<containername>:/var/lib/kolla/config | 01:20 |
| kfox1111 | SamYaple: I've done the same. | 01:20 |
| SamYaple | so a big problem youll find there is permissions. but now that kolla has static uid/guid you can actually get the correct permissions going and bind from host to contaienr | 01:20 |
| SamYaple | and bypass the config.json config file copying | 01:20 |
| kfox1111 | klindgren: the trick is to make each container get its own subdir, then copy the config's from /etc/<service>/ to /etc/kolla/containername/ | 01:21 |
| SamYaple | yea thats the thing you dont have to do with a baremetal converstion unless you are trying to migrate _to_ kolla-ansible | 01:21 |
| *** tonanhngo has quit IRC | 01:22 | |
| klindgren | yea - we are bascially building our own kolla_ansible but we actually want to make use of copy_once | 01:22 |
| harlowja | ^ with plans to show it to people to sorta work it through the system ;) | 01:22 |
| harlowja | because its approach is slightly different | 01:22 |
| SamYaple | i submitted a talk about that this cycle | 01:23 |
| harlowja | (the upstream system == system) | 01:23 |
| SamYaple | anyway, im sure kfox1111 is willing to walk you though it | 01:23 |
| klindgren | I was thinking about doing something like: - /etc/keystone/kolla/keystone.kolla:/var/lib/koll/config_files/config.json | 01:23 |
| klindgren | as a volume mount | 01:23 |
| *** sdake has quit IRC | 01:24 | |
| klindgren | but the other part of me said - that for those services where you didn't need to change startup options. Having it default to the correct "command" for the container would be a pretty simple optimization | 01:24 |
| *** crushil has quit IRC | 01:26 | |
| klindgren | seems like doing something like the above will work out what I need it to. That why I don't have to make our current config management system output that same files multiples times. | 01:33 |
| klindgren | s/why/way | 01:33 |
| kfox1111 | could always submit a patch to add the default config's to kolla containers and see if it would fly. | 01:46 |
| kfox1111 | you loose backwards compatability though. | 01:46 |
| kfox1111 | so probably won't be able to use containers that way before pike. | 01:46 |
| klindgren | yea - I will plan on doing that. | 01:47 |
| *** jemcevoy has quit IRC | 01:47 | |
| *** ipsecguy has quit IRC | 01:51 | |
| *** ipsecguy has joined #openstack-kolla | 01:51 | |
| *** MasterOfBugs has quit IRC | 01:57 | |
| *** adrian_otto has quit IRC | 02:04 | |
| sbezverk | kfox1111: hey, when you have a chance please check this ps, it is still wip but I would like to know what you think. https://review.openstack.org/#/c/428150/50 | 02:08 |
| *** unicell has quit IRC | 02:09 | |
| *** caowei has joined #openstack-kolla | 02:09 | |
| *** saneax is now known as saneax-_-|AFK | 02:10 | |
| *** sayantani01 has joined #openstack-kolla | 02:11 | |
| *** sayantani01 has quit IRC | 02:16 | |
| *** sayantani01 has joined #openstack-kolla | 02:16 | |
| *** japestinho has joined #openstack-kolla | 02:17 | |
| *** Pavo has joined #openstack-kolla | 02:25 | |
| *** adrian_otto has joined #openstack-kolla | 02:27 | |
| openstackgerrit | Borne Mace proposed openstack/kolla-kubernetes master: WIP: Added support for containerized dev bringup https://review.openstack.org/429295 | 02:29 |
| *** sacharya_ has joined #openstack-kolla | 02:34 | |
| *** sacharya has quit IRC | 02:36 | |
| *** fragatin_ has joined #openstack-kolla | 02:37 | |
| *** Pavo has quit IRC | 02:38 | |
| *** crushil has joined #openstack-kolla | 02:38 | |
| *** fragatina has quit IRC | 02:40 | |
| *** krtaylor has joined #openstack-kolla | 02:40 | |
| *** sdake has joined #openstack-kolla | 02:41 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Do not check security opt in some case in kolla_docker module https://review.openstack.org/429459 | 02:46 |
| *** zhurong has quit IRC | 02:51 | |
| *** rwallner has joined #openstack-kolla | 02:54 | |
| *** rwallner has quit IRC | 02:58 | |
| *** sdake has quit IRC | 03:01 | |
| *** sdake has joined #openstack-kolla | 03:01 | |
| *** sudipto_ has joined #openstack-kolla | 03:03 | |
| *** sudipto has joined #openstack-kolla | 03:03 | |
| openstackgerrit | Cao Xuan Hoang proposed openstack/kolla-ansible master: Remove support for py34 https://review.openstack.org/430525 | 03:07 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [wip] test scenario2 in gate https://review.openstack.org/412279 | 03:08 |
| zhubingbing_ | hello guys | 03:10 |
| sdake | sup zhenguo | 03:18 |
| zhenguo | sdake: hi | 03:19 |
| sdake | sup zhenguo :) | 03:20 |
| *** fragatin_ has quit IRC | 03:21 | |
| sdake | also hello zhubingbing_ :) | 03:21 |
| zhubingbing_ | hi sdake | 03:21 |
| zhubingbing_ | i have a question about kolla-k8s | 03:21 |
| sdake | shoot | 03:21 |
| *** sayantani01 has quit IRC | 03:21 | |
| zhubingbing_ | should i use kolla-k8S docker images tag 4.0.0 ？ | 03:22 |
| zhubingbing_ | i see set_gate.sh use 2.0.2 “mistake” | 03:22 |
| *** sayantani01 has joined #openstack-kolla | 03:23 | |
| *** sayantani01 has quit IRC | 03:24 | |
| sdake | sup duonghq | 03:24 |
| *** fragatina has joined #openstack-kolla | 03:24 | |
| sdake | duonghq how ya been :) - bmace_ almost has a virtualized dev env that is ready to go that is reliable :) | 03:24 |
| *** fragatina has quit IRC | 03:24 | |
| *** jrobinson is now known as jrobinson-afk | 03:25 | |
| *** fragatina has joined #openstack-kolla | 03:25 | |
| sdake | zhubingbing_ I think for dev 2.0.2 is sufficient | 03:26 |
| zhubingbing_ | sure | 03:26 |
| zhubingbing_ | roger | 03:27 |
| zhubingbing_ | ；） | 03:27 |
| sdake | zhubingbing_ because of config.json - we have a backwards compatible api | 03:27 |
| sdake | zhubingbing_ if your concerned about the download speed because docker hub perofrmance sucks in china | 03:27 |
| sdake | zhubingbing_ you can use newer versions and that should be fine | 03:27 |
| zhubingbing_ | roger | 03:28 |
| zhubingbing_ | undestand | 03:28 |
| sdake | zhubingbing_ is that the issue - or am I tilting at windmilsl there? | 03:28 |
| *** sayantani01 has joined #openstack-kolla | 03:31 | |
| zhubingbing_ | windmilsl | 03:31 |
| zhubingbing_ | what 'a mean ? | 03:31 |
| openstackgerrit | Zeyu Zhu proposed openstack/kolla-ansible master: Using yaml.safe_load instead of yaml.load https://review.openstack.org/430535 | 03:32 |
| *** zhurong has joined #openstack-kolla | 03:33 | |
| *** fragatin_ has joined #openstack-kolla | 03:33 | |
| *** cuongnv has quit IRC | 03:34 | |
| *** cuongnv has joined #openstack-kolla | 03:34 | |
| kfox1111 | sbezverk: that gate refactor looks really nice. :) | 03:36 |
| *** cuongnv has quit IRC | 03:36 | |
| bmace_ | sdake: the current wip may work end to end other than a couple of manual steps. after running setup_dev_env.sh ceph_workflow_service.sh needs to get called with ceph_multi centos <ip_addr> <internal_eth>. after some tests tomorrow i'll include the workflow call into the setup_dev_env script and have that called at container runtime by default. | 03:36 |
| *** cuongnv has joined #openstack-kolla | 03:36 | |
| *** fragatina has quit IRC | 03:37 | |
| *** fragatin_ has quit IRC | 03:37 | |
| kfox1111 | bmace_: have you looked at sbezverk's review? | 03:37 |
| openstackgerrit | yuhui proposed openstack/kolla master: [Trivial]Add/Correct some annotation words https://review.openstack.org/429442 | 03:37 |
| kfox1111 | he's been reworking the gate scripts to get them more modular/sharable. might be able to reuse some of it with the dev env too. | 03:38 |
| bmace_ | kfox1111: not yet. i'm sure once things are working there is a lot of de-duplication / merging of code that can be done. | 03:38 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart https://review.openstack.org/428150 | 03:38 |
| openstackgerrit | Cao Xuan Hoang proposed openstack/kolla master: Remove support for py34 https://review.openstack.org/430539 | 03:39 |
| kfox1111 | cool. | 03:39 |
| sdake | bmace_ ok - one last thing I forgot to comment on in your review that needs addressing - you need a reno release note :) | 03:39 |
| sdake | kfox1111 ya at this time I'd have 15 duplicated scripts of the same thing if it got us a working dev env :) | 03:39 |
| sdake | even 30 ;-) | 03:40 |
| bmace_ | lol | 03:40 |
| kfox1111 | :) | 03:42 |
| bmace_ | well luckily I don't think it is quite that bad. | 03:43 |
| *** sudipto has quit IRC | 03:43 | |
| *** sudipto_ has quit IRC | 03:43 | |
| bmace_ | sdake: and i don't know the structure / etc of the release note stuff. feel free to toss that comment in the review and i'll look into it. | 03:44 |
| sdake | bmace_ reno new blurb | 03:45 |
| sdake | modify the blurb file | 03:45 |
| sdake | it is obvious what to do | 03:45 |
| bmace_ | ok :) | 03:45 |
| sp_ | portdirect: [Want to start with kolla-k8s bugs fixing] is it possible to allocate me a kolla-k8s dev env prepared? So that I can start. | 03:46 |
| *** sudipto has joined #openstack-kolla | 03:46 | |
| *** sudipto_ has joined #openstack-kolla | 03:46 | |
| sdake | bmace_ that reno new blurb needs to be proceeded with pip install reno ;-) | 03:47 |
| duonghq | sdake, sorry, I just come back from meeting | 03:50 |
| *** sdake_ has joined #openstack-kolla | 03:54 | |
| *** zhuzeyu has joined #openstack-kolla | 03:55 | |
| *** sdake has quit IRC | 03:57 | |
| *** saneax-_-|AFK is now known as saneax | 03:58 | |
| *** jrobinson-afk is now known as jrobinson | 03:59 | |
| *** mdnadeem has joined #openstack-kolla | 04:00 | |
| openstackgerrit | jangseon ryu proposed openstack/kolla-ansible master: This feature is supporting for workers config in swift servers. https://review.openstack.org/430550 | 04:01 |
| *** zhurong has quit IRC | 04:04 | |
| *** fragatina has joined #openstack-kolla | 04:09 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart https://review.openstack.org/428150 | 04:12 |
| *** fragatina has quit IRC | 04:12 | |
| *** fragatina has joined #openstack-kolla | 04:12 | |
| *** fragatina has quit IRC | 04:13 | |
| *** fragatina has joined #openstack-kolla | 04:13 | |
| *** sudipto has quit IRC | 04:19 | |
| *** sudipto_ has quit IRC | 04:19 | |
| *** goldyfruit has joined #openstack-kolla | 04:22 | |
| *** goldyfruit has quit IRC | 04:33 | |
| *** huzhengchuan has quit IRC | 04:39 | |
| *** sacharya has joined #openstack-kolla | 04:43 | |
| *** sacharya_ has quit IRC | 04:43 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart https://review.openstack.org/428150 | 04:47 |
| sdake_ | portdirect about? | 04:49 |
| *** huzhengchuan has joined #openstack-kolla | 04:52 | |
| *** sacharya_ has joined #openstack-kolla | 04:56 | |
| *** sacharya has quit IRC | 04:57 | |
| *** crushil has quit IRC | 04:59 | |
| *** sudipto has joined #openstack-kolla | 05:01 | |
| *** sudipto_ has joined #openstack-kolla | 05:01 | |
| *** yingjun has quit IRC | 05:06 | |
| *** sudipto_ has quit IRC | 05:08 | |
| *** sudipto has quit IRC | 05:08 | |
| *** rwallner has joined #openstack-kolla | 05:10 | |
| *** rwallner has quit IRC | 05:14 | |
| *** unicell has joined #openstack-kolla | 05:16 | |
| *** sayantani01 has quit IRC | 05:19 | |
| *** unicell1 has joined #openstack-kolla | 05:23 | |
| *** unicell has quit IRC | 05:23 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: Add openstack-magnum-ui package for centos binary https://review.openstack.org/430567 | 05:24 |
| *** tonanhngo has joined #openstack-kolla | 05:25 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [wip] test scenario2 in gate https://review.openstack.org/412279 | 05:25 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Check to see if Horizon is working in the gate. https://review.openstack.org/426025 | 05:28 |
| sdake_ | kfox1111 are you about | 05:28 |
| *** sayantani01 has joined #openstack-kolla | 05:29 | |
| *** skramaja has joined #openstack-kolla | 05:31 | |
| *** japestinho has quit IRC | 05:31 | |
| sdake_ | Jeffrey4l what are your thoughts on this: http://logs.openstack.org/98/426598/9/check/gate-kolla-kubernetes-deploy-ubuntu-binary-2-ceph-nv/077dfba/console.html | 05:34 |
| *** huzhengchuan has quit IRC | 05:34 | |
| *** huzhengchuan has joined #openstack-kolla | 05:35 | |
| Jeffrey4l | sdake_, try to use wget. wget is more stable to download large file. | 05:35 |
| sdake_ | Jeffrey4l thanks didn't know that at all | 05:36 |
| sdake_ | Jeffrey4l it is actually kfox1111 's work | 05:36 |
| Jeffrey4l | i see the same issue when implement this in kolla-ansible. | 05:36 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: Use tini instead of dumb-init https://review.openstack.org/430108 | 05:37 |
| *** zhangqiankun has joined #openstack-kolla | 05:42 | |
| *** sacharya_ has quit IRC | 05:43 | |
| *** salv-orlando has joined #openstack-kolla | 05:45 | |
| *** unicell1 has quit IRC | 05:47 | |
| *** japestinho has joined #openstack-kolla | 05:47 | |
| *** unicell has joined #openstack-kolla | 05:48 | |
| *** salv-orlando has quit IRC | 05:50 | |
| *** bmace_ has quit IRC | 06:01 | |
| *** yingjun has joined #openstack-kolla | 06:05 | |
| *** qiliang27 has quit IRC | 06:08 | |
| *** unicell1 has joined #openstack-kolla | 06:09 | |
| *** unicell has quit IRC | 06:09 | |
| *** adrian_otto has quit IRC | 06:13 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla master: Fix trove dashboard issue in horizon container https://review.openstack.org/429183 | 06:17 |
| *** zhurong has joined #openstack-kolla | 06:22 | |
| duonghq | sdake_, still around? | 06:24 |
| sdake_ | duonghq indeed | 06:25 |
| duonghq | I see that the kolla-ansible is refactored much, currently how does the order of roles is determined? | 06:25 |
| sdake_ | duonghq not clear to me - Jeffrey4l or pbourke would know for sure | 06:26 |
| Jeffrey4l | duonghq, the order of roles is not changed. | 06:26 |
| duonghq | sdake_, thanks, Jeffrey4l I don't know but in my setup, the haproxy is deploy before mariadb | 06:26 |
| duonghq | so it failed at waiting for virtual ip | 06:26 |
| *** sdake_ is now known as sdake | 06:27 | |
| Jeffrey4l | haproxy is deployed always before mariadb. | 06:27 |
| Jeffrey4l | there may be some other issue. | 06:27 |
| duonghq | fatal: [ubuntu]: FAILED! => {"changed": false, "elapsed": 300, "failed": true, "msg": "Timeout when waiting for 192.168.122.250:3306"} | 06:27 |
| duonghq | 06:27 | |
| Jeffrey4l | hrm. let me check.. | 06:28 |
| duonghq | docker ps at deploy node http://paste.openstack.org/show/598040/ | 06:28 |
| Jeffrey4l | duonghq, this task is in mariadb role https://github.com/openstack/kolla-ansible/blob/8b4ae8c2a714a6e7fcf065f4a624ba45d8d3e1ce/ansible/roles/mariadb/tasks/start.yml#L21 | 06:30 |
| duonghq | Jeffrey4l, how about this one: https://github.com/openstack/kolla-ansible/blob/8b4ae8c2a714a6e7fcf065f4a624ba45d8d3e1ce/ansible/roles/haproxy/tasks/start.yml#L32 | 06:32 |
| Jeffrey4l | duonghq, this just wait for the vip. | 06:32 |
| Jeffrey4l | not mariadb port. | 06:32 |
| Jeffrey4l | hrm. wait. | 06:32 |
| Jeffrey4l | it should be fine. | 06:33 |
| Jeffrey4l | it connect the vip:database_port | 06:33 |
| Jeffrey4l | this port is listened by haproxy. | 06:33 |
| Jeffrey4l | it works even though mariadb is not started. | 06:33 |
| duonghq | Jeffrey4l, thank you | 06:33 |
| Jeffrey4l | np | 06:34 |
| *** huzhengchuan has quit IRC | 06:34 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Using https instead of http https://review.openstack.org/430127 | 06:38 |
| *** adrian_otto has joined #openstack-kolla | 06:43 | |
| *** zhurong has quit IRC | 06:43 | |
| *** jrobinson has quit IRC | 06:45 | |
| *** salv-orlando has joined #openstack-kolla | 06:46 | |
| *** huzhengchuan has joined #openstack-kolla | 06:48 | |
| *** zhurong has joined #openstack-kolla | 06:49 | |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 06:49 |
| sdake | Jeffrey4l - I started with kfox1111 's implementation of container pulling - and since you have already sorted this out - i copied alot of your code | 06:50 |
| Jeffrey4l | that's fine. | 06:50 |
| sdake | Jeffrey4l yes of course that is fine - we are one project ;) | 06:50 |
| openstackgerrit | Merged openstack/kolla-ansible master: Add Freezer doc link in README.rst https://review.openstack.org/429367 | 06:50 |
| sdake | even copying between other openstack projects is fine | 06:50 |
| Jeffrey4l | now i think there are lots of duplication code between kolla/kolla-ansible/kolla-k8s | 06:51 |
| *** satyar has joined #openstack-kolla | 06:51 | |
| *** salv-orlando has quit IRC | 06:51 | |
| sdake | i have a request though, could you review the last patchset i submitted there and versus the prior patch set | 06:51 |
| sdake | and add any commentary you have that I may haev missed | 06:51 |
| sdake | Jeffrey4l fwiw I agree, we need to standardize our gating | 06:51 |
| Jeffrey4l | i am thinking move some same code into kolla project. for example, setup docker service, etc | 06:51 |
| sdake | Jeffrey4l i dont mind if it is duplicated - i mind that the logic is completely different | 06:51 |
| sdake | ideally the logic should be very similar so cross-deliverable gating can be done eaisly | 06:52 |
| Jeffrey4l | use a common function script. like "function setup_docker_registry" | 06:52 |
| sdake | as in one person that works heavily in one deliverable can work in another deliverable's gating code easily | 06:52 |
| Jeffrey4l | this is optimal. ;) | 06:52 |
| * Jeffrey4l is checking your code. | 06:52 | |
| sdake | ya - we will have some tim to get there | 06:52 |
| Jeffrey4l | ye. | 06:53 |
| Jeffrey4l | yep. | 06:53 |
| sdake | yo uwill notice the images built for kolla-kubernetes gate are different then kolla-ansible | 06:53 |
| sdake | 2.0.2, 3.0.2 and master are built for kolla-kubernetes | 06:53 |
| sdake | only master is built for kolla-ansible | 06:53 |
| sdake | so i get the logic needs to be slightly different | 06:53 |
| sdake | thanks for checking Jeffrey4l :) | 06:53 |
| Jeffrey4l | maybe. | 06:54 |
| sdake | the fact that one gate was using curl for this operation and you already fixed that problem with wget seems like a problem | 06:54 |
| Jeffrey4l | at least, kolla and kolla-ansible share almost the same code. | 06:54 |
| sdake | we should be able to learn that lesson once rather than twice | 06:54 |
| Jeffrey4l | yep. | 06:54 |
| sdake | duonghq did you get sorted out? | 06:56 |
| Jeffrey4l | sdake, why use separate file here ? http://tarballs.openstack.org/kolla-kubernetes/gate/containers/ | 06:58 |
| Jeffrey4l | it will be very large to download these files. | 06:58 |
| duonghq | sdake, yup | 06:59 |
| sdake | Jeffrey4l i dont follow your question - partially because i hae no idea how this stuff works :) | 06:59 |
| duonghq | seem that my custom haproxy still hang around, I clean all config file | 06:59 |
| sdake | mind expanding on the specific line # in question | 06:59 |
| sdake | duonghq got it | 06:59 |
| Jeffrey4l | i will. | 07:00 |
| duonghq | currently, I got other errors, I'm trying to build another image | 07:00 |
| *** rwallner has joined #openstack-kolla | 07:00 | |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 07:01 |
| *** salv-orlando has joined #openstack-kolla | 07:02 | |
| duonghq | What does the error "matched" mean (in image building result) | 07:03 |
| Jeffrey4l | duonghq, seems like its parent failed? | 07:04 |
| sdake | duonghq is that an INFO output or an error output? | 07:04 |
| sdake | Jeffrey4l is kolla-ansible upgrade/reconfig/deploy functional at present? | 07:04 |
| sdake | (in master) | 07:04 |
| duonghq | sdake, Jeffrey4l the summary result, just cannot get idea of "matched" word | 07:05 |
| Jeffrey4l | sdake, upgrade has some issue ( nova ceph related ) | 07:05 |
| Jeffrey4l | deploy and reconfigure is fine. | 07:05 |
| *** salv-orl_ has joined #openstack-kolla | 07:05 | |
| sdake | duonghq its a poor error name | 07:05 |
| *** rwallner has quit IRC | 07:05 | |
| *** zhurong has quit IRC | 07:05 | |
| Jeffrey4l | duonghq, yep. it is bad. | 07:05 |
| sdake | duonghq rather poor error description | 07:05 |
| sdake | errors shoudln't require a phd to decipher | 07:05 |
| duonghq | can you give me more descriptive meaning of this? | 07:06 |
| jascott1 | evening folks | 07:06 |
| sdake | sup jascott1 | 07:06 |
| duonghq | evening jascott1 | 07:06 |
| jascott1 | how are all the things? | 07:06 |
| jascott1 | :) | 07:06 |
| sdake | jascott1 need m0ar reviews | 07:06 |
| jascott1 | yes | 07:07 |
| jascott1 | need more time period but def CRs | 07:07 |
| jascott1 | i havent even got to play with compute kit | 07:07 |
| jascott1 | been off in my golangary | 07:07 |
| sdake | jascott1 yar | 07:08 |
| Jeffrey4l | sdake, done i made some comments in patch 10. | 07:09 |
| sdake | thanks Jeffrey4l | 07:09 |
| Jeffrey4l | np. | 07:09 |
| *** salv-orlando has quit IRC | 07:09 | |
| Jeffrey4l | sdake, btw, centos+source is more stable than others ;) | 07:10 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: [wip] enable ceilometer related project in gate https://review.openstack.org/412278 | 07:17 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 07:20 |
| sdake | Jeffrey4l yup not surprising all that much | 07:20 |
| *** sdake_ has joined #openstack-kolla | 07:23 | |
| *** tonanhngo has quit IRC | 07:25 | |
| *** sdake has quit IRC | 07:26 | |
| *** pcaruana has joined #openstack-kolla | 07:29 | |
| sdake_ | Jeffrey4l is thi the problem with nova: http://logs.openstack.org/25/426025/24/check/gate-kolla-kubernetes-deploy-centos-binary-3-ceph-multi-nv/d9499c9/console.html#_2017-02-08_05_52_01_059982 | 07:33 |
| *** adrian_otto has quit IRC | 07:33 | |
| Jeffrey4l | sdake_, seems like a bad configuration http://logs.openstack.org/25/426025/24/check/gate-kolla-kubernetes-deploy-centos-binary-3-ceph-multi-nv/d9499c9/logs/openstack/kolla-nova-compute-xz2xd.txt | 07:34 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 07:35 |
| Jeffrey4l | sdake_, and this http://logs.openstack.org/25/426025/24/check/gate-kolla-kubernetes-deploy-centos-binary-3-ceph-multi-nv/d9499c9/logs/openstack/kolla-nova-conductor-0.txt | 07:35 |
| Jeffrey4l | seems like nova have a bug. but your nova-compute doesn't work at all. | 07:36 |
| *** david-lyle_ has joined #openstack-kolla | 07:37 | |
| Jeffrey4l | sdake_, what do you think about this https://review.openstack.org/430108 ? use tini instead of dumb-init | 07:38 |
| sdake_ | Jeffrey4l interesting | 07:40 |
| sdake_ | Jeffrey4l didn't knwo thta was a new feature of docker | 07:40 |
| Jeffrey4l | SamYaple told me yesterday. | 07:40 |
| sdake_ | Jeffrey4l I'm not sure we want to pin on docker-engine > 1.13.1 | 07:40 |
| sdake_ | docker-engine 1.10 is pretty much where i"d like to keep our min pin at | 07:40 |
| Jeffrey4l | tbh, docker should handle this. | 07:40 |
| Jeffrey4l | sdake_, maybe we should bump the docker-engine version. but it is too late to do it now. | 07:41 |
| sdake_ | I think the issue is that it is possible docker-engine may be replaced by various efforts in the container ecosystem, and then we would be left locked into docker permanently | 07:41 |
| sdake_ | or atleast for ocata | 07:41 |
| Jeffrey4l | and docker 1.13.1 is not released. | 07:41 |
| sdake_ | my take is lets punt until pike and see what happens | 07:41 |
| Jeffrey4l | and docker 1.13.0 is buggy with my test. | 07:41 |
| sdake_ | docker 1.13 is not high quality sadly | 07:42 |
| sdake_ | IIUC google peeps are making a competitor to docker-engine | 07:42 |
| Jeffrey4l | sdake_, i am fine before that happen ( replace docker ) | 07:42 |
| Jeffrey4l | yep. | 07:42 |
| sdake_ | and it may make sense to support one or the other or both | 07:42 |
| sdake_ | really depends on what happens there - i think its premature to lock us into a docker-only world | 07:43 |
| Jeffrey4l | at least, we have no choice, right? if we have, we can make the possible change. ;) | 07:43 |
| sdake_ | coreos has failed imo with their container replacement for docker, however, google may not as they have superior marketing and people-power | 07:44 |
| *** dciabrin has quit IRC | 07:44 | |
| Jeffrey4l | maybe | 07:44 |
| sdake_ | i think we will knwo by the end of pike one way or another | 07:44 |
| Jeffrey4l | possible. | 07:45 |
| sdake_ | if tini requires docker, that seems problematic in a world where there may be multiple container runtimes | 07:45 |
| sdake_ | dumb_init does the job, does it not? | 07:45 |
| Jeffrey4l | tini is a stand along app. | 07:45 |
| Jeffrey4l | i followed the docker repo. | 07:46 |
| sdake_ | i dont follwo the terms stand along app | 07:46 |
| Jeffrey4l | at the beginning docker have its own init process app. | 07:46 |
| sdake_ | i guess if we could make it conditoinal that would be ok | 07:46 |
| Jeffrey4l | but later, they think tini is better. | 07:46 |
| sdake_ | the thing is tini depends on docker right? | 07:46 |
| Jeffrey4l | so they just download and compile tini in docker's repo. and ship the tini with docker-engine package. | 07:47 |
| Jeffrey4l | in that package, tini is called "docker-init" | 07:47 |
| sdake_ | whatever competitor the community produces to docker-engine I expect dockerfiles as well as the image format will stay comptible | 07:47 |
| Jeffrey4l | sdake_, no tini depends on nothing. | 07:47 |
| sdake_ | so tini cn work with docker-engine 1.10? | 07:47 |
| Jeffrey4l | sdake_, yep. | 07:47 |
| Jeffrey4l | but above docker 1.13. you can use "docker run --init centos:7 bash" | 07:48 |
| *** matrohon has joined #openstack-kolla | 07:48 | |
| Jeffrey4l | docker will use docker-init( which is tini actuall) to launch bash. | 07:48 |
| sdake_ | what happens with docker-engine 1.10? | 07:49 |
| Jeffrey4l | you image do not have to install any init process in this case. | 07:49 |
| sdake_ | are zombie pids handled with tini? | 07:49 |
| Jeffrey4l | yep. | 07:49 |
| Jeffrey4l | docker engine 1.10 do not support this. | 07:49 |
| sdake_ | so tini determines the docker runtime its in? | 07:49 |
| Jeffrey4l | in this patch, we only move from dumb-init to tini. | 07:49 |
| Jeffrey4l | we do not pin do docker 1.13's new feature. | 07:49 |
| sdake_ | mind linking the github repo | 07:50 |
| Jeffrey4l | sdake_, https://github.com/krallin/tini | 07:50 |
| *** salv-orlando has joined #openstack-kolla | 07:50 | |
| Jeffrey4l | tini is almost the same with dumb-init | 07:50 |
| Jeffrey4l | we move to it only because docker use it, too. | 07:50 |
| Jeffrey4l | so i think this should be best tested by docker, and will be widely used in the future. | 07:51 |
| Jeffrey4l | once kolla require docker > 1.13. we can use docker's init feature, then we do not need install tini in dockerfile anymore. | 07:51 |
| Jeffrey4l | that's future plan. | 07:52 |
| Jeffrey4l | but i do not know when it will happen and whether it should happen. ;) | 07:52 |
| Jeffrey4l | this is another topic, imo. | 07:52 |
| *** salv-orl_ has quit IRC | 07:52 | |
| Jeffrey4l | sdake_, ^^ | 07:53 |
| *** dciabrin has joined #openstack-kolla | 07:54 | |
| sdake_ | Jeffrey4l the code looks good - although this file looks troubling given the fact there was a typo in the license file: https://github.com/krallin/tini/blob/master/src/tiniLicense.h | 07:54 |
| sdake_ | Jeffrey4l can you see if the preprocessed license file matches the license in the repo? | 07:55 |
| sdake_ | also - license on dumb_init is what? | 07:55 |
| sdake_ | I sort of feel like why fix something that isn't broken :) | 07:55 |
| sdake_ | especially t-3 weeks prior to a major release | 07:55 |
| Jeffrey4l | dumb-init is The MIT License (MIT) | 07:55 |
| Jeffrey4l | should be fine. | 07:55 |
| Jeffrey4l | tini is MIT too. | 07:56 |
| Jeffrey4l | https://github.com/krallin/tini/blob/master/LICENSE | 07:56 |
| Jeffrey4l | sdake_, | 07:56 |
| sdake_ | Jeffrey4l yo usee the git commit message "Fix typo in license" | 07:56 |
| sdake_ | you see the preprocessed license file | 07:56 |
| sdake_ | we want to ensure those are equivalent | 07:57 |
| Jeffrey4l | sdake_, another one reason we move it because https://review.openstack.org/429907 | 07:57 |
| sdake_ | and that they are actually the MIT lilcense and not claiming to be so :) | 07:57 |
| sdake_ | when someoen makes a typo in a license file, it tells me they customized it in some way | 07:57 |
| sdake_ | that is highly dangerous | 07:57 |
| Jeffrey4l | ok. let me decrypt it | 07:58 |
| *** dciabrin has quit IRC | 07:58 | |
| sdake_ | sounds good | 07:58 |
| *** dciabrin has joined #openstack-kolla | 07:58 | |
| sdake_ | and validate it against the OSI approved MIT license | 07:59 |
| sdake_ | https://opensource.org/licenses/MIT | 07:59 |
| *** n0isyn0i1e is now known as n0isyn0ise | 08:00 | |
| Jeffrey4l | preprocessed is the same with LICENSE | 08:02 |
| *** tonanhngo has joined #openstack-kolla | 08:03 | |
| sdake_ | and LICENSE matches OSI license? | 08:03 |
| Jeffrey4l | yep. | 08:04 |
| *** tonanhngo has quit IRC | 08:04 | |
| Jeffrey4l | so i think it is fine to use at the license level. sdake_ | 08:05 |
| *** sdake_ is now known as dake | 08:05 | |
| dake | ok | 08:05 |
| dake | the second question is does it actually work :) | 08:06 |
| dake | looking at that dumb_init 1.2.0 error, it looks like they somehow broke the implementation | 08:06 |
| dake | (the github issue tracker) | 08:06 |
| dake | i do like that arm is available in tini | 08:06 |
| dake | probably a topic for tomorrow's team meeting | 08:07 |
| Jeffrey4l | dake, yes it works the gate is fine after changing to tini. | 08:07 |
| Jeffrey4l | yep. i will add this into the meeting agenda. | 08:07 |
| dake | kolla-ansible gate is a leaky sieve :) | 08:07 |
| Jeffrey4l | no. i think it much better ;) | 08:07 |
| dake | it is probably improving no doubt - i've been pretty much mia from gate work since i retired from PTLship :) | 08:08 |
| Jeffrey4l | ;) | 08:09 |
| *** salv-orlando has quit IRC | 08:10 | |
| Jeffrey4l | https://review.openstack.org/412279 https://review.openstack.org/412278 you will like this dake | 08:10 |
| dake | Jeffrey4l ++++++ | 08:11 |
| Jeffrey4l | ;D | 08:12 |
| *** sdake has joined #openstack-kolla | 08:14 | |
| *** qiliang27 has joined #openstack-kolla | 08:14 | |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 08:17 |
| *** dake has quit IRC | 08:17 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla-ansible master: Fix copying over nfs_shares task failure https://review.openstack.org/430638 | 08:27 |
| *** david-lyle_ has quit IRC | 08:28 | |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 08:31 |
| *** stevemar has quit IRC | 08:33 | |
| *** stevemar has joined #openstack-kolla | 08:35 | |
| *** zioproto has joined #openstack-kolla | 08:38 | |
| sdake | this tarballs in the gate thing looks pretty good | 08:38 |
| *** huzhengchuan has quit IRC | 08:39 | |
| Jeffrey4l | tarballs means? | 08:39 |
| Jeffrey4l | tarballs.openstack.org/kolla/images/ ? | 08:39 |
| sdake | there is also one for kubernetes as well | 08:40 |
| Jeffrey4l | yep. | 08:40 |
| sdake | but yup those | 08:40 |
| Jeffrey4l | the only issue to push large file in tarballs.o.o is downloading them may be slow in some node. | 08:41 |
| sdake | takes about 2 minutes in the gate | 08:43 |
| sdake | versus 20 minutes to download from dockerhub | 08:43 |
| *** prameswar has joined #openstack-kolla | 08:44 | |
| Jeffrey4l | hrm. in some time. i saw this once. download 3GB file takes 1 hour ;( | 08:44 |
| openstackgerrit | Li Yingjun proposed openstack/kolla-ansible master: Fix telegraf task https://review.openstack.org/430648 | 08:46 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 08:50 |
| *** huzhengchuan has joined #openstack-kolla | 08:52 | |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 08:54 |
| sdake | Jeffrey4l in the gatenodes? | 08:56 |
| Jeffrey4l | yes. | 08:56 |
| Jeffrey4l | but only once. | 08:56 |
| Jeffrey4l | never mind. | 08:56 |
| *** salv-orlando has joined #openstack-kolla | 08:57 | |
| sdake | i can tell ya wget is alot better then curl | 08:57 |
| sdake | thanks for the tip there :) | 08:57 |
| sdake | Jeffrey4l do you know why? | 08:57 |
| Jeffrey4l | no ;( | 08:57 |
| *** egonzalez has joined #openstack-kolla | 08:58 | |
| zioproto | Hello all. Looks like it would be much better to start using master than the stable/newton version. At the moment our production (puppet) cloud is on Mitaka. It is possible to use newton kolla containers but kolla-ansible tooling and roles from (future) stable/ocata ? It would work as a migration path ? | 08:59 |
| Jeffrey4l | zioproto, i do not think so. | 08:59 |
| *** dtturner has quit IRC | 08:59 | |
| zioproto | let's say I am running kolla in stable/newton. What is the upgrade procedure ? | 09:01 |
| zioproto | there is a spec somewhere ? | 09:01 |
| zioproto | I did not find too much yet | 09:01 |
| zioproto | I dont understand what component makes the database migrations | 09:01 |
| Jeffrey4l | upgrade from newton to ocata? | 09:01 |
| zioproto | yes | 09:01 |
| zioproto | or mitaka to newton | 09:01 |
| zioproto | is the same | 09:01 |
| Jeffrey4l | there is no special doc. | 09:01 |
| zioproto | basically you have three things to do | 09:01 |
| zioproto | upgrade ansible roles | 09:01 |
| Jeffrey4l | normally run "kolla-ansible upgrade" | 09:02 |
| zioproto | pull new containers and restart them | 09:02 |
| zioproto | and do the database migrations | 09:02 |
| Jeffrey4l | oh yep. | 09:02 |
| Jeffrey4l | "kolla-ansible pull" then "kolla-ansible upgrade" | 09:02 |
| Jeffrey4l | upgrade will handle the database migrations. | 09:02 |
| zioproto | ok, so upgrade would do the database migrations | 09:02 |
| zioproto | so if I keep in my globals.yml the setting openstack_release: "3.0.2" but I have current master, everything would brake ? | 09:03 |
| Jeffrey4l | almost. in some case, you need add some items into passwords.yml and your inventory file. | 09:04 |
| Jeffrey4l | tbh, kolla do not handle this very well. | 09:05 |
| *** Serlex has joined #openstack-kolla | 09:16 | |
| egonzalez | Jeffrey4l: yep, the bug I opened yesterday is with docker 1.13 | 09:20 |
| *** mgoddard_ has joined #openstack-kolla | 09:21 | |
| egonzalez | or maybe because i have devicemapper as docker storage driver | 09:21 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 09:23 |
| Jeffrey4l | egonzalez, i use btrfs, which has such issue too. | 09:24 |
| Jeffrey4l | i think it is worth to install docker 1.13.1rc to have a try. ;) | 09:24 |
| Jeffrey4l | brb | 09:24 |
| sdake | morning egonzalez | 09:25 |
| openstackgerrit | Li Yingjun proposed openstack/kolla-ansible master: Fix haproxy config for solumn-api https://review.openstack.org/430679 | 09:25 |
| egonzalez | morning sdake | 09:26 |
| *** duonghq has quit IRC | 09:26 | |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 09:27 |
| *** fragatina has quit IRC | 09:30 | |
| *** fragatina has joined #openstack-kolla | 09:30 | |
| *** ipsecguy has quit IRC | 09:32 | |
| *** openstackgerrit has quit IRC | 09:34 | |
| *** mannamne has joined #openstack-kolla | 09:35 | |
| *** hrw has quit IRC | 09:38 | |
| *** japestinho has quit IRC | 09:38 | |
| *** NachoDuck_ has joined #openstack-kolla | 09:38 | |
| *** gfidente has joined #openstack-kolla | 09:38 | |
| *** gfidente has quit IRC | 09:38 | |
| *** gfidente has joined #openstack-kolla | 09:38 | |
| *** Guest66676 has joined #openstack-kolla | 09:41 | |
| *** abc__ has joined #openstack-kolla | 09:41 | |
| *** mandre_ has joined #openstack-kolla | 09:44 | |
| *** hrw has joined #openstack-kolla | 09:44 | |
| *** dims_ has joined #openstack-kolla | 09:44 | |
| *** huzhengchuan has quit IRC | 09:45 | |
| *** yingjun has quit IRC | 09:45 | |
| *** dims has quit IRC | 09:45 | |
| *** cinerama has quit IRC | 09:45 | |
| *** dmsimard has quit IRC | 09:45 | |
| *** timss has quit IRC | 09:45 | |
| *** abc has quit IRC | 09:45 | |
| *** mandre has quit IRC | 09:45 | |
| *** Guest66666 has quit IRC | 09:45 | |
| *** NachoDuck has quit IRC | 09:45 | |
| *** mandre_ is now known as mandre | 09:45 | |
| *** NachoDuck_ is now known as NachoDuck | 09:49 | |
| *** huzhengchuan has joined #openstack-kolla | 09:51 | |
| *** dmsimard has joined #openstack-kolla | 09:51 | |
| *** timss has joined #openstack-kolla | 09:52 | |
| *** openstackgerrit has joined #openstack-kolla | 09:54 | |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 09:54 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 09:55 |
| *** cuongnv has quit IRC | 10:02 | |
| *** japestinho has joined #openstack-kolla | 10:04 | |
| *** zhubingbing_ has quit IRC | 10:11 | |
| *** zhubingbing_ has joined #openstack-kolla | 10:11 | |
| pbourke | anyone having issues getting fluentd to start? | 10:19 |
| pbourke | 'service endpoint with name fluentd already exists' | 10:20 |
| satyar | not yet tried | 10:20 |
| *** ipsecguy has joined #openstack-kolla | 10:26 | |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Actually report gate failures for experimental jobs https://review.openstack.org/430708 | 10:26 |
| *** satyar has quit IRC | 10:27 | |
| *** sambetts|afk is now known as sambetts | 10:33 | |
| openstackgerrit | Wei Cao proposed openstack/kolla-ansible master: Remove Zaqar doc link in README.rst https://review.openstack.org/430714 | 10:36 |
| *** zhubingbing_ has quit IRC | 10:42 | |
| openstackgerrit | Eduardo Gonzalez proposed openstack/kolla-ansible master: Recover nova reload task to upgrade https://review.openstack.org/430762 | 10:47 |
| *** salv-orlando has quit IRC | 10:49 | |
| openstackgerrit | Wei Cao proposed openstack/kolla-ansible master: Correct the groups for solum in haproxy.cfg.j2 https://review.openstack.org/420407 | 10:52 |
| *** caowei has quit IRC | 10:54 | |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 10:57 |
| sdake | Jeffrey4l would you mind taking a look at that last patch | 10:57 |
| portdirect | o/ | 10:57 |
| sdake | sup portdirect | 10:58 |
| portdirect | hey sdake | 10:58 |
| sdake | portdirect - if you have the energy can youcheck out that gate patch | 10:58 |
| sdake | I've been digging into how the gate works a bit and deconstructed atleast the registry mirroring work | 10:58 |
| *** zhangqiankun has quit IRC | 10:58 | |
| portdirect | yeah - its a late start for me - so no excuses today | 10:58 |
| sdake | portdirect there are also other patches in the queue that could use reviews | 10:59 |
| portdirect | this one: https://review.openstack.org/426598 | 10:59 |
| sdake | yup that one | 10:59 |
| sdake | its 4am - going to crash for cuple hours | 10:59 |
| sdake | then kids off to school | 10:59 |
| sdake | 4 hours to learn how that works - however- now Iunderstand it | 10:59 |
| sdake | and understand why it can't be the same as kolla-ansible's gating scripts | 10:59 |
| sdake | the gate scripts need MOAR COMMENTS | 10:59 |
| *** ipsecguy has quit IRC | 10:59 | |
| sdake | some comments would have cut the 4 hours down to 20 minutes | 11:00 |
| portdirect | lol - man, If you ever win that one I'd be hyper impressed - the lack of comments really makes me sad | 11:00 |
| sdake | portdirect i'll commet it myself if need be | 11:01 |
| sdake | portdirect th only way to fix problems is to own them | 11:01 |
| sdake | expecting other people to magically fix things you want is unrealistic :) | 11:01 |
| *** zhangqiankun has joined #openstack-kolla | 11:01 | |
| sdake | i'm pretty sure there would not be -1's on comments in the gate scripts | 11:01 |
| sdake | however the gate scripts have grown unwiedly | 11:02 |
| sdake | i hear sbezverk has a refactor somewhere in the review queue :) | 11:02 |
| sdake | i've burned about 40 hours learning how the gate works for kolla-kubernetes - as part of the devenv dev | 11:02 |
| sdake | although bmace took over the devenv work and that is compelte as soon as global requirements unfreezes | 11:03 |
| sdake | speaking of unrealistic expectations, entrypoint is fubared | 11:04 |
| sdake | it doesn't seem to do what it claims | 11:04 |
| sdake | i see containers enter the error state all the time | 11:04 |
| sdake | tha shouldn't happen if the dep management is done properly | 11:04 |
| sdake | i'm not quite sure how to complain about that as it appears abanonded | 11:04 |
| portdirect | inc) should have some links there i think? | 11:05 |
| sdake | links huh? | 11:05 |
| sdake | you mean people to do the work | 11:05 |
| portdirect | yeah | 11:05 |
| sdake | I asked him about it earlier, he said he is out of bullets | 11:05 |
| portdirect | It's intel folk who look after it these days | 11:05 |
| portdirect | :( | 11:05 |
| sdake | seems like a topic for the meetign in 5 hours | 11:06 |
| sdake | or 4 hours | 11:06 |
| sdake | or whatver it is | 11:06 |
| sdake | ince a whole lot of people depend on it | 11:06 |
| sdake | perhaps inc0 can get the right poeple on it | 11:06 |
| sdake | i don't know go, although I could learn | 11:06 |
| sdake | however, go is not a language that is approved within openstack at this time | 11:07 |
| sdake | therefore, we can't import it into the openstack namespace | 11:07 |
| portdirect | yeah - I'd file a bug on their github and see if that gets a response | 11:07 |
| sdake | that doesn't mean we cna't use it tho | 11:07 |
| sdake | i'm not even sure where to begin othe then a screenshot | 11:07 |
| sdake | and "this shouldn't happen" | 11:07 |
| des_consolado | so the kolla repo has never tracked files | 11:07 |
| des_consolado | oh wtf | 11:07 |
| sdake | des_consolado could you expand on your question? | 11:08 |
| des_consolado | sorry premature enter | 11:08 |
| des_consolado | and I was scrolled up about a day or two uhh... ironic-agent.kernel | 11:08 |
| des_consolado | the ironic plays are incomplete I guess | 11:08 |
| sdake | ha ironic needs love | 11:08 |
| sdake | ha/ya | 11:08 |
| sdake | sean-k-mooney was working on them at one point - not sure on his current status there | 11:09 |
| sdake | portdirect the CFP was extended until the8th | 11:09 |
| sdake | if youcan come up with a good topic for me to present on besides doom and gloom ill submit one since I made you submit one ;) | 11:09 |
| sdake | thanks for that btw portdirect :) | 11:10 |
| sdake | that is probably 00:00 utc | 11:10 |
| sdake | which is 5pm my time iirc | 11:10 |
| sdake | so 12 hours out | 11:10 |
| portdirect | will try - but currenlty in the middle of moving house | 11:11 |
| *** sdake has quit IRC | 11:11 | |
| portdirect | my life is spread across everything | 11:11 |
| portdirect | and just about to head out to the charity shop again | 11:11 |
| *** sdake has joined #openstack-kolla | 11:11 | |
| hrw | looks like first aarch64 container using kolla gets closer :D | 11:18 |
| sp_ | portdirect: facing this error "Could not fetch specs from http://gems.hashicorp.com/" when i run command "vagrant plugin install vagrant-libvirt" | 11:18 |
| sp_ | portdirect: I am setting up kolla-k8s dev environment | 11:19 |
| sp_ | portdirect: machine is of configuration 32GB RAM, single node, 2 core CPU | 11:22 |
| *** wagiel has joined #openstack-kolla | 11:23 | |
| Serlex | sp_ are you behind a proxy? | 11:24 |
| portdirect | sp_: ^^ thats would be my first guess as well | 11:25 |
| sp_ | Serlex: portdirect when no proxy was set i faced the same issue, as i am facing now after setting this to | 11:27 |
| sp_ | ubuntu@openstack-nti-3:~$ env | grep proxy # just checking | 11:27 |
| sp_ | http_proxy=http://192.0.2.1:3128 | 11:27 |
| sp_ | https_proxy=http://192.0.2.1:3128 | 11:27 |
| sp_ | ubuntu@openstack-nti-3:~$ | 11:27 |
| *** wagiel has left #openstack-kolla | 11:27 | |
| portdirect | I'm sorry sp_ but I'm not going to be the best help on that today :( you may find this helpful: https://github.com/vagrant-libvirt/vagrant-libvirt#installation | 11:30 |
| sp_ | portdirect: thanks | 11:30 |
| sp_ | i will check | 11:30 |
| *** salv-orlando has joined #openstack-kolla | 11:33 | |
| Serlex | sp_ stupid question, but 192.0.2.1 is your proxy server right? | 11:37 |
| sp_ | Serlex: no, good question. No its not. I got the solution for a blog and I put it there which is wrong | 11:39 |
| Serlex | So, first check if you are behind a firewall which needs a proxy. if so, find out what is the proxy server and export http_proxy or/and https_proxy to your environment | 11:41 |
| sp_ | Serlex: I will catch you after 1:30 hr. BTW thanks | 11:42 |
| Serlex | I asked, because there are few blog and stackoverflow posts with the IP and port above...I thought you might of copied :D | 11:42 |
| sp_ | Serlex: You are right. | 11:42 |
| sp_ | :D | 11:42 |
| sp_ | I didn't modify that before running the same command | 11:43 |
| *** sdake has quit IRC | 11:43 | |
| *** sp_ has quit IRC | 11:44 | |
| *** ipsecguy has joined #openstack-kolla | 11:46 | |
| *** ipsecguy has quit IRC | 11:46 | |
| des_consolado | mliima: are you around today? | 11:49 |
| mliima | \o | 11:49 |
| mliima | des_consolado, | 11:50 |
| des_consolado | mliima: hey - you wrote the ironic config.yml that puts ironic-agent.kernel and .initramfs in the nodes' config dirs | 11:50 |
| des_consolado | where can I find out more about these files? they've never been in the repo, do we generate them or have to manually write them? | 11:50 |
| des_consolado | I can't find too much about them on google | 11:50 |
| *** cinerama has joined #openstack-kolla | 11:52 | |
| Serlex | des_consolado, you need to generate them locally | 11:56 |
| des_consolado | oh I hadn't even remembered to build the ironic image(s) actually, presuming they're not in the default profile | 11:58 |
| Serlex | I hit the same problem. Something along the lines of "disk-image-create ironic-agent fedora -o ironic-agent" | 11:59 |
| Serlex | Which will output .kernel and .initramfs files | 11:59 |
| Serlex | http://docs.openstack.org/developer/ironic-inspector/install.html | 12:00 |
| des_consolado | oh cool, thanks Serlex | 12:00 |
| *** huzhengchuan has quit IRC | 12:02 | |
| *** pbourke has quit IRC | 12:06 | |
| *** pbourke has joined #openstack-kolla | 12:07 | |
| *** dave-mccowan has joined #openstack-kolla | 12:08 | |
| *** ipsecguy has joined #openstack-kolla | 12:09 | |
| *** huzhengchuan has joined #openstack-kolla | 12:14 | |
| des_consolado | this should be automated though, right? :\ | 12:14 |
| des_consolado | so there's a new python requirement, python-diskimage-builder, with this | 12:15 |
| *** ipsecguy has quit IRC | 12:16 | |
| des_consolado | but ironic is optional and not default, so I guess that's why it's not in the requirements.txt - but if you enable ironic, I guess you should use a pip module in one of the playbooks to make sure this is installed... | 12:16 |
| *** mliima_ has joined #openstack-kolla | 12:16 | |
| *** ipsecguy has joined #openstack-kolla | 12:17 | |
| *** mliima has quit IRC | 12:20 | |
| *** lucker has joined #openstack-kolla | 12:22 | |
| lucker | hello | 12:22 |
| Serlex | I know what you mean regarding the automation. But I considering the minimum work required, i dont think its highest priority | 12:23 |
| des_consolado | yeah I should do a patch, haven't contributed yet | 12:24 |
| *** david-lyle has quit IRC | 12:24 | |
| *** huzhengchuan has quit IRC | 12:25 | |
| *** salv-orlando has quit IRC | 12:34 | |
| *** ipsecguy has quit IRC | 12:36 | |
| *** ipsecguy has joined #openstack-kolla | 12:37 | |
| *** huzhengchuan has joined #openstack-kolla | 12:37 | |
| *** ipsecguy has quit IRC | 12:41 | |
| zioproto | is there a date for the stable/ocata branch ? | 12:49 |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack/kolla master: Move fluentd td.repo to base for consistency https://review.openstack.org/430193 | 12:49 |
| zioproto | I will have this patch thah needs love before the branch of the stable release https://review.openstack.org/#/c/427139/ | 12:50 |
| *** rwallner has joined #openstack-kolla | 12:50 | |
| *** huzhengchuan has quit IRC | 12:51 | |
| *** zhangqiankun has quit IRC | 12:57 | |
| *** japestinho has quit IRC | 13:01 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart https://review.openstack.org/428150 | 13:02 |
| *** rhallisey has joined #openstack-kolla | 13:05 | |
| hrw | egonzalez: http://pastebin.com/3x9wzEhM - arm64 ;D | 13:08 |
| *** goldyfruit has joined #openstack-kolla | 13:10 | |
| *** goldyfruit has quit IRC | 13:10 | |
| *** satyar has joined #openstack-kolla | 13:12 | |
| *** zhubingbing has joined #openstack-kolla | 13:13 | |
| mliima_ | error in nova container durring deployment -> http://paste.openstack.org/show/598081/ | 13:13 |
| *** mgiles has joined #openstack-kolla | 13:14 | |
| *** mgiles has quit IRC | 13:16 | |
| *** mgiles has joined #openstack-kolla | 13:16 | |
| *** stevemar has left #openstack-kolla | 13:17 | |
| *** sp__ has joined #openstack-kolla | 13:19 | |
| *** salv-orlando has joined #openstack-kolla | 13:19 | |
| kfox1111 | morning | 13:21 |
| *** jheroux has joined #openstack-kolla | 13:21 | |
| *** rwallner has quit IRC | 13:24 | |
| *** sp__ has quit IRC | 13:25 | |
| *** sp_ has joined #openstack-kolla | 13:30 | |
| *** saneax is now known as saneax-_-|AFK | 13:32 | |
| *** sudipto has joined #openstack-kolla | 13:33 | |
| *** sudipto_ has joined #openstack-kolla | 13:33 | |
| *** sdake has joined #openstack-kolla | 13:36 | |
| sdake | morning peeps | 13:36 |
| *** fguillot has joined #openstack-kolla | 13:36 | |
| hrw | elo | 13:39 |
| hrw | (venv-for-kolla)14:37 hrw@pinkiepie-centos:kolla$ git review | 13:39 |
| hrw | fatal: ICLA contributor agreement requires current contact information. | 13:39 |
| hrw | so I added ones. | 13:39 |
| hrw | Code Review - Error | 13:39 |
| hrw | Server Error | 13:39 |
| hrw | Cannot store contact information | 13:39 |
| hrw | can someone tell me what is wrng? | 13:39 |
| mliima_ | error in nova container durring deployment -> http://paste.openstack.org/show/598081/ | 13:40 |
| mliima_ | morning sdake | 13:40 |
| sdake | sup mliima_ | 13:41 |
| sdake | mliima_ ya - nova is borked | 13:41 |
| sdake | portdirect can you please review this simple 2 liner: https://review.openstack.org/#/c/430708/1 | 13:41 |
| sdake | hrw ok - you need to add your contact information on openstac.org's website | 13:42 |
| sdake | when you ened to log out of gerrit | 13:42 |
| mliima_ | ok sdake | 13:42 |
| sdake | and log back into gerrit | 13:42 |
| mliima_ | :) | 13:42 |
| hrw | sdake: 14:39 < hrw> Cannot store contact information | 13:42 |
| hrw | sdake: that;s what gerrit tells me in browser | 13:42 |
| sdake | hrw in openstack.org, not review.openstack.org | 13:42 |
| sdake | login to openstack.org | 13:42 |
| *** sayantani01 has quit IRC | 13:43 | |
| sdake | review.openstack.org will not letyou store contact information - it comes from review.openstack.org | 13:43 |
| hrw | fucking shit. | 13:43 |
| * hrw goes | 13:43 | |
| sdake | ratheri t comes from the openstack.org website | 13:43 |
| sdake | hrw ya its not very intuitive | 13:43 |
| sdake | thanks portdirect :) | 13:43 |
| egonzalez | hrw: your profile in openstack.o.o need to be as Foundation Member | 13:44 |
| *** matrohon has quit IRC | 13:44 | |
| hrw | egonzalez: iirc it is | 13:44 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart https://review.openstack.org/428150 | 13:44 |
| sdake | kfox1111 morning | 13:45 |
| sdake | re rax - I see consistent fialures on rax - as in 100% in the kolla-ansible gate jobs | 13:45 |
| sdake | kfox1111 thanks for the review btw ;) | 13:45 |
| sp_ | sdake: morning | 13:45 |
| sdake | kfox1111 looking at your work there helped me figure out how the gate works | 13:45 |
| sdake | sp_ sup | 13:45 |
| kfox1111 | sdake: morning | 13:47 |
| sbezverk | kfox1111: it looks there are a couple of systematic failures. 1 - gate-kolla-kubernetes-deploy-centos-binary-3-ceph-multi-nv always fails with the same error even on a master gate check | 13:47 |
| hrw | R@#!%$@#% | 13:47 |
| kfox1111 | sdake: yeah, but kolla-kubernetes does not have that problem. | 13:47 |
| kfox1111 | sdake: I think its a failing of the kolla-ansible gate, not rax. | 13:47 |
| hrw | https://www.openstack.org/profile/ shows address added. git review says gtfo | 13:47 |
| sdake | kfox1111 i notice alot of failureson rax.iad for kolla-buernetes too | 13:47 |
| sbezverk | kfox1111: 2 - I am suspecting 3.0.2 cinder lvm volume is broken as the same config with 3.0.1 works | 13:47 |
| sdake | hrw now log out of review.openstack.org - then log back in | 13:47 |
| kfox1111 | sdake: when debugging issues, we've been logging them for awhile, and looking for patterns. | 13:48 |
| sdake | this wil sync your contact information with review.openstack.org | 13:48 |
| hrw | sdake: https://review.openstack.org/#/settings/contact shows empty data | 13:48 |
| sdake | kfox1111 fair enough - as i said in the reivew i'l moveremove it | 13:48 |
| sdake | hrw did you log out of review.openstack.org? | 13:48 |
| hrw | sdake: yes, I did | 13:48 |
| kfox1111 | sdake: in all the problems sovled, only at the very begining was there a pattern on provider, and that was due to multiple nics. once that was solved we never have seen a rax specific issue again. | 13:48 |
| sdake | hrw i can help you via webex if you ahve a 10 minutes now - otherwise I can help you later | 13:49 |
| hrw | sdake: https://www.openstack.org/community/members/profile/66842/marcin-juszkiewicz is my public profile | 13:49 |
| sdake | kfox1111 sweet, if you founnd a solution to that rax problem, could you please feed it into Jeffrey4l | 13:49 |
| sdake | hrw you need to set your adress information - ican't see that in your public profile | 13:49 |
| flaper87 | hey folks, I noticed there's no kolla image for redis, is there a reason for that? Or is it just that it's not being used right now? | 13:50 |
| *** salv-orl_ has joined #openstack-kolla | 13:50 | |
| kfox1111 | sdake: I'm afraid it will probably be different for each gate. :/ | 13:50 |
| sdake | hrw cisco.webex.com/join/stdake | 13:50 |
| sdake | kfox1111 right- feed in what you know | 13:50 |
| kfox1111 | sdake: kolla-kubernetes multinic problem was in our iptables modifying code. | 13:50 |
| *** matrohon has joined #openstack-kolla | 13:50 | |
| kfox1111 | kk. | 13:50 |
| flaper87 | I'd be happy to work on it if it's ok | 13:50 |
| sdake | kfox1111 just have a conversation with him is all i ask :) | 13:50 |
| sdake | kfox1111 i could be imaginging this problem | 13:50 |
| sdake | flaper87 wfm :) needs a blueprint | 13:50 |
| openstackgerrit | Merged openstack/kolla-kubernetes master: Actually report gate failures for experimental jobs https://review.openstack.org/430708 | 13:51 |
| sdake | flaper87 link the blueprint and i'll be happy to approve | 13:51 |
| sdake | flaper87 or dan can approve | 13:51 |
| sdake | or any other driver | 13:51 |
| kfox1111 | yeah. Ill talk to him about it. | 13:51 |
| kfox1111 | I have no doubt rax was a problme at one point for sure, as their nic arangemnt is different from all the rest it seems. but once I fixed the logic that expected only one nic in the vm's, its been stable since. | 13:52 |
| hrw | fukc | 13:52 |
| kfox1111 | on the kolla-kubernetes side. | 13:52 |
| sdake | hrw you dont have to swear :) | 13:52 |
| sdake | hrw webex - i can wlak you through it - the signin process is annoying | 13:52 |
| *** salv-orlando has quit IRC | 13:52 | |
| sdake | webex has no signin proces showever - just join and go | 13:53 |
| *** sudipto has quit IRC | 13:53 | |
| *** sudipto_ has quit IRC | 13:53 | |
| hrw | joining | 13:53 |
| sdake | thanks hrw | 13:53 |
| sdake | kfox1111 - ok dude thats a huge peice of infromation | 13:53 |
| flaper87 | sdake: sounds perfect, I'll do it then | 13:53 |
| sdake | hrw steven.dake@gmail.com | 13:55 |
| kfox1111 | np. :) | 13:56 |
| *** zhurong has joined #openstack-kolla | 13:57 | |
| sdake | hrw can you hear me :) | 13:57 |
| hrw | no | 13:57 |
| sdake | hrw i can hear you | 13:57 |
| sdake | hrw who knows whats going on with that - i'll type you share :0 | 13:57 |
| *** imcsk8_ has joined #openstack-kolla | 13:57 | |
| *** imcsk8 has quit IRC | 13:58 | |
| sdake | hrw i dont see your shared screen | 13:58 |
| sdake | hrw ya its annoying al this tech :) | 13:58 |
| flaper87 | sdake: https://blueprints.launchpad.net/kolla/+spec/redis-container | 13:59 |
| sdake | hrw i do not | 13:59 |
| sdake | hrw i did seeit originally | 13:59 |
| flaper87 | sdake: do I have to write a spec under kolla/specs ? | 13:59 |
| sdake | hrw lets restart the call | 13:59 |
| sdake | hrw maybe a resync will get it going | 13:59 |
| sdake | flaper87 no spec needed | 13:59 |
| sdake | flaper87 will be with you in a moment | 13:59 |
| sdake | good that worked hrw | 13:59 |
| flaper87 | sdake: coolio, thanks | 14:00 |
| *** caowei has joined #openstack-kolla | 14:00 | |
| sbezverk | kfox1111: is there a easy way to access nova-compute.log at the gate? | 14:01 |
| kfox1111 | sbezverk: logs/openstack/container-name.txt | 14:01 |
| sbezverk | kfox1111: perfect, exactly what I needed | 14:03 |
| sbezverk | thank you | 14:03 |
| kfox1111 | np. | 14:06 |
| sdake | ok flaper87 moment | 14:06 |
| sdake | hrw see not that hard | 14:06 |
| sdake | hrw of course i've done that debug about 100+ timees :) | 14:06 |
| hrw | sdake: it's sick ;d | 14:06 |
| sbezverk | kfox1111: have yu seen this traceback before? http://logs.openstack.org/50/428150/54/check/gate-kolla-kubernetes-deploy-centos-binary-3-ceph-multi-nv/b8c6b77/logs/openstack/kolla-nova-scheduler-0.txt | 14:07 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: support non-x86 architectures (aarch64, ppc64le) https://review.openstack.org/430940 | 14:07 |
| hrw | https://review.openstack.org/430940 yay! | 14:07 |
| hrw | now have to add some reviewers | 14:07 |
| kfox1111 | sbezverk: no. that one's new to me. | 14:07 |
| sdake | flaper87 ok your all set to go | 14:08 |
| kfox1111 | sbezverk: if I had to guess, | 14:08 |
| sbezverk | kfox1111: there are a couple of trace backs 1 in nova compute and 1 in scheduler, very consistent | 14:08 |
| kfox1111 | I'd say it was due to no computes up. | 14:08 |
| sdake | hrw nice arm work :) | 14:08 |
| flaper87 | sdake: awesome! Thanks a bunch. I'm on it, should have something up soon | 14:08 |
| sdake | ok gotta jet for awhile to take kid to school and car to shop | 14:08 |
| sdake | flaper87 note the deadline for newton has pssed | 14:09 |
| hrw | sdake: I based on Sajauddin's work | 14:09 |
| flaper87 | sdake: u mean ocata ? | 14:09 |
| flaper87 | sdake: it's fine, Pike works | 14:09 |
| sdake | flaper87 apprently living in the past :) | 14:09 |
| sdake | ok really GTG :) | 14:09 |
| sbezverk | kfox1111: agree about compute, since it is also not too happy: http://logs.openstack.org/50/428150/54/check/gate-kolla-kubernetes-deploy-centos-binary-3-ceph-multi-nv/b8c6b77/logs/openstack/kolla-nova-compute-xv6dj.txt | 14:09 |
| flaper87 | sdake: no worries, I don't even know what day it is | 14:09 |
| sdake | flaper87 it is wednesday :) | 14:10 |
| flaper87 | that explains why no one has pinged me saying I'm late for a meeting | 14:10 |
| flaper87 | good | 14:10 |
| kfox1111 | sbezverk: keystone logs are a bit weird too. | 14:11 |
| kfox1111 | sbezverk: Please put a link in the etherpad if you haven't already. This is pretty strange. would be nice if we could correlate it if we see it again. | 14:13 |
| sbezverk | kfox1111: I think I know the problem. keystone internal end point points to keystone-internal:5000 instead of 35357 | 14:14 |
| sbezverk | kfox1111: http://logs.openstack.org/50/428150/54/check/gate-kolla-kubernetes-deploy-centos-binary-3-ceph-multi-nv/b8c6b77/ | 14:14 |
| kfox1111 | hmm.. I think thats the way it always was though? | 14:15 |
| *** goldyfruit has joined #openstack-kolla | 14:15 | |
| kfox1111 | I think only the admin server is 35357 | 14:15 |
| sbezverk | hm ok maybe you are right, I got mixed up with admin | 14:15 |
| kfox1111 | is the error consistent? | 14:16 |
| sbezverk | kfox1111: yes, even on gate check of master.. | 14:19 |
| *** mdnadeem has quit IRC | 14:19 | |
| sbezverk | at first I thought I introduced it, but then this monrning I saw exactly the same on sdake's gatecheck run | 14:19 |
| kfox1111 | hmm.. | 14:20 |
| kfox1111 | interesting. | 14:20 |
| kfox1111 | so maybe something changed in infra... | 14:20 |
| kfox1111 | any pattern to them? | 14:20 |
| kfox1111 | seen it on a non multi job? | 14:20 |
| *** crushil has joined #openstack-kolla | 14:23 | |
| sbezverk | kfox1111: nope only branch 3 | 14:23 |
| kfox1111 | weird. | 14:24 |
| kfox1111 | we haven't been testing branch 3 very long. could be some race conditions in it still, but would be weird for them to show up more commonly now. | 14:24 |
| kfox1111 | maybe something merged recently that made it worse? | 14:25 |
| *** lamt has joined #openstack-kolla | 14:26 | |
| sp_ | sdake: I think we should draft a BP in kolla-ansible too w.r.t redis-container BP in kolla | 14:28 |
| sp_ | sdake: we can set the target fir pike-2 once redis-container would be completed in pike-1 release | 14:28 |
| kfox1111 | so, got prometheus up and running. | 14:29 |
| sp_ | sdake: please provide your opinion on this | 14:29 |
| kfox1111 | very interesting. :) | 14:29 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart https://review.openstack.org/428150 | 14:30 |
| *** gfidente is now known as gfidente|afk | 14:32 | |
| hrw | can someone tell me was debian support ever working in kolla? | 14:33 |
| *** sayantani01 has joined #openstack-kolla | 14:35 | |
| sbezverk | kfox1111: in kolla-kube or just on your cluster? re prometius | 14:38 |
| kfox1111 | just in my cluster. | 14:39 |
| sbezverk | kfox1111: anything interesting you managed to do with it? | 14:40 |
| kfox1111 | But, was curious if we could slide this: https://github.com/prometheus/haproxy_exporter | 14:40 |
| kfox1111 | as a sidecar intno the api_python_deployments. | 14:40 |
| *** jtriley has joined #openstack-kolla | 14:41 | |
| kfox1111 | sbezverk: not too much yet. just got it running last night, plugged into graphite, and collecting metrics from an ingress. | 14:41 |
| kfox1111 | just trying to figure it all out at this point. I've used influxdb for a while, and its fairly different. | 14:41 |
| sbezverk | kfox1111: are you looking into use it for accounting purposes? I mean haproxy_exporter? | 14:42 |
| kfox1111 | more monitoring I think. should be able to gather stuff like when things die, if latency spikes, etc. | 14:44 |
| *** crushil has quit IRC | 14:44 | |
| *** crushil has joined #openstack-kolla | 14:45 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: support non-x86 architectures (aarch64, ppc64le) https://review.openstack.org/430940 | 14:48 |
| sbezverk | kfox1111: if you check https://review.openstack.org/430708 it fails exactly the same way on that job.. | 14:49 |
| openstackgerrit | Flavio Percoco proposed openstack/kolla master: Add redis container https://review.openstack.org/430976 | 14:52 |
| kfox1111 | ah. yeah. | 14:54 |
| *** sudipto has joined #openstack-kolla | 14:54 | |
| *** sudipto_ has joined #openstack-kolla | 14:54 | |
| kfox1111 | sbezverk: added a section to the etherpad at the bootom. | 14:56 |
| kfox1111 | lets start recording them there and see if we can spot a pattern. | 14:56 |
| sbezverk | kfox1111: sounds good, could you please paste etherpad again? | 14:57 |
| kfox1111 | https://etherpad.openstack.org/p/kolla-kubernetes-gate-failure-tracking | 14:57 |
| *** mgoddard_ has quit IRC | 14:57 | |
| zioproto | I am trying master, what is this fluentd ? can I disable it ? | 15:00 |
| *** duonghq has joined #openstack-kolla | 15:00 | |
| *** lamt has quit IRC | 15:01 | |
| *** tonanhngo has joined #openstack-kolla | 15:01 | |
| egonzalez | zioproto: nope, fluentd is the replacement for heka | 15:01 |
| *** tonanhngo has quit IRC | 15:02 | |
| zioproto | oh so there is a migration path ? | 15:02 |
| zioproto | I worked with stable/newton | 15:02 |
| zioproto | and how I am trying master | 15:02 |
| zioproto | what is a valid openstack_release: ? | 15:02 |
| zioproto | I had 3.0.2 | 15:03 |
| egonzalez | zioproto: upgrade process remove heka and put fluentd in place | 15:04 |
| zioproto | I have put openstack_release: auto and I get No module named pbr.version | 15:04 |
| *** adrian_otto1 has joined #openstack-kolla | 15:05 | |
| *** vcn has joined #openstack-kolla | 15:08 | |
| *** ipsecguy has joined #openstack-kolla | 15:08 | |
| *** vcn has quit IRC | 15:09 | |
| *** vcn has joined #openstack-kolla | 15:09 | |
| *** vcn has quit IRC | 15:10 | |
| *** vcn has joined #openstack-kolla | 15:11 | |
| *** lamt has joined #openstack-kolla | 15:12 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart https://review.openstack.org/428150 | 15:12 |
| *** jmccarthy has quit IRC | 15:12 | |
| sbezverk | kfox1111: have you seen any situation when all pods showed running but wait_for_pod was still waiting and then timeing out? | 15:13 |
| *** vcn has quit IRC | 15:14 | |
| kfox1111 | hmm.. | 15:15 |
| kfox1111 | I think it can be in that state if there's a job unfinished too. | 15:15 |
| sbezverk | kfox1111: well but then it would mean bootstrap is not done and one of pods would be in Init state | 15:18 |
| sbezverk | I do not see it | 15:19 |
| sbezverk | I added to wait_for _pod some extra output to see | 15:19 |
| sbezverk | kfox1111: check this log if you have a minute: http://logs.openstack.org/50/428150/56/experimental/gate-kolla-kubernetes-deploy-centos-binary-2-helm-compute-kit-nv/f847804/ | 15:19 |
| *** sacharya has joined #openstack-kolla | 15:20 | |
| *** dave-mccowan has quit IRC | 15:20 | |
| *** adrian_otto1 is now known as adrian_otto | 15:21 | |
| kfox1111 | got the ceph_exporter working too. :) | 15:21 |
| kfox1111 | looking | 15:22 |
| kfox1111 | heh. that kind of locked up my browser... | 15:25 |
| *** saneax-_-|AFK is now known as saneax | 15:25 | |
| kfox1111 | sbezverk: the Restarts are interesting., | 15:26 |
| kfox1111 | may imply the deps aren't working quite right. | 15:27 |
| *** krtaylor has quit IRC | 15:28 | |
| *** jmccarthy has joined #openstack-kolla | 15:29 | |
| *** fragatina has quit IRC | 15:30 | |
| *** fragatina has joined #openstack-kolla | 15:30 | |
| *** caowei has quit IRC | 15:31 | |
| *** caowei has joined #openstack-kolla | 15:31 | |
| *** huzhengchuan has joined #openstack-kolla | 15:31 | |
| sbezverk | kfox1111: yeah :( when you checked logs for processes which restarted 5 time | 15:32 |
| sbezverk | you will see that it failed to contact mariadb first few time | 15:32 |
| sbezverk | and it should not happen | 15:32 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart https://review.openstack.org/428150 | 15:34 |
| *** krtaylor has joined #openstack-kolla | 15:38 | |
| *** dave-mccowan has joined #openstack-kolla | 15:38 | |
| *** duonghq has quit IRC | 15:39 | |
| *** saneax is now known as saneax-_-|AFK | 15:40 | |
| openstackgerrit | Merged openstack/kolla-kubernetes master: python 3.5 is enabled in tox environment https://review.openstack.org/416880 | 15:46 |
| *** duonghq__ has joined #openstack-kolla | 15:48 | |
| *** duonghq__ is now known as Duonghq | 15:48 | |
| *** Duonghq is now known as duonghq | 15:49 | |
| Jeffrey4l | egonzalez, around? any progress for nova upgrade about cellv2 issue? | 15:49 |
| egonzalez | Jeffrey4l: have some ideas, but not really sure. i've asked at nova channel but nobody answered | 15:54 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart https://review.openstack.org/428150 | 15:54 |
| Jeffrey4l | ok. thanks | 15:54 |
| egonzalez | Jeffrey4l: i've created a chart with implications of different scenarios https://www.lucidchart.com/publicSegments/view/72b23206-48af-4c8b-826b-5dbe4c9cfac9/image.png | 15:55 |
| *** huzhengchuan has quit IRC | 15:56 | |
| sp_ | egonzalez: drafted a BP https://blueprints.launchpad.net/kolla-ansible/+spec/redis-container-ansible-role | 15:56 |
| sp_ | egonzalez: please take a look | 15:57 |
| *** eaguilar has joined #openstack-kolla | 15:57 | |
| *** inc0 has joined #openstack-kolla | 15:57 | |
| *** adrian_otto has quit IRC | 15:57 | |
| egonzalez | sp_: for what will be used redis? | 15:57 |
| inc0 | good mornign | 15:57 |
| Jeffrey4l | egonzalez, have u tried the third one? "create cells with ocata" | 15:58 |
| sp_ | egonzalez: redis container would be supported by kolla deliverable | 15:58 |
| egonzalez | db_sync fails without cells db | 15:58 |
| sp_ | egonzalez: so need to add role too in kolla-ansible deliverable too | 15:58 |
| inc0 | meeting time | 15:58 |
| sp_ | inc0: morning | 15:58 |
| sdake | './lsup peeps | 15:58 |
| sdake | sp_ i dont know if redis would be used by ansible deployment or not - generally we try to add containers for generally useful things related to deployment | 15:59 |
| Jeffrey4l | feel nova leave a bomb there. | 15:59 |
| sdake | flaper87 may be able to add more context as to the technical need for redis | 16:00 |
| sdake | Jeffrey4l which bomb - you mean mess? :) | 16:00 |
| Jeffrey4l | nova cell creation. | 16:00 |
| Jeffrey4l | nova cell v2 creation during upgrade from newton to ocata. | 16:00 |
| sp_ | sdake: confirming with egonzalez for its feasibility | 16:01 |
| duonghq | Do we have weekly meeting? | 16:01 |
| Jeffrey4l | we may have to handle the database change during upgrade. | 16:01 |
| *** vhosakot has joined #openstack-kolla | 16:01 | |
| Jeffrey4l | duonghq, it is started ;) | 16:01 |
| *** schwicht has joined #openstack-kolla | 16:01 | |
| sp_ | duonghq: yes inc0 is here | 16:01 |
| egonzalez | Jeffrey4l: i don't know the implications of creating default cell in nova_api_cell0 in upgrade. will that give any issue for future versions? | 16:02 |
| *** srwilkers has joined #openstack-kolla | 16:02 | |
| Jeffrey4l | nova_api_cell0 is the default name in newton and nova_cell0 is the default name in ocata. | 16:02 |
| Jeffrey4l | we have to change the name during upgrade. | 16:03 |
| Jeffrey4l | it is not confirgurable. | 16:03 |
| * flaper87 here | 16:06 | |
| flaper87 | what did I do? | 16:06 |
| *** unicell has joined #openstack-kolla | 16:07 | |
| sp_ | flaper87: meeting started | 16:07 |
| flaper87 | My need for the redis image is ceilometer and zaqar | 16:07 |
| sdake | flaper87 you did nothign wrong | 16:07 |
| sdake | flaper87 cool thanks for adding the context on the reason for redis | 16:07 |
| sdake | flaper87 would you mind adding that to the blueprint pls | 16:08 |
| flaper87 | I can add it on the review/bp if needed | 16:08 |
| *** penfold has joined #openstack-kolla | 16:08 | |
| *** duonghq_ has joined #openstack-kolla | 16:08 | |
| flaper87 | yes | 16:08 |
| flaper87 | actually, I think I did | 16:08 |
| flaper87 | should be in the bp already | 16:08 |
| sdake | oh i guess i missed it :) | 16:08 |
| flaper87 | I forgot to link the bp | 16:08 |
| * flaper87 dumb | 16:08 | |
| *** unicell1 has quit IRC | 16:08 | |
| sdake | idc if people add stuff to kolla deliverable if it is useful in general - within limits :) | 16:08 |
| *** mgoddard has joined #openstack-kolla | 16:08 | |
| mgoddard | #openstack-meeting-4 | 16:08 |
| sdake | othes may feel differently | 16:08 |
| *** duonghq is now known as duonghq__ | 16:09 | |
| sdake | we have our team meeting atm in #openstack-meeting-4 now tho flaper87 so gtg - your wellcoemt o listen in | 16:09 |
| *** duonghq_ is now known as duonghq | 16:09 | |
| * flaper87 lurks | 16:09 | |
| openstackgerrit | Flavio Percoco proposed openstack/kolla master: Add redis container https://review.openstack.org/430976 | 16:09 |
| egonzalez | flaper87: good enough, just wanted to know the usage. | 16:11 |
| flaper87 | egonzalez: cool, does that address your questions on the review? | 16:11 |
| egonzalez | flaper87: qq, wont need python-redis package, i had some issues before iirc | 16:11 |
| flaper87 | Hopefully I didn't misunderstand the use of the profiles in conf.py | 16:11 |
| flaper87 | egonzalez: you probably need that in the zaqar image | 16:12 |
| flaper87 | and the ceilometer one | 16:12 |
| flaper87 | but it's already a dependency for the packages | 16:12 |
| flaper87 | so it should be good | 16:12 |
| flaper87 | and it's listed in the requirements | 16:12 |
| flaper87 | iirc | 16:12 |
| egonzalez | flaper87: cool, tell me under zaqar PS and will match to redis too. I have to rework the whole role and modify docker images too | 16:13 |
| openstackgerrit | Flavio Percoco proposed openstack/kolla master: Add redis container https://review.openstack.org/430976 | 16:14 |
| openstackgerrit | Flavio Percoco proposed openstack/kolla master: Add redis container https://review.openstack.org/430976 | 16:15 |
| *** matrohon has quit IRC | 16:15 | |
| *** adrian_otto has joined #openstack-kolla | 16:16 | |
| *** salv-orl_ has quit IRC | 16:19 | |
| *** david-lyle has joined #openstack-kolla | 16:23 | |
| *** Pavo has joined #openstack-kolla | 16:24 | |
| *** zhurong has quit IRC | 16:25 | |
| *** unicell has quit IRC | 16:25 | |
| *** saneax-_-|AFK is now known as saneax | 16:26 | |
| sp_ | egonzalez: what about redis ansible role ? | 16:27 |
| egonzalez | sp_: good enough, just wanted to know the usage. (missed the name before) | 16:29 |
| *** fragatina has quit IRC | 16:29 | |
| sp_ | egonzalez: please approve the same https://blueprints.launchpad.net/kolla-ansible/+spec/redis-container-ansible-role | 16:30 |
| *** fragatina has joined #openstack-kolla | 16:30 | |
| flaper87 | egonzalez: thanks for the review, could you help me understand those configs a bit better? | 16:33 |
| *** sayantan_ has joined #openstack-kolla | 16:33 | |
| egonzalez | flaper87: when you do kolla-build can select a profile to build(default, aux, gate) | 16:33 |
| egonzalez | and don't need to do kolla-build nova haproxy neutron etc | 16:34 |
| openstackgerrit | Flavio Percoco proposed openstack/kolla master: Add redis container https://review.openstack.org/430976 | 16:34 |
| flaper87 | egonzalez: ah, right! Now I got it #dumb | 16:34 |
| flaper87 | egonzalez: ok, I've addressed your comments | 16:34 |
| flaper87 | thanks again | 16:34 |
| *** sdake_ has joined #openstack-kolla | 16:36 | |
| *** sayantani01 has quit IRC | 16:36 | |
| *** sdake has quit IRC | 16:38 | |
| *** caowei has quit IRC | 16:38 | |
| *** sayantan_ has quit IRC | 16:39 | |
| sp_ | egonzalez: ^^ | 16:40 |
| *** zioproto has quit IRC | 16:40 | |
| *** zhubingbing has quit IRC | 16:43 | |
| *** prameswar has quit IRC | 16:50 | |
| *** david-lyle has quit IRC | 16:52 | |
| *** Guest66676 is now known as Guest6666 | 16:53 | |
| *** sacharya has quit IRC | 16:54 | |
| *** sacharya has joined #openstack-kolla | 16:54 | |
| *** salv-orlando has joined #openstack-kolla | 16:54 | |
| *** tonanhngo has joined #openstack-kolla | 16:56 | |
| *** tonanhngo has quit IRC | 16:56 | |
| Jeffrey4l | gema krtaylor another question: does binary with static build works on ppc? ( guess no ) | 16:59 |
| gema | Jeffrey4l: I work on ARM64, krtaylor on ppc :D | 17:00 |
| gema | Jeffrey4l: and this patch was done by hrw so i'd say | 17:00 |
| gema | hrw: ^ | 17:00 |
| gema | Jeffrey4l: he'll reply when he is back :D | 17:00 |
| Jeffrey4l | thanks. | 17:00 |
| *** egonzalez has quit IRC | 17:00 | |
| gema | Jeffrey4l: but what do you mean by a binary with static build? | 17:01 |
| gema | you mean built for ppc or for intel? | 17:01 |
| Jeffrey4l | gema, check this https://github.com/krallin/tini#statically-linked-version | 17:02 |
| krtaylor | Jeffrey4l, as I understand there are IBMers that have made this work for ppc64, but I have not verified...yet | 17:02 |
| Jeffrey4l | how can u get openstack packages on arm? ubuntu/debian provide it? or build it by you own. | 17:02 |
| Jeffrey4l | krtaylor, thanks. just curiosity ;) | 17:03 |
| gema | Jeffrey4l: we have a built and tested openstack package set | 17:03 |
| gema | Jeffrey4l: for centos and debian | 17:03 |
| gema | Jeffrey4l: ubuntu provides their own | 17:03 |
| Jeffrey4l | cool. | 17:03 |
| krtaylor | Jeffrey4l, understood, I want to make sure you get an answer | 17:03 |
| gema | Jeffrey4l: https://platforms.linaro.org/documentation/Reference-Platform/Platforms/Enterprise/Documentation/OpenStack/README.md/ | 17:03 |
| hrw | Jeffrey4l: hi | 17:04 |
| gema | thats for ARM64 | 17:04 |
| *** sayantani01 has joined #openstack-kolla | 17:04 | |
| Jeffrey4l | hi hrw | 17:04 |
| gema | I leave you in good hands, EOD for me :D | 17:04 |
| krtaylor | likewise for ppc64le, centos/RDO is there, as is ubuntu | 17:05 |
| hrw | Jeffrey4l: https://hub.docker.com/u/ppc64le/ | 17:05 |
| hrw | krtaylor: for arm64 we will use rdo too | 17:05 |
| Jeffrey4l | hrw, cool. | 17:05 |
| krtaylor | excellent | 17:05 |
| hrw | Jeffrey4l: I am waiting for official aarch64/centos7 image - will be provided on days | 17:06 |
| Jeffrey4l | then {{ base_arch }}/{{ base_image }}:{{ base_distro_tag }} is not good imo. | 17:06 |
| krtaylor | yeah, I was just looking at that also | 17:07 |
| *** duonghq has quit IRC | 17:08 | |
| hrw | Jeffrey4l: I used that from ppc64le patch | 17:08 |
| *** sayantani01 has quit IRC | 17:09 | |
| hrw | and with clean docker and that patch I build 25 containers from base | 17:09 |
| Jeffrey4l | hrw, krtaylor i left another comment about this. | 17:10 |
| krtaylor | yeah, thats the other folks that popped up and did this for ppc64le, not part of our openstack ppc64 team | 17:10 |
| hrw | Jeffrey4l: not agree with comment | 17:10 |
| krtaylor | I need to review that one also, on my list | 17:10 |
| krtaylor | getting basic understand of the project atm | 17:10 |
| krtaylor | understanding | 17:11 |
| hrw | Jeffrey4l: current state allows you to say --base-arch aarch64 and then you get aarch64. if someone wants to add arm (as arm 32bit) then it does nt have to play with dockerfile.j2 at all as it will just be used. | 17:11 |
| hrw | or any other arch | 17:11 |
| *** sayantani01 has joined #openstack-kolla | 17:11 | |
| *** david-lyle has joined #openstack-kolla | 17:12 | |
| hrw | Jeffrey4l: and setting conf.base_image is just wrong imho. | 17:12 |
| krtaylor | I need to look at how we did this for other projects | 17:12 |
| Jeffrey4l | hrm. ok... | 17:12 |
| krtaylor | just trying to get a sandbox working and get up to speed for longer-term kolla involvement | 17:12 |
| hrw | I am against hardcoding things | 17:12 |
| Jeffrey4l | as far as i know, kolla do not support 32bit. | 17:13 |
| hrw | Jeffrey4l: so make it s390x? | 17:13 |
| *** sayantani01 has quit IRC | 17:13 | |
| hrw | or any other 64bit? mips64? ia64? riscv64? | 17:13 |
| Jeffrey4l | i do not mark it hard coding. | 17:14 |
| Jeffrey4l | but "FROM {{ base_arch }}/{{ base_image }}:{{ base_distro_tag }}" does | 17:14 |
| *** sayantani01 has joined #openstack-kolla | 17:14 | |
| hrw | less than code from your last comment | 17:14 |
| Jeffrey4l | why my last comment does? | 17:14 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding compute-kit chart https://review.openstack.org/428150 | 17:14 |
| Jeffrey4l | base_image is configurable. base_arch is too. | 17:15 |
| hrw | ok, let me look other way at it | 17:16 |
| hrw | still not fully used to that code | 17:16 |
| Jeffrey4l | base_image parameter is introduced to support power cpu. | 17:17 |
| *** sayantani01 has quit IRC | 17:20 | |
| hrw | Jeffrey4l: so how would you use it? | 17:20 |
| hrw | kolla --base centos --base_image ppc64le/centos? | 17:20 |
| hrw | (assuming that ppc64le/centos exists) | 17:21 |
| *** dciabrin has quit IRC | 17:21 | |
| Jeffrey4l | hrw, yep. | 17:22 |
| Jeffrey4l | hrw check http://lists.openstack.org/pipermail/openstack-dev/2016-April/093057.html | 17:22 |
| *** Serlex has quit IRC | 17:22 | |
| hrw | Jeffrey4l: ok, sound fine for me. just have to expand --base-image help entry to mark that | 17:24 |
| hrw | "kolla --base centos --base_image aarch64/centos7 --base_arch aarch64" | 17:24 |
| Jeffrey4l | yep. | 17:24 |
| cliles | anyone know why the designate-ui from horizon was reverted? | 17:24 |
| hrw | Jeffrey4l: thanks for comments | 17:24 |
| Jeffrey4l | np. | 17:24 |
| * krtaylor reads scrollback | 17:25 | |
| Jeffrey4l | cliles, long story. but you can add it now again. :) | 17:25 |
| cliles | Jeffrey4l: yes, if I add it back it works fine | 17:26 |
| cliles | with a source build.... | 17:26 |
| Jeffrey4l | cliles, have u put the patch? | 17:26 |
| Jeffrey4l | we can merge it now. | 17:26 |
| krtaylor | Jeffrey4l, thanks for the link, that gives me someone to go talk to about getting my ppc64 env up and going :) | 17:27 |
| Jeffrey4l | krtaylor, np. lol | 17:27 |
| Jeffrey4l | seems they have set ppc64 up | 17:27 |
| krtaylor | yes, now I need to make sure it stays that way, so I'll be around :) | 17:29 |
| hrw | --base-image BASE_IMAGE | 17:30 |
| hrw | The base image name. Default is the same with base. | 17:30 |
| hrw | For non-x86 architectures use full name like | 17:30 |
| hrw | "aarch64/debian". | 17:30 |
| hrw | I can work with that ;D | 17:30 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: support non-x86 architectures (aarch64, ppc64le) https://review.openstack.org/430940 | 17:32 |
| *** bmace_ has joined #openstack-kolla | 17:32 | |
| hrw | Jeffrey4l: your comments implemented. patch got even smaller now | 17:33 |
| Jeffrey4l | nice | 17:33 |
| *** sayantani01 has joined #openstack-kolla | 17:34 | |
| Jeffrey4l | could u add the default base_image for ppc? like what my comment proposed? | 17:35 |
| Jeffrey4l | hrw | 17:35 |
| hrw | Jeffrey4l: ppc64le support for ubuntu required more than just setting default to ubuntu (at least according to original pp64le patch) | 17:37 |
| hrw | Jeffrey4l: I prefer to make smallest steps. if ppc64le needs default to be !default (==centos) then they are free to put patch after that one | 17:38 |
| Jeffrey4l | add default base-image make it works with simple "tools/build.py" | 17:38 |
| *** adrian_otto1 has joined #openstack-kolla | 17:39 | |
| Jeffrey4l | add these logical, the end-user still free to use his own base-image. | 17:39 |
| Jeffrey4l | see the outer if not conf.base_image condition? | 17:39 |
| openstackgerrit | Sayantani Goswami proposed openstack/kolla master: Fix pushing images to local registry https://review.openstack.org/426338 | 17:40 |
| hrw | Jeffrey4l: the proper play for that would be rather setting of _CLI_OPTS as this is where centos is set as default | 17:40 |
| *** mgoddard has quit IRC | 17:40 | |
| hrw | Jeffrey4l: and that's also changing tool defaults just because someone prefers other values | 17:41 |
| hrw | Jeffrey4l: should I add 'if aarch64 then go for debian' etc? | 17:41 |
| Jeffrey4l | hrm i think so. | 17:41 |
| Jeffrey4l | this make arch64 more easier to use and have nothing else side effect. | 17:42 |
| hrw | user X will install kolla, read docs ("default base is centos"), run tool and go for other tasks. few hours later will see wrong distro built | 17:42 |
| *** adrian_otto has quit IRC | 17:42 | |
| hrw | Jeffrey4l: why not hardcode "from mindreading import userdefaults"? | 17:43 |
| Jeffrey4l | sorry? | 17:43 |
| hrw | Jeffrey4l: x86-64 goes for centos, ppc64le goes for ubuntu, aarch64 goes debian, mips64 will went for yetanotherthing. Hate to be the one who has to write docs for it | 17:44 |
| Jeffrey4l | this is how kolla works now. | 17:45 |
| hrw | Jeffrey4l: kolla knows only x86-64. | 17:45 |
| hrw | NOTHING else | 17:45 |
| hrw | if potental ppc64le maintainer wants to have own defaults then I can +1 his changes. but do not want to have it in my patch | 17:46 |
| Jeffrey4l | if no. the writer will add" if you are build ppc64le, try "build.py --base-image xxx --base-arch ppc64" if you are building arm, try "build.py --base-image yyy --base-arch arm" | 17:46 |
| *** sudipto has quit IRC | 17:46 | |
| *** sudipto_ has quit IRC | 17:46 | |
| *** Pavo has quit IRC | 17:46 | |
| Jeffrey4l | hrw, aren't u trying to make kolla know ppc or arm? | 17:47 |
| hrw | now you run kolla and you have centos/x86-64 as defaults. if you run on aarch64 you get 'gtfo with this arch'. same on any other | 17:47 |
| hrw | Jeffrey4l: not arm. aarch64 (aka arm64) | 17:47 |
| hrw | Jeffrey4l: ppc64le is listed in ONE place in whole patch. just because someone started working on it. | 17:47 |
| hrw | aarch64 is mentioned in two. one of them is help text | 17:48 |
| hrw | I would write that patch same way for any other architecture | 17:48 |
| Jeffrey4l | anyway, just give u some advice ;) | 17:50 |
| hrw | Jeffrey4l: and -1 too ;D | 17:50 |
| Jeffrey4l | removed it. | 17:51 |
| hrw | thx | 17:51 |
| *** adrian_otto1 has quit IRC | 17:51 | |
| hrw | Jeffrey4l: if I would like to make aarch64 == debian by default I would do that in separate patch as well. | 17:51 |
| Jeffrey4l | ok. | 17:52 |
| *** adrian_otto has joined #openstack-kolla | 17:53 | |
| hrw | adding debian support will be interesting... | 17:54 |
| sdake_ | portdirect i am transitioning away from lastpass even though all the cool kids are using it and instead transitioning to google passwords since it theoretically should be more secure than the plaintext lastpss stores their databases in and the sloopy technical support nerds who give out passwords to random strangers for non-essential services | 18:00 |
| bmace_ | sdake_: if there were major security concerns about lastpass i would be surprised if i wouldn't have read about it on slashdot / reddit. have any links with relevant data? | 18:02 |
| sdake_ | bmace_ just hearsay | 18:03 |
| jascott1 | centralized storage of everyones passwords... what could go wrong | 18:03 |
| sdake_ | bmace_ i also disliek how it forces all passwords to be saved and doesn't offer a no-save option in the latest upgrade - which i find mandatory for very specific services to which I need my password memoried | 18:04 |
| sdake_ | jascott1 right ;) | 18:04 |
| bmace_ | sdake_: lol, well, don't believe everything you hear :) with how many people use it, if there were real concerns i think it would be a little more well known. | 18:04 |
| *** mannamne has quit IRC | 18:04 | |
| sdake_ | bmace_ my other concern remains unanswered -and google passwords does permit a "never save" option :) | 18:04 |
| sdake_ | bmace_ i'd like to transition off of all these password rememberance services and just have 3 paswords - 1 = critical services, 2 = important services, 3 = junk services | 18:05 |
| sbezverk | jascott1: qq in go struct, is there a way easily to get element label? | 18:05 |
| sdake_ | for the 1 category i memorize my passwords | 18:05 |
| bmace_ | sdake_: sure.. then if somehow your critical services password is discovered, keylogger, whatever.. they can now get into all your critical services.. | 18:05 |
| jascott1 | i only stress over ones that dont have recovery | 18:05 |
| sdake_ | and use strong passwords as per https://www.usenix.org/system/files/1401_08-12_mickens.pdf | 18:06 |
| sdake_ | jascott1 there are things i need secured (e.g. banking, medical records, etc) that i dont want in any centralized password store | 18:07 |
| portdirect | Mossad, sdake, doing mossad things... | 18:07 |
| jascott1 | i hear ya | 18:07 |
| sdake_ | portdirect media FTL :( | 18:07 |
| sdake_ | bmace_ you assume i use the same password for each category of #1 :) | 18:07 |
| jascott1 | sdake_ element label? you mean a struct property name? | 18:08 |
| sdake_ | jascott1 was that a misfire :) | 18:08 |
| jascott1 | if its unknown struct prop reflect pg | 18:08 |
| jascott1 | pg | 18:08 |
| jascott1 | !@#$ | 18:08 |
| openstack | jascott1: Error: "@#$" is not a valid command. | 18:08 |
| jascott1 | pkg | 18:08 |
| bmace_ | sdake_: you said you wanted 3 passwords, so not a terrible assumption on my part :P | 18:08 |
| jascott1 | have to agree the 3 passwds sounds risky | 18:09 |
| portdirect | I've not reviewed last pass sec policy, but I remember going meh last time I did. For all my really important things I've a magical amulet and use the super secure combination "Password123" | 18:09 |
| sdake_ | bmace_ oh right, well I guess I didn't want to give away all my secrets :) | 18:09 |
| *** unicell has joined #openstack-kolla | 18:09 | |
| sdake_ | portdirect really does use Password123 - I've seen it :) | 18:09 |
| jascott1 | i like to use my own algorithm | 18:10 |
| jascott1 | for pass gen | 18:10 |
| portdirect | Dude, don't lie: that was password1234 I gave you | 18:10 |
| sdake_ | portdirect oh right - my memory is fuzzy :) | 18:10 |
| portdirect | (It actually was as well) | 18:10 |
| bmace_ | the 4 foils the hackers every time.. smart! :) | 18:10 |
| portdirect | Yeah, my policy is either "don't care" or your gonna have a really bad time | 18:11 |
| bmace_ | even better, make it 125.. a little monty python in there! | 18:12 |
| *** srwilkers has quit IRC | 18:12 | |
| portdirect | bmace_: you know the score :) | 18:13 |
| jascott1 | remember to password storage systems can keep your password a secret if one of them doesnt exist | 18:15 |
| sbezverk | jascott1: example type a struct { a string / b int} I would like to be able to get 'a' | 18:15 |
| sbezverk | not it is value but property name not sure how correctly call it | 18:15 |
| jascott1 | sbezverk but you are asking ' i would like to know a exists though I dont know what props the struct has' or 'how do I access prop a on my struct'? | 18:16 |
| jascott1 | s := &mysruct{a: "asd", b: 1} | 18:17 |
| jascott1 | fmt.Printf("a %v", mysruct.a) | 18:18 |
| sbezverk | jascott1: man I want to use "a" as a key in the map to retrive from the map value which need to go into the struct. I do not want to type a: map["a"] | 18:18 |
| jascott1 | you want to dynaically name struct properties based on map key? | 18:18 |
| sbezverk | I would like to use map[varA] where varA would have "a" as a value | 18:18 |
| sbezverk | yep | 18:18 |
| jascott1 | need codegen maybe | 18:19 |
| sbezverk | oh so there is no known easy solution :( | 18:19 |
| jascott1 | idk I havent tried to make struct on the fly | 18:19 |
| jascott1 | wouldnt take my word for it | 18:19 |
| jascott1 | i will look into it, is there a PS dealing with this i can look at? | 18:20 |
| sbezverk | I would think when you deal with large structures, it would have been already solved ;) | 18:20 |
| jascott1 | why does the struct have to be dynamic? its basically a class in oop parlance would you use a class todo what you are trying to accomplish? | 18:20 |
| sdake_ | kfox1111 are you about | 18:21 |
| krtaylor | hrw, just got a chance to read back through the follow-on discussion, I am fine with your proposed approach from what I know so far (yes, I'll add that to my review) | 18:21 |
| sbezverk | jascott1: example when you instantiate struct record | 18:21 |
| sbezverk | if you have 20-30 elements in struct, that would take 30 line | 18:22 |
| sbezverk | would be more elegant to do it in loop | 18:22 |
| sdake_ | kfox1111 i hope you dont mind me taking over that gate patch, i think it will help take some burden off you | 18:22 |
| jascott1 | why so many elements? | 18:22 |
| sdake_ | kfox1111 and also help me learn how the gate works :) | 18:22 |
| jascott1 | sounds like you need a .values that holds a map | 18:22 |
| sbezverk | jascott1: ok thanks I will think about it | 18:23 |
| sdake_ | kfox1111 you wlil notice i went thorugh about 10 patchsets before i figured out the gate doesn't use a registry at all | 18:23 |
| sdake_ | kfox1111 good way to learn how the software works | 18:23 |
| openstackgerrit | Merged openstack/kolla-ansible master: Remove Zaqar doc link in README.rst https://review.openstack.org/430714 | 18:27 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding compute-kit chart https://review.openstack.org/428150 | 18:28 |
| openstackgerrit | Merged openstack/kolla-ansible master: Fix BASEDIR to package Kolla with snapcraft.io https://review.openstack.org/426703 | 18:30 |
| openstackgerrit | Merged openstack/kolla-ansible master: Using yaml.safe_load instead of yaml.load https://review.openstack.org/430535 | 18:31 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 18:33 |
| sbezverk | sdake_: I would appreciate if you could hold with gate modifications. I am almost done with my refactor. | 18:34 |
| sdake_ | sbezverk i'll be happy to rebase | 18:34 |
| sdake_ | sbezverk my changes are small | 18:34 |
| sdake_ | sbezverk i would appreciate reviews however | 18:34 |
| sbezverk | sdake_: the code you put in setup_gate is gone in my version | 18:34 |
| sdake_ | sbezverk again i'll be happy to rebase | 18:34 |
| *** rwallner has joined #openstack-kolla | 18:35 | |
| sdake_ | sbezverk rebase to me means taking a peice of work and making it work in whatever is in master | 18:35 |
| *** qwang has quit IRC | 18:35 | |
| *** portdirect has quit IRC | 18:35 | |
| *** robcresswell has quit IRC | 18:35 | |
| *** duonghq__ has quit IRC | 18:35 | |
| *** erlon has quit IRC | 18:35 | |
| sdake_ | sbezverk would still appreciate reviews :) | 18:35 |
| sdake_ | sbezverk +1 is sufficient | 18:35 |
| sdake_ | (or -1) | 18:35 |
| *** sindhu has quit IRC | 18:35 | |
| sdake_ | irccloud just crashed - roflcopter ;) | 18:36 |
| rwallner | question for the channel, deploying kolla newton branch with cinder+ceph, i noticed cinder-volume gets deployed on every [storage] inventory node, are multiple cinder-volume processes normal or is it using any of the active/active cinder config | 18:36 |
| sdake_ | sbezverk you will notice i added many comments to the review when you review it | 18:36 |
| sdake_ | sbezverk comments are a thing and help people understand the code :) | 18:36 |
| sdake_ | sbezverk if it takes all your brainpower to write it, it takes double that from someone else to understand it | 18:37 |
| *** SaMnCo has quit IRC | 18:37 | |
| *** ediardo has quit IRC | 18:37 | |
| *** DuncanT has quit IRC | 18:37 | |
| *** macsz has quit IRC | 18:37 | |
| *** akwasnie has quit IRC | 18:37 | |
| *** kong has quit IRC | 18:37 | |
| *** turvey has quit IRC | 18:37 | |
| sdake_ | wow lots of pplz use irccloud | 18:40 |
| sdake_ | sbezverk by commenting, you reduce the brainpower to understand to be equivalent to the brainpower of the author (in theory) | 18:41 |
| sdake_ | sbezverk the net effect is the community grows as a result | 18:41 |
| openstackgerrit | Michal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Release note for reconfiguration optimizaiton https://review.openstack.org/431107 | 18:42 |
| *** greenlight_ has joined #openstack-kolla | 18:43 | |
| *** berendt has quit IRC | 18:45 | |
| *** serverascode has quit IRC | 18:45 | |
| *** aimeeu has quit IRC | 18:45 | |
| *** NachoDuck has quit IRC | 18:45 | |
| *** NobodyCam has quit IRC | 18:45 | |
| *** hogepodge has quit IRC | 18:45 | |
| *** tonanhngo has joined #openstack-kolla | 18:45 | |
| sdake_ | sbezverk note this gate failure: http://logs.openstack.org/08/430708/1/check/gate-kolla-kubernetes-deploy-centos-binary-3-ceph-multi-nv/c7cf47d/console.html | 18:45 |
| inc0 | sdake_,yeah, lots of people;) | 18:45 |
| sdake_ | it seems as though 3.0.2 image's config is broken with nova | 18:45 |
| sbezverk | sdake_: what about it? | 18:45 |
| sdake_ | I asked Jeffrey4l to analyze it yesterday to which he did and indicated its a nova configuration problem | 18:46 |
| sdake_ | sbezverk any idea where I should begin to sort it out? | 18:46 |
| *** vhosakot has quit IRC | 18:46 | |
| sbezverk | sdake_: kfox1111 and I chatted about it earler. it seems keystone url in nova config is broken | 18:47 |
| sdake_ | sbezverk cool can you chat about it on the channel so I can read about it :) | 18:47 |
| *** sambetts is now known as sambetts|afk | 18:47 | |
| *** tonanhngo has quit IRC | 18:47 | |
| sdake_ | here is the irc log from Jeffrey4l 's analysis: http://eavesdrop.openstack.org/irclogs/%23openstack-kolla/%23openstack-kolla.2017-02-08.log.html#t2017-02-08T07:29:30 | 18:47 |
| sbezverk | sdake_: it should be in the scroll back | 18:48 |
| *** tonanhngo has joined #openstack-kolla | 18:48 | |
| sdake_ | sbezverk ahh ok cool - i guess i missed it this morning - my bad | 18:48 |
| sdake_ | this morning was super hectic, hd to drop off vehicle nd get two kids to school on time in a 1 hour window | 18:48 |
| sdake_ | note i demoted the trunk gate job to experimental here: https://review.openstack.org/#/c/430704/ | 18:49 |
| sdake_ | as it is unimplemented | 18:49 |
| sdake_ | sbezverk where is your gate rework patch - i'll be happy to review (if I can understand it) | 18:50 |
| *** vhosakot has joined #openstack-kolla | 18:50 | |
| sdake_ | sbezverk strugglign to find your gate refactor patch - you mention it in review https://review.openstack.org/#/c/426598/23 however I don't see a link to it nor the change ID | 18:53 |
| openstackgerrit | Merged openstack/kolla-ansible master: Use neutron user in neutron_lbaas.conf and overwrite defaults https://review.openstack.org/425150 | 18:55 |
| bmace_ | sdake_: for some reason the bash script ceph_workflow_service.sh exits right after the endpoint_test.sh line even though it was successful.. i'm not like a super bash guy.. no clue why that might be happening. | 18:55 |
| bmace_ | sdake_: other than that i think the review is there, other than writing up a doc. | 18:56 |
| openstackgerrit | Merged openstack/kolla-ansible master: adds ovs-dpdkctl tool https://review.openstack.org/408871 | 18:56 |
| sdake_ | bmace_ i'm not really a bash dude either | 18:56 |
| *** greenlight_ has left #openstack-kolla | 18:56 | |
| openstackgerrit | Borne Mace proposed openstack/kolla-kubernetes master: WIP: Added support for containerized dev bringup https://review.openstack.org/429295 | 18:56 |
| sdake_ | ther eis a way to get debug however | 18:56 |
| sdake_ | LMTGFU :) | 18:56 |
| bmace_ | sdake_: i had a similar issue with pkill helm stopping the whole script... i just nuked the pkill since we should be starting up in a fresh environment anyway and that fixed it.. i can't really do the same with the endpoint test.. i mean i could, but would rather have it in there as it seems useful. | 18:57 |
| sdake_ | let me look at the code first - got a line # in particular | 18:57 |
| bmace_ | sdake_: 119 in the latest ceph_workflow_service.sh in my review | 18:58 |
| bmace_ | sdake_: no real changes around there or even in that script vs. upstream so... odd | 18:58 |
| sdake_ | bmace_ so endpoint_test.sh fails? | 18:59 |
| sdake_ | moment - let me look at repo | 19:00 |
| bmace_ | sdake_: no, the test succeeds, then the script exits before the next line :/ | 19:00 |
| sbezverk | sdake_: https://review.openstack.org/#/c/428150/61 | 19:00 |
| *** sayantani01 has quit IRC | 19:03 | |
| bmace_ | sdake_: hrm.. looks like there is an exit -1 in the method in that script... a couple of exit -1s in there.. will have to look deeper into what this script is really trying to test. | 19:05 |
| openstackgerrit | Merged openstack/kolla-ansible master: Modify the version_info in pbr https://review.openstack.org/424965 | 19:07 |
| sdake_ | bmace_ ^^ | 19:08 |
| bmace_ | sdake_: what? the pbr change? | 19:08 |
| sdake_ | moment bmace_ | 19:08 |
| inc0 | so guys, we have 119 contributors to Ocata Kolla:) even tho Ocata was only 3 or so months with holidays and spring festival | 19:09 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Document the magic in endpoint_test.sh https://review.openstack.org/431114 | 19:10 |
| sdake_ | which spring festival | 19:11 |
| sdake_ | therer was also the chinese new year :) | 19:11 |
| inc0 | spring festival == chinese new year | 19:11 |
| sdake_ | bmace_ that should help get you going | 19:11 |
| sdake_ | oh i see :) | 19:11 |
| inc0 | and we actuyally have more unique reviewers than we did in newton | 19:11 |
| sdake_ | bmace_ the issue I think the cp operation isn't actually working | 19:12 |
| inc0 | so our numbers looks similar to newtons even tho as I said, it was short and cut off cycle | 19:12 |
| sdake_ | inc0 the committers will go down this cycle as well as less people gaming the ATC passes | 19:12 |
| inc0 | Pike will be glorious:) | 19:12 |
| sdake_ | so I think those numbers are actually better than you think :) | 19:12 |
| inc0 | maybe | 19:12 |
| inc0 | yeah | 19:13 |
| sdake_ | bmace_ did that patch help | 19:13 |
| inc0 | well atc gaming folk usually rush commits closer to summit | 19:13 |
| sdake_ | inc0 my point is everyone knows there is no atc passes to game | 19:13 |
| bmace_ | sdake_: yeah, that may be it.. i don't even see anywhere that sets $WORKSPACE | 19:13 |
| inc0 | sdake_, yeah, so people commiting actually care | 19:13 |
| sdake_ | bmace_ that gets set in setup_gate.sh | 19:13 |
| sdake_ | inc0 people gaming the atc passes care typically | 19:14 |
| sdake_ | inc0 they care to make a contribution and make it worthwhile | 19:14 |
| bmace_ | i'll take a look at that and maybe do it in setup_dev_env | 19:14 |
| sdake_ | inc0 they are just not going to be repeat contributors | 19:14 |
| inc0 | sdake_, well what I'm saying reasoning behind cotnributions without atc gaming is only to improve project | 19:14 |
| inc0 | which is great | 19:14 |
| sdake_ | bmace_ if you like my patch put a +1 on it, the gate needs to be documented | 19:14 |
| sdake_ | inc0 agreed, although atc gaming is dual purpose - to improve project and obtain atc pass :) | 19:15 |
| bmace_ | sdake_: looks like even setup_gate assumes workspace is defined already | 19:15 |
| *** saneax is now known as saneax-_-|AFK | 19:15 | |
| bmace_ | sdake_: how about an optional arg to that script that doesn't do the workspace stuff that really assumes this is being done in the gate? | 19:16 |
| sdake_ | bmace_ whatever makes it through the core reviewers works for me :) | 19:17 |
| bmace_ | kk | 19:17 |
| bmace_ | commented on review. | 19:17 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding compute-kit chart https://review.openstack.org/428150 | 19:18 |
| harlowja | have u guys seen http://paste.openstack.org/show/598133/ ? | 19:19 |
| harlowja | pretty sure its the setuptools is messed up issue i've seen, but just wnted to check | 19:19 |
| harlowja | ie https://github.com/pypa/setuptools/issues/942 | 19:19 |
| *** NachoDuck has joined #openstack-kolla | 19:21 | |
| *** rwallner has quit IRC | 19:22 | |
| *** MasterOfBugs has joined #openstack-kolla | 19:22 | |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 19:23 |
| sbezverk | bmace_: wrt WORKSPACE, I think it gets set by the gate when they give us VM | 19:24 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Pull container tallballs into the gate https://review.openstack.org/426598 | 19:24 |
| *** erlon has joined #openstack-kolla | 19:25 | |
| bmace_ | sdake_: sbezverk: it looks like the cp isn't even running, since workspace isn't set.. i think the last command return is -1 from the directory check for workspace/logs. how about just an exit 0 at the end, so if it doesn't exit -1 with a failure you get a nice clean 0 exit at the end? | 19:26 |
| bmace_ | i tested it and it seems to work well enough | 19:26 |
| bmace_ | not sure if there is a better / cleaner bash way | 19:26 |
| sdake_ | bmace_ leave a comment in my review and i'll fix it | 19:27 |
| sdake_ | bmace_ i had exit 0 in there originally | 19:27 |
| sdake_ | however before I pushed git review i used dd to remove the exit 0 | 19:27 |
| bmace_ | aaah, kk, i'll add the comment and change it locally for testing | 19:28 |
| sdake_ | the review is: https://review.openstack.org/431114 | 19:28 |
| bmace_ | hopefully just one more pass through this process! :) | 19:28 |
| sbezverk | personally I do not like -1 as exit, because in bash 0 is good 1 is bad. not sure why -1 came to the picture | 19:28 |
| sdake_ | sbezverk no idea - thats what is in master atm | 19:28 |
| sbezverk | sdake_: hm I thought it was pushed by you and got merged this morning, no? | 19:29 |
| sdake_ | sbezverk no here is the original commit: https://github.com/openstack/kolla-kubernetes/commit/bc9ccf624dc26173f4580df00aab7b0d5eb5085d | 19:29 |
| sdake_ | I will change it to 1 in a stacked patch set, indeeed it should not be -1 according to posix standards | 19:30 |
| sdake_ | sbezverk i may have done a -1 review this morning tho, and if so, I'll change that to exit 1 | 19:30 |
| sdake_ | one more pass ;) | 19:31 |
| *** DuncanT has joined #openstack-kolla | 19:31 | |
| *** serverascode has joined #openstack-kolla | 19:31 | |
| sbezverk | sdake_: well it got merged before I could react.. sorry | 19:32 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Remove all -1 from setup_gate.sh https://review.openstack.org/431119 | 19:32 |
| sdake_ | sbezverk that happens | 19:32 |
| sdake_ | sbezverk and there is a whole new patch to fix it :) | 19:32 |
| sdake_ | sbezverk we don't need each patch to be totally perfect | 19:32 |
| sdake_ | sbezverk iterate iterate iterate :) | 19:33 |
| sdake_ | optimizing for perfection is a bad practice imo :) | 19:33 |
| sdake_ | we should be optimizing for velocity | 19:33 |
| sdake_ | through velocity perfection comes naturally | 19:33 |
| *** DuncanT has quit IRC | 19:35 | |
| *** fragatina has quit IRC | 19:37 | |
| *** fragatina has joined #openstack-kolla | 19:37 | |
| openstackgerrit | Merged openstack/kolla-ansible master: Optimize reconfiguration for elasticsearch https://review.openstack.org/424139 | 19:38 |
| *** skuda has quit IRC | 19:40 | |
| hrw | krtaylor: thx | 19:40 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Document the magic in endpoint_test.sh https://review.openstack.org/431114 | 19:44 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Make endpoint_test return 1 instead of -1 on fail https://review.openstack.org/431126 | 19:44 |
| *** krtaylor has quit IRC | 19:45 | |
| *** haplo37 has quit IRC | 19:46 | |
| *** haplo37_ is now known as haplo37 | 19:46 | |
| sdake_ | bmace_ you should add a dependson to sbezverk 'z gate rework patch | 19:47 |
| sdake_ | bmace_ since your review is blocked anyway as a result of the kubernetes dependency | 19:47 |
| *** sacharya has quit IRC | 19:47 | |
| *** salv-orlando has quit IRC | 19:48 | |
| *** sacharya has joined #openstack-kolla | 19:48 | |
| sdake_ | hpoefully sbezverk 'z review wont sit aorund forever if he splits out the gate changes which are hard to digest from the compute kit | 19:48 |
| *** imcsk8_ has quit IRC | 19:51 | |
| sbezverk | sdake_: wow 3 days is forever for you ;) I suspect is hard to live with such high expections | 19:51 |
| *** imcsk8 has joined #openstack-kolla | 19:51 | |
| *** DuncanT has joined #openstack-kolla | 19:51 | |
| sdake_ | sbezverk how do you mean | 19:52 |
| *** Pavo has joined #openstack-kolla | 19:53 | |
| *** qwang has joined #openstack-kolla | 19:53 | |
| sdake_ | sbezverk 3 days of blocking 6 other patches is a problem | 19:53 |
| sdake_ | sbezverk those kinds of changes need to be fast tracked | 19:53 |
| sdake_ | sbezverk that results in compounding rebases which apparently people don't like to do :) | 19:53 |
| sbezverk | sdake_: well when we talk about changes the gate, 3 days is not much.. I would agree with you if it took me 3 days to change a comment or spell or something of that sort | 19:54 |
| sdake_ | sbezverk i'm not saying your slow | 19:54 |
| sdake_ | i'm say8ing the review process is slow | 19:54 |
| *** tonanhngo has quit IRC | 19:54 | |
| sdake_ | sbezverk in fact your quite fast :) | 19:54 |
| sdake_ | i on the other hand am slow to attend to patches | 19:55 |
| sbezverk | sdake_: if you'd examin that review carefully, you would see that compute part actually is not changing and is very small. | 19:55 |
| sdake_ | and can only really work in short spurts swhen I have free time available - so don't like to sit around being blocked -because saturday i will be prepping for a 2 hour seminar on kolla | 19:55 |
| sbezverk | so if you need to merge, it can be done now | 19:55 |
| sbezverk | as the main gate part is workign | 19:55 |
| *** robcresswell has joined #openstack-kolla | 19:55 | |
| sdake_ | sbezverk right - patches should be self-contained units not massive things | 19:55 |
| sbezverk | I am just making compute kit to work in iscsi env.. | 19:56 |
| sdake_ | need to run for a bit | 19:56 |
| *** sacharya_ has joined #openstack-kolla | 19:56 | |
| sdake_ | sbezverk cool - just shard off the gate refactor so other people can get unblocked :) | 19:56 |
| *** portdirect has joined #openstack-kolla | 19:57 | |
| sdake_ | sup portdirect | 19:57 |
| sdake_ | i see irccloud is back online :) | 19:57 |
| *** haplo37_ has joined #openstack-kolla | 19:57 | |
| *** david-lyle has quit IRC | 19:57 | |
| *** sacharya has quit IRC | 19:57 | |
| sdake_ | bmace_ your goin g to have to rebase your patch on top of sbezverk's work - along with the other 6 gate patches pending | 19:58 |
| sdake_ | ok - bbifew hours | 19:58 |
| *** rwallner has joined #openstack-kolla | 19:58 | |
| *** kong has joined #openstack-kolla | 19:59 | |
| bmace_ | sdake_: yup, well, waiting on kubernetes to be allowed anyway, so i expected some merges would be needed. | 19:59 |
| *** akwasnie has joined #openstack-kolla | 20:00 | |
| *** NobodyCam has joined #openstack-kolla | 20:02 | |
| *** aimeeu has joined #openstack-kolla | 20:02 | |
| klindgren | Is it on the road map to run all api's in the same manner? Like instead of some under eventlet and other under apache? | 20:05 |
| klindgren | we were working on this internally but using uswgi instead of apache. | 20:05 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/kolla master: support non-x86 architectures (aarch64, ppc64le) https://review.openstack.org/430940 | 20:07 |
| Pavo | question, how can I do ovs-vsctl cmds with using kolla-ansible? | 20:07 |
| *** mannamne has joined #openstack-kolla | 20:07 | |
| *** tonanhngo has joined #openstack-kolla | 20:08 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 20:10 |
| *** macsz has joined #openstack-kolla | 20:11 | |
| sbezverk | sdake_: here is gate refactor PS | 20:11 |
| sbezverk | I removed compute kit for now to get it merged so it will not block other folks.. | 20:11 |
| *** salv-orlando has joined #openstack-kolla | 20:11 | |
| *** ediardo has joined #openstack-kolla | 20:12 | |
| *** SaMnCo has joined #openstack-kolla | 20:13 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 20:14 |
| *** david-lyle has joined #openstack-kolla | 20:15 | |
| *** berendt has joined #openstack-kolla | 20:15 | |
| *** jtriley_ has joined #openstack-kolla | 20:16 | |
| *** sindhu has joined #openstack-kolla | 20:16 | |
| *** turvey has joined #openstack-kolla | 20:18 | |
| *** hogepodge has joined #openstack-kolla | 20:19 | |
| *** Pavo has quit IRC | 20:19 | |
| *** jtriley has quit IRC | 20:20 | |
| *** david-lyle has quit IRC | 20:20 | |
| *** mgkwill has quit IRC | 20:21 | |
| *** mgkwill has joined #openstack-kolla | 20:21 | |
| *** Pavo has joined #openstack-kolla | 20:21 | |
| *** jtriley_ has quit IRC | 20:24 | |
| *** fragatina has quit IRC | 20:27 | |
| *** krtaylor has joined #openstack-kolla | 20:28 | |
| *** matrohon has joined #openstack-kolla | 20:28 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 20:30 |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding compute kit based on iscsi backend https://review.openstack.org/431156 | 20:30 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Change endpoint-test -1 to 1 return code https://review.openstack.org/431126 | 20:32 |
| openstackgerrit | Steven Dake proposed openstack/kolla-kubernetes master: Document the magic in endpoint_test.sh https://review.openstack.org/431114 | 20:32 |
| *** jtriley has joined #openstack-kolla | 20:32 | |
| sdake_ | thanks sbezverk - you left the release note in - but i'll do a thorough review after my meeting in 30 mins | 20:33 |
| *** pcaruana has quit IRC | 20:43 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Adding compute kit based on iscsi backend https://review.openstack.org/431156 | 20:46 |
| *** Pavo has quit IRC | 20:47 | |
| *** penfold has quit IRC | 20:48 | |
| bmace_ | sbezverk: i'm curious, in what environment does --image-feature layering actually work, because if you don't pass in the arg "2" and have that arg set i get an error about the argument being invalid or no longer supported or some such | 20:49 |
| *** crushil has quit IRC | 20:50 | |
| *** sdake has joined #openstack-kolla | 20:54 | |
| kfox1111 | bmace_: kolla 2.x doesn't support the flag, and 3.x requires it. | 20:54 |
| kfox1111 | really, its a ceph hammer vs jewel thing. | 20:55 |
| SamYaple | you can set that in ceph.conf | 20:55 |
| bmace_ | kfox1111: thanks much. | 20:56 |
| kfox1111 | np | 20:56 |
| kfox1111 | SamYaple: yeah. that woudl be another way to solve it. | 20:56 |
| *** salv-orlando has quit IRC | 20:56 | |
| *** sdake_ has quit IRC | 20:58 | |
| sbezverk | bmace_: when we depricate hammer ;) if it happenes, that part can be removed | 20:59 |
| *** sp_ has quit IRC | 21:01 | |
| *** sacharya_ has quit IRC | 21:05 | |
| bmace_ | sbezverk: yup yup, just need to tweak my review a bit and pass in the $BRANCH like the gate script does. | 21:06 |
| *** sacharya has joined #openstack-kolla | 21:06 | |
| *** mannamne has quit IRC | 21:09 | |
| *** mannamne has joined #openstack-kolla | 21:10 | |
| *** rwallner has quit IRC | 21:12 | |
| *** rwallner has joined #openstack-kolla | 21:13 | |
| *** rwallner has quit IRC | 21:13 | |
| *** rwallner has joined #openstack-kolla | 21:14 | |
| *** rwallner has quit IRC | 21:14 | |
| *** mannamne has quit IRC | 21:20 | |
| *** matrohon has quit IRC | 21:22 | |
| *** rwallner has joined #openstack-kolla | 21:22 | |
| inc0 | sbezverk, that's why I'm saying that kolla-k8s should use up to date images;) | 21:25 |
| *** dave-mccowan has quit IRC | 21:26 | |
| *** rwallner has quit IRC | 21:27 | |
| sbezverk | inc0: agree :) it is just up date images has tendency to be more broken ;) | 21:27 |
| inc0 | stable/newton don't | 21:28 |
| inc0 | stable/ocata will be available in few days | 21:28 |
| inc0 | and well...cross repo gating | 21:28 |
| *** sacharya_ has joined #openstack-kolla | 21:29 | |
| *** adrian_otto has quit IRC | 21:29 | |
| *** sacharya has quit IRC | 21:29 | |
| *** Jeffrey4l has quit IRC | 21:34 | |
| *** Jeffrey4l has joined #openstack-kolla | 21:34 | |
| *** penfold has joined #openstack-kolla | 21:38 | |
| *** salv-orlando has joined #openstack-kolla | 21:40 | |
| *** vhosakot has quit IRC | 21:46 | |
| *** dave-mccowan has joined #openstack-kolla | 21:46 | |
| *** vhosakot has joined #openstack-kolla | 21:46 | |
| *** vhosakot has quit IRC | 21:47 | |
| *** adrian_otto has joined #openstack-kolla | 21:47 | |
| *** vhosakot has joined #openstack-kolla | 21:48 | |
| portdirect | I'd love it if we used master tbh, that way as we add them we can use them - though I'd also love it if we could start culling some for upstream's here and there (looking at you memcached for some ults low hanging fruit) | 21:48 |
| inc0 | portdirect, yisss, when I proposed this as ptg session https://etherpad.openstack.org/p/kolla-pike-ptg-schedule #7 | 21:50 |
| inc0 | you can put your support there;) | 21:51 |
| inc0 | for this session | 21:51 |
| * inc0 really wants kolla to limit focus just to OpenStack as much as it's reasonable | 21:51 | |
| portdirect | awesome - cheers bro :) | 21:53 |
| *** fguillot has quit IRC | 21:54 | |
| *** skuda has joined #openstack-kolla | 21:59 | |
| *** vhosakot has quit IRC | 22:01 | |
| *** vhosakot has joined #openstack-kolla | 22:01 | |
| *** sdake has quit IRC | 22:02 | |
| *** Pavo has joined #openstack-kolla | 22:02 | |
| *** sdake has joined #openstack-kolla | 22:02 | |
| sdake | portdirect inc0 in compelte agreemenet wrt adding master to the gate | 22:02 |
| sdake | portdirect inc0 after sbezverk 's patch merges, I'll take al ook at getting a gate setup for that | 22:03 |
| sdake | since bmace_ has the dev env wrapped up - i'm out of things to do :) | 22:03 |
| sdake | inc0 what i do need is some wayt o get the master images into tarballs.oo | 22:03 |
| inc0 | they're there | 22:03 |
| inc0 | they're being uploaded every commit | 22:04 |
| inc0 | to kolla | 22:04 |
| sdake | ok - i could pull them from there | 22:04 |
| inc0 | not that easily | 22:04 |
| inc0 | http://tarballs.openstack.org/kolla/images/ | 22:04 |
| inc0 | you download tar.gz | 22:04 |
| sdake | inc0 i check this out: | 22:04 |
| inc0 | untar it | 22:04 |
| inc0 | and then docker run registry -v /var/lib/registry:/path/to/untar | 22:05 |
| inc0 | and that's it | 22:05 |
| sdake | https://review.openstack.org/#/c/426598/ | 22:05 |
| sdake | icn0 that wont work with kubernetes | 22:05 |
| sdake | you have to use docker load | 22:05 |
| sdake | but its basically teh same concept | 22:05 |
| inc0 | kubernetes knows how to do registry... | 22:05 |
| sdake | right - althoug hthe gate code at present doesn't use a registry | 22:05 |
| sdake | it coudl be made to do so - baby steps first, would liek to get those tarballs being used | 22:06 |
| inc0 | https://review.openstack.org/#/c/418550/ this used to work... | 22:06 |
| sdake | that patch was wroking prior to merge conflict | 22:06 |
| portdirect | off the top of my head adding a registry would be the easiest way to do that - unless setting a custom image namespace is still a hassle | 22:06 |
| inc0 | shouldn't be | 22:07 |
| sdake | i've got a working review that uses docker load based upon kfox1111 'z work (I just reworked it slightly and learned about the gate) | 22:08 |
| sdake | after that I could add a registry | 22:08 |
| sdake | the issue is multinode | 22:08 |
| sdake | and sorting that out with a registry is semi-irritating | 22:08 |
| inc0 | you can run registry on every node if that's the issue | 22:08 |
| sdake | docker load is easy first step | 22:08 |
| inc0 | and always pull 127.0.0.1 | 22:08 |
| sdake | docker load loads the images into the cache | 22:08 |
| sdake | so it works prefectly | 22:08 |
| inc0 | no it's not unless you're willing to break our build gates byu taring every-single-image | 22:08 |
| inc0 | and uploading them | 22:09 |
| inc0 | with no regard to layering | 22:09 |
| inc0 | so full size image every time | 22:09 |
| sdake | hrm, does docker load ignore layering? | 22:09 |
| *** vhosakot_ has joined #openstack-kolla | 22:09 | |
| *** p6 has joined #openstack-kolla | 22:09 | |
| inc0 | indeed it does | 22:09 |
| sdake | ok well let me get the gate stablized at first | 22:10 |
| sdake | then ill sort out a registry next | 22:10 |
| sdake | i know how to do the job now (pre sbezverk 's rebase) | 22:10 |
| sdake | rather pre sbezverk 's refactor of the gate | 22:10 |
| p6 | interesting question- doing a lab deployment test of kolla here, keepalived won't bring up the internal VIP IP because haproxy is failed, haproxy won't start because it can't bind to the VIP... | 22:10 |
| *** vhosakot_ has quit IRC | 22:10 | |
| openstackgerrit | Merged openstack/kolla master: Add redis container https://review.openstack.org/430976 | 22:10 |
| inc0 | p6, keepalived shouldn't fail because of haproxy | 22:11 |
| inc0 | what's actual error? | 22:11 |
| portdirect | nice - if you need a hand with k8s multinode registry give me a holler - we may be able to do it super easy with a single k8s service, as thats what a few of my clusters are running atm | 22:11 |
| *** vhosakot_ has joined #openstack-kolla | 22:11 | |
| inc0 | (thing is keepalived deploy is part of haproxy role, so that might be misleading) | 22:11 |
| openstackgerrit | Merged openstack/kolla master: Add openstack-magnum-ui package for centos binary https://review.openstack.org/430567 | 22:11 |
| p6 | inc0: VRRP_Instance(kolla_internal_vip_51) Entering Backup, then almost immediately after that- entering FAULT | 22:11 |
| p6 | i'm presuming FAULT is because the check failed, the actual interface looks up from the container | 22:12 |
| sdake | inc0 also the problem with limiting focus to just openstack is that we break the ability to have cross-distro and cross-arch support | 22:12 |
| inc0 | p6 keepalived doesn't check anything with haproxy | 22:12 |
| inc0 | sdake, which I am strongly considering | 22:12 |
| inc0 | as long as we enable people to override default image | 22:12 |
| *** vhosakot has quit IRC | 22:13 | |
| inc0 | if someone cares about centos mariadb image and it's not available | 22:13 |
| inc0 | I'd be happy if this person upload it, or maybe rht could? | 22:13 |
| sdake | as i said in the review - i am -2 on that technical approach | 22:13 |
| inc0 | thing is, I don't think *we* need to | 22:13 |
| inc0 | as you said to me on multiple occasions, you can't -2 specs;) | 22:13 |
| sdake | right - id be -1 on a rollcallvote then :) | 22:13 |
| sdake | and I think you wuld struggle to find consensus but welcome to try | 22:14 |
| inc0 | fair enough, but don't worry, I want to have lenghty conversation | 22:14 |
| inc0 | I just think our model is impossible to maintain | 22:14 |
| sdake | its being maintained just fine now | 22:14 |
| inc0 | on a long run | 22:14 |
| p6 | inc0: it has vrrp_script /check_alive defined which is doing a show info against /var/lib/kolla/haproxy/haproxy.sock | 22:14 |
| sdake | with no struggle | 22:14 |
| *** vhosakot_ has quit IRC | 22:14 | |
| inc0 | sdake, ubuntu was broken for 2 months | 22:14 |
| sdake | inc0 that is because nobody cares about ubuntu and the gating is weak | 22:15 |
| inc0 | and I have no idea if our rabbitmq doesn't miss any security patch or whatnot | 22:15 |
| portdirect | yeah - the only people i see really caring about that are RDO/RH - and we could easily help them put the framework in place to take on that tech debt | 22:15 |
| inc0 | well "nobody cares" is a bit of a strong given it's one of 3 main distros we support | 22:15 |
| sdake | perhaps | 22:15 |
| sdake | the fat it was broken in master for 2 months shows nobody tests it | 22:16 |
| inc0 | also, rabbitmq is equally true to centos | 22:16 |
| sdake | the solution is gating | 22:16 |
| portdirect | or uses it :( | 22:16 |
| inc0 | portdirect, people use it | 22:16 |
| inc0 | just not necessarily main body of contributors | 22:16 |
| sdake | portdirect most of the community uses centos not ubuntu | 22:16 |
| inc0 | it was broken in master | 22:16 |
| *** vhosakot has joined #openstack-kolla | 22:16 | |
| inc0 | 60% of operational openstack in the wild runs on ubuntu | 22:16 |
| sdake | anyway sounds like a fine ptg debate right before dinner :) | 22:16 |
| inc0 | according to survey | 22:16 |
| sdake | so we can get drunk afterwards ;-) | 22:17 |
| portdirect | yeah - thats a fair point inc0, we need to find a way to close that feedback loop | 22:17 |
| * portdirect typing lagg :( | 22:17 | |
| inc0 | portdirect, true, and true that we need gating | 22:17 |
| *** jtriley has quit IRC | 22:17 | |
| inc0 | but no gating ever will ensure that we have correct versions of stuff | 22:17 |
| sdake | if we had effective gating ubuntu maintenance would be no sewat | 22:17 |
| inc0 | and not miss some security updates somewhere | 22:17 |
| sdake | and jeffrey4l is working on that with others | 22:17 |
| sdake | i'd trust a distro such as red hat prior to trusting an upstream such as mariadb for maintenance | 22:18 |
| sdake | red hat's bread and butter is making sure mariadb and rabbitmq work well | 22:18 |
| inc0 | remember issues we had with rabbitmq versions? | 22:18 |
| sdake | yes because we were using the rabbitmq from rabbitmq, rather then the rabbitmq from RDO :) | 22:19 |
| sdake | that got fixed | 22:19 |
| sdake | red hat has 30+ people maintaing rabbitmq and mariadb just for their distro | 22:19 |
| portdirect | sdake: i suppose that's where we differ (and drinks need to be involved in the resolution...) I agree in a package world. but in a container world I kinda trust the project more than a packager | 22:19 |
| sdake | that amplifies the effect that the mariadb contribs have | 22:19 |
| sdake | portdirect knowing how the sausage is made at rht, and knowing how the sausage is made upstream, the distros do add significant value even if they give it away for free | 22:20 |
| sdake | atleast the rht case | 22:20 |
| sdake | not sure about cononcial | 22:20 |
| sdake | i think their maintenacei sk ind of laggy adn probably where we have the disconnect | 22:20 |
| inc0 | sdake, then let rht support images | 22:21 |
| sdake | the questoin is will they | 22:21 |
| sdake | if they wont then we have to do so | 22:21 |
| portdirect | sdake: and *this* is why we need shots involved as we fire shots at each other ;) | 22:21 |
| sdake | we are making inroads there bu twe aren't there yet | 22:21 |
| inc0 | if image is supported by someone even outside kolla | 22:21 |
| sdake | portdirect only if its rum :) | 22:21 |
| inc0 | (and that can be our community as people) | 22:21 |
| inc0 | it can be used and provide feedback by wider audience | 22:22 |
| sdake | i really dont see what that change buys us | 22:22 |
| inc0 | there is no value in having images for that stuff in kolla imho | 22:22 |
| sdake | but i've got real work to do - we can discuss at ptg | 22:22 |
| sdake | i would agree with your position if red hat and cononccal agreeed to maintain containers to our standards | 22:23 |
| sdake | (and oracle) | 22:23 |
| inc0 | dmsimard, ^ ideas? | 22:23 |
| sdake | I doubt we can get all 3 of those bohemeths to do that | 22:23 |
| portdirect | RH will soon i think | 22:23 |
| sdake | what woudl happen is they would maintain them to *their* standards | 22:23 |
| inc0 | you think you guys would be willing to run containers for stuff like mariadb, rabbitmq and other non-openstack services? | 22:23 |
| inc0 | sdake, we *just* need packages in container | 22:24 |
| inc0 | other than that, we can handle this with layer above them | 22:24 |
| sdake | rabbitmq has a huge dep chain on erlang | 22:24 |
| inc0 | all I need is docker image with every package service needs | 22:24 |
| sdake | erlang has a huge mainteance team at red hat | 22:24 |
| sdake | relying on pivotal to maintain that is painful | 22:24 |
| sdake | we tried that and it led to near disaster | 22:25 |
| inc0 | that's exactly why we can't hope to keep up with them | 22:25 |
| sdake | instead we rely on rdo - and they do a good job | 22:25 |
| sdake | anway - real work :) bbl | 22:25 |
| inc0 | only we don't really https://github.com/openstack/kolla/blob/master/docker/rabbitmq/Dockerfile.j2#L47 | 22:26 |
| *** rhallisey has quit IRC | 22:26 | |
| *** fragatina has joined #openstack-kolla | 22:30 | |
| *** gfidente|afk has quit IRC | 22:31 | |
| *** dave-mccowan has quit IRC | 22:31 | |
| *** sdake_ has joined #openstack-kolla | 22:32 | |
| dmsimard | inc0: need to give me a tl;dr please | 22:32 |
| inc0 | dmsimard, so, we are thinking of loosing support for non-openstack services like mariadb | 22:33 |
| inc0 | but if we'd like to keep all centos stuff...well...centos | 22:33 |
| inc0 | that would require us to have access to centos-based mariadb container somewhere...dockerhub | 22:34 |
| inc0 | wouldn't rht be interested to host images like that? | 22:34 |
| inc0 | a) rh stuff would get more exposure as people would just install mariadb with centos base | 22:34 |
| inc0 | not only openstack people, anyone wanting mariadb | 22:34 |
| *** erlon has quit IRC | 22:35 | |
| inc0 | b) it would help us drop this code from our repo, which some people, including myself, would like to see one day | 22:35 |
| *** vhosakot has quit IRC | 22:35 | |
| inc0 | not to mention openshift could make use of these things | 22:35 |
| *** sdake has quit IRC | 22:36 | |
| *** jheroux has quit IRC | 22:36 | |
| dmsimard | So basically instead of having kolla build a rabbitmq container, a mariadb container, etc.. use whatever is on dockerhub ? | 22:39 |
| portdirect | by default yes - though pinned to a version | 22:39 |
| inc0 | dmsimard, poc of what I'd do https://review.openstack.org/#/c/427931/ | 22:39 |
| inc0 | portdirect, ^ | 22:40 |
| portdirect | inc), I'd love it if we could get rid of even that, though I understand that for ansible that wouldn't be possible | 22:41 |
| inc0 | portdirect, well there are issues this solves even in k8s layer | 22:41 |
| inc0 | like init to reap properly or uid fixing for upgrades | 22:41 |
| dmsimard | I don't have a strong opinion, but I can ask people that might | 22:42 |
| inc0 | dmsimard, I'm not asking for answers, just throwing it out there | 22:42 |
| inc0 | idea that lots of people could benefit from | 22:42 |
| portdirect | yeah - this is deff one to mull over for a bit :) | 22:43 |
| dmsimard | as far as I'm concerned, I'd at least make it configurable so that we can pull the mariadb container from another source | 22:45 |
| dmsimard | I have to take off, will you start a ML thread so that people can chime in ? | 22:46 |
| inc0 | dmsimard, we'll discuss this on ptg, and source of mariadb will be configurable | 22:47 |
| dmsimard | discuss this on openstack-dev too :) | 22:48 |
| inc0 | yeha probably too, just want to get some initial thoughts | 22:48 |
| *** tvignaud has joined #openstack-kolla | 22:48 | |
| *** rwallner has joined #openstack-kolla | 22:49 | |
| *** inc0 has quit IRC | 22:52 | |
| *** huzhengchuan has joined #openstack-kolla | 22:52 | |
| *** rwallner has quit IRC | 22:53 | |
| bmace_ | any of the kolla-k8s folks have an issue w/ running branch 3.0.2 by default in devenv? if someone wants to run 2.0.2 they could always tweak the code and rebuild the container. | 22:53 |
| *** mannamne has joined #openstack-kolla | 22:55 | |
| portdirect | bmace_: I'l like us to be as close to the tip as possible for kolla-k8s dev as possible | 22:59 |
| portdirect | if you can get 3.0.2 working then that gets a +2 from me | 23:00 |
| bmace_ | portdirect: yup, going to try it out and see what breaks | 23:00 |
| *** skuda has quit IRC | 23:03 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 23:04 |
| *** mannamne has quit IRC | 23:11 | |
| *** tonanhngo has quit IRC | 23:12 | |
| *** tvignaud has quit IRC | 23:13 | |
| *** satyar has quit IRC | 23:15 | |
| *** crushil has joined #openstack-kolla | 23:19 | |
| *** goldyfruit has quit IRC | 23:22 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes master: Gate refactoring https://review.openstack.org/428150 | 23:22 |
| *** krtaylor has quit IRC | 23:25 | |
| *** huzhengchuan has quit IRC | 23:26 | |
| *** jrobinson has joined #openstack-kolla | 23:26 | |
| *** fragatina has quit IRC | 23:29 | |
| *** fragatina has joined #openstack-kolla | 23:30 | |
| *** zhurong has joined #openstack-kolla | 23:30 | |
| *** jrobinson has quit IRC | 23:30 | |
| *** jrobinson has joined #openstack-kolla | 23:32 | |
| *** schwicht has quit IRC | 23:32 | |
| *** zhurong has quit IRC | 23:36 | |
| sdake_ | @bmace_ 3.0.2 from earlier converstions with sbezverk is busted in the gate so its likely busted outside the gate :) | 23:56 |
| bmace_ | sdake_: ah... what about it is busted? | 23:56 |
| sdake_ | @sbezverk said the endpoint isn't registered correctly | 23:56 |
| sdake_ | for nova | 23:56 |
| sdake_ | sbezverk says its in the scrollback althogh i don't see it in the archives and didn't persoanlly witness the conversation :) | 23:58 |
| sdake_ | that needs fixing sap tho | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
