Tuesday, 2017-11-21

*** salv-orlando has quit IRC00:09
*** salv-orlando has joined #openstack-kolla00:09
*** jrist-afk is now known as jrist00:12
*** salv-orlando has quit IRC00:14
*** hongbin has quit IRC00:14
*** Pavo has quit IRC00:18
*** lrensing has joined #openstack-kolla00:20
*** itlinux has quit IRC00:26
*** zshi has joined #openstack-kolla00:39
*** jamesbenson has joined #openstack-kolla00:40
*** jamesbenson has quit IRC00:44
*** Pavo has joined #openstack-kolla00:49
owalshinc0: guessing I need https://review.openstack.org/521372 to land before my patch can merge?00:52
*** lrensing has quit IRC00:52
owalshinc0: shall I just recheck? looks like a repo issue00:52
*** Pavo has quit IRC00:54
inc0owalsh: http://logs.openstack.org/72/521372/2/check/kolla-build-oraclelinux-source/942cb3a/logs/build/neutron-linuxbridge-agent.txt.gz yeah seems like bad download or sth00:55
inc0try recheck00:55
*** tovin07_ has joined #openstack-kolla00:55
owalshinc0: ack, will do00:56
inc0maybe repo maintainers forgot about updating checksums00:56
inc0pbourke: ^00:56
*** gfhellma has quit IRC00:58
*** heigao has joined #openstack-kolla00:58
*** reddreamster has joined #openstack-kolla00:59
owalshinc0: still needs a +W, any reason to wait given the old link is now 404?00:59
*** duonghq has joined #openstack-kolla00:59
inc0well it won't merge unless gates pass00:59
inc0when gates are green, this should totally get +w01:00
owalshinc0: hoping it fixes the gate, kafka failing stopped https://review.openstack.org/520114 landing01:01
duonghqinc0, inc0 seem that we get trouble with oraclelinux-source?01:02
duonghqgate become unstable01:02
inc0duonghq: well, I don't blame just oraclelinux01:03
inc0gates in general seems less stable than usual01:03
duonghqack01:03
owalshseems to be intermittent, check passed for me but gate failed01:03
inc0problem with oraclelinux is that infra doesn't have cache for it01:03
inc0hence we don't have local mirrors hence slow01:03
inc0duonghq: speaking of gates https://review.openstack.org/#/c/519939/01:04
inc0this needs merging;)01:04
duonghqinc0, roger01:04
inc0ansible gates uses month-old tarballs01:05
*** salv-orlando has joined #openstack-kolla01:11
*** lrensing has joined #openstack-kolla01:11
*** lrensing has quit IRC01:14
*** manheim has quit IRC01:16
*** daidv has quit IRC01:18
mikalHmmm, next problem. "kolla-ansible genconfig" fails.01:19
*** daidv has joined #openstack-kolla01:19
mikalTASK [setup] *******************************************************************01:19
mikalfatal: [localhost]: FAILED! => {"failed": true, "msg": "ERROR! The conditional check '(ansible_play_batch | length) != (groups['all'] | length)' failed. The error was: ERROR! error while evaluating conditional ((ansible_play_batch | length) != (groups['all'] | length)): ERROR! 'ansible_play_batch' is undefined\n\nThe error appears to have been in '/usr/local/share/kolla-ansible/ansible/site.yml':01:19
mikalline 27, column 7, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n  tasks:\n    - setup:\n      ^ here\n"}01:19
*** reddreamster has quit IRC01:24
*** salv-orlando has quit IRC01:26
kfox1111inc0: first pxeboot of a vm. :)01:26
kfox1111close now. :)01:26
kfox1111now gotta try and pxeboot it off of the centos mirror.01:26
duonghqinc0, done01:27
*** Pavo has joined #openstack-kolla01:28
kfox1111so got, pxe server, provisioning dns, ingress, and primary rpm repo snapshot server.01:28
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Apply neutron database migration  https://review.openstack.org/40792201:28
kfox1111just need a simple dhcp setup and I think I'm good to post the prototype.01:29
*** vhosakot has quit IRC01:30
openstackgerritKevin Zhao proposed openstack/kolla master: Creates directory /var/run/mysqld on aarch64 when building MariaDB docker image  https://review.openstack.org/52147901:30
openstackgerritKevin Zhao proposed openstack/kolla master: Add python-openstackclient to debian kolla-toolbox  https://review.openstack.org/52148101:30
openstackgerritMerged openstack/kolla-ansible master: Pull image from dockerhub rather than tarballs.o.o site  https://review.openstack.org/51993901:30
*** yangyapeng has joined #openstack-kolla01:31
*** dave-mccowan has joined #openstack-kolla01:31
openstackgerritMerged openstack/kolla-ansible stable/ocata: Fix the deprecated syntax in 01-rewrite.conf  https://review.openstack.org/52133701:33
*** yangyapeng has quit IRC01:35
*** zhangfei has joined #openstack-kolla01:37
kfox1111first centos boot.... :)01:39
kfox1111hmm.. partial...01:39
kfox1111no dns...01:39
kfox1111makes sence as I was testing with libvirt's dns.01:40
mikalAny thoughts on that gencongig error?01:40
mikalansible_play_batch is undefined it seems01:45
*** yangyapeng has joined #openstack-kolla01:49
*** athomas has quit IRC01:49
*** yangyapeng has quit IRC01:54
*** jamesbenson has joined #openstack-kolla02:00
*** jamesbenson has quit IRC02:04
openstackgerritzhubingbing proposed openstack/kolla master: fix missyntax in README.rst  https://review.openstack.org/52169902:05
*** rwsu has joined #openstack-kolla02:06
*** zhubingbing__ has joined #openstack-kolla02:06
lxdongHas anyone got experience of how to make use of the replication of ceph , i.e. the disk of instance volume failed or the node which instance on down , we can find and switch to the replication of the instance, right?02:07
*** zhangfei has quit IRC02:09
*** yangyapeng has joined #openstack-kolla02:15
*** yangyapeng has quit IRC02:19
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/pike: Pull image from dockerhub rather than tarballs.o.o site  https://review.openstack.org/52170102:19
*** kevzha01 has joined #openstack-kolla02:19
*** kevzha01 is now known as kevinz02:20
*** zhangfei has joined #openstack-kolla02:22
*** salv-orlando has joined #openstack-kolla02:22
*** lrensing has joined #openstack-kolla02:26
*** salv-orlando has quit IRC02:27
*** lrensing has quit IRC02:33
Jeffrey4lsup sdake rwellum02:33
rwellumEvening Jeffrey4l02:34
*** yangyapeng has joined #openstack-kolla02:34
Jeffrey4lhi rwellum, what's wrong with "lokolla" namespace?02:34
rwellumJeffrey4l: nothing02:34
Jeffrey4lah, OK02:35
rwellumJeffrey4l: I'm building Pike and I see openstack client issues when deploying - wondering if related to your recent patch02:37
Jeffrey4lrwellum, openstack is not found?02:37
rwellumyes02:37
*** Pavo has quit IRC02:37
Jeffrey4lyes. this is fixed in the latest pike branch.02:37
Jeffrey4lrwellum, https://review.openstack.org/51997102:38
*** itlinux has joined #openstack-kolla02:38
rwellumI updated kolla and still see the issue after rebuilding images.02:38
*** yangyapeng has quit IRC02:38
*** lrensing has joined #openstack-kolla02:38
masbergood afternoon, could I please have some advise about kolla-ansible deploying opentack with external ceph? I can get glance to work but not cinder. I get a permissionError but keyring is correct http://paste.openstack.org/raw/626883/02:42
masberany thoughts?02:42
Jeffrey4lrwellum, could you paste the error message?02:42
rwellum"sh: line 3: /usr/bin/openstack: No such file or directory"02:43
Jeffrey4lrwellum, where does this come from?02:44
Jeffrey4lmasber, try to run: rbd -p volumes -u cinder ls in cinder_volume container.02:44
Jeffrey4lduonghq, could you review https://review.openstack.org/52133602:45
Jeffrey4lberendt, ^^02:45
rwellumJeffrey4l: I did a kubectl log on the container that is unhappy02:45
Jeffrey4lrwellum, are you trying kolla-kubernetes?02:46
Jeffrey4lrwellum, more logs and context is helpful.02:46
rwellumyeah02:46
rwellumSure - sorry - was discussing this with inc0 earlir02:46
masberJeffrey4l, rbd: list: (1) Operation not permitted02:47
*** athomas has joined #openstack-kolla02:47
* Jeffrey4l is read scroll back.02:47
Jeffrey4lmasber, hrm could you provide more logs? you may need exec the container with root privilege.02:48
masberJeffrey4l, http://paste.openstack.org/raw/626884/02:48
rwellummikal: the rbac needs to be 1.7 too fyi02:49
openstackgerritChason Chan proposed openstack/kolla master: Upgrade the rst convention of the Admin Guide  https://review.openstack.org/51165902:49
Jeffrey4lmasber, hrm, no idea. guess there are really something wrong with ceph.conf or keyring.02:50
masberJeffrey4l, do you know if the the permissions to the pool volume are correct?02:51
*** athomas has quit IRC02:52
Jeffrey4lmasber, seems OK.02:53
duonghqJeffrey4l, done02:53
*** lrensing has quit IRC02:54
Jeffrey4lthx02:54
rwellumJeffrey4l: with https://review.openstack.org/#/c/521701/1 - does that mean we've published pike to dockerhub?02:56
rwellumUnder lokolla?02:56
Jeffrey4lrwellum, push to dockerhub under kolla02:56
Jeffrey4lthis is already done on master branch02:57
Jeffrey4lcheck https://hub.docker.com/r/kolla/ubuntu-source-keystone/tags/   queens tag02:57
*** absubram has quit IRC02:58
*** yangyapeng has joined #openstack-kolla02:59
rwellumWhy queens before pike?03:01
*** jamesbenson has joined #openstack-kolla03:02
Jeffrey4lrwellum, queens is the master branch. and this name will be changed to "master" later. i do not think queens is a good name for master branch.03:03
*** yangyapeng has quit IRC03:04
rwellumSorry Jeffrey4l I get that - my question is why pushing master/queens etc to dockerhub when we don't have pike pushed yet?03:04
Jeffrey4lrwellum, codes to push pike is under review ;D03:04
Jeffrey4lrwellum, here is the code https://review.openstack.org/51879703:05
openstackgerritJeffrey Zhang proposed openstack/kolla stable/pike: Dockerhub publisher job  https://review.openstack.org/51879703:06
*** jamesbenson has quit IRC03:07
rwellumOk missed this03:07
Jeffrey4lzhubingbing__, pbourke inc0 please review https://review.openstack.org/52133203:07
zhubingbing__Done @Jeffrey4103:08
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/pike: Pull image from dockerhub rather than tarballs.o.o site  https://review.openstack.org/52170103:09
*** reddreamster has joined #openstack-kolla03:09
*** dave-mccowan has quit IRC03:10
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/ocata: Pull image from dockerhub rather than tarballs.o.o site  https://review.openstack.org/52170403:10
mikalrwellum: oh, cool. I shall fix.03:11
reddreamsterhi, container bootstrap_gnocchi failed to start, with the exception:   File "/usr/lib/python2.7/site-packages/futurist/_utils.py", line 23, in <module>     from monotonic import monotonic as now  # noqa   File "/usr/lib/python2.7/site-packages/monotonic.py", line 164, in <module>     raise RuntimeError('no suitable implementation for this system') RuntimeError: no suitable implementation for this system03:11
rwellumJeffrey4l: for the missing openstack, I update kolla repo and made sure it got your ps. Then I rebuilt and repushed my images. And still see issues, you think your fix needs to be applied to more containers potentially?03:12
Jeffrey4lrwellum, where the error message come from?03:12
Jeffrey4lreddreamster, which branch are u using?03:12
Jeffrey4lreddreamster, could you file a bug on https://bugs.launchpad.net/kolla-ansible03:13
*** zhubingbing__ has quit IRC03:13
rwellumJeffrey4l: they are all containers involving keystone https://www.irccloud.com/pastebin/SEPJr7Bo/03:13
reddreamsterI'm using the kolla-ansible ocata, and image is centos binary03:14
Jeffrey4lreddreamster, please file a bug ;D03:15
*** zhubingbing__ has joined #openstack-kolla03:15
Jeffrey4lrwellum, hrm, which container require openstack client?03:16
rwellumJeffrey4l: actually no clue - I'd have to dig through them all - but I assume it's the same if it's kolla-ansible03:17
rwellumWell from a Service level anyway03:17
rwellumkfox1111: Any way to tell? ^^^03:17
Jeffrey4lrwellum, fond this https://github.com/openstack/kolla-kubernetes/blob/master/helm/kolla-common/templates/_common_create_keystone_service.yaml#L3703:18
mikalrwellum: "kolla-ansible genconfig" is crashing now is the next spot I am stuck on03:18
*** yangyapeng has joined #openstack-kolla03:18
reddreamsterJeffrey4l, ok, I can file a bug. But I'm using the head version of branch ocata of kolla-ansible, and "official" build of centos-binary-ocata, maybe it's too normal to be a bug?03:19
kolla-slack<kfox1111> I think kolla kubernetes uses thr openstack cli client only in the toolbox container.03:19
* Jeffrey4l is trying to build the latest kolla-toolbox .03:19
Jeffrey4lkfox1111, seems yes.03:19
rwellumkfox1111: which Jeffrey4l just confirmed with the code above I guess.03:19
Jeffrey4lreddreamster, not sure. maybe some packages is not installed in binary case.03:20
Jeffrey4lreddreamster, did you hit this issue before?03:20
Jeffrey4land centos+source is more stable reddreamster03:20
rwellummikal: I think that's out of date as well in the doc...03:21
*** harlowja has quit IRC03:22
reddreamsterJeffrey4l, yes, we are using a relatively old binary version, maybe 2 months ago, and I'm trying to do an upgrade to latest images with latest kolla-ansible03:22
*** yangyapeng has quit IRC03:22
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible stable/ocata: Pull image from dockerhub rather than tarballs.o.o site  https://review.openstack.org/52170403:23
*** salv-orlando has joined #openstack-kolla03:23
mikalrwellum: herm. This doc is excellent.03:23
mikalrwellum: the doc says to do a "sudo kolla-ansible genconfig", whatfore would that be replaced with now?03:24
rwellumcd kolla-kubernetes; sudo ansible-playbook -e ansible_python_interpreter=/usr/bin/python -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla ./ansible/site.yml03:25
rwellummikal - because we stopped sharing code with kolla-ansible I think03:26
Jeffrey4lrwellum, are you pretty sure you are using latest pike images? seems this openstack binary is already there.03:26
kolla-slack<kfox1111> Yrah. Kolla ansible kept breaking us. We forked it temporarily until we can get more k8s native.03:27
Jeffrey4lreddreamster, which monotonic package version on you system/container.03:27
rwellumJeffrey4l: I'm building from source - and yeah I have stable/pike checked out.03:27
*** salv-orlando has quit IRC03:28
mikalrwellum: and that replaces the "genconfig" bit, yeah?03:28
rwellummikal: yes03:28
kolla-slack<kfox1111> We need somrone to add a source gate for kolla kubernetes to the kolla images at some point.03:28
Jeffrey4lrwellum, check the container by docker run directly.03:28
mikalrwellum: ta03:28
mikalrwellum: I'm writing these up as a patch to the deployment guide, so the effort isn't completely wasted03:29
rwellumkfox1111: true03:29
rwellummikal: np. Like I said ko.py is up-to-date - after a while I stopped updating the guide because of the pace of change and updated my script.03:29
Jeffrey4lneed lunch. bbiab03:30
reddreamsterJeffrey4l, how to check? python package version?03:30
rwellumJeffrey4l: that's a little trickier - because these containers - some of them are temporary containers just to bring something up. kfox1111 any suggestion how to debug this?03:31
kolla-slack<kfox1111> Yeah. That always worried me about the docs. Cant easily be tested.03:31
Jeffrey4ldocker run -it --rm gnocchi-base pip freeze | grep monotonic03:31
Jeffrey4lor rpm -qa | grep monotonic03:31
kolla-slack<kfox1111> Rwellum: add a sleep 10000 to the command03:32
rwellumkfox1111: we need to version the doc I guess - so at least we can have a stable version.03:32
rwellumkfox1111: ah - that approach - will do!03:32
mikalrwellum: Oh, I don't think I fully groked the significance of ko.py03:32
kolla-slack<kfox1111> We need a stable version of thr code too for that03:32
rwellumkfox1111: lol yeah..03:32
kolla-slack<kfox1111> Im hoping jascott1 and inc0 can bang out a prototype operator soon.03:33
kolla-slack<kfox1111> Then we can do a 1.x i think03:33
rwellummikal: idea was to get users up and running quickly - then can move to more realistic deployments. Also has a --demo option which will explain things as you progress if you're interested.03:34
rwellumkfox1111: yeah +103:34
reddreamsterJeffrey4l , docker run -it --rm installation1:4000/lokolla/centos-binary-gnocchi-api:4.0.3 pip freeze | grep monotonic, and it shows monotonic==0.603:37
rwellumkfox1111: so those crashing containers are all toolbox:     image: docker.io/rwellum/centos-source-kolla-toolbox:5.0.103:38
kolla-slack<kfox1111> Yeah. You could always try pinning that one container back to an older ver of the container too.03:38
*** athomas has joined #openstack-kolla03:39
kolla-slack<kfox1111> Probanly something missing from the container or a command changed.03:39
kolla-slack<kfox1111> Gotta head out for a while.03:39
rwellumhttps://review.openstack.org/#/c/519971/1/docker/kolla-toolbox/Dockerfile.j2 - thought this was the fix03:40
Jeffrey4lreddreamster, in my centos+ocata+source env, it is monotonic==1.303:40
reddreamsterJeffrey4l, OK, I'm switching to source build. BTW, should I use 'deploy' or 'upgrade' command of kolla-ansible in order to switch to source?03:41
Jeffrey4lreddreamster, upgrade.03:42
Jeffrey4lfrom requirements project, it say we should use monotonic===1.2  https://github.com/openstack/requirements/blob/stable/ocata/upper-constraints.txt#L19503:42
Jeffrey4linteresting. there must be something wrong ;(03:42
reddreamsterJeffrey4l, thank you jeffrey03:44
Jeffrey4lnp.03:45
reddreamsterJeffrey4l, I can make a double check if my images used are really official binary build.03:46
Jeffrey4lokay. i am trying to use a binary image to check.03:46
*** itlinux has quit IRC03:58
*** harlowja has joined #openstack-kolla04:01
rwellummikal: my bedtime  - but I'll check in the morning see how far you got.04:02
*** yangyapeng has joined #openstack-kolla04:03
reddreamsterJeffrey4l, the monotonic version in the latest binary build is the same as the old one: both are 0.6. And I can import monotonic without any problem in an interactive python session within a container created from this latest binary build.04:04
Jeffrey4lhrm. no idea ;(04:07
*** yangyapeng has quit IRC04:08
*** mdnadeem has joined #openstack-kolla04:10
*** itlinux has joined #openstack-kolla04:12
reddreamsterJeffrey4l, should I delete /tmp/.local_settings.md5sum.txt in my controller nodes?04:17
Jeffrey4lreddreamster, no. this file is required. and will be generated automatically.04:17
reddreamsterJeffrey4l, I remember there was an issue, when switching from binary to source, some static resources will not be generated if this file (.local_settings.md5sum.txt ) is existed before04:19
Jeffrey4lhrm yes. /tmp is mound from host. so need remove the file.04:20
mikalrwellum: ta. The mariadb init is crashing, but that can be a problem for tomorrow.04:20
openstackgerritJeffrey Zhang proposed openstack/kolla stable/ocata: Fix Horizon asset compression not happening on redeploy  https://review.openstack.org/52171004:21
Jeffrey4lreddreamster, here is the patch, which is not backport to ocata ^^04:21
reddreamsterJeffrey4l, you rock04:21
Jeffrey4l;p04:22
*** yangyapeng has joined #openstack-kolla04:24
*** salv-orlando has joined #openstack-kolla04:24
reddreamsterJeffrey4l, my upgrade to source failed at the same container: bootstrap_gnocchi with the same error04:24
Jeffrey4l;(04:25
reddreamstermaybe I should try to destroy and make a new installation04:25
reddreamsterJeffrey4l, seems an upgrade issue?   File "/var/lib/kolla/venv/bin/gnocchi-upgrade", line 6, in <module>     from gnocchi.cli import upgrade04:26
Jeffrey4lshouldn't be matter.04:27
*** lrensing has joined #openstack-kolla04:28
*** yangyapeng has quit IRC04:28
*** salv-orlando has quit IRC04:29
lxdongexternal ceph deploy hit [compute01][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.compute01.asok mon_status [compute01][ERROR ] admin_socket: exception getting command descriptions: [Errno 2] No such file or directory04:36
lxdonghave purged once04:36
*** lrensing has quit IRC04:37
*** reddreamster has quit IRC04:40
inc0good evening04:40
inc0Jeffrey4l: https://review.openstack.org/#/c/518797/ I have no idea where delorean went...04:40
*** lrensing has joined #openstack-kolla04:41
*** itlinux has quit IRC04:44
*** gkadam has joined #openstack-kolla04:46
*** itlinux has joined #openstack-kolla04:47
*** lrensing has quit IRC04:47
*** yangyapeng has joined #openstack-kolla04:48
*** yangyapeng has quit IRC04:52
*** skramaja has joined #openstack-kolla04:55
*** jamesbenson has joined #openstack-kolla05:11
*** janki has joined #openstack-kolla05:13
Jeffrey4linc0, stable branch do not depends on delorean repo it depends centos-release-openstack-pike  repo.05:15
*** jamesbenson has quit IRC05:16
Jeffrey4lplease review https://review.openstack.org/521405  inc0 zhubingbing__ duonghq pbourke05:18
Jeffrey4linc0, now seems the jobs is very slow. the build jobs may timeout for 1 hour 30 min sometimes.05:18
*** salv-orlando has joined #openstack-kolla05:25
*** lrensing has joined #openstack-kolla05:28
*** salv-orlando has quit IRC05:29
*** itlinux has quit IRC05:31
openstackgerritJeffrey Zhang proposed openstack/kolla master: Use 3 hours timeout for gate jobs and install yum-axelget  https://review.openstack.org/52171605:33
*** reddreamster has joined #openstack-kolla05:35
*** caowei has joined #openstack-kolla05:36
*** yangyapeng has joined #openstack-kolla05:37
*** pcaruana has joined #openstack-kolla05:39
*** goutham has quit IRC05:42
*** goutham has joined #openstack-kolla05:43
spsuryamorning guys05:48
*** harlowja has quit IRC05:52
*** jamesbenson has joined #openstack-kolla05:53
*** jamesbenson has quit IRC05:57
*** zhangfei has quit IRC06:05
spsuryakrtaylor: what you think how much work is remaining in this https://blueprints.launchpad.net/kolla-ansible/+spec/ka-queens-doc-restructure06:09
spsuryawanted to discuss about this06:11
spsuryaactually our tz is different06:12
*** lrensing has quit IRC06:12
*** pcaruana has quit IRC06:13
*** zhangfei has joined #openstack-kolla06:18
*** dciabrin has quit IRC06:18
*** dciabrin has joined #openstack-kolla06:19
*** mdnadeem has quit IRC06:22
*** heigao_1212 has joined #openstack-kolla06:22
*** dciabrin has quit IRC06:22
*** jdandrea has quit IRC06:23
*** heigao has quit IRC06:23
*** janki has quit IRC06:23
*** janki has joined #openstack-kolla06:23
*** jdandrea has joined #openstack-kolla06:24
*** salv-orlando has joined #openstack-kolla06:24
*** dciabrin has joined #openstack-kolla06:25
reddreamsterHi, during upgrade, the task "ceph : Mounting Ceph OSD volumes" takes very long time for a node, is it normal?06:26
*** mdnadeem has joined #openstack-kolla06:38
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145006:49
*** mdnadeem has quit IRC06:57
openstackgerritMerged openstack/kolla stable/ocata: Pin fluent-plugin-grok-parser to 2.1.4  https://review.openstack.org/52133607:01
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145007:04
reddreamsterHello, I'm debugging my problem with container bootstrap_gnocchi, I found it fails at this statement: clock_gettime = ctypes.CDLL(ctypes.util.find_library('c'), use_errno=True).clock_gettime07:04
reddreamsterexception is Resource temporarily unavailable07:05
reddreamsterCan anybody help me out?07:05
openstackgerritJeffrey Zhang proposed openstack/kolla stable/ocata: Dockerhub publisher job  https://review.openstack.org/52133407:09
*** mdnadeem has joined #openstack-kolla07:10
openstackgerritJeffrey Zhang proposed openstack/kolla stable/ocata: Fix Horizon asset compression not happening on redeploy  https://review.openstack.org/52171007:10
*** cah_link has joined #openstack-kolla07:13
*** manheim has joined #openstack-kolla07:14
*** cah_link has quit IRC07:16
lxdongERROR! Unexpected Exception, this is probably a bug: No module named oslo_config07:17
*** egonzalez has joined #openstack-kolla07:18
*** cah_link has joined #openstack-kolla07:19
*** gkadam has quit IRC07:20
*** jamesbenson has joined #openstack-kolla07:24
lxdongpip show oslo_config Name: oslo.config Version: 5.1.0 Summary: Oslo Configuration API Home-page: https://docs.openstack.org/oslo.config/latest/ Author: OpenStack Author-email: openstack-dev@lists.openstack.org License: UNKNOWN Location: /usr/lib64/python2.7/site-packages Requires: debtcollector, six, oslo.i18n, stevedore, PyYAML, netaddr, rfc398607:25
*** magicboiz has quit IRC07:26
*** jamesbenson has quit IRC07:30
*** pcaruana has joined #openstack-kolla07:30
openstackgerritMerged openstack/kolla-ansible stable/pike: Zuul: add file extension to playbook path  https://review.openstack.org/51604307:30
openstackgerritMerged openstack/kolla-ansible master: Zuul: add file extension to playbook path  https://review.openstack.org/51604207:30
*** lpetrut has joined #openstack-kolla07:32
*** manheim has quit IRC07:34
lxdongWhy would kolla_internal_vip_address be inet 192.168.4.99/32 scope global eth0?07:41
lxdongIsn't is should be 192.168.4.99/0?07:41
*** heigao_1212 has quit IRC07:42
*** heigao_1212 has joined #openstack-kolla07:43
openstackgerritMerged openstack/kolla stable/pike: Bump kafka version to 0.10.2.1  https://review.openstack.org/52140507:47
*** shardy has joined #openstack-kolla07:49
*** manheim has joined #openstack-kolla07:52
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145007:56
*** jamesbenson has joined #openstack-kolla08:06
lxdongShall I enable_ceph_rgw if I use external ceph?08:06
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145008:06
Jeffrey4legonzalez, could u review https://review.openstack.org/50804608:07
lxdongI can't upload images with external ceph.08:08
lxdongIt keeps saving.08:09
*** jamesbenson has quit IRC08:11
*** rmart04 has joined #openstack-kolla08:16
*** salv-orlando has quit IRC08:18
*** salv-orlando has joined #openstack-kolla08:18
*** heigao_1212 has quit IRC08:20
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145008:21
*** salv-orlando has quit IRC08:22
*** salv-orlando has joined #openstack-kolla08:31
*** reddreamster has quit IRC08:31
openstackgerritWei Cao proposed openstack/kolla-ansible master: Add CephFS backend in Manila  https://review.openstack.org/51619608:35
*** lpetrut has quit IRC08:36
*** magicboiz has joined #openstack-kolla08:38
*** lpetrut has joined #openstack-kolla08:40
lxdongWill friends using external ceph share something helpful?08:40
*** mgoddard has joined #openstack-kolla08:45
*** reddreamster has joined #openstack-kolla08:46
reddreamsterJeffrey4l, I make a destroy and deploy, and now it seems OK. So I won't file a bug for bootstrap_gnocchi08:47
openstackgerritWei Cao proposed openstack/kolla-ansible master: Add CephFS backend in Manila  https://review.openstack.org/51619608:50
*** zhubingbing__ has quit IRC08:54
*** zhubingbing__ has joined #openstack-kolla08:56
*** zhangfei has quit IRC08:58
*** lpetrut has quit IRC08:59
*** gkadam has joined #openstack-kolla09:01
reddreamsterJeffrey4l, I make a destroy and deploy, and now it seems OK. So I won't file a bug for bootstrap_gnocchi09:01
*** amoralej|off is now known as amoralej09:01
Jeffrey4lreddreamster, ok..09:04
*** jamesbenson has joined #openstack-kolla09:09
*** honza has quit IRC09:09
reddreamsterJeffrey4l, but it's still strange that  ctypes.CDLL(ctypes.util.find_library('c'), use_errno=True).clock_gettime failed09:09
Jeffrey4lreddreamster, are you using centos+binary or source?09:10
Jeffrey4lyes. no idea why..09:10
openstackgerritJeffrey Zhang proposed openstack/kolla master: Add squid cache proxy to speed up build  https://review.openstack.org/52145009:10
reddreamsterJeffrey4l, maybe some upstream (docker?) problem. Yes, I failed to upgrade to source, then I make a clean installation using centos+source09:12
Jeffrey4lcan not understand. just load a c library. ;(09:12
*** jamesbenson has quit IRC09:13
reddreamsteranyway, thank you, Jeffrey4l09:13
Jeffrey4lnp ;)09:13
*** honza has joined #openstack-kolla09:14
*** honza is now known as Guest1908509:14
*** zhangfei has joined #openstack-kolla09:15
reddreamsterJeffrey4l, the reason I want to upgrade to the latest ocata, is I failed to enable ironic. When I enable ironic switch and make an upgrade, all compute nodes and storages get stuck, a lot of CPU soft lockup and I think you have fixed this problem.09:18
Jeffrey4lwhat is "get stuck", and CPU soft lookup? reddreamster ?09:18
reddreamsterI noticed that iscsid containers keep restarting, and most compute nodes and storages nodes became very slow and unresponsive. And a lot of "kernel:NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s" kind of messages09:23
reddreamsterI have to hard reset and remove iscsid containers.09:23
Jeffrey4lreddreamster, i saw such issue. but did nothing for this. i am thinking it is a bug from kernel or docker09:26
jmccarthyAnyone familiar with using rsync to connect with a daemon running on non-default port ? (i.e. swift)09:26
jmccarthyFor me, rsync replication fails, since it seems to always be trying to connect on 87309:27
Jeffrey4ljmccarthy, rsync -e '-p 8022'09:27
Jeffrey4ljmccarthy, rsync -e ' ssh -p 8022'09:27
Jeffrey4ljmccarthy, rsync -e 'ssh -p 8022'09:27
jmccarthyI have to bring ssh into it ? I found --port= mentioned in a few places, but that didn't seem to work as of yet09:28
reddreamsterJeffrey4l, OK, then what's the right way to enable ironic?09:28
lxdongBuildAbortException: Build of instance 383c9e91-53ec-4ec9-9d23-f728f1072f41 aborted: Volume de6e003a-7af6-412f-8960-b7f5a5c6988a did not finish being created even after we waited 0 seconds or 1 attempts. And its status is error.09:28
jmccarthyJeffrey41: Will that work with something like:09:29
jmccarthyrsync --recursive --whole-file --human-readable --xattrs --itemize-changes --ignore-existing --timeout=30 --contimeout=30 --bwlimit=0 --exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z] /srv/node/sdb1/objects/143/547 10.196.222.43::object/sdb1/objects/14309:29
Jeffrey4lreddreamster, just enable_ironic=yes? and you may need prepare some ironic-kernel and configuration before and after the deployment.09:29
Jeffrey4ljmccarthy, or add the port into ~/.ssh/config file.09:30
Jeffrey4ljmccarthy, i think it should work.09:30
reddreamsterI have create a fedora image using disk-image-create, and copied them to /etc/kolla/config/ironic/, and also enable the switch. Is it ok?09:31
Jeffrey4lreddreamster, yes.09:31
jmccarthyJeffrey41: Ok I experiment with that :) Thanks !09:32
*** goutham has left #openstack-kolla09:32
*** ktibi has joined #openstack-kolla09:34
*** yingjun has quit IRC09:34
*** lpetrut has joined #openstack-kolla09:42
reddreamsterJeffrey41, I want to have another try to enable ironic, when I want to add a new service, should I use deploy or reconfigure or upgrade?09:43
reddreamsterHi guys, can I ask a basic question? When I want to add a new service, should I use deploy or reconfigure or upgrade of kolla-ansible?09:53
*** gfidente has joined #openstack-kolla09:56
*** gfidente has quit IRC09:56
*** gfidente has joined #openstack-kolla09:56
*** salv-orlando has quit IRC10:00
*** salv-orlando has joined #openstack-kolla10:01
*** duonghq has quit IRC10:02
*** janki has quit IRC10:02
*** janki has joined #openstack-kolla10:02
*** jascott1 has quit IRC10:03
japestinhoreddreamster, afaik just do kolla-ansible deploy again10:03
reddreamsterjapestinho, ok, thank you10:04
*** salv-orlando has quit IRC10:05
*** daidv has quit IRC10:05
*** goutham has joined #openstack-kolla10:09
egonzalezreddreamster, yep, deploy is the way10:16
*** caowei has quit IRC10:23
*** tovin07_ has quit IRC10:23
*** jamesbenson has joined #openstack-kolla10:25
*** goldyfruit has joined #openstack-kolla10:28
reddreamsteregonzalez, got it, thank you10:28
*** jamesbenson has quit IRC10:30
jmccarthyWhat's the quickest way these days to get a kolla deploy going (without building images) ? (I don't need master/very latest)10:45
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla-ansible master: Add a precheck to ensure Cinder backend enabled  https://review.openstack.org/52105110:46
*** goldyfruit has quit IRC10:47
*** goldyfruit has joined #openstack-kolla10:50
*** reddreamster has quit IRC10:54
*** zhangfei has quit IRC10:57
*** salv-orlando has joined #openstack-kolla11:01
*** salv-orlando has quit IRC11:06
*** goldyfruit has quit IRC11:08
openstackgerritMerged openstack/kolla master: Bump kafka version to 0.11.0.2  https://review.openstack.org/52137211:15
openstackgerritMerged openstack/kolla master: Install libvirt-clients for nova-libvirt image  https://review.openstack.org/50804611:25
*** k_mouza has joined #openstack-kolla11:28
jmccarthyAnyone hit this if trying to do all-in-one ? http://paste.openstack.org/show/626929/11:32
openstackgerritVladislav Belogrudov proposed openstack/kolla-ansible master: Move Cinder backend passwords to passwords.yml  https://review.openstack.org/52181711:33
egonzalezjmccarthy, is ansible version, min 2.2 or 2.3 iirc11:38
jmccarthyHmm I'm on ansible 2.1.0.011:40
jmccarthyDam ..11:40
openstackgerritJeffrey Zhang proposed openstack/kolla stable/pike: Install libvirt-clients for nova-libvirt image  https://review.openstack.org/52181911:41
jmccarthyegonzalez: What version ansible should I go with if I'm trying 'pip install kolla-ansible' method ?11:43
egonzalezjmccarthy, 2.2.011:44
jmccarthykk - thanks !11:45
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Configure glance ceph during upgrade and genconfig  https://review.openstack.org/51572011:50
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Support configuration of custom fluentd filters  https://review.openstack.org/51344511:51
mgoddardHi Folks, could someone take a look at https://review.openstack.org/#/c/478993/? It's been sitting around for a long time, and makes ironic unusable.11:54
mgoddardIt has a +2 already...11:54
jmccarthyHrm howabout this ? I am just going wrong all over .. http://paste.openstack.org/show/626932/11:55
jmccarthyAh .. ok I'm double checking the requirements table ..11:58
*** salv-orlando has joined #openstack-kolla12:01
jmccarthyWhat version should I have instead of 5.0.0 for latest from docker.io ?12:03
jmccarthy"image": "kolla/centos-binary-cron:5.0.0", "volumes": ["/etc/kolla//cron/:/var/lib/kolla/config_files/:ro", "/etc/localtime:/etc/localtime:ro", "kolla_logs:/var/log/kolla/"]}}, "msg": "Unknown error message: Tag 5.0.0 not found in repository12:03
jmccarthyIs there a way to check what the most recent versons/images of what are available there ?12:07
jmccarthyOk 4.0.0 is there, that'll do12:15
*** rhallisey has joined #openstack-kolla12:15
*** Guest19085 is now known as honza12:27
*** goutham has quit IRC12:42
openstackgerritHeetae Ahn proposed openstack/kolla master: Add RHEL subscription registration  https://review.openstack.org/49514812:44
*** yangyapeng has quit IRC12:44
*** yangyapeng has joined #openstack-kolla12:45
*** yangyapeng has quit IRC12:49
*** mtsv has joined #openstack-kolla12:56
*** goutham has joined #openstack-kolla12:56
*** zshi has quit IRC12:58
mtsvHello, I'm trying to provision nodes manually using kolla/bifrost but I'm getting the following error:12:58
mtsv()[root@node01-head bifrost]# cd /bifrost12:58
mtsv()[root@node01-head bifrost]# . env-vars12:58
mtsv()[root@node01-head bifrost]# export BIFROST_INVENTORY_SOURCE=/etc/bifrost/servers.yml12:58
mtsv()[root@node01-head bifrost]# ansible-playbook -vvvv -i /bifrost/playbooks/inventory/bifrost_inventory.py /bifrost/playbooks/enroll-dynamic.yaml -e "ansible_python_interpreter=/var/lib/kolla/venv/bin/python" -e @/etc/bifrost/bifrost.yml12:58
mtsvNo config file found; using defaults12:58
mtsvERROR! The file /bifrost/playbooks/inventory/bifrost_inventory.py is marked as executable, but failed to execute correctly. If this is not supposed to be an executable script, correct this with `chmod -x /bifrost/playbooks/inventory/bifrost_inventory.py`.12:58
mtsvInventory script (/bifrost/playbooks/inventory/bifrost_inventory.py) had an execution error:12:58
mtsvHas anyone seen that before?12:58
*** zshi has joined #openstack-kolla12:59
*** Pavo has joined #openstack-kolla12:59
*** amoralej is now known as amoralej|lunch13:00
*** lxdong has quit IRC13:00
*** Pavo has quit IRC13:00
gouthamhttps://hastebin.com/gubilijecu.vbs deployment failing with this error any idea??13:10
gouthamegonzalez: ^^13:10
*** dave-mccowan has joined #openstack-kolla13:11
gouthami used centos binary images this time kolla stable/pike13:11
openstackgerritAndy Smith proposed openstack/kolla-ansible master: Add support for hybrid messaging backends  https://review.openstack.org/46896613:11
gouthamhttps://hastebin.com/etosipegez.pl ---> inventory file13:13
gouthamFailed while checking if the nova compute service is up13:14
gouthamon the controller13:14
rwellumjmccarthy: currently on dockerhub, 4.0.0 is the latest. There are a couple of patches in flux to push pike and master too.13:15
gouthaminc0: any idea???13:15
*** yangyapeng has joined #openstack-kolla13:16
*** dave-mcc_ has joined #openstack-kolla13:16
*** dave-mccowan has quit IRC13:17
*** shardy is now known as shardy_lunch13:22
ktibigoutham docker logs nova_compute13:23
ktibion compute node13:23
gouthamok ktibi13:23
gouthamjust a sec i will give i trying to deploy again13:24
*** mdnadeem has quit IRC13:26
gouthamktibi: it is failing the node which was assigned a controller role13:31
ktibigoutham do you have container on your compute node ?13:35
gouthamye s13:35
gouthamhttps://hastebin.com/imotenanob.cs  --- ktibi13:35
gouthamdocker logs ^^13:35
ktibiok and you have always Waiting for nova-compute service up ?13:36
gouthamyes13:36
ktibion controler => docker exec kolla_toolbox openstack --os-interface internal --os-auth-url http://192.168.122.195:35357 --os-identity-api-version 3 --os-project-domain-name default --os-tenant-name admin --os-username admin --os-password R0W5dVdDjz64khXvdw2cVr2V7Bb6cfpkxiHkvAOx --os-user-domain-name default compute service list -f json13:37
gouthamhttps://hastebin.com/yudafudegu.go13:38
*** mgoddard has quit IRC13:40
*** amoralej|lunch is now known as amoralej13:44
gemahrw: how do I look up the version of a package in centos?13:44
gemahrw: what's the dpkg -l equivalent?13:44
gouthamktibi: any idea???13:45
*** mgoddard has joined #openstack-kolla13:45
hrwgema: yum, rpm13:45
gemayeah, but how do you get the version of the package?13:45
*** shardy_lunch is now known as shardy13:45
hrwgema: "yum info package" or "rpm -q package" if for installed13:46
gouthamhrw: any idea on this?? https://hastebin.com/gubilijecu.vbs deployment failing with this error any idea??13:46
gouthamhttps://hastebin.com/etosipegez.pl ---> inventory file13:46
hrwgoutham: I am good at building, not at deploying ;(13:47
gouthamok hrw thanks13:47
ktibigoutham I think your nova-compute can't contact controler13:48
ktibican you can go in nova-compute container13:48
ktibiand try to curl internal API13:48
*** rmart04 has quit IRC13:48
gouthaminternal api u mean??13:49
gouthamyes i could login13:49
rwellumhrw: Do you know the version of libvirt we package in pike images?13:49
gouthamktibi: ^13:50
*** salv-orlando has quit IRC13:51
*** salv-orlando has joined #openstack-kolla13:52
hrwrwellum: for Debian it would be 3.6.0 one13:52
ktibigoutham ok no network pb13:52
hrwrwellum: ubuntu goes with 3.6 as well13:52
ktibigoutham send from controller /var/lib/docker/volumes/kolla_logs/_data/nova/nova-compute.log13:53
hrwrwellum: do not remember centos version13:53
rwellumThat's the one version I need :)13:55
gouthamktibi:  there is no compute-log :(13:55
*** salv-orlando has quit IRC13:55
*** salv-orlando has joined #openstack-kolla13:56
hrwrwellum: "docker run -it kolla/centos-base-binary:5.0.1 yum into libvirt"?13:56
ktibigoutham your nova-compute container no works, I don't know why, docker logs have nothing very strange.....13:57
rwellumhrw: ok bringing cluster back up and will check13:58
gouthamok ktibi i will see13:58
hrwrwellum: 3.2.0 looks like14:01
hrwrwellum: but I checked with quite old image so may lack current repos14:01
rwellumhrw: ok will check.14:02
rwellumI'm chasing that darn libvirt bug again.14:02
hrw;(14:03
*** skramaja has quit IRC14:03
hrwrwellum: I have to chase where default vm is defined. libvirt or nova and find/convince devs to change it14:04
rwellumhrw: change what sorry?14:04
*** jascott1 has joined #openstack-kolla14:05
hrwrwellum: on x86 VM is pci machine so you can add storage/network at any random moment.14:05
hrwrwellum: on aarch64 VM is pcie machine and has just one pcie slot free for storage/network by default14:05
hrwrwellum: and 99.99% of uses is on x86 so no one bother14:06
hrwrwellum: piix4 is pci, q35 is pcie but no one uses q35 on x8614:06
rwellumhrw: interesting - just don't see the relevance to what we were talking about regarding libvirt. :)14:06
hrwrwellum: you just reminded me that I have that on my todolist14:07
*** jascott1 has quit IRC14:09
rwellumOh well you're welcome hrw :)14:10
*** japestinho has quit IRC14:18
hrwrwellum: o, I did not noticed that you are on sdi-team ml ;D14:24
rwellumBlame gema :)14:24
*** jmccarthy1 has joined #openstack-kolla14:25
gouthamany one has idea on cAdvisor ???14:25
*** mdnadeem has joined #openstack-kolla14:26
*** jmccarthy has quit IRC14:27
*** clayton has quit IRC14:27
*** clayton has joined #openstack-kolla14:30
hrwrwellum: this week I mostly blame bigtop devs14:31
* hrw out14:32
*** goutham has quit IRC14:39
*** egonzalez has quit IRC14:43
*** egonzalez has joined #openstack-kolla14:46
*** pbourke has quit IRC14:47
*** pbourke has joined #openstack-kolla14:49
ktibianyone can help me we my review ? I need to add a release note but first time for me :/14:50
ktibihttps://review.openstack.org/#/c/519302/14:50
egonzalezktibi, install reno (pip install reno) then create a release note with (reno new <title>) and add content to it14:54
egonzalezktibi, https://docs.openstack.org/reno/latest/user/usage.html14:54
*** jtriley has quit IRC14:55
sdakektibi pip install reno14:56
sdakektibi reno new slugname14:56
sdakemodify slug14:56
sdakecommit it with the change14:56
*** magicboiz has quit IRC14:56
sdakelooks like egonzalez answered you already lol14:56
ktibisdake egonzalez ok I added my notes. git add + review -s ?15:02
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Change listen for mdns  https://review.openstack.org/51930215:04
ktibilike that ?15:05
*** janki has quit IRC15:07
*** k_mouza has quit IRC15:07
*** k_mouza has joined #openstack-kolla15:08
*** dciabrin has quit IRC15:09
*** dciabrin has joined #openstack-kolla15:09
*** jtriley has joined #openstack-kolla15:09
*** jtriley has quit IRC15:10
*** mdnadeem has quit IRC15:10
*** jtriley has joined #openstack-kolla15:11
*** jtriley has joined #openstack-kolla15:11
*** jamesbenson has joined #openstack-kolla15:13
*** jamesbenson has quit IRC15:13
*** daidv has joined #openstack-kolla15:30
*** dciabrin has quit IRC15:32
*** tvignaud has quit IRC15:32
ktibiegonzalez can you cherry pick your fix about endpoint ?15:44
rwellumsdake: inc0 you guys see the issue pop up on the kolla mailer about nova-compute not coming up in Pike stable. Fairly sure that's very similar to the issues I've been seeing with libvirt for weeks.15:44
*** jmccarthy1 has left #openstack-kolla15:47
*** jmccarthy has joined #openstack-kolla15:47
*** tvignaud has joined #openstack-kolla15:49
*** lrensing has joined #openstack-kolla15:51
*** lrensing has quit IRC15:51
*** jistr is now known as jistr|mtg15:59
egonzalezrwellum, not really sure, may be issues from 5.0.0 when centos 7.4 was released, asked more info in the email16:00
*** egonzalez has quit IRC16:02
*** yangyapeng has quit IRC16:02
*** yangyapeng has joined #openstack-kolla16:03
*** jamesbenson has joined #openstack-kolla16:03
*** ansmith has joined #openstack-kolla16:04
*** cah_link has quit IRC16:04
*** manheim has quit IRC16:04
*** janki has joined #openstack-kolla16:06
*** gaoyan has joined #openstack-kolla16:07
*** yangyapeng has quit IRC16:08
*** itlinux has joined #openstack-kolla16:10
*** mgoddard has quit IRC16:10
*** gaoyan has quit IRC16:13
*** lrensing has joined #openstack-kolla16:13
*** jistr|mtg is now known as jistr16:16
*** manheim has joined #openstack-kolla16:16
*** rhallisey has quit IRC16:18
*** manheim has quit IRC16:21
*** manheim has joined #openstack-kolla16:29
*** daidv has quit IRC16:39
*** rhallisey has joined #openstack-kolla16:42
*** salv-orlando has quit IRC16:45
*** salv-orlando has joined #openstack-kolla16:46
*** salv-orlando has quit IRC16:50
jmccarthyAny ideas about an error like this with swift ? My 'operator' node has nothing to do with swift-account-server, swift-container-server, or swift-object-server afaik16:51
jmccarthyhttp://paste.openstack.org/show/626975/16:51
*** openstackstatus has quit IRC16:58
*** goldyfruit has joined #openstack-kolla16:58
*** openstackstatus has joined #openstack-kolla16:59
*** ChanServ sets mode: +v openstackstatus16:59
*** goldyfruit has quit IRC17:01
*** mgoddard has joined #openstack-kolla17:01
*** salv-orlando has joined #openstack-kolla17:02
*** goldyfruit has joined #openstack-kolla17:08
*** vhosakot has joined #openstack-kolla17:08
*** ntpttr_laptop has joined #openstack-kolla17:08
*** yangyapeng has joined #openstack-kolla17:09
vhosakotinc0: the talk with rwellum at Sydney went well. The video is up.  The forum sessions with Jeffrey4l also went well.  we missed you17:09
openstackgerritKevin Tibi proposed openstack/kolla-ansible master: Horizon multidomain flag  https://review.openstack.org/52195017:11
vhosakotinc0: Jeffrey4l has the links to the etherpads for all the sessions.17:12
ktibiegonzalez if you can check my PR ;)17:12
*** yangyapeng has quit IRC17:14
*** manheim has quit IRC17:20
*** manheim has joined #openstack-kolla17:20
*** janki has quit IRC17:22
*** ansmith has quit IRC17:24
*** manheim has quit IRC17:25
*** gkadam has quit IRC17:26
*** goldyfruit has quit IRC17:28
*** absubram has joined #openstack-kolla17:34
*** abishop has joined #openstack-kolla17:34
*** jascott1 has joined #openstack-kolla17:35
*** k_mouza has quit IRC17:37
*** pcaruana has quit IRC17:48
*** rhallisey has quit IRC17:53
abishopI have a question for the container experts17:55
abishopI'm a openstack developer chasing a bug that is unrelated to containers17:55
abishopI'd like to patch some openstack code (something in site-packages) inside a container (say, to add an extra log message)17:55
abishopis that possible?17:55
*** jtriley has quit IRC17:58
*** hongbin has joined #openstack-kolla17:58
inc0good morning17:59
inc0abishop: sure it's possible18:00
inc0which project you need?18:00
abishopinc0: in the cinder_api container, I'd like to patch something in site-packages/castellan18:01
inc0ah ok, I was asking because for most project we have dev mode that would make things easier18:02
abishopI already tried bind mounting the hosts's site-packages/castellan but it didn't help18:02
inc0what happened?18:02
abishopinside the container, I can see the hosts's stuff18:02
abishopon host, I deleted .py[co] file18:03
inc0well bindmount will mean that it will use host code for this oen18:03
abishopcontainer is clearly running the original code, and does not seem to "pick up" the modified .py file18:03
inc0ahh18:03
inc0hmm18:03
abishopI was hoping I could patch from the host side, restart container18:03
*** jistr is now known as jistr|off|trng18:04
inc0so if you're using kolla images with source builds18:04
*** lrensing has quit IRC18:04
inc0it will use venv18:04
inc0just so you know18:04
* abishop has lots to learn18:04
inc0I mean your thinking is correct, add volume to container run that will bindmount some host dir to correct place inside container18:04
abishopI've done that for other stuff, but never tried patching code until now18:05
inc0question is if you bindmounted to correct place, so tell me, which images are you using and where did you bindmount exactly?18:05
*** jtriley has joined #openstack-kolla18:06
abishopsome background: I'm a combo cinder/tripleo guy18:07
abishopsee https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/cinder-api.yaml#L15218:07
abishopI added an extra line mapping host's site-packages/castellan (repeated full path on both sides of ':')18:07
jamesbensonmorning inc018:08
*** david-lyle has quit IRC18:09
*** david-lyle has joined #openstack-kolla18:09
inc0abishop: ok, background - I know very little about tripleo;)18:09
jamesbensonhas anyone deployed k8s from swarm?18:09
abishopinc0: then we're in good company, because I know little about containers!18:09
inc0but sum of us would create mega-openstack-o-tron18:10
inc0ok so if you run docker exec -it << cinder container name >> bash18:10
abishopinc0: I can "docker inspect" to confirm the bind mount is correct, and can "see" the host's stuff from inside the container18:10
inc0but it doesn't pick up code inside?18:11
abishopyup, done that; that's how I verify the container can see the host's file18:11
inc0try python -c "import castellan; castellan.__file__"18:11
abishopinteresting! will do that soon, but I have the wheels off the wagon at the moment (redeploying)18:12
inc0ok18:12
inc0well if you're using source builds18:12
inc0like centos-source-cinder...18:12
inc0images18:12
inc0then code will run inside virtualenv and venv path is https://github.com/openstack/kolla/blob/master/docker/openstack-base/Dockerfile.j2#L40218:14
inc0so if you bound to hosts site-packages, that might not be correct one18:14
abishopI don't know for certain how the images are built. I'd have to ask other tripleo folks who did that work18:14
*** dciabrin has joined #openstack-kolla18:14
inc0what's image name?18:14
inc0well in any case, that's worth to check18:15
abishopdocker.io/tripleomaster/centos-binary-cinder-api18:15
*** jmccarthy has left #openstack-kolla18:16
*** amoralej is now known as amoralej|off18:16
inc0right so it's binary18:17
inc0well still check castellan.__file__18:17
inc0pbourke mandre sdake vhosakot can I have eyes on this please? https://review.openstack.org/#/c/518797/18:17
inc0if we merge it, tomorrow we'll have stable pike images in hub18:18
vhosakotinc0: sure, will review it18:18
*** rhallisey has joined #openstack-kolla18:21
sdakeinc0 should it be failing gates?18:25
sdakeinc0 i'll provide a review however18:25
inc0well whole deployment works18:26
inc0thing is, without it our regular gates are just dead18:26
*** shardy has quit IRC18:26
inc0we need these images on hub because tarballs weren't updated for a long time now18:26
sdakeinc0 cool18:30
sdakeinc0 will take a look18:30
sdakeinc0 let me finish this call with electrician18:30
openstackgerritMerged openstack/kolla stable/pike: implement deploy jobs in kolla  https://review.openstack.org/52133218:35
openstackgerritMerged openstack/kolla master: Include required packages for libvirt SASL auth on CentOs/RHEL  https://review.openstack.org/52011418:35
*** noVNC has joined #openstack-kolla18:38
noVNChi all18:40
noVNCdoes kolla apply host timezone to containers ?18:40
*** manheim has joined #openstack-kolla18:41
*** ntpttr_laptop has quit IRC18:45
*** jtriley_ has joined #openstack-kolla18:46
inc0noVNC: we don't do anything with TZ18:46
*** jtriley has quit IRC18:47
*** ansmith has joined #openstack-kolla18:49
kfox1111inc0: sorry I didn't post the thing last night. still have a few things to go.18:51
*** ntpttr_laptop has joined #openstack-kolla18:51
kfox1111but I'll post what I got now so you can poke at it.18:51
inc0cool18:51
inc0one thing I found out is that debians also have some support for kickstart18:52
kfox1111mostly I just gotta get a temporary dhcp server going.18:52
kfox1111yeah. ubuntu/debian uses something called preseed.18:52
inc0no, I'm saying is they understand kickstart itself18:52
kfox1111not quite as good, but can totally automate thigns.18:52
kfox1111oh really?18:52
inc0it has preseed with more features18:52
inc0but basically what we need is there18:53
kfox1111nice. :)18:53
inc0https://help.ubuntu.com/community/KickstartCompatibility18:53
inc0well it doesn't have RAID support and whatnot, but I don't need it for my stuff and you don't use ubuntu18:54
kfox1111interesting.18:54
kfox1111oh, bummer.18:54
kfox1111we do use that a fair amount here.18:54
inc0ah18:54
inc0well18:54
kfox1111still, its a good start. :)18:54
inc0so I guess we'll need preseed after all18:54
inc0but we know where to start18:54
kfox1111+118:55
kfox1111templating out preseed is the same amount of effort to doing kickstart I think.18:55
inc0well different formats18:55
kfox1111I think we're pretty much 1/1 in I use el and you use ubuntu,18:55
inc0but yeah, not an issue18:55
kfox1111so between the two of us, we shoudl be able to come up with some reference templates for both.18:55
kfox1111:)18:55
inc0right18:55
sdakeanyone know anything about g uitars18:55
inc0I can hack up piece of python+jinja2 in few hrs18:56
inc0jascott1 knows a lot about guitars18:56
sdakejascott1 need a recommendation plz18:56
kfox1111inc0: https://github.com/kfox1111/charts/tree/kube-provision-node/incubator/kube-provision-node18:56
jascott1sdake what are you looking for? electric or acoustic?18:56
sdakejascott1 electirc for my son - starter guitar18:57
sdakehere are rthe recommendations we have so far18:57
sdakehttps://www.amazon.com/dp/B0002CZURO/ref=as_li_ss_tl?ie=UTF8&linkCode=sl1&tag=consordini-20&linkId=66cc643f79247692e46d9e30bb294c6d18:57
*** itlinux has quit IRC18:57
sdakehttps://www.amazon.com/dp/B0010X7LF818:57
kfox1111inc0: all of it is pretty good except the dhcp chart. its half baked. gonna be working on that next.18:57
jascott1sdake standards are pretty heavy18:57
inc0where do you have images?18:57
sdakemy son picked out this: https://www.amazon.com/Epiphone-Electric-Guitar-Coil-Splitting-Handed/dp/B01FVAIOVU?th=118:57
kfox1111inc0: hub's building all the images.18:58
inc0right...where can I find dockerfiles?;)18:58
jascott1sdake yeah that is known as an SG18:58
jascott1the style of that guitar18:58
inc0I'll try to hack up docker compose for this quickly18:58
sdakewhich liink - the 1st, 2nd, or third? :)18:58
kfox1111inc0: all my stuff is autobuilt. so has pointers to the github repos.18:58
jascott1the 2nd one with the amp18:59
kfox1111inc0: easier to do minikube.18:59
sdakewhat about the 3rd one18:59
kfox1111it does use k8s 3rd party resources for things.18:59
sdakethat is what he picked out (online)18:59
sdakeno idea what coil splitting is19:00
sdakei looked online19:00
sdakelooked like greek to me :)19:00
jascott1so the pickups are single coil or double (also known as humbucker). split means you can use the double as two singles19:00
jascott1using switches to control which pickups are used give syou different tones19:00
sdakepickups = microphone?19:01
sdakecoil splitting sounds more complicated19:01
jascott1basically19:01
sdakemy son is 13..... :)19:01
jascott1the epiphones are Gibson copies. some are pretty nice19:01
jascott1the pickups are just magnetic pole pieces, one for each string. each magnet is affected by the vibration of the string and sends that as signal19:03
rwellumsdake: How about: https://reverb.com/p/gibson-custom-shop-jimmy-page-number-two-les-paul-signed-tom-murphy-aged-sunburst-2009?gclid=Cj0KCQiAus_QBRDgARIsAIRGNGhXC2w6yJpinRS9F_6jZBAgEoiAeCzGxEm5I2AkJCjs0UF5GIiTBSsaApKkEALw_wcB&hfid=607660719:03
*** Pavo has joined #openstack-kolla19:03
rwellumThe shipping is a bit steep though :(19:03
*** itlinux has joined #openstack-kolla19:03
jascott1Fender Stratocasters (David Gilmour, Eric Clapton) have single coils and have that more treble screeching lead sound19:04
sdakeso epiphone is a legit brand, and double coil is complicated?19:04
jascott1Gibson Les Pauls use double coils which gives it a bassy-er tone which is more smooth (allman brothers, Slash)19:04
jascott1not complicated. its just 2 single coils wound together19:05
jascott1sdake I will take one of those Jimmy Page guitars19:05
rwellumjascott1: have you run your ansible pb against pike images?19:05
jascott160k is ridiculous19:05
*** noVNC has quit IRC19:06
jascott1https://reverb.com/item/4880729-paul-reed-smith-dragon-i?gclid=Cj0KCQiAus_QBRDgARIsAIRGNGhcpFuL1CQwhj8LFbpTevBThdBqSS5r1RuraA2jmB4vCMk1MBhJflwaAkZxEALw_wcB&pla=119:06
sdakejascott1 that looks bangin dude :)19:06
jascott1rwellum ive been running against 4.0.0 images19:07
sdakeso budget is 500 :)19:07
jascott1haha19:07
jascott1thats a nice budget for 13 year old beginner19:07
sdakei think he is into ebony19:07
jascott1I am a Les Paul man myself. My son got a sunburst Fender strat for his Bday last year19:07
jascott1then Les Pauls are your guitar19:07
jascott1that black SG looks nice19:08
jascott1would have to play it19:08
sdakeepiphone = les pual?19:08
jascott1can always take him to Guitar Center to try them out if you havent already19:08
jascott1Epiphone makes clones but they are pretty good19:08
sdakei see19:08
sdakeso epiphone is like les paul and les paul is good because - ebony?19:09
jascott1just better materials and attention to detail19:09
rwellumjascott1: :( - ever feel like trying pike? ;)19:09
jascott1(so they say)19:09
sdakeso yo uwould go with https://www.amazon.com/dp/B0002CZURO/ref=as_li_ss_tl?ie=UTF8&linkCode=sl1&tag=consordini-20&linkId=66cc643f79247692e46d9e30bb294c6d?19:09
jascott1rwellum would love to. having insane problem with cluster atm. kubelet is not authing to api server so I cannot exec into Pods or get logs of pods that arent running on master19:10
rwellumjascott1: that sounds like a well known problem...19:10
jascott1sdake looks nice19:10
jascott1sdake seriously tho most any guitar store will have all these or similar and he coiuld try em out19:11
rwellumjascott1: https://github.com/kubernetes/kubernetes/issues/53333#issuecomment-33979360119:11
rwellumBased on zero info of course - but I had to fix this recently.19:12
jascott1rwellum man if that is it I am going to mail you a beer19:12
jascott1thanks19:12
rwellum+1 :)19:12
sdakejascott1 so that SG is the way to roll19:12
sdakenow amps.. :)19:13
jascott1oh boy19:13
sdakehttps://www.amazon.com/Marshall-DSL5C-5-Watt-2-Channel-Guitar/dp/B00FSNYAGE19:14
sdakethis one I picked - he has no preference19:14
rwellumjascott1: this is what I did in the end. Ignore the python and jump to the bash. https://www.irccloud.com/pastebin/H8r2pj4e/19:14
jascott1sdake nice!19:14
sdakeis that a rockin amp? :)19:14
jascott1seems pricey not familar with that model19:14
jascott1but marshall is def rocking19:14
sdake5 watt tube19:14
jascott1what kinda music he into?19:15
sdakehe doesn't like music19:15
sdakelol19:15
jascott1haha19:15
jascott1sounds like my son19:15
rwellumhttp://1.bp.blogspot.com/-Df5m7H3Uo0Q/VSzQcAjqfWI/AAAAAAAA4i0/x96jxByoBNU/s1600/20131017-185320.jpg19:15
jascott1kids kill me these days19:15
jascott1lol ^ buy that amp19:15
sdakejascott1 loll19:15
sdakejascott1 which kind of amp would you buy (brand?)19:16
sdake500$ budget19:16
jascott1i like vintage tube amps19:16
sdakesure19:16
jascott1musicman ernieball fenders19:16
sdakeso modern amps any better?19:16
jascott1its really dependent on the use case (isnt everything)19:16
sdakeso --- complicated :)19:17
jascott1want to play on the street? Get a portable roland amp. want to play jazz? get something with vibrato.19:17
jascott1want to look like a rockstar? get a marshall.19:17
sdakeok marshall it is19:17
jascott1haha19:17
jascott1he will prb be very happy with that marshall19:18
sdakeany recommendations for modern marshalls?19:18
sdakeor is that choice above look good?19:18
jascott1plus should have resell value if his tastes change19:18
*** Pavo has quit IRC19:18
sdaketbh reselling 500$ worth of amp really isn't worth my time when things are worth 50 bucks later ;)19:18
jascott1check it on reverb.com or similar if you want to see resell19:19
sdakereverb = ebay for guitar gear?19:19
*** gfidente is now known as gfidente|afk19:20
sdakedo you think 5 amps is enough power19:20
sdakei run my SET amp at under 1 watt tyipically and it sounds fantastic19:20
sdake5 amps/5 watts19:20
jascott1yeah these days its fine19:20
sdakeya effecient speakers19:20
sdakethe pacifica19:21
sdakewas recommended by one of our friends19:21
sdakethoughts on that?19:21
jascott1for festivus present, I am accepting this if anyone is buying19:21
jascott1https://www.sweetwater.com/store/detail/65DeluxeRev?gclid=Cj0KCQiAus_QBRDgARIsAIRGNGgpkCFfnhEUkhKqWiDmiNmjdFogLAgLpJij12URmGKTSjGO0tLUeDEaAlWGEALw_wcB19:21
rwelluminc0: image question... In the kolla build.conf there are various lists of images listed by 'infra', 'main', 'default', 'gate' and 'aux'. What subset of these do I need to clone to be able to build all from source?19:21
jascott1sdake pacifica?19:22
inc0rwellum: these things are "profiles"19:22
sdakehttps://www.amazon.com/dp/B0010X7LF819:22
jascott1FYI other than my son's Fender I dont buy much new gear19:22
inc0say you want to deploy basic kolla ansible19:22
inc0then you run kolla-build -p default19:23
inc0and it will build all images required for this19:23
inc0and nothing else19:23
sdakesadly its not ebony19:23
rwelluminc0: Ah very cool! What if I want a combo?19:24
jascott1sdake for that price you can get a real Fender (mexican)19:25
jascott1thats what my son has19:25
sdakejascott1 is that a copy of a fender or something?19:26
jascott1yamaha makes some nice little accoustic guitars19:26
jascott1never used their electrics19:26
jascott1yeah thats called a Fender Stratocaster body style19:26
jascott1similar to the Epiphone being a copy of the Gibson Les Payl19:26
jascott1Paul19:26
inc0rwellum: kolla-build --profle a --profile b19:28
*** mgoddard has quit IRC19:29
jascott1blockchain |bläkCHān| noun. A thing nerds use to trick you out of your money19:29
sdakejascott1 ;-)19:30
rwelluminc0: ty19:37
sdakejascott1 thanks for the convo - i linked this to my parents for the guitar they are buying him19:37
sdakemaybe they should just   take him to the store to choose a guitar19:37
jascott1yeah Guitar Center is hurting and its black friday week, they might have some deals. although id rather help a local store if possible19:38
jascott1depending. some local owners are d1cks19:38
sdakejascott1 i buy all my stereo gear at a local owner20:10
Zara(hi! I'm working a little with kolla atm so have been lurking, but hah, I have that G-400 pro! I have this amp for using at home: https://www.amazon.co.uk/Blackstar-311737-Fly-Stereo-Electric-Combination/dp/B00RECW47E/ref=sr_1_2?ie=UTF8&qid=1511295160&sr=8-2&keywords=blackstar+fly+3 there's a buying guide over here that I used when I started out that might be generally helpful: https://www.justinguit20:13
Zaraar.com/en/BC-102-WhatGuitar.php)20:13
sdakethanks zara :)20:14
Zaranp, came out of a meeting to a thread about guitars, it was nice xD20:15
*** salv-orlando has quit IRC20:15
*** salv-orlando has joined #openstack-kolla20:16
rwellumKolla fails to lure out a lurker but guitars work....20:19
*** salv-orlando has quit IRC20:20
Zaraheh, I started working with it last week, I'll probably be asking far too many questions soon :)20:20
rwellumZara: welcome :)20:25
*** salv-orlando has joined #openstack-kolla20:37
*** sbezverk has quit IRC20:42
*** rumors_ has quit IRC20:42
*** jtriley_ has quit IRC20:55
*** noVNC has joined #openstack-kolla20:56
*** gfidente|afk has quit IRC21:07
*** salv-orlando has quit IRC21:11
*** sbezverk has joined #openstack-kolla21:11
*** salv-orlando has joined #openstack-kolla21:11
*** salv-orlando has quit IRC21:16
*** ktibi has quit IRC21:17
*** lpetrut has quit IRC21:21
*** jtriley has joined #openstack-kolla21:22
*** jbrooks has quit IRC21:26
inc0Zara: answering question is always high point of my day, so yes, please, throw at us as much as you want;)21:35
*** salv-orlando has joined #openstack-kolla21:41
Zarahaha, I'll see what I can come up with :)21:43
*** jtriley has quit IRC21:45
*** dave-mcc_ has quit IRC21:47
*** threestrands has joined #openstack-kolla21:48
noVNCinc0, then all containers in host doesn't know my timezone ? :S21:52
inc0noVNC: frankly I thought docker will handle this21:52
inc0I'm not sure tho21:52
inc0no, it seems inside cotnainer it's UTC21:53
*** jascott1 has quit IRC21:54
noVNCinc0, I always use -v /usr/share/zoneinfo/MYTZ:/etc/localtime:ro deploying a docker manually but kolla should have an option to handle timezones21:55
kfox1111back.21:57
*** jascott1 has joined #openstack-kolla22:09
*** yangyapeng has joined #openstack-kolla22:10
*** jascott1 has quit IRC22:14
*** yangyapeng has quit IRC22:14
*** jascott1 has joined #openstack-kolla22:22
*** abishop has quit IRC22:23
*** noVNC has quit IRC22:27
*** lxdong has joined #openstack-kolla22:38
*** vhosakot has quit IRC22:41
*** itlinux has quit IRC23:05
*** jamesbenson has quit IRC23:06
*** jamesbenson has joined #openstack-kolla23:08
*** jamesbenson has quit IRC23:12
*** jascott1 has quit IRC23:27
*** jascott1 has joined #openstack-kolla23:27
*** jascott1 has quit IRC23:28
*** jascott1 has joined #openstack-kolla23:28
*** rhallisey has quit IRC23:40
jascott1rwellum was so excited about your potential fix but I think its cent oriented (I am on ubuntu). are you using k8s 1.8?23:49
jascott1i asked because it rejected the swap related flag23:50
*** manheim has quit IRC23:51
*** manheim has joined #openstack-kolla23:52
*** ntpttr_laptop has quit IRC23:56
*** manheim has quit IRC23:56
*** salv-orlando has quit IRC23:59
*** salv-orlando has joined #openstack-kolla23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!