| *** eandersson has quit IRC | 00:48 | |
| *** eandersson has joined #openstack-containers | 00:51 | |
| *** dave-mccowan has joined #openstack-containers | 01:04 | |
| openstackgerrit | Merged openstack/magnum-ui master: Cleanup .zuul.yaml https://review.openstack.org/601672 | 01:46 |
|---|---|---|
| openstackgerrit | Jake Yip proposed openstack/magnum-tempest-plugin master: Add option for kubernetes coe https://review.openstack.org/601889 | 02:06 |
| openstackgerrit | Jake Yip proposed openstack/magnum-tempest-plugin master: add option for docker_storage_driver https://review.openstack.org/601890 | 02:10 |
| *** eandersson has quit IRC | 02:23 | |
| *** eandersson has joined #openstack-containers | 02:25 | |
| *** ykarel|away has joined #openstack-containers | 02:53 | |
| *** ykarel|away has quit IRC | 02:57 | |
| *** ykarel|away has joined #openstack-containers | 02:58 | |
| *** zul has joined #openstack-containers | 03:02 | |
| *** ykarel|away has quit IRC | 03:31 | |
| *** dave-mccowan has quit IRC | 03:31 | |
| *** ramishra has joined #openstack-containers | 03:45 | |
| *** flwang has joined #openstack-containers | 03:53 | |
| *** ykarel|away has joined #openstack-containers | 03:55 | |
| *** udesale has joined #openstack-containers | 04:01 | |
| *** ivve has quit IRC | 04:06 | |
| *** ianychoi has quit IRC | 04:19 | |
| *** ykarel|away has quit IRC | 04:52 | |
| *** flwang1 has quit IRC | 04:57 | |
| openstackgerrit | Erik Olof Gunnar Andersson proposed openstack/magnum master: Trivial code cleanups https://review.openstack.org/601904 | 05:01 |
| *** ricolin has joined #openstack-containers | 05:10 | |
| *** ykarel|away has joined #openstack-containers | 05:11 | |
| openstackgerrit | Erik Olof Gunnar Andersson proposed openstack/magnum master: Trivial code cleanups https://review.openstack.org/601904 | 05:21 |
| *** jaewook_oh has joined #openstack-containers | 05:50 | |
| *** lbragstad has joined #openstack-containers | 06:08 | |
| *** threestrands has joined #openstack-containers | 06:13 | |
| *** threestrands has quit IRC | 06:13 | |
| *** threestrands has joined #openstack-containers | 06:13 | |
| *** pcaruana has joined #openstack-containers | 06:23 | |
| *** mvpnitesh has joined #openstack-containers | 06:30 | |
| *** strigazi has quit IRC | 06:30 | |
| *** lbragstad has quit IRC | 06:36 | |
| *** mattgo has joined #openstack-containers | 06:37 | |
| *** eyalb has joined #openstack-containers | 06:45 | |
| eyalb | hi anyone can help me with magnum on devstack ? | 06:46 |
| jaewook_oh | hi, I'm not core contributor here, but maybe I can help you. what is your problem? | 06:48 |
| eyalb | hi trying to install start a k8s on devstack with magnum according to this url https://docs.openstack.org/magnum/ocata/dev/quickstart.html#building-a-kubernetes-cluster-based-on-fedora-atomic | 06:49 |
| eyalb | I am tring to build the k8s cluster according to the above documentation | 06:50 |
| eyalb | cloud-init fails when on the instance created | 06:50 |
| eyalb | some services fail to start with no clear reason | 06:51 |
| eyalb | docker and flanneld | 06:51 |
| eyalb | flunneld fails on timeout | 06:51 |
| jaewook_oh | Does the instance(master node or minions) is created correctly? | 06:52 |
| eyalb | docker on dependency but I dont know which dependency | 06:52 |
| eyalb | yes | 06:52 |
| jaewook_oh | Oh then can I see the lateset log? | 06:52 |
| jaewook_oh | latest | 06:52 |
| eyalb | cloud-init.log ? | 06:52 |
| eyalb | or cloud-init-output.log | 06:52 |
| jaewook_oh | yes maybe it is displayed on the console | 06:53 |
| jaewook_oh | umm I'm not sure so can I see both of them? | 06:53 |
| eyalb | ok | 06:53 |
| eyalb | one minute | 06:54 |
| jaewook_oh | Take your time :) | 06:55 |
| *** rcernin has quit IRC | 06:59 | |
| eyalb | https://pastebin.com/qiCyRFRD | 07:09 |
| eyalb | this is cloud-init | 07:09 |
| *** ricolin has quit IRC | 07:11 | |
| *** ykarel|away is now known as ykarel | 07:14 | |
| eyalb | https://pastebin.com/V0CDrf7j | 07:14 |
| eyalb | and this is cloud-init-output.log | 07:15 |
| *** AlexeyAbashkin has joined #openstack-containers | 07:15 | |
| eyalb | what is see is that on the fedora instance the docker service is dead | 07:20 |
| eyalb | trying to start it fails on dependency | 07:21 |
| eyalb | the flanneld service also is dead trying to start it fails on timeout | 07:21 |
| eyalb | the etcd service keeps failing also | 07:23 |
| eyalb | E | etcdmain: failed to join discovery cluster (context deadline exceeded) | 07:23 |
| eyalb | :17:46.857570 I | etcdmain: discovery token https://discovery.etcd.io/d37fa3d7383679af8b6e2b2538a54eaa was used, but failed to bootstrap the cluster. | 07:23 |
| eyalb | :17:46.867264 I | etcdmain: please generate a new discovery token and try to bootstrap again. | 07:23 |
| eyalb | Main process exited, code=exited, status=1/FAILURE | 07:23 |
| eyalb | Unit entered failed state. | 07:23 |
| eyalb | Failed with result 'exit-code'. | 07:23 |
| *** strigazi has joined #openstack-containers | 07:25 | |
| *** ykarel is now known as ykarel|lunch | 07:26 | |
| *** vijaykc4 has joined #openstack-containers | 07:52 | |
| *** mvpnitesh has quit IRC | 08:03 | |
| *** ykarel|lunch is now known as ykarel | 08:19 | |
| *** mattgo has quit IRC | 08:28 | |
| *** mvpnitesh has joined #openstack-containers | 08:32 | |
| *** mattgo has joined #openstack-containers | 08:34 | |
| *** vijaykc4 has quit IRC | 08:44 | |
| *** belmorei_ has joined #openstack-containers | 08:59 | |
| *** belmoreira has quit IRC | 08:59 | |
| *** suanand has joined #openstack-containers | 09:22 | |
| openstackgerrit | Spyros Trigazis proposed openstack/magnum master: WIP: build images in the ci https://review.openstack.org/585420 | 09:29 |
| openstackgerrit | Spyros Trigazis proposed openstack/magnum master: WIP: build images in the ci https://review.openstack.org/585420 | 09:52 |
| openstackgerrit | Spyros Trigazis proposed openstack/magnum master: WIP: build images in the ci https://review.openstack.org/585420 | 10:04 |
| jaewook_oh | eyalb I checked your log. But I suggest you using master version of magnum | 10:07 |
| eyalb | I use the master version | 10:08 |
| jaewook_oh | Oh | 10:08 |
| jaewook_oh | In fact I was also suffered by that error | 10:08 |
| strigazi | what error? | 10:08 |
| jaewook_oh | flanneld | 10:09 |
| eyalb | i think that since flunneld and etcd started to run in containers | 10:09 |
| strigazi | eyalb: jaewook_oh use fedora atomic 27 or 28 | 10:10 |
| eyalb | I tryed 27 and 28 | 10:10 |
| strigazi | and set the storage driver to overlay2 | 10:10 |
| eyalb | same error | 10:10 |
| strigazi | --docker-storage-driver overlay2 | 10:10 |
| jaewook_oh | Were there any chage? I've never used that option, but it was ok. | 10:11 |
| eyalb | I did according to the documentation | 10:11 |
| eyalb | on devstack | 10:11 |
| strigazi | nothing changed | 10:12 |
| strigazi | what is the error? | 10:12 |
| eyalb | flanneld fails on timeout | 10:13 |
| eyalb | docker fails on dependency | 10:13 |
| eyalb | etcd doesnt restarts all the time | 10:13 |
| strigazi | master branch and devstack? | 10:13 |
| eyalb | yes | 10:13 |
| eyalb | etcdmain: failed to join discovery cluster (context deadline exceeded) | 10:14 |
| strigazi | are you using overlay2 as a docker-storage-driver? | 10:15 |
| eyalb | I dont think so I did what the documentation says https://docs.openstack.org/magnum/latest/contributor/quickstart.html | 10:15 |
| eyalb | look at the devstack part | 10:15 |
| strigazi | can you try to create a cluster template with docker-storage-driver overlay2 and then create a cluster? | 10:16 |
| eyalb | how do I do that ? | 10:17 |
| strigazi | then show me: /var/log/cloud-init-output.log and atomic containers list | 10:17 |
| strigazi | https://docs.openstack.org/magnum/latest/contributor/quickstart.html#building-a-kubernetes-cluster-based-on-fedora-atomic | 10:17 |
| strigazi | openstack coe cluster template create ... --docker-storage-driver overlay2 ... | 10:17 |
| eyalb | ok i will try and tell you' | 10:18 |
| *** vijaykc4 has joined #openstack-containers | 10:20 | |
| *** udesale has quit IRC | 10:30 | |
| *** ricolin has joined #openstack-containers | 10:30 | |
| *** serlex has joined #openstack-containers | 11:06 | |
| *** serlex has quit IRC | 11:06 | |
| *** belmorei_ has quit IRC | 11:10 | |
| *** suanand has quit IRC | 11:19 | |
| *** niteshmvp has joined #openstack-containers | 11:22 | |
| *** mvpnitesh has quit IRC | 11:22 | |
| openstackgerrit | Spyros Trigazis proposed openstack/magnum master: WIP: build images in the ci https://review.openstack.org/585420 | 11:24 |
| *** dave-mccowan has joined #openstack-containers | 11:32 | |
| *** belmoreira has joined #openstack-containers | 11:36 | |
| eyalb | strigazi: didn't work here is cloud-init-output.log http://paste.openstack.org/show/729963/ | 11:50 |
| eyalb | strigazi: this link is better shows all the output https://pastebin.com/Yth1TBrY | 11:51 |
| eyalb | flanneld failed to start | 11:55 |
| eyalb | flanneld.service: Start operation timed out. Terminating. | 11:55 |
| eyalb | Sep 12 11:53:03 k8s-cluster-qo6dgncuwzxb-master-0.novalocal systemd[1]: flanneld.service: Main process exited, code=exited, status=143/n/a | 11:55 |
| eyalb | Sep 12 11:53:04 k8s-cluster-qo6dgncuwzxb-master-0.novalocal systemd[1]: Failed to start Flanneld overlay address etcd agent. | 11:55 |
| eyalb | Sep 12 11:53:04 k8s-cluster-qo6dgncuwzxb-master-0.novalocal systemd[1]: flanneld.service: Unit entered failed state. | 11:55 |
| eyalb | Sep 12 11:53:04 k8s-cluster-qo6dgncuwzxb-master-0.novalocal systemd[1]: flanneld.service: Failed with result 'timeout'. | 11:55 |
| eyalb | docker service failed to start | 11:56 |
| eyalb | Dependency failed for Docker Application Container Engine. | 11:56 |
| eyalb | Sep 12 11:36:11 k8s-cluster-qo6dgncuwzxb-master-0.novalocal systemd[1]: docker.service: Job docker.service/start failed with result 'dependency'. | 11:56 |
| eyalb | and etcd service keeps restarting | 11:57 |
| eyalb | etcdmain: failed to join discovery cluster (context deadline exceeded) | 11:57 |
| *** udesale has joined #openstack-containers | 12:21 | |
| openstackgerrit | Spyros Trigazis proposed openstack/magnum master: WIP: build images in the ci https://review.openstack.org/585420 | 12:21 |
| strigazi | eyalb: journalctl -u docker --no-pager do it for flanneld and etcd too. | 12:42 |
| eyalb | https://pastebin.com/fYdHJuTf this is for docker | 12:44 |
| eyalb | https://pastebin.com/GYLd00r9 this is for flanneld | 12:45 |
| eyalb | https://pastebin.com/uJQPbLix this is for etcd | 12:47 |
| eyalb | for etcd i didnt copy all the log it repeats itself all the time | 12:47 |
| *** ricolin has quit IRC | 12:53 | |
| strigazi | it looks like etcd can't bootstrap itself. is discovery.etcd.io reachable from the master node? | 12:54 |
| strigazi | eyalb: try with another discovery url. Just to double check. | 12:55 |
| strigazi | eyalb: curl https://discovery.etcd.io/new?size=1 | 12:55 |
| strigazi | eyalb: and set it in /etc/etcd/etcd.conf | 12:55 |
| strigazi | eyalb: and do systemctl restart etcd | 12:56 |
| strigazi | eyalb: stop etcd, rm -rf /var/lib/etcd/*, change the url, start etcd | 12:56 |
| eyalb | i am getting this on etcd journal | 13:00 |
| eyalb | container_linux.go:348: starting container process caused "process_linux.go:402: container init caused \"rootfs_linux.go:58: mounting \\\"/var/lib/etcd/etcd.etcd\\\" to rootfs \\\"/var/lib/containers/atomic/etcd.0/rootfs\\\" at \\\"/var/lib/etcd\\\" caused \\\"stat /var/lib/etcd/etcd.etcd: no such file or directory\\\"\"" | 13:00 |
| strigazi | eyalb: mkdir -p /var/lib/etcd/etcd.etcd && systemctl restart etcd | 13:01 |
| *** jaewook_oh has quit IRC | 13:04 | |
| eyalb | same as before https://pastebin.com/8yJtzyPr | 13:06 |
| *** niteshmvp has quit IRC | 13:07 | |
| *** ykarel has quit IRC | 13:11 | |
| *** ykarel has joined #openstack-containers | 13:18 | |
| *** threestrands has quit IRC | 13:24 | |
| *** ykarel_ has joined #openstack-containers | 13:34 | |
| *** vijaykc4 has quit IRC | 13:36 | |
| *** ykarel has quit IRC | 13:36 | |
| *** zul has quit IRC | 14:00 | |
| *** mgoddard has joined #openstack-containers | 14:03 | |
| *** hongbin has quit IRC | 14:07 | |
| *** ykarel_ is now known as ykarel|away | 14:12 | |
| *** udesale_ has joined #openstack-containers | 14:13 | |
| *** udesale has quit IRC | 14:16 | |
| *** ykarel|away has quit IRC | 14:17 | |
| *** zul has joined #openstack-containers | 14:22 | |
| *** vijaykc4 has joined #openstack-containers | 14:30 | |
| *** eyalb has quit IRC | 14:32 | |
| *** ricolin has joined #openstack-containers | 14:37 | |
| *** ricolin has quit IRC | 14:38 | |
| *** mgoddard has quit IRC | 14:39 | |
| *** itlinux has quit IRC | 14:41 | |
| *** ricolin has joined #openstack-containers | 14:42 | |
| *** slagle has joined #openstack-containers | 14:44 | |
| *** lbragstad has joined #openstack-containers | 14:46 | |
| *** mgoddard has joined #openstack-containers | 14:49 | |
| *** vijaykc4 has quit IRC | 14:57 | |
| *** ykarel has joined #openstack-containers | 14:57 | |
| *** mgoddard has quit IRC | 15:02 | |
| *** mgoddard has joined #openstack-containers | 15:21 | |
| *** itlinux has joined #openstack-containers | 15:28 | |
| *** ykarel is now known as ykarel|away | 15:33 | |
| *** ykarel|away has quit IRC | 15:48 | |
| *** pcaruana has quit IRC | 15:55 | |
| *** ykarel|away has joined #openstack-containers | 16:02 | |
| *** mrodriguez has joined #openstack-containers | 16:04 | |
| *** vijaykc4 has joined #openstack-containers | 16:07 | |
| *** vijaykc4 has quit IRC | 16:10 | |
| *** vijaykc4 has joined #openstack-containers | 16:13 | |
| *** ramishra has quit IRC | 16:16 | |
| *** ramishra has joined #openstack-containers | 16:17 | |
| *** AlexeyAbashkin has quit IRC | 16:20 | |
| *** Bhujay has joined #openstack-containers | 16:29 | |
| *** vijaykc4 has quit IRC | 16:35 | |
| *** mgoddard has quit IRC | 16:46 | |
| *** pcaruana has joined #openstack-containers | 16:51 | |
| *** udesale_ has quit IRC | 16:54 | |
| *** mgoddard has joined #openstack-containers | 17:07 | |
| *** vijaykc4 has joined #openstack-containers | 17:09 | |
| *** vijaykc4 has quit IRC | 17:13 | |
| *** mgoddard has quit IRC | 17:19 | |
| *** mgoddard has joined #openstack-containers | 17:21 | |
| *** lbragstad has quit IRC | 17:22 | |
| *** vijaykc4 has joined #openstack-containers | 17:25 | |
| mrodriguez | Hello, quick question | 17:25 |
| mrodriguez | I'm using magnum 6.1.2 on a Queens environment with Neutron DVR, and I'm seeing and odd behavior, so I was wondering if you guys have seen this, because I haven't found a reported bug. | 17:25 |
| *** lbragstad has joined #openstack-containers | 17:26 | |
| mrodriguez | The problem is when deploying a magnum cluster using floating IPs, the master FIPs are setup in the SNAT namespace in the controllers | 17:26 |
| mrodriguez | and in the qrouter/fips namespaces in the computes at the same time, | 17:26 |
| mrodriguez | if I create non-magnum instances and attach FIPs works fine, it's just when I use magnum that I see this, and only a 50% of the time, | 17:26 |
| mrodriguez | which makes instances not able to access the outside and they fail to pull k8s images from the hub. | 17:27 |
| mrodriguez | My tests with magnum in Pike are fine, though. | 17:27 |
| *** vijaykc4 has quit IRC | 17:30 | |
| *** mattgo has quit IRC | 17:31 | |
| *** vijaykc4 has joined #openstack-containers | 17:39 | |
| *** Bhujay has quit IRC | 17:45 | |
| *** ricolin has quit IRC | 17:47 | |
| *** slagle has quit IRC | 17:51 | |
| *** ramishra has quit IRC | 17:53 | |
| *** hongbin has joined #openstack-containers | 17:56 | |
| *** vijaykc4 has quit IRC | 17:57 | |
| *** dave-mccowan has quit IRC | 17:59 | |
| *** vijaykc4 has joined #openstack-containers | 18:02 | |
| *** ykarel|away has quit IRC | 18:03 | |
| *** dave-mcc_ has joined #openstack-containers | 18:06 | |
| *** hongbin has quit IRC | 18:17 | |
| *** flwang1 has joined #openstack-containers | 18:19 | |
| *** zul has quit IRC | 18:21 | |
| *** mgoddard has quit IRC | 18:29 | |
| openstackgerrit | Andreas Jaeger proposed openstack/magnum master: switch documentation job to new PTI https://review.openstack.org/595458 | 18:30 |
| openstackgerrit | Andreas Jaeger proposed openstack/magnum master: add python 3.6 unit test job https://review.openstack.org/595459 | 18:30 |
| openstackgerrit | Andreas Jaeger proposed openstack/python-magnumclient stable/pike: import zuul job settings from project-config https://review.openstack.org/595472 | 18:32 |
| *** AJaeger has joined #openstack-containers | 18:32 | |
| openstackgerrit | Andreas Jaeger proposed openstack/python-magnumclient stable/ocata: import zuul job settings from project-config https://review.openstack.org/595469 | 18:34 |
| AJaeger | magnum cores, those changes should finish python3-first OpenStack global stein goal , please review | 18:35 |
| AJaeger | strigazi: ^ | 18:38 |
| openstackgerrit | Andreas Jaeger proposed openstack/magnum master: add python 3.6 unit test job https://review.openstack.org/595459 | 18:38 |
| AJaeger | magnum cores, full list of open reviews for python3-first is https://review.openstack.org/#/q/topic:python3-first+is:open+project:%255Eopenstack/.*magnum.* | 18:39 |
| *** lbragstad has quit IRC | 18:41 | |
| *** pcaruana has quit IRC | 18:47 | |
| *** lbragstad has joined #openstack-containers | 19:00 | |
| *** slagle has joined #openstack-containers | 19:04 | |
| *** dave-mcc_ has quit IRC | 19:05 | |
| *** dave-mccowan has joined #openstack-containers | 19:07 | |
| *** ricolin has joined #openstack-containers | 19:09 | |
| *** hongbin has joined #openstack-containers | 19:12 | |
| *** zul has joined #openstack-containers | 19:26 | |
| *** hongbin has quit IRC | 19:29 | |
| *** mrodriguez has quit IRC | 19:30 | |
| *** zul has quit IRC | 19:30 | |
| *** lbragstad has quit IRC | 19:30 | |
| *** zul has joined #openstack-containers | 19:30 | |
| *** vijaykc4 has quit IRC | 19:32 | |
| *** ricolin has quit IRC | 19:33 | |
| *** ricolin has joined #openstack-containers | 19:33 | |
| *** slagle has quit IRC | 19:37 | |
| *** ricolin has quit IRC | 19:43 | |
| *** ricolin has joined #openstack-containers | 19:44 | |
| *** flwang1 has quit IRC | 19:52 | |
| *** mgoddard has joined #openstack-containers | 19:56 | |
| *** pcaruana has joined #openstack-containers | 19:58 | |
| *** slagle has joined #openstack-containers | 20:02 | |
| *** hongbin has joined #openstack-containers | 20:12 | |
| *** pcaruana has quit IRC | 20:20 | |
| *** ricolin has quit IRC | 20:21 | |
| *** ricolin has joined #openstack-containers | 20:22 | |
| *** lbragstad has joined #openstack-containers | 20:37 | |
| *** janki has joined #openstack-containers | 20:42 | |
| *** hongbin has quit IRC | 20:49 | |
| *** hongbin has joined #openstack-containers | 20:55 | |
| *** flwang1 has joined #openstack-containers | 21:00 | |
| *** hongbin has quit IRC | 21:16 | |
| flwang | AJaeger: done, thanks | 21:28 |
| flwang | AJaeger: need strigazi for a final approval, but i don't worry about that | 21:28 |
| *** ianychoi has joined #openstack-containers | 21:35 | |
| *** itlinux has quit IRC | 21:41 | |
| *** rcernin has joined #openstack-containers | 21:44 | |
| *** hongbin has joined #openstack-containers | 21:51 | |
| *** cbrumm has quit IRC | 22:01 | |
| *** mgoddard has quit IRC | 22:01 | |
| openstackgerrit | Merged openstack/magnum master: Fix unit test failure with python3.6 https://review.openstack.org/596861 | 22:29 |
| *** itlinux has joined #openstack-containers | 22:30 | |
| *** zul has quit IRC | 22:31 | |
| *** ricolin has quit IRC | 22:37 | |
| *** slagle has quit IRC | 22:42 | |
| *** hongbin has quit IRC | 22:43 | |
| *** ricolin has joined #openstack-containers | 22:46 | |
| *** mgoddard has joined #openstack-containers | 22:52 | |
| *** mgoddard has quit IRC | 22:58 | |
| *** mgoddard has joined #openstack-containers | 22:58 | |
| *** slagle has joined #openstack-containers | 23:05 | |
| *** lbragstad has quit IRC | 23:06 | |
| *** hongbin has joined #openstack-containers | 23:07 | |
| *** ricolin has quit IRC | 23:09 | |
| *** ricolin has joined #openstack-containers | 23:16 | |
| *** lbragstad has joined #openstack-containers | 23:18 | |
| *** ricolin has quit IRC | 23:23 | |
| *** ricolin has joined #openstack-containers | 23:23 | |
| *** lbragstad has quit IRC | 23:27 | |
| *** ricolin has quit IRC | 23:27 | |
| *** slagle has quit IRC | 23:30 | |
| *** mgoddard has quit IRC | 23:30 | |
| *** lbragstad has joined #openstack-containers | 23:40 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!