| sdake | again 5+ years out | 00:00 |
|---|---|---|
| harlowja | :) | 00:00 |
| sdake | I have thought obsessivly about this stuff ffor 3 years ;) | 00:00 |
| sdake | atm i'm working on getting our core team off of vacation ;) | 00:00 |
| harlowja | why 5 years out then :-P | 00:00 |
| sdake | we have alot of stuff to do between now and then | 00:00 |
| harlowja | 5 days out, lol | 00:00 |
| sdake | i could probably code the ring protocol in 6-8 weeks | 00:01 |
| sdake | but it would be super experimental | 00:01 |
| harlowja | ya, no doubt | 00:01 |
| *** weiyu_ has quit IRC | 00:01 | |
| sdake | i think oru current technique is pretty solid | 00:01 |
| sdake | we use project best practices for upgrades | 00:01 |
| harlowja | agreed | 00:02 |
| sdake | kolla actually spurred people into developing an upgrade plan for their respective projects :) | 00:02 |
| harlowja | +1 | 00:02 |
| harlowja | people actually use all this stuff? | 00:02 |
| harlowja | lol | 00:02 |
| sdake | so we use whatever they define | 00:02 |
| sdake | the containerization of openstack is all about usability and managability | 00:03 |
| sdake | not really about security or isolation | 00:03 |
| harlowja | yup, makes sense to me | 00:03 |
| *** adrian_otto has joined #openstack-kolla | 00:03 | |
| sdake | hey adrian_otto | 00:03 |
| adrian_otto | hi sdake | 00:04 |
| sdake | how oges it | 00:05 |
| sdake | i hear there is some new contianer openstack project underway | 00:05 |
| adrian_otto | you know. Fighting hackers is a chore. | 00:05 |
| adrian_otto | yes, Higgins. | 00:05 |
| sdake | been there on the other side ;) | 00:05 |
| harlowja | adrian_otto that reminds me, whatever happened to u maybe releasing that 'analysis of magnum-desired-targeted users that rackspace did' ? | 00:05 |
| harlowja | was that ever possible? | 00:05 |
| harlowja | and oh hi! | 00:06 |
| harlowja | lol | 00:06 |
| adrian_otto | we did discuss it, harlowja, but I'm not able to share it at this time. | 00:06 |
| harlowja | k | 00:06 |
| sdake | adrian_otto bummer we didn't get a chance to meet at summit or chat at all | 00:06 |
| sdake | i moderated 16 sessions and was in a panel | 00:06 |
| sdake | so I was super beat every day | 00:06 |
| adrian_otto | the bottom line is that for stakeholders like us, the new Magnum focus is really compelling, where HIggins' focus is not. | 00:06 |
| sdake | took me a week to recover | 00:07 |
| adrian_otto | it was a great summit. | 00:07 |
| sdake | i htink the new magnum focus was always whatI had in mind when I wrote the original poc :) | 00:07 |
| sdake | the only reason I put that pod/rc/etc stuff in there wwas to build a community of devs | 00:07 |
| adrian_otto | yes, I remember this topic from long ago, re: native clients | 00:07 |
| sdake | i mean community of magnum devs | 00:08 |
| sdake | not other devs :) | 00:08 |
| adrian_otto | 10/4 | 00:08 |
| sdake | "hey we deploy kubernetes" isn't super complelling | 00:08 |
| sdake | until you actually get into it | 00:08 |
| sdake | the other apis were pretty much an engagement point ;) | 00:08 |
| adrian_otto | the k8s integration with cinder volumes for storage pools is really pretty neat | 00:09 |
| *** diogogmt has quit IRC | 00:09 | |
| *** ravig has quit IRC | 00:13 | |
| *** salv-orlando has joined #openstack-kolla | 00:14 | |
| *** beekhof has quit IRC | 00:14 | |
| *** ravig has joined #openstack-kolla | 00:28 | |
| *** ravig has quit IRC | 00:36 | |
| *** salv-orlando has quit IRC | 00:36 | |
| openstackgerrit | Mauricio Lima proposed openstack/kolla: Make Heka collect Ceph logs https://review.openstack.org/317790 | 00:46 |
| *** weiyu has joined #openstack-kolla | 00:48 | |
| *** Jeffrey4l has quit IRC | 00:49 | |
| openstackgerrit | Mauricio Lima proposed openstack/kolla: Make Heka collect Ceph logs https://review.openstack.org/317791 | 00:59 |
| *** allen_gao has quit IRC | 01:03 | |
| *** sacharya has quit IRC | 01:09 | |
| *** manjeets has left #openstack-kolla | 01:11 | |
| *** salv-orlando has joined #openstack-kolla | 01:18 | |
| *** inc0 has joined #openstack-kolla | 01:19 | |
| *** inc0 has quit IRC | 01:21 | |
| *** inc0 has joined #openstack-kolla | 01:21 | |
| *** ravig has joined #openstack-kolla | 01:29 | |
| *** salv-orlando has quit IRC | 01:36 | |
| *** Jeffrey4l has joined #openstack-kolla | 01:45 | |
| -openstackstatus- NOTICE: Gerrit is about to be restarted to help with page timeouts | 01:46 | |
| *** Jeffrey4l has quit IRC | 01:55 | |
| *** tfukushima has joined #openstack-kolla | 01:58 | |
| *** asalkeld has joined #openstack-kolla | 02:02 | |
| *** sdake has quit IRC | 02:06 | |
| *** SiRiuS has quit IRC | 02:06 | |
| *** Jeffrey4l has joined #openstack-kolla | 02:08 | |
| *** sacharya has joined #openstack-kolla | 02:09 | |
| *** unicell has quit IRC | 02:10 | |
| *** salv-orlando has joined #openstack-kolla | 02:12 | |
| *** sdake has joined #openstack-kolla | 02:12 | |
| *** sacharya has quit IRC | 02:14 | |
| *** yuanying has joined #openstack-kolla | 02:17 | |
| *** sdake has quit IRC | 02:22 | |
| *** stvnoyes has quit IRC | 02:30 | |
| *** stvnoyes has joined #openstack-kolla | 02:31 | |
| *** salv-orlando has quit IRC | 02:32 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements https://review.openstack.org/317181 | 02:35 |
| *** unicell has joined #openstack-kolla | 02:43 | |
| *** Jeffrey4l has quit IRC | 03:03 | |
| *** salv-orlando has joined #openstack-kolla | 03:05 | |
| *** inc0 has quit IRC | 03:07 | |
| *** godleon has quit IRC | 03:09 | |
| *** sdake has joined #openstack-kolla | 03:09 | |
| *** tfukushima has quit IRC | 03:12 | |
| *** adrian_otto has quit IRC | 03:13 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Make passwords.yml file generation configurable https://review.openstack.org/317642 | 03:17 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Make passwords.yml file generation configurable https://review.openstack.org/317642 | 03:21 |
| *** coolsvap has joined #openstack-kolla | 03:22 | |
| *** daneyon has joined #openstack-kolla | 03:25 | |
| sdake | coolsvap i think your passwordsfile patch is wrong | 03:27 |
| coolsvap | hmm | 03:28 |
| *** salv-orlando has quit IRC | 03:28 | |
| *** daneyon has quit IRC | 03:30 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Make passwords.yml file generation configurable https://review.openstack.org/317642 | 03:31 |
| *** dave-mccowan has quit IRC | 03:32 | |
| coolsvap | sdake, I missed testing it, updated the review | 03:32 |
| sdake | yup just read your comment | 03:33 |
| sdake | i'd test it this time - not sure if that is right either | 03:33 |
| sdake | ;) | 03:33 |
| coolsvap | tested it before submitting the review | 03:33 |
| sdake | cool | 03:33 |
| *** vhosakot has joined #openstack-kolla | 03:36 | |
| *** Jeffrey4l has joined #openstack-kolla | 03:36 | |
| *** sdake_ has joined #openstack-kolla | 03:37 | |
| openstackgerrit | Steven Dake proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy https://review.openstack.org/315860 | 03:38 |
| *** sdake has quit IRC | 03:40 | |
| sdake_ | Jeffrey4l /var/log/audit is 700 root | 03:41 |
| sdake_ | i submitted a new change with a sudo in there | 03:41 |
| Jeffrey4l | ok | 03:41 |
| *** sacharya has joined #openstack-kolla | 03:53 | |
| *** sdake_ has quit IRC | 03:58 | |
| *** sacharya has quit IRC | 03:58 | |
| *** ravig has quit IRC | 04:04 | |
| *** salv-orlando has joined #openstack-kolla | 04:05 | |
| *** sdake has joined #openstack-kolla | 04:09 | |
| sdake | Jeffrey4l i just toggeld ci and notice dyour patch set 1 passed the gate | 04:12 |
| sdake | and noticedy ou commented out rabbitmq_nodenmae | 04:12 |
| sdake | the reason it works on centos is because centos has erlang with ipv6 support | 04:17 |
| sdake | hmm actually ubuntu doe stoo | 04:17 |
| sdake | not sure if that is it | 04:17 |
| Jeffrey4l | sdake, it is not the root cause. just a workaround. | 04:19 |
| sdake | what made you think to try that as a workaround? | 04:19 |
| Jeffrey4l | sdake, i hit this issue in one of my env. I make several tests. just blind test. after comment that configure out, it works. But i have no idea why it works. | 04:21 |
| sdake | it doesn't work everywhere | 04:21 |
| sdake | gate 1 failed gate 2 worked | 04:21 |
| Jeffrey4l | after make some more test, i found the hostname in /etc/hosts is not in the first position. | 04:21 |
| sdake | which change is that- i really want to see the contents of /etc/hosts | 04:22 |
| Jeffrey4l | gate 2 is just a rebase of gate 1. the change is the same. | 04:22 |
| Jeffrey4l | the /etc/hosts is just like `x.x.x.x node1 origial_hostname` | 04:23 |
| Jeffrey4l | it is right. | 04:23 |
| sdake | yes but running on different gear | 04:23 |
| Jeffrey4l | I printed the /etc/hosts out. | 04:23 |
| sdake | but gate 1 fails gate 2 works | 04:24 |
| sdake | if its just a rebase | 04:24 |
| sdake | it ran on different hardware, meaning sometimes itworks smeimtes it doesn't | 04:24 |
| *** salv-orlando has quit IRC | 04:25 | |
| Jeffrey4l | in the gate 1, the rabbitmq is not crash at last. it is different issue. | 04:25 |
| Jeffrey4l | I have another workaround which is better. just change the hostname in the jenkins user with sudo. it fixed this issue. | 04:26 |
| Jeffrey4l | I will push this later. | 04:26 |
| coolsvap | can we list out the findings somewhere maybe in a bug or something | 04:26 |
| sdake | how is the hostname changed now - without sudo? | 04:26 |
| Jeffrey4l | using ansible see the setup_node.yml file. | 04:27 |
| sdake | use sudo in the ansible file - the purpose of that ansible code is to enable the multinode gating | 04:27 |
| Jeffrey4l | yes. | 04:27 |
| Jeffrey4l | OK. i will write all, or push a PS with all the find and workaround. | 04:27 |
| sdake | sounds like ansible hostname operation is not suitable - my guess is a selinux violation | 04:28 |
| sdake | wtb audit log | 04:28 |
| sdake | but rax.ord is busted | 04:28 |
| sdake | and it seems that is all that is scheduled atm | 04:28 |
| Jeffrey4l | here the ansible changed the hostname http://logs.openstack.org/60/315860/26/check/gate-kolla-dsvm-build-centos-binary/9d4659d/console.html#_2016-05-17_23_14_07_068 | 04:29 |
| Jeffrey4l | but then print the hostname, it is not changed. http://logs.openstack.org/60/315860/26/check/gate-kolla-dsvm-build-centos-binary/9d4659d/console.html#_2016-05-17_23_15_51_499 | 04:29 |
| sdake | is the ansible script being run as root user? | 04:31 |
| sdake | or jenkins | 04:32 |
| sdake | while relying on hostname module in ansible seems correct, it looks like it doesn't work correctly :) | 04:32 |
| *** diga has joined #openstack-kolla | 04:32 | |
| sdake | what does hostnamectl look like with your sudo hostname operation? | 04:33 |
| sdake | does it also chane static hostnmae? | 04:33 |
| Jeffrey4l | sdake, ansible works. I tested that. set the hostname by using hostnamectl also cause this kind of issue. | 04:34 |
| sdake | how does your workaround work then? | 04:34 |
| Jeffrey4l | give me some time. I will make a detailed PS to show the issue. | 04:35 |
| Jeffrey4l | just re-set the hostname in the `setup_gate.sh` file in the jenkins account by using `sudo hostnamectl node1` | 04:35 |
| *** adrian_otto has joined #openstack-kolla | 04:37 | |
| sdake | Jeffrey4l and your saying sudo hostnamectl node1 works but hostnamectl node1 doesnt ? | 04:38 |
| Jeffrey4l | give me seconds. a little busy. :( | 04:38 |
| sdake | ok | 04:38 |
| *** sacharya has joined #openstack-kolla | 04:52 | |
| openstackgerrit | Steven Dake proposed openstack/kolla: Use Infra provided mirrors for centos https://review.openstack.org/317831 | 04:53 |
| *** Jeffrey4l has quit IRC | 04:53 | |
| *** salv-orlando has joined #openstack-kolla | 04:58 | |
| *** diga has quit IRC | 05:01 | |
| *** sean-k-m1 has joined #openstack-kolla | 05:06 | |
| *** sacharya has quit IRC | 05:06 | |
| sdake | so basically all centos gates are failing atm | 05:10 |
| sdake | because the mirrors are inconsistent | 05:10 |
| sdake | it will probablybe like that for 8-24 hours | 05:11 |
| sdake | so i'm headed to bed :) | 05:12 |
| sdake | night all | 05:12 |
| *** Kennan has quit IRC | 05:12 | |
| *** dmsimard has quit IRC | 05:12 | |
| *** sean-k-mooney has quit IRC | 05:12 | |
| *** anbehl has quit IRC | 05:12 | |
| *** Kennan has joined #openstack-kolla | 05:13 | |
| *** diga has joined #openstack-kolla | 05:13 | |
| *** anbehl has joined #openstack-kolla | 05:13 | |
| *** dmsimard has joined #openstack-kolla | 05:15 | |
| *** salv-orlando has quit IRC | 05:18 | |
| *** salv-orlando has joined #openstack-kolla | 05:18 | |
| *** vhosakot has quit IRC | 05:22 | |
| *** sdake has quit IRC | 05:26 | |
| *** asalkeld has quit IRC | 05:52 | |
| *** fragatin_ has joined #openstack-kolla | 05:52 | |
| *** fragatin_ has quit IRC | 05:52 | |
| *** fragatin_ has joined #openstack-kolla | 05:53 | |
| *** fragatin_ has joined #openstack-kolla | 05:54 | |
| *** fragatina has quit IRC | 05:55 | |
| *** fragatin_ has quit IRC | 05:59 | |
| *** sacharya has joined #openstack-kolla | 06:05 | |
| *** jrist has quit IRC | 06:07 | |
| *** fragatina has joined #openstack-kolla | 06:07 | |
| *** sacharya has quit IRC | 06:10 | |
| *** fragatina has quit IRC | 06:12 | |
| *** chopmann has joined #openstack-kolla | 06:18 | |
| *** Jeffrey4l has joined #openstack-kolla | 06:21 | |
| *** jrist has joined #openstack-kolla | 06:22 | |
| *** jrist has quit IRC | 06:22 | |
| *** jrist has joined #openstack-kolla | 06:22 | |
| *** CaoWei has joined #openstack-kolla | 06:22 | |
| *** fragatina has joined #openstack-kolla | 06:24 | |
| *** CaoWei has quit IRC | 06:27 | |
| *** CaoWei has joined #openstack-kolla | 06:27 | |
| *** salv-orlando has quit IRC | 06:30 | |
| *** fragatina has quit IRC | 06:35 | |
| *** fragatina has joined #openstack-kolla | 06:36 | |
| *** tfukushima has joined #openstack-kolla | 06:47 | |
| *** CaoWei has quit IRC | 06:47 | |
| *** CaoWei has joined #openstack-kolla | 06:48 | |
| *** ozialien10 has quit IRC | 06:50 | |
| *** Jeffrey4l has quit IRC | 06:50 | |
| openstackgerrit | Md Nadeem proposed openstack/kolla: Added unit test for kolla_docker https://review.openstack.org/285138 | 06:50 |
| *** beekhof has joined #openstack-kolla | 06:50 | |
| *** coolsvap has quit IRC | 06:53 | |
| *** coolsvap has joined #openstack-kolla | 06:53 | |
| *** mdnadeem has joined #openstack-kolla | 06:56 | |
| *** jtriley has quit IRC | 07:10 | |
| *** Jeffrey4l has joined #openstack-kolla | 07:10 | |
| *** salv-orlando has joined #openstack-kolla | 07:11 | |
| *** salv-orlando has quit IRC | 07:31 | |
| *** jmccarthy1 has joined #openstack-kolla | 07:31 | |
| *** dmk0202 has joined #openstack-kolla | 07:35 | |
| *** salv-orlando has joined #openstack-kolla | 07:35 | |
| *** diga has quit IRC | 07:36 | |
| *** mikelk has joined #openstack-kolla | 07:39 | |
| rcarrillocruz | Jeffrey4l: heya, you around | 07:39 |
| rcarrillocruz | ? | 07:39 |
| *** jmccarthy has joined #openstack-kolla | 07:41 | |
| *** jmccarthy1 has left #openstack-kolla | 07:42 | |
| *** salv-orl_ has joined #openstack-kolla | 07:48 | |
| *** salv-orlando has quit IRC | 07:52 | |
| *** shardy has joined #openstack-kolla | 07:53 | |
| *** unicell has quit IRC | 08:04 | |
| *** sacharya has joined #openstack-kolla | 08:06 | |
| *** rmart04 has joined #openstack-kolla | 08:07 | |
| *** sacharya has quit IRC | 08:10 | |
| *** gfidente has joined #openstack-kolla | 08:13 | |
| *** salv-orl_ has quit IRC | 08:27 | |
| *** wmiller has joined #openstack-kolla | 08:29 | |
| Jeffrey4l | rcarrillocruz, yep | 08:29 |
| rcarrillocruz | heya | 08:29 |
| rcarrillocruz | regarding the migration to ansible 2 | 08:30 |
| rcarrillocruz | i'd like to help | 08:30 |
| rcarrillocruz | i wonder if there's a list of work items | 08:30 |
| rcarrillocruz | so people can sign up for specific items | 08:30 |
| rcarrillocruz | to not start working on something that someone may have started already or viceversa | 08:30 |
| rcarrillocruz | ? | 08:30 |
| Jeffrey4l | rcarrillocruz, so like right now. my PS fix all the gap from ansible 1 to ansible 2. | 08:31 |
| rcarrillocruz | ah, the maria thing? | 08:31 |
| rcarrillocruz | that it | 08:31 |
| rcarrillocruz | ? | 08:31 |
| Jeffrey4l | only the modules we wrote are only compatible( kolla_docker, merge_configs) | 08:32 |
| Jeffrey4l | rcarrillocruz, what? | 08:32 |
| Jeffrey4l | here is the PS. https://review.openstack.org/317421 | 08:32 |
| Jeffrey4l | some small work is needed. | 08:32 |
| Jeffrey4l | but the gate is green, anyway. | 08:32 |
| rcarrillocruz | yeah, i saw your change, it had mariadb | 08:32 |
| rcarrillocruz | that's what the maria thing was about | 08:32 |
| rcarrillocruz | fair enough then | 08:32 |
| Jeffrey4l | rcarrillocruz, it is fixed in the latest PS. | 08:33 |
| Jeffrey4l | rcarrillocruz, are u checked it? | 08:33 |
| Jeffrey4l | the wait_for module make some change between ansible 1 and ansible 2. | 08:33 |
| rcarrillocruz | i have not checked your patch no... | 08:33 |
| rcarrillocruz | when i saw the email from sdake i was expecting more work | 08:34 |
| rcarrillocruz | which would be distributed amongst more people | 08:34 |
| Jeffrey4l | rcarrillocruz, check this https://review.openstack.org/#/c/317421/2/ansible/roles/mariadb/tasks/start.yml | 08:34 |
| patchbot | Jeffrey4l: patch 317421 - kolla - Bump the ansible to 2 | 08:34 |
| rcarrillocruz | but if all the ansible 2 migration is on that change, then that it's | 08:34 |
| Jeffrey4l | bump ansible version is easy than we thought. | 08:34 |
| Jeffrey4l | the deploy ubuntu source job is green. | 08:35 |
| *** mbound has joined #openstack-kolla | 08:36 | |
| *** pbourke has quit IRC | 08:38 | |
| *** pbourke has joined #openstack-kolla | 08:39 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy https://review.openstack.org/315860 | 08:41 |
| *** akwasnie__ has joined #openstack-kolla | 08:42 | |
| *** ediardo_ has joined #openstack-kolla | 08:43 | |
| mdnadeem | Jeffrey4l, I have updated the patch, Please visit : https://review.openstack.org/#/c/285138/ | 08:43 |
| patchbot | mdnadeem: patch 285138 - kolla - Added unit test for kolla_docker | 08:43 |
| *** akwasnie___ has joined #openstack-kolla | 08:43 | |
| Jeffrey4l | ok | 08:43 |
| *** unicell has joined #openstack-kolla | 08:44 | |
| *** shardy_ has joined #openstack-kolla | 08:44 | |
| *** akwasnie_ has quit IRC | 08:45 | |
| *** akwasnie has quit IRC | 08:45 | |
| *** shardy has quit IRC | 08:45 | |
| *** tpeoples has quit IRC | 08:45 | |
| *** cloudnull has quit IRC | 08:45 | |
| *** ediardo has quit IRC | 08:45 | |
| *** Kimmo_ has quit IRC | 08:45 | |
| *** peterjenkins has quit IRC | 08:45 | |
| *** gfidente has quit IRC | 08:45 | |
| *** kklimonda has quit IRC | 08:45 | |
| *** akwasnie__ is now known as akwasnie_ | 08:45 | |
| *** akwasnie___ is now known as akwasnie | 08:45 | |
| *** kklimonda has joined #openstack-kolla | 08:46 | |
| *** ediardo_ is now known as ediardo | 08:47 | |
| *** serverascode has quit IRC | 08:47 | |
| *** cloudkiller has joined #openstack-kolla | 08:48 | |
| *** kklimonda_ has quit IRC | 08:49 | |
| *** gfidente has joined #openstack-kolla | 08:50 | |
| *** tpeoples has joined #openstack-kolla | 08:52 | |
| *** kjelly has joined #openstack-kolla | 08:53 | |
| *** Serlex has joined #openstack-kolla | 08:53 | |
| *** peterjenkins has joined #openstack-kolla | 08:55 | |
| *** kklimonda_ has joined #openstack-kolla | 08:57 | |
| *** serverascode has joined #openstack-kolla | 08:59 | |
| pbourke | morning guys, can someone please review https://review.openstack.org/#/c/310246/ | 09:01 |
| patchbot | pbourke: patch 310246 - kolla - Improve Vagrants bootstrap.sh proxy support | 09:01 |
| pbourke | Jeffrey4l: ^ | 09:02 |
| *** smekel_ has quit IRC | 09:06 | |
| Jeffrey4l | pbourke, in the NO_PROXY define. it should not have port info. | 09:06 |
| pbourke | Jeffrey4l: ah, got you | 09:06 |
| Jeffrey4l | pbourke, so i think `NO_PROXY=127.0.0.1,operator.local` is enough. | 09:07 |
| *** smekel_ has joined #openstack-kolla | 09:08 | |
| *** salv-orlando has joined #openstack-kolla | 09:09 | |
| *** CaoWei has quit IRC | 09:09 | |
| *** unicell1 has joined #openstack-kolla | 09:11 | |
| *** unicell has quit IRC | 09:14 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy https://review.openstack.org/315860 | 09:15 |
| openstackgerrit | Francesco Vollero proposed openstack/kolla: Fixed typos in Ansible files https://review.openstack.org/317752 | 09:19 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy https://review.openstack.org/315860 | 09:30 |
| *** jmccarthy1 has joined #openstack-kolla | 09:34 | |
| *** jmccarthy1 has left #openstack-kolla | 09:34 | |
| *** weiyu has quit IRC | 09:35 | |
| *** jmccarthy1 has joined #openstack-kolla | 09:39 | |
| *** jmccarthy1 has left #openstack-kolla | 09:40 | |
| *** daneyon has joined #openstack-kolla | 09:45 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy https://review.openstack.org/315860 | 09:45 |
| *** cloudkiller is now known as cloudnull | 09:46 | |
| coolsvap | Jeffrey4l, sdake said in the morning seems like the infra mirrors are not working properly | 09:46 |
| coolsvap | we might not get correct results | 09:47 |
| coolsvap | <sdake> so basically all centos gates are failing atm | 09:47 |
| coolsvap | <sdake> because the mirrors are inconsistent | 09:47 |
| coolsvap | <sdake> it will probablybe like that for 8-24 hours | 09:47 |
| coolsvap | <sdake> so i'm headed to bed :) | 09:47 |
| coolsvap | <sdake> night all | 09:47 |
| coolsvap | Jeffrey4l, ^^ | 09:47 |
| Jeffrey4l | it is OK now. | 09:47 |
| Jeffrey4l | coolsvap, check the PS 30 here https://review.openstack.org/#/c/315860/30 | 09:48 |
| patchbot | Jeffrey4l: patch 315860 - kolla - Fix the rabbitmq crash on CentOS binary and source... | 09:48 |
| Jeffrey4l | it show the current root issue about the crash of rabbitmq. | 09:48 |
| Jeffrey4l | PS 31 should all green.. I am waiting for the gate. | 09:49 |
| *** daneyon has quit IRC | 09:50 | |
| *** adrian_otto has quit IRC | 09:50 | |
| coolsvap | okay | 09:50 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: DO NOT MERGE: TEST MASTER BRANCH https://review.openstack.org/294906 | 09:52 |
| coolsvap | once it is resolved, can you document the fix in the bug pls, i missed most of the things in morning | 09:52 |
| Jeffrey4l | coolsvap, actually, i haven't find the root cause. PS 31 just a workaround. | 09:52 |
| Jeffrey4l | but sure, i will explain every i know. | 09:53 |
| coolsvap | Jeffrey4l, yes even the workaround | 09:53 |
| Jeffrey4l | every/everything | 09:53 |
| coolsvap | would be good to have documented | 09:53 |
| *** berendt has joined #openstack-kolla | 09:53 | |
| Jeffrey4l | roger. | 09:53 |
| coolsvap | :) | 09:53 |
| openstackgerrit | Paul Bourke proposed openstack/kolla: Improve Vagrants bootstrap.sh proxy support https://review.openstack.org/310246 | 09:57 |
| *** weiyu_ has joined #openstack-kolla | 09:57 | |
| *** godleon has joined #openstack-kolla | 09:59 | |
| *** sacharya has joined #openstack-kolla | 10:07 | |
| *** sacharya has quit IRC | 10:13 | |
| *** salv-orlando has quit IRC | 10:13 | |
| *** tfukushima has quit IRC | 10:19 | |
| *** salv-orlando has joined #openstack-kolla | 10:20 | |
| *** tfukushima has joined #openstack-kolla | 10:20 | |
| *** Jeffrey4l has quit IRC | 10:25 | |
| *** Kimmo__ has joined #openstack-kolla | 10:39 | |
| *** berendt has quit IRC | 10:48 | |
| *** berendt has joined #openstack-kolla | 10:49 | |
| openstackgerrit | Md Nadeem proposed openstack/kolla: Added unit test for kolla_docker https://review.openstack.org/285138 | 10:50 |
| *** weiyu_ has quit IRC | 10:54 | |
| *** tfukushima has quit IRC | 11:06 | |
| *** berendt has quit IRC | 11:13 | |
| ccesario | morning! | 11:16 |
| *** berendt has joined #openstack-kolla | 11:18 | |
| *** mlima has joined #openstack-kolla | 11:19 | |
| mlima | morning guys | 11:20 |
| *** cu5 has joined #openstack-kolla | 11:25 | |
| *** chopmann has quit IRC | 11:29 | |
| pbourke | o/ | 11:30 |
| openstackgerrit | Merged openstack/kolla: Fixed typos in Ansible files https://review.openstack.org/317752 | 11:46 |
| *** diogogmt has joined #openstack-kolla | 11:48 | |
| *** SiRiuS__ has joined #openstack-kolla | 11:49 | |
| *** SiRiuS__ has quit IRC | 11:50 | |
| *** dwalsh has joined #openstack-kolla | 11:51 | |
| *** rhallisey has joined #openstack-kolla | 11:53 | |
| openstackgerrit | Paul Bourke proposed openstack/kolla: Fix the gate lying https://review.openstack.org/313591 | 11:54 |
| *** SiRiuS__ has joined #openstack-kolla | 11:57 | |
| *** diogogmt has quit IRC | 12:02 | |
| *** berendt has quit IRC | 12:08 | |
| *** sacharya has joined #openstack-kolla | 12:09 | |
| *** godleon has quit IRC | 12:09 | |
| *** sacharya has quit IRC | 12:13 | |
| openstackgerrit | Md Nadeem proposed openstack/kolla: Added unit test for check container https://review.openstack.org/286513 | 12:14 |
| *** sbezverk_ has quit IRC | 12:26 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Updated Gnocchi binary containers https://review.openstack.org/317256 | 12:26 |
| openstackgerrit | Merged openstack/kolla: Collect more info from the gate for debug https://review.openstack.org/315505 | 12:26 |
| openstackgerrit | Merged openstack/kolla: Stop configuring neutron to enforce DHCP MTU option https://review.openstack.org/311258 | 12:26 |
| *** berendt has joined #openstack-kolla | 12:40 | |
| *** Mr_Broken has joined #openstack-kolla | 12:42 | |
| *** salv-orlando has quit IRC | 12:42 | |
| *** dwalsh has quit IRC | 12:44 | |
| Mr_Broken | hey guys | 12:51 |
| Mr_Broken | trying to deploy allinone (stable/mitaka) on ubuntu | 12:52 |
| Mr_Broken | weirdest thing happens during deployment | 12:52 |
| Mr_Broken | http://paste.openstack.org/show/497496/ | 12:53 |
| Mr_Broken | basicaly it hangs while waiting for connection to keystone | 12:53 |
| Mr_Broken | but i can see that keystone docker is already up | 12:53 |
| Mr_Broken | and can telnet to the port mentioned ;/ | 12:53 |
| *** athomas has joined #openstack-kolla | 13:02 | |
| *** ravig has joined #openstack-kolla | 13:11 | |
| *** mbound has quit IRC | 13:17 | |
| openstackgerrit | Merged openstack/kolla: Updated from global requirements https://review.openstack.org/317181 | 13:20 |
| *** daneyon has joined #openstack-kolla | 13:21 | |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy https://review.openstack.org/315860 | 13:24 |
| mlima | Mr_Broken, try docker ps -a | 13:26 |
| mlima | and paste the output | 13:26 |
| *** daneyon has quit IRC | 13:26 | |
| *** esharao has joined #openstack-kolla | 13:31 | |
| *** diogogmt has joined #openstack-kolla | 13:33 | |
| openstackgerrit | Merged openstack/kolla: Make Heka collect Ceph logs https://review.openstack.org/317791 | 13:34 |
| *** Jeffrey4l has joined #openstack-kolla | 13:36 | |
| *** athomas has quit IRC | 13:38 | |
| *** athomas has joined #openstack-kolla | 13:39 | |
| *** vhosakot has joined #openstack-kolla | 13:39 | |
| *** salv-orlando has joined #openstack-kolla | 13:43 | |
| Mr_Broken | mlima: no containers left | 13:44 |
| *** mlima has quit IRC | 13:44 | |
| *** diogogmt has quit IRC | 13:44 | |
| *** mgoddard_ has joined #openstack-kolla | 13:45 | |
| *** mlima has joined #openstack-kolla | 13:45 | |
| *** inc0 has joined #openstack-kolla | 13:46 | |
| *** mgoddard has quit IRC | 13:48 | |
| inc0 | good morning | 13:51 |
| mlima | morning inc0 | 13:52 |
| vhosakot | morning inc0 mlima and everyone! | 13:52 |
| mlima | morning vhosakot | 13:52 |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla: Change the SELinux doc to a security doc https://review.openstack.org/318113 | 13:57 |
| *** absubram has quit IRC | 13:59 | |
| *** dave-mccowan has joined #openstack-kolla | 13:59 | |
| *** williamcaban has joined #openstack-kolla | 13:59 | |
| *** mgoddard_ has quit IRC | 14:01 | |
| *** mgoddard has joined #openstack-kolla | 14:01 | |
| *** Liuqing has joined #openstack-kolla | 14:04 | |
| *** Jeffrey4l has quit IRC | 14:08 | |
| *** salv-orlando has quit IRC | 14:09 | |
| *** sacharya has joined #openstack-kolla | 14:09 | |
| *** vhosakot has quit IRC | 14:12 | |
| *** vhosakot has joined #openstack-kolla | 14:13 | |
| *** shardy_ is now known as shardy | 14:14 | |
| *** sacharya has quit IRC | 14:14 | |
| *** sdake has joined #openstack-kolla | 14:14 | |
| *** daneyon has joined #openstack-kolla | 14:14 | |
| *** daneyon_ has joined #openstack-kolla | 14:16 | |
| *** berendt has quit IRC | 14:16 | |
| *** Mr_Broken has quit IRC | 14:17 | |
| *** mbound has joined #openstack-kolla | 14:17 | |
| *** daneyon has quit IRC | 14:20 | |
| *** mbound has quit IRC | 14:23 | |
| *** sdake has quit IRC | 14:26 | |
| *** sdake has joined #openstack-kolla | 14:27 | |
| *** cu5 has quit IRC | 14:28 | |
| *** Liuqing has quit IRC | 14:33 | |
| *** salv-orlando has joined #openstack-kolla | 14:35 | |
| *** daneyon_ has quit IRC | 14:36 | |
| *** sdake_ has joined #openstack-kolla | 14:42 | |
| *** sdake has quit IRC | 14:43 | |
| *** daneyon has joined #openstack-kolla | 14:44 | |
| *** inc0 has quit IRC | 14:45 | |
| *** berendt has joined #openstack-kolla | 14:45 | |
| *** coolsvap has quit IRC | 14:53 | |
| *** inc0 has joined #openstack-kolla | 14:53 | |
| *** coolsvap has joined #openstack-kolla | 14:54 | |
| *** sacharya has joined #openstack-kolla | 14:59 | |
| *** mark-casey has joined #openstack-kolla | 15:01 | |
| *** CaoWei has joined #openstack-kolla | 15:04 | |
| *** salv-orlando has quit IRC | 15:05 | |
| *** daneyon has quit IRC | 15:12 | |
| *** jtriley has joined #openstack-kolla | 15:12 | |
| *** daneyon has joined #openstack-kolla | 15:13 | |
| *** athomas has quit IRC | 15:16 | |
| *** kklimonda has quit IRC | 15:16 | |
| *** mlima has quit IRC | 15:16 | |
| *** athomas has joined #openstack-kolla | 15:18 | |
| *** athomas has quit IRC | 15:23 | |
| *** mlima has joined #openstack-kolla | 15:26 | |
| *** jtriley has quit IRC | 15:26 | |
| *** rhallisey has quit IRC | 15:27 | |
| *** rhallisey has joined #openstack-kolla | 15:28 | |
| *** daneyon has quit IRC | 15:30 | |
| vhosakot | meeting in 60 mins | 15:30 |
| *** salv-orlando has joined #openstack-kolla | 15:31 | |
| *** diogogmt has joined #openstack-kolla | 15:33 | |
| *** mbound has joined #openstack-kolla | 15:34 | |
| *** dmk0202 has quit IRC | 15:37 | |
| *** dmk0202 has joined #openstack-kolla | 15:37 | |
| mlima | rhallisey, ping? | 15:37 |
| rhallisey | mlima, hi | 15:38 |
| *** Mr_Broken has joined #openstack-kolla | 15:38 | |
| *** ravig has quit IRC | 15:39 | |
| *** CaoWei has quit IRC | 15:39 | |
| rhallisey | mlima, what's up? | 15:39 |
| *** CaoWei has joined #openstack-kolla | 15:39 | |
| mlima | in this ps https://review.openstack.org/#/c/318113/ and maybe can be interesting not remove the "Overview" about SELi.nux | 15:40 |
| patchbot | mlima: patch 318113 - kolla - Change the SELinux doc to a security doc | 15:40 |
| *** mikelk has quit IRC | 15:40 | |
| mlima | unless it is no longer needed. | 15:40 |
| *** MarMat has joined #openstack-kolla | 15:40 | |
| mlima | what do you think? rhallisey | 15:41 |
| rhallisey | mlima, sure. I'll add it under the SELinux title | 15:41 |
| *** salv-orlando has quit IRC | 15:41 | |
| mlima | add one note rhallisey | 15:42 |
| rhallisey | sure | 15:42 |
| *** salv-orlando has joined #openstack-kolla | 15:42 | |
| mlima | :) | 15:43 |
| *** SiRiuS__ has quit IRC | 15:43 | |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla: Change the SELinux doc to a security doc https://review.openstack.org/318113 | 15:44 |
| *** dmk0202 has quit IRC | 15:51 | |
| *** SiRiuS__ has joined #openstack-kolla | 15:52 | |
| *** daneyon has joined #openstack-kolla | 15:56 | |
| *** daneyon has quit IRC | 15:57 | |
| *** daneyon has joined #openstack-kolla | 15:58 | |
| *** mbound has quit IRC | 16:00 | |
| *** mgoddard_ has joined #openstack-kolla | 16:01 | |
| *** mgoddard has quit IRC | 16:04 | |
| Mr_Broken | anyone can help me with allinone mitaka/stable deployment on Ubuntu ? | 16:06 |
| Mr_Broken | deployment hangs while waiting for keystone and fails | 16:06 |
| Mr_Broken | but i can see the keystone docker being created | 16:06 |
| Mr_Broken | and started | 16:06 |
| Mr_Broken | and port reachable via telnet :/ | 16:07 |
| *** CaoWei has quit IRC | 16:07 | |
| Mr_Broken | http://paste.openstack.org/show/497496/ | 16:08 |
| *** alyson_ has joined #openstack-kolla | 16:08 | |
| *** JoseMello has joined #openstack-kolla | 16:08 | |
| *** mbound has joined #openstack-kolla | 16:11 | |
| *** CaoWei has joined #openstack-kolla | 16:12 | |
| *** mbound has quit IRC | 16:13 | |
| *** mbound has joined #openstack-kolla | 16:13 | |
| *** CaoWei has quit IRC | 16:14 | |
| mlima | Mr_Broken, try docker ps -a and paste the output | 16:19 |
| Mr_Broken | but now i am just after failed deployment : | 16:20 |
| Mr_Broken | mlima: http://paste.openstack.org/show/497547/ | 16:21 |
| *** pbourke-mobile2 has joined #openstack-kolla | 16:22 | |
| openstackgerrit | Merged openstack/kolla: Improve Vagrants bootstrap.sh proxy support https://review.openstack.org/310246 | 16:25 |
| inc0 | Mr_Broken, can you paste output from ansible | 16:27 |
| inc0 | ? | 16:27 |
| mlima | keystone containers is up | 16:28 |
| *** Jeffrey4l has joined #openstack-kolla | 16:28 | |
| vhosakot | meeting in a min! | 16:29 |
| Mr_Broken | inc0 : you want full output ? | 16:29 |
| inc0 | yeah | 16:29 |
| Mr_Broken | inc0: i used verbose - so its quite a lot ;] | 16:29 |
| mlima | Mr_Broken, run tools/diag and paste output | 16:29 |
| Mr_Broken | kk | 16:30 |
| inc0 | well, might actually be helpful | 16:30 |
| *** unicell1 has quit IRC | 16:30 | |
| sdake_ | did we get a diag tool? | 16:30 |
| * sdake_ yayas | 16:30 | |
| vhosakot | meeting time | 16:30 |
| Mr_Broken | inc0: would have to rerun deployment , (wasnt in screen) | 16:30 |
| Mr_Broken | mlima: on deployer or controller ? | 16:31 |
| *** sdake_ has quit IRC | 16:31 | |
| inc0 | Mr_Broken, make sure to tools/cleanup-containers first | 16:31 |
| mlima | both | 16:31 |
| *** sdake has joined #openstack-kolla | 16:31 | |
| inc0 | and since you're reruning you can ditch verbose;)_ | 16:31 |
| Mr_Broken | mlima: no tools/diag in stable/mitaka ? | 16:32 |
| mlima | oh god, :/ | 16:32 |
| mlima | my bad | 16:33 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Update ubuntu dockerfiles for formatting https://review.openstack.org/317238 | 16:33 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Update quickstart guide for formatting https://review.openstack.org/317205 | 16:33 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Add support to lint the install commands in Dockerfiles https://review.openstack.org/317364 | 16:33 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Update the horizon dockerfile for formatting https://review.openstack.org/317363 | 16:33 |
| openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the rabbitmq crash on CentOS binary and source deploy https://review.openstack.org/315860 | 16:34 |
| Mr_Broken | inc0: http://paste.openstack.org/show/497551/ | 16:38 |
| *** ravig has joined #openstack-kolla | 16:39 | |
| Mr_Broken | i noticed that it deploys haproxy and keepalived | 16:39 |
| Mr_Broken | is this normal with allinone ? | 16:39 |
| *** diogogmt has quit IRC | 16:40 | |
| inc0 | well it deploys it by default | 16:40 |
| Mr_Broken | kk | 16:40 |
| inc0 | you can turn it off by enable_haproxy: false | 16:40 |
| inc0 | in global.yml | 16:40 |
| *** diogogmt has joined #openstack-kolla | 16:41 | |
| Mr_Broken | could I paste You my globals.yml to verify ? | 16:41 |
| inc0 | sure, that would help | 16:42 |
| inc0 | also which version of ansible? 1.9.4? | 16:42 |
| Mr_Broken | http://paste.openstack.org/show/497554/ | 16:42 |
| Mr_Broken | root@kolla-deployer-esn:~/kolla/tools# ansible --version | 16:42 |
| Mr_Broken | ansible 1.9.4 | 16:42 |
| inc0 | 10.136.228.152 is not used right? | 16:43 |
| inc0 | or it's ip of node itself? | 16:43 |
| Mr_Broken | right | 16:43 |
| Mr_Broken | not used | 16:43 |
| Mr_Broken | and it binded itself on the controller | 16:43 |
| Mr_Broken | and keystone is "reachable" on both IP's | 16:43 |
| inc0 | so one thing unrelated to your prolem, enable_cinder wont work on it's own with mitaka | 16:43 |
| inc0 | we only have iscsi+lvm on newton | 16:44 |
| inc0 | on mitaka only easy way to get cinder working is with ceph | 16:45 |
| inc0 | but back to the issue at hand | 16:45 |
| *** ravig has quit IRC | 16:45 | |
| inc0 | so this is output? part of hostname in ansible is cut? | 16:46 |
| inc0 | (talking about ansible output, at the end you don't have full hostname)( | 16:47 |
| *** Serlex has quit IRC | 16:50 | |
| *** pbourke-mobile-3 has joined #openstack-kolla | 16:50 | |
| *** pbourke-mobile2 has quit IRC | 16:54 | |
| *** mummer has joined #openstack-kolla | 16:55 | |
| *** rmart04 has quit IRC | 16:57 | |
| *** jtriley has joined #openstack-kolla | 16:58 | |
| Mr_Broken | yeah it was cut from paste | 16:58 |
| Mr_Broken | TASK: [keystone | Running Keystone bootstrap container] *********************** | 16:59 |
| Mr_Broken | <ironic-kolla> REMOTE_MODULE kolla_docker image=10.136.228.103:4000/kollaglue/ubuntu-source-keystone:2.0.0 action=start_container restart_policy=never name=bootstrap_keystone | 16:59 |
| Mr_Broken | changed: [ironic-kolla -> ironic-kolla] => {"changed": true, "result": false} | 16:59 |
| Mr_Broken | TASK: [keystone | Starting keystone container] ******************************** | 16:59 |
| Mr_Broken | <ironic-kolla> REMOTE_MODULE kolla_docker name=keystone image=10.136.228.103:4000/kollaglue/ubuntu-source-keystone:2.0.0 action=start_container | 16:59 |
| Mr_Broken | changed: [ironic-kolla] => {"changed": true, "result": false} | 16:59 |
| Mr_Broken | TASK: [keystone | Wait for keystone startup] ********************************** | 16:59 |
| Mr_Broken | <ironic-kolla> REMOTE_MODULE wait_for host=ironic-kolla port=35357 | 16:59 |
| Mr_Broken | but this fragment I've already pasted before ;] | 16:59 |
| Mr_Broken | #JSYK telnet ironic-kolla 35357 works fine | 16:59 |
| *** sbezverk has joined #openstack-kolla | 17:05 | |
| *** mgoddard_ has quit IRC | 17:07 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Add support for mistral ubuntu binary containers https://review.openstack.org/317240 | 17:07 |
| *** mgoddard has joined #openstack-kolla | 17:07 | |
| *** unicell has joined #openstack-kolla | 17:08 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Add support for magnum ubuntu binary containers https://review.openstack.org/317251 | 17:08 |
| *** mark-casey has quit IRC | 17:09 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Updated Gnocchi binary containers https://review.openstack.org/317256 | 17:09 |
| *** absubram has joined #openstack-kolla | 17:11 | |
| *** kklimonda has joined #openstack-kolla | 17:12 | |
| *** Lyncos has joined #openstack-kolla | 17:13 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Add support for murano binary containers for rpm based distros https://review.openstack.org/317270 | 17:13 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Add ubuntu binary container for zaqar https://review.openstack.org/317276 | 17:14 |
| Mr_Broken | inc0: any ideas ? :> | 17:14 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Add sahara containers https://review.openstack.org/317261 | 17:14 |
| inc0 | Mr_Broken, meeting for next 15mins, be right back with you | 17:15 |
| Mr_Broken | inc0: no rush | 17:16 |
| *** pbourke-mobile-3 has quit IRC | 17:18 | |
| *** shardy has quit IRC | 17:19 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla-kubernetes: Kolla Kubernetes Service Discovery BP https://review.openstack.org/317537 | 17:20 |
| *** ravig has joined #openstack-kolla | 17:25 | |
| inc0 | Mr_Broken, back | 17:30 |
| sdake | Mr_Broken please use a paste service - it is really hard to debug paste messages in irc | 17:30 |
| Mr_Broken | inc0 : cool, should I disable HAProxy ? | 17:30 |
| *** unicell has quit IRC | 17:30 | |
| sdake | dont disable haproxy | 17:30 |
| *** unicell1 has joined #openstack-kolla | 17:30 | |
| Mr_Broken | sdake: sure, used paste.openstack.org but it did cut few last lines | 17:31 |
| sdake | Mr_Broken can you paste again in a paste service please | 17:31 |
| *** fragatina has quit IRC | 17:31 | |
| rhallisey | sbezverk, re your dns spec | 17:31 |
| rhallisey | sbezverk, I think a blueprint will be enough | 17:32 |
| inc0 | Mr_Broken, hmmm ironic-kolla resolves to 10.136.228.152? | 17:32 |
| rhallisey | sbezverk, and desribe the method you wrote in the spec in the BP | 17:32 |
| Mr_Broken | inc0: ironic-kolla resolves to 10.136.228.151 | 17:32 |
| sdake | inc0 if people disable haproxy, then they just have to reenable it when they want to get areal deployment going | 17:32 |
| Mr_Broken | 10.136.228.152 -was free IP | 17:32 |
| inc0 | well, try this | 17:32 |
| Mr_Broken | sdake: i do have a multinode running with haproxy - works fine | 17:33 |
| sdake | Mr_Broken what is your exact issue then? | 17:33 |
| Mr_Broken | sdake: now i need a development allinone deployment | 17:33 |
| inc0 | change kolla_internal_vip_address to 10.136.228.151 and add option enable_haproxy: false | 17:33 |
| inc0 | fqdn should resolve to floating ip | 17:33 |
| Mr_Broken | fqdn should resolve to ha-proxy IP you mean ? | 17:34 |
| Mr_Broken | inc0: that was my idea too | 17:34 |
| Mr_Broken | kk will try | 17:34 |
| sdake | Mr_Broken yes it is normal to deploy haproxy and keepalived on allinone | 17:34 |
| sdake | we don't descriminate between allinone and mulitnode | 17:34 |
| sdake | it should be the same exact deployment | 17:34 |
| inc0 | but fqdn should resolve to it | 17:35 |
| sdake | the only reason we have enble_haproxy as an option is to enable third party load balancing services | 17:35 |
| *** athomas has joined #openstack-kolla | 17:36 | |
| *** rhallisey has quit IRC | 17:36 | |
| Mr_Broken | inc0: but in any case , on both IP's this port is reachable | 17:37 |
| Mr_Broken | how does the deployer check for it ? | 17:37 |
| Mr_Broken | and fails ... | 17:37 |
| *** rhallisey has joined #openstack-kolla | 17:37 | |
| inc0 | so I think it shouldn't be reachable on 151 | 17:37 |
| inc0 | we bind do specific_ip:35357 not *:35357 | 17:38 |
| Mr_Broken | hmmm ok | 17:38 |
| Mr_Broken | so I should only change fqdn to resolve to ha-IP | 17:38 |
| Mr_Broken | and retry right ? | 17:38 |
| Mr_Broken | and change to : | 17:39 |
| Mr_Broken | kolla_internal_vip_address: "10.136.228.151" | 17:39 |
| inc0 | no | 17:39 |
| inc0 | so if you change internal_vip to 151 | 17:39 |
| inc0 | fqdn is ok | 17:39 |
| inc0 | it should point to internal_vip_address | 17:40 |
| Mr_Broken | but then disable ha-proxy | 17:40 |
| inc0 | yes | 17:40 |
| openstackgerrit | Steven Dake proposed openstack/kolla: Document upgrading for operators https://review.openstack.org/317084 | 17:40 |
| Mr_Broken | and if i want to keep it enabled like sdake suggests ? | 17:40 |
| inc0 | either that or keep haproxy and make fqdn point 152 | 17:40 |
| Mr_Broken | kk will try that first | 17:40 |
| Mr_Broken | if that fails - will try to disable haproxy | 17:40 |
| *** ravig has quit IRC | 17:40 | |
| sdake | inc0 i'm pretty sure everytime you tell someone to disable haproxy it just confuses the situation ;) | 17:40 |
| *** fbarilla has joined #openstack-kolla | 17:41 | |
| inc0 | but it does help for aio;) | 17:41 |
| *** ravig has joined #openstack-kolla | 17:42 | |
| fbarilla | just re-installed Kolla, instantiating cirros VM leads to: "aborted: Block Device Mapping is Invalid" Any idea? | 17:43 |
| sdake | i have debugged 20+ deploys where enable_haproxy was disabled.. | 17:43 |
| sdake | fbarilla need more data | 17:43 |
| sdake | fbarilla you ssaid reinstalled, was it working previousy? | 17:43 |
| fbarilla | it's new deployment on a different system | 17:44 |
| fbarilla | 2016-05-18 12:31:32.460 1 INFO nova.virt.block_device [req-c66d2e85-9de8-4c77-a9a7-9aecb780a87d a448fa392dae48559c26e00a7056e06c 8ef392ce59db452592fff013f8508067 - - -] [instance: 541d11fe-7e5a-41ef-b10d-86426ffba8d9] Booting with blank volume at /dev/vda 2016-05-18 12:31:32.461 1 ERROR nova.compute.manager [req-c66d2e85-9de8-4c77-a9a7-9aecb780a87d a448fa392dae48559c26e00a7056e06c 8ef392ce59db452592fff013f8508067 - - -] [ins | 17:44 |
| inc0 | fbarilla, stable mitaka with cinder? | 17:45 |
| fbarilla | yes | 17:45 |
| inc0 | yeah...welll | 17:45 |
| inc0 | we don't have iscsi in mitaka | 17:45 |
| inc0 | this thing will come in in newton | 17:45 |
| inc0 | for mitaka I strongly suggest using ceph | 17:46 |
| inc0 | we can work out way to deploy iscsi with mitaka, but that will not be super clean | 17:46 |
| fbarilla | what if I want to use local storage ? | 17:46 |
| inc0 | for cinder? | 17:46 |
| *** Jeffrey4l has quit IRC | 17:46 | |
| inc0 | nova ephemerals on local storage works well | 17:47 |
| inc0 | it's volumes that are issue | 17:47 |
| fbarilla | ok, let me check | 17:47 |
| *** NobodyCam has joined #openstack-kolla | 17:48 | |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Make passwords.yml file generation configurable https://review.openstack.org/317642 | 17:48 |
| *** mummer has quit IRC | 17:50 | |
| *** apuimedo has joined #openstack-kolla | 17:50 | |
| Mr_Broken | inc0: looks like it hangs again | 17:52 |
| inc0 | hmm | 17:52 |
| Mr_Broken | waiting 3000 sec now i think | 17:52 |
| inc0 | iptables are clean? | 17:53 |
| *** ravig has quit IRC | 17:53 | |
| Mr_Broken | yeah | 17:53 |
| Mr_Broken | i am telneting from deployer to controller on this point | 17:53 |
| Mr_Broken | port* | 17:53 |
| inc0 | and thats haproxy scenerio right? | 17:53 |
| Mr_Broken | yep | 17:54 |
| Mr_Broken | timeout confirmed | 17:54 |
| inc0 | can you tcpdump this port on ironic node to see if ansible access it? | 17:54 |
| Mr_Broken | during deployment ? | 17:54 |
| *** gfidente is now known as gfidente|afk | 17:54 | |
| Mr_Broken | can try | 17:54 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Make passwords.yml file generation configurable https://review.openstack.org/317642 | 17:57 |
| Mr_Broken | inc0: i can only see ssh traffic from my host | 17:57 |
| Mr_Broken | inc0: nothing i can see coming on this interface on port 35357 | 17:57 |
| inc0 | hmm | 17:57 |
| inc0 | how about you try to deploy it from ironic node? | 17:58 |
| inc0 | so aio on local connection | 17:58 |
| Mr_Broken | i want my deployer node "clean" | 17:59 |
| Mr_Broken | use it for different deployments | 17:59 |
| Mr_Broken | it was successfull in deploying my working multinode topology - i will need it to replicate it soon | 18:00 |
| Mr_Broken | I'll try without HAproxy first | 18:00 |
| *** unicell1 has quit IRC | 18:00 | |
| *** unicell has joined #openstack-kolla | 18:00 | |
| inc0 | well if there is no traffic, I don't think it's haproxy issue | 18:01 |
| inc0 | but let's try | 18:01 |
| Mr_Broken | why do you think its a network issue if i can reach this port from deployer ? | 18:02 |
| Mr_Broken | http://paste.openstack.org/show/497573/ | 18:03 |
| inc0 | rather ansible issue | 18:04 |
| inc0 | not sure what went wrong tho | 18:04 |
| Mr_Broken | yeah, that could be the case | 18:04 |
| inc0 | if you don't see any traffic going through, something is blocking it | 18:04 |
| Mr_Broken | i can see traffic when I telnet | 18:04 |
| inc0 | you can try to tcpdump deployment host to see if it's going out | 18:04 |
| Mr_Broken | i cant see when deployer is working | 18:04 |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla: Change the SELinux doc to a security doc https://review.openstack.org/318113 | 18:04 |
| Mr_Broken | yeah lets see on the deployer | 18:05 |
| *** ravig has joined #openstack-kolla | 18:05 | |
| inc0 | tbh I never seen this problem before;) | 18:05 |
| *** fragatina has joined #openstack-kolla | 18:05 | |
| Mr_Broken | inc0: tons of ssh traffic | 18:08 |
| inc0 | try port 35357 | 18:08 |
| inc0 | ;) | 18:08 |
| Mr_Broken | inc0: but it stops on this exact moment | 18:08 |
| Mr_Broken | weird as hell | 18:09 |
| Mr_Broken | same network segment ... no firewall | 18:09 |
| openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Make passwords.yml file generation configurable https://review.openstack.org/317642 | 18:09 |
| inc0 | yeah...this is strange | 18:11 |
| Mr_Broken | inc0: deployer doesnt initiate any traffic on 35357 | 18:11 |
| inc0 | the plot thickens | 18:13 |
| Mr_Broken | :] | 18:13 |
| inc0 | turn off iptables for a moment maybe? | 18:14 |
| Mr_Broken | http://paste.openstack.org/show/497578/ | 18:15 |
| *** ravig has quit IRC | 18:16 | |
| Mr_Broken | input/output default policy accept | 18:16 |
| Mr_Broken | and no rules in chains | 18:16 |
| inc0 | I got nothing else...sorry | 18:17 |
| inc0 | something is funky with deployment host | 18:17 |
| *** ravig has joined #openstack-kolla | 18:18 | |
| Mr_Broken | ;> | 18:19 |
| Mr_Broken | my deployer is awsome! :D | 18:19 |
| *** ravig has quit IRC | 18:19 | |
| Mr_Broken | kk, i might try to make a new one then | 18:19 |
| Mr_Broken | but first i will try again without haproxy | 18:19 |
| *** coolsvap has quit IRC | 18:20 | |
| Mr_Broken | thanks for all the help! | 18:20 |
| *** dwalsh has joined #openstack-kolla | 18:20 | |
| inc0 | good luck | 18:23 |
| *** ravig has joined #openstack-kolla | 18:25 | |
| *** fragatin_ has joined #openstack-kolla | 18:26 | |
| Mr_Broken | same thing | 18:28 |
| *** fragatina has quit IRC | 18:29 | |
| *** fragatina has joined #openstack-kolla | 18:29 | |
| *** fragatin_ has quit IRC | 18:29 | |
| *** sdake_ has joined #openstack-kolla | 18:31 | |
| *** sdake has quit IRC | 18:33 | |
| *** ravig has quit IRC | 18:34 | |
| Mr_Broken | omfg... the host controller host was created by vagrant | 18:40 |
| Mr_Broken | and had dns pointing to vagrant network | 18:40 |
| Mr_Broken | and vagrant server had actually this ironic-kolla name in its config | 18:41 |
| Mr_Broken | poiting to some 192.168... network :P | 18:41 |
| Mr_Broken | thats why no traffic on the interface ;] | 18:41 |
| Mr_Broken | its working now | 18:41 |
| Mr_Broken | thanks for all the help again ! | 18:41 |
| *** sacharya_ has joined #openstack-kolla | 18:43 | |
| *** ravig has joined #openstack-kolla | 18:44 | |
| *** sacharya has quit IRC | 18:47 | |
| vhosakot | Mr_Broken: is ironic-kolla something you adding in the config ? or, kolla added it during build/deploy ? | 18:51 |
| Mr_Broken | vhosakot: ironic-kolla was the hostname of my controller :P | 18:51 |
| vhosakot | ah, so, after you changed to IP, it worked ? | 18:52 |
| Mr_Broken | I've changed controllers /etc/resolv.conf | 18:52 |
| Mr_Broken | since it was pointing to some vagrant server dns :] | 18:52 |
| Mr_Broken | and this vagrant server had the same hostname in dns config ;] | 18:52 |
| Mr_Broken | but on different network/interface | 18:52 |
| vhosakot | ah nice.. yes, a dns issue on the controller.. | 18:52 |
| vhosakot | cool | 18:52 |
| Mr_Broken | yeah ;] | 18:52 |
| vhosakot | cool | 18:53 |
| Mr_Broken | lesson for today - always deploy your controllers by yourself ;] | 18:53 |
| Mr_Broken | dont let your friend deploy it using vagrant ;] | 18:53 |
| vhosakot | well, the /etc/resolv.conf file on any node is operator's reponsibility if DNS is expected :) | 18:54 |
| Mr_Broken | absolutely | 18:54 |
| vhosakot | cool glad it worked.. yeah, I do the same thing as well... add the right nameservers and search domains in my /etc/resolv.conf on the deploy node | 18:56 |
| inc0 | Mr_Broken, so it's all good now? | 18:59 |
| *** daneyon has quit IRC | 19:03 | |
| *** ravig has quit IRC | 19:05 | |
| *** mummer has joined #openstack-kolla | 19:08 | |
| vhosakot | inc0: yeah, Mr_Broken said it worked once he used IP instead of hostname for the controller... I have seen the same issue too before and resolved it by correcting my /etc/resolv.conf | 19:08 |
| *** ravig has joined #openstack-kolla | 19:09 | |
| *** ravig has quit IRC | 19:10 | |
| Mr_Broken | yeah, all good now | 19:11 |
| Mr_Broken | controller node had wrong dns settings | 19:11 |
| *** sacharya has joined #openstack-kolla | 19:12 | |
| Mr_Broken | funny, i was under the impression that ansible host would be the one resolving this name | 19:13 |
| *** SiRiuS__ has quit IRC | 19:15 | |
| *** sacharya_ has quit IRC | 19:16 | |
| *** kbyrne has quit IRC | 19:16 | |
| inc0 | so ansible works in a different way | 19:19 |
| inc0 | it generates big python scripts with logic and executes it on host | 19:20 |
| inc0 | that enables deployment host to just have access to ssh, nothing else is required | 19:20 |
| *** kbyrne has joined #openstack-kolla | 19:20 | |
| *** MarMat_ has joined #openstack-kolla | 19:21 | |
| *** dwalsh has quit IRC | 19:22 | |
| *** sdake_ has quit IRC | 19:23 | |
| *** MarMat has quit IRC | 19:24 | |
| sbezverk | inc0 ping | 19:28 |
| *** Mr_Broken has quit IRC | 19:30 | |
| *** Mr_Broken has joined #openstack-kolla | 19:30 | |
| inc0 | hey sbezverk whats up? | 19:30 |
| sbezverk | inc0 I have a question about build.py, fo you have a couple of minutes to chat? | 19:34 |
| inc0 | sure, go ahead | 19:34 |
| *** Mr_Broken has quit IRC | 19:35 | |
| *** Mr_Broken has joined #openstack-kolla | 19:35 | |
| sbezverk | inc0 when source is url, we get tar for a component example neutron. now in neutron docker we have line ADD neutron-base-archive /neutron-base-source | 19:37 |
| sbezverk | I cannot figure out where neutron-base-archive is coming from | 19:37 |
| sbezverk | inc0 neutron tar ball does not have a folder with this name | 19:37 |
| *** fragatina has quit IRC | 19:38 | |
| inc0 | hmm, give me a moment to refresh my memory | 19:38 |
| sbezverk | inc0 it must be something in build.py, do you know this process? | 19:38 |
| vhosakot | sbezverk: if you're talking about the neutron-lbaas PS, I was not able to find neutron-base-archive in the entire repo except https://github.com/openstack/kolla/blob/master/docker/neutron/neutron-base/Dockerfile.j2#L51 | 19:38 |
| *** fragatina has joined #openstack-kolla | 19:38 | |
| vhosakot | inc0: I need to know as well.. how that base-archive variable works in the Dockerfile when building from source | 19:39 |
| sbezverk | vhosakot yes, it must be a trick in build.py I just do not see it there | 19:39 |
| *** Mr_Broken has quit IRC | 19:39 | |
| *** SiRiuS__ has joined #openstack-kolla | 19:39 | |
| inc0 | https://github.com/openstack/kolla/blob/master/kolla/cmd/build.py#L172 | 19:40 |
| inc0 | this is where build downloads tar | 19:40 |
| vhosakot | sbezverk: I enabled some debugs and see that the function process_source is called https://github.com/openstack/kolla/blob/master/kolla/cmd/build.py#L171-L236 | 19:40 |
| vhosakot | inc0: whrere is the source tar untarred and installed ? in build.py or Dockerfile ? | 19:41 |
| inc0 | vhosakot, docker itself untars it | 19:41 |
| vhosakot | ah ok | 19:41 |
| inc0 | afair | 19:41 |
| sbezverk | inc0 do not think so I am looking at build.py and I think it untars it there | 19:42 |
| inc0 | yeah, line 214 | 19:43 |
| inc0 | you're right | 19:43 |
| inc0 | or... | 19:43 |
| inc0 | no, hold on | 19:43 |
| sbezverk | inc0 I think line 286 is where tar gets opened | 19:44 |
| inc0 | this is for plugin | 19:45 |
| inc0 | it gets retarred | 19:46 |
| inc0 | yeah, ADD will untar it | 19:46 |
| inc0 | http://stackoverflow.com/questions/24958140/docker-copy-vs-add | 19:46 |
| *** sdake has joined #openstack-kolla | 19:49 | |
| vhosakot | ah ADD untars it.. magic! | 19:49 |
| *** ravig has joined #openstack-kolla | 19:49 | |
| sbezverk | inc0 ok, but then what associate neutron-base-archive with actual tar file? | 19:50 |
| inc0 | it's saved under this name by build.py | 19:50 |
| sbezverk | there is should be some logic to connect them together :-) | 19:51 |
| inc0 | https://github.com/openstack/kolla/blob/master/kolla/cmd/build.py#L172 | 19:51 |
| inc0 | source['name'] is neutron-base | 19:52 |
| *** mlima has left #openstack-kolla | 19:52 | |
| inc0 | as this is name of container | 19:52 |
| inc0 | and -archive is added there | 19:52 |
| sbezverk | inc0 ok got it, I will add some debugging to see what is happening here.. thank you for your insights | 19:52 |
| inc0 | any time | 19:53 |
| *** gfidente|afk is now known as gfidente | 19:56 | |
| *** ravig has quit IRC | 19:57 | |
| *** salv-orlando has quit IRC | 19:59 | |
| *** ravig has joined #openstack-kolla | 20:01 | |
| *** diogogmt has quit IRC | 20:21 | |
| *** ravig has quit IRC | 20:23 | |
| *** ravig has joined #openstack-kolla | 20:23 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: WIP: Adds Neutron LBaaS Support https://review.openstack.org/318322 | 20:23 |
| *** fbarilla has quit IRC | 20:25 | |
| *** sacharya_ has joined #openstack-kolla | 20:31 | |
| *** diogogmt has joined #openstack-kolla | 20:33 | |
| *** sacharya has quit IRC | 20:34 | |
| *** daneyon has joined #openstack-kolla | 20:35 | |
| *** ravig has quit IRC | 20:36 | |
| *** vhosakot has quit IRC | 20:37 | |
| *** jtriley has quit IRC | 20:38 | |
| *** daneyon_ has joined #openstack-kolla | 20:39 | |
| *** daneyon has quit IRC | 20:40 | |
| *** ravig has joined #openstack-kolla | 20:42 | |
| *** absubram has quit IRC | 20:46 | |
| *** daneyon_ has quit IRC | 20:47 | |
| *** vhosakot has joined #openstack-kolla | 20:50 | |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla: Add generate-config option to kolla-ansible https://review.openstack.org/318343 | 21:15 |
| *** ayoung has quit IRC | 21:18 | |
| *** ayoung has joined #openstack-kolla | 21:18 | |
| *** salv-orlando has joined #openstack-kolla | 21:21 | |
| *** dave-mccowan has quit IRC | 21:23 | |
| *** inc0 has quit IRC | 21:44 | |
| *** daneyon has joined #openstack-kolla | 21:49 | |
| *** berendt has quit IRC | 21:59 | |
| *** sacharya has joined #openstack-kolla | 22:03 | |
| *** ozialien10 has joined #openstack-kolla | 22:03 | |
| *** mummer has quit IRC | 22:05 | |
| *** ravig has quit IRC | 22:05 | |
| *** sacharya_ has quit IRC | 22:07 | |
| openstackgerrit | Ryan Hallisey proposed openstack/kolla: Generate configuration using ansible for any project https://review.openstack.org/318356 | 22:11 |
| *** vhosakot has quit IRC | 22:15 | |
| *** harlowja has quit IRC | 22:22 | |
| *** athomas has quit IRC | 22:22 | |
| *** daneyon has quit IRC | 22:25 | |
| *** rhallisey has quit IRC | 22:29 | |
| *** ravig has joined #openstack-kolla | 22:35 | |
| *** ravig has quit IRC | 22:37 | |
| *** gfidente has quit IRC | 22:43 | |
| *** MarMat_ has quit IRC | 22:51 | |
| *** esharao has quit IRC | 22:53 | |
| *** mbound has quit IRC | 22:54 | |
| *** harlowja has joined #openstack-kolla | 23:00 | |
| *** SiRiuS__ has quit IRC | 23:00 | |
| *** MarMat_ has joined #openstack-kolla | 23:02 | |
| *** SiRiuS__ has joined #openstack-kolla | 23:05 | |
| *** JoseMello has quit IRC | 23:09 | |
| *** salv-orl_ has joined #openstack-kolla | 23:10 | |
| *** salv-orlando has quit IRC | 23:13 | |
| *** weiyu has joined #openstack-kolla | 23:26 | |
| openstackgerrit | Serguei Bezverkhi proposed openstack/kolla: Adds Neutron LBaaS Support https://review.openstack.org/318322 | 23:28 |
| *** vhosakot has joined #openstack-kolla | 23:37 | |
| *** salv-orl_ has quit IRC | 23:46 | |
| *** mbound has joined #openstack-kolla | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!