Thursday, 2017-03-02

financeMannsdake you got any idea with the windows blue screen http://imgur.com/a/cvUCj?00:03
alopinaccessible boot device... hrm00:03
alopnot a windows guy, but I have seen similar error messages when the guest image was corrupted00:04
*** jrobinson_ has joined #openstack-kolla00:05
*** jrobinson_ is now known as jrobinson00:05
financeMannalop the image boots up just fine from virtualbox and i set it up as a cowq image so i just upload that image straight to openstack00:06
financeMannboots like halfway then dies00:06
alopI saw earlier that you mentioned virtio drivers00:06
alopI'm wondering if there's something silly like, in virtualbox, your VM is configured for sata, and in openstack, your vm is configured for scsi00:07
financeMannalop sata http://imgur.com/a/TLjOM00:08
financeManndunno how to tell in openstack00:08
sdakefinanceMann something alop said triggered me to ask this quesiton -> do you have the virutalbox addons guest cd installed?00:08
*** krtaylor has quit IRC00:08
financeMannno, no idea what that is00:09
sdakefinanceMann if the answer is no you probably need that, although I still don't do windows :)00:09
inc0virtualbox addons?00:09
inc0for qemu?00:09
financeManni just spun up virtualbox, threw in the iso, configured stuff and then uploaded the image to openstack00:09
alopfinanceMann: maybe try that again, but change your storage controller to SCSI?00:09
financeMannSCSI on virtualbox?00:10
inc0financeMann: https://wiki.gentoo.org/wiki/QEMU/Windows_guest00:10
inc0try to create image like described there00:10
alopjust a thought, because I'm thinking your installed OS is looking for a certain device path that no longer exists00:10
sbezverksdake: it appears there are two fixes needed to be backported to newton for inspector.. could you backport them please?00:10
inc0sbezverk: need a bug00:10
inc0and a patch00:11
inc0do you have bug and a patch?00:11
sbezverkinc0: they are already in master, let me get bug and ps00:11
inc0so, find the review00:11
inc0it was merged with00:11
inc0click cherry-pick button00:11
inc0and cherry pick it to both ocata and newton00:11
sbezverkinc0: it does not work, there is merge conflict00:12
sbezverk#165034500:12
inc0you need to resolve it then;)00:12
*** lamt has joined #openstack-kolla00:12
alopfinanceMann: caveat, I'm not a windows user, but if my linux guest had in fstab that /dev/sda3 was the rootfs, but with a new subsystem, it actually shows up as /dev/vda3, that would cause similar issues00:12
sbezverk162445700:12
sdakesbezverk use cherrypick -x to cherrypick it00:12
sbezverksdake: I tried but it does not work with two cherry-picks00:13
sdakedo one at a time00:13
sdakeas separate patches00:13
sdakein separate repositories00:13
sdakein separate directories on yoru harddisk00:13
sdakeproblem solved ;-)00:13
sbezverksdake: I thought you wanted to see ironic working, maybe it could be good contribution from you ;)00:14
sdakesbezverk some day you will need to learn how to use a manual cherrypick - if you want me to do that work for you now please link the bugs00:14
sdakei was working on fixing the fact that kollakube is broken00:14
sdakehowever i have not yet learned how to type on two keyboards at once00:15
sdakemaybe oneday when we all jack into the matrix that will be possible ;)00:15
alopsdake: sounds like something out of Swordfish00:15
inc0moving home, ttyl guys00:16
sbezverksdake: nvm that fix does not work, so no need to backport it00:17
sdakesbezverk when you have a specific bug id, please let me know, and I'll cherrypick it for you if need be00:17
sbezverksdake:  #1650345  1624457 supposed to fix the issue but it does not seem to be the case00:20
sdakelets start with what is the issue00:20
sbezverksdake: http://paste.openstack.org/show/601025/00:22
sdakesbezverk can you please link the bugs you think fix it rather then giving me bug ids - I have launchpad fatigue00:24
sdakelooks to me as though the container is missing sudo privileges for rootwrap00:24
sdakewhich is easy to resolve00:24
sdakehttps://ubuntuforums.org/archive/index.php/t-1401055.html00:25
sbezverksdake: https://review.openstack.org/#/c/439882/00:25
*** schwicht has joined #openstack-kolla00:26
sdakesbezverk are ou doing binary or source?00:27
sdakesbezverk i thought it was source only00:27
sdakeThis change adds a second sudoers file that will work for the binary00:27
sdake    install type, and installs the correct sudoers file for the install00:27
sdake    type.00:27
sdake    Change-Id: I8ecd0b658b8df8f38ddf717fa9443d4dc289698400:27
sdake    Closes-Bug: #162445700:27
openstackbug 1624457 in kolla newton "iptables -N ironic-inspector returned non-zero exit status 1" [Critical,New] https://launchpad.net/bugs/162445700:27
*** jtriley has joined #openstack-kolla00:28
openstackgerritCharlie Kang proposed openstack/kolla-ansible master: Etcd fails to start - missing environment parameter  https://review.openstack.org/43993700:28
*** Mannheom has quit IRC00:28
*** Manheim has quit IRC00:28
sdakesbezverk you can't cherrypick two patches into one00:29
sdakethat isn't permitted by the stable policy00:29
sdakeeach one has to be cherrypicked individually00:29
sbezverksdake: I think that change actually broke source00:30
sdakethat is entirely possible00:30
*** gfidente|afk has quit IRC00:30
sdakelet me look at master00:30
*** lamt has quit IRC00:31
sbezverksdake: it is in the master but who tested source ;) ?? after this change00:31
sdakesbezverk no idea00:32
sbezverksdake: I guess instead of no 2 fixes into 1 cherry pick, or before that, the stable policy should say NO COMMIT non-tested change00:33
*** jtriley has quit IRC00:33
*** manheim has joined #openstack-kolla00:34
*** sdake has quit IRC00:36
*** Pavo has quit IRC00:37
*** tovin07 has joined #openstack-kolla00:38
financeManninc0 alop i’m hoping this helps http://ask.cloudbase.it/question/1227/nano-server-wont-boot/00:40
financeManndoes that change simply require a deploy or just a reconfigure?00:40
*** sdake has joined #openstack-kolla00:42
sdakesbezverk plz revert the patch locally and test with it reverted00:43
sdakeif the revert works, i'll revert it in master and reopen the bug00:43
sdakegit revert ef971bff5135b88e3451eb451418327e672f6d8b is how you would do that00:43
*** rhallisey has quit IRC00:46
sbezverksdake: that is what I am doing it right now00:47
*** duonghq_ is now known as duonghq00:47
sdakesbezverk good to hear - let me know and I'll get back to doing what I was doing :)00:47
sdakeduonghq sup dude00:47
sdakeduonghq we have a new project from this morning's meeting00:47
sdakeduonghq https://etherpad.openstack.org/p/kolla-kubernetes-deploy-guide-BP00:48
* duonghq reading 00:48
duonghqsdake, seem interesting00:51
sdakewe need a dev env docs (have that) and a deployment doc (that is what this is)00:52
duonghqsdake, at this level of details?00:52
sdakeduonghq yup00:52
sdakeduonghq our docs are totally out of date, they need complete rework - and the best way to rework them is to start over ;)00:53
duonghqgot it00:53
sdakeminus the dev env00:53
sdakethe dev env docs are gtg00:53
*** krtaylor has joined #openstack-kolla00:53
*** cuongnv has joined #openstack-kolla00:56
*** cuongnv has quit IRC00:56
*** cuongnv has joined #openstack-kolla00:57
financeMannHow do I create a volume through kolla? I am not seeing the option01:00
financeMannit looks like my windows 10 instance has no volumes01:00
duonghqfinanceMann, what do you mean?01:01
*** crushil has joined #openstack-kolla01:03
*** daidv has joined #openstack-kolla01:04
financeMannduonghq a fella in openstack said No Volumes attached -> http://imgur.com/a/TLjOM01:04
financeMannas an issue01:04
financeMannif ya look at the config01:04
bpattewardunonghq Hi01:05
alopfinanceMann: you don't exactly need volume attached01:06
bpattewarduonghq hi01:06
duonghqI think you should create volume in openstack, it's OpenStack stuff01:06
duonghqbpattewar, hey there01:06
alopthat is an additional block device from the cinder service01:06
alophowever, you'll notice that your root device is 60GB01:06
alopthat should suffice01:06
alopin the UI, you can create a volume, and then attach it to an instance01:07
alophowever it's not a prerequisite01:08
bpattewarduonghq I updated all the heat patches, now how to to test them on gate ?. I tried to test them locally but faced issue with configmaps,01:08
duonghqbpattewar, sorry, I need few minutes for warm up01:09
duonghqand write today IRC meeting report01:09
bpattewarduonghq ok, when we can catch up?01:10
duonghq20mins?01:11
duonghqlast week I help my colleague to deploy and test ceilometer upgrade in Kolla, so cannot doing much on Heat :(01:12
bpattewarduonghq ok, lets chat after 20 min.01:13
openstackgerritSteven Dake proposed openstack/kolla-kubernetes master: Add etc/kolla_kubernetes to installed directories  https://review.openstack.org/43994101:17
sdakesup bpattewar01:17
duonghqbpattewar, can you update your ps according to Steve comment? https://review.openstack.org/#/c/414825/01:18
bpattewarduonghq I will update it01:20
bpattewarsdake I am doing good, done with heat patches, I am looking for how I can test it ?01:21
sdakebpattewar right - testing is the hard part01:21
sdakebpattewar firsty ou need the gate to be green01:21
*** caowei has joined #openstack-kolla01:21
sdakebpattewar then can do testing next01:21
sdakebpattewar the gate has a bunch of red in it01:21
sdakebpattewar that needs to be fixed01:22
*** zhubingbing_ has joined #openstack-kolla01:22
sdakesup zhenguo01:22
sdakesup zhubingbing_01:22
zhubingbing_hi sdake01:22
bpattewarsdake the code is split in 3 patches and I feel that's the reason patches are failing, how to merge 3 patches01:22
*** jtriley has joined #openstack-kolla01:22
sdakebpattewar git rebase -i01:23
sdakebpattewar first make a backup of your repo01:23
sdakebpattewar where is your repoistory located?01:23
bpattewarmy desktop (locally)01:24
sdakeright, so where on your disk (path)01:24
sdakebpattewar i'll walk you through the steps - its pretty easy01:24
bpattewarsdake  /home/bpattewa/kolla-kubernetes/01:25
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855601:27
*** jtriley has quit IRC01:27
sdakebpattewar do this - cp -aR /home/bpattewa/kolla-kubernetes /home/bpattewa/kolla-kubernetes.bak01:27
sdakecd ~/kolla-kubernetes01:27
sdakegit rebase -i01:27
*** jtriley has joined #openstack-kolla01:28
openstackgerritBalaji G Pattewar proposed openstack/kolla-kubernetes master: Helm charts for heat/heat-cfn create user and endpoints.  https://review.openstack.org/41482501:28
bpattewarsdake after rebase ?01:29
sdakeyou should see 3 lines01:29
sdakecan you paste them in a paste service01:29
sdakezhubingbing_ - we are collaborating on the docs01:29
zhubingbing_ok01:30
sdakeetherpad is here: https://etherpad.openstack.org/p/kolla-kubernetes-deploy-guide-BP01:31
sdakebpattewar ok the steps are as follows: 1. make a backup, 2. git rebase -i, 3. paste output of the screen that git rebase -i presents01:32
sdakebpattewar once you paste, I'll provide further instruction from there01:32
*** jtriley has quit IRC01:33
*** Pavo has joined #openstack-kolla01:34
*** alop has quit IRC01:35
*** Pavo has quit IRC01:39
*** adrian_otto has quit IRC01:44
*** jrobinson is now known as jrobinson-afk01:48
*** duonghq has quit IRC01:59
*** manheim has quit IRC02:00
*** sayanta__ has quit IRC02:01
*** jrobinson-afk is now known as jrobinson02:02
*** duonghq has joined #openstack-kolla02:03
duonghqsomething happen with my box, so docker refuses to restart02:04
openstackgerritBalaji G Pattewar proposed openstack/kolla-kubernetes master: Helm charts for heat/heat-cfn create user and endpoints.  https://review.openstack.org/41449602:05
*** manheim has joined #openstack-kolla02:06
sdakeduonghq there is always the rm -rf /var/lib/docker option02:06
sdakethat will make docker start properly02:06
sdakeduonghq you ahve to stop docker first, the ndo that02:06
sdakezhubingbing_ if your running through that etherpad, please leave notes02:07
duonghqsdake, it's also refuses to stop02:07
sdakeduonghq kill -9 :)02:07
duonghqit's always a option02:07
duonghqjust wonder why docker refuses to stop/restart02:08
zhubingbing_ok02:08
zhubingbing_sorry02:08
sdakezhubingbing_ if you do plan to contribute to that doc, plz add your name to the contributors02:08
sdakeso we can add the appropriate co-author lines02:08
sdakezhubingbing_ and also watch the video plz :)02:09
zhubingbing_of cause02:09
zhubingbing_i add my name to contributors02:09
*** sdake_ has joined #openstack-kolla02:10
*** goldyfruit has joined #openstack-kolla02:12
*** sdake has quit IRC02:13
*** bpattewar has quit IRC02:14
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855602:19
*** MasterOfBugs has quit IRC02:20
*** unicell has quit IRC02:20
*** jtriley has joined #openstack-kolla02:22
*** goldyfruit has quit IRC02:23
*** goldyfruit has joined #openstack-kolla02:23
*** Margin has joined #openstack-kolla02:25
portdirectsdake_: just watched the video, nice work! :)02:26
*** schwicht has quit IRC02:26
Marginhi , I use kolla on centos7,  I found kolla-ansible need python jinja2 > 2.8 , but If I install ansible rpm with python jinja 2.7 , how do I solve this issue ?02:26
*** goldyfruit has quit IRC02:26
sdake_portdirect thanks although it was a team effort ;)02:26
*** goldyfruit has joined #openstack-kolla02:26
*** manheim has quit IRC02:27
*** jtriley has quit IRC02:27
*** jtriley has joined #openstack-kolla02:27
portdirectthat was bifrost doing the ironic legwork?02:27
portdirectneed to look at it again02:27
sdake_indeed02:28
*** sdake_ is now known as sdake02:28
financeMannI need to set some nova-compute nova.conf options specifically  cpu_mode=host-passthrough and virt_type = kvm Where do I do that with kolla?02:28
sdakeportdirect assumign your tlak gets accepted for summit, I'd hope you can use some of that in your presentation :)02:28
financeMannI tried setting them in nova.conf but a reconfigure blows them away02:28
portdirect+1 to that :)02:28
portdirectnow we just need a multinode and its gravy :)02:29
sdakeyup - i have the hardware - not sure the software is ready to rock for it:)02:29
duonghqhope that somebody can make it roll https://review.openstack.org/#/c/439402/02:29
sdakesbezverk ^^02:29
sdakeduonghq gate is failing02:30
duonghqubuntu gate is busted for awhile02:30
sdakeduonghq roger02:30
sdakeduonghq does ubuntu work?02:30
portdirectthink talk schedule is published next week?02:31
sdakeportdirect thats the word on the street02:31
financeManndo I put changes to nova.conf jsut anywhere in globals.yml preappended with nova_?02:31
sdakeportdirect atleast notifications will be given next week02:31
sdakeportdirect when the talks are actually scheduled may take longer02:31
duonghqsdake, it doesn't relate to distro, just ansible/yaml matter02:32
sdakeportdirect sorting out the new ptg/summit mix is a new thing for everyone02:32
sdakeportdirect its not like turning the crank in years past02:32
portdirectcool - yeah logistics for that is a nightmare02:32
*** jtriley has quit IRC02:32
sdakei did see next summit is in vancouver02:32
sdakeafter australia02:32
sdakeno idea where the ptgs are02:32
portdirectI'm taking my bike - gonna hit up the shore - been meaning to do that for over 10 years :)02:33
portdirect(vancouver north shore)02:33
sdakeportdirect sounds good - although I am not much of a bike rider :)02:33
duonghqthanks02:34
portdirectare the scripts for that deployment anywhere - it went a bit fast but ironic provisioned kube?02:34
sdakeportdirect thtas how it worked02:34
sdakeportdirect ironic folks did that part of the video02:35
sdakeportdirect i don't know where their work is that automated all that, so I'll be sorting that out as we finish the deployment workflow02:35
sdakeas I said team effort02:35
portdirectI'll need to rewind but was it via cloud-init/metadata or ansible playbook?02:36
portdirecteither way looks interesting02:36
sdakeironic is a playbook02:36
sdakethe images were baked02:36
sdakewe are in the process of unbaking them now so that workflow can be documented in kolla-kubernetes02:36
*** harry_liu has joined #openstack-kolla02:37
sdakethe first openstack-sig helm meeting went well02:37
sdakealthough I won't be able to attend in the future02:38
sdakefor the 2nd half hour02:38
sdakei have a conflict - and I can't ask 40 people to move a meeting for me, and i can't ask 15 people to move a meeting for me02:38
sdakebeing on two calls at once is rude02:38
sdakeand I'll not be doing that again02:38
portdirectlol - its pretty comedy though02:38
sdaketwo calls at once?  - yah I should have had my wife take a picutre02:39
sdakelistening through two ears to two convos - painful02:39
sdakei preferred the wednesday slot - i think that worked for everyone02:39
sdakealthough v1k0d3n seemed to want  to keep it to the new tuesday meeting02:40
sdakeanyway my thai 5 stars hot is here02:40
sdaketime to eat!02:40
portdirect gutted I missed it, but was doing another long commute - have a good one man02:41
*** tonanhngo has joined #openstack-kolla02:42
v1k0d3n@sdake just didn't know if there was a real need to change the meeting times if we already had a reoccurring time set up. not sure about others, but times slots on my end are a real premium.02:43
sdakev1k0d3n same story with everyone02:44
sdakev1k0d3n is what is is - like i said I can't ask two separate large groups to change the meeting slots02:44
sdakemaybe someone  else can - but I don't  roll that way02:44
v1k0d3nyeah more norm than not lately for everyone.02:44
sdakeanyway dinner time02:44
*** harry_liu has quit IRC02:45
sdakeportdirect the meeting was recorded - should check that out when you have a chance02:45
*** harry_liu has joined #openstack-kolla02:45
v1k0d3nWhat meeting are we tr talking about again? I may have missed context.02:45
portdirecti think openstack-sig?02:46
*** tonanhngo has quit IRC02:46
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Test gate  https://review.openstack.org/43995502:47
v1k0d3nportdirect...Ah...Gotcha.02:47
v1k0d3nNot sure that has to be a perm meeting for us thoigh, does it?02:47
*** britthouser4 has quit IRC02:49
*** yee379 has quit IRC02:49
financeMannsdake if i want to update /etc/kolla/nova-compute/nova.conf attributes what file do I set those in? global.xml or ?02:50
financeManneverythign I sett seems to get overriden by a reconfigure02:50
*** britthouser5 has joined #openstack-kolla02:50
*** britthouser has joined #openstack-kolla02:50
*** britthouser has quit IRC02:50
*** yee379 has joined #openstack-kolla02:50
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Test gate  https://review.openstack.org/43995502:50
*** britthouser5 has quit IRC02:51
*** britthouser has joined #openstack-kolla02:51
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855602:53
Marginhello, I open a bug https://bugs.launchpad.net/kolla/+bug/166922902:59
openstackLaunchpad bug 1669229 in kolla "Unable to find '/etc/kolla/config/swift/account.builder" [Undecided,New]02:59
sdakev1k0d3n i don't think anything is permanent02:59
sdakev1k0d3n as to the length of the wg, I think it will run for as long as people show interest03:00
sdakev1k0d3n just like anything else03:00
sdakefinanceMann that is documented03:00
sdakefinanceMann moment03:00
financeMannhttps://docs.openstack.org/developer/kolla-ansible/deployment-philosophy.html#kolla-s-solution-to-customization03:00
financeMann?03:00
financeMann“To achieve this result, simply modify the file /etc/kolla/config/nova/nova-compute.conf and add the contents:"03:00
financeMannThat path doesn’t exist.03:00
sdakefinanceMann yup thats how you customize03:00
sdakeyou have to mkdir -p /etc/kolla/config/nova03:00
financeMannOH03:01
sdakeand instead of nova-compute.conf its just nova.conf03:01
sdakei'll fix that error, thanks for pointing it out03:01
financeMannso I need to “mkdir -p /etc/kolla/config/nova” and then make a file in that folder called nova.conf and place the overrides there?03:01
sdakeyup03:01
sdakemake sure to put the ini headers03:02
sdakesuch as [libvirt] or whatever03:02
financeMannThank you i would have never put that in there03:03
financeMannand scratch my head for hours03:03
financeMannls03:03
sdakefinanceMann yup but you found it :)03:03
sdakefinanceMann do you have an email address - I can add you as a coauthor since you found the problem03:06
sdakefinanceMann (the one you registered with the foundation)03:06
financeMannwhats the foundation url03:06
financeMannampopp04@gmail.com03:06
financeMannthat should be correct03:06
sdakeopenstack.org03:06
openstackgerritDavid Moreau Simard proposed openstack/kolla-ansible master: Do not merge: Test ARA 0.12.0rc1  https://review.openstack.org/43996303:07
*** dave-mccowan has joined #openstack-kolla03:07
sdakefinanceMann can you register with the foundation - or I can't add you as a coauthor - gerrit will reject it03:07
financeMannone second03:08
sdakesometimes its a bit tricky - I can walk you through it if you like03:09
sdakehowever on the plus side you will be able to fix these problems you find in the future on your own03:09
financeMannsdake all done03:12
duonghqdon't know why ara make only ubuntu gate failed03:12
financeMannaccount should be verified sdake03:12
financeMannsdake I set the config where ya said and it still blew them away when i did reconfigure. The attributes are gone at /etc/kolla/nova-compute/nova.conf even though I have the overrides specified at /etc/kolla/config/nova/nova.conf03:17
sdakehmm try /etc/kolla/config/nova.conf03:17
sdakefinanceMann did you sign the CLA for the foundation?03:18
sdakefinanceMann what is your profile id?03:18
financeMann8381403:18
financeMannls03:18
financeMannsdake “THE OPENSTACK FOUNDATION INDIVIDUAL MEMBER AGREEMENT (Signed: March 02, 2017)"03:20
sdakefinanceMann nice statement of interest :)03:20
*** jtriley has joined #openstack-kolla03:21
*** sp_ has joined #openstack-kolla03:22
sdakefinanceMann yup03:22
openstackgerritSteven Dake proposed openstack/kolla-ansible master: philosophy example on customization is incorrect  https://review.openstack.org/43997003:22
sdakefinanceMann check out that erview by clicking on it03:23
sdakefinanceMann and test it plz - I am not setup for kolla-ansible dev atm as my machines are loaned out03:23
sdake(or being used by me)03:24
financeMannsdake sounds good, how do i test website changes like that? Easy way to deploy/test it?03:26
*** goldyfruit has quit IRC03:26
sdakefinanceMann just make sure it works as documented would be gefn :)03:26
financeMannoh gotcha, test the description ya set03:26
*** jtriley has quit IRC03:26
sdakeif you click the file deployment-philosphy.rst03:27
*** jtriley has joined #openstack-kolla03:27
sdakeit will show you the changes03:27
financeMannit needs to be a file in “/etc/kolla/config/nova.conf03:27
financeMannsounds good03:27
financeManni’ll check03:27
sdakei think thats right03:27
sdakeworth a shot03:27
financeMannya i just verified it03:27
sdakeif it works for you +1 the patch plz03:27
sdakethat way other cr's know its gtg03:27
financeMannsdake perfect03:28
financeManni verified and double checked your review03:28
sdakeenjoy :)03:28
financeMannsounds good03:28
financeMannsdake where is the +1 button03:30
financeMannsdake http://imgur.com/a/8Jy1O my account prolly needs approval03:31
financeMannor something03:31
*** jtriley has quit IRC03:32
*** erlon has quit IRC03:35
duonghqfinanceMann, around?03:37
financeMannsup03:37
financeMannbarely03:37
financeMannduonghq03:38
duonghqdid you try /etc/kolla/config/nova/nova-compute.conf file?03:38
duonghqjust create this file03:38
*** unicell has joined #openstack-kolla03:38
*** unicell has quit IRC03:38
duonghqand put the libvirt config here03:38
sdakeduonghq the docs are wrong  Ithink03:38
sdakeduonghq hence my patch03:38
duonghqsdake, iirc, I can make the conf come in with the original doc03:39
duonghqsdake, financeMann I have a meeting now,03:39
duonghqsorry guys03:39
financeMannk03:39
*** Margin has quit IRC03:46
sdakeI see CNCF considering introducing Zuul into their projects03:50
sdakepretty sweet03:50
sdakezuul = winning03:50
sdakehey folks, if your interested in cross-project collab with other deployment projects, please join #openstack-deployment03:56
sbezverksdake: just got results, that PS in fact breaks source04:06
sdakesbezverk i was just getting ready to hit the sack04:06
sdakesbezverk that patch needs reverting then04:06
sbezverksdake: let's do it tomorrow04:07
sp_sdake: +1 for #openstack-deployment04:07
sdakesbezverk bit tired, mind linking the bug to me again so I can geti t fixed04:07
sbezverkafter chatting with mgoddard04:07
sdakesp_ it was shardy's idea04:07
sp_sdake: roger04:07
sdakesbezverk running out of time for the release04:07
sdakesbezverk although yo uwake up earlier then i do - I'd recommend a revert followed by fixing it correctly whatever that may be04:08
sdakesbezverk link the bug so I can reopen it plz04:08
*** sudipto has joined #openstack-kolla04:10
*** sudipto_ has joined #openstack-kolla04:10
sdakesbezverk we can sort out what to dow ith it in the morning - although it needs reopening now04:10
sbezverkhttps://bugs.launchpad.net/kolla/+bug/162445704:10
openstackLaunchpad bug 1624457 in kolla newton "iptables -N ironic-inspector returned non-zero exit status 1" [Critical,New]04:10
sdakethanks04:10
sdakeits already open?04:10
sbezverkit is fixed in master04:10
sdakemaster source works?04:11
sbezverkcannot test, do not have master gates04:11
sdakeneed those04:11
sbezverkthere is limitted amount of things I can do04:12
sbezverksomebody needs to start contributing too04:12
sdakesbezverk i wasn't suggesting you do it04:12
sdakeI was stating it as something that needs to be done :)04:12
sdakesbezverk everyone contributes in their own ways04:13
sbezverkanyway I am off for now. talk to you tomorrow04:13
sdakeenjoy - i am off too04:13
sdakeportdirect hope you enjoyed the video - night :)04:13
duonghqnight sdake04:14
duonghqsbezverk,04:14
*** dave-mccowan has quit IRC04:16
*** mdnadeem has joined #openstack-kolla04:17
*** sayantan_ has joined #openstack-kolla04:18
sp_good night sdake sbezverk04:20
*** jtriley has joined #openstack-kolla04:21
*** Margin has joined #openstack-kolla04:23
inc0good evening everyone04:27
*** Margin has quit IRC04:28
*** Margin has joined #openstack-kolla04:29
*** sudipto_ has quit IRC04:30
*** sudipto has quit IRC04:30
*** Jeffrey4l has joined #openstack-kolla04:32
sdakesay when you have a chance have a look at \04:34
*** jrobinson is now known as jrobinson-afk04:35
*** adrian_otto has joined #openstack-kolla04:37
*** jtriley has quit IRC04:42
*** adrian_otto has quit IRC04:54
*** daidv has quit IRC04:57
*** crushil has quit IRC04:57
*** lamt has joined #openstack-kolla05:02
*** lamt has quit IRC05:05
*** sdake has quit IRC05:08
*** harry_liu has quit IRC05:09
*** sayantan_ has quit IRC05:19
*** jtriley has joined #openstack-kolla05:19
*** skramaja has joined #openstack-kolla05:21
*** jtriley has quit IRC05:28
*** harry_liu has joined #openstack-kolla05:30
*** daidv has joined #openstack-kolla05:31
*** daidv has quit IRC05:39
*** unicell has joined #openstack-kolla05:44
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Update the file format for baremetal  https://review.openstack.org/43785805:46
*** jrobinson-afk is now known as jrobinson05:56
*** daidv has joined #openstack-kolla06:00
openstackgerritDuong Ha-Quang proposed openstack/kolla-ansible master: Fix Ceilometer cannot create MySQL database  https://review.openstack.org/43883806:05
*** trinaths has joined #openstack-kolla06:06
*** sayantan_ has joined #openstack-kolla06:19
*** saneax-_-|AFK is now known as saneax06:26
sp_operation got stuck after this message TASK [kube-join : join workers to the initialized kubernetes cluster] **********06:44
sp_skipping: [kube1]06:44
sp_I run the command "vagrant up"06:44
*** salv-orlando has joined #openstack-kolla06:45
sp_all the kubes[1-4]has been started06:45
sp_but operation not able to process after this06:45
sp_if anyone can help06:45
sp_???06:45
sp_hoping the response from portdirect06:46
*** zhurong has joined #openstack-kolla06:47
*** unicell has quit IRC06:51
*** unicell has joined #openstack-kolla06:51
*** salv-orl_ has joined #openstack-kolla06:52
*** saneax is now known as saneax-_-|AFK06:52
*** zhurong has quit IRC06:53
*** salv-orlando has quit IRC06:55
*** sudipto_ has joined #openstack-kolla06:56
*** sudipto has joined #openstack-kolla06:56
portdirectYo! :)06:57
sp_portdirect: hi...06:58
portdirectSo skipping kube1 for joining cluster is normal06:58
portdirectAs it should be the master node06:58
portdirectBut getting stuck is not :(06:59
sp_portdirect: yes skipping kube106:59
portdirectCan you post full logs to a pastebin?06:59
sp_portdirect: yes, sure06:59
*** sudipto_ has quit IRC07:00
*** sudipto has quit IRC07:00
portdirectSweet07:00
sp_portdirect: give me a minute07:00
portdirectWill have to vanish in 15, for a bit but let's see if we can sort you out before then :)07:01
*** saneax-_-|AFK is now known as saneax07:02
sp_portdirect:  seems like my scrolling tab is stopped07:03
sp_only below logs available07:03
sp_}07:03
sp_TASK [kube-join : stat for existing kubelet config] ****************************07:03
sp_ok: [kube2]07:03
sp_ok: [kube1]07:03
sp_ok: [kube3]07:03
sp_ok: [kube4]07:03
sp_TASK [kube-join : join workers to the initialized kubernetes cluster] **********07:03
sp_skipping: [kube1]07:03
sp_portdirect:  in next time I will send you in mail with complete log07:04
sp_in next time installation*07:04
portdirectAll good, if you put them at paste.openstack.org then we can get more eyes on them07:05
*** Margin has quit IRC07:06
portdirectI'd try a vagrant destroy and vagrant up again. But with nothing more to go on can't be much help ATM :( Hope it works out for you :)07:06
*** Margin has joined #openstack-kolla07:06
sp_portdirect:  already tried many times07:07
sp_:(07:07
portdirect:( that sucks. If you get a paste with the exact commands and output you are running that would really help07:11
portdirectI'll be out of comma for a few hours, but hopefully someone else here will be help. Though I'll def look at them when I can.07:12
portdirectS/comma/comms07:12
*** trinaths has quit IRC07:17
*** saneax is now known as saneax-_-|AFK07:24
sp_portdirect:  i will see07:26
sp_and let you know07:26
*** saneax-_-|AFK is now known as saneax07:32
*** zhugaoxiao has joined #openstack-kolla07:34
*** sayantan_ has quit IRC07:36
*** bmace has quit IRC07:43
*** bmace has joined #openstack-kolla07:44
*** jrobinson has quit IRC07:46
*** Serlex has joined #openstack-kolla07:50
*** unicell has quit IRC07:53
openstackgerritzhubingbing proposed openstack/kolla master: Add python-pankoclient to panko  https://review.openstack.org/44018007:57
zhubingbing_hello guys07:59
*** magicboiz has quit IRC08:04
*** shardy has joined #openstack-kolla08:04
*** matrohon has joined #openstack-kolla08:04
*** athomas has joined #openstack-kolla08:07
*** pcaruana has joined #openstack-kolla08:13
*** jtriley has joined #openstack-kolla08:16
*** jtriley has quit IRC08:20
*** mnasiadka has joined #openstack-kolla08:21
*** zioproto has joined #openstack-kolla08:22
*** harry_liu has quit IRC08:27
*** harry_liu has joined #openstack-kolla08:27
*** kklimonda_ has joined #openstack-kolla08:29
*** kklimonda_ is now known as kklimonda^08:29
*** matrohon has quit IRC08:34
*** DFFlanders has joined #openstack-kolla08:41
openstackgerritDavid Rabel proposed openstack/kolla-ansible master: Fixed some tox errors in docs  https://review.openstack.org/44021108:41
*** trinaths has joined #openstack-kolla08:41
*** nathharp has joined #openstack-kolla08:42
*** egonzalez has joined #openstack-kolla08:42
*** rmart04 has joined #openstack-kolla08:44
*** rmart04 has quit IRC08:48
*** papacz has joined #openstack-kolla08:50
*** sdake_ has joined #openstack-kolla08:52
*** rmart04 has joined #openstack-kolla08:57
*** harry_liu has quit IRC08:58
*** harry_liu has joined #openstack-kolla08:59
*** shardy has quit IRC09:04
*** shardy has joined #openstack-kolla09:04
*** Manheim has joined #openstack-kolla09:05
*** Mannheom has joined #openstack-kolla09:05
openstackgerritDavid Rabel proposed openstack/kolla-ansible master: Fixed some tox errors in docs  https://review.openstack.org/44021109:05
openstackgerritDavid Rabel proposed openstack/kolla-ansible master: Fixed some tox errors in docs  https://review.openstack.org/44021109:06
hrwciting my wife: I vomitted on ML about jenkins tests09:13
*** rabel_b1 has joined #openstack-kolla09:13
berendtrabel_b1: hola09:14
rabel_b1berendt: hi09:14
rabel_b1my question from the other room again:  jeffrey4l : would you mind to open https://bugs.launchpad.net/kolla-ansible/+bug/1669075 again? At least until someone gives a comment in the bug why this is not a bug. Because in my opinion it is, as I said there.09:17
openstackLaunchpad bug 1669075 in kolla-ansible "kolla-ansible pull with kolla_ansible-4.0.0.0rc1 fails, because of missing tag in docker registry" [Undecided,Invalid]09:17
berendtrabel_b1: it is not a bug, we have not yet released 4.0.0, because of that you cannot find images on docker hub09:18
berendtdeployment with master will never work with images from docker hub, you have to build your own set of images or you have to use stable branch09:18
rabel_b1berendt: installing kolla-ansible with pip (like suggested in the docs) gives me 4.0.0rc1 . so the deployment does not work as explained in the docs.09:21
berendtrabel_b1: you can find prebuild images of the last successful commit on master at http://tarballs.openstack.org/kolla/images/09:21
rabel_b1this is either a bug in the docs or in kolla-ansible itself09:21
sdake_rabel_b1 i can explain that for you09:22
sdake_rabel_b1 moment let me read the bug in more detail09:22
sdake_rabel_b1 kolla's general policy is to push images to dockerhub per tag09:23
sdake_rabel_b1 we don't have any infrasturcture to do this work; it is completely a volunteer effort much like kolla itself is09:24
sdake_rabel_b1 however we have to find specific volunteers tod othe pushing09:24
sdake_we push only on released tags, not on release candidate tags09:24
sdake_rabel_b1 I suppose we could change this to release release candidates on docker hub, although we would need ot find someone to do that pushing09:25
sdake_rabel_b1 we struggle to find anyone to push the images for the tags at all09:25
*** Jeffrey4l has quit IRC09:25
*** Jeffrey4l has joined #openstack-kolla09:25
rabel_b1sdake: thank you for the explaination.09:27
berendtsdake_: i can make a regular push of ubuntu-source images09:28
sdake_berendt see bug information09:29
berendtsdake_: do we have a list who pushes which images at the moment?09:29
sdake_berendt i'm adding topic to the agenda to discuss this issue for next meeting09:29
berendtsdake_: let's add it to the nex meeting09:29
berendt;)09:29
sdake_https://bugs.launchpad.net/kolla-ansible/+bug/1669075/comments/409:29
openstackLaunchpad bug 1669075 in kolla-ansible "kolla-ansible pull with kolla_ansible-4.0.0.0rc1 fails, because of missing tag in docker registry" [Low,Confirmed]09:29
*** zioproto has quit IRC09:30
*** Jeffrey4l has quit IRC09:31
sdake_rabel_b1 see https://wiki.openstack.org/wiki/Meetings/Kolla#Agenda_for_next_meeting_.28Mar_1st_2017.2909:31
sdake_rabel_b1 rather https://wiki.openstack.org/wiki/Meetings/Kolla#Agenda_for_next_meeting_.28Mar_8th_2017.2909:32
sdake_berendt portdirect has a script which containerizes the push workflow09:32
sdake_berendt however, it is incomplete - it only pushes master, not the tags on tagging nor the nightlies09:33
berendtsdake_: i have something similiar in my jenkins to make daily builds of our custimised packages09:33
* portdirect hides09:33
berendti rebuild the latest pushed tag once a day09:33
sdake_portdirect mind linking your repo for comedy effect ;)09:33
portdirectLol though berendts sounds better09:33
rabel_b1sdake_, berendt: thank you09:34
berendti am happy to share this on a public repo09:34
*** zioproto has joined #openstack-kolla09:34
portdirecthttps://github.com/portdirect/kolla-cron-builder09:34
berendtlet's discuss this topic next meeting to first have a unified view on this topic09:34
sdake_teh real problem is this work isn't in openstack-infra09:34
berendtafterwards we can discuss how to implement this09:34
sdake_if it were, then we would be set09:34
portdirectberendt: +109:34
sdake_berendt wfm :)09:34
sdake_berendt the commedy effect I was going for was this:09:35
sdake_useage09:35
sdake_Dont, but if you ran the install script already then you are already to late...09:35
berendtLol09:36
sdake_everyone wants images pushed, nobody really wants to own it09:36
sdake_including me09:36
*** zioproto has quit IRC09:36
portdirect:) my life is full of sketchy kickstarts09:36
*** zioproto has joined #openstack-kolla09:37
Marginhi , sdake, can you help me about https://bugs.launchpad.net/kolla/+bug/1669229 ?09:37
openstackLaunchpad bug 1669229 in kolla "Unable to find '/etc/kolla/config/swift/account.builder" [Undecided,New]09:37
sdake_people still asking me to mow the lawn for a house i sold t-8 months ago09:37
sdake_who are these crazy people :)09:37
sdake_i guess it was t-4 months ago09:38
sdake_feels like 8 months :)09:38
sdake_the correct answer is to get this work integrated into infra09:38
sdake_how to do that, I dont know09:38
sdake_i tried and tried and tried with infra and basically nobody there had time to deal with it or cared enoug habout it09:39
*** yingjun has quit IRC09:39
sdake_and nobody on the kolla team had enough time or energy to deal with it either09:39
*** hrw has quit IRC09:39
sdake_so i'm done ranting on the topic :)09:39
sdake_Margin what do you want me to do with that bug09:39
*** sdake_ is now known as sdake09:41
Marginhelp me to confirm whether it is a issue  .09:41
egonzalezMargin, have you followed doc process https://github.com/openstack/kolla-ansible/blob/master/doc/swift-guide.rst09:41
egonzalezrings must be created before deployment iirc09:42
*** Jeffrey4l has joined #openstack-kolla09:43
*** sp_ has quit IRC09:44
*** hrw has joined #openstack-kolla09:44
*** Margin has quit IRC09:46
*** Margin has joined #openstack-kolla09:47
*** Margin has quit IRC09:49
*** trinaths has quit IRC09:54
openstackgerritcaoyuan proposed openstack/kolla-ansible master: Fix Creating Panko MongoDB database failed  https://review.openstack.org/43840809:55
*** sp_ has joined #openstack-kolla09:56
*** manheim_ has joined #openstack-kolla09:56
*** manheim_ has quit IRC09:58
*** manheim_ has joined #openstack-kolla09:58
egonzalezJeffrey4l, did you get any error upgrading keystone about a duplicate Key name?09:59
Jeffrey4legonzalez, no. error logs/10:02
Jeffrey4l?10:02
egonzalezat db upgrade DBError: (pymysql.err.InternalError) (1061, u"Duplicate key name 'ixu_user_id_domain_id'") [SQL: u'ALTER TABLE user ADD CONSTRAINT ixu_user_id_domain_id UNIQUE (id, domain_id)']10:02
jmccarthyHmm anyone know where/why when building bifrost, it goes off to fetch this from github ?10:02
jmccarthyINFO:kolla.image.build.bifrost-base:^[[91m--2017-03-02 09:51:30--  https://raw.githubusercontent.com/ansible/ansible-modules-extras/stable-2.2/cloud/openstack/os_keystone_service.py10:02
jmccarthyINFO:kolla.image.build.bifrost-base:^[[0m10:02
jmccarthyINFO:kolla.image.build.bifrost-base:^[[91mSaving to: './scripts/../playbooks/library/os_keystone_service.py'10:02
jmccarthyINFO:kolla.image.build.bifrost-base:     0K ......                                                100% 87.7M=0s10:02
jmccarthyINFO:kolla.image.build.bifrost-base:^[[0m10:02
jmccarthyINFO:kolla.image.build.bifrost-base:^[[91m2017-03-02 09:51:30 (87.7 MB/s) - './scripts/../playbooks/library/os_keystone_service.py' saved [6224/6224]10:02
Jeffrey4lrabel_b1, sorry. i leaved one message there, just now.10:02
Jeffrey4legonzalez, never seen. could u reproduce this?10:03
*** cuongnv has quit IRC10:03
rabel_b1Jeffrey4l: no worries10:04
egonzalezJeffrey4l, redeploying again10:04
egonzalezJeffrey4l, can you create users in the upgraded keystone? in the past all worked fine except user creation10:05
jmccarthyErg ok yea .. I see it now in scripts/env-setup.sh10:06
*** daidv has quit IRC10:07
jmccarthyI see .. hrm seems to be if on < ansible 2.2 it will do that10:07
*** pbourke has quit IRC10:09
*** pbourke has joined #openstack-kolla10:10
*** tovin07 has quit IRC10:12
sdakefor our emea crew and all the crazy us folks that are up at this hour, if you are interested in cross project collaboration with other deployment tools please join #openstack-deployment10:13
Jeffrey4legonzalez, not sure. will check later.10:13
sdakealso for those interested in kolla-kubernetes, there is this documentation effort which includes a video inside:10:14
sdakehttps://etherpad.openstack.org/p/kolla-kubernetes-deploy-guide-BP10:14
Jeffrey4legonzalez, do u have logs?10:14
duonghqanybody has idea about Ubuntu gate failing in kolla-ansible? about the ara issue?10:17
*** sdake has quit IRC10:18
*** hachi has quit IRC10:19
*** duonghq has quit IRC10:21
*** sdake has joined #openstack-kolla10:22
sp_portdirect: pasted the completed logs for the issue of vagrant up  http://paste.openstack.org/show/601101/10:24
*** caowei has quit IRC10:24
egonzalezJeffrey4l, was that I created users while upgrading, database get lock and result in db inconsistencies10:25
egonzalezJeffrey4l, just for the interest error logs: http://paste.openstack.org/show/601105/10:36
egonzalezjust wondering if will be better to cut connections to db before db sync, otherwise if someone creates a resource in keystone db schema get broken10:36
*** sdake has quit IRC10:41
*** mgoddard has joined #openstack-kolla10:45
*** manheim_ has quit IRC10:49
*** manheim_ has joined #openstack-kolla10:50
*** DFFlanders has quit IRC10:51
*** manheim_ has quit IRC10:51
*** manheim_ has joined #openstack-kolla10:51
*** tovin07 has joined #openstack-kolla10:54
*** sambetts|afk is now known as sambetts10:59
*** shardy has quit IRC11:00
*** shardy has joined #openstack-kolla11:01
rabel_b1egonzales: I have a question regarding the workflow11:03
egonzalezrabel_b1, sup11:03
rabel_b1I just created a new bug ( https://bugs.launchpad.net/kolla-ansible/+bug/1669361 ) and submitted a change to that. but that seems to be wrong...11:04
openstackLaunchpad bug 1669361 in kolla-ansible " tox -e docs fails in stable/ocata, too" [Undecided,New] - Assigned to David Rabel (rabel-b1)11:04
rabel_b1i did not know, that it is possible to mark branches as affected in launchpad11:04
egonzalezrabel_b1, yep, already did it for you ;)11:05
egonzalezrabel_b1, https://bugs.launchpad.net/kolla-ansible/+bug/1669305 in target to series button11:05
openstackLaunchpad bug 1669305 in kolla-ansible pike "tox -e docs fails " [Medium,In progress] - Assigned to David Rabel (rabel-b1)11:05
rabel_b1egonzales: thanks. :) but for the future: how to do that?11:05
egonzalezrabel_b1, check above ^^11:07
rabel_b1egonzales: I can't find that on other bugs. Just target distribution or project11:07
manheim_hi, do i need kuryr if I only use docker containers for openstack services? for compute i use kvm VMs11:07
*** gfidente has joined #openstack-kolla11:08
egonzalezManheim, nope, just if want to use kuryr service11:08
manheim_well, i want to use it only if i have a need for it, and in this case i cannot see one11:08
egonzalezrabel_b1, it depends of what bug, if need to be backported probably have such target11:08
manheim_my take is that kuryr is for when i want to use openstack provisioned containers11:09
manheim_for neutron networks and fucntionality...11:09
manheim_please correct me if i'm wrong11:10
rabel_b1egonzales: honestly i don't understand that11:10
egonzalezManheim, yep11:10
*** sdake has joined #openstack-kolla11:12
egonzalezrabel_b1, what don't understand to explain a bit better?11:12
sdakesay - is this doc patch correct: https://review.openstack.org/#/c/439970/11:13
rabel_b1egonzales: If I have a bug in launchpad and i want to tell launchpad, which series it affects, how can i do it? as i understood what you said, there is the possibility to select the series under the target button, but not for every bug. i don't understand, why this is not available to any bug. launchpad cannot know, which bug has to be backported, before we tell it.11:15
*** ccesario has joined #openstack-kolla11:16
egonzalezsdake, both paths are correct. config/nova.conf will apply such changes to all nova services in all nodes, and config/nova/nova-compute.conf only to compute nodes11:17
sdakeegonzalez i see - the cat who tested it was changing things unrelated to nova-compute11:18
sdakefinanceMann ^^11:18
sdakeegonzalez since that is the only customization example I am aware of that is documented, perhaps we can just go with that and forget that per-service customization is a thing :)11:18
sdakefinanceMann was the co-authored-by individual11:19
sdakerabel_b1 re your question, I didn't see the full exchange, however, only the drivers team can target bugs to a specifi series iirc11:19
sdakerabel_b1 we have a pretty loose policy on who can join the drivers team - typically anyone interested in doing bug triage11:20
egonzalezsdake, I think so. Having globally applied will save us of a bunch of issues. BTW, we do not have a service customization doc with good examples11:20
sdakeegonzalez re globally applied, if we wish to enforce that in the codebase, we sould folow the standard deprecation policy11:21
sdakeegonzalez now would be a good time to get that kicked off :)11:21
pbourkehi Jeffrey4l, can you have another look at https://review.openstack.org/#/c/435023/ when you have time, thanks11:21
rabel_b1sdake: ah ok. thanks11:21
sdakeegonzalez if we don't want to apply that in the code, then we can just leave it as is for now and only document it in the philosophy document as our current docs are in shambles11:21
sdakeegonzalez although a customization document would solve this problem permanently11:22
rabel_b1sdake, egonzales: in the commit message of the backport, i use partial-bug then?11:22
sdakerabel_b1 nope you should do a straight cherrypick11:23
egonzalezrabel_b1, nope, code must be cherry-picked once master is merged11:23
rabel_b1yes, but the cherry-pick still has a commit message11:23
sdakerabel_b1 indeed it should :)11:23
rabel_b1;)11:23
rabel_b1but i just leave it as it is?11:24
egonzalezyep11:24
*** sp_ has quit IRC11:24
rabel_b1ok, thanks11:24
sdakerabel_b1 for correct tracking the bug should be  targeted to series however11:25
sdakerabel_b1 i don't know which bug you are backporting so I have no idea if it is or not :)11:25
egonzalezsdake, re globally, there are use cases when users want apply changes to all services, and others when changes target to specific services or nodes. I think in the code base nothing have to be changed11:25
rabel_b1sdake https://bugs.launchpad.net/kolla-ansible/ocata/+bug/166930511:25
openstackLaunchpad bug 1669305 in kolla-ansible pike "tox -e docs fails " [Medium,In progress] - Assigned to David Rabel (rabel-b1)11:25
sdakeegonzalez sounds good11:25
zhubingbing_egonzalez last time you said fluentd log  warn t I have solved11:27
sdakerabel_b1 i targeted to the proper series11:27
egonzalezzhubingbing_, solved rabbitmq warn, but still having warnings11:28
zhubingbing_i don't submmit11:28
zhubingbing_;)11:28
egonzalezhehe, though were talking about rabbit warns :D11:29
zhubingbing_I have not submitted my commit yet11:29
egonzalezcan someone acknowledge https://review.openstack.org/#/c/438188/ ?11:30
egonzalezzhubingbing_, thanks for look into that11:30
zhubingbing_ok11:32
sdakeegonzalez is that fluentd?11:35
zhubingbing_yes11:35
zhubingbing_it's is fluentd11:35
sdakenice11:36
sdakeneed that in kolla-kubernetes11:36
zhubingbing_i will do it11:36
sdakenice11:36
sdakethanks ;-)11:36
*** manheim_ has quit IRC11:38
sdakezhubingbing_ if you want a dev env, bmace and portdirect have done a great job implementing one using vagrant11:38
*** manheim_ has joined #openstack-kolla11:38
zhubingbing_ok11:38
sdakezhubingbing_ it is self-contained and doesn't permanently alter the state of the machine11:38
zhubingbing_i will study vagrant11:39
zhubingbing_very good11:39
zhubingbing_ok11:39
sdakezhubingbing_ rather then study vagrant11:39
sdakestudy this instead: https://docs.openstack.org/developer/kolla-kubernetes/development-environment.html11:39
zhubingbing_roger11:39
*** manheim_ has quit IRC11:43
openstackgerritOpenStack Proposal Bot proposed openstack/kolla master: Updated from global requirements  https://review.openstack.org/43772811:46
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-ansible master: Updated from global requirements  https://review.openstack.org/43830611:46
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-kubernetes master: Updated from global requirements  https://review.openstack.org/43932011:46
*** mliima has joined #openstack-kolla11:46
*** nathharp has quit IRC11:47
sdakesup mliima11:47
*** nathharp has joined #openstack-kolla11:48
egonzalezzhubingbing_, after upgrade to ocata, heka volumes remains there. not seeing any valuable inside http://paste.openstack.org/show/601123/11:49
*** sdake has quit IRC11:49
*** nathharp_ has joined #openstack-kolla11:50
*** sdake has joined #openstack-kolla11:50
mliimamorning guys11:51
mliimamorning sdake11:51
*** nathharp__ has joined #openstack-kolla11:51
*** nathharp__ has quit IRC11:52
zhubingbing_so we need remove it11:52
*** manheim_ has joined #openstack-kolla11:52
zhubingbing_remove volume11:52
*** nathharp has quit IRC11:53
*** nathharp_ has quit IRC11:54
*** sdake_ has joined #openstack-kolla11:55
*** sdake has quit IRC11:56
jmccarthyWhat ansible version are folks on these days ? 2.2 yet ?12:08
sbezverkmgoddard: ping12:09
sdake_morning sbezverk12:09
*** sdake_ is now known as sdake12:09
openstackgerritzhubingbing proposed openstack/kolla master: Update flunent v12.0 to v14.0  https://review.openstack.org/44048212:13
egonzalezjmccarthy, 2.2.1.0, the one provided in epel12:14
*** JoseMello has joined #openstack-kolla12:17
*** athomas has quit IRC12:18
sdakesbezverk please have a look at this: https://etherpad.openstack.org/p/kolla-kubernetes-deploy-guide-BP and this: http://eavesdrop.openstack.org/irclogs/%23openstack-kolla/%23openstack-kolla.2017-03-02.log.html#t2017-03-02T02:26:1812:19
sbezverksdake_ good morning12:19
sdakesbezverk also zhubingbing_ has said he will do fluentd, mind handing that off to him?12:20
*** shardy is now known as shardy_lunch12:21
*** rhallisey has joined #openstack-kolla12:22
*** rhallisey has quit IRC12:22
*** rwellum has joined #openstack-kolla12:23
sbezverksdake: re fluentd, sure thing.. he just need to add it as a work item to more microservices blueprint12:24
sdakeqwang just caught your message from earlier - there are instructions on the mailing list re the deploy guide and the instructions in the etherpad have been updated12:25
openstackgerritzhubingbing proposed openstack/kolla master: Add python-pankoclient to panko  https://review.openstack.org/44018012:25
zhubingbing_microservices blueprint ?12:25
zhubingbing_for exemple12:25
sbezverkzhubingbing_: sorry more-microservices blueprint12:25
sdakezhubingbing_ this one: https://blueprints.launchpad.net/kolla-kubernetes/+spec/more-microservices12:26
sbezverkit is the name of blueprint for additional microservices which did not make it to compute kit12:26
*** skramaja_ has joined #openstack-kolla12:26
*** goldyfruit has joined #openstack-kolla12:27
*** skramaja has quit IRC12:27
*** sdake_ has joined #openstack-kolla12:28
jmccarthyegonzalez: 2.2.1.0 in containers only is it ? Or on the operator/master node ?12:28
*** athomas has joined #openstack-kolla12:29
*** mnasiadka has quit IRC12:29
egonzalezjmccarthy, 2.2.1 in deployer node, 2.1.1.0 in kolla_toolbox container12:29
*** sdake has quit IRC12:30
sbezverksdake: we need to fix ironic-inspector image so it would work for both cases, source and binary12:31
sdake_sbezverk roger that12:31
*** tovin07 has quit IRC12:34
openstackgerritzhubingbing proposed openstack/kolla master: Add python-pankoclient to panko  https://review.openstack.org/44018012:35
financeManngood morning12:35
sdake_financeMann do you ever sleep :)12:36
financeMannmoney dont sleep12:36
openstackgerritRico Lin proposed openstack/kolla-kubernetes master: [Fix gate]Update test requirement  https://review.openstack.org/44051312:36
sdake_financeMann no instead it compounds12:36
financeMannit sure does in my compound12:37
sdake_;-)12:37
zhubingbing_egonzalez12:37
openstackgerritRico Lin proposed openstack/kolla-ansible master: [Fix gate]Update test requirement  https://review.openstack.org/44051512:37
sdake_financeMann curious what your take is on warren buffet's statement that "You can't go broke if you don't borrow money."12:37
sdake_as it relates to leverage12:38
*** goldyfruit has quit IRC12:38
sdake_Jeffrey4l need a bit of help related to ironic-inspector12:39
sdake_Jeffrey4l docker images are busted there, my first inclination is to revert the change that mgoddard added as it breaks source builds12:40
openstackgerritzhubingbing proposed openstack/kolla master: Update fluentd v12.0 to v14.0  https://review.openstack.org/44048212:40
sdake_Jeffrey4l however mgoddard likely added the change because it enables binary builds12:40
sdake_Jeffrey4l however, looking at the rest of the docker files, mgoddard uses a pattern that is atypical12:40
sdake_sbezverk can you link the review plz12:41
*** rwallner has joined #openstack-kolla12:41
financeMannI worked at a firm where I wrote an automated trading system that managed “$20,000,000,000” of future contracts using leverage at 20% which means it had an market value of $100,000,000,000 ($100 billion USD).  I personally think leverage is stupid because one small mistake and we could have been wiped off the flace of the planet. Some of these leverage techniques are like 1000 to 1 leverage12:43
financeMannmy hands would shake every time i wrote code just thinking about the leverage i had to deal with12:44
financeMannbut i agree with him, in my own business i always go for free money, never borrow, just be given free money12:45
sdake_financeMann right - I was more curious on your thoughts as it relates to leveraging yourself :)12:46
financeMannwhen ya say leveraging what do you mean by that word12:46
sdake_financeMann true story I was once offered 1.2 mil/yr to work at a finance firm12:46
sdake_financeMann decided the money wasn't worth the pain of moving to new york12:47
sdake_financeMann well levarage usually has a financial connotation, however, it can also be applied to a variety of different things such as an individual's work output12:47
sdake_financeMann are you aware of warren buffet's bet with protege partners?12:49
financeMannnope don’t follow him much, what is it12:49
egonzalezfinanceMann, just deployed newton with spice enabled and it works fine12:49
sdake_he bet 1 million over 10 years against protege partners that passive investing would blow their managed hedge fund away12:49
sdake_and he looks to be winning12:50
financeMannya spice works fine egonzalez, just cant get novnc or spice to work with my windows image12:50
financeMannsdake_ yea it’s funny that active investment is actually not better and usually worse than active management12:50
sdake_financeMann winning :)12:50
financeMann*passive12:50
financeMannthe firm I worked at did $100 billion USD In passive investment strategies12:51
rwellumsdake_,  morning... https://etherpad.openstack.org/p/kolla-create-configmaps - looks like a weird format issue (wrapped). Do we have a better version?12:51
financeMannour catch line was something like “We can’t gaurentee you anything better than the market but we can sure gaurentee you’ll get 5 times whatever the market gives you”12:51
sdake_financeMann ever read https://www.amazon.com/Coffeehouse-Investor-Wealth-Ignore-Street/dp/159184584X12:51
sdake_financeMann that goes both ways ;-)12:52
sdake_rwellum moment looking12:52
sdake_rwellum that script should work as is12:52
sdake_rwellum does it not work?12:52
*** salv-orlando has joined #openstack-kolla12:52
rwellumsdake_, didn't try because it looked wrong.12:54
sdake_rwellum fixed12:54
rwellumsdake_, thanks.12:54
*** salv-orl_ has quit IRC12:55
financeMannI think my problem is that I can’t load the virtio drivers properly into my windows instance, I try to manually update the ethernet adapter driver to virtio driver and it just crashes my virtualbox12:56
financeMannlooking at device manager none of the drivers were actually applied12:56
financeMannjust installed into the windows driver repository or whatever12:56
rwellumfinanceMann, why not just run a Linux VM on your windows box? Things tend to work much better imo. Unless you have a specific reason for messing with windows.12:57
financeMannrwellum I have openstack running on centos and im tryin to do windows deployment instances12:58
financeMannShould I follow -> https://docs.openstack.org/image-guide/windows-image.html ?12:58
financeMannand just make the image on my centos box directly?12:58
*** shardy_lunch is now known as shardy12:58
*** sdake has joined #openstack-kolla12:59
rwellumHave never tried financeMann but looks possible to me.12:59
financeManni’ll try that13:00
financeMannsdake_ I haven’t read that, my background is in computational finance and theoretical computer science so I spend like months or years just staring at 3-6 minutes of price data and execute an option position for 60 seconds13:00
financeMannso it’s all just like math to me with real no underlying meaning other than patterns and analysis13:01
sdakefinanceMann sounds like that material is too basic for you :)13:01
*** sdake_ has quit IRC13:01
openstackgerritMartin André proposed openstack/kolla master: Skip directory perms check if it doesn't exist  https://review.openstack.org/44053413:01
financeMannI got this friend who has made millions on options and I am trying to convert his strategy into an automated algo and it’s a lot harder because even though he’s documented his technique so exactly he still does a lot of intuition things13:02
financeMannwithout even realizing it13:02
*** matrohon has joined #openstack-kolla13:02
sdakei have a regular 401k, an actively managed rollover 401k, and DCP13:03
sdakeI am rolling the actively managed rollover 401k from fidelity to vanguard to simplify my life13:04
sdakethe other 401k and dcp i can't do anything with sadly, however, they are rockin about 15% after fees are accounted for, or 25% prior to fees13:04
sdakeactive management with the fees with compounding is a killer13:04
financeMannsdake if you haven’t seen this movie I highly recommend it as it does an amazingly excellent job of explaining investing along with the housing crash -> http://www.imdb.com/title/tt1596363/13:05
*** schwicht has joined #openstack-kolla13:06
sdakeyes I've seen it ;)13:06
financeMannsdake activate management used to be great when the markets aren’t informationally efficent but with technology information and prices interact pretty precisely13:06
sdakei was going to ask you if you had seen it as well, but couldn't recall the name of it13:06
*** zhubingbing_ has quit IRC13:06
sdakeI thought it was a fantastic movie :)13:06
sdakefinanceMann yup the pros have better tools then average joes like me, even though I understand certain segments better than the pros13:07
*** skramaja_ has quit IRC13:07
*** skramaja_ has joined #openstack-kolla13:07
financeMannplus how do you compete with a guy executing trades worth $20 million a pop, the fees and such are so low13:07
sdakeeven the pros can outperform me personally in the tech sector, however, they can't outperform passive management :)13:07
sdakeroger that!13:07
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855613:08
*** mnasiadka has joined #openstack-kolla13:09
sdakefinanceMann fwiw my wife thought your openstack statement of interest was interesting13:10
*** harry_liu has quit IRC13:10
sdakefinanceMann she mentioned something like "usually you learn how to manage a supercomputer before you buy it" :)13:10
financeMannlol im not the type to go to school to learn how to drive a lambo if i want one :D theres always a first ya gotta learn on13:11
sdakefinanceMann lol13:11
sdakefinanceMann ya i didn't go to porsche driving school for my panamera although I probably should have as I've wrecked about 4 tires13:12
sdakeor my wife has :)13:12
sdakenot sure who13:12
sdakecurbs suck13:12
financeMannlol ive been looking for tire insurance actually because i bet you my wife will hit curbs on our new car13:13
financeMannif you ever find any insurance specifically for wheels13:13
financeMannlet me know13:13
sdakeyou can file that under your normal insurance plan (atleast in az) however they jacked my insurance rates up 1k/yr as a result of a 4k offroading experience onto a sidewalk13:14
sdakediscount tire handles tires, but nobody handles wheels13:14
sdakesounds like a business opportunity :)13:14
sdakeinsurance is a terrible racket13:14
*** schwicht has quit IRC13:14
*** sdake_ has joined #openstack-kolla13:16
financeMannlol yea indeed, im just worried that damage to the tires would be less than the deductable13:17
*** Shanna has joined #openstack-kolla13:17
*** eaguilar has joined #openstack-kolla13:18
*** schwicht has joined #openstack-kolla13:19
sdake_what I need is brake insurance13:19
sdake_my last brakejob was 350013:19
* sdake_ GROANS13:19
*** sdake has quit IRC13:19
*** schwicht has quit IRC13:20
sdake_Jeffrey4l ironic-inspector busted, need advice plz13:20
financeManngezz what serious, is that on the porsche?13:21
rwellumsdake_, "/opt/kolla-kubernetes/tools/helm_build_all.sh ." - question about this. What's the working dir? "." is anywhere you run the command from.13:21
sdake_rwellum good q13:22
sdake_rwellum I put em in /opt/kolla-kubernetes13:22
rwellumsdake_, sbezverk mentioned he had to run these commands from within each respective dir, but you're pointint o /opt/*13:22
rwellum"pointing to"13:22
sdake_rwellum i don't thiink it matters where you put them as long as all the commands are run from one dir13:23
rwellumok13:23
sdake_rwellum your Q&A in the etherpad is excellent, keep it up :)13:23
openstackgerritTim Clark proposed openstack/kolla-kubernetes master: Adding nova-compute-ironic service chart  https://review.openstack.org/43984113:23
sdake_please add lines indicating you tested them13:23
rwellumWill do - good point. I'm running through them now.13:24
sdake_rwellum the more people test the instructions the better they are :)13:24
sdake_rwellum there are still some undefined peices13:24
sdake_rwellum dims said he would take a look today-early next week as well13:24
sdake_rwellum also inc0 said he would look today13:24
sdake_rwellum and i believe qwang can help as well13:24
sdake_if we can pile on that etherpad, we can get this knocked out in short order13:25
Serlexlink to etherpad?13:25
sdake_serlex moment13:25
sdake_Serlex https://etherpad.openstack.org/p/kolla-kubernetes-deploy-guide-BP13:26
openstackgerritRico Lin proposed openstack/kolla master: [Fix gate]Update test requirement  https://review.openstack.org/44055113:26
sdake_Serlex in case you are curious why we are doing this work: http://lists.openstack.org/pipermail/openstack-dev/2017-March/113209.html13:27
*** zhubingbing_ has joined #openstack-kolla13:27
Serlexthank you!13:27
Serlexim always curious13:27
sdake_Serlex curiousity is usually good :)13:27
sdake_Serlex these instructions nearly almost work - check out the video for evidence :)13:27
sdake_still getting security advisories from red hat for heat - can't ever escape :)13:28
sdake_good thing I have rockin filters on my gmail account :)13:29
*** rwallner has quit IRC13:30
rwellumsdake_, glad it's more than just me checking this :)13:31
sdake_rwellum yup also zhubingbing_ may or may not check it out too - unclear13:33
rwellumsdake_, ack13:34
zhubingbing_i am hear13:36
sdake_zhubingbing_ we were determining if you were going to run through the instructions on the etherpad or do fluentd instead13:36
zhubingbing_for the video i checking it13:36
sdake_zhubingbing_ which is really based on your choice not ours :)13:37
zhubingbing_ok13:37
*** goldyfruit has joined #openstack-kolla13:37
zhubingbing_sdake i will try use etherpad  do fluentd instead13:38
*** jpstnh has joined #openstack-kolla13:38
sdake_zhubingbing_ that sentence didn't parse13:39
sdake_zhubingbing_ could you restate plz13:39
sdake_zhubingbing_ your our resident expert on fluentd, it would be good if you could do the fluentd dev13:39
rwellumsdake_, issue running kolla-service-start.sh - it's looking for /root/cloud.yaml - which I don't have. Did I miss a step?13:40
sdake_rwellum i linked cloud.yaml in the etherpad13:40
sdake_rwellum it does need customization for your environment13:40
zhubingbing_ok13:41
*** srwilkers has joined #openstack-kolla13:41
sdake_rwellum line 2213:42
srwilkersmorning13:42
*** jtriley has joined #openstack-kolla13:43
sdake_sup srwilkers13:44
sdake_sbezverk if you could look at line 24, i have a request  for you https://etherpad.openstack.org/p/kolla-kubernetes-deploy-guide-BP13:46
sdake_sbezverk i think we just need the ethernet interface customated right :)13:47
sdake_rwellum ^^13:47
*** jtriley has quit IRC13:47
sdake_financeMann once you finish up sorting out how to drive your lambo could use any help on driving a different model :)13:48
rwellumsdake_, looking at it now.13:48
*** sayantan_ has joined #openstack-kolla13:48
sdake_kfox1111 actually knows how that file is generated13:48
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Fix fluentd undefined method 'parse'  https://review.openstack.org/44056313:49
*** sp_ has joined #openstack-kolla13:49
sdake_sbezverk may as well, we should probably put the tool in there that generates the file instead of the file itself13:49
sbezverksdake_: there is a tool to generate it13:49
sdake_rwellum i'd do that, but I don't recall what it was that I ran :)13:49
*** Jeffrey4l has quit IRC13:49
financeMannsdake_ sounds good! :)13:49
sbezverkbuild_example_yaml.py13:49
sbezverkin tools13:50
sdake_thanks i was just hunting down where it was13:50
sdake_no need to do that now :)13:50
*** aolwas has quit IRC13:51
openstackgerritzhubingbing proposed openstack/kolla-ansible master: Fix fluentd undefined method 'parse'  https://review.openstack.org/44056313:51
rwellumThat's a well documented script :)13:51
*** mdnadeem has quit IRC13:52
*** rwallner has joined #openstack-kolla13:52
sdake_rwellum ya - wtb docs all over kolla!13:53
*** rmart04 has quit IRC13:54
sdake_gotta get the kid to school bbl13:56
rwellumsbezverk, ok the script generates a cloud.yaml with everything commented out - and the user has to decide what to build?13:57
*** saneax is now known as saneax-_-|AFK13:58
*** eaguilar has quit IRC13:59
sbezverkrwellum: yep13:59
sbezverkwell not build but customize13:59
sbezverkservices configuration, you describe your specific env using it14:00
sdake_make it harder ;)14:00
sdake_wish my daughter would completely wake up on her own14:00
sbezverklike I have for my kube cluster so repro the same result is much easier14:00
sdake_i think we can check a working "deploy everything" example into the repo14:00
sp_sdake_: I pray for her14:01
rwellumYes I like that idea.14:01
sbezverksdake_ deploy everything is asking for trouble14:01
sbezverkit should be deploy minimal config14:01
sdake_and later make the example generator select certain services14:01
rwellumWhat is the ip addr I am supposed to customize?14:01
*** salv-orlando has quit IRC14:01
rwellumsbezverk, as long as it fails gracefully?14:01
sdake_sp_ nah she is doing fine14:02
sdake_sp_ she just isn't a morning person14:02
sbezverkhave meeting, will be back later..14:02
sdake_sp_ today she is busting my schedule unfortunately :(14:03
sp_sdake_:  but my wishes and prayer always with her14:03
sdake_rwellum in the linked cloud yaml search for enps0somethignoranother :)14:03
sdake_sp_ thanks dude :)14:03
sdake_rwellum i think its tunnel interface iirc14:04
sdake_rwellum although i'm not sure14:04
sp_sdake_: my pleasure14:04
sdake_i gotta say i preferred linkedin version -1 :)14:05
sdake_oh well gotta move with the times :)14:05
*** schwicht has joined #openstack-kolla14:06
rwellumsdake_, I think ext_interface_name: enp13s0 ?14:06
rwellumor maybe both14:06
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855614:07
*** lamt has joined #openstack-kolla14:11
*** fguillot has joined #openstack-kolla14:11
*** lamt has quit IRC14:12
sdake_rwellum taking daughter to school then have meeting at 30 after - so i'll be back in 1-2 hrs - keep at it :)14:14
*** rmart04 has joined #openstack-kolla14:15
rwellumsdake_, ack14:16
*** crushil has joined #openstack-kolla14:17
*** eaguilar has joined #openstack-kolla14:18
rwellumsbezverk, ext_bridge_name: br-ex - is this provided by openvswitch or by me to openvswitch?14:20
*** lamt has joined #openstack-kolla14:25
*** Jeffrey4l has joined #openstack-kolla14:29
Jeffrey4lsorry guys, very busy today. and tired. will check the message tomorrow.14:30
*** Jeffrey4l has quit IRC14:35
*** JoseMello has quit IRC14:35
*** yingjun has joined #openstack-kolla14:37
financeMannim trying to run virt-install and I cant figure it out, it keeps saying “Cannot access storage file ‘/tmp/win.ISO’ and “You will need to grant the ‘qemu’ user sesarch permissions for the following: [‘’]”14:39
financeMannI set qemu to run as root and it still does it14:39
financeMannthis is why i like windows, it blows my mind how many problems i run into with linux14:39
*** rhallisey has joined #openstack-kolla14:40
rabel_b1financeMann: :D yeah, you never run in any problems with windows14:40
egonzalezfinanceMann, linux at least says that have a permission issue, windows don't ;)14:40
financeMannlinux is awesome when it works :P14:40
financeMannI dont even know what to try, I already googled this issue and sudo, su, chmod 777, root user14:41
egonzalezfinanceMann, are you root or with other user?14:43
mgoddardsbezverk, sdake_: looks like I've been causing trouble14:43
financeMannI am sudo su14:43
financeMannroot14:43
mgoddardsdake_: how does my change break source builds?14:46
SerlexfinanceMann why dont you just move the ISO to user's home directory, check its permissions14:48
sbezverkmgoddard: unfortunately when your ps was backported to stable newton it broke14:48
mgoddardah14:49
rwellumfinanceMann, I have the same issues running virt-install sometimes. I think your ISO needs to be in /var/lib/libvirt/images14:49
*** wirehead_ has quit IRC14:49
financeMannrwellum it was but still had the same issue14:49
financeMannmaybe i need to chmod mod the iso?14:49
rwellumOr what Serlex said maybe - but libvirt usually has permissions set correctly14:49
rwellumAlternative - run virt-manager - instead of virt-install - for some reason the GUI always works - because I guess it handles all the permissions correctly.14:50
*** wirehead_ has joined #openstack-kolla14:50
mgoddardsbezverk: so the changes in master and ocata are still ok?14:50
Serlexiso can be anywhere long as the permissions are correct. Switch to root if you can to skip past permissions14:50
financeMannSerlex i did but same issue14:51
*** manheim_ has quit IRC14:51
financeMannits saying “Cannot open directory ‘/home/andrew’ no such file or directory exists14:51
financeMannlol......14:51
financeMannit runs the process as the qemu user i believe or somethign14:51
Serlexlets see your virt-install command...in whole14:51
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855614:52
mgoddardsbezverk: I can't see that commit in either ocata or newton, and sdake_ referenced the change on the master branch in his comment on the bug14:53
sbezverkmgoddard: I could not test master as we do not have master running jobs14:53
financeMannSerlex pastebin.com/2x133s2N14:54
financeMannwww.pastebin.com/2x133s2N14:54
mgoddardsbezverk: Ok, but I'm saying I don't think that change was backported to ocata or newton (or at least it wasn't merged)14:54
sbezverkmgoddard: if I give you Docker working for me, can you try to make it working for binary?14:54
sbezverkmgoddard: right I cherrypicked and run the image14:54
mgoddardsbezverk: I'm just trying to work out what needs to be backed out. sdake_ said that my change broke source builds and needs to be reverted14:55
*** srwilkers has quit IRC14:58
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Test fix ubuntu libvirt gate  https://review.openstack.org/43889714:59
*** TxGirlGeek has joined #openstack-kolla14:59
*** lamt has quit IRC15:01
SerlexfinanceMann, you are running disk-path twice...not sure if thats standard practise15:01
*** TxGirlGeek has quit IRC15:02
Serlexfor the ISO, try --location=/parth/to/iso15:02
*** TxGirlGeek has joined #openstack-kolla15:02
Serlexvirt-install --network bridge:virbr0 --name compute2-ovm --ram=8048 --vcpus=4 --file=/etc/libvirt/compute2-ovm.img -s 50 --noautoconsole --graphics vnc --location=OVM.iso15:02
sbezverkmgoddard: let's not worry about backing out, let's find a solution working for both source and binary15:02
mgoddardsbezverk: which branch are you using? newton?15:03
*** rmart04 has quit IRC15:03
sbezverkmgoddard: yes we use stable newton15:04
*** manheim_ has joined #openstack-kolla15:05
sbezverkmgoddard: here is my docker file which is working for source: http://paste.openstack.org/show/601150/15:05
*** TxGirlGeek has quit IRC15:06
*** trinaths has joined #openstack-kolla15:08
mgoddardsbezverk: I suspect that what you need to do is apply https://github.com/openstack/kolla/commit/040ff6ea037357a84a6450c944648b83eb833454 and then my patch15:09
*** mnasiadka has quit IRC15:12
*** trinaths has quit IRC15:12
hrwkfox1111: are you Kevin Fox? I want to know is ceph-fuse package mandatory for ceph images or will they work without it installed? It is built only for x86_64 which blocks my non-x86 work.15:13
sbezverkmgoddard: that is what I did last night..15:13
openstackgerritMerged openstack/kolla-ansible master: Fixed some tox errors in docs  https://review.openstack.org/44021115:14
*** crushil has quit IRC15:15
*** TxGirlGeek has joined #openstack-kolla15:15
*** crushil has joined #openstack-kolla15:15
mgoddardsbezverk: and what happened? do you have error output?15:16
sbezverkmgoddard: I was seeing iptables issue15:16
*** TxGirlGeek has quit IRC15:16
openstackgerritEduardo Gonzalez proposed openstack/kolla master: Test fix ubuntu libvirt gate  https://review.openstack.org/43889715:17
*** sayantan_ has quit IRC15:17
*** TxGirlGeek has joined #openstack-kolla15:17
*** sayantan_ has joined #openstack-kolla15:17
*** lamt has joined #openstack-kolla15:19
mgoddardsbezverk: which container distro are you using?15:19
*** sayantan_ has quit IRC15:20
*** sayantan_ has joined #openstack-kolla15:20
*** TxGirlGeek has quit IRC15:21
*** rwallner has quit IRC15:22
hrwkfox1111: can ceph-fuse package install be moved to cephfs-fuse image instead?15:23
*** TxGirlGeek has joined #openstack-kolla15:23
SerlexfinanceMann, that do it?15:23
openstackgerritzhubingbing proposed openstack/kolla master: Fix fluentd undefined method 'parse'  https://review.openstack.org/44062815:24
sbezverkmgoddard: centos source15:25
*** dave-mccowan has joined #openstack-kolla15:26
openstackgerritMerged openstack/kolla-ansible master: Etcd fails to start - missing environment parameter  https://review.openstack.org/43993715:26
*** rwallner has joined #openstack-kolla15:26
openstackgerritMerged openstack/kolla-ansible master: Update the file format for baremetal  https://review.openstack.org/43785815:27
*** srwilkers has joined #openstack-kolla15:27
*** sayantan_ has quit IRC15:27
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855615:28
hrwkfox1111: something like that: https://paste.fedoraproject.org/paste/N2OuCHaAVi1bow~rZjiuG15M1UNdIGYhyRLivL9gydE=/15:28
*** sayantan_ has joined #openstack-kolla15:28
*** lucasxu has joined #openstack-kolla15:32
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: ironic-pxe: handle non-x86 architectures  https://review.openstack.org/43481715:32
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: debian: enable all images enabled for Ubuntu  https://review.openstack.org/43278715:32
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Add support for non-x86 architectures (aarch64, ppc64le)  https://review.openstack.org/43094015:32
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: nova-libvirt: handle ppc64le  https://review.openstack.org/43481015:32
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: nova-compute: handle rtslib(-fb) for debian-binary builds too  https://review.openstack.org/43594115:33
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: debian: move to stretch  https://review.openstack.org/43445315:33
*** lamt has quit IRC15:33
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: debian: install gnupg and dirmngr needed for apt-key  https://review.openstack.org/43443115:33
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: ceph: move ceph-fuse package to cephfs-fuse image  https://review.openstack.org/44063415:33
hrwkfox1111: I added you to 440634 patch15:34
*** lamt has joined #openstack-kolla15:34
*** eaguilar has quit IRC15:36
*** tovin07 has joined #openstack-kolla15:37
*** TxGirlGeek has quit IRC15:37
*** TxGirlGeek has joined #openstack-kolla15:38
pbourkesdake_: inc0: portdirect: can any of you guys tell me if kubernetes-entrypoint is still being used by kolla-k8s?15:45
financeMannno Serle15:45
financeMannSerlex15:45
financeMannno luck15:45
pbourkesbezverk: ^15:47
pbourkebmace: ^15:47
sbezverkpbourke: yep15:51
sbezverkwe use it extensively for services and computekit charts15:51
pbourkesbezverk: ok thanks, thought it might have been replaced by helm15:51
sbezverkpbourke: nooooo, we need both15:51
portdirect^^ sbezverk speaks the truth ;)15:53
*** athomas has quit IRC15:53
*** TxGirlGeek has quit IRC15:54
portdirectCheers pbourke15:54
*** TxGirlGeek has joined #openstack-kolla15:54
pbourkethanks guys, sorry to ping so many of you :p15:54
portdirectNP dude15:54
sbezverkpbourke: np, as long as it helps to keep these images ;)15:54
pbourkeaw i was so ready to 'git rm -rf'15:54
portdirectI dare you15:55
mgoddardsbezverk: Just applied 040ff6ea037357a84a6450c944648b83eb833454 then 5752c7eb0b1f9c5978dd4e9271ded346cea231e0 to stable/newton and it worked for me15:55
mgoddardsbezverk: centos source15:55
financeMannWhen i do virt-install its sayin cannot open directory for the iso because it doesnt exist but of course an ls shows it exists15:56
financeManni 777 the whole contents15:56
financeMannso any user running should see it....15:56
sbezverkmgoddard: is there a ps I can cherry pick and test on my side?15:56
sbezverkmgoddard: or you did it locally ?15:57
*** zhubingbing_ has quit IRC15:57
*** lamt has quit IRC15:58
mgoddardsbezverk: I did it locally. All I did was checkout stable/newton, then cherry pick those two commits15:59
*** TxGirlGeek has quit IRC15:59
sbezverkmgoddard: that is what I did too last night when tried source and it failed for me..16:00
mgoddardsbezverk: in https://review.openstack.org/#/c/439913/1 you said the first commit was against stable policy. What did you mean?16:00
*** athomas has joined #openstack-kolla16:00
sbezverkmgoddard: sdake told me that I could not cherry pick two PS16:00
sbezverkin one shot16:00
mgoddardsbezverk: I didn't use kolla-ansible to deploy, I just ran the container manually. I had a Bifrost container running so just used the DB and config file from there16:00
*** Shanna has quit IRC16:01
sbezverkmgoddard: so I did it locally without pushing16:01
*** mliima has quit IRC16:01
mgoddardsbezverk: no you can't cherry pick 2 in 1. It would require two separate reviews16:01
sbezverkmgoddard: yeah, well I wanted to do it quick ;) no time for policies16:02
mgoddardsbezverk: I see. Can you try again? It's definitely working for me.16:03
*** yingjun has quit IRC16:04
*** TxGirlGeek has joined #openstack-kolla16:04
*** schwicht has quit IRC16:04
mgoddardsbezverk: verify that your sudoers file is as expected in the container16:04
openstackgerritMartin André proposed openstack/kolla master: Defer handling of /var/lib/neutron/kolla to kolla API  https://review.openstack.org/44053416:07
sbezverkmgoddard: it needs to be backported to newton anyway, any change you can push it for review?16:07
SerlexFinanceMann, go into the directory of the iso and run it, if it says it doesnt exists, check for typos16:10
mgoddardsbezverk: I'll submit the rootwrap change for ocata. newton would need further testing. given that your environment is newton, could you handle that?16:11
financeMannit exists16:12
financeManni tried16:12
*** tovin07 has quit IRC16:12
financeManneven if i try to load it in virt manager16:12
financeManni see the directory, double click on it and then it gets an error saying that the file i just double clicked on doesnt actually exist16:13
*** sayantan_ has quit IRC16:13
financeMannSerlex ^16:13
*** sayantan_ has joined #openstack-kolla16:13
financeMannSerlex if I spin up a new Centos box within openstack can I then go into that box and build virtual images from there?16:13
financeManncan i nest vm tech like that with openstack16:13
*** zhubingbing_ has joined #openstack-kolla16:13
*** skramaja_ has quit IRC16:15
SerlexI'm sure you can16:16
Serlexbut the fact that it says file doesn't exists and you sure it does is worrying16:16
financeMannSerlex ya which is why im gonna try it from a fresh centos instance16:17
*** sp_ has quit IRC16:22
*** TxGirlGeek has quit IRC16:23
*** manheim_ has quit IRC16:24
inc0good morning16:25
inc0portdirect: you asked me for guide how to deploy kolla-k8s outside gate right?16:25
financeManninc0 good morning, i am downloadin a premade windows 2012 cowq2 image to verify my setup works16:25
inc0financeMann: cool, let me know how it went16:26
inc0I want a screenshot of kolla running opoenstack running windows running minesweeper;)16:26
inc0portdirect: check this out https://etherpad.openstack.org/p/kolla-kubernetes-deploy-guide-BP16:26
*** salv-orlando has joined #openstack-kolla16:29
*** lamt has joined #openstack-kolla16:30
*** n0isyn0i1e is now known as n0isyn0ise16:30
*** zhubingbing_ has quit IRC16:31
*** TxGirlGeek has joined #openstack-kolla16:36
*** manheim_ has joined #openstack-kolla16:38
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Update Bifrost documentation  https://review.openstack.org/42684116:40
portdirectinc0: all good, was looking at that last night ;)16:41
portdirectThanks dude16:41
openstackgerritMark Goddard proposed openstack/kolla-ansible master: Fix bootstrap-servers with invalid api_interface  https://review.openstack.org/43494016:41
*** pcaruana has quit IRC16:42
*** jtriley has joined #openstack-kolla16:42
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Update Multinode deployment of kolla guide  https://review.openstack.org/42685216:43
*** huzhengchuan has joined #openstack-kolla16:51
kfox1111morning.16:53
*** rwallner has quit IRC16:59
*** schwicht has joined #openstack-kolla17:01
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855617:01
sbezverkkfox1111: good morning17:01
*** rwallner has joined #openstack-kolla17:02
*** sdake has joined #openstack-kolla17:02
sdakesup eeps17:03
sdakepeeps17:03
*** jpstnh has quit IRC17:04
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855617:05
sdakerwellum get an further- I noticed a bunch m0ar notes17:05
sdakean/any17:05
*** sdake_ has quit IRC17:06
*** rwallner has quit IRC17:06
*** egonzalez has quit IRC17:08
*** schwicht has quit IRC17:08
*** matrohon has quit IRC17:08
sdakesbezverk whats happenign with  the ironic gate?17:09
*** crushil has quit IRC17:10
sbezverksdake: in the process of developing17:11
sbezverkthe gate with basic ironic test is up and running17:11
sdakesbezverk what about mgoddard 's change that looks incorrect to me?17:11
mgoddardsdake: how is it incorrect? Functionally or in terms of the pattern used?17:12
sbezverksdake: it did not work last night on both centos and ubuntu source but there might be a chance that cherrypicks were not correct..17:12
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Fix pushing images to local registry documentation  https://review.openstack.org/42685817:12
*** dave-mcc_ has joined #openstack-kolla17:12
sdakemgoddard pattern used17:12
sdakemgoddard it looks different from other patterns when I looked at  it last night17:12
sdakeinc0 would know for sure, he is the wizard who architected the dockerfiles  :)17:13
sdakesbezverk we still want a consistent pattern17:13
sbezverksdake: so I would like somebody build  a source image for ironic-inspector17:13
*** dave-mccowan has quit IRC17:13
sdakesbezverk what I don't understand is why every other image but ironic would work17:13
sbezverkfor sanity testing17:13
mgoddardsdake: ok, thanks for clarifying. I agree that it's a little different to the normal pattern. Does that warrant a revert when it resolves a bug though?17:13
sdakemgoddard it may not resolve the bug - I'm concerned of 1 of 2 things17:14
sdakeeither a) we need to apply that pattern to all our docker files17:14
sdakeor b) we need to revert your change and fix it with the patterns already existing17:14
sbezverksdake: ironic-inspector requires iptables, and it seems that change did something which source did not like17:14
sdakeright i recall looking at the change and it used rootwrap17:14
sdakecould someone plz link it - having link fatigue :)17:15
sdakeand at 2% power17:15
*** TxGirlGeek has quit IRC17:16
*** dave-mccowan has joined #openstack-kolla17:16
mgoddardsdake: the issue occurs because kolla uses the ironic user to run ironic-inspector, but (at least on CentOS) the package installs a sudoers file for the ironic-inspector user. The 'correct' fix would use the ironic-inspector user for inspector (not ironic).17:16
sbezverksdake: here is one https://review.openstack.org/#/c/440672/17:16
*** eaguilar has joined #openstack-kolla17:16
sdakethe package installs a sudoers file?17:16
*** TxGirlGeek has joined #openstack-kolla17:16
sdakemgoddard was this centos binary?17:17
*** dave-mcc_ has quit IRC17:17
sbezverkmgoddard: do you have a link for second mlima PS? I cannot find it :(*17:17
*** skramaja has joined #openstack-kolla17:17
mgoddardsdake: I chose the solution as it was simple and required minimal changes, and would not have an impact on other distros that might use the ironic user for ironic inspector. As there is no deployment gate testing for Ironic/inspector I didn't want to risk it17:17
mgoddardsdake: yes, centos binary17:17
sdakemgoddard indeed - although there is gating in kolla-kubernetes17:18
sdakemgoddard and from what I could tell last night that was breaking that gating17:18
sdakeWTB CROSS REPO GATING17:18
mgoddardsdake: that's good to know17:18
sdakemgoddard the gating there is source based17:18
mgoddardsdake: broken gate not good to know....17:18
sdakeand your testing was binary basesd17:18
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Fix MySQL DB error in bifrost container  https://review.openstack.org/42439117:18
sdakemgoddard any chance you could test source in your local env?17:18
sdakemgoddard my personal envs are loaned out or setup for kolla-kubernetes17:19
sdakelet me plug in and get a 10 min break - will brb17:19
mgoddardsdake: I've just built some source images locally and they seem to run ok, albeit in a fairly manually deployed environment17:19
sdakemgoddard thats good to know, how did you deploy centos binary?17:20
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Fix MySQL DB error in bifrost container  https://review.openstack.org/42439117:20
sdakebbi10 - need a break :)17:20
financeMannINTERESTING, the cow2q Windows Server 2012 image I downloaded online, which is verified to work with kvm don’t work!!!17:21
*** JoseMello has joined #openstack-kolla17:21
financeMannCan anyone think of any kolla/openstack specific configurations I might need to change17:21
*** rwellum_ has joined #openstack-kolla17:21
financeMannnvm IT WORKS NOW17:22
financeMannWill I be able to log in!? that is the question -> http://imgur.com/a/zLSvp17:23
financeManntheres a screenshot for ya inc017:23
Serlexof course its windows, doesnt do anything magical  :)17:23
*** aolwas has joined #openstack-kolla17:24
*** rwellum has quit IRC17:24
sbezverksdake: here is the second PS https://review.openstack.org/#/c/380774/17:25
financeMannSerlex says it creates the Admin user and you can get the password with nova get-password <instance> <SSH_private_key>17:26
financeMannhow do I get the admin password with kolla?17:26
financeManndont have the nova command17:26
financeMannin the gui :P17:26
*** manheim_ has quit IRC17:26
inc0financeMann: sooo...this is when things become funny17:30
inc0I have no clue whatsoever how it works in windows17:30
portdirectfinanceMann: is that using the cloudbase image? Or did you bake your own?17:30
inc0portdirect: you don't ssh to windows tho17:30
inc0I mean...does cloud init even exists in windows17:31
inc0?17:31
financeMannI used this https://cloudbase.it/windows-cloud-images/#download17:31
portdirectNope, but the cloudbase one used to have a default password17:31
Serlexnova get-password17:31
financeMannit has a how to17:31
financeMannon that page17:31
*** fooliouno has joined #openstack-kolla17:31
Serlexyou dont have cli available I guess is the reason you are asking?17:31
inc0right...17:31
sdakeinc0 need some help17:32
financeMannit has rdp17:32
financeMannbut i dunno the password17:32
inc0sdake: shoot17:32
sdakeinc0 see this patch: https://review.openstack.org/#/c/440672/17:32
SerlexfinanceMann, do you have CLI access?17:32
sdakeinc0 there is some debate as to whether this patch is correct or not17:33
financeMannconsole access in the gui17:33
sdakeactually that is the cherrypick17:33
Serlexno, i mean to Nova17:33
sdakelet me find the master version17:33
financeMannthis is all i got Serlex http://imgur.com/a/zLSvp17:33
sdakeinc0 https://review.openstack.org/#/c/436922/17:33
inc0sdake: I can't see any debate in this...17:34
sdakeinc0 midn expanding plz17:34
*** eaguilar has quit IRC17:34
mgoddardsdake: just built an ubuntu source image, it appears they also use the ironic-inspector17:34
inc0looks good to me17:34
mgoddardsdake: ... user17:34
inc0I mean having 2 different sudoers is new17:34
inc0but well17:34
inc0not bad too17:34
sdakeinc0 ok - it doesn't follow the other patterns used in the repo17:34
SerlexfinanceMann, i think only way is to retrieve it via nova get-password17:35
sdakeand appears to break source ironic but binary ironic works17:35
sdakealthough mgoddard has reported it works in his manual deploy of centos source17:35
sdakemgoddard did you also do a manual deploy of centos binary?17:35
sdakeinc0 what I don't get is why the rest of binary would work without this pattern17:35
inc0that's actually good question17:35
mgoddardsdake: yes, I've now done a manual binary & source deploy17:36
sdakeright17:36
sdakeinc0 and we know binary works because it passed 4 gates17:36
sdake3 humans and a virtual gate17:36
financeMannSerlex how do I execute nova get-password, dont have the nova command it says17:36
*** lucasxu has quit IRC17:36
inc0well obviously source works too because that's how we roll for years now;)17:37
mgoddardsdake, inc0: the others don't need this because they use the same user as the packages. kolla is using the ironic user but packages expect you to use the ironic-inspector user.17:37
inc0ahh17:37
sdakemgoddard sbezverk inc0 i've got a meeting in 45 mins, and have to jet for a few hours after that17:37
inc0interesting17:37
sdakemgoddard thats helpful17:37
inc0so it's ironic that broke the standards?17:37
sdakethe correct fix is to standardize the uid17:37
sdakei would think17:37
SerlexfinanceMann you need to install the relevant client to execute commands17:37
sdakewe do that here:17:38
mgoddardsdake, inc0: I think the correct fix is to use ironic-inspector user for the ironic-inspector container, not the ironic user17:38
Serlexsomething like `pip install python-openstackclient`17:38
inc0well anyway, we merged it to master so I'll +2 newton too17:38
sdakeinc0 hang tight17:38
*** lucasxu has joined #openstack-kolla17:38
sdakeinc0 i think we need a revert17:39
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855617:39
sdakeand to fix it properly rather then backport it17:39
inc0ok17:39
inc0so question MArk17:39
inc0why ironic-inspector should be different user?17:39
sdakeinc0 where are the defualt users specified in the dockerfiles?17:39
sdakestuff moves around  hard to keep track17:39
mgoddardinc0: that's just what RDO & ubuntu17:40
inc0so packagers have dedicated user for it?17:40
mgoddardinc0: it's a separate component from Ironic with it's own API. It's not just an ironic service17:40
inc0I wonder if there is specific reason for it17:40
inc0hmm17:41
sdakemgoddard i see - so ubuntu source is broken?17:41
sdakerathere source entirely is broken?17:41
sdakeso we agree ironic-inspector should be a different user17:42
sdakeatleast i do :)17:42
inc0then we should create ironic-inspector user in source too17:42
mgoddardsdake: my change *should* have been a noop for source - it was just a file rename and an instruction move to a place where it should still be executed17:42
inc0I see the problem now, having different behavior between souirce/binary is bad17:42
sdakemgoddard right - although kolla really strives for consistency in the codebase17:43
sdakemgoddard mlima also had a change?17:43
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-ansible master: Updated from global requirements  https://review.openstack.org/43830617:44
inc0sdake: one thing tho is that consistency < working code17:44
inc0I'd rather fix it to get it working and then fix master to get it consistent17:44
sdakeinc0 right although we have neither atm :)17:44
sdakelet me find mlima's patch moment17:44
inc0Marks change is working right17:44
inc0?17:44
*** eaguilar has joined #openstack-kolla17:44
mgoddardsdake: do you have an example of a failed k8s gate?17:45
sdakeinc0 no it breaks the source gate for k8s17:45
sdakesbezverk can you link the gate for mgoddard plz17:45
inc0that's strange, containers should be used in same way17:45
inc0maybe it's bug in k8s gate rather than container17:45
sdakeinc0 there is no ironic gating at all for kolla-ansible17:45
mgoddardsdake: given that there are changes for ironic/inspector in k8s currently is it not possible that it wasn't my change?17:45
sdakeinc0 so it passed 3 gates, not 417:45
sdakemgoddard it is possible17:46
sdakemgoddard lets get to the root cause of the breakage, before doing any more reverts or +2s :)17:46
mgoddardsdake: agreed17:46
sdakesbezverk can you confrim it was working prior to the change?17:46
*** krtaylor has quit IRC17:46
inc0ok...so show us the breakage logs plz sdake17:46
sdakeinc0 sbezverk will have to show you17:47
sdakeinc0 i am struggling to find mlima's patch on top17:47
sdakehere is a fix for the original patch: https://review.openstack.org/#/c/380774/17:48
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Fix MySQL DB error in bifrost container  https://review.openstack.org/42439117:48
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Update Bifrost playbooks  https://review.openstack.org/42543517:48
sdakehere is mlima's bug report: https://bugs.launchpad.net/kolla/+bug/165034517:49
openstackLaunchpad bug 1650345 in kolla-ansible "Ironic Inspector DBAPIError" [High,Fix released] - Assigned to Mauricio Lima (mliima) (mauricio-lima)17:49
mgoddardsdake: I think mlima's change is fine17:51
openstackgerritBalaji G Pattewar proposed openstack/kolla-kubernetes master: Helm charts for heat/heat-cfn create user and endpoints.  https://review.openstack.org/41449617:51
inc0yeah I don't think these changes are really related17:51
*** adrian_otto has joined #openstack-kolla17:52
sdakeneither of them are in the images that sbezverk is testing - so they are related to ironic-insepctor not working in the k8s gate17:52
mgoddardsdake: do the tests run during check or only gate? this change passed all deploy tests this afternoon: https://review.openstack.org/#/c/439841/17:52
inc0and you could argue that to best follow our standards we should have ironic-inspector as separate docker not part of ironic17:52
inc0I believe this is a good change, let's see what breaks under k8s plz17:52
mgoddardinc0, sdake, sbezverk: just heading home, I'll be back online in ~2017:53
inc0speaking of gates, am I only person worried about ubuntu gates red?17:53
inc0kk cya then Mark17:53
sdakeinc0 has something to do with ara17:53
inc0ara?17:54
sdakemgoddard see ya in a bit although I have to jet soon for the day17:54
inc0what's ara17:54
sdakeinc0 focus dude focus :)17:54
inc0no really, what's ara?17:54
sdakeits an analysis tool for ansible17:54
sdakeits been in the codebase for months17:54
*** lucasxu has quit IRC17:54
sdakealthough I think pbr is busted or something17:54
sdakeI don't know the details17:54
sdakesearch [release] tag17:54
sdakehere is the ironic-inspector patch set which apparently breaks: https://review.openstack.org/#/c/438556/17:55
sdakewith the change, not sure without the change17:55
sdakehopefully sbezverk can respond shortly17:56
sdakegroan 6gb of quota for mailbox is insufficient17:57
sdakemailbox almost full17:57
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Update Bifrost documentation  https://review.openstack.org/42684117:57
sdakeinc0 ara is dmsimard 's project - you can ask him for more details17:57
sdakeinc0 i have seen the output, its pretty cool17:57
dmsimard?17:57
dmsimardsdake: did you see the /new/ output ?17:57
sdakeinc0 although i am not debugging the ubuntu gates at m:)17:58
*** mgoddard has quit IRC17:58
dmsimardsdake, inc0: http://logs.openstack.org/63/439963/1/check/gate-kolla-ansible-dsvm-deploy-centos-binary-centos-7-nv/a7243b8/logs/playbook_reports/reports/index.html17:58
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Update Bifrost documentation  https://review.openstack.org/42684117:58
*** gfidente is now known as gfidente|afk17:59
sdakedmsimard need ara for k8s ;)18:00
dmsimardehhhhhhhhhhhhh18:00
sdakeinc0 ^^ wheee18:00
sdakewell since nobody is around that understands the inspector problem I guess we are blocked until inc0 gets us unblocked18:00
sdakei've gotta jet for a bit - so can't help18:01
*** srwilkers has quit IRC18:01
inc0sdake: I still need an answer "what breaks for k8s?":18:01
*** sambetts is now known as sambetts|afk18:02
jemcevoyTo get OVS vlans to work on CentOS 7.3 it looks like I need to stop the two openvswitch containers and run the openvswitch switch services directly on the bare metal server.  How do I stop these two containers from deploying?  inc0: can you help.  We planned to deploy at https://pod.penguincomputing.com last sunday but Neuton was not working right with vlans...18:02
inc0jemcevoy: so my question would be - why you need ovs outside container?18:03
inc0what is the problem?18:03
*** rwallner has joined #openstack-kolla18:03
jemcevoyWhen the network starts on the host and the ifcfg scripts  have the OVS in them the network service start ovs on the bare metal as the first thing it does.18:04
jemcevoythis messes up the the whole network18:05
inc0uhh there is no clean way to disable ovs but keep neutron-ovs-agend deployed18:05
jemcevoybecause OVS is already running before the docker continer for OVS starts18:05
inc0you'll run newton right?18:06
jemcevoyIt is not the neutron agent...18:06
sdakeinc0 you will have to get that answer from sbezverk as I don't have the details18:06
jemcevoyIt is the openvswitch_db and openvswitch_vswitchd containers18:06
inc0my point is, only way to just disable these two and not neutron agents is to pretty much comment this code18:07
inc0jemcevoy: https://github.com/openstack/kolla/blob/stable/newton/ansible/roles/neutron/tasks/start.yml#L2-L7518:07
*** erlon has joined #openstack-kolla18:07
inc0for newton18:07
jemcevoyYes newton 3.0.2 is what I am using...18:08
*** schwicht has joined #openstack-kolla18:08
*** rwallner has quit IRC18:08
inc0so just comment out lines I linked18:08
kfox1111inc0: I've had a 1:30-2:30pm meeting pop up. I shoudl be free after that though.18:10
inc0np, I'll give a shot sdakes notes18:10
sdakesbezverk yo dude, is this the job that is breaking? http://logs.openstack.org/56/438556/26/check/gate-kolla-kubernetes-pep8-ubuntu-xenial/dbe9c47/console.html#_2017-03-02_15_33_14_07818318:11
sdakeinc0 looking at that gate job, that looks like a pbr issue to me18:13
sdakenot sure if that is the gate that sbezverk had failure on18:13
jemcevoyinc0 that looks like it will do what I need... Thank you so much... I owe you a beer on my boss...  And we can discuss my finding from the ops perspective.  Maybe now if I can get VLANs working properly with neutron I'll be able to take a weekend off...18:13
inc0haha18:13
inc0well, I'd be interested to hear your feedback, we shouldn't need to do what you just did18:14
*** TxGirlGeek has quit IRC18:15
*** unicell has joined #openstack-kolla18:15
*** TxGirlGeek has joined #openstack-kolla18:16
*** mgoddard has joined #openstack-kolla18:16
*** lamt has quit IRC18:16
jemcevoyMy opinion is that openvswitch itself should not be in a container because kolla uses the bare metal network namespace for all its networking.  It is the common over containerization problem....18:17
inc0jemcevoy: but at the same time we generally don't touch host18:17
inc0we won't deploy ovs in this case and we should deploy ovs;)18:18
inc0we could rework our ovs config tho18:18
inc0to enable creating tagged vlans for x_interface18:19
inc0instead of specyfiying iface - give us vlan tag18:19
jemcevoyinc0 yes that is the best solution....18:19
*** rwallner has joined #openstack-kolla18:19
inc0I'll write blueprint for that18:19
inc0and target it to Pike18:20
*** TxGirlGeek has quit IRC18:20
jemcevoyMy problem was getting IPs onto the bare metal host on reboot.  I could make it work by doing manual ip link up, ip addr add but that will not work in production.  The server needs IPs when it boots18:21
*** shardy has quit IRC18:21
*** TxGirlGeek has joined #openstack-kolla18:22
openstackgerritMerged openstack/kolla master: Add the fluentd link into README.rst  https://review.openstack.org/43928318:24
mgoddardinc0, sbezverk: the gate failures on https://review.openstack.org/#/c/438556/ in the ironic jobs are due to ironic-dnsmasq, not ironic-inspector18:24
mgoddardinc0, sbezverk: http://logs.openstack.org/56/438556/26/experimental/gate-kolla-kubernetes-deploy-centos-source-3-ironic-nv/308cd79/console.html18:25
*** crushil has joined #openstack-kolla18:25
openstackgerritMerged openstack/kolla-ansible master: Set default value for osds/osd_ids facts when facts not set  https://review.openstack.org/43850318:27
openstackgerritMerged openstack/kolla-ansible master: Update the link in README.rst  https://review.openstack.org/43928118:27
openstackgerritMerged openstack/kolla-ansible master: philosophy example on customization is incorrect  https://review.openstack.org/43997018:27
openstackgerritMerged openstack/kolla-ansible master: Fix designate deploy/genconfig  https://review.openstack.org/43842018:27
openstackgerritMerged openstack/kolla-ansible master: Fix Creating Panko MongoDB database failed  https://review.openstack.org/43840818:27
mgoddardsbezverk: I think your problem is here: http://logs.openstack.org/56/438556/26/experimental/gate-kolla-kubernetes-deploy-centos-source-3-ironic-nv/308cd79/logs/pods/kolla-ironic-dnsmasq-kvzm3-initialize-ironic-dnsmasq.txt18:27
sdakemgoddard could also be pbr, that changed today as well18:31
sdakemgoddard although that patch set 26 is definately busted18:31
*** lucasxu has joined #openstack-kolla18:32
mgoddardsdake: given that that review is actually changing k8s ironic deployment and the failure looks unrelated to inspector is my change safe (until a more consistent approach is found)?18:33
sdakemgoddard sbezverk 's latest patch set busted: https://review.openstack.org/#/c/438556/26..2918:33
sdakemgoddard i'd like to get feedback from sbezverk before we backport a bunch of changes18:33
mgoddardsdake: sure18:34
*** TxGirlGeek has quit IRC18:35
*** TxGirlGeek has joined #openstack-kolla18:37
*** schwicht has quit IRC18:43
*** mgoddard has quit IRC18:51
*** mgoddard has joined #openstack-kolla18:52
*** salv-orl_ has joined #openstack-kolla18:52
*** crushil has quit IRC18:53
*** crushil has joined #openstack-kolla18:53
*** sdake_ has joined #openstack-kolla18:54
sbezverksdake: mgoddard: do you have in image for me to test?18:54
*** salv-orlando has quit IRC18:55
*** sdake has quit IRC18:55
sbezverkgents the failure you see pep8 (I was told) is not related to our software, other project are also seeing the same issue..18:56
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855618:58
*** eaguilar has quit IRC18:59
mgoddardsbezverk: do you want binary or source?19:03
mgoddardsbezverk: I'm really not doing anything magic - you should be able to build the image yourself19:03
*** krtaylor has joined #openstack-kolla19:05
mgoddardsbezverk: sdake says you have a gate job that is currently failing due to the inspector build. Is that true or is it a case of crossed wires?19:05
*** manheim_ has joined #openstack-kolla19:05
openstackgerritMerged openstack/kolla master: Add trove and sahara dashboard ubuntu binary  https://review.openstack.org/42653319:05
*** adrian_otto has quit IRC19:07
openstackgerritMerged openstack/kolla master: Updated from global requirements  https://review.openstack.org/43772819:07
*** ntpttr_ has quit IRC19:07
*** manheim_ has quit IRC19:09
sbezverkmgoddard: I had to use a custom image to get going at the gate19:14
*** adrian_otto has joined #openstack-kolla19:15
rwellum_sdake_, I am getting an issue with the tunnel line in cloud.yaml19:17
rwellum_      tunnel_interface: eth019:17
rwellum_Error: failed to parse ./cloud.yaml: error converting YAML to JSON: yaml: line 49: did not find expected key19:17
*** lucasxu has quit IRC19:18
*** sayantan_ has quit IRC19:19
*** lucasxu has joined #openstack-kolla19:19
*** sayantan_ has joined #openstack-kolla19:19
*** eaguilar has joined #openstack-kolla19:19
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Update Bifrost documentation  https://review.openstack.org/42684119:22
*** srwilkers has joined #openstack-kolla19:23
*** sayantan_ has quit IRC19:23
*** adrian_otto has quit IRC19:23
*** sayantan_ has joined #openstack-kolla19:23
mgoddardsbezverk: ok, could you point me to the logs where it failed? also, how was the image custom?19:24
*** srwilkers has quit IRC19:24
*** sdake_ has quit IRC19:24
*** adrian_otto has joined #openstack-kolla19:24
*** schwicht has joined #openstack-kolla19:27
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Update Multinode deployment of kolla guide  https://review.openstack.org/42685219:27
*** srwilkers has joined #openstack-kolla19:29
*** fooliouno has quit IRC19:35
*** lamt has joined #openstack-kolla19:35
*** lamt has quit IRC19:36
*** lamt has joined #openstack-kolla19:37
*** MasterOfBugs has joined #openstack-kolla19:37
sbezverkmgoddard: I already gave you the error message and my Docker file..19:42
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Update Bifrost documentation  https://review.openstack.org/42684119:42
*** rwallner has quit IRC19:44
sbezverkmgoddard: Look at it from different perspective, you pushed the fix and you have to make sure it does not break anything, it is kind of your reponsibility to do since you are the submitter. I can test to validate, but it has to be driven by you...19:44
*** adrian_otto has quit IRC19:45
*** ipsecguy has joined #openstack-kolla19:45
*** ipsecguy_ has quit IRC19:47
*** Serlex has quit IRC19:50
*** rwallner has joined #openstack-kolla19:52
*** eaguilar_ has joined #openstack-kolla19:55
*** eaguilar has quit IRC19:56
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Update Bifrost documentation  https://review.openstack.org/42684120:04
*** bpattewar has joined #openstack-kolla20:04
openstackgerritTim Clark proposed openstack/kolla-kubernetes master: Adding ironic service chart  https://review.openstack.org/43983820:05
*** rwallner has quit IRC20:05
*** rwallner has joined #openstack-kolla20:07
*** rwallner has quit IRC20:07
*** rwallner has joined #openstack-kolla20:08
sayantan_Can I please have some eyes on https://review.openstack.org/#/c/426852/ ?20:11
openstackgerritMerged openstack/kolla-ansible master: Updated from global requirements  https://review.openstack.org/43830620:14
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855620:15
*** srwilkers has quit IRC20:22
*** lamt has quit IRC20:23
*** athomas has quit IRC20:24
*** sayantan_ has quit IRC20:24
*** sayantan_ has joined #openstack-kolla20:24
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Deployment Guide  https://review.openstack.org/42796520:25
*** lamt has joined #openstack-kolla20:25
*** JoseMello has quit IRC20:25
kfox1111wow... docker enterprise edition and community edition...20:28
kfox1111why does the buisness world keep trying to use a buisness model that tends to fail frequently... :/20:28
openstackgerritBalaji G Pattewar proposed openstack/kolla-kubernetes master: Helm charts for heat/heat-cfn create user and endpoints.  https://review.openstack.org/41449620:32
*** TxGirlGeek has quit IRC20:33
*** sayantan_ has quit IRC20:34
*** sayantan_ has joined #openstack-kolla20:35
*** sayantan_ has quit IRC20:36
mgoddardsbezverk: I agree that it's my responsibility to validate my change. I'm just trying to get the information I need to do so. I'm concerned that there are several threads of conversation here and I want to clarify everything. Yesterday you were trying to cherry pick my change to newton. Today we are talking about a kolla-k8s patch you are working on. I thought the dockerfile and error message were for the newton backport, or am I20:36
mgoddardwrong?20:36
*** sayantan_ has joined #openstack-kolla20:36
sbezverkmgoddard: ok for my k8s patch, which is for ironic inspector I needed kolla's ironic-inspector image20:39
sbezverksince in k8s we use only stable newton,20:40
sbezverkthat is what triggered all this20:40
sbezverkmgoddard: the error I gave you earlier was from the image I build based on stable newton and your fix20:41
*** srwilkers has joined #openstack-kolla20:42
sbezverkthe docker file is what worked for me20:42
sbezverkto move forward20:42
*** rwallner has quit IRC20:42
sbezverksince my ultimate goal was not get backports but to get ironic inspector being tested in k8s gates20:42
*** rwallner has joined #openstack-kolla20:43
mgoddardsbezverk: ok I think I understand. Still, I haven't pushed any changes to stable/newton so I can't have broken kolla-k8s, can I? Surely it was always broken, but might (or might not) be fixed by my change?20:43
mgoddardsbezverk: anyway, let's move on and try to fix it20:44
sbezverkmgoddard: yes, there is a good chance it was broken before, it is just when I tried your fix did not unbroken it ;) that is why sdake asked you to investigate.20:44
sbezverkmgoddard: basically to confirm, I need somehow to get stable newton image with two fixes, because just yours is not sufficient as it is missing bootstrap script20:46
sbezverkI cannot build images now as I my dev env is k8s based20:46
sbezverkmgoddard: I was hoping maybe sdake could do it..20:47
*** DFFlanders has joined #openstack-kolla20:47
mgoddardsbezverk: I'll build an image and push it to dockerhub20:48
mgoddardsbezverk: centos/source, right?20:48
*** sayantan_ has quit IRC20:49
*** sayantan_ has joined #openstack-kolla20:49
sbezverkmgoddard: if you can do ubuntu too great, if not centos is sufficient to confirm your fix. please use tag 3.0.3-beta.220:51
sbezverkand it has to be stable/netwon please20:51
*** eaguilar_ has quit IRC20:52
*** salv-orl_ has quit IRC20:54
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855620:54
*** crushil has quit IRC20:56
*** crushil has joined #openstack-kolla20:57
*** sayantan_ has quit IRC20:57
*** sayantan_ has joined #openstack-kolla20:58
*** rwallner has quit IRC21:03
mgoddardsbezverk: docker.io/markgoddard/ubuntu-source-ironic-inspector:3.0.3-beta.2 and docker.io/markgoddard/centos-source-ironic-inspector:3.0.3-beta.221:03
*** rwallner has joined #openstack-kolla21:07
*** rwallner_ has joined #openstack-kolla21:08
sbezverkmgoddard: great thank you, will test them on my next run.. both fixes are there, right?21:08
mgoddardsbezverk: yes, those images contain both fixes21:09
mgoddardsbezverk: signing off now. If you want to send any results/information my email is mark@stackhpc.com.21:09
*** sayantan_ has quit IRC21:09
*** sayantan_ has joined #openstack-kolla21:09
*** eaguilar has joined #openstack-kolla21:10
*** rwallner has quit IRC21:11
*** rwallner_ has quit IRC21:13
sbezverkmgoddard: thanks a lot , have a good one21:15
openstackgerritMerged openstack/kolla-ansible master: Disable unneeded fact gathering  https://review.openstack.org/43788121:15
kfox1111portdirect: ping21:17
*** mgoddard has quit IRC21:17
*** TxGirlGeek has joined #openstack-kolla21:18
*** srwilkers has quit IRC21:19
*** adrian_otto has joined #openstack-kolla21:21
financeManni got nova get-password all setup but how do i run it so it shows my passwords21:22
*** lamt has quit IRC21:22
openstackgerritBalaji G Pattewar proposed openstack/kolla-kubernetes master: Helm charts for heat/heat-cfn create user and endpoints.  https://review.openstack.org/41449621:23
financeMannheres the output www.pastebin.com/C6eQbmst21:24
financeMannsbezverk ?21:24
financeMannMAYBE I can just set21:26
sbezverkfinanceMann: not sure really..21:26
sbezverknever used that get-password before..21:27
financeMannwhere would i put “OPENSTACK_ENABLE_PASSWORD_RETRIEVE = True”21:27
financeMannfor horizon21:27
jascott1kfox1111 this is interesting https://github.com/databus23/helm-diff/21:27
*** salv-orlando has joined #openstack-kolla21:28
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Deployment Guide  https://review.openstack.org/42796521:28
sbezverkfinanceMann: checkthis out https://bugs.launchpad.net/charms/+source/openstack-dashboard/+bug/165189321:30
openstackLaunchpad bug 1651893 in OpenStack openstack-dashboard charm "Add option 'openstack_enable_password_retrieve' on charm" [Wishlist,Fix released] - Assigned to Frode Nordahl (fnordahl)21:30
financeMannsbezverk cool how do i enable that in kolla?21:30
openstackgerritTim Clark proposed openstack/kolla-kubernetes master: Adding ironic service chart  https://review.openstack.org/43983821:31
*** eaguilar has quit IRC21:32
*** TxGirlGeek has quit IRC21:32
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855621:34
jemcevoyinc0 & SamYaple I have all my neutron connectivity and recover after a reboot working on CentOS 7.3 with the openvswitch service running on the bare metal server and the two docker containers openvswitch_vswitchd and openvswitch_db removed.  I am also using a flat VLAN and all works great... 0.1 ms pings all around including floating IPs.   But no jumbo frames. MTU is stuck at 1500...21:36
jemcevoyIn which container is the mtu detected...21:36
kfox1111jascott1: very cool. thanks for the pointer. in a meeting so cant look at it closely yet. But will soon. :)21:38
inc0kolla cores, can I have eyes on https://review.openstack.org/#/c/427965/10 please?21:39
sbezverkfinanceMann: good question, it does not look like it is exposed in the config file..21:39
inc0jemcevoy: uhh...which interface failed to re-discover mtu?21:40
jemcevoymy whole 10Gig network has an MTU of 900021:40
jemcevoyI'll paste my ip addr show and ova-vsctl show21:41
*** jrobinson has joined #openstack-kolla21:43
openstackgerritSayantani Goswami proposed openstack/kolla-ansible master: Deployment Guide  https://review.openstack.org/42796521:44
*** dave-mccowan has quit IRC21:44
jemcevoyinc0  network on vmhost1  http://paste.openstack.org/show/601192/21:45
jemcevoybr-10gig is the OVS bridge with my vlan provider networking21:46
inc0looks like 9k..21:48
*** wirehead_ has quit IRC21:55
jemcevoyDoes cirros do jumbo frames?   I will try a CentOS vm21:55
financeMannso guys, /etc/kolla/horizon/horizon.conf HOW do I change a setting in that file and have my open-stack pick it up? Seems like kolla keeps overriding it? and it’s a setting that apparently kolla dont support yet21:55
financeMannwhich blows my mind since i should be able to override anything i want21:55
jemcevoyTries CentOS and it just gets an mtu of 1500 [jmcevoy@ops1 ~]$ ssh centos@10.110.4.921:59
jemcevoyWarning: Permanently added '10.110.4.9' (ECDSA) to the list of known hosts.21:59
jemcevoy[centos@centos001 ~]$ ip a21:59
jemcevoy1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 121:59
jemcevoy    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:0021:59
jemcevoy    inet 127.0.0.1/8 scope host lo21:59
jemcevoy       valid_lft forever preferred_lft forever21:59
jemcevoy    inet6 ::1/128 scope host21:59
jemcevoy       valid_lft forever preferred_lft forever21:59
jemcevoy2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 100021:59
jemcevoy    link/ether fa:16:3e:f9:37:3d brd ff:ff:ff:ff:ff:ff21:59
jemcevoy    inet 172.30.0.6/20 brd 172.30.15.255 scope global dynamic eth021:59
jemcevoy       valid_lft 86353sec preferred_lft 86353sec21:59
jemcevoy    inet6 fe80::f816:3eff:fef9:373d/64 scope link21:59
jemcevoy       valid_lft forever preferred_lft forever21:59
qwanginc0: meeting link?22:00
inc0qwang: I'm trying to set my k8s kluster up22:00
inc0cloud1 hates me today22:00
inc0vms are timing out like crazy22:00
qwangoh, i forgot it is tmux session22:01
inc0still, regardless how we do it22:01
inc0we need working k8s before that;)22:01
*** wirehead_ has joined #openstack-kolla22:02
financeManninc0 how do i set a horizon conf setting without it gettin blown away or how do i set it so it runs22:02
financeMannneed to set OPENSTACK_ENABLE_PASSWORD_RETRIEVE = True22:02
*** fguillot has quit IRC22:05
*** sayanta__ has joined #openstack-kolla22:06
*** wirehead_ has quit IRC22:06
SamYaplefinanceMann: are you injecting passwords? thats not enabled by default22:07
SamYapledoesnt work so well or with most stoage backends22:07
financeMannthe instance created itself the password22:07
financeMannSamYaple22:07
financeMannwindows 201222:07
financeManngenerated it22:08
*** sayantan_ has quit IRC22:08
inc0financeMann: you need to change file in kolla-ansible/roles/horizon/templates/local.conf.j2 and add this var22:09
inc0then run kolla-ansible reconfigure22:09
financeMannwhich var22:09
sbezverkSamYaple: do you use dnsmasq by any chance?22:10
financeManninc0 where is kolla-ansible/roles/ located?22:12
financeManni cant find it22:12
jemcevoyinc0 and SamYaple:  I found something... The entry I have in my kolla config did not make it to the containers....22:12
jemcevoy$ cat /etc/kolla/config/neutron/neutron.conf22:12
jemcevoy[DEFAULT]22:12
jemcevoyverbose = False22:12
jemcevoyglobal_physnet_mtu = 900022:12
inc0financeMann: wich version of kolla?22:12
jemcevoyBut the ml2_conf.ini file changes made it to the containers///22:13
inc0jemcevoy: you did config override?22:13
SamYaplesbezverk: yes22:14
SamYaplejemcevoy: /etc/kolla/config/neutron.conf22:14
jemcevoyI put updated I wanted into a few files in /etc/kolla/config/neutron/ directory before deploy22:15
SamYaplejemcevoy: you have the wrong file22:15
*** manheim_ has joined #openstack-kolla22:15
inc0yeah SamYaple is right22:15
jemcevoyDo I need to do anthing more than than that22:15
*** wirehead_ has joined #openstack-kolla22:15
inc0jemcevoy: it's not /etc/kolla/neutron/neutorn.conf its /etc/kolla/neutron.conf22:15
inc0good catch SamYaple22:16
sbezverkSamYaple: when I start it for ironic it is complaining about inconsistent dhcp range but it is consistent. I was wondering if you saw something like that?22:16
SamYapledont listen to inc0, he also said the wrong file22:16
SamYaplejemcevoy: put settings in /etc/kolla/config/neutron.conf22:16
inc0my god -.-22:16
inc0yeah, you're right22:16
jemcevoyThe file I cat'd above looks like the right one, no?22:16
*** crushil has quit IRC22:17
inc0jemcevoy: it looks right, just it's in wrong place;)22:17
SamYaplejemcevoy: /etc/kolla/config/neutron/neutron.conf != /etc/kolla/config/neutron.conf22:17
sbezverkSamYaple: dhcp-range=net2,172.22.0.10,172.22.0.20,255.255.255.0,24h22:17
*** krtaylor has quit IRC22:17
SamYaplesbezverk: since this is all backed by a database i find it hard to believe its inconsistent. i blame another dhcp server running on the network22:17
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla-ansible master: Enable external openvswitch  https://review.openstack.org/44083422:17
*** TxGirlGeek has joined #openstack-kolla22:17
*** rwellum_ has quit IRC22:18
jemcevoyOK thanks... this will fix my pci_passthru problem too.... I'll move /etc/kolla/config/nova/nova.conf up a level.22:18
*** rwellum_ has joined #openstack-kolla22:18
inc0lol22:18
*** manheim_ has quit IRC22:20
SamYaplejemcevoy: yea read that as /etc/kolla/config/<project>.conf and /etc/kolla/config/<service-name>/<project>.conf22:20
inc0probably that wasn't ideal idea22:21
inc0but here we are22:21
SamYapleno. its the only logical way to do it. there was alot of talk about it22:21
inc0yeah, can't remember really22:21
jemcevoyAm I correct here?  /etc/kolla/config/neutron/ml2_conf.ini  and  /etc/kolla/config/neutron/ml2_conf.ini22:21
SamYaple/etc/kolla/config/<project>/<project>.conf makes no sense22:21
inc0jemcevoy: these are correct22:21
SamYaplejemcevoy: https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/neutron/tasks/config.yml#L120-L12322:22
SamYaplemostly just because we have teh service overrides too22:22
SamYaplebut hey, we can just add a line and read from both places. its no additional overhead22:22
sbezverkSamYaple: hmm, it is running at the gate ;) but who knows these gates22:22
jemcevoySo now just a kolla-ansible -i inventory/delta reconfigure and I'll have a working cluster???22:23
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855622:25
*** rwellum_ has quit IRC22:25
inc0jemcevoy: well...let's not get ahead of ourselves:P but that should fix it22:26
inc0btw jemcevoy I submitted a patch to remove need of meddling with code if you want external ovs22:27
*** schwicht has quit IRC22:27
financeManninc0 stale version22:28
financeMannlol stable i mean22:30
financeMannstable branch22:30
jemcevoyinc0:  Commenting out the first 75 lines worked...  :-)  how do I grab your patch?22:31
*** rhallisey has quit IRC22:31
*** rwallner has joined #openstack-kolla22:34
*** Margin has joined #openstack-kolla22:35
Marginhi, I open a new bug https://bugs.launchpad.net/kolla/+bug/166959922:35
openstackLaunchpad bug 1669599 in kolla "failed to deploy neutron service when sysctl " [Undecided,New]22:35
inc0jemcevoy: I'd suggest not grabbing it because it'll land in master22:37
inc0you'll get it after upgrade to pike;)22:38
jemcevoySamYaple:  One more question.... How do I target the following to just the hypervisors that gave nVidia Grid cards?  nova.conf22:38
jemcevoy[DEFAULT]22:38
jemcevoypci_alias={"vendor_id":"10de","product_id":"11bf", "name":"K2_Grid"}22:38
jemcevoypci_passthrough_whitelist={"vendor_id":"10de","product_id":"11bf"}22:38
*** rwallner has quit IRC22:38
financeManninc0 i cant find kolla-ansible/roles/horizon/templates/local.conf.j2 anywhere not any local.conf.j2 files it looks like22:39
inc0jemcevoy: /etc/kolla/config/nova/<<hostname>>/nova.conf22:39
inc0financeMann: if it's latest stable, it will be in your kolla dir22:40
jemcevoyThank inc022:40
financeMannlike /root/kolla-git/kolla22:40
financeManninc022:40
inc0then ansible/roles/horizon/templates/local_settings.j222:40
SamYaplejemcevoy: you should be able to target with glance metadata on the image and/or flavor. i dont remember which and have not personally done it22:42
inc0SamYaple: I think question was how to make host-specific overrides22:43
SamYapleah22:43
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855622:47
*** salv-orlando has quit IRC22:51
*** salv-orlando has joined #openstack-kolla22:51
kfox1111inc0: ping22:54
inc0kfox1111: I think we'll need to move this little op in tume22:54
inc0time22:54
inc0my k8s cluster went retart22:54
inc0retard22:54
kfox1111kk22:54
inc0and kargo hates me today22:54
*** breitz has quit IRC23:01
*** schwicht has joined #openstack-kolla23:01
*** breitz has joined #openstack-kolla23:02
sbezverkkfox1111: I saw a kubernetes X-File today :)23:02
financeManninc0 does this look good www.pastebin.com/vL3Gy0MM23:02
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes master: WIP Adding ironic inspector microservices  https://review.openstack.org/43855623:04
jemcevoyYes Yes Yes!!!!23:04
jemcevoyNetwork Overview23:04
jemcevoyName23:04
jemcevoyFlatNet23:04
jemcevoyID23:04
jemcevoyf19d0760-4d91-4ea6-b049-30cbc41a4cf523:04
jemcevoyProject ID23:04
jemcevoycf75b9651dea4158b5ce196aab4d273123:04
jemcevoyStatus23:04
jemcevoyActive23:04
jemcevoyAdmin State23:04
jemcevoyUP23:04
jemcevoyShared23:04
jemcevoyYes23:04
jemcevoyExternal Network23:04
jemcevoyNo23:04
jemcevoyMTU23:04
jemcevoy900023:04
jemcevoyProvider Network23:04
jemcevoyNetwork Type: vlan23:04
jemcevoyPhysical Network: physnet123:04
jemcevoySegmentation ID: 11023:04
kfox1111sbezverk: yeah?23:05
*** krtaylor has joined #openstack-kolla23:05
kfox1111jemcevoy: congrats. :)23:05
sbezverkkfox1111: yep I was passing this line net2,172.22.0.10,172.22.0.20,255.255.255.0,24h as a parameter but unexplicably  it got rendered into net2,172.22.0.10,172.23.0.20,255.255.255.0,24h23:06
sbezverkI check everything and I never had 172.23 ever23:06
financeMannsbezverk does this look correct to you www.pastebin.com/vL3Gy0MM23:07
kfox1111sbezverk: weird.23:07
sbezverkso I moved it from all_values.yaml to workflow config script generator and now waiting for result23:07
sbezverkif it works there, I will go back to see if I can reproduce it23:08
*** sayanta__ has quit IRC23:08
*** sayantan_ has joined #openstack-kolla23:08
*** sdake has joined #openstack-kolla23:09
sbezverkfinanceMann: as I said I have never tried it before, but it look reasonable to me23:09
*** Margin has quit IRC23:09
financeManngood good a reasonable config for a reasonable man23:10
inc0financeMann: wrong file23:10
inc0you need local_config.j223:11
financeMannthere isnt one23:11
financeManndo i need to make it?23:11
financeMannthat config crashes my kolla openstack deployment now lol23:11
inc0local_settings, sorry23:11
financeMannrevertin23:11
inc0https://github.com/openstack/kolla/blob/stable/newton/ansible/roles/horizon/templates/local_settings.j223:11
inc0this one23:11
financeMannOH23:11
financeManni know that one23:11
inc0jemcevoy: glad you got it working :)23:12
*** adrian_otto has quit IRC23:16
*** yuanying_ has joined #openstack-kolla23:18
*** sdake has quit IRC23:18
*** oomichi has quit IRC23:18
*** sdake has joined #openstack-kolla23:19
*** yuanying has quit IRC23:20
sdakesup humans23:20
*** saneax-_-|AFK is now known as saneax23:20
sdakedid folks get further in the deployment docs?23:20
*** oomichi has joined #openstack-kolla23:21
inc0sdake: my k8s is fubared:()23:21
inc0fighting to redeploy, but I'll probably do it over weekend23:21
sdakeya the docs are tricky - as they need developers to debug23:21
inc0brain is fried23:21
sdakei'd try out a vm for now23:21
sdakeso its eas yto get back to a good starting place23:22
inc0well, I'm not using vagrant23:22
*** lucasxu has quit IRC23:22
sbezverkinc0: you have great ability to kill k8s clusters ;)23:22
inc0I need to figure out good way to deploy multinode23:22
inc0right now it's k8s cluster that's killing me23:22
inc0but that's just technology around me, it breaks23:22
inc0call it aura of operator23:22
sdakei see23:23
sdakewell multinode is hard - two vms should make that easier23:23
sdakekubeadm takes a token23:23
sdakeand the token is used to sync them together23:23
inc0I'm fighting with kargo23:24
inc0all the stuff I'll learn will be useful later23:24
*** erlon has quit IRC23:25
bpattewarI am working on heat micro-services.  I am looking for files to add configmaps so that heat related microservices pass jekins build.23:26
bpattewarwhich files I need to modify to add configmaps for heat ?23:27
sbezverkbpattewar: you need to check a few places23:29
sbezverkbpattewar: etc/kolla-kubernetes/service-resource.yml23:30
sbezverkbpattewar: need to check if genconfig generates them23:30
sbezverkbpattewar: basically you need to see heat related folder in /etc/kolla23:31
*** schwicht has quit IRC23:31
sbezverkif you do not, then your global.yml probably does not have heat enabled23:31
bpattewarsbezverk I see heat related folder after genconfig, but I found my "kollakube res create configmap heat-api" fails with error configmap not found,23:32
*** adrian_otto has joined #openstack-kolla23:32
bpattewarsbezverk does this because of missing entry in etc/kolla-kubernetes/service-resource.yml?23:32
*** MasterOfBugs has quit IRC23:32
*** MasterOfBugs has joined #openstack-kolla23:33
*** jtriley has quit IRC23:33
sbezverkbpattewar: yes, it is very possible23:33
sbezverkbpattewar: yep, just check and it is not there in master so if you do not add it then configmap generation will fail23:34
bpattewarsbezverk I will check that23:35
*** jtriley has joined #openstack-kolla23:35
*** MasterOfBugs has quit IRC23:38
*** sp_ has joined #openstack-kolla23:39
sp_morning all23:39
sbezverkbpattewar: please use as example ironic section  in service-resource.ya23:39
*** sdake has quit IRC23:40
*** sdake_ has joined #openstack-kolla23:40
*** TxGirlGeek has quit IRC23:41
*** sayanta__ has joined #openstack-kolla23:42
*** sayantan_ has quit IRC23:42
portdirectinc0: if you need a hand I could help you set up a k8s cluster with kubeadm - super easy23:49
kfox1111yeah. kubeadm is super easy for testing with.23:49
kfox1111portdirect: ever upgrade a production k8s yet? can you run different versions of kubelet and control plane without loosing pods?23:50
jemcevoy inc0 kfox1111 SamYaple It worked all the way through:23:50
jemcevoy[centos@centos001 ~]$ ip link show eth023:50
jemcevoy2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc pfifo_fast state UP mode DEFAULT qlen 100023:50
jemcevoythanks for all the help23:51
*** sdake_ has quit IRC23:53
portdirectkfox1111: yes and no - I've done a lot of 0.0.X upgrades but never had to do 0.X.0's23:53
kfox1111k. yeah. thats what I'm wondering about.23:54
britthouserdocs I've read said kubectl needs to be &gt;= master control services23:55
portdirectfor that I've been on someone else's turf (public cloud) so moving sideways was easy23:55
kfox1111I've got a 1.3.6 thats getting rather long in the tooth.23:55
britthouserI've been playing with self-hosted master services, which is kinda cool23:55
portdirect^^ interested23:55
portdirectbritthouser: as in kok?23:56
britthouserThere is a youtube of CO k8s meetup showing self hosted using23:56
britthouser bootkube23:56
*** jmccarthy has quit IRC23:56
kfox1111britthouser: yeah? having good luck with it?23:56
britthouserYes...master services are host inside the k8s cluster23:56
britthouseryeah its pretty nifty23:57
kfox1111britthouser: I'm very interested in getting some of that into helm charts.23:57
kfox1111helm upgrade kube-apiserver :)23:57
britthouserYou gotta have a 'seed' of some kind to get started.23:57
kfox1111helm upgrade cannal23:57
kfox1111helm upgrade kube-dashboard23:57
kfox1111etc. :)23:57
britthouserbut once they are in the cluster, you can do upgrade etc just like any other service23:57
kfox1111a set of static pods should work for that case I think.23:57
portdirectlol - helm delete --purge kube-dashboard ;)23:57
kfox1111I just got tiller working as a static pod yesterday. :)23:58
britthouserslick!23:58
britthouserI've wanted to run openstack like that for years.23:58
kfox1111me too.23:58
kfox1111hoped trippleo would make it work.23:59
britthouserRun the MariaDB for all the services in Trove.23:59
kfox1111but the rest of the project silo's didn't want to suppor the use case I think. :/23:59
portdirectbritthouser: I tried that bad times23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!