Monday, 2016-08-22

*** rkrum has joined #openstack-kolla00:00
*** zhurong has quit IRC00:06
*** dmueller-evoila has joined #openstack-kolla00:23
*** dmueller-evoila has quit IRC00:28
*** fragatina has joined #openstack-kolla00:43
*** duonghq has joined #openstack-kolla00:45
*** dave-mccowan has joined #openstack-kolla01:02
*** dave-mccowan has quit IRC01:02
*** salv-orlando has joined #openstack-kolla01:06
*** salv-orlando has quit IRC01:08
*** zhurong has joined #openstack-kolla01:13
*** HyperJohnGraham has quit IRC01:35
*** fragatin_ has joined #openstack-kolla01:43
*** fragatina has quit IRC01:47
*** salv-orlando has joined #openstack-kolla02:16
*** salv-orlando has quit IRC02:19
*** Jeffrey4l has joined #openstack-kolla02:24
*** daneyon has joined #openstack-kolla02:46
*** yuanying has quit IRC02:46
*** daneyon has quit IRC02:50
*** yuanying has joined #openstack-kolla02:50
*** kbaegis has quit IRC03:12
openstackgerritDuong Ha-Quang proposed openstack/kolla: [wip] Add Ansible become to quick start guide  https://review.openstack.org/35837403:12
*** chrichip has quit IRC03:23
*** chrichip has joined #openstack-kolla03:23
*** salv-orlando has joined #openstack-kolla03:26
*** salv-orlando has quit IRC03:33
*** HyperJohnGraham has joined #openstack-kolla03:40
*** ayoung has quit IRC03:43
*** yuanying has quit IRC03:45
*** yuanying has joined #openstack-kolla03:48
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Update Dockerfiles for footer related changes  https://review.openstack.org/35774603:52
openstackgerritTin Lam proposed openstack/kolla: Fix typo in iscsi pull playbook  https://review.openstack.org/35839004:07
openstackgerritHui Kang proposed openstack/kolla: Add etcd container  https://review.openstack.org/35515604:10
duonghqPavo: are you there?04:12
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/kolla: Vagrant doc updates  https://review.openstack.org/35324004:23
*** michauds has joined #openstack-kolla04:34
*** salv-orlando has joined #openstack-kolla04:36
*** david-lyle has quit IRC04:37
*** salv-orlando has quit IRC04:43
*** diga has joined #openstack-kolla04:44
*** fragatina has joined #openstack-kolla05:20
*** fragatin_ has quit IRC05:20
*** aswadr_ has joined #openstack-kolla05:22
*** HyperJohnGraham has quit IRC05:39
*** diga has quit IRC05:44
*** cloudnull has quit IRC05:46
*** irtermite has quit IRC05:46
*** salv-orlando has joined #openstack-kolla05:46
*** salv-orlando has quit IRC05:54
*** duonghq has quit IRC05:57
*** caowei has joined #openstack-kolla05:58
*** duonghq has joined #openstack-kolla05:59
*** senk has joined #openstack-kolla06:01
*** salv-orlando has joined #openstack-kolla06:07
*** cloudnull has joined #openstack-kolla06:07
*** michauds has quit IRC06:15
*** coolsvap has joined #openstack-kolla06:15
*** coolsvap has quit IRC06:16
*** coolsvap has joined #openstack-kolla06:16
*** zhiwei has joined #openstack-kolla06:25
*** ad_rien_ has quit IRC06:31
openstackgerritDuong Ha-Quang proposed openstack/kolla: Check if ansible_user is in docker group  https://review.openstack.org/35843206:57
*** ad_rien_ has joined #openstack-kolla07:01
*** duonghq has quit IRC07:02
*** Mr_Broken has joined #openstack-kolla07:02
*** egonzalez90 has joined #openstack-kolla07:03
egonzalez90morning o/07:03
*** zhurong has quit IRC07:09
*** zhurong has joined #openstack-kolla07:13
*** narasimha_SV has joined #openstack-kolla07:14
openstackgerritDuong Ha-Quang proposed openstack/kolla: Check if ansible_user is in docker group  https://review.openstack.org/35843207:15
narasimha_SVafter adding dockerfile for ironic to create /var/lib/ironic folder with ironic user permission07:15
narasimha_SVstill I see that folder is not getting created.07:15
*** salv-orl_ has joined #openstack-kolla07:15
narasimha_SVi tried by editing in ironic-base and also ironic-conductor docker files07:15
*** duonghq has joined #openstack-kolla07:16
*** daneyon has joined #openstack-kolla07:16
*** salv-orlando has quit IRC07:18
*** bootsha has joined #openstack-kolla07:19
*** daneyon has quit IRC07:21
duonghqPavo, kbaegis: anybody there?07:26
*** b_bezak has joined #openstack-kolla07:30
*** salv-orl_ has quit IRC07:32
*** berendt has joined #openstack-kolla07:33
*** rkrum has quit IRC07:34
*** bootsha has quit IRC07:36
*** narasimha_SV has quit IRC07:37
egonzalez90narasimha_SV, PS link?07:47
openstackgerritJeffrey Zhang proposed openstack/kolla: DO NOT MERGE: TEST UBUNTU MULTIGATE  https://review.openstack.org/32630708:06
*** matrohon has joined #openstack-kolla08:06
openstackgerritWei Cao proposed openstack/kolla: Add solum container  https://review.openstack.org/35540808:07
*** gfidente has joined #openstack-kolla08:08
*** athomas has joined #openstack-kolla08:10
*** salv-orlando has joined #openstack-kolla08:14
*** coolsvap is now known as _coolsvap_08:18
*** bootsha has joined #openstack-kolla08:26
*** Serlex has joined #openstack-kolla08:31
*** yuanying has quit IRC08:34
*** yuanying has joined #openstack-kolla08:35
*** papacz has quit IRC08:35
*** Mr_Broken has quit IRC08:42
*** Mr_Broken has joined #openstack-kolla08:43
*** yuanying has quit IRC08:47
*** qbjolof has quit IRC08:48
*** qbjolof has joined #openstack-kolla08:48
*** yuanying has joined #openstack-kolla08:49
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix Ubuntu binary build and deploy gate  https://review.openstack.org/35848808:59
*** daneyon has joined #openstack-kolla09:05
*** daneyon has quit IRC09:09
*** Guest_48844 has joined #openstack-kolla09:18
*** pbourke has joined #openstack-kolla09:18
*** bootsha has quit IRC09:20
*** bootsha has joined #openstack-kolla09:23
*** pbourke has quit IRC09:25
*** athomas has quit IRC09:29
*** athomas has joined #openstack-kolla09:34
openstackgerritWei Cao proposed openstack/kolla: Add solum container  https://review.openstack.org/35540809:48
*** Guest_48844 has quit IRC09:49
*** Guest_48844 has joined #openstack-kolla09:51
Guest_48844allah is doing09:51
Guest_48844sun is not doing allah is doing09:51
Guest_48844moon is not doing allah is doing09:51
Guest_48844stars are not doing allah is doing09:51
berendtGuest_48844 go ahead09:51
Guest_48844planets are not doing allah is doing09:51
Guest_48844galaxies are not doing allah is doing09:52
Guest_48844oceans are not doing allah is doing09:52
Guest_48844mountains are not doing allah is doing09:52
Guest_48844trees are not doing allah is doing09:52
Guest_48844mom is not doing allah is doing09:52
Guest_48844dad is not doing allah is doing09:53
Guest_48844boss is not doing allah is doing09:53
Guest_48844job is not doing allah is doing09:53
Guest_48844dollar is not doing allah is doing09:53
Guest_48844degree is not doing allah is doing09:53
Guest_48844medicine is not doing allah is doing09:53
Guest_48844customers are not doing allah is doing09:53
Guest_48844you can not get a job without the permission of allah09:54
Guest_48844you can not get married without the permission of allah09:54
Guest_48844nobody can get angry at you without the permission of allah09:55
Guest_48844light is not doing allah is doing09:55
Guest_48844fan is not doing allah is doing09:55
Guest_48844businessess are not doing allah is doing09:55
Guest_48844america is not doing allah is doing09:56
berendtsombody here who can kick the spammer? it is annoying...09:56
Guest_48844fire can not burn without the permission of allah09:56
Guest_48844knife can not cut without the permission of allah09:56
Guest_48844rulers are not doing allah is doing09:56
Guest_48844governments are not doing allah is doing09:57
Guest_48844sleep is not doing allah is doing09:57
Guest_48844hunger is not doing allah is doing09:57
Guest_48844food does not take away the hunger allah takes away the hunger09:57
Guest_48844water does not take away the thirst allah takes away the thirst09:57
Guest_48844seeing is not doing allah is doing09:58
Guest_48844hearing is not doing allah is doing09:58
Guest_48844seasons are not doing allah is doing09:58
*** rkrum has joined #openstack-kolla09:58
Guest_48844weather is not doing allah is doing09:58
egonzalez90coolsvap ping09:58
Guest_48844humans are not doing allah is doing09:58
Guest_48844animals are not doing allah is doing09:58
*** zhurong has quit IRC09:58
Guest_48844the best amongst you are those who learn and then teach quran09:59
Guest_48844one letter read from book of allah amounts to one good deed and allah multiplies one good deed ten times10:00
Guest_48844hearts get rusted as does iron with water to remove rust from heart recitation of quran and rememberance of death10:00
Guest_48844heart is likened to a mirror10:01
Guest_48844when a person commits one sin a black dot sustains the heart10:01
*** rkrum has quit IRC10:02
Guest_48844to accept islam say that i bear witness that there is no deity worthy of worship except allah and muhammad peace be upon him is his slave and messenger10:03
Guest_48844read book http://www.fazaileamaal.com10:04
Guest_48844read book http://www.muntakhabahadith.com10:04
Guest_48844need spiritual teacher visit http://www.alhaadi.org.za10:05
egonzalez90berendt, just mark as ignored until some op can kick him10:05
berendtegonzalez90 this way the spam is still in the channel logs10:05
Guest_48844allah created the sky without any pillars10:05
berendtI wrote a mail to one of the guys from the freenode staff team, maybe they can help.10:06
*** FireFly has joined #openstack-kolla10:06
berendtFireFly thanks for joining, it is Guest_48844 ...10:06
*** Guest_48844 has quit IRC10:06
FireFlyWell10:06
berendtFireFly looks good. thank you!10:07
FireFlyI didn't even do anything :D10:07
FireFlyFeel free to poke me if they return10:07
berendtHmm. I thought you kicked him :)10:07
berendtMaybe it is sufficient to highlight the bot to kick him..10:07
FireFlyJudging by the nickname.. was it one of them 'allah' spammers?10:08
FireFlyor something else?10:08
berendtyes, "humans are not doing allah is doing" ...10:08
FireFlyRight10:12
*** pbourke_ has joined #openstack-kolla10:18
pbourke_#openstack-ekko10:18
openstackgerritDuong Ha-Quang proposed openstack/kolla: Specify 'become' to tasks in common and destroy roles  https://review.openstack.org/35853910:18
*** kbaegis has joined #openstack-kolla10:19
*** pbourke_ is now known as pbourke10:19
*** duonghq has quit IRC10:20
*** bootsha has quit IRC10:22
*** bootsha has joined #openstack-kolla10:23
*** imcsk8 has quit IRC10:35
*** imcsk8 has joined #openstack-kolla10:35
*** ad_rien_1 has joined #openstack-kolla10:40
*** ad_rien_ has quit IRC10:40
*** imcsk8_ has joined #openstack-kolla10:48
*** imcsk8 has quit IRC10:51
*** daneyon has joined #openstack-kolla10:53
*** nick-ma has quit IRC10:54
*** nick-ma has joined #openstack-kolla10:54
*** daneyon has quit IRC10:57
*** openstackgerrit has quit IRC11:03
*** openstackgerrit has joined #openstack-kolla11:03
openstackgerritWei Cao proposed openstack/kolla: Add solum container  https://review.openstack.org/35540811:06
*** bootsha has quit IRC11:10
*** FireFly has left #openstack-kolla11:10
*** bootsha has joined #openstack-kolla11:15
*** fragatina has quit IRC11:15
*** ajpower has quit IRC11:16
*** fragatina has joined #openstack-kolla11:16
*** afranc has quit IRC11:17
*** imcsk8_ has quit IRC11:18
*** afranc has joined #openstack-kolla11:18
*** imcsk8 has joined #openstack-kolla11:19
*** salv-orlando has quit IRC11:19
*** salv-orlando has joined #openstack-kolla11:21
*** ajpower has joined #openstack-kolla11:21
*** salv-orl_ has joined #openstack-kolla11:22
*** Guest52040 has joined #openstack-kolla11:23
*** salv-orlando has quit IRC11:25
*** zhubingbing has joined #openstack-kolla11:27
*** zhiwei has quit IRC11:29
*** openstackstatus has quit IRC11:36
*** openstackstatus has joined #openstack-kolla11:38
*** ChanServ sets mode: +v openstackstatus11:38
*** bootsha has quit IRC11:39
*** sean-k-mooneyAFK is now known as sean-k-mooney11:42
*** bootsha has joined #openstack-kolla11:43
*** kbaegis has quit IRC11:43
*** kbaegis has joined #openstack-kolla11:45
*** salv-orl_ has quit IRC11:53
*** salv-orlando has joined #openstack-kolla11:54
*** kbaegis1 has joined #openstack-kolla11:56
*** kbaegis1 has quit IRC11:56
*** kbaegis2 has joined #openstack-kolla11:56
*** kbaegis has quit IRC11:56
openstackgerritJeffrey Zhang proposed openstack/kolla: Fix Ubuntu binary build and deploy gate  https://review.openstack.org/35848812:00
*** dave-mccowan has joined #openstack-kolla12:02
*** ad_rien_1 has quit IRC12:07
*** ad_rien_ has joined #openstack-kolla12:08
*** Jeffrey4l_ has joined #openstack-kolla12:15
*** Jeffrey4l has quit IRC12:16
*** zhubingbing has quit IRC12:28
*** caowei has quit IRC12:28
*** godleon has joined #openstack-kolla12:30
*** srwilkers_ has joined #openstack-kolla12:33
*** rhallisey has joined #openstack-kolla12:37
*** daneyon has joined #openstack-kolla12:41
*** daneyon has quit IRC12:46
*** srwilkers_ has quit IRC12:49
*** salv-orlando has quit IRC12:50
*** dwalsh has joined #openstack-kolla12:51
*** dwalsh has quit IRC12:56
*** ad_rien_ has quit IRC12:57
*** egonzalez90 has quit IRC12:58
*** ad_rien_ has joined #openstack-kolla12:58
*** mgoddard has joined #openstack-kolla13:00
*** srwilkers_ has joined #openstack-kolla13:02
*** srwilkers_ has left #openstack-kolla13:02
openstackgerritPrithiv proposed openstack/kolla: Dockerfiles for collectd-ceilometer-plugin Container  https://review.openstack.org/35863213:09
*** jtriley has joined #openstack-kolla13:10
*** Guest37793 is now known as zeus13:24
*** zeus has joined #openstack-kolla13:24
*** dmueller-evoila has joined #openstack-kolla13:26
*** dmueller-evoila has quit IRC13:26
*** Guest52040 has quit IRC13:30
*** papacz has joined #openstack-kolla13:30
*** dwalsh has joined #openstack-kolla13:33
*** sould has joined #openstack-kolla13:38
*** sould has quit IRC13:45
*** inc0 has joined #openstack-kolla13:46
*** sdake has joined #openstack-kolla13:46
inc0good morning13:47
inc0hey sdake, still in the land of living?13:47
*** dwalsh has quit IRC13:47
pbourkehey inc013:47
sdakemorning peeps13:47
sdakeme sure13:47
sdakemy friend not so much13:47
inc0hey Paul, I failed at rally:/13:48
sdakeonly going tto be in a little bit  today13:48
sdakewanted to ssee where osic si13:48
pbourkeinc0: where'd you get to?13:49
inc0I ran stuff, made ~/root/rally-results13:50
*** sdake_ has joined #openstack-kolla13:50
inc0redeployed with ceph afterwards13:50
inc0but rally shown lots of errors13:50
inc0rally task list -> tons of fails13:50
pbourkedid it work before you deployed with ceph?13:51
inc0not sure, I ran tasks outputted them to file and happily moved on13:52
inc0only afterwards Ive noticed something is off13:52
inc0but issues sounded keystone-ish13:53
inc0look at tasks error log13:53
pbourkethere are a handful that fail because no cinder13:53
*** sdake has quit IRC13:53
inc0I did deploy cinder13:53
sdake_inc0 which email13:54
pbourkeinc0: looking now13:56
pbourkeinc0: unrelated but, have you ever seen neutron-openvswitch-agent having permission trouble accessing /var/run/openvswitch/db.sock13:56
inc0no13:57
pbourkeinc0: as when you look at it that file is owned by root but the container is running as neutron13:57
inc0I know sbezverk_ seen this while porting neutron to k8s13:57
inc0however I am baffled13:57
pbourkei cant even find where this is bind mounted despite it showing up on the host filesystem13:58
pbourkeinc0: anyway, it seems almost all rally failures are down the image name in glance13:58
*** sould has joined #openstack-kolla13:58
pbourkeinc0: dont see anything related to keystone13:59
inc0I added uec image13:59
*** mgoddard_ has joined #openstack-kolla13:59
pbourkeim not seeing it...14:00
*** sould has quit IRC14:01
sbezverk_inc0: remember we had similar discussion last week about the socket?14:02
*** mgoddard has quit IRC14:03
pbourkesbezverk_: what was the summary14:04
sdake_pbourke did the osic cluster suffer this permissions problem for ovs?14:04
pbourkeinc0: did you archive the results for the first scenario somewhere14:04
pbourkesdake_: no osic is ok14:05
pbourkesdake_: its in a deployment i have im seeing it14:05
inc0pbourke, yes, first dir in ~/root/rally-results14:05
sbezverk_pbourke: I noticed that neutron-ovs-agent container runs with use neutron, but ovsdb as root14:05
sbezverk_so the socket gets created with only root priv14:06
pbourkesbezverk_: yeah. so its strange it ever works14:06
sbezverk_pbourke: exactly was my qurestion to inc014:06
*** JoseMello has joined #openstack-kolla14:06
sbezverk_there is a theory that it worked because it was done via rootwrap14:06
pbourkesbezverk_: actually yeah I have something hacked around rootwrap let me check. thanks14:09
*** kbaegis2 has quit IRC14:11
*** cinerama has quit IRC14:11
pbourkeinc0: going to fix up the image name and re-run for ceph14:11
*** haplo37__ has joined #openstack-kolla14:11
inc0ok14:11
sdake_berendt around?14:13
berendtsdake_ jup14:13
sdake_sup14:13
pbourkesbezverk_: rootwrap fixed it!14:13
sdake_so re irc permissions14:13
sdake_wfm - i dont care if folks that are trusted have operator permissions14:13
sdake_but we dont run with operator permissions in channel in general14:14
berendtthe spam bot was just annoying and it would be nice if it is possible to kick/ban in such a situation14:15
sdake_right14:15
sdake_just setting groundrules :)14:15
sbezverk_pbourke: great, you confirmed the theory then :-)14:16
pbourkeinc0: how did you generate the json/html14:17
pbourkeinc0: seems we only have stats for one task14:17
*** sdake_ is now known as sdake14:18
*** ChanServ sets mode: +o sdake14:18
sdake[07:18:13]  <sdake>flags #openstack-kolla berendt +o14:18
sdake[07:18:14] -ChanServ-You are not authorized to execute this command.14:18
*** ad_rien_ has left #openstack-kolla14:19
*** bootsha has quit IRC14:20
sbezverk_sdake: I keeplooking at rtnetlink problem with namespaces and noticed that namespaces do not get mounted on the host, and only one dhcp namespace got mounted inside of dhcp container. do you know at what point namespace gets mounted?14:25
*** berendt has quit IRC14:25
*** zhiwei has joined #openstack-kolla14:26
*** berendt has joined #openstack-kolla14:26
*** zhiwei has quit IRC14:30
sdakeberendt try /msg chanserv #kolla op berendt14:33
*** bootsha has joined #openstack-kolla14:33
*** cinerama has joined #openstack-kolla14:34
pbourkeinc0: can you confirm the command(s) you used to generate the report for deploy #1 (without ceph)14:36
*** ChanServ sets mode: +o berendt14:36
berendtsdake /msg chanserv OP #openstack-kolla berendt worked. thanks.14:37
*** ChanServ sets mode: -o berendt14:37
*** ChanServ sets mode: +o berendt14:38
*** ChanServ sets mode: +o berendt14:38
*** ayoung has joined #openstack-kolla14:41
*** b_bezak has quit IRC14:48
*** senk has quit IRC14:49
*** bootsha has quit IRC14:53
*** salv-orlando has joined #openstack-kolla14:54
*** salv-orlando has quit IRC14:57
*** ayoung has quit IRC14:59
*** HyperJohnGraham has joined #openstack-kolla15:02
*** sould has joined #openstack-kolla15:06
*** sould has quit IRC15:12
*** Jeffrey4l_ has quit IRC15:13
*** mgoddard has joined #openstack-kolla15:14
*** mgoddard_ has quit IRC15:15
pbourkelatest openstackclient seems to break kolla for me15:21
*** vhosakot has joined #openstack-kolla15:21
pbourkewonder what our gates will think15:21
*** vbel has quit IRC15:21
*** vbel has joined #openstack-kolla15:22
*** Jeffrey4l_ has joined #openstack-kolla15:22
*** daneyon has joined #openstack-kolla15:23
*** berendt has quit IRC15:24
*** _coolsvap_ is now known as coolsvap15:24
sdakewas going to climb humphreys today15:27
sdakeand woke up with terible backache15:27
*** daneyon has quit IRC15:28
inc0sdake, vodka is good medicine for that15:30
inc0also makes trip more interesting15:31
sdakeinc0 this is humprehys: http://www.allflagstaff.com/mountains/mt_humphreys.php15:34
sdake3 hrs my ass15:35
sdakemore like 5 up 7 down15:35
inc0looks great15:36
sdakewhen i was in perfect shape i could do humphreys in about 3.5 hours15:36
*** Administrator__ has quit IRC15:36
inc09 miles total n 3 hrs? fuck. I don't know who made this measurement15:37
*** Administrator__ has joined #openstack-kolla15:37
inc0and it's mountains15:37
sdakewith the last mile anklebreakers everywhere15:37
sdakei can do 10 miles in 3 hours over flat terrain15:37
sdakebut this is straight up then straight back down15:38
inc0pbourke, sorry I was on call15:39
inc0did you move anything forward?15:39
*** harlowja_at_home has joined #openstack-kolla15:40
*** matrohon has quit IRC15:42
jrich523_sdake: so if its half up and half down, shouldnt the time even out? :)15:44
*** jrich523_ is now known as jrich52315:44
*** aNupoisc has joined #openstack-kolla15:45
sdakejrich523 going down is harder then up15:45
sdakein many domains - not just hiking :)15:46
jrich523yeah, im mostly just giving you crap, i use to hike a lot, and it always felt that would be better, until you start to come down :)15:46
jrich523lot of stress on your feet to maintain speed/control15:46
sdakeand knees15:47
jrich523yeah, those too, as i get older the more they hurt15:47
sdakei'm 42 - not sure if i can hike this mountain anymore15:47
jrich523so lets see, you're all banged up, some feet/knee problems and tooth geesh, rough weekend :)15:47
jrich523im 36.. im not far behind you15:47
jrich523my hikes have gotten easier over the years lol15:48
jrich523hmm is there anything stopping you from using a top level domain for internal DNS?15:49
jrich523i feel like there isnt anything stopping you from doing system.mydomain15:49
*** jemcevoy has joined #openstack-kolla15:49
*** michauds has joined #openstack-kolla15:50
*** sdake has quit IRC15:54
*** sdake has joined #openstack-kolla15:55
*** Jeffrey4l_ has quit IRC16:00
*** mgoddard_ has joined #openstack-kolla16:01
pbourkeinc0: I just want to confirm what you've done16:02
*** dgonzalez has quit IRC16:03
*** bradjones has quit IRC16:03
pbourkeinc0: so I dont do anything unnecessary16:03
pbourkeinc0: it seems you generate the reports for just the one task rather than all in the rally deployment?16:03
inc0nah16:04
inc0I generated for all of them16:04
*** mgoddard has quit IRC16:04
*** ssurana has joined #openstack-kolla16:04
*** dgonzalez has joined #openstack-kolla16:05
*** bradjones has joined #openstack-kolla16:06
*** bradjones has quit IRC16:06
*** bradjones has joined #openstack-kolla16:06
pbourkeinc0: ~/rally-results/19-08-4pmCST/output.html only contains one task16:06
inc0ahh16:07
inc0yeah in this one16:07
inc0in 5pm I learned my lesson;)16:07
inc0I'm in tmux16:07
*** dave-mccowan has quit IRC16:08
*** dave-mcc_ has joined #openstack-kolla16:08
pbourkeactually its no big deal as we still have the info saved in the rally db16:09
pbourkeso you just need to remember which rally deployment it was16:09
inc0so i probably ran on same deployment16:10
pbourkethe kolla-rally-tests.sh script creates a new one each time16:10
pbourkeare we on different tmuxes?16:11
inc0ok16:11
*** salv-orlando has joined #openstack-kolla16:11
*** wirehead_ has quit IRC16:11
*** wirehead_ has joined #openstack-kolla16:12
pbourkeinc0: can you grab all reports from your previous deploy before we re-do the ceph ones?16:13
*** Jeffrey4l_ has joined #openstack-kolla16:14
*** egonzalez90 has joined #openstack-kolla16:18
*** fragatina has quit IRC16:19
*** fragatina has joined #openstack-kolla16:19
sbezverk_sdake: I can ping between dhcp agent and neutron router over ovs bridge :-)16:21
*** vhosakot has quit IRC16:24
kfox1111sbezverk_: awesome. :)16:24
sbezverk_kfox1111: do not think so, if you see my container you will do -100 ;-)16:25
*** vhosakot has joined #openstack-kolla16:25
kfox1111hehe.16:25
kfox1111well, its a step in the right direction. :)16:25
kfox1111cleanup next. :)16:25
sbezverk_kfox1111: do you want to have a heartattack? I can show you the pod definition16:26
kfox1111sure. :)16:26
kfox1111I need something to wake me up this morning. :)16:26
sbezverk_kfox1111: here you go, I warned you: http://paste.openstack.org/show/562247/16:27
kfox1111not horible. needs some work. but good you got it working and identified the stuff like hostIPC needed to get it working.16:29
kfox1111is there a reason you coupled l3 agent and dhcp together?16:29
sbezverk_kfox1111: yes16:29
sbezverk_issues with namespaces16:30
kfox1111how so?16:30
sbezverk_kfox1111: it is still not fixed16:30
sbezverk_host sees namespaces but cannot access them :-(16:30
kfox1111not sure I follow. what is complainging?16:31
*** vhosakot has quit IRC16:31
inc0what happend to kolla-ansible cleanup? pbourke16:32
pbourkeinc0: its now destroy16:32
pbourkeinc0: not sure who pushed that change16:32
kfox1111do the two network namespaces just cant talk to each other if in seperate containers, or does something actually complain?16:33
inc0not working well too16:33
pbourkewhats the problem16:33
kfox1111shoot. I blew out my docker devicem mapper trying to fix it... gota reboot. :/16:33
*** Jeffrey4l_ has quit IRC16:33
inc0ceph_mon volumes are stale16:33
pbourkeinc0: yeah... I've been meaning to log that bug16:33
*** mark-casey has joined #openstack-kolla16:33
pbourke:/16:33
sbezverk_inc0: have you seen ip6tables-restore traceback in kolla before?16:34
*** gfhellma has joined #openstack-kolla16:34
inc0sbezverk_, nope...16:34
sbezverk_it seems l3-agent uses ip6tables-restore -n16:34
sbezverk_but -n option does no exist16:34
sbezverk_in package we have with kolla16:35
Mech422Morning16:35
sbezverk_anyway I filed a bug with neutron16:36
*** athomas has quit IRC16:36
*** harlowja_at_home has quit IRC16:37
*** Serlex has quit IRC16:40
kfox1111back.16:40
kfox1111maybe that's a new feature in newton?16:41
*** zhiwei has joined #openstack-kolla16:42
sbezverk_kfox1111: I use master16:43
kfox1111yeah. so it might be a new thing with newton (trunk)16:44
kfox1111maybe try switchign the image to 2.0.1 instead of 3.0.0?16:44
*** vhosakot has joined #openstack-kolla16:45
sbezverk_kfox1111: it does not seem to impact atm.. my main pain is namespaces16:45
kfox1111k.16:45
*** mgoddard_ has quit IRC16:46
kfox1111so whats the namespace issue? does ping just not work, or is it something else?16:46
*** zhiwei has quit IRC16:46
*** gfidente has quit IRC16:46
sbezverk_kfox1111: It is hard to explain.. it seems connectivity depends upon a working namespace16:47
*** fragatina has quit IRC16:47
kfox1111there are multiple types of namepaces. which one are you refering to?16:47
kfox1111ip netns ?16:48
sbezverk_kfox1111: when running commands withis name space stop working I loose connectivity16:48
sbezverk_kfox1111: yes16:48
kfox1111ok. lets see...16:48
kfox1111ip netns's are a bit different then even a kernen net namespace.16:48
kfox1111kernel.16:48
kfox1111they do some special filesystem thing, wich I think you might have to share with the host,16:49
kfox1111which is why its working when in the same pod maybe...16:49
*** mgoddard has joined #openstack-kolla16:49
sbezverk_kfox1111: all net name spaces are listed in /run/netns16:50
*** godleon has quit IRC16:50
kfox1111yeah. /var/netns.16:50
sbezverk_and we do share it16:50
kfox1111 /var/lib/netns16:50
kfox1111which I think is a symlink..16:50
*** aNupoisc has quit IRC16:50
*** egonzalez90 has quit IRC16:50
*** egonzalez90 has joined #openstack-kolla16:50
kfox1111yeah. to /run/netns16:51
sbezverk_kfox1111: do not think so, I checked with classical kolla16:51
sbezverk_and everything stays in /run/netns16:51
kfox1111 /var/run  is a symlink on my box to ../run16:52
*** unicell1 has quit IRC16:53
sbezverk_kfox1111: ok16:53
sbezverk_kfox1111: but since we share /run/netns to all neutron containers they and host should have access16:54
*** dims has quit IRC16:54
sbezverk_what happens is I see that name space created example in l3 agent is accessible from within I can run ip netns exec qrouter ip a16:55
sbezverk_but the same command run from host generate error16:55
sbezverk_but host see l3-agent namespace as it shows it in "ip netns"16:56
*** dims has joined #openstack-kolla16:56
jrich523hows the current master branch, did the horizon issue get resolved?16:57
rhalliseysbezverk_, so outside the container you cant see anything you created?16:58
sbezverk_rhallisey: I can see but cannot taste16:59
sbezverk_let me illustrate it with some logs, 1 sec17:00
rhalliseydoes kubernetes support shared volume mounts?17:01
rhalliseythis seems like mount propogation is failing17:01
kfox1111gota a meeting. bbiab.17:02
kfox1111yeah. did you do the mount propigation tweak from the install docs in docker?17:02
sbezverk_rhallisey: http://paste.openstack.org/show/562251/17:02
sbezverk_do you mean shared flag in docker startup file>17:03
sbezverk_?17:03
rhalliseythat mount needs to be shared17:03
sbezverk_it is17:03
rhalliseyso that all the containers and the host can change it and the changed get seen everywhere17:04
sbezverk_        - name: host-run-netsh17:04
sbezverk_          hostPath:17:04
sbezverk_            path: /run/netsh17:04
rhalliseyI don't think that17:05
rhalliseythat's shared17:05
sbezverk_rhallisey: that might be a problem because when namespace gets created inside of container, host sees it like this:17:05
rhalliseyit doing normal mounting17:05
rhalliseyso it's taking the copy /run/netns and mounting it per container17:05
sbezverk_----------.  1 root root   0 Aug 22 11:17 qrouter-baa3335b-0013-42dd-856a-64a5c2557a0117:05
sbezverk_rhallisey: I was told that since MountFlag=Shared17:06
rhalliseyinteresting...17:06
sbezverk_it does sharring by default17:06
rhalliseyhostPath has a different definition that I expected17:07
sbezverk_rhallisey: that thing screwed up my whole weekend, because I could not get my head around it17:07
rhalliseybecause how does it store data if there are multiple users of the hostPath17:07
rhalliseysbezverk_, we can test this17:07
*** inc0 has quit IRC17:07
rhalliseystart like mariadb and create a file in there17:07
rhalliseyinstead of starting the service17:08
rhalliseythen start another mariadb17:08
rhalliseyand create a different file17:08
rhalliseyls the hostPath17:08
*** inc0 has joined #openstack-kolla17:08
rhalliseyI"m wondering what is there17:08
sbezverk_I can do it with already existing containers17:08
rhalliseyok touch a file in a shared dir17:08
rhalliseyin multiple containers17:09
rhalliseyand ls that dir17:09
rhalliseysee what shows up there17:09
*** fragatina has joined #openstack-kolla17:09
sbezverk_rhallisey: yep I created files from dhcp and from l3 and host sees both files17:11
rhalliseyhmm17:12
rhalliseydoes the l3 container show both files too17:12
sbezverk_and I can even read the content on the host17:12
sbezverk_yes17:12
rhalliseyok its shared then17:13
sbezverk_http://paste.openstack.org/show/562253/17:13
rhalliseyweird what is the difference in those envs17:14
rhalliseyhost vs container..17:14
sbezverk_rhallisey: no idea, if you want I can setup webex to show you..17:15
rhalliseycould it be the kernel version17:16
sbezverk_rhallisey: I suspect the issue is the way namespace get created, probably in kube there is something specific which is not considered in the current code17:16
rhalliseysbezverk_, I think other have this working though17:17
sbezverk_rhallisey: hm, I would really like to see it if in fact it is working17:17
rhalliseywell it may not be idk17:18
sbezverk_I had to do so much twicking to make ovsdb/vswitchd working, it is just crazy17:18
rhalliseywe're close17:19
*** unicell has joined #openstack-kolla17:20
sbezverk_rhallisey: and the only way I managed to get them working with perfect stability was not using kolla abi :-( it was breaking them constantly17:20
rhalliseysbezverk_, that' ok17:20
rhalliseywe can change it17:20
rhalliseythis exposes a flaw in it17:20
*** berendt has joined #openstack-kolla17:21
*** aNupoisc has joined #openstack-kolla17:23
jrich523hey can someone give me a hand with dealing with the missing 3.0 tag on docker.io/kolla/centos-binary-kolla-toolbox?17:25
*** inc0 has quit IRC17:28
*** aNupoisc has quit IRC17:31
*** fragatina has quit IRC17:33
*** fragatina has joined #openstack-kolla17:33
*** mntdevops has quit IRC17:36
*** inc0 has joined #openstack-kolla17:39
rhalliseyjrich523, 3.0 will be pushed after the N release17:44
jrich523until then, how do i tell it to deploy whatever is current?17:44
rhalliseyjrich523, you can build them17:45
rhalliseyclone master17:45
jrich523thats what i've done17:45
rhalliseylook in the tools directory17:45
rhalliseyls /tools/build.py17:45
rhalliseythat script will build all the images you need17:45
jrich523thats script is pretty basic17:47
jrich523jsut calling another module to do the work17:47
rhalliseyyup17:47
rhalliseythat will get you going17:47
jrich523hmm17:48
*** berendt has quit IRC17:48
*** haplo37__ has quit IRC17:49
jrich523looks like its in diag17:52
jrich523so i found that my controler has the 3.0.0 docker image (someone helped me get this going, might have manually pulled it?)17:57
*** sould has joined #openstack-kolla17:57
*** gfhellma has quit IRC17:58
rhalliseyif you want latest master you'll have to build it.  Maybe it came for a local registry?17:59
jrich523yeah see.. someone helped build this18:00
jrich523and i saw most of it over webex, but i missed a few parts18:00
jrich523one of which was how he fixed this18:00
jrich523i have a all in one setup right now, but needed to add a compute node18:00
*** gfhellma has joined #openstack-kolla18:00
jrich523which, the only problem i have left is this pesky tag18:00
jrich523so im thinking of exporting the image and importing it on the other box... probably not idea... but.. should cut it18:00
jrich523im using an inventory file with kolla-ansible -i <file> deploy18:01
*** sould has quit IRC18:01
rhalliseyjrich523, https://github.com/openstack/kolla/blob/master/doc/multinode.rst#deploy-a-registry-required-for-multinode18:02
rhalliseyyou can use a local docker registry18:02
rhalliseyor build the images on the new host18:02
jrich523based on what docker images return, looks like i've got them all locally, but, i dont believe i ever did the registry stuff (Because it was originally all in one)18:03
inc0jrich523, you suggested me ATH right?18:03
jrich523i sure did inc0, and i think you ordered it up?18:03
*** kbaegis has joined #openstack-kolla18:03
inc0yeah, just got it and testing it18:03
inc0so far it's cool18:03
jrich523oh damn that was fast18:03
inc0amazon <318:04
kbaegisI'm glad sahara is already around :)18:04
jrich523lol yeah right, a abuse that so bad18:04
inc0wanted to say thanks:) I like midtones and highs18:04
jrich523i get same day delivery a lot, for free, just cuz18:04
jrich523yeah its a well rounded set18:04
jrich523which is what i was looking for since i use them for games/calls/music18:04
jrich523you got it with the v-moda and adapter? or just rocking the headphones so far18:04
inc0yeah, also I tend to listen to music that needs these highs, like classical18:05
inc0full set, but it seems mic is borked18:05
inc0it doesn't seem to be working, can't hear anything over mics cable18:05
inc0will debug later todat18:05
jrich523hmm i've had good luck with the mic's, the adapters tho can be suspect18:06
kfox1111sbezverk_: rhallisey: something to follow if you arn't already: https://github.com/kubernetes/kubernetes/pull/2069818:06
inc0yeah, will try these too18:06
jrich523i assume you took them apart ok to get the adapter in correctly?18:06
inc0hmm...I might not...took what apart?18:07
sbezverk_kfox1111: thank you intresting thread18:07
jrich523so there is a locking... tab... inside the headphone18:07
rhalliseykfox1111, it seems like the mount is propogating though18:08
jrich523if you look at the cable that came with it, it has a groove to push in and twist to keep it there18:08
jrich523which gets in the way with that adapter18:08
jrich523so you have to take it apart and remove the tab (super easy, its a screwed on part)18:08
rhalliseysbezverk_, run that same test you did on the host in the dhcp and l3 containers18:08
inc0ahh I see what you mean18:08
jrich523super easy, just... needs to be done is all18:08
inc0I've missed that one18:08
jrich523i tried to force it past that nub, no luck, def have to take it out18:09
inc0will do it later, probably that's the case18:09
inc0or make a dent in adapter18:09
jrich523meh i considered that too18:09
rhalliseysbezverk_, ok checked your old paste l3 worked18:09
jrich523peeling off the outer case18:09
kfox1111rhallisey: yeah. I'm trying to get my docker pieced back together so I can look at it.18:09
jrich523but they are so cheaply made i was scared to do anything to it18:09
rhalliseykfox1111, ya same18:09
kfox1111it ate is back end storage. :/18:09
rhalliseykfox1111, getting to multonode is a pita here..18:09
inc0yeah, I'd rather mess with 5$ adapter than 150$ headphones;)18:10
* rhallisey is 9 vms in18:10
jrich523honestly its super easy18:10
jrich523pretty sure there is a video out there too18:10
inc0I'll use a drill probably, especially that I have 2 of them18:10
jrich523ahh nice18:10
kfox1111rhallisey: yeah. I thin this is one of the darker sides of containers right now. it needs to use some things that are not very well documented.18:10
rhalliseykfox1111, aio need some improvment18:10
jrich523i will say, based on where the mic clip is (mic mute/vol) i sometimes get that caught under the desk and it rips out the plug18:10
kfox1111hell. docker's use of thin provisioned device mapper things are also very hard to debug. :)18:10
rhalliseyand for multinode we need a single node ceph18:11
jrich523so it might be good that its not locked in there :)18:11
kfox1111as there are very little docs on the topic.18:11
kfox1111yeah. We need a tutorial for using kolla-ansible to deploy just a single node ceph for testing.18:11
inc0yeah, that's why you want removable cable18:11
kfox1111until we can get kube standing it up.18:11
sbezverk_kfox1111: once I got ceph going for my kube cluster, I try not to touch it ;-)18:13
rhalliseysbezverk_, how did you deploy multinode kube?18:13
rhalliseytaking recommendations18:13
sbezverk_it gave me some really nasty surprises, like FS corruptions18:13
kfox1111sbezverk_: yeah, I got it working in mine with kubernetes managed. but had to manually do some of the job stuff,18:14
sbezverk_rhallisey: everything was done manually..18:14
kfox1111and I've got a loopback/volume mount thing I have to manually do before launching kubelet.18:14
sbezverk_that was the only way to make sure everything works as expected18:14
kfox1111I need to document all that stuff.18:14
sdakesbezverk_ nice18:14
sbezverk_kfox1111: as per your comment I splitted l3 and dhcp, dod not make any difference18:15
sbezverk_but agree it is more flexible18:15
rhalliseysbezverk_, I think you might have answered this, but they are all in the same pod or no?18:15
sbezverk_rhallisey: now I have thin pod18:16
rhalliseyhm18:16
sbezverk_1 service per pod18:16
sdakesbezverk_ kfox has a systemd workaround in there18:16
sdakethen it would appear the mounts show up on the host18:16
kfox1111sbezverk_: cool. what are the differences between your split stuff, and whats in this review: https://review.openstack.org/#/c/3575518:17
sbezverk_sdake: mounts always appeared on the host, they were not just usable18:17
sdakewell finally got all my gear for humphrys18:17
sdakesbezverk_ this makes them usable...18:17
kfox1111just the ipc flag?18:17
sdakenow its 11am - too late to climb - tomorrow it is18:17
sbezverk_kfox1111: I am not going to push it for review18:17
kfox1111yeah, just wondering what to fix in #35755.18:18
sbezverk_because it is major change in architecture18:18
sdakekfox1111 in that kubernetes github pull request, you commented that you used a systemd workaround18:18
sbezverk_I will keep it as plan B if normal way will not work out18:18
sdakeI've got a workaround for now. Say you want to share out /export/foo and make it remountable:18:18
sdakeI made a systemd unit that does the following after mounts happen but before docker starts:18:18
sdakemount --bind --make-shared /export /export18:18
kfox1111I did?18:18
kfox1111sdake: oh. yeah. that. :)18:18
sdakejuly 2318:18
kfox1111yeah. it works pretty well.18:19
rhalliseykfox1111, I think the mounts are shared at the moment though18:19
sdakerhallisey no - default is private not shared18:19
rhalliseywe tested it earlier18:19
sbezverk_sdake: we tested and they are shared18:19
sbezverk_I created file on share mount18:20
rhalliseyif they were private, you would create a file in each container and it would not be seen18:20
*** HyperJohnGraham has quit IRC18:20
sbezverk_and host and all containers who mounted that share saw it right away18:20
rhalliseyas they would be slave mounts18:20
kfox1111sdake: http://pastebin.com/UUS5hybJ18:20
rhalliseys/slave/private18:21
kfox1111it worked one way though. the container mounts are still slaves.18:21
kfox1111so I couldn't get cvmfs to run in containers and share back outwards like I wanted.18:21
rhalliseyI think docker defaults as slave not private18:21
kfox1111I think it might work with the kolla-kubernetes workaround though. I've been meaning to try that.18:22
sdakerhallisey definatelly private18:22
rhalliseyI think it's private if you use volume in the dockerfile18:22
kfox1111then I can get cvmfs containerized.18:22
rhalliseyI think -v is a slave mount18:22
rhalliseys/volume/VOLUME/18:22
rhalliseykfox1111, if you run that container with cvmfs:/cvmfs:shared it should work18:23
sbezverk_have meeting will be back in 2 hours18:23
rhalliseysbezverk_, kk18:24
rhalliseysbezverk_, ping when you're back and we can keep looking18:24
*** vhosakot has quit IRC18:24
kfox1111rhallisey: not by default. as its a slave mount back to the host. but I think the settings listed in kolla-kubernetes to change the default to shared might work around the issue for me.18:24
kfox1111cause I want to run the cvmfs fuse filesystem in a container by daemonset, and then consume it in a different pod.18:25
*** vhosakot has joined #openstack-kolla18:25
rhalliseyyou have to run docker with mountflags=shared18:25
kfox1111there we go.. docker is starting to rebuild now.18:25
rhalliseyand use -v  cvmfs:/cvmfs:shared18:25
kfox1111rhallisey: you have to do both?18:25
sdakerhallisey - k8s does not permit passing the shared flag to a host mount18:25
kfox1111cause k8s can't do the latter step yet.18:26
rhalliseyit may not support it18:26
sdakeit does not support it18:26
kfox1111rhallisey: https://github.com/kubernetes/kubernetes/pull/20698 <- no support yet. :/18:26
rhalliseybut we were seeing behavior of a shared mount18:26
sdakekfox1111 has a link above which shows htei issue pull reuqeet18:26
rhalliseyright I know, but idk how sbezverk_ was able to share files in the dir18:26
rhalliseythis needs more testing18:26
sdakerhallisey the way was via an Empty volume mount18:26
rhalliseyno he used hostPath18:27
sdakeof /run/netns18:27
sdakebut then the namespace doesn't appear on the host18:27
kfox1111docker images pulling...18:27
kfox1111ok. I should be able to help test soon.18:27
rhalliseywell think of this18:27
kfox1111well... except, I cant... :/18:27
kfox1111I need to run opevswitch on the host, and share it out.18:27
rhalliseyif you use hostPath, it makes sense by default that everything is slave by default18:28
rhalliseyhostPath is meant to store files on the host18:28
kfox1111as its backing docker, and other native bridges.18:28
rhalliseybut if you have multiple users of a since hostPath then what?18:28
rhalliseyhas to be shared18:28
kfox1111rhallisey: yeah.18:28
rhalliseythe sharing may be wrong18:28
*** sdake has quit IRC18:29
kfox1111can you update a sharing flag after its mounted?18:29
kfox1111--remount,shared?18:29
rhalliseynot sure18:29
kfox1111if so, we could work around it until k8s gains native support.18:29
rhalliseykfox1111, we need to poke around here and see what the kernel thinks of that mount18:31
rhalliseyand what we can actually do with it18:31
kfox1111oh... well, the neutron-l3-agent is the one making the namespaces though. so I think I can test that.18:31
rhalliseykfox1111, well all we need to test is 2 pods that use the same hostPath18:32
kfox1111hmm...18:32
kfox1111actually I think I can do it in 1. launch the l3-agent and see if I can see it on the host?18:32
kfox1111if so, it shoudl work over to another pod too.18:33
rhalliseyinc0, https://github.com/kubespray/kargo you tried that right?18:33
inc0yeah18:33
sbezverk_kfox1111: seeing and using it two differenet things18:33
rhalliseykfox1111, possibly18:33
inc0it's cool18:33
rhalliseykfox1111, if it's seen on the host then that means the mount is at least a slave18:33
sbezverk_I can see all namespaces but running command against these namespaces from the host does not work18:33
kfox1111sbezverk_: ip netns exec qrouter-.... ip a #should do it.18:33
rhalliseyif you can see it on the host and in another container then it would be shared18:34
sbezverk_but it does not18:34
sbezverk_kfox1111: ip netns18:34
sbezverk_shows namespace18:34
sbezverk_ip netns exec qrouter ip a18:34
kfox1111the exec lets you enter it. which is what I think breaks?18:34
sbezverk_gives RTNETLINK18:34
sbezverk_error18:34
kfox1111yeah.18:34
kfox1111that makes sense.18:35
sbezverk_the same command within container returns correct output18:35
sbezverk_kfox1111: would be good if you can confirm it, maybe it is "feature" of my cluster18:36
rhalliseyinc0, k trying kubespray18:36
kfox1111yeah. trying to launch an l3 agent now...18:37
kfox1111hmm... need to get the configmap created...18:38
kfox1111ok... got one...18:39
*** zhiwei has joined #openstack-kolla18:39
*** gfhellma has quit IRC18:40
kfox1111k.. don't have that container handy...18:41
kfox1111gota build it. :/18:41
kfox1111and its gota rebuild the base image....18:42
kfox1111this might take a bit.18:42
rhalliseykk18:42
*** zhiwei has quit IRC18:43
kfox1111base is almost done building...18:49
kfox1111oh. now on to openstack-base.18:50
jemcevoyMech422, sean-k-mooney,  I got past my ceph install problem and now can deploy a healthy ceph... It turned out to be the firewall.  The doc did not say anything about turning off the firewall.  Is anyone looking into firewall rules for the install?18:50
Mech422jemcevoy: sorry - I don't configure firewalling on my cluster machines, so its never come up18:51
jemcevoyI was just running with what CentOS7.2 has out of the box.  ie minimal kickstart...18:52
jrich523hey rhallisey, that link is what i need i think however stuff isnt adding up (re: docker registry)18:53
jrich523mostly im having a problem setting it to be insecure, the file referenced isnt there, and googling makes me thinks there are more steps to it than just creating that file18:53
kfox1111arg... snapshotting isn't working.18:54
rhalliseyjrich523, did you setup systemd correctly?18:54
kfox1111do you have to tell docker your using btrfs?18:54
rhalliseyalso be sure to do a systemd daemon-reload18:54
jrich523i've done that, but not recently, so let me try that18:55
jrich523also, the only reason i didnt try that first, was because it was in the next step (figured it needed the setting before restarting stuff)18:55
kfox1111and, gota restart all over again building images. :/18:56
rhalliseyjrich523, sure.  Let me know if that helps18:56
jrich523nope, didnt create that file18:56
jemcevoyNow I have gotten stuck at Neutron.  Right after the the step "neutron | Starting neutron-server container] " I loose all network access to the "public" side of the network... I need to use VLAN 10 to access anything outside of my dev rack... This is my log http://droplet.salemherbals.com/jmcevoy/20160821-kollaInstall.html18:57
jrich523https://docs.docker.com/engine/admin/systemd/18:57
jrich523that is what i read that made me believe there is more to it18:57
*** haplo37__ has joined #openstack-kolla18:57
jrich523systemctl show docker | grep EnvironmentFile18:57
jrich523that returns nothing18:57
jrich523which is why i tought more needed to be done than just creating that file18:58
rhalliseyjrich523, check /etc/systemd/system/docker.service18:58
rhalliseydo you have environmentFile there?18:58
jrich523its docker.service.d and no18:58
jrich523jsut kolla.conf (shared mount stuff)18:59
rhalliseyhow about /usr/lib/systemd/system/docker.service19:00
*** daneyon has joined #openstack-kolla19:00
jrich523that exists19:01
rhalliseyjrich523, does environmenFile exist in there?19:02
jrich523nope19:02
rhalliseyjrich523, at it there19:04
rhalliseyand add $DOCKER_OPTS19:04
*** daneyon has quit IRC19:05
jrich523does the env file belong in the [Service] section?19:05
rhalliseyyes19:06
*** HyperJohnGraham has joined #openstack-kolla19:06
jrich523and am i adding the $DOCKER_OPTS to the ExecStart?19:06
rhalliseyyup19:08
rhalliseyEnvironmentFile=-/etc/default/docker19:08
rhalliseyExecStart=/usr/bin/docker daemon -H fd:// $DOCKER_OPTS19:08
openstackgerritEduardo Gonzalez proposed openstack/kolla: Add nova-serialproxy container  https://review.openstack.org/35882219:09
openstackgerritMichal Jastrzebski (inc0) proposed openstack/kolla: Customization for base  https://review.openstack.org/35804219:14
jrich523rhallisey: so i then follow the Ubuntu directions (this is CentOS 7), which tells me to enter, in the env file, DOCKER_OPTS="--insecure-registry 192.168.1.100:4000"19:15
*** salv-orl_ has joined #openstack-kolla19:16
rhalliseyjrich523, I think /etc/sysconfig/docker use to be a default19:17
rhalliseyor it's a global systemd default idk19:17
rhalliseybut, the ubuntu piece will work regardless19:18
jrich523ok19:18
jrich523actually it failed, but i think i got it19:18
jrich523just going to test stuff first19:18
rhalliseyon by a default I mean default in the systemd start file19:18
rhalliseyjrich523, ok gotcha19:18
*** salv-orlando has quit IRC19:19
jrich523so, in the end, what i did is added the env file path to the service as you said, left the exec alone (the one you provided didnt fly) and then added the insecure gateway stuff to the file (just as the centos directions say)19:19
rhalliseyjrich523, did it work?19:19
jrich523basically all i had to do outside of the directions was to specify the env file, which, i might not have to do if it was an assume default locaiton... but docker is running, now just need to check registry19:19
jrich523well i dont know if the registry is working yet, but docker started back up this time19:19
rhalliseycool19:20
rhalliseycheck the status19:20
rhalliseyshould see insecure-registyry19:20
jrich523i see it running in docker ps19:20
jrich523k19:20
*** senk has joined #openstack-kolla19:20
*** berendt has joined #openstack-kolla19:20
rhalliseyya iirc /etc/sysconfig/docker was a default as an environemnt file and is no longer19:21
rhalliseyjrich523, if you can, update the docs to reflect that19:21
rhalliseythe ubuntu systemd method will work for centos19:21
jrich523hmm if it does, im missing something19:21
jrich523it didnt want to start19:21
rhallisey+19:21
jrich523based on the exec command you gave (which is what the docs talked about for ubuntu)19:22
rhalliseycan you paste the output of systemctl status docker19:22
jrich523http://paste.openstack.org/show/562270/19:23
jrich523i dont see any reference to the param19:23
rhalliseyrun a systemctl daemon-reload19:23
rhalliseyand restart it19:23
jrich523i had before starting it, but i'll give it another go19:23
rhalliseyhm19:23
rhalliseycan you paste /usr/lib/systemd/system/docker.service19:24
jrich523http://paste.openstack.org/show/562271/19:24
rhalliseyand paste /etc/sysconfig/docker19:25
*** berendt has quit IRC19:25
jrich523http://paste.openstack.org/show/562272/19:25
rhallisey#ExecStart=/usr/bin/docker daemon -H fd:// $DOCKER_OPTS19:26
rhalliseyit's commented out19:26
rhalliseyanbd19:26
jrich523... i should probalby update that ip :-/19:26
jrich523right, because that failed19:26
rhalliseyDOCKER_OPTS="--insecure-registry 192.168.1.100:4000" is the var19:26
rhalliseyoh when you ran with that19:26
jrich523which is commented out as well, since it pairs up with the commented out start19:26
jrich523the service fails to start when i use the commented out method19:26
*** haplo37__ has quit IRC19:26
rhalliseywhat was the failure?19:27
jrich523let me swap it back, not sure it gave much other than a failure code of 1 i think, but give me a sec19:27
rhalliseyok19:27
*** senk has quit IRC19:28
*** senk has joined #openstack-kolla19:29
*** salv-orl_ has quit IRC19:29
jrich523http://paste.openstack.org/show/562274/19:29
*** david-lyle has joined #openstack-kolla19:30
rhalliseyugh19:30
jrich523seems like its not allowed to run docker this way, it has to be dockerd?19:31
jrich523which... doesnt support the params in this way19:31
rhalliseysystemctl unmask docker.socket19:32
rhalliseythen start it again19:32
jrich523err, as root its saying i dont have permissions...19:32
*** HyperJohnGraham has quit IRC19:33
rhalliseycan you paste /etc/systemd/system/docker.service.d/docker_options.conf19:34
senkjrich523 wat is `systemctl status docker.socket` saying?19:34
*** gfhellma has joined #openstack-kolla19:34
jrich523senk: not found19:34
jrich523rhallisey: that isnt there, only kolla.conf19:35
senkjrich523 looks like a problem with systemd socket activation.. any problems with using `-H unix:///var/run/docker.sock`19:35
*** HyperJohnGraham has joined #openstack-kolla19:36
rhalliseyjrich523, can you paste what's in kolla.conf19:36
jrich523senk: where/how do i use that?19:36
jrich523[Service] MountFlags=shared19:37
senkjrich523 instead of `-H fd://`19:37
jrich523k19:37
senkfor socket activation https://github.com/docker/docker/blob/master/contrib/init/systemd/docker.socket should be present in /etc/systemd/system19:39
jrich523that got it running19:40
rhalliseynice19:40
senkfor more information on socket activation: http://0pointer.de/blog/projects/socket-activation.html19:40
rhalliseythanks senk19:41
jrich523http://paste.openstack.org/show/562277/19:41
jrich523thats the status, dont see any mention of the insecure setup tho19:41
*** david-lyle has quit IRC19:42
*** sdake has joined #openstack-kolla19:42
sdakeinc0 ping19:43
rhalliseydid you reload the daemon?  I wonder if the /usr/lib/systemd/system/docker.serivce changed19:43
jrich523i did, i've been doing: systemctl daemon-reload;systemctl restart docker19:43
inc0sdake, here19:44
*** david-lyle has joined #openstack-kolla19:46
rhalliseyjrich523, is docker.service still have $DOCKER_OPTS in place?19:46
rhalliseys/is/does/19:47
jrich523yeah19:47
rhalliseyweird19:47
jrich523i commented out the 'centos' syntax and uncommented the docker_opts19:47
rhalliseyI'm not sure19:48
jrich523i think i at least have a handle on whats going on now19:48
senkjrich523 do you have output of `docker info`19:48
jrich523oh, that would show insecure registries, which, lists it as 127.0.0.0/819:49
jrich523http://paste.openstack.org/show/562278/19:49
senkwhat is currently in /etc/systemd/system/docker.service.d19:51
jrich523just kolla.conf19:52
senkand content of /etc/systemd/system/docker.service19:52
senkand `systemctl show docker` maybe :D19:53
jrich523i dont have docker.service, just docker.service.d19:54
kfox1111hmm....19:55
kfox1111are we assigning uid's explicitly in containers?19:55
senkwhat about /lib/systemd/system/docker.service?19:55
kfox1111how do we know neutron's uid isn't going to change?19:55
jrich523http://paste.openstack.org/show/562280/19:56
jrich523it has the 3 start methods (yours is active) and the env config path set to /etc/sysconfig/docker19:56
jrich523oh wait19:56
jrich523so19:56
senkjrich523 make line 14 look like this19:56
senkExecStart=/usr/bin/docker daemon -H unix://var/run/docker.sock19:56
senkah wait19:57
senklike ExecStart=/usr/bin/docker daemon -H unix://var/run/docker.sock $DOCKER_OPTS19:57
jrich523k, that makes sense19:57
*** matrohon has joined #openstack-kolla19:57
kfox1111do we just rely on whatever rpm/deb creates for the user?19:57
*** inc0 has quit IRC19:57
*** inc0 has joined #openstack-kolla19:58
jrich523nice19:58
inc0guys I need an advice19:58
jrich523when i do docker info i see the repo there19:58
inc0I'm thinking of customization of sources.list19:58
senkjrich523 great19:59
inc0and I have an idea I'd like to run with you before I'll do this19:59
jrich523thanks senk!19:59
inc0macro edit_file19:59
senkjrich523 now i can sleep in peace :D19:59
jrich523just in time for me to get lunch, now that its 1pm :)19:59
jrich523lol19:59
inc0that will act like customizable, only with lines:)19:59
senk10pm here :D19:59
jrich523lol just in time then :)19:59
senkjrich523 oh yes.. bye :)20:00
jrich523thanks again20:00
jrich523cya20:00
*** senk has quit IRC20:00
inc0so lines_append add line -> it will append at the end of the file, lines_remove -> sed line to empty line, lines_override -> sed line to new line20:00
kfox1111fyi, I tried updating an entry in an ini file that had duplicate lines, but the line I wanted to edit was not duplicated.20:00
kfox1111crudini did not munge the file.20:00
kfox1111so we're fine using it for kolla-kubernetes.20:01
inc0so this will not be just for ini files...my main concern now are souces.list20:01
*** HyperJohnGraham has quit IRC20:01
inc0and it will have to be bashy bashy as it'll be part of build20:01
*** ayoung has joined #openstack-kolla20:03
kfox1111fun. so we're just using the uids of whatever package gets there first.20:03
kfox1111going to need a second init container I think...20:06
inc0issue is COPY in docker only works with local dir20:07
inc0so if somebody wants to add new sources.list they have to put it into kolla dir20:07
inc0which is crappy20:07
rhalliseyinc0, not getting kubespary working20:07
rhallisey:/20:07
rhalliseygets stuck on a cert task20:07
kfox1111know offhand how to get k8s to override user?20:08
inc0rhallisey, try to run just this play https://github.com/kubespray/kargo/blob/master/cluster.yml20:08
sbezverk_kfox1111" would be goo to have crudini in base image20:09
rhalliseyinc0, am20:09
rhalliseyinc0, just changed to inventory20:09
kfox1111sbezverk_: yeah, that may be an option too.20:09
sbezverk_I need to do some prep which requires boot up with actual process image and crudini only installed in tool box20:09
kfox1111you can have more then one init container though, so I've been able to do it that way.20:09
sbezverk_otherwise I had to you sed which works but looks scary20:10
kfox1111yeah.20:10
sbezverk_have you tried namespace?20:10
kfox1111sbezverk_: I'm updating https://review.openstack.org/#/c/357557 to try and run it on my box,20:10
sbezverk_kfox111120:10
kfox1111using some of the stuff in your pastebin.20:10
sbezverk_cool, cannot wait to see the result20:10
sbezverk_I really hope it is just my cluster problem20:11
kfox1111the chown was throwing me though. as neutron uid is only in the neutron-base container, not the toolbox.20:11
kfox1111so adding a new init container now.20:11
kfox1111but the neutron container is running as netron user, so it cant chown.20:11
kfox1111know how to override?20:11
kfox1111sbezverk_: how did you get the chown to work?20:18
sbezverk_kfox1111: I had to force neutron ovs to use tcp socket20:20
kfox1111was talking about the init container: chown -R neutron:kolla /var/log/kolla;20:20
sbezverk_:-) ahhhh it is bacuse you use tool boc20:21
kfox1111when I run the l3-agent, its running as user 'neutron', and doesn't have permissions to do that.20:21
*** sdake has quit IRC20:21
sbezverk_box neutron user is not defined in tool box20:21
kfox1111no, I'm running the chown in the neutron container.20:21
kfox1111but its switching to user neutron first.20:21
kfox1111had SecurityContextDeny in my admission-controler on api-server.20:23
sbezverk_kfox1111: because of all these incompatibilities I completely stopped using extended_start20:23
kfox1111yeah. I like the init containers better for that sort of thing. Ok. I have a solution. moving on....20:24
rhalliseysbezverk_, post your patch and document the kube issue.20:25
openstackgerritEduardo Gonzalez proposed openstack/kolla: Ansible config for nova-serialproxy console  https://review.openstack.org/35883920:25
kfox1111failure applying iptables rules now...20:25
rhalliseysbezverk_, what do you have for the extend_start changes20:25
rhalliseysbezverk_, is it hard coded?20:25
rhalliseyinc0, ^ repo split dude20:25
sbezverk_I do not use it at all, I have command in the pod that start the process20:25
rhalliseyok20:26
sbezverk_all preparation which used to be done in extended_start are done init container20:26
rhalliseywas there any changed on the kolla side?20:26
sbezverk_no, kolla does not need any changes20:26
rhalliseyperfect20:26
rhalliseylet's go with that for now20:26
sbezverk_it is even better to roll back to the original state20:27
rhalliseyit will add to our mound of tech debt, but it will work for now20:27
sbezverk_I mean for kolla20:27
sbezverk_to the point when we tried to optimize it for kube20:27
sbezverk_rhallisey: one thing which is not done is rendering of these new templates20:28
sbezverk_I will post templates, but will need somebody's help to get rendering around them.20:28
kfox1111almost there...20:29
kfox1111iptables is failing to apply now...20:29
*** egonzalez90 has quit IRC20:29
sbezverk_kfox1111: hit that too20:29
*** salv-orlando has joined #openstack-kolla20:29
sbezverk_you need to load ip6table20:29
sbezverk_you need to load ip6tables20:29
sbezverk_module20:30
kfox1111need it installed?20:30
kfox1111oh.20:30
kfox1111gotcha.20:30
sbezverk_mdules mount should fix it20:30
kfox1111it is loaded it seems.20:31
kfox1111still failing...20:31
sbezverk_kfox1111: how about hostIPC?20:32
sbezverk_It uses semaphors for iptables20:32
kfox1111yup got that.20:32
kfox1111neutron.agent.linux.iptables_manager RequiredOptError: value required for option: lock_path20:32
kfox1111maybe that's it.20:32
kfox1111I'm using my own neutron config files from the host.20:33
rhalliseykfox1111, are you cool rebasing https://review.openstack.org/#/c/357557 after sbezverk_ patch lands?20:34
*** salv-orlando has quit IRC20:34
rhalliseywould like to get a working neutron then we can optimize20:34
kfox1111which patch?20:34
rhallisey https://review.openstack.org/#/c/35755720:34
kfox1111no, which sbezverk_ patch?20:34
*** sdake has joined #openstack-kolla20:35
kfox1111rhallisey: do you mean this: http://paste.openstack.org/show/562247/ ?20:36
*** jtriley has quit IRC20:36
rhalliseyya the one he is posting20:37
kfox1111when we talked earlier, he was just trying to get something to work.20:37
kfox1111I think we should merge both into 357557 in the end?20:37
*** david-lyle has quit IRC20:38
kfox1111I've been pulling stuff in from the pastebin into review #357557.20:38
rhalliseyya20:38
*** david-lyle has joined #openstack-kolla20:39
sbezverk_kfox1111: If we can to first merge my containers and then add your labeling and placement but without changing how containers start20:39
kfox1111hmm... I think my config started more then one agent in the container, but it started this time.20:39
sbezverk_that is what I saw too when I was using exteneded_start20:40
sbezverk_second container will die eventually20:40
kfox1111I think there's a fair amount of difference in start aragement between the two, and I think mine might be closer to what we want in the end?20:40
sbezverk_kfox1111 if you make it working, sure20:40
kfox1111k. I can exec into the ip netns space..20:40
kfox1111lets see if it was a leftover from l3agent running on the host though...20:41
kfox1111ok. deleted from host....20:42
kfox1111restarting the container.20:42
kfox1111ok. too the point where I'm reproducting sbezverk_'s RTNETLINK answers: Invalid argument20:44
kfox1111on the host.20:44
kfox1111lets see...20:44
*** david-lyle has quit IRC20:44
*** david-lyle_ has joined #openstack-kolla20:44
sbezverk_:-(20:44
*** david-lyle_ has quit IRC20:44
kfox1111sec. never did the docker share thing yet.20:44
kfox1111docs are wrong... fixing...20:45
*** daneyon has joined #openstack-kolla20:48
rhalliseyman kubespray has my env all messed up20:50
rhallisey:/20:50
kfox1111all the propagation modes show up still as rslave still when docker inspecting the container.20:51
sbezverk_kfox1111: I mean it is not great, but it is not a show stopper fr us20:53
*** daneyon has quit IRC20:53
sbezverk_as long as inside of a container the process can access namespace correctly it will work20:53
kfox1111nothing talks to the ip netns but that one container?20:53
sbezverk_what I also noticed that name space gets broken after a period of time20:53
sbezverk_the workaround I found which works was to remove namespace from the host20:54
kfox1111somethings cleaning it up?20:54
sbezverk_then it gets re-created and will work again for a while20:54
kfox1111In that case, maybe we just don't mount /run/netns?20:54
kfox1111it would be isolated then.20:55
sbezverk_kfox1111: do not know, all of a sudden I could not run ip netne exec even inside of container20:55
kfox1111if we're sure nothing else needs access to it, then yeah, lets just not mount /run/netns. it shoudl protect it from that I think.20:56
rhalliseysbezverk_, as long as all the containers that share that volume can use the namespace then we're good20:58
kfox1111hmm.... user neutron can't enter it though.20:58
rhalliseywe can report the host issue as a kube bug20:58
sbezverk_rhallisey: we do not know if it is not by design20:58
rhalliseyindeed20:59
sbezverk_it would be great to get kube guy you met at summit to join irc to have a chat20:59
kfox1111ok. I"m able to ping the router from dhcp.20:59
sbezverk_and maybe even demonstration20:59
kfox1111so I think this update will work.20:59
openstackgerritKevin Fox proposed openstack/kolla-kubernetes: WIP - l3/metadata DaemonSets + DVR, & labels  https://review.openstack.org/35755721:00
kfox1111sbezverk_: please give that a try when you get a sec. I think I merged in enough of your changes that it works.21:01
kfox1111got a meeting. bbiab21:01
*** dgonzalez has quit IRC21:01
*** dgonzalez has joined #openstack-kolla21:03
*** salv-orlando has joined #openstack-kolla21:04
rhalliseysbezverk_, did you do this to setup multinode? http://kubernetes.io/docs/getting-started-guides/docker-multinode/21:05
rhalliseylooks neat21:05
rhalliseysuper easy21:05
*** salv-orlando has quit IRC21:19
*** salv-orlando has joined #openstack-kolla21:19
*** david-lyle_ has joined #openstack-kolla21:19
*** salv-orlando has quit IRC21:20
*** salv-orlando has joined #openstack-kolla21:20
*** JoseMello has quit IRC21:20
*** imcsk8 has quit IRC21:25
*** imcsk8 has joined #openstack-kolla21:25
*** godleon has joined #openstack-kolla21:26
*** adnavare has joined #openstack-kolla21:28
adnavareHi Guys, I am installing docker for Kolla but I am getting following errors http://pastebin.com/hsEDv99p. I am using this http://pastebin.com/U68RjDgB playbook to install the packages to setup the host. Any inputs on this? Do I need some more extra packages before this?21:33
jrich523based on that it looks like docker isnt fully installed? im pretty sure docker-engine comes with docker, if you do docker --version whats it spew out?21:34
rhalliseyyou can install it this way: curl -sSL https://get.docker.io | bash21:34
*** david-lyle_ has quit IRC21:34
rhalliseyhmm haven't used that play before21:34
adnavarejrich523: docker is not installed yet21:35
adnavareso --version is saying docker not installed21:36
jrich523oh, well you've got to install it :)21:36
adnavareI am trying to do that. The playbook does it21:36
adnavarelet me check again if it is present, but I believe so21:36
jrich523well, apparently it doesnt :)21:36
jrich523from what i see, it looks like it should21:37
adnavarejrich523: so I am adding a repo using "deb https://apt.dockerproject.org/repo ubuntu-trusty main" and then installing docker-engine21:37
jrich523but i cant say i've done it from that repo or that way, i did the curl like rhallisey mentioned21:37
adnavarejrich523: do i need first docker separately? and then docker engine21:38
jrich523well based on what you're doing, it should do it for you21:38
jrich523however thats a new playbook21:38
*** Mr_Broken has quit IRC21:38
adnavarejrich523: Okay, let me try with your curl way21:38
jrich523where did you get the playbook?21:38
adnavarejrich523: I have done it for my setup21:39
jrich523nice21:39
jrich523so technically what you are doing should work21:39
jrich523but, it cant install docker, question is why21:39
adnavarejrich523: hmm, yeah that's what I am held at21:39
jrich523since its all something you've created, it might be better to look for ansible help21:39
adnavareand the packages it is recommending are never suggested21:39
adnavarejrich523: so you did curl and then normal apt-get install?21:40
adnavareis that the way you did?21:40
jrich523well, yum, im on centos, but yeah21:40
jrich523i used the quick start21:40
jrich523which is kinda off21:40
adnavareOh Okay21:40
jrich523but yeah, there are few things you need before starting the build, docker is one of those few :)21:41
jrich523and your 'set up packaging on target hosts' seems to have the rest of the dependencies21:41
adnavarejrich523: the error seems weird not clearly stating what is going wrong21:41
adnavarejrich523: hmm yeah :)21:42
jrich523well it looks like its trying to install the engine, and perhaps pass some params, which, could also be the problem? i dont know man, not awesome with ansible21:43
jrich523err what OS are you using?21:43
*** rhallisey has quit IRC21:44
adnavarejrich523: UBUNTU21:44
adnavare14.0421:44
jrich523hmm21:44
mark-caseyadnavare: can you print the output of the previous task, the apt-get update? I wonder if it's skipping21:44
jrich523i see some references to OS issues, oddly worded tho21:44
jrich523ibdevmapper1.02.1 (>= 2:1.02.99) but 2:1.02.77-6ubuntu2 is to be installed21:45
adnavaremark-casey: do you mean the error that I am getting?21:45
adnavarejrich523: it is saying some broken packages21:46
jrich523a whole bunch, mostly based on new versions when looking for older?21:46
mark-caseyadnavare: yes. you have an apt task that just sets update_cache=yes. I'm wondering if Ansible is just returning OK and not running the apt-get update because there is not package listed to act on21:46
jrich523all steming from docker-engine it seems21:46
adnavaremark-casey: oh okay let me copy that in pastebin21:47
mark-caseygranted I don't know why that would do this... :D21:48
openstackgerritPrithiv proposed openstack/kolla: Dockerfiles for collectd-ceilometer-plugin Container  https://review.openstack.org/35863221:48
adnavaremark-casey: this is the output of play http://pastebin.com/gdSG1HsE21:48
adnavaremark-casey: it seems to install packages21:49
adnavaremark-casey: "item=[u'ntp', u'ntpdate', u'openssh-server', u'sudo', u'python-pip', u'python-dev', u'libffi-dev', u'libssl-dev', u'gcc', u'git', u'linux-image-generic-lts-wily']"21:49
adnavarejrich523: what do you mean looking for older versions?21:50
jrich523adnavare: maybe newer, but, this: ibdevmapper1.02.1 (>= 2:1.02.99) but 2:1.02.77-6ubuntu2 is to be installed21:51
jrich523i assume thats saying greater than .99, but .77 to be installed (not new enough?)21:51
jrich523few version references in that error you posted21:51
adnavarejrich523: Yeah seems something like that. Because even my curl is not working21:51
mark-caseyadnavare: after this fails you might "apt-get update" and "apt-get install docker-engine" manually. If that works then in your playbook move the update_cache:yes down to the docker install ansible task. If not then my guess was not it21:51
jrich523oh now thats weird21:51
adnavaremark-casey: so shall i now run apt-get update?21:52
mark-caseyyeah. assuming docker still isn't installed right now21:52
adnavareyeah docker not installed21:52
mark-caseyadnavare: I was wrong. this is on the docs for Ansible's apt module: "Run the equivalent of apt-get update before the operation. Can be run as part of the package installation or as a separate step." So what you had should have been ok21:55
mark-casey'or as a separate step' is ok21:55
adnavaremark-casey: hmm but my apt-get update gave couple of warnings http://pastebin.com/LHr9iZ8k21:57
adnavarerich523:seems i need certain packages basic version and then update those packages21:57
mark-caseyoh. yea. so the ansible just hasn't been able to give you that feedback as written. that could be it21:57
*** vhosakot has quit IRC21:58
adnavaremark-casey: i did not got you21:58
jrich523speaking of ansible/docker, if i setup a docker registry i have to configure that on each endpoint? im trying to use the multinode playbook and iv'e setup the registry which is ok on the controller but the remote end cant find it, and docker info doesnt list it as there21:58
jrich523i guess i was under the impression that would get passed over, but doesnt seem to be?21:58
mark-caseyadnavare: well the error is that apt needs one version of some packages and is installing another version. duplicate or wrong repos could, possibly, do that21:59
mark-caseyyou could always do the curl method but I've seen docker commiters say they're looking to move away from that in the future21:59
*** matrohon has quit IRC22:01
adnavaremark-casey: yes, okay let me try to get "init-system-helpers 1.14, lsb-base 4.1Debian11ubuntu6, libdevmapper"22:03
adnavareas these are the packages it is looking22:03
adnavaremark-casey: i am just wondering these packages are never required, or atleast no where said to be installed22:04
*** caowei has joined #openstack-kolla22:14
sbezverk_rhallisey: no, I have not used it..22:19
*** srwilkers_ has joined #openstack-kolla22:27
*** david-lyle_ has joined #openstack-kolla22:37
*** daneyon has joined #openstack-kolla22:37
*** daneyon has quit IRC22:41
*** david-lyle has joined #openstack-kolla22:49
*** david-lyle_ has quit IRC22:52
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP introduces new approach in starting OVS in Kube  https://review.openstack.org/35889522:53
*** mark-casey has quit IRC22:53
*** gfhellma has quit IRC22:55
Pavoevening everyone22:55
inc0hey Pavo22:55
Pavohows it be going?22:56
inc0slowly but steadily22:56
Pavonice22:56
Pavodoes kolla support pci-passthrough or sr-iov?22:57
Pavoor should I say can it support?22:57
inc0I know a guy who ran sr-iov22:57
inc0but afair there was some issues with it22:57
inc0it is possible tho22:57
openstackgerritSerguei Bezverkhi proposed openstack/kolla-kubernetes: WIP introduces new approach in starting OVS in Kube  https://review.openstack.org/35889522:57
Pavoah, yeah been testing pci-passthough with just using custom nova.conf file but having issues also22:58
*** david-lyle has quit IRC23:02
jemcevoyinc0, I have a nVidia K2 Grid card in the kolla cluster I am trying to build... (stuck in neutron) that I will need to get pci-passthrough working on so I can help with the passthrough stuff. BUT I need to get neutron working first...23:15
inc0what seems to be an issue?23:15
jemcevoyPavo do you have all the kernel args and pci_stubs configured?23:15
jemcevoyhttp://droplet.salemherbals.com/jmcevoy/20160821-kollaInstall.html23:16
*** sdake has quit IRC23:16
jemcevoyWhen I get to the red part I no longer have a connection to the public network.. Ping stops working23:16
*** michauds has quit IRC23:17
inc0jemcevoy, ubuntu 14.04?23:17
jemcevoyI need to use VLAN 10 to got off the my development rack to the rest of the network23:17
jemcevoyCentOS 7.223:17
jemcevoyand openvswitch23:18
jemcevoyShould I change to linux bridge?23:18
inc0I don't think this is an issue23:18
inc0but tak a look at syslog23:18
inc0docker seems to be acting up23:19
jemcevoyDo you mean /var/log/messages on the host system?  cc1-d?23:19
inc0well, /var/log/syslog on ubuntu23:20
inc0equivalent23:20
jemcevoyJust kickstarted so it will take 15-20 mints to fail again23:20
jemcevoysyslog = messages,,,23:21
*** dave-mcc_ has quit IRC23:23
*** zhiwei has joined #openstack-kolla23:27
*** zhiwei has quit IRC23:31
*** sdake has joined #openstack-kolla23:33
*** adnavare has quit IRC23:42
kbaegisSo with Centos7, installing it inside an openstack instance23:42
kbaegisI can't seem to see any disks23:42
kbaegisDoes that have to be set up as a volume/qcow instead?23:43
inc0hmm, maybe selinux is not very permissive?23:43
*** bmace has quit IRC23:49
*** bmace has joined #openstack-kolla23:49
*** sdake has quit IRC23:55
*** inc0 has quit IRC23:57
*** britthouser has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!