Tuesday, 2016-11-22

*** Bico_Fino has quit IRC00:02
*** TxGirlGeek has quit IRC00:03
AnswerGuyAfter an all-in-one deployent of Kolla/Openstack 3.0.1 (base: ubuntu install_type: source) I've created/uploaded three images to Glance using 'glance image-create ...'00:09
AnswerGuyIn each case I've gotten and error message like: Error finding address for http://172.19.2.251:9292/v2/images/aa19dbd9-6082-4fdd-b916-b3fe4a6a0ec7/file:00:10
AnswerGuy'openstack image list' show:00:10
*** Pavo has joined #openstack-kolla00:11
AnswerGuy| aa19dbd9-6082-4fdd-b916-b3fe4a6a0ec7 | CentOS 7                   | saving |00:12
AnswerGuy| 92c25a0c-cf32-4be3-938a-4d65baccd27c | Ubuntu Xenial Xeru 16.04.1 | saving |00:12
AnswerGuy| 624d62a0-47f0-49f1-ba59-f474b5a3d989 | Debian Jessie 64-bit       | saving |00:12
AnswerGuy| 2b3610ea-8ddb-4b1a-b0b3-3682f34c0127 | cirros                     | saving |00:12
AnswerGuy... all of them are listed as "saving" including the Cirros image that was created by the init-runonce script after the post-deployment step.00:12
*** yingjun has joined #openstack-kolla00:19
AnswerGuy... and I get Image 2b3610ea-8ddb-4b1a-b0b3-3682f34c0127 is not active. (HTTP 400) ... even when trying to use the cirros image (or any other).00:20
*** yingjun has quit IRC00:24
*** saneax-_-|AFK is now known as saneax00:24
jascott1AnswerGuy where is trying to save the images to?00:26
*** jgriffith has joined #openstack-kolla00:26
AnswerGuyShow a "show" on each of theseI don't know.00:28
*** goldyfruit has quit IRC00:28
AnswerGuyI don't know where this installation of Glance is trying to save its files.00:28
jascott1totally guessing but I would figure that out first00:29
AnswerGuy#glance_backend_file: "yes"00:29
jascott1since it *almost* works00:29
*** gfidente has quit IRC00:29
AnswerGuyYeah, I'm guessing that the file it getting up into RabbitMQ or memcache and not to the file backend.00:29
*** jgriffith has quit IRC00:30
AnswerGuy'openstack image show ...' give something like: /v2/images/2b3610ea-8ddb-4b1a-b0b3-3682f34c0127/file for the "file" value00:31
jascott1hmm maybe curl the registry directly and poke around?00:32
jascott1glance registry00:32
*** tovin07_ has joined #openstack-kolla00:32
*** yingjun has joined #openstack-kolla00:33
*** jgriffith has joined #openstack-kolla00:33
AnswerGuyIs there a HOWTO guide on debugging Glance/image issues somewhere?  (Sounds like this is more of a Glance issue than a Kolla issue ... other than the notion that Kolla's default behavior might be improved).00:36
*** jgriffith has quit IRC00:36
sdake_AnswerGuy yes upstream maintains many guides for all of the various services00:40
sdake_google away :)00:40
Pavook completely flat network00:41
Pavosdake_00:41
Pavocan you try ddi.hopto.org:400000:42
sdake_site can't be reached00:42
Pavothat is being forwarded to 8000:42
Pavowtf00:42
Pavothis is BS00:42
Pavoyeah this is BS because every other port forward is working00:47
*** duonghq_ has joined #openstack-kolla00:49
*** jtriley has joined #openstack-kolla01:01
*** zhubingbing has joined #openstack-kolla01:03
*** diogogmt has quit IRC01:05
*** eaguilar has joined #openstack-kolla01:08
*** duonghq_ is now known as duonghq01:16
duonghqmorning guys01:16
*** portdirect__ has quit IRC01:16
*** newmember has quit IRC01:17
jascott1good morning!01:18
tovin07_morning01:20
*** dave-mccowan has joined #openstack-kolla01:31
*** zhurong has joined #openstack-kolla01:41
Pavook I have completely redone my entire network to a complete flat network no vlans, no trunks nothing, 2 interfaces only on each node eth0 all traffic and eth1 for neutron if this doesn't work there is something wrong with kolla01:42
sdake_pavo may i suggest running horizon on a port other then 8001:43
Pavoas the forwared port?01:44
sdake_so your normal port forward are working?01:44
sdake_sup duonghq01:44
Pavobecause I am using 4000 external to 80 internal as the forwarding01:44
sdake_right - i mean as a test01:44
Pavoyes my other port forwarding are working no issues01:45
*** eaguilar has quit IRC01:45
Pavosee ddi.hopto.org:300001:45
Pavoyou can get to that right?01:45
sdake_right, so want to see if a port forward of horizon on 8000 works01:45
sdake_connection refused01:45
Pavook will switch to 800001:45
Pavowait not done deploying yet01:45
Pavoand you said connection refused for ddi.hopto.org:300001:46
Pavo?01:46
jascott1that url is your gogs and it works01:46
Pavook good01:46
Pavowaiting on deployment to get done01:47
harlowjaqq sdake_ inc0 for the dsvm jobs, most of those are nv right?01:47
harlowjai think the centos one isnt right?01:47
harlowjawill the rest switch (sometime?) to voting?01:47
harlowja(if this was already answered somewhere, let me know, ha)01:47
* harlowja may be dumb or asking same question again, lol01:48
sdake_harlowja actually i htink inc0 changed em to voting01:48
harlowjaah01:48
*** diogogmt has joined #openstack-kolla01:49
sdake_harlowja i'm not sure which ones would have to ask him01:49
harlowjakk01:49
inc0harlowja, just source build01:49
inc0not all of them01:49
*** jgriffith has joined #openstack-kolla01:49
*** liyifeng has joined #openstack-kolla01:50
harlowjakk01:50
Pavook sdake_  try ddi.hopto.org:800001:52
Pavoanything?01:54
jascott1success!01:55
Pavono f##$ing way01:55
Pavoseriously?01:55
jascott1horizon login01:56
Pavook wtf01:56
Pavook now how about we get tls working01:57
Pavosince apparently I am an idoit01:57
Pavolol01:57
jascott1everything is always so simple after we solve the problem :)01:58
Pavobut don't know what the issue was01:58
jascott1those are the best01:59
jascott1cause it means you prob get to do it all over again ;)01:59
Pavonope once I get TLS working I am done01:59
Pavonot touching it again02:00
Pavolol02:00
harlowjainc0 sdake_ another thing that wanted to see about, we've been using uwsgi here vs apache; would the be any major objection to having uwsgi being a thing to install (vs apache)02:00
sdake_harlowja you provide the patches we provide the reviews :)02:01
harlowjak02:01
inc0backwards compatibility02:01
inc0upgrades02:01
inc0apache will have to go through deprecation02:01
sdake_ya i think that could probably be selectable?02:02
harlowjaya, something like that02:02
harlowjai'm talking with the ops guys here, seeing if they would just be ok with apache02:02
harlowjawant more of a reason than 'meh bunch of apache instances'02:02
sdake_lol02:02
sdake_ya we dont erally want to go through the whole litany of things inc0 listed above ;)02:02
harlowja:-p02:02
sdake_i think the dockerfiles are configurable enough that they could be configured02:03
sdake_and the ansible could be configred02:03
harlowjaright, certain sections i'd have to chop up02:03
harlowjahttps://github.com/openstack/kolla/blob/master/docker/keystone/keystone-base/Dockerfile.j2#L63-L7002:03
kollabotkolla/Dockerfile.j2 at master · openstack/kolla · GitHub02:03
harlowjathat one mainly02:03
inc0well, I wouldn't want to support both thb02:03
inc0tbh02:04
inc0if one is better than other, let's stick to better02:04
harlowjaagreed02:04
sdake_well harlowja there is a project in openstack to manage temporary forks02:05
sdake_harlowja the idea is it rebases to hte latest z stream at one command02:05
sdake_oracle using it02:06
Pavook sdake_ and inc0 ready to get TLS working now?02:06
sdake_if you really need it, could follow that model02:06
inc0Pavo, sooo you don't know what was the issue?02:06
Pavohave no clue02:06
sdake_real quick02:06
sdake_lets have a recap02:06
Pavounless it was some kind of vlan issue02:06
sdake_the issue was...02:06
sdake_changing the port from 80 to somethign else ? :)02:06
Pavobecause I have no vlans now02:06
sdake_yo ugot rid of vlans and that fixe dit?02:07
Pavook so how is 443 gonna work now?02:07
Pavono no02:07
*** dave-mccowan has quit IRC02:07
Pavowell lets check02:07
PavoI will do 80 to 80 and see what happens02:07
sdake_lets figure out what you did to fix it02:07
sdake_so we can leearn from it02:07
Pavook try ddi.hopto.org02:07
sdake_nothing02:08
sdake_sitting around02:08
Pavook one sec02:08
Pavooknow try ddi.hopto.org:800002:08
sdake_nada02:08
sdake_lemme log off vpn...02:09
*** sdake has joined #openstack-kolla02:10
sdakepavo 8000 works without vpn, wht about 80?02:10
Pavook try without 800002:10
Pavoddi.hopto.org02:10
sdakeya 80 works02:10
sdakeare you switching configs between?02:10
Pavono02:11
Pavojust switching port forwarding02:11
Pavoso now 80 works02:11
Pavohmmm02:11
sdakeis 80 internal?02:11
sdakeor 8000 internal?02:11
sdakegot a screenshot?02:11
Pavoright now 80 are both02:11
Pavohttps://www.dropbox.com/s/q4ystpzt5fir3si/Screenshot%202016-11-21%2021.11.51.png?dl=002:11
Pavoummm think I messed horizon up lol02:12
*** jgriffith has quit IRC02:12
Pavoone sec02:12
*** sdake_ has quit IRC02:13
Pavowow yeah I messed it up badly02:13
*** derekjhyang has joined #openstack-kolla02:13
PavoI was thinking I could just have the things I wanted changed in the custom config and nope thats not correct02:13
Pavooops02:14
Pavoguess you have to have all settings that are default in the custom config but just add the changes you want02:14
Pavodoing a reconfigure right now02:15
sdakeok dinner time02:16
openstackgerritAlexis Rivera proposed openstack/kolla-ansible: updating-deprecated-ansible-modules  https://review.openstack.org/40046602:26
kollabotGerrit Code Review02:26
openstackgerritJoshua Harlow proposed openstack/kolla: Allow for externally managed configuration  https://review.openstack.org/33259002:27
kollabotGerrit Code Review02:27
openstackgerritJoshua Harlow proposed openstack/kolla: Don't process/queue children not matched  https://review.openstack.org/40046702:29
kollabotGerrit Code Review02:29
Pavotheoretically I could pip install kolla on my mac and wouldn't need a VM as my deployer right?02:31
Pavook for TLS I should only have to add another IP as external vip, enable tls and add FQDN for external vip and make certs02:34
Pavothen reconfigure02:34
Pavocorrect inc0?02:35
inc0for deployment yeah02:36
inc0for docker registry02:37
inc0well, doable02:37
inc0just pita02:37
inc0(answer to mac question)02:37
openstackgerritAlexis Rivera proposed openstack/kolla-ansible: updating-deprecated-ansible-modules  https://review.openstack.org/40046602:37
kollabotGerrit Code Review02:37
PavoI have a docker registry running on my mac now without issue02:37
inc0kk then02:37
inc0ad TLS, yeah sounds about right02:37
Pavook editing globals now02:38
Pavook here goes nothing02:39
sdakepavo did you figure out how you got port 80 working?02:40
Pavonope lol02:40
sdakegroan02:40
PavoI know right02:41
Pavoonly thing it could have been was my vlan configuration02:41
sdakewhat else did you change in your env?02:41
Pavothats all I took out02:41
sdakeyour wireless probably doesnt support vlan02:41
Pavoremoved all vlans, trunks and only have 2 interfaces on nodes now02:41
Pavoyeah it does02:41
sdakeinteresting02:41
Pavohttps://www.dropbox.com/s/nofht5a1jeblwf9/Screenshot%202016-11-21%2021.42.05.png?dl=002:42
Pavosee02:42
sdakewow cna't believe it has that feature02:43
Pavoit didn't by default, using Tomato firmware02:43
sdakenever seen commercial product with vlans that is wireless02:43
sdakeoh custom firmware02:43
sdakecool well whatever works ;)02:43
*** gardlt has joined #openstack-kolla02:44
*** tonanhngo has quit IRC02:48
Pavook can you try https://ddi.hopto.org02:48
*** tonanhngo has joined #openstack-kolla02:48
Pavoanything?02:50
*** tonanhngo has quit IRC02:50
sdakenada02:50
Pavohmmm02:50
Pavowhat about now?02:51
Pavostill notihing?02:52
*** Jeffrey4l has joined #openstack-kolla02:53
openstackgerritAlexis Rivera proposed openstack/kolla-ansible: updating-deprecated-ansible-modules  https://review.openstack.org/40046602:53
kollabotGerrit Code Review02:53
*** tonanhngo has joined #openstack-kolla03:04
*** zhurong has quit IRC03:05
*** tonanhngo has quit IRC03:06
*** zhurong has joined #openstack-kolla03:06
*** sdake has quit IRC03:07
openstackgerritAlexis Rivera proposed openstack/kolla-ansible: updating-deprecated-ansible-modules  https://review.openstack.org/40046603:10
kollabotGerrit Code Review03:10
*** unicell1 has quit IRC03:11
*** bmace has quit IRC03:20
*** bmace has joined #openstack-kolla03:20
Pavofinally03:24
Pavohttps://ddi.hopto.org03:24
Pavoworking03:24
Pavoinc0 you can get to https://ddi.hopto.org right03:27
openstackgerritJeffrey Zhang proposed openstack/kolla: Remove setup_$distro.sh script  https://review.openstack.org/40048803:34
kollabotGerrit Code Review03:34
*** jgriffith has joined #openstack-kolla03:35
*** jgriffith has quit IRC03:36
*** fragatin_ has joined #openstack-kolla03:36
Pavowhy in the world would admin-openrc.sh use external vip03:37
*** fragatin_ has quit IRC03:38
*** fragati__ has joined #openstack-kolla03:38
openstackgerritJeffrey Zhang proposed openstack/kolla: Add octavia docker image  https://review.openstack.org/39989603:39
kollabotGerrit Code Review03:39
PavoI would assume admin-openrc.sh would only use internal endpoints03:39
PavoI wouldn't think anyone in their right mind would use admin-openrc.sh from external network03:39
*** fragatina has quit IRC03:39
*** fragati__ has quit IRC03:41
v1k0d3nhey portdirect_away you around?03:51
openstackgerritAlexis Rivera proposed openstack/kolla-ansible: updating-deprecated-ansible-modules  https://review.openstack.org/40046603:52
kollabotGerrit Code Review03:52
*** fragatina has joined #openstack-kolla03:57
*** unicell has joined #openstack-kolla03:59
*** tonanhngo has joined #openstack-kolla04:04
*** tonanhngo has quit IRC04:06
*** fragatina has quit IRC04:06
*** fragatina has joined #openstack-kolla04:07
*** Pavo has quit IRC04:11
*** fragatina has quit IRC04:11
*** sdake has joined #openstack-kolla04:13
*** sdake_ has joined #openstack-kolla04:14
*** diogogmt has quit IRC04:15
*** Pavo has joined #openstack-kolla04:16
*** sdake has quit IRC04:18
*** mdnadeem has joined #openstack-kolla04:23
*** tonanhngo has joined #openstack-kolla04:24
*** tonanhngo has quit IRC04:25
*** fragatina has joined #openstack-kolla04:29
*** fragatina has quit IRC04:29
*** inc0 has quit IRC04:29
*** fragatina has joined #openstack-kolla04:29
*** kong has quit IRC04:30
*** sp_ has joined #openstack-kolla04:31
*** tonanhngo has joined #openstack-kolla04:45
*** tonanhngo has quit IRC04:48
sdake_Jeffrey4l any idea on this gate failure in your ci patch? http://logs.openstack.org/01/398501/25/check/gate-kolla-ansible-dsvm-deploy-centos-source-centos-7-nv/db4be3c/console.html#_2016-11-22_03_16_17_06910505:01
kollabotResource at http://logs.openstack.org/01/398501/25/check/gate-kolla-ansible-dsvm-deploy-centos-source-centos-7-nv/db4be3c/console.html#_2016-11-22_03_16_17_069105 exceeds the maximum size.05:01
* Jeffrey4l is checking.05:02
sdake_looks like mysql looking for a file i've never seen before...05:02
sdake_just saw the wierdest review05:03
*** sbezverk_ has quit IRC05:03
sdake_check_mode review05:04
sdake_was yes now no05:04
sdake_no is right ;)05:04
*** sbezverk has joined #openstack-kolla05:04
sdake_ Alternatively you can run:05:05
sdake_2016-11-22 03:16:17.069530 | '/usr/bin/mysql_secure_installation'05:05
sdake_we do this iirc05:05
Jeffrey4lsdake_, check this  http://logs.openstack.org/01/398501/25/check/gate-kolla-ansible-dsvm-deploy-centos-source-centos-7-nv/db4be3c/logs/kolla/mariadb/mariadb.log05:05
Jeffrey4lyour logs should be correct.05:06
Jeffrey4lsdake_, search `[ERROR] WSREP: Process completed with error: /usr/local/bin/wsrep-notify.sh --status Joined --uuid 0769833e-b062-11e6-a02a-ff8f8ad832b5 --primary yes --index 0 --members 0768818a-b062-11e6-bbff-fecc5408fe87/node1/10.210.35.13:3306: 1 (Operation not permitted)`05:06
sdake_161122  3:16:16 [ERROR] WSREP: Process completed with error: /usr/local/bin/wsrep-notify.sh --status Joined --uuid 0769833e-b062-11e6-a02a-ff8f8ad832b5 --primary yes --index 0 --members 0768818a-b062-11e6-bbff-fecc5408fe87/node1/10.210.35.13:3306: 1 (Operation not permitted)05:06
sdake_ya05:06
sdake_permissions must be off on that file in the container05:07
Jeffrey4lno idea what's this. the other container: ubuntu and oraclelinux are ok.05:07
sdake_so only centos?05:08
*** mdnadeem has quit IRC05:08
sdake_this is sort of why we need cross repo gating ;)05:08
Jeffrey4lsdake_, not sure. this is not happen stabilize.05:08
Jeffrey4llast recheck, only oracle+source failed.05:09
sdake_so its intermittent?05:09
Jeffrey4lthis is the first time i saw  such issue.05:09
Jeffrey4land yes. it is intermittent.05:09
sdake_groan05:09
sdake_2016-11-22 02:51:42.267537 | [Zuul] Building remotely on centos-7-rax-iad-5720846 in workspace /home/jenkins/workspace/gate-kolla-ansible-dsvm-deploy-centos-source-centos-7-nv05:10
Jeffrey4lsdake_, this is a following PS https://review.openstack.org/40005105:10
kollabotGerrit Code Review05:10
sdake_so we know rax-iad generally hs problems for us05:10
Jeffrey4lit is all green.05:10
sdake_what provider did oracle+source fail on?05:10
sdake_i saw somewhere new images were being pushed by infra yesterday or the day prior05:11
sdake_could be selinux issue on a specific provider as well05:11
Jeffrey4lmaybe. but we can not explain this. it should not be related to host os, imo.05:11
Jeffrey4lsdake_, oracle+source is different issue.05:12
sdake_got a link to that one?05:12
Jeffrey4lnova_libvirt Existed ( in oracle+source )05:12
Jeffrey4lsdake_, http://logs.openstack.org/01/398501/25/check/gate-kolla-ansible-dsvm-deploy-oraclelinux-binary-centos-7-nv/4f9b4a7/console.html#_2016-11-22_03_25_01_39583605:12
kollabotResource at http://logs.openstack.org/01/398501/25/check/gate-kolla-ansible-dsvm-deploy-oraclelinux-binary-centos-7-nv/4f9b4a7/console.html#_2016-11-22_03_25_01_395836 exceeds the maximum size.05:12
Jeffrey4lsdake_, libvirtd.log   http://logs.openstack.org/01/398501/25/check/gate-kolla-ansible-dsvm-deploy-oraclelinux-binary-centos-7-nv/4f9b4a7/logs/kolla/libvirt/libvirtd.log05:13
sdake_2016-11-22 02:51:09.857711 | [Zuul] Building remotely on centos-7-rax-iad-5720987 in workspace /home/jenkins/workspace/gate-kolla-ansible-dsvm-deploy-oraclelinux-binary-centos-7-nv05:13
sdake_looks like another rax-iad problem05:13
Jeffrey4lmaybe.05:13
sdake_have had more problems with rax-iad then any other provider ;)05:14
sdake_keep going at the rechecks05:14
sdake_we need to get that work merged now that pc has merged05:14
sdake_fwiw i've seen that second failure before on rax-iad05:15
*** n3v3rm0r3r has quit IRC05:15
sdake_never seen that first failure05:15
sdake_tif you see more perm denied we prob need to contact infra to ask the mto push new images to rax-iad05:16
sdake_especially if we can grab the audit log05:16
Jeffrey4lsdake_, we have grab the audit log.05:17
sdake_coool do you have link to audit log for the mysql failure?05:17
Jeffrey4lsdake_, http://logs.openstack.org/01/398501/25/check/gate-kolla-ansible-dsvm-deploy-centos-source-centos-7-nv/db4be3c/logs/system_logs/05:17
kollabotIndex of /01/398501/25/check/gate-kolla-ansible-dsvm-deploy-centos-source-centos-7-nv/db4be3c/logs/system_logs05:17
Jeffrey4lfyi, the system log is collected all the time.05:17
sdake_type=USER_LOGIN msg=audit(1479783067.974:167): pid=1135 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=login acct="(unknown)" exe="/usr/sbin/sshd" hostname=? addr=172.99.112.182 terminal=ssh res=failed'05:18
sdake_i see that05:18
Jeffrey4lbut i am now sure what cause the mariadb failed.05:18
sdake_nice work on that ;)05:18
sdake_thats the only audit long entry i see that looks problematic05:18
sdake_there is another one after it as well05:18
sdake_well not sure - was hoping to see mysql pop up in that audit log05:20
sdake_or something else05:20
Jeffrey4lbut seems it is ok.05:20
openstackgerritJeffrey Zhang proposed openstack/kolla: NO_MERGE: test mitaka branch  https://review.openstack.org/39387705:23
kollabotGerrit Code Review05:23
sdake_off to bed05:24
sdake_night folks05:24
*** sdake_ has quit IRC05:24
Jeffrey4lnight.05:24
*** sdake has joined #openstack-kolla05:26
*** gardlt has quit IRC05:27
*** sdake has quit IRC05:30
*** kollabot has quit IRC05:34
*** kollabot has joined #openstack-kolla05:34
*** unicell has quit IRC05:45
*** unicell has joined #openstack-kolla05:45
*** prameswar has joined #openstack-kolla05:46
Jeffrey4lsdake05:52
Jeffrey4lneed ack for https://review.openstack.org/398501  which unblock the kolla-ansible gate. thanks.05:53
kollabotGerrit Code Review05:53
*** saneax is now known as saneax-_-|AFK05:54
*** tonanhngo has joined #openstack-kolla05:55
*** mdnadeem has joined #openstack-kolla05:56
*** tonanhngo has quit IRC05:56
*** skramaja has joined #openstack-kolla05:56
*** kollabot has quit IRC05:57
*** kollabot has joined #openstack-kolla05:58
*** senk has joined #openstack-kolla05:59
*** kollabot has quit IRC06:01
*** kollabot has joined #openstack-kolla06:02
*** kollabot has joined #openstack-kolla06:02
*** kristian__ has joined #openstack-kolla06:03
*** Pavo has quit IRC06:11
*** tonanhngo has joined #openstack-kolla06:15
*** Pavo has joined #openstack-kolla06:15
*** tonanhngo has quit IRC06:16
*** tonanhngo has joined #openstack-kolla06:27
*** tonanhngo has quit IRC06:30
openstackgerritJeffrey Zhang proposed openstack/kolla: Remove setup_$distro.sh script  https://review.openstack.org/40048806:33
*** v1k0d3n has quit IRC06:34
*** f13o has joined #openstack-kolla06:43
*** awidders_ has joined #openstack-kolla06:49
*** awiddersheim has quit IRC06:49
bjolomorning06:52
*** senk has quit IRC06:52
*** Satya_ has joined #openstack-kolla06:52
*** kristian__ has quit IRC06:57
*** sp_ has quit IRC07:06
*** sp_ has joined #openstack-kolla07:19
*** tonanhngo has joined #openstack-kolla07:25
*** tonanhngo has quit IRC07:26
*** senk has joined #openstack-kolla07:30
*** sdake has joined #openstack-kolla07:33
*** tovin07_ has quit IRC07:33
*** tovin07 has quit IRC07:33
*** sdake_ has joined #openstack-kolla07:34
*** tovin07 has joined #openstack-kolla07:35
*** tovin07_ has joined #openstack-kolla07:36
*** sdake has quit IRC07:38
*** Serlex has joined #openstack-kolla07:42
*** tonanhngo has joined #openstack-kolla07:45
*** tonanhngo has quit IRC07:47
*** senk has quit IRC07:48
*** f13o has quit IRC07:50
*** senk has joined #openstack-kolla07:53
*** kollabot has quit IRC07:55
openstackgerritMerged openstack/kolla-ansible: Fix fact gathering when using --limit  https://review.openstack.org/39831307:55
*** kollabot has joined #openstack-kolla07:56
jascott1hubot hi07:56
openstackgerritSteven Dake proposed openstack/kolla: Add specs are advisory readme.rst to kolla repo  https://review.openstack.org/40057007:56
jascott1werps...07:56
jascott1kollabot hi07:56
kollabotHi07:56
*** matrohon has joined #openstack-kolla07:57
*** berendt has joined #openstack-kolla07:57
sdake_sup berendt07:57
sdake_hey jascott107:57
*** kollabot1 has joined #openstack-kolla07:58
openstackgerritMerged openstack/kolla-ansible: Fix network configuration for cloudkitty  https://review.openstack.org/40001107:58
jascott1yo07:58
jascott1stopped the bot from saying 'Gerrit Code Review' every time one posted07:58
*** kollabot has quit IRC07:58
berendtmorning07:59
*** kollabot1 has quit IRC08:00
*** kollabot has joined #openstack-kolla08:00
jascott1this bot is 'not entirely stable' ;)08:01
sdake_;-)08:01
sdake_when i was a young tike i wrote an irc bot08:01
sdake_called annoy bot08:02
sdake_heard of it?08:02
sdake_;-)08:02
jascott1heheh08:02
sdake_also wrote an icmp nuke bot08:02
sdake_that was more fun :)08:02
*** tonanhngo has joined #openstack-kolla08:02
sdake_annoy bot was pretty cool it would join a channel08:02
sdake_and then have other annoy bots join a channel over time08:03
sdake_and they would carry on a nonsensical conversation08:03
jascott1hey that is familiar08:03
sdake_icmp nuke bot would icmp nuke a irc server, then connect a user for each user in the channel08:03
sdake_this would cause mass collisions and kill everyone in the channel08:03
sdake_obvoiusly in the 90s when nickserv wasn't a thing and icmp wasn't locked down :)08:04
jascott1i remember bot floods and what not but wasnt aware of icmp nuke going on08:04
sdake_ya that is not possible today08:04
*** tonanhngo has quit IRC08:05
sdake_this was sort of pre-firewall :)08:05
jascott1kinda funny im living on irc again 20+ years later08:05
sdake_my friend did something much more interesting, he wrote a firewall that run on a flooppy disk08:06
sdake_actually i guess he is my brother in law08:06
sdake_such a wierd thing to say08:06
jascott1i have one08:06
jascott1we play music most fridays downtown Hillsboro08:06
sdake_nice08:06
jascott1with my stepbrother08:06
sdake_which instrument08:07
jascott1another local band is called 'brother man' which wouldve been great for us08:07
jascott1great guys08:07
sdake_ya i go down to the hifi store some days and local bands are playing their presses on their gear08:08
jascott1guitar for me, stepbro keys and bro in law sings and plays acoustic08:08
jascott1you play keys?08:08
sdake_not musical at all08:08
sdake_my daughter is08:08
sdake_in choir and dance atm08:08
openstackgerritJavier Castillo Alcíbar proposed openstack/kolla-ansible: Fix ceilometer not sending logs to heka  https://review.openstack.org/40016808:08
sdake_my wife is08:09
sdake_my son is not08:09
sdake_i attended 301 music in america in university08:09
jascott1its great, id go crazy without it im sure08:09
sdake_easy course08:09
sdake_but it didn't  get into the mechanics of playing an instrument or harmony08:09
sdake_i did a drum circle once ;)08:09
sdake_that was kind of crazy08:09
jascott1used to play bass in a 'power trio' when I was younger. good ol days08:10
openstackgerritJeffrey Zhang proposed openstack/kolla: NO_MERGE: test mitaka branch  https://review.openstack.org/39387708:10
sdake_my daughter has a guitar but she doesn't play it08:10
sdake_kind of a bummer08:10
sdake_she is quite gifted on the art side and techincal side08:10
jascott1my youngest is playing guitar. plays it a little everyday which is about as much as I could ask for08:10
sdake_thats fantastic :)08:11
*** Pavo has quit IRC08:11
sdake_my son is more of a computer nerd :)08:11
Satya_lol08:11
jascott1convinced it helps shake out the bad bits in ma brain08:11
jascott1ya I cant get mine into it08:11
jascott1he wants to but doesnt have any motivation08:11
sdake_teaching him c now08:11
jascott1Ive learning unity3d hoping to gateway him into it08:12
jascott1but he is more into playing games08:12
jascott1cool!08:12
sdake_ya my son is totally into vid games08:12
sdake_but we learn c about 40 mins a day08:12
sdake_teaching him vi with it08:12
sdake_rather he learns08:13
jascott1man thats great. Ive showed mine a ittle of everything, i thought web/js would be empowering (look you can kill a paywall, kill a graphic etc) yawnz08:13
sdake_i bought my daughter a c book08:13
sdake_she took it to school08:13
sdake_i think she read parts of it08:13
sdake_she reads really fast08:13
jascott1to each their own tho. we really just push finding *something* you love to do08:13
sdake_which is not how K&R is meant to be digested08:14
jascott1heheh08:14
jascott1wow thats so cool08:14
sdake_she wants to be a video game artist of some type when she  grows up apparently08:14
sdake_she is 1408:14
sdake_son is undecided - not thinking of such things08:14
jascott1oh hey have they messed with unity? its really fun08:15
sdake_nope whats unity08:15
jascott1its c# or js but really should use c#08:15
jascott1its a free game engine08:15
sdake_some type of api?08:15
sdake_right makes sense08:15
*** Pavo has joined #openstack-kolla08:16
sdake_i think that might be to advanced for them08:16
jascott1well free up until you gross 100k$ yr08:16
jascott1no i promise08:16
jascott1this is like autocad for games08:16
jascott1kinda like unreal08:16
sdake_lol08:16
jascott1https://unity3d.com/08:16
kollabotUnity - Game Engine08:16
jascott1one sec08:17
jascott1https://unity3d.com/learn/tutorials/projects/roll-ball-tutorial08:17
kollabotUnity - Roll-a-ball tutorial08:17
openstackgerritzhubingbing proposed openstack/kolla-ansible: Add trove role  https://review.openstack.org/40058008:18
jascott1so its mostly UI driven (although you can script everything) but uses snippets of C# or js to detect collisions08:18
sdake_the concepts look fairly complex for a 12 year old08:18
jascott1true the UI is a little daunting08:19
jascott1its great tho. yeah 12 might be a little on the young side08:19
sdake_my true goal is to teach them how a computer works top to bottom08:19
sdake_since that is what they are interested in08:19
jascott1it helps if they are interested in08:20
jascott1can always build on that08:20
sdake_indeed son is not sure on daughter :)08:20
sdake_jascott1 which part of the world you in08:21
jascott1Im outside of Portland OR in Hillsboro08:21
sdake_oh right you said that ;)08:21
jascott1inc0 is moving up here in Dec08:21
sdake_yup he mentioned it08:22
sdake_intel site then at hillsboro?08:22
sdake_been to it08:22
sdake_worked at intel08:22
sdake_c608:22
jascott1oh yeah? how was that?08:22
sdake_back when c6 was cool08:22
jascott1C6?08:23
jascott1campus?08:23
sdake_building i worked in08:23
sdake_chandler 608:23
jascott1oh08:23
jascott1yea we are in Jones Farm08:23
openstackgerritzhubingbing proposed openstack/kolla: Fix congress broken  https://review.openstack.org/39841308:23
*** tonanhngo has joined #openstack-kolla08:23
sdake_i was there during the late 90s08:23
sdake_security was high08:23
sdake_always felt like someone was gonna come in and shoot up the place ;)08:23
zhubingbingsdake08:23
jascott1yikes!08:23
zhubingbinghttps://review.openstack.org/398413 please review it08:24
zhubingbing;)08:24
sdake_intel was really good for me08:24
jascott1hmm luckily i dont feel that way08:24
jascott1(about the shooting)08:24
sdake_how long you been there08:24
sdake_its a different time08:24
jascott1its been great for me08:24
sdake_intel probably not so paranoid now :)08:24
jascott1great company to work for08:24
sdake_ya i suspect i woudl have gone far if i stayed at intel08:24
*** tonanhngo has quit IRC08:24
jascott1get caught in a 'restructuring'?08:25
sdake_nope joined a startup08:25
sdake_which was run aground08:25
jascott1ah brave man!08:25
jascott1oh08:25
jascott1sorry08:26
sdake_but it was a rockin learning experience08:26
sdake_its ok it wasn't my money it was in fact intels :)08:26
sdake_the co was montavista08:26
jascott1whatd yall do?08:27
sdake_embedded linux08:27
sdake_basically our business model looked like this08:27
jascott1ah cool08:27
sdake_we made 300 board ports a year08:27
sdake_and 10 of them sold08:27
sdake_for 10-50k in total08:27
sdake_and we had 120 mil in funding08:27
sdake_and a couple hundred employees08:27
jascott1wow08:27
sdake_the worst part is our customers were making bilskies off our board ports08:28
sdake_actually thats not the worst part08:28
sdake_better saved for in person :)08:28
jascott1no doubt. where are you located now?08:29
sdake_arizona08:29
sdake_at cisco08:29
jascott1ah the dry lands!08:29
sdake_i spent about 12 years in flagstaff08:29
sdake_4 seasons08:30
jascott1i liked flag when I visited08:30
jascott1those northern towns seem cool but also seemed like not a lot todo08:30
openstackgerritJeffrey Zhang proposed openstack/kolla: NO_MERGE: test mitaka branch  https://review.openstack.org/39387708:30
jascott1not that i do much, laptop, guitar, libations.08:30
*** egonzalez90 has joined #openstack-kolla08:32
sdake_ya flagstaff is perfect for that :)08:33
Serlexmorning, what about to koll-ansible?08:38
sdake_serlex that didn't parse ;)08:41
*** tonanhngo has joined #openstack-kolla08:44
*** hogepodge has quit IRC08:45
*** tonanhngo has quit IRC08:45
sdake_sup egonzalez9008:46
sdake_zhubingbing i looked at your review08:48
zhubingbingok08:48
sdake_zhubingbing you must check out http://github.com/openstack/kolla-ansible08:48
kollabotGitHub - openstack/kolla-ansible: Ansible deployment of the Kolla containers08:48
sdake_we split the repos08:48
bjolopbourke, i did some testing yesterday using macvlan interfaces instead of vlans and it seems to work08:48
sdake_sup bjolo08:48
bjolosup sdake_08:48
bjolowhen do you sleep? :)08:49
sdake_bjolo I'm reminded of a Bee Jees song...08:49
sdake_bjolo hopefully soon08:49
sdake_still lagging from bcn08:49
sdake_takes me a couple weeks to get back on a normal schedule08:49
bjolooh hit you that bad huh08:49
*** jmccarthy has joined #openstack-kolla08:49
sdake_ya europe is brutal for me08:49
sdake_going isn't bad08:50
sdake_coming back is hard08:50
bjoloi remember one time i flew to hawaii from sweden. Swear to god, i could not eat, sleep or even talk for 4 days08:50
sdake_yikes08:50
bjolocould not form a single sentence properly. my brain was just firing off in all directions08:51
sdake_ya i dont have that problem08:51
bjologood08:51
sdake_just sleep lag08:51
bjolohope you get back on schedule soon. jet lag sucks08:51
sdake_it doesn't help that i pulled a 30 hour day on wednesday08:51
sdake_of last week08:51
bjolonope08:52
sdake_had to be done08:52
*** sdake_ is now known as sdake08:52
sdakei ten dto run odd hours anyway08:53
sdakeso being up at 2am isn't totally abnormal08:53
sdakefor me atleast ;-)08:53
bjolonope08:53
bjoloyou are usually here when i come in in the morning08:53
bjolook need to run08:53
sdakesome days08:53
sdakelater08:53
bjolomellanox onsite for tech update on their switches and nics08:54
sdakeenjoy08:54
sdakei bought mellanox at 1$08:54
sdakeit went to 12008:54
sdakeI sold it08:54
sdakewinning :)08:54
bjolonice :)08:54
bjoloi like their nics08:54
bjolotheir switches seems pretty darn good too08:54
sdakethis was in the rdma infiniband days08:54
bjolociao for now08:54
sdakelater08:55
sdakezhubingbing and you should apply that work to that repo08:56
sdakeand resubmit it08:56
*** Satya_ has quit IRC08:56
sdakezhubingbing the reason it has a -2 on it is the kolla repo no longer has an ansible dir08:56
sdakewell enough fun for one day - enjoy08:57
*** sdake has quit IRC08:57
*** prameswar has quit IRC08:58
zhubingbingok09:03
*** athomas has joined #openstack-kolla09:04
*** tonanhngo has joined #openstack-kolla09:04
*** tonanhngo has quit IRC09:06
openstackgerritzhubingbing proposed openstack/kolla-ansible: Fix congress broken  https://review.openstack.org/40062309:10
zhubingbingsdake https://review.openstack.org/#/c/400623/09:11
*** prameswar has joined #openstack-kolla09:11
openstackgerritJeffrey Zhang proposed openstack/kolla: Update Percona repo to current release  https://review.openstack.org/39954909:20
openstackgerritJeffrey Zhang proposed openstack/kolla: NO_MERGE: test mitaka branch  https://review.openstack.org/39387709:21
magicboizmorning09:23
magicboizI need help from of you guys :)09:23
*** tonanhngo has joined #openstack-kolla09:24
magicboizI'd like to copy the CA certificate to ALL docker containers, what would be the correct way to do it?09:24
magicboizplaying with config.json / kolla-toolbox.json.j2?09:24
*** tonanhngo has quit IRC09:25
*** mmoster_ has joined #openstack-kolla09:25
egonzalez90magicboiz: if is copying something to docker images, use image customization http://docs.openstack.org/developer/kolla/image-building.html#dockerfile-customisation09:26
kollabotBuilding Container Images — kolla 4.0.0.0b2.dev49 documentation09:26
zhubingbinghttps://review.openstack.org/#/c/400623/09:27
egonzalez90if is something on ansible side, actually there is not any mechanism to copy custom files yet09:27
zhubingbinghello please review it09:27
zhubingbing-)who can help me09:27
egonzalez90you'll need to edit code09:27
magicboizegonzalez90: ok09:29
egonzalez90if is for TLS certificates, you can use this http://docs.openstack.org/developer/kolla/advanced-configuration.html#tls-configuration09:30
kollabotAdvanced Configuration — kolla 4.0.0.0b2.dev49 documentation09:30
*** mmoster_ has quit IRC09:32
*** f13o has joined #openstack-kolla09:33
*** Satya_ has joined #openstack-kolla09:34
Satya_hi09:34
*** yingjun has quit IRC09:37
*** yingjun has joined #openstack-kolla09:37
egonzalez90Hi Satya_09:38
Satya_hi09:38
Satya_Hi egonzalez9009:40
*** yingjun has quit IRC09:42
*** tonanhngo has joined #openstack-kolla09:43
*** tonanhngo has quit IRC09:44
*** f13o has quit IRC09:46
*** tovin07_ has quit IRC09:48
*** tovin07 has quit IRC09:49
*** eaguilar has joined #openstack-kolla09:56
*** athomas has quit IRC09:57
*** athomas has joined #openstack-kolla09:57
*** athomas has quit IRC09:57
*** zhurong has quit IRC10:03
*** prameswar has quit IRC10:04
*** tonanhngo has joined #openstack-kolla10:04
*** tonanhngo has quit IRC10:05
*** Satya_ has quit IRC10:06
*** athomas has joined #openstack-kolla10:07
athomas.,10:07
*** Pavo has quit IRC10:11
*** Pavo has joined #openstack-kolla10:16
*** berendt has quit IRC10:16
*** prameswar has joined #openstack-kolla10:20
*** portdirect_ has joined #openstack-kolla10:20
*** portdirect_ has quit IRC10:23
*** tonanhngo has joined #openstack-kolla10:24
*** portdirect_ has joined #openstack-kolla10:24
*** portdirect_ has quit IRC10:24
*** portdirect_ has joined #openstack-kolla10:25
*** portdirect_ has joined #openstack-kolla10:25
*** gfidente has joined #openstack-kolla10:25
*** gfidente has joined #openstack-kolla10:25
*** zhubingbing has quit IRC10:25
portdirect_kollabot help10:26
*** tonanhngo has quit IRC10:26
kollabotportdirect_: replied to you in private!10:26
portdirect_kollabot the rules10:26
kollabot0. A robot may not harm humanity, or, by inaction, allow humanity to come to harm.10:26
kollabot1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.10:26
kollabot2. A robot must obey any orders given to it by human beings, except where such orders would conflict with the First Law.10:26
kollabot3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.10:26
egonzalez90lol10:27
portdirect_oh dear10:27
egonzalez90isnt a rule for woot?10:27
portdirect_moar woot!10:28
portdirect_anyway morning egonzalez90!10:28
egonzalez90morning portdirect_10:29
*** ppalacios has joined #openstack-kolla10:30
*** portdirect_ has quit IRC10:37
sp_sdake_: jascott1 kollabot just a lame query. Can we use kolla-k8s for POC or Production environment?10:48
sp_egonzalez90: You can also provide your views on this for me to get understanding.10:48
pbourkesp_: kolla-k8s is not production ready10:54
*** shardy has joined #openstack-kolla10:55
sp_pbourke: even not after ocata release :( ??10:56
pbourkesp_: I'm not actively involved in kolla-k8s at the moment but I dont see how it could go from POC to production ready in one release10:57
sp_pbourke: Thanks for your kind response10:58
*** jascott1 has quit IRC10:59
*** eaguilar has quit IRC11:00
*** portdirect_away is now known as portdirect11:04
openstackgerritMerged openstack/kolla-ansible: Fix ceilometer not sending logs to heka  https://review.openstack.org/40016811:05
portdirectsp_: the ocata release  was just a POC, since then several other people have got involved (including me), many of whom where working on parallel projects11:06
portdirectsp_: we only recently came to a consensus on how the direction we should be moving in, based upon our expereinces of openstack in k8s, and the speed of development of k8s itself11:07
openstackgerritMerged openstack/kolla-ansible: updating-deprecated-ansible-modules  https://review.openstack.org/40046611:08
portdirectsp_: this is best layed out in this doc https://github.com/openstack/kolla-kubernetes/blob/master/specs/kolla-kubernetes-arch.rst, though this is also worth reading: https://github.com/openstack/kolla-kubernetes/blob/master/specs/README.rst11:08
kollabotkolla-kubernetes/README.rst at master · openstack/kolla-kubernetes · GitHub11:08
*** msimonin has joined #openstack-kolla11:08
sp_portdirect: in your 1st line. I guess you are talking about Newton release11:10
portdirectsp_: yeah, only just had my first sip of coffee this morning :/11:10
sp_portdirect: nice :)11:11
*** Bico_Fino has joined #openstack-kolla11:12
*** zhubingbing_ has joined #openstack-kolla11:15
*** zhangshuai has joined #openstack-kolla11:30
*** tonanhngo has joined #openstack-kolla11:35
*** tonanhngo has quit IRC11:36
*** mmoster_ has joined #openstack-kolla11:41
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Remove docker from kolla-ansible  https://review.openstack.org/39832011:42
openstackgerritMerged openstack/kolla-ansible: fix ci gate  https://review.openstack.org/39850111:43
openstackgerritMerged openstack/kolla-ansible: Use tox to build gate images  https://review.openstack.org/40005111:43
*** mmoster_ has quit IRC11:48
*** zhangshuai has quit IRC11:50
*** zhangshuai has joined #openstack-kolla11:50
pbourkecan someone please review https://review.openstack.org/#/c/392583/11:53
*** tonanhngo has joined #openstack-kolla11:55
*** tonanhngo has quit IRC11:56
openstackgerritJavier Castillo Alcíbar proposed openstack/kolla-ansible: Refined version of heka-ceilometer in order to manage logs from - apache: ceilometer-api - openstack: ceilometer-collector, polling...  https://review.openstack.org/40070211:57
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Remove docker folder from kolla-ansible  https://review.openstack.org/39832011:58
*** jtriley has quit IRC12:05
openstackgerritJeffrey Zhang proposed openstack/kolla-ansible: Remove the disable of ipv6 in gate  https://review.openstack.org/40070712:07
openstackgerritJeffrey Zhang proposed openstack/kolla: Install mkfs.vfat tool in ironic-conductor image  https://review.openstack.org/40070912:09
*** Pavo has quit IRC12:11
openstackgerritMauricio Lima proposed openstack/kolla-ansible: Remove docker folder from kolla-ansible  https://review.openstack.org/39832012:11
*** Bico_Fino has quit IRC12:11
openstackgerritJavier Castillo Alcíbar proposed openstack/kolla-ansible: Make sure ceilometer/service_credentials wotks with internalURL  https://review.openstack.org/40071112:14
*** tonanhngo has joined #openstack-kolla12:15
*** Pavo has joined #openstack-kolla12:15
*** tonanhngo has quit IRC12:17
openstackgerritJavier Castillo Alcíbar proposed openstack/kolla-ansible: Make sure heka-ceilometer.toml manages correctly apache and openstack ceilometer logs  https://review.openstack.org/40071612:18
openstackgerritJeffrey Zhang proposed openstack/kolla: Update Percona repo to current release  https://review.openstack.org/39954912:21
*** tonanhngo has joined #openstack-kolla12:26
*** tonanhngo has quit IRC12:27
*** Bico_Fino has joined #openstack-kolla12:28
*** rmart04 has joined #openstack-kolla12:33
portdirectJeffrey4L: thanks for sorting that bug :) if your about I would appreciate some advice re: https://bugs.launchpad.net/kolla/+bug/164299512:34
openstackLaunchpad bug 1642995 in kolla newton "Designate source Images do not contain required assets" [Undecided,New] - Assigned to Pete Birley (portdirect)12:34
kollabotBug #1642995 “Designate source Images do not contain required as...” : Bugs : kolla12:34
Jeffrey4lwhat kind of advice? :)12:35
Jeffrey4lportdirect,12:35
portdirectJeffrey4L: solving it is super easy, but I'm not sure of the workflow to tie toegether correctly between releases - if you could give me some pointers I'll get right on it :)12:35
Jeffrey4lportdirect, fix it in the master branch and backport it into newton when merged. you should not care about the release very much.12:36
*** liyifeng has quit IRC12:37
portdirectcool  - cheers12:38
*** f13o has joined #openstack-kolla12:41
*** rhallisey has joined #openstack-kolla12:43
*** tonanhngo has joined #openstack-kolla12:45
*** f13o has quit IRC12:46
*** tonanhngo has quit IRC12:47
openstackgerritPete Birley proposed openstack/kolla: Fix Designate source image container assets  https://review.openstack.org/40073012:47
*** skramaja_ has joined #openstack-kolla12:48
openstackgerritPete Birley proposed openstack/kolla: Fix Designate source image container assets  https://review.openstack.org/40073012:48
*** skramaja has quit IRC12:48
Bico_FinoHi, I need anything configured inside /etc/kolla prior to run kolla build ?12:49
*** mmoster_ has joined #openstack-kolla12:50
rhalliseyBico_Fino, yes, copy the contents of etc/kolla in the kolla directory12:50
pbourkeBico_Fino: http://docs.openstack.org/developer/kolla/image-building.html12:50
kollabotBuilding Container Images — kolla 4.0.0.0b2.dev49 documentation12:50
Bico_FinoYeah, already did that12:52
Bico_FinoI’m trying with 3.0.1 version12:52
Bico_FinoGot some failures12:52
openstackgerritMauricio Lima proposed openstack/kolla: Add nfs package in manila-data dockerfile  https://review.openstack.org/40073412:52
Bico_Finohttps://gist.github.com/bicofino/c56b1e1ccf7d35564df489c0de3a53fb12:52
kollabotgist:c56b1e1ccf7d35564df489c0de3a53fb · GitHub12:52
pbourkeBico_Fino: would need to see the full output to know why those images failed12:53
Bico_Finopbourke: Let me run again and save the full output12:54
*** eaguilar has joined #openstack-kolla12:59
*** sdake has joined #openstack-kolla12:59
sdakemorning peeps13:00
*** prameswar has quit IRC13:00
sdakepbourke yo dwag13:00
pbourkesdake: morning13:00
sdakepbourke i think the gates are finally working13:00
pbourkeyeah massive thanks to Jeffrey4l13:01
sdakepbourke Jeffrey4l did a monster job hammering em out13:01
pbourkegreat to see13:01
sdakewondering if you know of any other short term breakages (besides wtf to do with docs)13:01
sdakethta are missing from the gate13:01
*** zhurong has joined #openstack-kolla13:02
*** msimonin has quit IRC13:03
*** tonanhngo has joined #openstack-kolla13:04
*** sdake_ has joined #openstack-kolla13:04
sdake_[06:01:37]  <sdake>wondering if you know of any other short term breakages (besides wtf to do with docs)13:05
sdake_[06:01:52]  <sdake>thta are missing from the gate13:05
sdake_yo dawg pbourke ^^ :)13:05
Bico_Finopbourke: Full log now > https://gist.github.com/bicofino/c56b1e1ccf7d35564df489c0de3a53fb13:05
kollabotResource at https://gist.github.com/bicofino/c56b1e1ccf7d35564df489c0de3a53fb exceeds the maximum size.13:05
*** dave-mccowan has joined #openstack-kolla13:05
sdake_sorry about the yo dawg ting, its from an email one of my friends (zane bitter) wrote13:05
sdake_which was pretty funny13:05
*** mdnadeem has quit IRC13:05
sdake_and its kind of sticking :)13:05
sdake_it will subside eventually :)13:05
*** tonanhngo has quit IRC13:05
sdake_funny in that his email was sad but true13:06
*** sdake has quit IRC13:07
sdake_anyway guess not :)13:11
sdake_moring dave-mccowan13:11
dave-mccowangood morning sdake_13:11
sdake_dave-mccowan are ou on slack too?13:12
dave-mccowanyes, at least on one internal slack server13:12
sdake_is there one client to rule them all13:13
sdake_for mac13:13
sdake_iirc your on a mac13:13
sdake_would rather not have two client windows open - difficult to deal with one window..13:13
dave-mccowani only know about the official slack client.  i haven't looked for others.13:13
sdake_slack client itself has irc support?13:13
dave-mccowanoh... i don't think so.  i run textual, slack, and spark clients. :-(13:14
sdake_don't forget jabber ;)13:14
dave-mccowan:-(13:14
*** eaguilar_ has joined #openstack-kolla13:14
*** sp__ has joined #openstack-kolla13:14
sdake_atleast jabber doesn't take up a whole window :)13:15
dave-mccowanthen, we still need webex and email.  and sometimes i see people in person.13:15
*** msimonin has joined #openstack-kolla13:15
sdake_well thta may not be true13:15
*** eaguilar has quit IRC13:15
sdake_ya - trying to sort out how to work with two clients13:15
*** skramaja has joined #openstack-kolla13:16
*** skramaja_ has quit IRC13:16
Bico_Finopbourke: Looks like I got a bunch of these -> The command '/bin/sh -c echo 'binary not yet available for centos'     && /bin/false' returned a non-zero code: 113:16
portdirectkfox1111: about?13:20
*** tovin07 has joined #openstack-kolla13:20
Bico_Finopbourke: I was able to build congress-base that was failing by using —type ubuntu13:23
Bico_FinoGoing try build everything with —type ubuntu13:24
portdirectquestion to the floor: has anyone run kolla-k8s from a fedora host (or another system the predictable interface names...)? having some fun with setting up ansible genconfig as my dev box has device names that my k8s nodes dont (eg enp3s0 vs eth0)13:24
sdake_portdirect at one point fedora didn't work with centos images13:25
sdake_the reason had to do with something about fedora having a newer something or another that centos couldn't decode13:25
sdake_kernel driver imges i think13:25
sdake_so digging into your question more, kubernets just creates eth0 right?13:27
sdake_if you set internal_interface to eth013:27
sdake_that may get the job done13:28
openstackgerritDaniel Gonzalez Nothnagel proposed openstack/kolla: Remove 'ansible' from README directory list  https://review.openstack.org/40075313:28
*** lamt has joined #openstack-kolla13:28
portdirectyeah - I'm working on that stuff we were talking about yesterday, to try and get the docs a bit more aligned with where we are now.13:29
openstackgerritMerged openstack/kolla: Clean up docs around local registry  https://review.openstack.org/39258313:29
portdirectMy dev boxes are running F24, and I've got a k8s cluster running on CentOS 7.2 in vagrant, with acesss via kubectl13:30
portdirectso at this point: https://github.com/openstack/kolla-kubernetes/blob/master/doc/source/multi-node.rst#configure-kolla13:30
kollabotkolla-kubernetes/multi-node.rst at master · openstack/kolla-kubernetes · GitHub13:30
Bico_Finopbourke: —base I mean, not —type. :)13:31
sdake_cool so working on the vagrant dev environment for kolla-kubernetes seems cruical to me13:31
sdake_i had planned to dig into it today to see where it stood and what needs to be done13:31
portdirectI'm having some probs simply running kolla-ansible genconfig without freaking out at generating haproxy configs13:31
sdake_i see13:31
sdake_sbezverk probably a good person to contact here13:32
sdake_sbezverk he runs a similiar setup (cenots however)13:32
sdake_sbezverk but it does the same udev funkiness as fedora does with interface names13:33
sdake_portdirect did you read the manual re integrating the config options into globals.yaml?13:33
portdirectyeah - I had a similar seup working a month ago... may check out an earlier commit for kolla and kolla-k8s and then fastforawrd till I get stuck again.13:34
*** tonanhngo has joined #openstack-kolla13:34
sdake_i think one delta you got going here is your running vagrant13:35
sdake_what interfaces does vagrant expose?13:35
*** fguillot has joined #openstack-kolla13:35
*** tonanhngo has quit IRC13:35
sdake_my expectation would be vagrant would expose eth0/eth113:35
sdake_it may atm only b eexposing eth013:35
sdake_needs to expose two interfaces13:35
sdake_which is trivial to do from my understnading13:36
portdirectyeah - I may be taking to big a leap with that :/ though it would mean that I could really rip into getting going when i van have everitning in a venv outside and just creat and destroy clusters at will..13:36
portdirecthalycon is set up to expose both interfaces13:36
portdirectI'll have another crack after lunch and hit up sbezverk when he's about13:38
*** v1k0d3n has joined #openstack-kolla13:46
*** mliima_ has joined #openstack-kolla13:46
Bico_FinoWe don’t have the 3.0.1 for https://hub.docker.com/r/kolla/ubuntu-binary-kolla-toolbox/tags/ yet?13:47
sdake_it can't expose host interfaces13:49
sdake_it uses libvirt13:49
sdake_portdirect ^13:49
*** mliima has quit IRC13:49
sdake_libvirt creates its own set of interfaces13:49
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Service and Mariadb operator template  https://review.openstack.org/39997213:51
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Mariadb Kubernetes Operator  https://review.openstack.org/39926313:51
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Kubernetes Operator base  https://review.openstack.org/39926213:51
*** jgriffith has joined #openstack-kolla13:53
openstackgerritOpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements  https://review.openstack.org/40077013:54
*** tonanhngo has joined #openstack-kolla13:54
openstackgerritMerged openstack/kolla: Update Percona repo to current release  https://review.openstack.org/39954913:55
*** tonanhngo has quit IRC13:56
mliima_horizon dashboard is broken?13:56
egonzalez90mliima_: not sure, what is not working?13:57
portdirectsdake_: rodger13:58
mliima_http://paste.openstack.org/show/590071/ egonzalez9013:58
kollabotPaste #590071 | LodgeIt!13:58
sdake_mliima_ horizon wfm13:58
*** jtriley has joined #openstack-kolla13:58
pbourkeBico_Fino: so some images are not available for the binary type14:01
*** n3v3rm0r3r has joined #openstack-kolla14:01
Bico_Finopbourke: I see. Going try from source then.14:02
pbourkeBico_Fino: yes Id recommend that14:03
*** v1k0d3n has left #openstack-kolla14:04
*** v1k0d3n has joined #openstack-kolla14:04
*** v1k0d3n has quit IRC14:04
*** v1k0d3n has joined #openstack-kolla14:04
egonzalez90mliima_: are you using debug = true?14:05
mliima_yes14:05
egonzalez90quite old, but seems to be the same https://bugs.launchpad.net/horizon/+bug/115576514:06
openstackLaunchpad bug 1155765 in OpenStack Dashboard (Horizon) "Offline compression enabled but key is missing from offline manifest" [Medium,Fix released] - Assigned to Yves-Gwenael Bourhis (yves-gwenael-bourhis)14:06
kollabotBug #1155765 “Offline compression enabled but key is missing fro...” : Bugs : OpenStack Dashboard (Horizon)14:06
egonzalez90may be a bug in packages14:07
openstackgerritOpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements  https://review.openstack.org/40077014:07
mliima_ok egonzalez9014:07
mliima_i'll try14:07
openstackgerritPete Birley proposed openstack/kolla: Fix Designate source image container assets  https://review.openstack.org/40073014:08
*** skramaja has quit IRC14:09
*** Pavo has quit IRC14:11
*** tonanhngo has joined #openstack-kolla14:15
*** Pavo has joined #openstack-kolla14:15
*** tonanhngo has quit IRC14:16
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Change services dir to templates dir  https://review.openstack.org/39997114:18
*** zhurong has quit IRC14:21
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-ansible: Updated from global requirements  https://review.openstack.org/40078914:25
Bico_Finopbourke: Was able to generate all images without error.14:27
pbourkeBico_Fino: good to hear14:27
pronare there any drawback sof using standlone ceph with kolla?14:27
Bico_Finopbourke: going try kolla-ansible prechecks14:27
pbourkeBico_Fino: id also recommend that :)14:30
pbourkeBico_Fino: once the prechecks pass its very likely you'll have a clean deployment14:31
*** msimonin has quit IRC14:33
egonzalez90pron: im not getting the question14:33
*** tonanhngo has joined #openstack-kolla14:35
*** tonanhngo has quit IRC14:36
Bico_Finopbourke: prechecks looks fine.14:43
*** msimonin has joined #openstack-kolla14:45
*** msimonin has left #openstack-kolla14:46
*** yingjun has joined #openstack-kolla14:52
*** tonanhngo has joined #openstack-kolla14:55
*** msimonin has joined #openstack-kolla14:56
*** eaguilar_ has quit IRC14:56
*** tonanhngo has quit IRC14:57
*** msimonin has quit IRC14:58
v1k0d3npeterjenkins_:  hey man14:59
v1k0d3nyou around?14:59
v1k0d3ni talked with inc0 last night. we're going to write some documentation around halcyon for kolla-kube now that things are shaping up nicely (thanks for your help btw...a lot of good adds in here now).15:00
Bico_Finopbourke: It’s deployed. :)15:00
*** yingjun has quit IRC15:04
*** yingjun has joined #openstack-kolla15:04
*** yingjun has quit IRC15:08
Bico_Finopbourke: kolla-3.0.1.tar.gz on pypi.python.org is missing some fixes(malformed config.js on ironic containers)15:10
sdake_Bico_Fino ya- ironic is busted in all versions of kolla including master15:11
Bico_FinoThis is the commit https://github.com/openstack/kolla-ansible/commit/b11504d4e1ac2e787e8015d7ccca1cb2f1aa732515:12
kollabotFix invalid json in ironic service · openstack/kolla-ansible@b11504d · GitHub15:12
*** msimonin has joined #openstack-kolla15:12
sdake_Bico_Fino sean-k-mooney is working on ironic iirc, recommend asking the source ;)15:12
Bico_FinoThanks sdake_15:13
*** srwilkers has joined #openstack-kolla15:14
*** ppalacios has left #openstack-kolla15:17
*** TxGirlGeek has joined #openstack-kolla15:18
*** tonanhngo has joined #openstack-kolla15:20
sean-k-mooneysdake_: it should be working on newton+15:22
*** tonanhngo has quit IRC15:22
sdake_bmaas?15:22
sean-k-mooneysdake_: yes15:22
sdake_sweet15:22
sdake_well its busted apparently :)15:22
sean-k-mooneysdake_: we have a ci that uses kolla to provide baremetal nodes15:22
sdake_Bico_Fino can you file a bug plz15:22
sdake_Bico_Fino si it can be appropriately triaged15:22
sean-k-mooneysdake_: wznoinsk  was working on it15:22
sdake_sean-k-mooney right wznoinsk perhaps can take a look at Bico_Fino 's issue15:23
sdake_i dont know first thing about ironci :)15:23
openstackgerritJavier Castillo Alcíbar proposed openstack/kolla-ansible: Make sure ceilometer/service_credentials wotks with internalURL  https://review.openstack.org/40071115:23
*** tovin07 has quit IRC15:34
*** tonanhngo has joined #openstack-kolla15:38
*** tonanhngo has quit IRC15:40
*** unicell1 has joined #openstack-kolla15:42
*** unicell has quit IRC15:42
*** ayoung has quit IRC15:45
*** bmace has quit IRC15:46
*** f13o has joined #openstack-kolla15:51
*** ntpttr is now known as ntpttr-vacation15:52
*** magicboiz has quit IRC15:55
*** tonanhngo has joined #openstack-kolla15:55
*** dave-mccowan has quit IRC15:55
*** tonanhngo has quit IRC15:55
*** zhubingbing_ has quit IRC15:58
*** berendt has joined #openstack-kolla16:00
*** magicboiz has joined #openstack-kolla16:01
Bico_Finogoing check that sdake_16:02
*** f13o has quit IRC16:04
*** inc0 has joined #openstack-kolla16:05
*** prameswar has joined #openstack-kolla16:05
inc0good morning16:05
egonzalez90morning inc016:05
*** sayantani01 has joined #openstack-kolla16:06
inc0how is my favorite community today?16:09
*** senk has quit IRC16:10
*** dave-mccowan has joined #openstack-kolla16:10
*** Pavo has quit IRC16:11
srwilkershello inc016:11
*** Pavo has joined #openstack-kolla16:11
inc0srwilkers, hey, got an business for you m816:12
inc0so hide while you can;)16:12
srwilkersuh oh16:12
srwilkersfeel free to pm me16:12
inc0nah, it's cool16:12
Bico_Finosdake_: I changed the templates inside /usr/local/share/kolla/ansible/roles/ironic/templates, doing a deploy again16:13
inc0so in your github repo you already have mariadb and keystone16:14
inc0all helmy helmy and cool16:14
inc0what would you say to making it more kolla-k8s16:15
inc0and start porting it to kolla?16:15
srwilkersthats actually what im working on currently16:15
*** msimonin has quit IRC16:15
*** tonanhngo has joined #openstack-kolla16:16
inc0then sir you are reading my mind, I will be thrilled to see it:)16:16
srwilkers:)16:17
*** msimonin has joined #openstack-kolla16:17
*** tonanhngo has quit IRC16:17
Pavoso..... good morning everyone16:17
srwilkersey Pavo16:17
Bico_Finoalready 2 PM here16:17
Bico_Finolol16:17
PavoI finally got TLS working lastnight16:17
inc0yay16:17
inc0what was the issue?16:18
Pavohonestly think it was the way I had the routes on the host16:18
Pavonodes16:18
Pavogoing to redo it today with my vlans set back up16:18
Pavobut ran into another issue16:19
Pavoadmin-openrc.sh after deploying with TLS was using all external endpoints16:19
Pavowhich was using my external domain name16:20
Pavowhy does this happen?16:20
inc0Pavo, well, by design tbh;)16:20
inc0but that's easy to change, it's jsut openrc16:20
PavoI would imagine that admin-openrc.sh would only use internal endpoints16:21
Pavowho in their right mind would use admin-openrc.sh from outside is beyond me16:21
Pavoso the template for admin-openrc.sh is?16:22
egonzalez90tools/openrc-example16:22
egonzalez90sorry, this one ansible/roles/common/templates/admin-openrc.sh.j216:23
Pavohmm interesting16:25
Pavoexport OS_AUTH_URL={{ admin_protocol }}://{{ kolla_internal_fqdn }}:{{ keystone_admin_port }}/v316:25
Pavoits using kolla_internal_fqdn16:25
Pavowhich I do not have set in globals16:25
*** diogogmt has joined #openstack-kolla16:25
Pavowhich should by default use kolla_internal_vip_address16:26
egonzalez90yup, weird. Did you used kolla-ansible post-deploy to create openrc?16:27
Pavoyeah16:27
openstackgerritChristian Berendt proposed openstack/kolla: Install MySQL-python with pip in openstack-base container (type source)  https://review.openstack.org/40084916:27
*** ayoung has joined #openstack-kolla16:27
Pavothink I really need to setup a DNS server16:32
*** tonanhngo has joined #openstack-kolla16:35
portdirectPavo: do you need FedRAMP for your deployments? (asking out of interest mainly)16:36
*** tonanhngo has quit IRC16:36
Pavonever heard of it, let me look it up16:36
Pavoah16:37
Pavonah we have a RMF process that they have to go through16:37
openstackgerritPaul Bourke (pbourke) proposed openstack/kolla: Install neutron-vpnaas in neutron-server  https://review.openstack.org/40086716:40
*** rmart04_ has joined #openstack-kolla16:46
*** jascott1 has joined #openstack-kolla16:48
*** jascott1 has quit IRC16:49
*** rmart04 has quit IRC16:49
*** rmart04_ is now known as rmart0416:49
*** senk has joined #openstack-kolla16:49
*** matrohon has quit IRC16:49
*** jascott1 has joined #openstack-kolla16:49
*** zhangshuai has quit IRC16:52
*** magicboiz has quit IRC16:52
*** zhangshuai has joined #openstack-kolla16:52
*** inc0 has quit IRC16:53
*** tonanhngo has joined #openstack-kolla16:55
*** inc0 has joined #openstack-kolla16:55
*** tonanhngo has quit IRC16:56
*** kristian__ has joined #openstack-kolla16:57
kristian__Hi sdake_ and portdirect16:58
portdirectword16:58
*** berendt has quit IRC16:59
kristian__portdirect: have you found something in the logs?17:00
portdirectno sorry :(17:01
kristian__:/ ok then17:01
Bico_Finosdake_: Got ironic running.17:01
*** huikang has joined #openstack-kolla17:04
*** athomas has quit IRC17:05
pbourkeBico_Fino: which driver, pxe?17:05
pbourkeJeffrey4l: just noticed rootwrap.conf is owned by neutron, I assume this is bad17:05
Bico_Finopbourke: all the ironic containers.17:06
Bico_Finopbourke: Need configure now17:06
*** fragatina has quit IRC17:06
Bico_FinoI’m following this -> http://docs.openstack.org/developer/kolla/ironic-guide.html17:06
kollabotIronic in Kolla — kolla 4.0.0.0b2.dev53 documentation17:06
pbourkeBico_Fino: so you haven't actually proivsioned a server with it yet17:06
kristian__portdirect: do you know how to get murano and magnum running on kolla with dashboard? and is trove available to deploy with kolla?17:06
Bico_Finonot yet pbourke17:06
pbourkeBico_Fino: ok :)17:06
Bico_FinoThis is my goal for today. :P17:06
pbourkeBico_Fino: im at that stage also but am waiting for access to some hardware to actually test it17:07
pbourkeBico_Fino: so be interested to know how you get on17:07
Bico_Finopbourke: I’m using Kolla 3.0.1(Newton)17:07
Bico_FinoI’m debbuging this now > ERROR nova.compute.manager [req-93641741-c952-44aa-b213-eeb720eb9cde - - - - -] No compute node record for host openstack1 on nova_compute_ironic17:08
*** athomas has joined #openstack-kolla17:09
Bico_FinoYou got this error on yours pbourke ?17:11
portdirectkristian__: sry, I'm not using either of these within kolla yet, you will need to get horizon running with a db cache backend - there are ansible roles for both of these services however, I dont think there is ansible role for trove.17:11
kristian__portdirect: ok but with 3.0.1 when I tried it I couldnt see it in horizon17:12
pbourkeBico_Fino: it sounds familiar but Im not sure what it means off the top of my head... like I said I haven't got to the stage where I can provision a server yet17:12
kristian__do you think it should work on 3.0.2?17:12
Bico_Finopbourke: I see.17:13
*** huikang has quit IRC17:15
*** tonanhngo has joined #openstack-kolla17:15
*** tonanhngo has quit IRC17:17
*** newmember has joined #openstack-kolla17:17
portdirectkristian__: I think you will need to set these up as plugins during image building: http://docs.openstack.org/developer/kolla/image-building.html#plugin-functionality17:18
kollabotBuilding Container Images — kolla 4.0.0.0b2.dev53 documentation17:18
*** sdake_ has quit IRC17:18
kristian__portdirect: so rebuild all of my images??17:18
portdirectkristian__: this may help (for getting info about the plugins you need), but note the image produced is *definitely* not compatible with kolla:  https://github.com/portdirect/harbor/blob/latest/docker/openstack/openstack-horizon/openstack-horizon-httpd/Dockerfile17:20
kollabotharbor/Dockerfile at latest · portdirect/harbor · GitHub17:20
egonzalez90kristian__: trove ansible is under review ATM17:20
portdirectkristian__: you should only need to build the horizon image afaik, but I'm really not the best person to ask :/17:20
kristian__ok thanks17:21
*** msimonin has quit IRC17:21
*** inc0 has quit IRC17:22
*** egonzalez90 has quit IRC17:23
*** sdake has joined #openstack-kolla17:24
*** wwriverrat has joined #openstack-kolla17:25
*** rmart04 has quit IRC17:30
mliima_guys, need act here https://review.openstack.org/#/c/399715/17:34
mliima_https://review.openstack.org/#/c/398320/ and https://review.openstack.org/#/c/400734/17:34
*** unicell1 has quit IRC17:35
openstackgerritJeffrey Zhang proposed openstack/kolla: Update Percona repo to current release  https://review.openstack.org/40088917:35
*** fguillot has quit IRC17:36
openstackgerritJeffrey Zhang proposed openstack/kolla: Update Percona repo to current release  https://review.openstack.org/40089217:37
Jeffrey4lpbourke, re  rootwrap.conf, in which container?17:38
*** fguillot has joined #openstack-kolla17:38
pbourkeJeffrey4l: all the neutron containers17:39
pbourkeJeffrey4l: I assume nova is the same17:39
Jeffrey4lpbourke, hmm, yep. all containers are the same. it is not good.17:39
pbourkeJeffrey4l: that said the filter file for vpnaas is owned by root and its not being read17:39
Bico_Finothis one?17:39
Bico_Fino(neutron-server)[neutron@openstack1 /]$ ls -la /etc/neutron/rootwrap.conf17:39
Bico_Fino-rw-r--r-- 11 neutron neutron 1219 Nov  2 17:30 /etc/neutron/rootwrap.conf17:39
pbourkeBico_Fino: yes17:39
Jeffrey4lthis is talked in the ml.17:40
pbourkeyeah I remember sam saying something about it17:40
pbourkewould have to dig back17:40
Jeffrey4lbtw, how u guys search mail in http://lists.openstack.org/pipermail/openstack-dev/ ?17:40
kollabotOpenStack Open Source Cloud Computing Software » The OpenStack-dev Archives17:40
pbourkego away kollabot !17:40
jascott1i'll take that one out as well17:42
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Pull swift-object-expirer image  https://review.openstack.org/40089417:42
*** inc0 has joined #openstack-kolla17:42
*** tonanhngo has joined #openstack-kolla17:42
pbourkeJeffrey4l: not sure if this is the best way but https://www.mail-archive.com/openstack-dev@lists.openstack.org/ is searchable17:43
kollabotopenstack-dev17:43
pbourkejascott1: thanks :)17:43
Jeffrey4lthanks.17:43
wwriverratOh great Kolla gurus (or folks who know LOTS more than me): I need to somehow inject a custom pip.conf (targeting --extra-index-url) when pip is installed for Kolla to use. We use some custom package dependencies in private repos and would like to be able to pull those packages in also. Is there a "blessed" way to do this (or maybe some ideas how we might override how pip.conf is installed)?17:44
*** kollabot has quit IRC17:44
pbourkeJeffrey4l: http://lists.openstack.org/pipermail/openstack-dev/2016-September/104519.html17:44
inc0wwriverrat, that's interesting problem, I think I know how to help17:45
openstackgerritEduardo Gonzalez proposed openstack/kolla-ansible: Tacker NFV Ansible support  https://review.openstack.org/39917917:45
*** kollabot has joined #openstack-kolla17:45
wwriverratawesome :-)17:45
Jeffrey4lpbourke, yep. ( i got it in my gmail ;-) )17:45
Jeffrey4lwwriverrat, check this https://github.com/openstack/kolla/blob/master/tools/setup_gate.sh#L30,L3717:46
inc0wwriverrat, http://docs.openstack.org/developer/kolla/image-building.html#dockerfile-customisation this is mechanism to customize stuff inside docker17:46
kollabotkolla/setup_gate.sh at master · openstack/kolla · GitHub17:46
kollabotBuilding Container Images — kolla 4.0.0.0b2.dev53 documentation17:46
pbourkeJeffrey4l: have you tried vpnaas by any chance?17:47
inc0wwriverrat, idea is to use some block to create your pip.ini17:47
Jeffrey4lpbourke, no. any issue?17:47
wwriverratAwesome. I’ll start digging into both ways. Thanks17:47
inc0https://github.com/openstack/kolla/blob/master/docker/base/Dockerfile.j2#L7 like this one17:47
kollabotkolla/Dockerfile.j2 at master · openstack/kolla · GitHub17:47
pbourkeJeffrey4l: it seems to have a problem with rootwrap filters. That's how I noticed the permission thing17:47
Jeffrey4lpbourke, error message?17:48
pbourkeJeffrey4l: http://paste.openstack.org/show/590108/17:48
kollabotPaste #590108 | LodgeIt!17:48
Jeffrey4lit should work if the rootwrapper owned by neutron. pbourke17:48
jascott1thats another one17:48
pbourkeJeffrey4l: the filters are there but its the only file owned by root. Currently rebuilding with it owned by neutron17:48
wwriverrat@inc0: Yeah. I’m working with harlowja and he mentioned the same reference17:48
pbourkeJeffrey4l: its world readable though so I cant see why it would be an issue17:48
Jeffrey4linc0, should we remove the include_header and include_footer parameter? they are marked deprecated since newton, already.17:49
inc0Jeffrey4l, good catch, yeah17:49
inc0wanna publish bug for it?17:49
inc0and mark it as low hanging fruit17:49
*** kollabot has quit IRC17:49
*** kollabot has joined #openstack-kolla17:49
Jeffrey4lroger.17:51
openstackgerritOpenStack Proposal Bot proposed openstack/kolla: Updated from global requirements  https://review.openstack.org/40077017:51
openstackgerritOpenStack Proposal Bot proposed openstack/kolla-ansible: Updated from global requirements  https://review.openstack.org/40078917:52
Jeffrey4lpbourke, need copy this file into /etc/neutron/rootwrap.d/ file https://github.com/openstack/neutron-vpnaas/tree/master/etc/neutron/rootwrap.d17:52
kollabotneutron-vpnaas/etc/neutron/rootwrap.d at master · openstack/neutron-vpnaas · GitHub17:52
Jeffrey4lneed this line in your case: https://github.com/openstack/neutron-vpnaas/blob/master/etc/neutron/rootwrap.d/vpnaas.filters#L1417:52
kollabotneutron-vpnaas/vpnaas.filters at master · openstack/neutron-vpnaas · GitHub17:52
pbourkeJeffrey4l: yeah I have it17:55
*** kollabot has quit IRC17:55
pbourkeJeffrey4l: so not sure why neutron isn't loading it17:55
*** kollabot has joined #openstack-kolla17:55
*** diogogmt has quit IRC17:56
Jeffrey4lhrm ;/17:57
*** fragatina has joined #openstack-kolla17:59
*** jtriley has quit IRC17:59
*** diogogmt has joined #openstack-kolla17:59
Jeffrey4lpbourke, inc0  please review this  https://review.openstack.org/400707 , it is blocked mitaka branch, right now.18:00
kollabotGerrit Code Review18:00
jascott1ugh wtf18:00
mliima_haha inc018:02
mliima_https://review.openstack.org/#/c/400707/18:02
kollabotGerrit Code Review18:02
inc0yeah18:02
inc0that was one fast merge18:02
inc0;)18:02
harlowjawhat's kollabot do btw?18:02
harlowja:-P18:02
inc0harlowja, beats me18:02
harlowjau guys should just use my https://github.com/harlowja/gerritbot2 :-P18:02
kollabotGitHub - harlowja/gerritbot2: The next generation of gerritbot (with multi-backend support!)18:03
harlowjathx kollabot that's your replacement, ha18:03
Jeffrey4lthanks.18:03
*** kollabot has quit IRC18:03
inc0harlowja, tbh I have no idea who created it;) but well, kollabot is welcome here as anyone18:03
harlowjahaha18:03
harlowjamaybe its really a person18:03
harlowjawith feelings18:03
inc0we're tolerant bunch, bot lives matter to us too18:03
harlowja:-P18:03
*** kollabot has joined #openstack-kolla18:03
inc0welcome kollabot18:04
harlowjawwriverrat u figure it out?18:04
Jeffrey4lharlowja, inc0  <sdake>Jeffrey4l i think that is jascott's toy18:04
harlowjaJeffrey4l gotcha18:04
harlowjagerritbot2 is mine, lol18:04
jascott1you are correct18:04
wwriverratnot yet. still poking around :-)18:04
harlowjak18:04
harlowjai think u can use use openstack_base_header18:05
harlowjato get it in18:05
harlowjaother option is we can further templatize that pip_install macro18:05
jascott1btw I just took out the url-title so it wont be blabbing uselessly after every url paste18:05
jascott1harlowja I will check it out18:05
mliima_Jeffrey4l, does it works for ubuntu source? https://review.openstack.org/#/c/395957/18:05
harlowjajascott1 u might like https://github.com/harlowja/gerritbot2/blob/master/plugins/gerritbot/gerritbot.py#L265-L29818:05
harlowjahttps://github.com/harlowja/gerritbot2/blob/master/plugins/gerritbot/templates/review.md (when a review is mentioneD)18:06
harlowja^ that jinja2 is used18:06
Jeffrey4lmliima_, seems no. i didn't fix this in Ubuntu ( i does not use Ubuntu :( )18:06
*** sp__ has quit IRC18:07
openstackgerritMerged openstack/kolla-ansible: Remove the disable of ipv6 in gate  https://review.openstack.org/40070718:07
Jeffrey4lbut i will try to fix it on Ubuntu ;) mliima_18:07
mliima_ok Jeffrey4l18:07
*** msimonin has joined #openstack-kolla18:08
*** hyakuhei has quit IRC18:08
*** unicell has joined #openstack-kolla18:10
*** Pavo has quit IRC18:11
*** Pavo has joined #openstack-kolla18:11
*** pbourke has quit IRC18:14
*** pbourke has joined #openstack-kolla18:14
*** jtriley has joined #openstack-kolla18:15
*** hyakuhei has joined #openstack-kolla18:15
*** prameswar has quit IRC18:15
*** huikang has joined #openstack-kolla18:16
openstackgerritJeffrey Zhang proposed openstack/kolla: Remove the disable of ipv6 in gate  https://review.openstack.org/40092218:16
openstackgerritJeffrey Zhang proposed openstack/kolla: Remove the disable of ipv6 in gate  https://review.openstack.org/40092318:17
openstackgerritJeffrey Zhang proposed openstack/kolla: Update Percona repo to current release  https://review.openstack.org/40089218:18
openstackgerritJeffrey Zhang proposed openstack/kolla: Bump OpenStack service version  https://review.openstack.org/39427118:18
*** rmart04 has joined #openstack-kolla18:19
*** senk has quit IRC18:19
*** huikang has quit IRC18:20
*** senk has joined #openstack-kolla18:21
*** unicell has quit IRC18:26
*** shardy has quit IRC18:27
*** huikang has joined #openstack-kolla18:27
*** hyakuhei has quit IRC18:28
*** hyakuhei has joined #openstack-kolla18:28
*** hyakuhei has quit IRC18:28
*** hyakuhei has joined #openstack-kolla18:28
*** rmart04_ has joined #openstack-kolla18:34
v1k0d3nso inc0...working on an AIO and have a question....18:35
v1k0d3nsorry, to be more clear...18:35
v1k0d3nAIO with single interface (the bridge stuff...which sdake has asked me to blueprint for possible AIO pretask).18:36
v1k0d3nthink i have one interface mixed up still because i am getting an error typical if you have TLS on an interface that shouldn't have TLS (what you guys were trying to explain to my slow brain i believe the other day).18:36
*** rmart04 has quit IRC18:36
*** rmart04_ is now known as rmart0418:36
v1k0d3nSSL exception connecting to https://openstack.jinkit.com:5000/v3/auth/tokens: bad handshake: Error([('SSL routines', 'SSL23_GET_SERVER_HELLO', 'unknown protocol')],)18:37
v1k0d3nthat is most likely because i have the wrong interface configured with HAproxy...is that correct? sdake does this make sense?18:37
*** kristian__ has quit IRC18:40
inc0v1k0d3n, question is18:41
*** diogogmt has quit IRC18:43
*** Pavo has quit IRC18:43
*** Pavo has joined #openstack-kolla18:44
*** diogogmt has joined #openstack-kolla18:45
*** strigazi is now known as strigazi_AFK18:46
inc0does openstack.jinkit.com resolves to interface you want tls in?18:47
*** Pavo has quit IRC18:49
*** jgriffith has quit IRC18:51
*** Pavo has joined #openstack-kolla18:52
huikangHi, since kolla has been split to kolla and kolla-ansible both of which have the docker directory, which one should I use to build images?18:54
*** unicell has joined #openstack-kolla18:54
*** diogogmt has quit IRC18:55
*** Pavo has quit IRC18:56
*** Pavo has joined #openstack-kolla18:57
inc0huikang, kolla-ansible does not have docker directory18:58
inc0;)18:58
huikanginc0, https://github.com/openstack/kolla-ansible/tree/master/docker18:59
inc0huikang, ok, we didn't remove it I guess, shouldn't be there19:00
*** diogogmt has joined #openstack-kolla19:00
inc0kolla is used for build19:00
*** senk has quit IRC19:00
huikanginc0, thanks19:00
*** f13o has joined #openstack-kolla19:00
*** inc0 has quit IRC19:02
*** sdake_ has joined #openstack-kolla19:03
*** newmember has quit IRC19:04
jascott1oh ya docker folder is still there19:05
*** f13o has quit IRC19:05
*** sdake has quit IRC19:06
*** inc0 has joined #openstack-kolla19:09
mliima_https://review.openstack.org/#/c/398320/ inc0 huikang19:10
*** Pavo has quit IRC19:13
*** huikang has quit IRC19:13
*** Pavo has joined #openstack-kolla19:14
*** inc0 has quit IRC19:19
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Service and Mariadb operator template  https://review.openstack.org/39997219:22
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Mariadb Kubernetes Operator  https://review.openstack.org/39926319:22
openstackgerritRyan Hallisey proposed openstack/kolla-kubernetes: Kubernetes Operator base  https://review.openstack.org/39926219:22
*** schwicht has joined #openstack-kolla19:23
rhalliseysdake_, ^19:23
rhalliseythat's in better shape in terms of structure19:23
*** huikang has joined #openstack-kolla19:25
*** eaguilar has joined #openstack-kolla19:25
*** matrohon has joined #openstack-kolla19:28
*** gfidente has quit IRC19:28
*** awiddersheim has joined #openstack-kolla19:28
*** sayantani01 has quit IRC19:30
*** awidders_ has quit IRC19:31
v1k0d3ninc0 left.19:32
*** Bico_Fino_ has joined #openstack-kolla19:32
*** kristian__ has joined #openstack-kolla19:33
v1k0d3ntbh...let me send a link of interfaces and globals.yaml19:34
*** kristian__ has quit IRC19:34
*** Bico_Fino has quit IRC19:34
*** Bico_Fino_ is now known as Bico_Fino19:34
*** kristian__ has joined #openstack-kolla19:34
v1k0d3nhttps://gist.github.com/v1k0d3n/f29b57f39ef1d7b928519a5b2ec4c99419:34
kristian__Hi. Google is down for me :(19:36
v1k0d3nkristian__: aaaahhhhh19:36
*** huikang has quit IRC19:36
kristian__all google services down even their dns19:36
*** daneyon has joined #openstack-kolla19:37
*** daneyon has left #openstack-kolla19:38
*** Bico_Fino has quit IRC19:39
*** senk has joined #openstack-kolla19:43
sdake_rhallisey in a meeting atm, will take a look19:44
jascott1wha?19:44
*** schwicht has quit IRC19:47
*** msimonin1 has joined #openstack-kolla19:48
*** msimonin has quit IRC19:50
*** diogogmt has quit IRC20:00
sdake_mliima_ thanks for that20:01
sdake_jascott1 huh?20:01
sdake_jascott1 talking to me or kristian?20:01
*** DaveTurner has joined #openstack-kolla20:04
*** inc0 has joined #openstack-kolla20:06
*** huikang has joined #openstack-kolla20:08
*** dave-mccowan has quit IRC20:10
*** Pavo has quit IRC20:11
*** sayantani01 has joined #openstack-kolla20:11
*** Pavo has joined #openstack-kolla20:11
*** rhallisey has quit IRC20:12
*** senk has quit IRC20:17
*** huikang has quit IRC20:22
*** eaguilar has quit IRC20:27
*** eaguilar has joined #openstack-kolla20:27
kristian__skdake_ do you know how to setup murano and magnum on kolla horizon?20:30
kristian__* sdake_:20:31
*** huikang has joined #openstack-kolla20:31
*** huikang has quit IRC20:32
*** huikang has joined #openstack-kolla20:33
*** Pavo_ has joined #openstack-kolla20:36
*** diogogmt has joined #openstack-kolla20:37
*** Pavo has quit IRC20:37
*** Pavo_ is now known as Pavo20:38
jascott1sdake sorry that was in response to 'google' is down20:38
inc0google is down?:(20:40
jascott1not for me20:40
jascott1cant ping 8.8.8.8 tho, thought that worked before20:41
inc0it did20:41
inc0I can ping it20:41
jascott1oh im on proxy20:41
inc0was meant to ask you20:42
jascott1ya it worky from cloud120:42
*** Pavo has quit IRC20:43
kristian__its working for me now20:44
kristian__but in some parts of my country it isnt20:44
*** Pavo has joined #openstack-kolla20:45
v1k0d3nkristian__: where are you located?20:46
v1k0d3nhttp://downdetector.com/status/google/map/20:46
v1k0d3ni noticed an outage in EU20:46
kristian__slovakia20:46
v1k0d3nah...there you go.20:46
v1k0d3nmakes more sense now.20:46
kristian__v1k0d3n: can you please help me setup murano and magnum on horizon?20:51
*** inc0 has quit IRC20:52
*** ayoung has quit IRC20:55
*** ayoung has joined #openstack-kolla20:56
v1k0d3nkristian__: would be happy to help, but in the middle of things myself.20:57
v1k0d3nis it really late where you are?20:57
kristian__oh ok20:57
kristian__yes20:57
v1k0d3nthink you're quite a few hours ahead, right?20:57
kristian__9:57 pm20:58
kristian__yes I will be up will midnight20:58
v1k0d3nok. is this for a lab, poc, development?20:58
kristian__lab, "mini cloud gaming"20:58
kristian__thats why the gpu is in there that I have problem passing20:59
*** sp__ has joined #openstack-kolla21:00
*** newmember has joined #openstack-kolla21:01
*** inc0 has joined #openstack-kolla21:01
*** ayoung has quit IRC21:01
*** f13o has joined #openstack-kolla21:04
*** schwicht has joined #openstack-kolla21:04
sdake_v1k0d3n re the halycon dev env for kubernetes21:05
sdake_v1k0d3n whats it take to make centos as a base image work in that?21:05
-openstackstatus- NOTICE: Gerrit is offline until 21:30 UTC for scheduled maintenance: http://lists.openstack.org/pipermail/openstack-dev/2016-November/107379.html21:09
*** ChanServ changes topic to "Gerrit is offline until 21:30 UTC for scheduled maintenance: http://lists.openstack.org/pipermail/openstack-dev/2016-November/107379.html"21:09
*** Pavo has quit IRC21:11
*** jgriffith has joined #openstack-kolla21:13
*** rmart04 has quit IRC21:16
*** jgriffith has quit IRC21:17
*** sp__ has quit IRC21:18
*** jgriffith has joined #openstack-kolla21:21
*** eaguilar has quit IRC21:23
*** msimonin1 has quit IRC21:24
v1k0d3nsdake_: what do you mean?21:26
v1k0d3noh...21:27
v1k0d3ngotcha...one sec, i'll show you.21:27
v1k0d3nsdake_: you have two places...the image which is in config.rb21:28
v1k0d3nhttps://github.com/att-comdev/halcyon-vagrant-kubernetes/blob/master/config.rb#L221:28
v1k0d3nthen here for ansible scripts: https://github.com/att-comdev/halcyon-kubernetes/blob/1ff13d38d93ea54a9053f0f89daf0346acdb0a5f/kube-deploy/group_vars/all.yml#L1721:29
*** jgriffith has quit IRC21:29
sdake_that second variable controls what?21:30
sdake_config setup?21:30
*** jascott1 has quit IRC21:31
*** eaguilar has joined #openstack-kolla21:32
*** jascott1 has joined #openstack-kolla21:32
sdake_v1k0d3n seems like centos is ready to go with changing those two variables?21:32
*** jascott1 has quit IRC21:34
*** jascott1 has joined #openstack-kolla21:34
*** inc0 has quit IRC21:34
*** Jeffrey4l has quit IRC21:34
*** eaguilar has quit IRC21:34
*** Jeffrey4l has joined #openstack-kolla21:35
srwilkerssdake_, yeah, it should be21:35
sdake_srwilkers nice - what is plan for persistent storage for the dev environment21:35
*** huikang has quit IRC21:36
v1k0d3nfor some reason, i was thinking Ubuntu was set, no?21:37
v1k0d3nthink i'm losing my brains. haha21:37
sdake_v1k0d3n ubuntu is default21:37
*** huikang has joined #openstack-kolla21:37
v1k0d3nah, ok.21:37
sdake_v1k0d3n there is an implementation of centos21:37
v1k0d3njust checking21:37
v1k0d3noh, there is definitely...yes.21:37
sdake_so PVCs21:38
sdake_need that21:38
v1k0d3nand persistent storage, we are currently working on this actually.21:38
sdake_cool21:38
v1k0d3ncoming.21:38
v1k0d3nusing Ceph.21:38
v1k0d3nwhich was assumed would be inline with kolla?21:38
sdake_i don't know of any other answer but i am not a kubernetes expert21:38
*** jascott1 has quit IRC21:38
sdake_i know there is storage plugins for other systems21:39
sdake_like gce/etc21:39
sdake_but nothing that would work in a dev environment easily for aio21:39
*** ChanServ changes topic to "Looking for Ansible deployment? git checkout http://github.com/openstack/kolla-ansible; New to Kolla? Please read the documentation here: http://docs.openstack.org/developer/kolla/; Kolla IRC meetngs on Wednesdays @ 16:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b (old logs from #kolla http://goo.gl/VKpPzA):"21:40
sbezverksdake_: for aio we can also use host mounted storage21:40
*** huikang has quit IRC21:40
sdake_sbezverk ya - however vagrant spawns vms21:40
sbezverksdake_ ceph only really required for multinode kube cluster21:40
sdake_sbezverk the idea is a dev environment with multiple nodes21:40
v1k0d3nso the trick is not with ceph actually (that is done)21:40
v1k0d3nthe trouble is with the pvc actually21:42
*** sdake_ has quit IRC21:42
v1k0d3nwe had to patch controller, and have an image ready for that.21:42
*** jascott1 has joined #openstack-kolla21:42
sbezverkv1k0d3n: what was wrong with pvc?21:43
v1k0d3nhttps://quay.io/repository/attcomdev/kube-controller-manager21:43
alanmeadowssbezverk: lots of pain21:44
*** jgriffith has joined #openstack-kolla21:44
alanmeadowssbezverk: but we got it going... combination of several things21:44
alanmeadowsone is 1.5.0.beta1 to offer a working rbd storage provisioner, but also a custom kube-controller-manager container with the ceph tools21:45
sbezverkalanmeadows: interesting, the only pain we saw was when worker with attached rbd volume was going off the air, then ceph cluster kept locks for it, other than that everything worked well.21:45
alanmeadowsbut our ceph chart, once what we have is up at EOD should work with that configuration21:46
*** ayoung has joined #openstack-kolla21:46
alanmeadowssbezverk: I think part of it depends on what deploy paradigm, namely whats housing the kube-controller-manager process wich tries to launch rbd. For kubeadm out of the box, thats a gcr container with no ceph utils21:47
sbezverkalanmeadows: we used two approaches, one running specially baked image with all ceph bits in it and second just install on kubelet host, ceph-common. In either case worked well.21:49
alanmeadowsyup, we went with the latter, per v1k0d3ns paste above21:49
alanmeadowsexcept that for reliable PVC rbd provisioning we had to go jump to 1.5.0.beta1 which brought in some PetSet rename pain21:50
*** msimonin has joined #openstack-kolla21:50
sbezverkalanmeadows: really ?!?!?! so there is no backward compatibitiy between petset and the new name they introduced in 1.5.0??21:51
alanmeadowsthe fun of v1alpha APIs? :)21:51
alanmeadowsalso no transition for existing petsets21:52
alanmeadowsas far as I can tell21:52
alanmeadowsDIY21:52
sbezverkalanmeadows: wow, it is not nice for sure.. I guess I better get 1.5.0 going and start using new convention :-(21:53
v1k0d3nsbezverk: just use halcyon when we update it :)21:53
v1k0d3nto be fair...still pretty beta.21:53
alanmeadowsso you were doing rbd volume claims/pvc with pre1.5.0? What version?21:53
sbezverkv1k0d3n: thank you but no, I like real hardware :-)21:54
alanmeadowsNot functional for us in  v1.4.621:54
alanmeadowshttps://github.com/kubernetes/kubernetes/commit/5445ccf4cbc8aa5794e125f1b66dcc16ae4a957221:55
*** matrohon has quit IRC21:56
sbezverkalanmeadows: ok so with this change we do not need to pre-create rbd volume. What about initialization of filesystem on it?21:58
*** jgriffith_ has joined #openstack-kolla22:03
*** inc0 has joined #openstack-kolla22:03
*** Pavo has joined #openstack-kolla22:03
alanmeadowssbezverk: you can request an fs with the PVC, haven't tried that yet22:04
alanmeadowssbezverk: but because we use petsets with volumeClaimTemplates (1:1 PVC with container automatically) we needed RBD PVCs22:04
alanmeadowsbut other then PetSets we already did some helm pre/post jobs to manufacture the rbd volumes we needed22:05
alanmeadowsbut at this point need PVCs to work22:05
*** jtriley_ has joined #openstack-kolla22:05
*** jgriffith has quit IRC22:06
*** bmace has joined #openstack-kolla22:06
*** f13o has quit IRC22:07
*** msimonin has quit IRC22:07
*** jtriley has quit IRC22:08
sbezverkalanmeadows: got it. I hope whoever submitted that commit, figured it out, as we saw some issue when pod tried to use PVC/PV pointing to a rbd volume where FS has not been created22:09
sbezverkkubelet could not mount it and pod stayed in hanging state22:09
*** jtriley_ has quit IRC22:10
*** jgriffith_ is now known as jgriffith22:13
*** srwilkers has quit IRC22:14
*** schwicht has quit IRC22:17
*** schwicht has joined #openstack-kolla22:19
*** lamt has quit IRC22:20
*** sdake has joined #openstack-kolla22:23
sdakev1k0d3n one problem with a mac is lack of removable battery :(22:23
sdakev1k0d3n needless to say lost power during our conversation22:24
sdakeif your still about, you were saying the problem si with pvc?22:24
*** schwicht has quit IRC22:24
jascott1le seigh. non removable everything these days :(22:29
sdakeya22:31
sdakebatteries included ftw :)22:31
Pavosdake can you try https://ddi.hopto.org22:31
sdakepavo sure22:31
sdakepavo although not all ngiht :)22:31
Pavoshould work22:31
pmisiakquit22:31
*** pmisiak has quit IRC22:32
sdakepavo looks good you have tls22:32
sdakeyour cert isn't ssigned22:32
Pavoyeah22:32
sdakewhich is normal for a self-signed cert22:32
sdakea proper cloud would pay good money to have their certs signed22:32
*** Serlex has quit IRC22:32
Pavook leaving it alone22:32
Pavothis is only for PoC22:32
sdakeroger22:32
sdakei'd open all the other openstack endpoint ports22:33
sdakeyou can determine that via oenstack endpoint list22:33
Pavoand maybe something to allow others to test stuff out22:33
sdakethat way people can use openstack cli to access your cloud22:33
*** pmisiak has joined #openstack-kolla22:34
PavoI really don't like the idea of cli access from outside22:34
sdakeok then dont do that :)22:35
sdakeit is safe and secur ewith tls however22:36
sdakewithout tls, well i wouldn't do that22:36
*** pmisiak has quit IRC22:36
sdakein a real cloud people will want to be able to access via clis22:36
*** pmisiak has joined #openstack-kolla22:36
Pavowell a real cloud would also have more than 10Mb connection22:37
Pavolol :P22:37
Pavothats my upload limit22:37
Pavowhich sucks22:37
sdakeyou have a point :)22:37
sdakev1k0d3n the halyson work looks good for a dev environment for kolla from my pov22:38
sdakelaycion22:38
Pavook so looks like kolla-ansible done, now to start on kolla-k8s22:38
sdakev1k0d3n i think the one blocker is the lack of Ceph22:38
sdakev1k0d3n do you need any help there?22:38
sdakepavo kolla-k8s not really pocable at this point22:38
sdakepavo its a work in progress22:39
sdakepavo not to discourage you from palying with it, but i am struggling myself to get it operational22:39
v1k0d3nsdake: very close.22:40
v1k0d3nmaybe by eod perhaps. alanmeadows is working on this.22:40
sdakev1k0d3n nice22:40
v1k0d3nit's been a bit of a challenge.22:40
sdakesup alanmeadows22:40
sdakenice to meet you22:40
v1k0d3nso i have a guy planning to write the updates for kolla-k8s documentation, using halcyon...since this will be maintained to support exactly what kolla-k8s needs.22:41
sdakeya we did same sort of thing with heat when kolla was started actually22:41
sdakev1k0d3n sounds good22:41
v1k0d3ni remember the days of kolla via heat actually!22:41
sdakeintereseting22:41
sdakeya, we have come along way :)22:41
v1k0d3nsdake: did you see that halcyon also deploys straight to openstack as well?22:42
v1k0d3nmost definitely has.22:42
sdakei did see that22:42
sdakei'd rather use it to setup a bare metal simulation of kubernetes22:42
v1k0d3nyup. look at config.rb, and vagrant.22:42
sdakeso devs have a way to run22:42
v1k0d3nvagrantfile22:42
*** sayantani01 has quit IRC22:42
v1k0d3nso that's why i split out the repos...22:43
v1k0d3nso ansible could deploy straight to bare metal.22:43
v1k0d3nwith no need for the vagrant bits.22:43
*** sayantani01 has joined #openstack-kolla22:43
sdakecool22:43
sdakenot sure kolla has an answer for baremetal on kubernetes, atm we re using ironic in ansible land22:43
v1k0d3nin our scenario, we use bare metal too22:43
v1k0d3nfirst this: https://github.com/att-comdev/dockerfiles/tree/master/maas22:43
v1k0d3nthen bare metal provision.22:44
sdakelooks interesting22:44
v1k0d3nand provisioning part will automatically assign into the kubernetes cluster using daemonsets.22:44
awiddersheimwith kolla the `reconfigure` command22:44
awiddersheimreally just takes update configs22:45
alanmeadowsthe maas stuff is missing a few things22:45
awiddersheimand distributes them restarting anything that needs it?22:45
v1k0d3nso we wanted to be modular.22:45
awiddersheimwith re-running `deploy` do the same thing?22:45
v1k0d3nhonestly, if this was greenfield for us...we could use ironic. in our case, we already have maas. so this transitions for us.22:45
alanmeadowsits going to be wrapped into a helm chart, with proper config maps shortly, and then the apt-foo removed for individual containers22:45
awiddersheimdo you run `deploy` if you are adding new nodes?22:45
v1k0d3nhowever we are making it extremely pluggable. no religion on bmp.22:46
*** sdake has quit IRC22:46
*** sdake has joined #openstack-kolla22:46
sdakekeyboard shut down22:47
sdakenot sure what happened22:47
*** klindgren has joined #openstack-kolla22:47
v1k0d3nsdake: i'm taking a hard look at the AIO single-nic thing for kolla-a22:48
v1k0d3nhave a question....22:48
v1k0d3ni made a config error, but want to identify what i need to do. could use your expertise.22:49
sdakeshoot22:49
sdakenot sure i can help :)22:49
sdakenetworking not my expertise22:49
sdakebut will give it  a go22:49
v1k0d3nhere's config...it's split into three files on gist...22:49
v1k0d3nfirst globals.yaml. then interfaces config, then interfaces22:50
v1k0d3nhttps://gist.github.com/v1k0d3n/f29b57f39ef1d7b928519a5b2ec4c99422:50
v1k0d3nso here is what's happening...unfortunately (i need to correct behavior with a config change).22:50
v1k0d3nfirst going to openstack.jinkit.com (172.29.236.25 or br-mgmt) works like a charm.22:51
v1k0d3nTLS...i like that.22:51
*** schwicht has joined #openstack-kolla22:52
klindgrenHowdy, I have a question regarding kolla and creating openstack service users (nova/galnce/keystone ect ect).  Its also indirectly related to: https://review.openstack.org/#/c/332590/22:52
sdakeSorry, the website openstack.jinkit.com cannot be found22:52
sdakeis what chrome spit out22:52
v1k0d3nsecond...when i assign the physi1 interface to flat, that picks up the 192.168.4.0/22 (br-kolla) flat network perfectly. (happy about this also).22:52
v1k0d3ni know. you can reach...internal22:52
v1k0d3nbut here's the bad part i want to correct....22:53
klindgrenTheir is a comment about handling the of userid mapping between the system and the the container.  But dont you already have this problem with the volume mounts that are currently being performed?22:53
v1k0d3nthe openrc files get generated with openstack.jinkit.com, no cert definition, and when i point to the crt i get empty [] responses.22:53
sdakeklindgren it should work just like normal openstack does on bare metal - however let me look at review22:53
klindgrenhttps://github.com/openstack/kolla-ansible/blob/master/ansible/roles/nova/tasks/start_compute.yml#L11-L2122:53
klindgrenThe issue I think is that the users when created inside the container you guys dont specify a specific userid22:54
klindgrenso when maping in the logging directory, we already have a mismatch between what user has access on the the container hosts to what user has access in the container host no?22:54
klindgrenIe: https://github.com/openstack/kolla/blob/master/docker/glance/glance-base/Dockerfile.j2#L3522:55
klindgrenis going to cause the glance user to be added with the next availabile 500 level user.22:56
sdakeklindgren moment22:57
sdakev1k0d3n i dont follow those last two sttements22:58
klindgrenwhich is fine until the base image includes a new server that changes what the glance user is in the image.  It also cause username mismatches between the host and the container for mounted volumes, because the userid in the container can be all over the place.22:58
sdakespecifically i can reach internal, how?22:58
klindgrensdake, np - I can wait my turn :-D22:58
sdakeklindgren not a robot - need a moment to process the review :)22:58
*** schwicht has quit IRC22:58
harlowjay u not a robot22:59
harlowjalol22:59
sdakesup harlowja22:59
harlowja:)22:59
sdakefwiw i dont think having godadydd or not godaddy in the commit message matters at all22:59
sdakei'm not sur ewhy that dude said that stuff about "your company" :)22:59
harlowjaha23:00
harlowjameh, whatever23:00
sdakeklindgren no23:00
sdakeharlowja note there is a tool for maintnaining up to date temporary forks of openstack projects23:01
sdakeharlowja one command does it all23:01
harlowjaya, i've heard about that23:01
harlowjagit?23:01
harlowjalol23:01
harlowja:-P23:01
*** schwicht has joined #openstack-kolla23:01
v1k0d3nsdake btw...that config is the primer for what will end up taking care of that blueprint (from a template pov).23:01
sdakenah it automatically rebases23:01
harlowjagit rebase23:01
harlowjalol23:01
sdakev1k0d3n undersotood23:01
*** sayantani01 has quit IRC23:01
v1k0d3nthat could essentially be one interface in reality.23:01
sdakeharlowja automatically rebases to latest z stream23:01
sdakeharlowja its a pretty cool tool, i've used it23:02
harlowjaya, git-upstream or something23:02
sdakeharlowja back when i was jerking around with "convergence"23:02
sdakeya thats it23:02
sdakemaybe thats not it23:02
sdakenot sure23:02
sdakepbourke uses it in oracle23:02
sdakethey carry some patches on top23:03
sdakehaven't actually looked at your code23:03
harlowjaya, such a tool is only useful if u've got the rest of the pipeline :-P23:03
harlowjapatching not so hard, its the rest of the pipeline, ha23:03
sdakeharlowja right - noticed you have kolla rolling through jenkins - nice progress!23:03
awiddersheimsdake: some workflow questions for you23:03
harlowjasdake its getting somewhere, ha23:03
awiddersheimwhen you do a `reconfigure` where/when does the old container get removed?23:03
sdakeawiddersheim you will have to wait a moment23:04
sdakeklindgren we set permissions of all relevant files here:23:04
*** schwicht has quit IRC23:06
sdakeklindgren https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/heat/templates/heat-api.json.j2#L11-L1723:06
sdakethat is how that permission problem is solved23:06
sdakeimo its subptimal, we should preallocate UIDs (I think as you suggested) for every service in openstack-bse or base23:07
sdakeok v1k0d3n23:07
klindgrenis that executed within the container?23:07
sdakeklindgren right23:08
sdakein set_configs.py23:08
sdakeset_configs.py parses the json23:08
sdakethat json file is the api to the containers23:09
*** bmace has quit IRC23:09
klindgrenkk - I haven't been doing too much of the kolla/ansible stuff.  Just was looking at some stuff with josh and noticed the userads being done without uids.  Having had issues with that in the past.  Especially on shared filesystems (like with glance and an nfs store)23:12
*** bmace has joined #openstack-kolla23:12
klindgrenSo you would be open to a patch that has a mapping of openstack services -> uid so that the uids are consistently set.  Also so that the uid's can be mapped from container -> host for things that are pisted externaly to the container.23:13
v1k0d3nok sdake?23:13
klindgrens/pisted/persisted/23:14
*** Bico_Fino has joined #openstack-kolla23:14
sdakesorry got distracted23:14
v1k0d3nit's cool23:15
*** schwicht has joined #openstack-kolla23:16
sdakev1k0d3n moment having conversation with wife23:17
v1k0d3nok.23:18
jascott1should the UID have to exist in code or can we just enforce it in the stock dockerfiles?23:18
*** sayantani01 has joined #openstack-kolla23:18
jascott1s/enforce/implement23:18
*** n3v3rm0r3r has quit IRC23:19
*** TxGirlGeek has quit IRC23:21
klindgrenI think it would make sense to have it as a way that people could easily override the stock values if needed for their deployment?23:23
jascott1always nice but then we add 40 lines to global yaml?23:24
jascott1could put the defaults in the templates with logic to override IF they exist23:24
jascott1in globals23:24
openstackgerritAlexis Rivera proposed openstack/kolla-ansible: renaming-kolla-build-command  https://review.openstack.org/40100523:25
jascott1I guess they need to be unique across services?23:25
klindgrenThat seems like it would be acceptable.23:25
jascott1cant just use 888 across the baord?23:26
sdakejascott1 ok guys got to queue, v1k0d3n first ;)23:26
sdakerather not jascott1 :)23:26
sdakei dont know how that got in there23:26
*** kristian__ has quit IRC23:27
klindgrenjascottl - honestly I am not actually sure if they need to be unique.23:27
*** liyifeng has joined #openstack-kolla23:27
sdakeso v1k0d3n not clear on what your asking23:27
sdakei see globals.yaml in that gist23:27
sdakebut dont' see other things23:27
harlowjajascott1 66623:28
harlowjalol23:28
jascott1almost said it23:28
jascott1haha23:28
harlowja:-p23:28
v1k0d3nsdake i explained.23:28
harlowjaprob klindgren favorite number...23:28
sdakev1k0d3n right, so how do i get at the other files in teh gist23:28
v1k0d3nbut let you help others.23:28
*** amaged__ has quit IRC23:28
v1k0d3nthey are all in the same exact gist.23:28
v1k0d3nscroll down23:28
*** amaged__ has joined #openstack-kolla23:28
sdakeok let me check that out23:28
klindgrenjascott1, if they were all the same, it would allow ops to create an "openstack user" on the host.  Then the containers can internally map that uid to whatever name they want.23:29
*** amaged__ has quit IRC23:29
*** sharon_so has joined #openstack-kolla23:29
sdakeklindgren one point, i am not the end all be all of open to patches - the core reviewers sort that out :)23:29
klindgrenIE in glance 888 is the glance user, in the nove container 888 is nova.... but on the host everything just uses the openstack user which is 888 as well.23:30
sdakeklindgren write a blueprint, include work items, will put in discussion state, we can discuss23:30
klindgrensdake, fair.  Some ideas though are like a hell no. Others are like a "meh" :-D23:30
sdakeklindgren nah we are pretty open to most ideas23:31
sdakeif people write the code we generally merge it23:31
sdakei think where things get tricky is repo splits and stuff like that23:31
harlowjaklindgren  is like an expert in jinja2 now also23:31
harlowjasuper-expert23:31
sdakethat is super disruptive as can be seen by the last 2 weeks of kolla reorg :)23:31
harlowjaya23:31
sdakeok v1k0d3n see your gists23:32
sdakedidn't realize gist had multiple file submission capability23:33
*** sharon_so has quit IRC23:33
v1k0d3nyeah, that's why i like using gist23:33
v1k0d3ni can just update and repost or attach multiple files when troubleshooting with someone.23:34
sdake[15:53:41]  <v1k0d3n>the openrc files get generated with openstack.jinkit.com, no cert definition, and when i point to the crt i get empty [] responses.23:34
sdakev1k0d3n this is what i was missing in the barrage of q&a :)23:35
sdakeso OS_CA_CERT needs to be defined if tls is enabled in the post-deploy playbook23:35
sdakev1k0d3n hwo are you pointing it to the crt file?23:35
sdake /etc/kolla/certificates/haproxy-ca.crt?23:35
*** schwicht has quit IRC23:36
sdakev1k0d3n essentially there is a bug in post-deploy which doesn't set OS_CA_CERT23:37
sdakewhen enable_tls = yes23:37
sdakeOS_CA_CERT file also needs to be readable23:37
sdakeso if your not running as root, typically would hae to copy that file somewhere next to your client23:38
sdakefrom my understanding if you have a properly signed certificate, you don't need the OS_CA_CERT at all23:38
sdakeso not sure if etting OS_CA_CERT is the correct answer23:39
sdakereally depends on if the certificate is self signed or not23:39
v1k0d3nsdake: so trying that....but throwing errors23:39
v1k0d3none sec23:39
sdaketo work around your problem, recommend setting OS_CA_CERT as follows23:39
sdakeexport OS_CACERT=/Users/sdake/demo/haproxy-ca.crt23:40
sdakekolla's tls options are locked down23:40
v1k0d3nUnable to establish connection to http://openstack.jinkit.com:35357/v3/auth/tokens: HTTPConnectionPool(host='openstack.jinkit.com'23:40
sdakei have seen some people have problems with tls in their environments23:40
v1k0d3ni did set OS ...23:40
v1k0d3noh wait..23:40
v1k0d3none sec....23:40
sdakev1k0d3n did you source it?23:40
v1k0d3nso OS_CACERT....23:41
sdakethe cause of the tls problems in their environments is unknown - if we reduce ssecurity on tls it works for them23:41
sdakeya sorry had it wrong :)23:41
v1k0d3nthat cert needs to be copied to home and user needs permissions?23:41
sdakeright23:41
v1k0d3nok23:41
v1k0d3nlet me try23:41
v1k0d3none sec23:41
sdakethat file is the public certificate23:41
sdakeok whos up next :)23:42
sdakeklindgren ?23:42
sdakebtw got 40 mins on the clock until dinner with "Ansible Community Manager"23:42
inc0sdake, wanna mention ansible override feature?23:43
v1k0d3nsdake: The request you have made requires authentication. (HTTP 401) (Request-ID: req-5742fcb9-447d-4fa1-9556-82372433b7bc)23:43
sdakeinc0 feel free, not sure what you mean :)23:43
inc0sdake, "ansible community manager"23:43
sdakeaka wife23:43
klindgrenI think I am good.  Just not sure if we need a unique ID per service or if its acceptable to have a standard uid.  I think a standard uid would actually work out jsut fine.23:44
inc0ahh23:44
inc0ok23:44
inc0say hello to her23:44
sdakeklindgren we actually wanted to do that in newton23:44
inc0brain is fried ;(23:44
sdakeklindgren but we were out of time23:44
sdakeklindgren so we got what we got now23:44
sdakeklindgren faster implementation23:45
klindgrenso was their a blueprint I can glob on to?23:45
sdakedefine "standard uid"23:45
sdakeklindgren possible although with the reorg, no idea where it is23:45
*** Bico_Fino has quit IRC23:45
sdakeklindgren moment, let me see if i can find it23:46
klindgrenso using uid say 888 in all the conainers for service users.23:46
klindgren"standard uid"23:46
sdakei see23:46
sdakeyou mean like nova = 888 glance = 88823:46
klindgrenso on the host one would create 888 as the openstack user.23:46
harlowja66623:46
harlowjalol23:46
klindgrenanythign thats mapped into the host, 888 would be nova in the nova containers23:47
klindgrenglance in the glance containers23:47
sdakesome of our containers communicate23:47
sdakeso that model doesn't totally work23:47
awiddersheimcan anyone tell me how an `upgrade` cleans up the old containers23:47
sdakethe one example that comes to mind is nova + libvirt23:47
awiddersheimI'm nto seeing it anywhere23:47
sdakeawiddersheim it doesn't clean up the docker cache23:47
sdakeawiddersheim if that is what your after23:48
awiddersheimsure but I'm not seeing in the code where the current running is stopped23:48
sdakeinc0 will do :)23:48
sdakeinc0 mind taking that q since you spearheaded the upgrade work23:48
awiddersheimsdake: using horizon as an example since it's simple23:49
awiddersheimhttps://github.com/openstack/kolla-ansible/blob/master/ansible/roles/horizon/tasks/upgrade.yml23:49
sdakeinc0 know your fried :)23:49
awiddersheimit just copies over new config and starts container23:49
awiddersheimbut I never see where any exiting older container gets stopped23:49
inc0awiddersheim, our "start" task will redeploy23:49
klindgrensdake, not sure I follow how this is an issue for nova/libvirt?  Does nova write files that libvirt needs to read? or vice versa?23:49
sdakeklindgren right23:49
awiddersheiminc0: ok... get I get some more details about what redeploy means?23:49
sdakefile reads/writes go both ways23:49
sdakeso they need two uids23:49
sdakeand possibly a third, i forget the details23:50
awiddersheiminc0: I see in kolla_docker it does a compare but it seems to only do that compare on an existing container and if they are different in some way it will remove one23:50
inc0awiddersheim, https://github.com/openstack/kolla-ansible/blob/master/ansible/library/kolla_docker.py#L56323:51
awiddersheimright I was looking at this part23:51
klindgrensdake, confused how this is not broken currently then?  If the libvirt container doesn't have the nova user installed in it. and/or its using a differnt uid for nova than the nova container.23:51
klindgrenyou are going to run into permisions issues, unless the permissions were set wide to begin with?23:52
sdakeklindgren it does indeed work, i'm not sure how, jeffrey4l sorted that one out23:52
awiddersheimso when I `upgrade` should I not change23:52
sdakeklindgren that one was complicated23:52
awiddersheimthe tag?23:52
sdakeklindgren jeffrey is in apac23:52
sdakeklindgren best to sk him directly :)23:52
inc0awiddersheim, tag should be caught by this23:53
sdakeklindgren or i could sk him and get back to you during the day - i often see him although not over turkey day23:53
inc0and it should redeploy new tag23:53
awiddersheimokay23:53
sdakeawiddersheim also it compares the hash23:53
sdakenot just the tag23:53
awiddersheimit's not obvious to me how that is happening I guess23:53
awiddersheimjust lookign at the code23:53
awiddersheimbut23:53
awiddersheimperhaps i need to stare at it longer23:53
klindgrenjeffery == jeffery4l ?23:54
inc0awiddersheim, or we made some horrible mistake;) did it work?23:54
sdakeklindgren right23:54
awiddersheiminc0: haven't done it yet23:54
klindgrenkk - I will reach out and hash some stuff out with him23:54
sdakeupgrade definately works23:54
awiddersheimwanted to understand how it worked first23:54
awiddersheimI guess when I look at this code23:54
sdakethere is iirc some services which lack upgrade23:54
inc0kk23:54
sdakesome of the non-core projects23:55
awiddersheimI expect to have a 3.0 tag23:55
awiddersheimthen I push a new container with 3.123:55
awiddersheimbut when I look at this code it seems like it will only compare the 3.1 tagged container to itself23:55
inc0that would be bug, but I don't think that's the case23:55
sdakeit doesn't look at the tag, it looks at the hash iirc23:55
sdakelooking at tag is not sufficient23:56
sdakeklindgren cool - he is really the best resource on this, he did most of the design since we were in crunch mode23:56
*** Bico_Fino has joined #openstack-kolla23:56
sdakeand to do it right the way we desired wasn't going to happen23:56
inc0awiddersheim, it will base on container name afair23:57
inc0and images changed23:57
inc0so nova_scheduler container will be different when you try to redeploy23:57
inc0or upgrade23:57
v1k0d3nsdake: that didn't work.23:57
inc0hence it will deploy new image23:57
inc0hence upgrade!23:57
v1k0d3nthink it went by in all the back and forth.23:57
awiddersheiminc0: so docker pulls down the new container tag23:57
inc0yeah23:57
awiddersheimkind of overwriting the odl one23:58
awiddersheimand this compare will see the change23:58
sdakejascott1 from above comment: [16:24:04]  <jascott1>always nice but then we add 40 lines to global yaml?23:58
inc0althout I *strongly* suggest to do kolla-ansible pull before upgrade23:58
awiddersheimand remove the old one23:58
awiddersheimok23:58
awiddersheiminc0: another quick question23:58
inc0it will remove old container (container, not image) and start new one with newer image23:58
inc0you have both images saved23:58
awiddersheimwhen I want to expand the number of compute hosts I have23:58
sdakejascott1 please read: http://docs.openstack.org/developer/kolla/deployment-philosophy.html23:59
awiddersheimdo I just do another `deploy` or do I also need to do a `reconfigure`?23:59
inc0awiddersheim, for compute nodes just deploy should cut it23:59
inc0as nova-compute will introduce itself23:59
awiddersheimI guess that is a bad example... maybe something that needs rabbit configs23:59
awiddersheimor something23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!