Tuesday, 2019-08-06

*** owalsh has quit IRC00:01
*** gyee has quit IRC00:19
*** markvoelker has joined #openstack-ansible00:41
*** markvoelker has quit IRC00:51
*** markvoelker has joined #openstack-ansible01:17
*** spsurya has joined #openstack-ansible01:17
*** altlogbot_3 has quit IRC01:37
*** altlogbot_0 has joined #openstack-ansible01:37
*** markvoelker has quit IRC01:38
*** weshay_dentist is now known as weshay02:13
*** BjoernT has joined #openstack-ansible02:41
*** markvoelker has joined #openstack-ansible02:42
*** BjoernT_ has joined #openstack-ansible02:58
*** BjoernT has quit IRC02:59
*** nurdie has joined #openstack-ansible03:00
*** markvoelker has quit IRC03:15
*** yolanda has quit IRC03:21
*** yolanda has joined #openstack-ansible03:22
*** nurdie has quit IRC03:49
*** nurdie has joined #openstack-ansible03:49
*** nurdie has quit IRC03:54
*** BjoernT_ has quit IRC04:12
*** udesale has joined #openstack-ansible04:38
*** jhesketh has joined #openstack-ansible04:54
*** markvoelker has joined #openstack-ansible05:28
*** markvoelker has quit IRC05:33
*** gkadam_ has joined #openstack-ansible05:54
*** gkadam_ has quit IRC05:54
*** gkadam has quit IRC05:56
*** joshualyle has joined #openstack-ansible06:28
*** markvoelker has joined #openstack-ansible06:36
*** miloa has joined #openstack-ansible06:52
miloaMorning06:52
*** kopecmartin|off is now known as kopecmartin06:58
*** nurdie has joined #openstack-ansible07:01
*** nurdie has quit IRC07:06
*** markvoelker has quit IRC07:09
*** jbadiapa has joined #openstack-ansible07:18
jrosserMorning07:21
*** tosky has joined #openstack-ansible07:24
*** jbadiapa has quit IRC07:27
*** nurdie has joined #openstack-ansible07:37
*** nurdie has quit IRC07:42
*** rpittau|afk is now known as rpittau07:46
*** nurdie has joined #openstack-ansible07:46
*** nurdie has quit IRC07:51
*** aedc has quit IRC08:11
*** electrofelix has joined #openstack-ansible08:11
*** fghaas has joined #openstack-ansible08:39
*** rgogunskiy has joined #openstack-ansible08:52
evrardjpmorning08:53
*** masterpe has joined #openstack-ansible08:54
miloaevrardjp & jrosser: I modify https://review.opendev.org/#/c/671762/ if you have some time to check it :) thanks.09:06
miloas/modify/modified/09:06
*** nurdie has joined #openstack-ansible09:08
*** owalsh_ is now known as owalsh09:10
*** dr_feelgood has joined #openstack-ansible09:11
*** nurdie has quit IRC09:13
evrardjpthanks miloa!09:14
evrardjpI will review, but I think jrosser should give his opinion, he is the one using ceph the most. We need the CI to pass too09:14
miloaok :) many thanks :) it is a functionnality we need here where i am working :)09:16
admin0morning09:18
*** shyamb has joined #openstack-ansible09:22
*** nurdie has joined #openstack-ansible09:29
ChosSimbaOneHi everyone. Finally back from holiday and ready for more OSA action :-)09:33
ChosSimbaOneSo i thoght i saw on twitter that OSA for stein has been mark stable is that correct? https://docs.openstack.org/openstack-ansible/latest/ still says pre-rplease.09:33
*** nurdie has quit IRC09:34
evrardjpmiloa: I like it. I suggested improvements on the ansible, but these are cosmetic decisions09:41
evrardjphowever it doesn't pass testing, so if you could tackle the issue that would be great09:42
evrardjpChosSimbaOne: yes it was marked as stable. Latest is not stein, it's our work on train09:42
evrardjpthere is a banner on top09:42
evrardjp"This release is under development. The current supported release is Stein. "09:43
evrardjpwhich reminds me.... noonedeadpunk could you review this? https://review.opendev.org/#/c/674096/ and https://review.opendev.org/#/c/674098/ ?09:44
*** nurdie has joined #openstack-ansible09:50
noonedeadpunkhi there:)09:51
*** nurdie has quit IRC09:55
miloaevrardjp: Many thanks, I replied to your comments, perhaps I did not understood well :) or didn't know or to do it :) .10:04
*** dr_feelgood has quit IRC10:07
*** dr_feelgood has joined #openstack-ansible10:09
*** nurdie has joined #openstack-ansible10:10
*** nurdie has quit IRC10:15
*** shyamb has quit IRC10:19
*** dr_feelgood has quit IRC10:21
*** dr_feelgood has joined #openstack-ansible10:21
*** dr_feelgood has quit IRC10:25
*** nurdie has joined #openstack-ansible10:31
*** nurdie has quit IRC10:36
*** rgogunskiy has quit IRC10:45
*** dr_feelgood has joined #openstack-ansible10:49
*** shyamb has joined #openstack-ansible10:51
*** nurdie has joined #openstack-ansible10:52
*** nurdie has quit IRC10:57
*** shyamb has quit IRC11:12
*** shyam89 has joined #openstack-ansible11:12
*** dr_feelgood has quit IRC11:13
*** dr_feelgood has joined #openstack-ansible11:13
openstackgerritIonuț Bîru proposed openstack/openstack-ansible-os_ceilometer master: Change default username for oslo from designate to designate-rpc  https://review.opendev.org/67478011:14
*** dr_feelgood has quit IRC11:14
*** dr_feelgood has joined #openstack-ansible11:15
ioninoonedeadpunk, thanks for the review :)11:16
noonedeadpunkit's really good catch11:16
ioninoonedeadpunk, well, i'm trying to make ceilometer+gnocchi to work on stein11:17
*** shyamb has joined #openstack-ansible11:17
ioniand at first, it did do some resources until on 19 july11:17
ioniwhen i added designate :)11:17
*** shyam89 has quit IRC11:17
noonedeadpunkYeah, I see11:18
ioninow i learned that a lot of things were remove from ceilometer and the template for pipelines doesn't have any sense to keep it11:18
ionitransformers, deprecated, cpu_util deprecated11:18
ionii have to learn how to do the calculation for cpu utilization11:19
ionihttps://opendev.org/openstack/ceilometer/commit/9db5c6c9bfc66018aeb78c4a262e1bfa9b32679811:19
*** kplant has joined #openstack-ansible11:19
noonedeadpunkioni: you mean utilization in %?11:20
ioniyes11:20
*** ivve has joined #openstack-ansible11:22
noonedeadpunkyeah, the only thing left regarding this is time spend... And iirc it's storing delta11:22
noonedeadpunkprobably now, when telemetry has new cores and alive again they will probably bring some thngs back...11:23
ionii don't know yet :)11:23
ionii want first to see things in gnocchi(resources been created)11:23
*** nurdie has joined #openstack-ansible11:33
*** nurdie has quit IRC11:37
openstackgerritIonuț Bîru proposed openstack/openstack-ansible-haproxy_server master: Letsencrypt remove suffix from path  https://review.opendev.org/67478511:43
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: Set defaults for project-specific variables  https://review.opendev.org/67335011:48
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: smart_sources: Use config files from repo  https://review.opendev.org/67464911:51
*** nurdie has joined #openstack-ansible11:51
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: smart_sources: Use config files from repo  https://review.opendev.org/67464911:54
*** nurdie has quit IRC11:56
*** dr_feelgood has quit IRC12:01
*** zbr is now known as zbr|lunch12:01
*** dr_feelgood has joined #openstack-ansible12:02
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: smart_sources: Use config files from repo  https://review.opendev.org/67464912:02
*** markvoelker has joined #openstack-ansible12:04
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: Add integrated coverage  https://review.opendev.org/66033312:04
noonedeadpunkioni: is it possible to define path for letsencrypt command?12:06
*** markvoelker has quit IRC12:06
ioninoonedeadpunk, default is in /etc/letsencrypt12:06
noonedeadpunkjust not to rely on wether it's first time letsencrypt is runned or not12:06
*** markvoelker has joined #openstack-ansible12:06
noonedeadpunkI mean to exclude even possibility of suffix creation12:07
ioninoonedeadpunk, the thing is that, I already fix it and also in template (letsencrypt_renew) but somehow, somebody committed again with 00112:07
*** dr_feelgood has quit IRC12:07
ioninoonedeadpunk, hmm, i only removed it from letsencrypt_new https://opendev.org/openstack/openstack-ansible-haproxy_server/commit/b9cb133bb041dc3ec5393d7b760bb4aac587257d12:09
ioniat that time the task had the correct path12:10
ioninoonedeadpunk, i don't know, letsencrypt tool does this automatically i guess12:10
*** shyamb has quit IRC12:10
*** shyamb has joined #openstack-ansible12:11
noonedeadpunkioni: but according to your comment, is it true, that once letsencrypt will be runned another time, it will create directory with suffix?12:11
* noonedeadpunk too lazy to check this with his own12:11
ioninoonedeadpunk, no, it will use the configuration12:12
ioninoonedeadpunk, i wanted to say that i don't know when it creates the suffix, i had this problem when i changed the documment root af the same domain, rerun the letsencrypt command (not renew) and it created a new directly with suffix12:12
noonedeadpunkI mean can we probably define smth like --work-dir for command to ensure, that it will use this exact directory?12:13
noonedeadpunkOr whatever suites https://gist.github.com/ebekker/abd89a833c050669cd5a#file-letsencrypt-help-all-L146-L16612:13
ioninoonedeadpunk, the suffix is for config dir12:14
*** dr_feelgood has joined #openstack-ansible12:15
noonedeadpunkwe're excpecting to see chainfile there. so defining --fullchain-path should guarantee that this file lies under this dir?12:15
noonedeadpunkSorry, I just not a big expert in letsencrypt since was using validated wildcards all the time12:16
ionii'll check but i don't think so12:26
*** shyamb has quit IRC12:27
noonedeadpunkioni: it will be cool if you can check that out12:28
*** udesale has quit IRC12:32
*** udesale has joined #openstack-ansible12:32
*** zbr|lunch is now known as zbr12:38
*** ansmith has joined #openstack-ansible12:40
*** nurdie has joined #openstack-ansible12:45
*** nurdie has quit IRC12:50
*** aedc has joined #openstack-ansible13:03
*** dr_feelgood has quit IRC13:09
*** dr_feelgood has joined #openstack-ansible13:09
*** ansmith has quit IRC13:20
*** ansmith has joined #openstack-ansible13:28
*** nurdie has joined #openstack-ansible13:38
*** dr_feelgood has quit IRC13:39
*** dr_feelgood has joined #openstack-ansible13:40
*** BjoernT has joined #openstack-ansible13:40
*** dr_feelgood has quit IRC13:42
*** dr_feelgood has joined #openstack-ansible13:43
*** nurdie has quit IRC13:43
*** BjoernT has quit IRC13:44
*** BjoernT has joined #openstack-ansible13:48
*** dr_feelgood has quit IRC13:51
*** altlogbot_0 has quit IRC14:12
*** altlogbot_1 has joined #openstack-ansible14:13
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add image for manila test  https://review.opendev.org/67465314:17
*** joshualyle has quit IRC14:20
*** KeithMnemonic has joined #openstack-ansible14:36
*** BjoernT has quit IRC14:42
*** rholloway has joined #openstack-ansible14:48
*** nurdie has joined #openstack-ansible14:57
rhollowayanyone know what the recommended way is to configure ceph 'devices' in for each host? I see user_variables.yml has the global ceph-ansible settings which is where devices would seem to fall based on documentation, but not sure what the process looks like if there is a different list/configuration per host15:04
mnaserrholloway: you can add things in /etc/openstack_deploy/{group,host}_vars/*.yml15:06
mnasersimilar to an actual openstack inventory15:06
evrardjprholloway: depending on your version though. I assume stable/stein or master, so mnaser's advice applies. See also: https://evrard.me/custom-inventories-with-openstack-ansible15:08
rhollowayI'm also new to openstack-ansible completely. For example if I have in  openstack_user_config.yml osd the item ceph-osd_hosts.osd1.ip: 1.2.3.4 - would it be /etc/openstack_deploy/ceph-osd-osd1_vars/*.yml or something?15:08
rhollowayyea I'm just starting to test openstack-ansible using stable/stein15:09
*** BjoernT has joined #openstack-ansible15:10
rhollowayor maybe it's just /etc/openstack_deploy/osd1_vars/*.yml for specific host and /etc/openstack_deploy/ceph-osd_vars/*.yml applies to group15:10
evrardjpsee also: https://evrard.me/group-and-host-variables-overriding-in-openstack-ansible15:11
rhollowayoh I'm being dumb, I think you meant /etc/openstack_deploy/host_vars/osd1.yml or something15:14
rhollowayassuming osd1 is the host seen (due to naming in openstack_user_config.yml)15:14
*** spatel has joined #openstack-ansible15:15
rhollowaysame as regular ansible, I'm just assuming the names defined in openstack_user_config.yml for each service are the hostname ansible sees15:15
*** BjoernT has quit IRC15:23
*** gyee has joined #openstack-ansible15:29
*** nurdie_ has joined #openstack-ansible15:32
*** BjoernT has joined #openstack-ansible15:33
*** nurdie has quit IRC15:35
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: Add variable files for RedHat and Suse  https://review.opendev.org/67485115:41
jrosserrholloway: coming from a regular ansible perspective it might be better to consider openstack_user_config.yml as a bit of magical input that drives the dynamic inventory15:41
jrosserthen stick to the usual host_vars/group_vars in /etc/openstack_deploy15:41
rhollowayyea we're getting there. I'm familiar with ceph, openstack, and ansible, but new to ceph-ansible and openstack-ansible. just trying to piece it altogether for new cluster15:43
jrosserand anything you put in user_variables*.yml is passed as '-e' on the ansible command line so are global scope variable overrides of the highest priority15:43
rhollowayopenstack-ansible seems to be a pretty decent (and still maintained) deployment tool for openstack15:43
rhollowaygood to know15:44
*** ivve has quit IRC15:46
rhollowayone other question maybe you/someone else here knows. From openstack-ansible perspective for IP ranges I see there is container (mgmt), storage, and tunnel (vxlan) networks seem to be the big 3. Per defaults/docs, all get attached to vlans. Which of these are actually needed to be routable from external networks? I'm assuming storage doesn't need to be so which IP block we give it shouldn't matter one bit (in terms of overlap with other15:49
rholloway networks). For container/tunnel I'm not sure. It seems container block needs to be routable likely, tunnel possibly? Do floating IPs come out of the tunnel space or container space?15:49
rhollowaytrying to size the netblocks and figure out which will need to be routable from the rest of the org vs. live only within our openstack infrastructure15:50
noonedeadpunkrholloway: actually neither should be routable15:51
rhollowayhow is that? just going through deploy guide it seems things like horizon come out of container range15:52
noonedeadpunktunnel is used for private networks, on top of them vlans are build. container is the network by which containers and all openstack services will communicate with each other15:52
noonedeadpunkso only vlan and public networks should be routable15:53
noonedeadpunkrholloway: it's balanced with haproxy15:53
evrardjprholloway: you can decide if you want directly routable, but you're not in need of that15:54
rhollowayI didn't see a separate public networks option.15:54
evrardjpeach host does nat translation on lxcbr0 but doesn't expose things through this15:54
noonedeadpunkso as a public IP stands external_lb_vip_address15:54
evrardjpyeah only haproxy + keepalived should be on the external_lb_vip_address (which could be a fqdn btw!)15:55
rhollowayhmm, ok15:55
evrardjpso haproxy needs an access to an external network and the mangement network15:55
evrardjpand that's all you need15:55
noonedeadpunkrholloway: as a public network from which public IP's would be given by neutron stands br-vlan with flat (or not only flat) type15:55
evrardjpbut, like I said, if you want, you can with osa15:55
evrardjpgenerally ppl like the isolation though15:56
rhollowaybut the deployment host does need access to container (br-mgmt) at the very least, deploy host would possibly need/use a second interface (to access deploy host)15:56
noonedeadpunkevrardjp: I'd say that routable mgmt is not secure, since nova-console is exposed via it15:56
evrardjpyes indeed, and I agree with you noonedeadpunk15:57
evrardjprholloway: the deploy host need access to the nodes, which doesn't mean per se br-mgmt15:57
evrardjphowever it's by far more convenient15:57
evrardjpkeep in mind the deploy node could be a node of your infra too15:58
rhollowaywe are using foreman for that part because it'll handle pxeboot aspect and base configuration of the nodes (prior to openstack-ansible usage)15:58
evrardjp"for that part" ?15:59
rhollowayfor the deploy host15:59
rhollowayforeman node will do pxeboot + openstack-ansible deploy15:59
evrardjpI meant you could collocate the place where you deploy and any of your openstack nodes (compute, infra, whatever) if you prefer not having a separate node15:59
evrardjpok15:59
noonedeadpunkrholloway: deploy in terms of osa is regular server or VM from which you run openstack-ansible. It do not provide pxe boot or whatever (at least with osa)16:00
evrardjpI am not sure I will be able to attend the full meeting today16:00
evrardjpnoonedeadpunk: foreman does that for him :)16:01
rhollowayso I guess best practice would be foreman to have couple interfaces, one on br-mgmt / container vlan, and the other public/routable (internally within our org) so we can manage foreman. Any access to openstack nodes/containers would then need to be done through foreman node16:01
*** nurdie_ has quit IRC16:01
evrardjpnoonedeadpunk: he wants to collocate where openstack-ansible deployer node is with foreman :)16:01
rhollowayyea foreman does pxe boot, I'm just putting openstack-ansible on the same node16:01
evrardjprholloway: you're not in need of that tbh16:01
noonedeadpunkevrardjp: yeah, I just felt some expectations that osa theoretically could do that:)16:01
*** nurdie has joined #openstack-ansible16:01
evrardjprholloway: you could just put foreman on the same network as the osa nodes, on br-mgmt for example16:02
evrardjpthen for the nodes that need to be external, configure the extra bridges16:02
rhollowayforeman also has ansible integration that I thought I could use to automatically handle openstack-ansible part as well but I think it wouldn't be worth the effort, osa seems to have it's own way of doing things with it's dynamic inventory and ansible-runtime, and foreman has it's own way of doing ansible, so they don't really mix well but I can still use same node16:02
mnaser#startmeeting openstack_ansible_meeting16:02
openstackMeeting started Tue Aug  6 16:02:34 2019 UTC and is due to finish in 60 minutes.  The chair is mnaser. Information about MeetBot at http://wiki.debian.org/MeetBot.16:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:02
mnaser#topic office hours16:02
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:02
mnasero\/ bonjour16:02
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:02
*** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)"16:02
noonedeadpunko/16:02
mnaserbonjour16:02
evrardjprholloway: I guess you could, but it might require some manual work. We are all doing ansible behind the scenes. We just have special modules and plugins.16:03
jrossero/16:03
evrardjpbut it's meeting time now, so le'ts talk about that later :)16:03
evrardjpo/16:03
rhollowayyea it would require extra work, I shall be silent for a bit while you all smarter than me do important things16:03
evrardjpyou're welcome to join :)16:03
evrardjpthe more the merrier :)16:03
mnaseri think we all have common interest in how we drive the deployment before the OSA part16:04
mnaseri pushed this up to the mailing list btw -- https://etherpad.openstack.org/p/PVG-OSA-PTG16:04
mnaseri could swear evrardjp made one before16:04
mnaserbut i lost it and couldnt google it anywhere (even using google-fu with site:eavesdrop.openstack.org)16:04
noonedeadpunkI can recall it either...16:04
*** rholloway has quit IRC16:05
evrardjpI have maybe in bookmarks, but I said noonedeadpunk should bookmark if I forgot mine :)16:05
evrardjphahah16:05
*** weifan has joined #openstack-ansible16:06
* noonedeadpunk looks through bookmarks16:06
evrardjphttps://etherpad.openstack.org/p/osa-shanghai-summit-planning16:06
evrardjplet's keep yours mnaser16:07
evrardjpwe'll just add to the official one what we think we should add :)16:07
mnaserah i guess i can copy pasta16:07
mnaseri emailed that one out16:07
evrardjpyeah, selective maybe16:07
evrardjptake the one you emailed as ref :)16:07
evrardjpmine was just a memo more than anything16:07
*** Carcer has joined #openstack-ansible16:08
mnaserok voila16:08
evrardjpyup just added a few ones I can think of right now16:08
mnaseri have someone figuring out logistics to see if i can get noonedeadpunk and guilhermesp to be there16:08
evrardjpthat's awesome16:09
evrardjpthat will be quite a trip for guilhermesp :)16:09
mnasereverywhere is quite the trip for guilhermesp16:09
evrardjpthat's true :)16:09
noonedeadpunk:P16:09
mnaseranywhere he goes its 30 hours .. i dunno how :)16:09
*** rholloway has joined #openstack-ansible16:09
mnaserbtwf16:09
mnaseror those interested16:09
mnaseri would try to start the visa process early16:09
mnaserit's a good 10 pages or so to fill ut16:10
noonedeadpunkmnaser: I guess I'll be attending anyway (btw logistic is quite straighforward for me, since I've been in Shanghai several times)16:10
mnaserTIL :P16:10
mnaserso i anticipate will be there but i dunno about others16:11
mnaserjrosser: ?16:11
mnaserwe struggled to get you out to denver :)16:11
jrosserit's fairly well beyond my travelling appetite really16:11
mnaseri figured as much16:11
mnaser:p16:11
evrardjpjrosser:  :)16:11
mnaserlogan- / spotz  ?16:11
guilhermesphahhah evrardjp yeah, would be nice to go through pacific and not atlantic16:11
spotzhola16:12
mnaseris shanghai seemingly a thing for you? :)16:12
logan-o/16:12
spotzI am not planning on it no16:12
mnaserah okay fair enough16:12
logan-same16:12
noonedeadpunkthat's sad:(16:12
spotzMy travel tends to be on the graciousness of others16:13
evrardjpwe could open the video conferencing for those who don't ~join~ sleep16:13
mnaseryeah it seems like we almost have no one going to be there at this point :(16:13
* chandankumar is going to shanghai16:14
mnaserwell, no one as in like.. not much people :p16:14
mnasera much smaller audience16:14
evrardjpI know if I am coming I will be split into many small pieces before/during/and after the travel16:14
mnaseryeah likewise.. so maybe we shouldnt ask for that much time for OSA16:14
spotzI think most groups will have a small prescense if any16:14
spotzSpace is a premium so yeah if you only need a small chunk better to under commit then over16:15
evrardjpI guess one of the session proposed on the etherpad could have the presence of chandankumar so that's a plus :)16:15
evrardjpI mean NEED the presence of chandankumar16:15
evrardjp:D16:15
mnaseri assume MAYBE a few ex-rackers that used to work on OSA might be there16:16
chandankumarevrardjp: mnaser we started devstack OSA thread on openstack-discuss does something happened with that?16:16
evrardjpwe would be honored to have his presence all along but I suppose he is busy in other places too :)16:16
mnaserbut they'll be busy with their own projects i think16:16
chandankumarevrardjp: :-)16:16
mnaserchandankumar: i got grilled in that thread and it seemed like people weren't too excited about it :P16:16
mnaserfelt like an overwhelming amount of work (or it was painted as such)16:16
evrardjpmnaser: I think you mean "a few others ex-rackers"?16:17
mnaseryes :p16:17
mnaserdetail16:17
evrardjpthere are still some hanging around here, don't know why16:17
evrardjphahahah16:17
evrardjpmnaser: :)16:17
chandankumarevrardjp: do we want to poke them ? to know their status16:17
*** owalsh_ has joined #openstack-ansible16:17
chandankumarcloudnull: odyssey4me you are coming to shanghai ptg?16:18
*** miloa has quit IRC16:18
noonedeadpunkbtw, evrardjp I can remember that Rico promissed smth in Berlin, but don't remember what exactly... And returning to ex-rackers, I hope it wasn't Stella...16:18
spotzAlso andymccr16:18
spotzI doubt mhayden16:19
spotzjamesdenton?16:19
* mhayden wuts16:19
jamesdentonhi hey16:19
evrardjpnoonedeadpunk:  :)16:19
spotzmhayden jamesdenton - Shanghai?16:19
cloudnullI will be there.16:19
spotzGoing through the list of ex-rackers besides evrardjp and me:)16:19
evrardjpcloudnull: woot16:19
jamesdentonnot at this time16:19
jamesdentonbut things could change16:19
evrardjpcongrats on core cloudnull  btw :)16:20
evrardjpjamesdenton:  :)16:20
evrardjpcloudnull: or should I say good luck ? :)16:20
evrardjpI don't know yet for andymccr and asettle16:20
evrardjpwhat about d34dh0r53 ?16:21
mnaserso cloudnull might be there but i guess he'll be busy with tripleo-y things16:21
evrardjpwe had far more than those but those were deeply involved in osa :)16:22
mnaserbut it would be good to find sometime to talk cross-project discussions16:22
*** owalsh has quit IRC16:22
evrardjpyeah16:22
spotzI know there's been a lot of cross project goodness with tripleo and OSA, any with kolla-ansible?16:22
evrardjpI think I could use that time for containers-sig, as there are related work that doesn't fully touch the containers but touch deployment tools16:22
mnaseri think we tried to reach out but the project seems to be happy with their tooling and not interested16:23
evrardjpspotz: yeah mark said hello :)16:23
*** weifan has quit IRC16:23
evrardjpbut that's the gist indeed16:23
*** weifan has joined #openstack-ansible16:24
spotzevrardjp: Say hi back:)16:24
*** nurdie_ has joined #openstack-ansible16:24
evrardjpmnaser: so what's the long story then?16:25
*** tosky has quit IRC16:25
evrardjpdo we keep something, only for cross team collab?16:25
mnaseri think tripleo/osa is a good point of collab16:25
evrardjpso we'll have something there indeed16:26
evrardjpthe rest can be done remotely I guess?16:26
evrardjpand doesn't need attendance _per se_?16:26
chandankumarmnaser: regarding container tooling what about checking with tripleo team if they want to collaborate16:26
mnaseri guerss so16:26
evrardjpmnaser: ok16:27
evrardjpthanks for clarification16:27
*** nurdie has quit IRC16:27
*** weifan has quit IRC16:29
evrardjpI have to go folks, ttyl everyone!16:29
mnasertake carte16:29
evrardjpty! (ok will play with them! ok, french speaking joke...)16:30
mnaserlolll16:30
*** owalsh_ has quit IRC16:31
*** owalsh has joined #openstack-ansible16:31
*** markvoelker has quit IRC16:32
noonedeadpunkbtw manila still fails:( https://logs.opendev.org/33/660333/9/check/openstack-ansible-deploy-aio_metal-debian-stable/6a73e41/logs/openstack/aio1-utility/stestr_results.html16:34
noonedeadpunkdoes anyone have any assumptions why this may happen?16:35
noonedeadpunkTons of reasons found https://logs.opendev.org/33/660333/9/check/openstack-ansible-deploy-aio_metal-debian-stable/6a73e41/logs/host/manila-share.service.journal-16-16-39.log.txt.gz#_Aug_06_16_15_1916:38
cloudnullevrardjp thanks!16:38
cloudnullI suspect I will be there busy with tripleo things, however, OSA is now part of some of those tripleo-y things, so I'm sure we'll have some time to talk shop and have a few Stellas16:39
*** rpittau is now known as rpittau|afk16:41
admin0if i create /host_vars/node1.yml  .and i want it to be lxd,  is just adding 1 line     nova_virt_type: lxd enough ?16:41
noonedeadpunkOk, found it!16:42
admin0to be exact: /etc/openstack_deploy/host_vars/hostname.yml16:43
*** markvoelker has joined #openstack-ansible16:44
jrossermnaser: is there something existing on the etherpad there which would cover tempest plugins being installed from pip rather than source16:44
jrosseri.e how we could consume source for more things that break us16:44
jrosserif i understand correctly thats what is stopping this from getting further https://review.opendev.org/#/c/671769/16:46
spateljrosser: can you look at this? - http://paste.openstack.org/show/755578/16:47
spatelwhy "neutron-sriov-nic-agent.service" service running here?16:47
mnaserjrosser: well i see this as two ways16:47
mnaserwe can either fix our stuff so we can help gate tempest plugins that we consume16:47
mnaserand continue pulling in source16:48
spatelI have queens deployment which doesn't have that service running there, look like only stein has this issue16:48
mnaserand i think thats like a a win-win-win16:48
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add image for manila test  https://review.opendev.org/67465316:48
*** BjoernT has quit IRC16:48
jrossermnaser: there have been a couple of occasions recently where we have tried to increase test coverage, octavia and novnc, and both have failed becasue of bringing in only released versions of some $thing16:49
jrosserso if we can improve that, it would be good16:50
mnaserjrosser: hmm not sure i am following yet :(16:50
jrosserthe adding novnc test to os_nova fails becasue we don't use the master version of the tempest plugin for that, i think16:51
jrossermaybe i understand this wrong?16:52
mnaserjrosser: no that makes sense16:52
mnaserthis goes back to us pinning things inside master16:52
mnaseridk if thats the best thing to do16:53
jrossertempest itself we pin the SHA for16:53
jrosserbut not the plugins16:53
mnaserhmm16:57
mnaseryeah ok that makes sense16:57
mnaserimho we shouold just leverage zuul for everything in our gates but idk16:57
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: Add integrated coverage  https://review.opendev.org/66033316:58
*** udesale has quit IRC17:00
noonedeadpunkmnaser endmeeting?17:08
*** BjoernT has joined #openstack-ansible17:08
mnasernoonedeadpunk: welp17:10
mnaser#endmeeting17:10
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC"17:10
openstackMeeting ended Tue Aug  6 17:10:08 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:10
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-08-06-16.02.html17:10
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-08-06-16.02.txt17:10
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-08-06-16.02.log.html17:10
d34dh0r53ohai17:13
d34dh0r53doubt I'll be in Shanghai unless something pretty crazy happens17:13
d34dh0r53it's a bummer too, Shanghai is an awesome city17:13
*** weifan has joined #openstack-ansible17:14
*** weifan has quit IRC17:19
*** weifan has joined #openstack-ansible17:22
*** weifan has quit IRC17:22
*** weifan has joined #openstack-ansible17:23
*** weifan has quit IRC17:23
*** weifan has joined #openstack-ansible17:23
*** mgariepy has quit IRC17:25
*** weifan has quit IRC17:26
*** chandankumar is now known as raukadah17:30
spateljrosser: i have opened this bug - https://bugs.launchpad.net/openstack-ansible/+bug/183918417:33
openstackLaunchpad bug 1839184 in openstack-ansible "neutron-sriov-nic-agent.service getting install default " [Undecided,New]17:33
spatelThis is very strange..17:33
*** jonher has quit IRC17:39
spatelignore this bug damn.. i had user_variables.yml messed up17:39
*** jonher has joined #openstack-ansible17:40
spatelwhy does OSA create symlinks for /var/log/nova -> /openstack/log/ostack-compute-bld-sriov-2-50-nova ?17:44
spatelwhat is the point to keep logs in /openstack directory?17:45
spateljust for consolidation in one place?17:45
noonedeadpunkspatel: yep17:46
noonedeadpunkand in master we stopped doing this with migration to journald17:46
spatelThis is dangerous to keep logs in / filesystem17:46
spatelwe have 10G root and i noticed my one of node totally unresponsive and found filesystem full :(17:47
jrosserOn my systems /openstack is its own filesystem17:47
noonedeadpunk+217:47
spatelwe are using standard kickstart file with has 10G root and /var is 500G17:47
noonedeadpunkso nothing stopps you from making /var 400gb and 100gb /openstack17:48
spatelnow i have to write custom script to points logs to /var before it make other nodes unhappy17:48
spatelwe use local disk for storage and i want to use more and more disk for vms17:49
spatellet me find a way or increase log rotation on logs17:49
noonedeadpunkdunno if you can use symlink for /openstack....17:50
spatelnoonedeadpunk: i think just just move logs dir would be easy enough because that is only pounding disk17:52
*** spsurya has quit IRC17:52
spateltell me one thing... i have compute node-1 which is attached to controller, life is good17:53
spateltoday i have just kick started node-1 and re-configure with same IP / name and added in cluster again with all playbook17:53
spateli can see it in hyperviouse list but somehow its not taking any workload17:54
spatelgetting error "no valid host found" when trying to launch instance17:54
spatelDo i need to remove from openstack controller before re-build nodes?17:55
spatelnoonedeadpunk: jrosser^^17:55
jrosserI don’t have my notes in front of me right now, but we did this relatively painlessly for xenial/bionic upgrade17:57
*** ansmith_ has joined #openstack-ansible17:57
spatelAll i am trying to understand, do i need to remove node before nuke it down and re-add?17:57
spatelI nuke 5 nodes and rebuild it with same IP/name and all behaving very strange..17:58
spatelmostly /var/log/nova/nova-compute.log spilt lots of logs every few minute but in this 5 nodes its totally stuck no activity also no error17:58
*** ansmith has quit IRC18:00
spateleven i reboot nodes18:01
*** nurdie has joined #openstack-ansible18:01
*** poopcat has joined #openstack-ansible18:03
spatelLet me try openstack-ansible remove_compute_node.yml -e host_to_be_removed='ostack-compute-bld-sriov-2-1'18:03
spateland re-add again18:03
*** nurdie_ has quit IRC18:05
ionispatel, what about openstack network agent list?18:10
spateldamn it, failed - http://paste.openstack.org/show/755580/18:10
spatelioni: i can see that in agent list18:11
ionispatel, is it up?18:11
ionispatel, i think the delete command is wrong18:11
spatelyes   | :-)   | UP    | neutron-linuxbridge-agent |18:12
spatelioni:   -e host_to_be_removed='ostack-compute-bld-sriov-2-1.example.com' works18:13
spatelit need FQDN18:13
spatelLets me re-run all playbook to add compute node again18:15
spateldo you think i should destroy /openstack/venvs/  on compute node before re-run playbook18:16
spatelioni: ^^18:16
spatelanyway lets see - openstack-ansible setup-hosts.yml os-nova-install.yml os-neutron-install.yml --limit ostack-compute-bld-sriov-2-118:16
*** nurdie has quit IRC18:22
*** nurdie has joined #openstack-ansible18:23
*** ansmith has joined #openstack-ansible18:33
*** ansmith_ has quit IRC18:35
*** jbadiapa has joined #openstack-ansible18:47
mhaydenspotz: no shanghai for me18:51
mhaydenspotz: but portugal, yes18:51
spatelioni: getting this error in nova logs - http://paste.openstack.org/show/755583/18:51
spatellook like something busted to placement api18:51
*** allanb has left #openstack-ansible18:52
spotzmhayden: what's portugal?:)18:52
mhaydenlinux plumbers conf18:53
spotzcool, bring back some Port:)18:53
mhaydenportugal is also a nice country on the west side of europe18:53
mhaydenthe speak portuguese18:53
mhaydenthey have a rich naval and maritime history18:53
mhaydenthey are also part of the EU18:53
* mhayden giggles18:53
spotzhehehe, I miss you:)18:53
mhaydenspotz: but mnaser counts his blessings that my gate-busting patches have not appeared during his reign. ;)18:54
jrosserspatel for re-kicking compute nodes we brought them back with this18:54
spotzawwww you should do one for old times sakes18:54
jrosseropenstack-ansible setup-hosts.yml --limit localhost,NEW_HOST_NAME18:55
mnasermhayden switched to doing kernel work because he realized that with almost no CI, he can get away with it all the time :-P18:55
spotzhehe18:55
jrosseransible nova_all -m setup18:55
jrosseropenstack-ansible setup-openstack.yml --limit localhost,NEW_HOST_NAME18:55
jrosserand that was enough to bring them back working18:55
jrosserthat could be made quicker by skipping all the irellevant bits of setup_openstack.yml for a compute node18:56
spateljrosser: i did - openstack-ansible setup-hosts.yml os-nova-install.yml os-neutron-install.yml --limit ostack-compute-bld-sriov-2-118:56
mhaydenmnaser: if you think CI for openstack is challenging... :)18:56
jrosserspatel: see that we include localhost in the --limit18:57
mnasermhayden: im sure you're having plenty of fun :D18:57
jrosserlots of things may go wierd otherwise18:57
spateljrosser: hmmm let me try that too18:57
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add image for manila test  https://review.opendev.org/67465318:58
jrosseralso we redid the setup module because i guess some fact is different between one OS release and another18:58
*** jbadiapa has quit IRC19:03
spateljrosser: i hit this bug - https://bugs.launchpad.net/nova/+bug/182947919:12
openstackLaunchpad bug 1829479 in OpenStack Compute (nova) "The allocation table has residual records when instance is evacuated and the source physical node is removed" [Medium,Triaged]19:12
*** jbadiapa has joined #openstack-ansible19:16
*** nurdie has quit IRC19:19
*** nurdie has joined #openstack-ansible19:20
*** strattao has quit IRC19:25
*** kopecmartin is now known as kopecmartin|off19:29
*** jbadiapa has quit IRC19:31
*** ivve has joined #openstack-ansible19:32
*** dirk has quit IRC20:02
*** dirk has joined #openstack-ansible20:05
*** ansmith has quit IRC20:32
*** kplant has quit IRC21:02
noonedeadpunkmnaser: strange why this raises https://logs.opendev.org/53/674653/7/check/openstack-ansible-deploy-aio_lxc-debian-stable/381ecbe/logs/ara-report/result/fcc687a9-7996-468a-babb-c7a132be10b2/21:04
*** spatel has quit IRC21:09
*** nurdie_ has joined #openstack-ansible21:13
admin0how do i force a flavor to a hypervisor .. i got 2 lxd nodes up, and a lxd flavor .. but for some reasons, they do not go into the lxd computes21:14
*** nurdie has quit IRC21:15
*** nurdie_ has quit IRC21:18
jamesdentonhttps://docs.openstack.org/nova/latest/admin/configuration/schedulers.html#host-aggregates?21:20
admin0jamesdenton, how do I add just AggregateInstanceExtraSpecsFilter to the defaults ? copy the existing line and add this to override ?21:33
jamesdentonis it not in the filter list already?21:35
admin0i do not see it21:35
admin0enabled_filters = RetryFilter, AvailabilityZoneFilter, RamFilter, AggregateRamFilter, ComputeFilter, AggregateCoreFilter, DiskFilter, AggregateDiskFilter, AggregateNumInstancesFilter, AggregateIoOpsFilter, ComputeCapabilitiesFilter, ImagePropertiesFilter,21:35
admin0 ServerGroupAntiAffinityFilter, ServerGroupAffinityFilter, NUMATopologyFilter21:35
admin0tag 18.1.321:36
jamesdentonyou might need to override the entire list then21:36
jamesdentonhttps://docs.openstack.org/openstack-ansible-os_nova/latest/21:36
jamesdentonnova_scheduler_default_filters21:36
jamesdentonand add that one21:36
*** markvoelker has quit IRC21:38
admin0i see 18.1.8 as latest .. would upgrading to that fix this ?21:39
poopcatDoubt it. It doesn't look like it's part of the default filters21:39
poopcatnova_scheduler_default_filters: "RetryFilter,AvailabilityZoneFilter,RamFilter,ComputeFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGroupAffinityFilter,AggregateCoreFilter,AggregateDiskFilter"21:39
poopcatThose are the default filters. In the overrides, add that line and then add each new filter you want, separated by a comma... then run the nova playbooks21:41
admin0on it21:41
admin0thanks guys .. midnight here .. will continue tomorrow morning21:46
*** nurdie has joined #openstack-ansible21:47
*** nurdie has quit IRC21:51
poopcatoof. good luck @admin022:03
*** ansmith has joined #openstack-ansible22:09
*** rholloway has quit IRC22:12
*** nurdie has joined #openstack-ansible22:19
*** nurdie has quit IRC22:24
*** nurdie has joined #openstack-ansible22:37
*** nurdie has quit IRC22:41
*** nurdie has joined #openstack-ansible23:06
*** nurdie has quit IRC23:11
*** markvoelker has joined #openstack-ansible23:13
*** markvoelker has quit IRC23:18
*** joshualyle has joined #openstack-ansible23:47
*** joshualyle has quit IRC23:51
*** joshualyle has joined #openstack-ansible23:53
*** joshualyle has quit IRC23:55
*** joshualyle has joined #openstack-ansible23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!