Wednesday, 2017-08-02

*** tonyb has joined #puppet-openstack00:15
tonybI'm really new to puppet.  I'm tryign to use packstack and one of the jobs?manifests is failing with an I *think* it's due to an undefined variable.  Any pointers on how I can debug this?00:16
mnasertonyb got any logs?00:21
tonybmnaser: sure let me pastebin them00:22
tonybmnaser: slightly edited http://paste.openstack.org/show/617195/00:27
mnaserhttps://github.com/openstack/packstack/blob/master/packstack/puppet/modules/packstack/manifests/neutron/ovs_agent.pp#L5000:28
mnaserlooks like localip is not set for whatever reason00:28
mnaserhttps://github.com/openstack/packstack/blob/master/packstack/puppet/modules/packstack/manifests/neutron/ovs_agent.pp#L21-L2600:29
mnaserdo you have the openvswitch interface configured/selected in packstack?00:29
mnasermore specifically CONFIG_NEUTRON_OVS_TUNNEL_IF00:30
tonybmnaser: okay so that telss me I've misunderstood the OVS code00:31
tonybmnaser: I do have them configured and more than likley I have them configfured badly00:32
mnasermake sure you have that interface correctly set00:32
mnaseri think its not set most likely00:32
tonybThanks. I'll check that00:32
tonybI thought that is it was unset, then neutron_ovs_tunnel_if woudl be undef, which measn that ovs_agent_vxlan_cfg_neut_ovs_tun_if will also be unset which means that I'd hit line 25 'localip = choose_my_ip(hiera('HOST_LIST')'00:34
tonybwhat did I misunderstand?00:35
mnasertonyb: im assuming it probably tried to autoselect based on the choose_my_ip and didnt exactly pick the right one00:37
mnasertonyb i work with the puppet modules often but not packstack specifically so my knowledge goes to as far as that the value is incorrect there but i dont know why/how it should be set00:37
mnaserbut there certainly should be an interface there00:37
*** fultonj has joined #puppet-openstack00:40
tonybmnaser: Thanks.  I certainly get what you're saying.  I'm just trying to learn more (any) puppet ;P00:40
mnasertonyb00:41
mnasernp :)00:41
*** oyrogerg has joined #puppet-openstack00:43
oyrogergEmilienM: G'day, here I am as you suggest00:44
oyrogerggregoryo is taken on another server, so I reversed it.00:45
dmsimardtonyb: looking at the packstack integration tests is a good way to get started00:46
dmsimardhttps://github.com/openstack/packstack#packstack-integration-tests00:46
dmsimardand then you have the different scenarios file such as https://github.com/openstack/packstack/blob/master/tests/scenario001.sh00:47
tonybdmsimard: cool  Thanks!00:47
dmsimardtonyb: we have the same thing for pure puppet, puppet-openstack-integration: https://github.com/openstack/puppet-openstack-integration#description00:47
dmsimardWith scenarios here https://github.com/openstack/puppet-openstack-integration/tree/master/fixtures and the different manifests here: https://github.com/openstack/puppet-openstack-integration/tree/master/manifests00:48
EmilienMoyrogerg: welcome here!00:51
oyrogergI'm glad there's some overlap - I'm in AWST (UTC+8) which often makes quick communication challenging.00:53
EmilienMoyrogerg: I'm usually online on PST evenings00:54
EmilienMoyrogerg: but I'm based in PST and mwhahaha (Alex) on MST00:54
oyrogergWhat's MST?00:54
* oyrogerg fires up worldtimebuddy.com00:54
EmilienMmountain00:54
oyrogergAh that's USA too00:55
mwhahahaUtc-7 (it's 6:55 PM)00:55
EmilienMoyrogerg: yeah00:55
EmilienMoh that's Alex :)00:55
EmilienMoyrogerg: so you're using Puppet modules to deploy OpenStack right?00:55
EmilienMoyrogerg: do you use the upstream ones, do you fork them? what version of them do you use, we want to know everything ahahaha00:55
oyrogergYep. I started with the AIO fixture/scenario, then started going through it to try to create a new compute node on our existing (Fuel-deployed) environment.00:56
oyrogergI want to stick with upstream if possible00:56
EmilienMcool00:57
oyrogergMy Puppetfile is largely a copy and paste from the one at https://github.com/openstack/puppet-openstack-integration00:57
EmilienMwell, I suggest to read our code, all modules / libraries are on github/openstack, and if you have any question let us know00:57
EmilienMkeep in mind https://github.com/openstack/puppet-openstack-integration is used by CI00:57
oyrogergWell, my main questions so far are around which00:59
oyrogergWell, my main questions so far are around which modules I will need for which node types.00:59
mnasera new user? :>00:59
oyrogergThe AIO obviously uses all (most?) of them, but clearly cinder isn't needed for a compute node, etc.00:59
mnaseroyrogerg id familiarize myself with the different openstack services -- but most of the time, neutron/nova will go in compute nodes and rest go in controller :>01:00
EmilienMmnaser: yeah! we have a new user and AFIK a new potential contributor :D01:00
mnaseroyrogerg: welcome :>01:00
oyrogergSo I'm taking a somewhat naive approach (being entirely new to OpenStack in January), and looking at the packages installed and services running on an existing compute node01:01
oyrogergThen working out which module will make that happen on my new compute node01:01
oyrogergIf there's a better way, I'd love to hear it01:02
mnaserthat's a pretty good way of getting started, you can also use the puppet modules to take over a cloud01:02
mnaserso "ok: i need neutron-<something>-agent and nova-compute" .. add the appropriate configs and classes, and technically a puppet run should make no changes (puppet agent -tv --noop is my goto)01:03
oyrogergOnce we are more familiar with it, we will either do that, or replace the existing cloud with a new deployment.01:03
oyrogergYep, that's my command line too (:01:04
mnaseri've done plenty of "takeovers" -- i try to grep the service configuration file and make sure i have all the settings are in the puppet manifest01:04
mnasersed '/^#.*/d' /etc/nova/nova.conf | sed '/^$/d'01:04
oyrogergIt's not so simple with this Fuel deployed one though - just looking at nova, there were at least half a dozen (or a dozen? can't remember) deprecated settings that I had to go and check01:05
mnaseroh yeah you'll have to go through that little process but you get the hang of it, just make sure you're using modules from the appropriate version of cloud you're taking over01:05
oyrogergi.e. they weren't mentioned anywhere in Puppet modules, but were in nova.conf - and sure enough, we won't be needing them01:05
oyrogergIt's all Ocata01:05
mnaseroh good, that's pretty recent, id suggest using stable/ocata in your puppetfile01:06
mnaserand yeah, that's no fun, but going through the openstack nova code its easy to identify whats needed and whats leftover from previous upgrades, etc.01:06
mnaseri say nova, but it could be any project01:06
* tonyb waves at oyrogerg from AEST ;P01:07
* tonyb also waves at EmilienM :)01:07
EmilienMwoot, a tonyb around here01:07
oyrogergThe past few days have been networking, and my head is spinning. I'm using the example42-network module to configure it, but in the end it's VLANs and local config compexity that's hard.01:07
oyrogergG'day tonyb, pleased to meet another ozstacker online - I haven't found many01:08
tonybEmilienM: tryignto get my head around all the things puppet/tripleo/ironic :)01:08
EmilienMgood luck!01:08
EmilienMI've heard they are cool projects01:08
tonyboyrogerg: Theer are a few of us over here but <5001:08
EmilienMI think you're lucky.01:08
oyrogergYeah, nova seemed like a good place to start since it's somewhat standalone01:08
tonybEmilienM: Well wait and see what I try and do to/with them then decide if you're lucky01:09
openstackgerritMerged openstack/puppet-nova stable/newton: Switch nova_security_rule to openstack provider  https://review.openstack.org/48822401:30
openstackgerritMerged openstack/puppet-nova stable/ocata: Switch nova_security_rule to openstack provider  https://review.openstack.org/48822301:30
*** https_GK1wmSU has joined #puppet-openstack01:34
*** https_GK1wmSU has left #puppet-openstack01:37
*** ilbot3 has quit IRC01:45
*** ilbot3 has joined #puppet-openstack01:52
*** markvoelker has joined #puppet-openstack01:54
*** dixiaoli has joined #puppet-openstack02:05
*** markvoelker has quit IRC02:23
*** dixiaoli has quit IRC02:47
*** dixiaoli has joined #puppet-openstack02:51
*** markvoelker has joined #puppet-openstack02:59
*** udesale has joined #puppet-openstack03:33
*** rodrigopaiva has joined #puppet-openstack03:37
*** rodrigopaiva has quit IRC03:41
*** rodrigopaiva has joined #puppet-openstack03:46
*** chem has quit IRC03:47
*** morazi has quit IRC03:48
*** rodrigopaiva has quit IRC03:48
*** indistylo has joined #puppet-openstack04:23
*** udesale__ has joined #puppet-openstack04:29
*** udesale has quit IRC04:31
*** dixiaoli has quit IRC04:40
*** skramaja has joined #puppet-openstack05:13
*** ratailor has joined #puppet-openstack05:15
*** jtomasek has joined #puppet-openstack05:16
*** dixiaoli has joined #puppet-openstack05:28
*** dixiaoli has quit IRC05:28
*** dixiaoli has joined #puppet-openstack05:29
*** jaosorior has quit IRC06:25
*** rwsu has quit IRC06:30
*** jaosorior has joined #puppet-openstack06:34
LarsErikPwouldn't it be a good idea to backport the placement.pp in nova to stable/newton since it is mandatory in ocata?06:34
LarsErikPwill make upgrading so much easier06:35
LarsErikPand as I say this, a vague memory of someone else proposing this earlier this summer.... EmilienM ? mwhahaha ?06:36
LarsErikP^ i tend to leave some words out of my sentences... *needs more coffee*06:37
*** ccamacho has quit IRC06:38
*** rcernin has joined #puppet-openstack06:46
*** markvoelker has quit IRC06:51
*** jaganathan has joined #puppet-openstack06:53
*** oidgar has joined #puppet-openstack07:05
*** agurenko has joined #puppet-openstack07:07
*** aarefiev_afk is now known as aarefiev07:07
*** yprokule has joined #puppet-openstack07:07
*** udesale has joined #puppet-openstack07:33
*** udesale__ has quit IRC07:35
*** amoralej|off is now known as amoralej07:44
*** tesseract has joined #puppet-openstack07:48
*** ccamacho has joined #puppet-openstack07:52
*** chem has joined #puppet-openstack08:11
*** simon-AS5591 has joined #puppet-openstack08:13
*** derekh has joined #puppet-openstack08:15
*** udesale__ has joined #puppet-openstack08:20
*** udesale has quit IRC08:22
*** https_GK1wmSU has joined #puppet-openstack08:26
*** jpena has joined #puppet-openstack08:26
*** https_GK1wmSU has left #puppet-openstack08:28
*** openstackgerrit has quit IRC08:33
*** rmart04 has joined #puppet-openstack08:53
*** dtantsur|afk is now known as dtantsur09:17
*** salmankhan has joined #puppet-openstack09:25
*** dixiaoli has quit IRC10:04
*** indistylo has quit IRC10:06
*** jaosorior has quit IRC10:10
*** indistylo has joined #puppet-openstack10:21
*** ansmith has joined #puppet-openstack10:40
*** ansmith_ has joined #puppet-openstack10:41
*** markvoelker has joined #puppet-openstack10:52
*** ansmith_ has quit IRC10:53
*** ansmith has quit IRC10:53
*** markvoelker has quit IRC10:57
*** jaosorior has joined #puppet-openstack11:02
*** atoth has quit IRC11:05
*** udesale__ has quit IRC11:09
mwhahahaLarsErikP: yea mnaser proposed it and I think we merged it? If not i'll take a look today11:31
LarsErikPmwhahaha: oooh nice! But I don't think it was ever merged: https://github.com/openstack/puppet-nova/blob/stable/newton/manifests/placement.pp11:37
LarsErikP404 ;)11:37
LarsErikPI'm sure you already have it, but I found the change: https://review.openstack.org/#/c/488246/11:39
*** markvoelker has joined #puppet-openstack11:53
*** dprince has joined #puppet-openstack11:54
*** oidgar has quit IRC11:56
*** atoth has joined #puppet-openstack11:58
*** morazi has joined #puppet-openstack12:05
*** jpena is now known as jpena|lunch12:06
* mwhahaha pokes Hunner12:15
mwhahahaHunner: https://github.com/puppetlabs/puppetlabs-stdlib/pull/791 seems to have broken puppet-pacemaker12:15
*** amoralej is now known as amoralej|lunch12:18
*** markvoelker has quit IRC12:22
*** markvoelker has joined #puppet-openstack12:22
*** openstackgerrit has joined #puppet-openstack12:23
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration master: Pin stdlib to 4.16.0  https://review.openstack.org/49000412:23
*** chem has quit IRC12:25
*** chem has joined #puppet-openstack12:26
*** amoralej|lunch is now known as amoralej12:29
*** ratailor has quit IRC12:32
*** chem has quit IRC12:42
*** oidgar has joined #puppet-openstack12:42
*** chem has joined #puppet-openstack12:43
*** chem has quit IRC12:43
*** chem has joined #puppet-openstack12:47
*** amoralej is now known as amoralej|lunch12:47
openstackgerritPradeep Kilambi proposed openstack/puppet-panko master: Add panko client install support  https://review.openstack.org/49001212:49
mnaserLarsErikP: looks like its about to merge.. so you should be able to use it :)13:00
*** jpena|lunch is now known as jpena13:06
openstackgerritDmitry Tantsur proposed openstack/puppet-ironic master: Add a class to run the db online_data_migrations  https://review.openstack.org/49002613:30
*** jistr is now known as jistr|mtg13:32
*** amoralej|lunch is now known as amoralej13:37
*** ansmith_ has joined #puppet-openstack13:38
*** ansmith has joined #puppet-openstack13:39
*** ansmith__ has joined #puppet-openstack13:40
*** ansmith has quit IRC13:40
*** ansmith_ has quit IRC13:41
*** rwsu has joined #puppet-openstack13:41
*** rwsu has joined #puppet-openstack13:41
*** ansmith__ has quit IRC13:41
*** ansmith has joined #puppet-openstack13:44
*** indistylo has quit IRC13:45
*** aarefiev is now known as aarefiev_afk13:51
*** jistr|mtg is now known as jistr13:52
-openstackstatus- NOTICE: We have disable infracloud-vanilla due to the compute host running mirror.regionone.infracloud-vanilla.o.o being offline. Please recheck your failed jobs to schedule them to another cloud.13:58
openstackgerritAndy Smith proposed openstack/puppet-oslo master: Remove use of oslo.messaging rpc_backend  https://review.openstack.org/48926413:59
*** udesale__ has joined #puppet-openstack14:06
*** skramaja has quit IRC14:08
openstackgerritAndy Smith proposed openstack/puppet-qdr master: Fix permissions on qdrouterd.sasldb  https://review.openstack.org/48925714:25
*** oidgar has quit IRC14:25
*** rwsu has quit IRC14:29
*** udesale has joined #puppet-openstack14:34
*** udesale__ has quit IRC14:35
mnaseri've been looking at when the jobs timeout and it seems that the second run of installation takes 10 minutes (and the the initial taking 30 minutes)14:38
mnaserunfortunately because the job is timing out we have zero logs14:38
mwhahahait happens from time to time14:38
mwhahahausually it's a cloud provider issue with repos so it hangs or is really slow downloading14:38
*** rwsu has joined #puppet-openstack14:39
mnasermwhahaha: im going to check with infra if we can do something like at least pull out the puppet logs on job timeouts so we can pin point issues -- maybe we can setup our own timeout - 10 minutes which collects all data and fails before we get killed14:39
mwhahahait's probably related to infracloud-vanilla14:40
mwhahahayou can check the logs to see what cloud it ran on14:40
mwhahaha(it's one of the first few lines)14:40
mnaserin this case it was citycloud14:40
*** xarses has joined #puppet-openstack14:40
mnaserand 26 minutes for another install on rackspace and 10 minutes for 2nd run as well (seems like the 10 minute pattern is weird)14:42
mnaserhttp://logs.openstack.org/25/489725/2/check/gate-puppet-openstack-integration-4-scenario003-tempest-centos-7/961a508/console.html#_2017-08-02_02_58_46_796637 and http://logs.openstack.org/25/489725/2/check/gate-puppet-openstack-integration-4-scenario001-tempest-centos-7/052597f/console.html#_2017-08-02_03_10_22_342992 both just almost exactly 10 minutes, so looks like something is timing out and taking 10 minutes14:42
mwhahahayea that's probably an overloaded vm14:43
mwhahahathe 2nd run is just a rerun puppet so it should it would make sense that it's shorter but 10 mins seems a bit long14:45
*** dfisher has joined #puppet-openstack14:45
mnaseryeah for me it seems odd that its almost exactly 10 minutes to the dot, seems like its stuck somewhere with a 10 minute timeout14:53
*** ratailor has joined #puppet-openstack14:57
*** jistr is now known as jistr|mtg15:06
*** dprince has quit IRC15:14
*** ratailor has quit IRC15:24
*** udesale has quit IRC15:34
openstackgerritMerged openstack/puppet-nova stable/newton: Nova Placement API support  https://review.openstack.org/48824615:36
openstackgerritMerged openstack/puppet-openstack-integration stable/newton: nova: activate placement API service  https://review.openstack.org/48825215:36
*** yprokule has quit IRC15:36
mnaserLarsErikP ^ its there now :)15:37
Hunnermwhahaha: thanks for your detective work!15:38
mwhahahabtw it timed out in the tempest run not the deployment15:38
openstackgerritBrent Eagles proposed openstack/puppet-octavia master: Change service-type to load-balancer  https://review.openstack.org/49006215:48
openstackgerritDmitry Tantsur proposed openstack/puppet-ironic master: Add a class to run the db online_data_migrations  https://review.openstack.org/49002615:51
*** rmart04 has quit IRC15:53
*** indistylo has joined #puppet-openstack16:00
*** makowals has quit IRC16:00
*** jaganathan has quit IRC16:03
*** agurenko has quit IRC16:04
*** rcernin has quit IRC16:08
*** simon-AS5591 has quit IRC16:15
*** jistr|mtg is now known as jistr16:22
openstackgerritAlex Schultz proposed openstack/puppet-openstack-integration master: Pin stdlib to 4.16.0  https://review.openstack.org/49000416:35
*** simon-AS559 has joined #puppet-openstack16:39
*** dprince has joined #puppet-openstack16:42
*** ccamacho has quit IRC16:42
*** derekh has quit IRC16:59
*** dtantsur is now known as dtantsur|afk17:00
*** tesseract has quit IRC17:07
*** ntpttr_laptop__ has joined #puppet-openstack17:20
*** ntpttr_laptop__ has quit IRC17:20
*** ntpttr_laptop has joined #puppet-openstack17:20
EmilienMiurygregory: if you around https://review.openstack.org/#/c/48972517:21
iurygregorysure EmilienM17:21
EmilienMthx!17:24
iurygregoryyw :D17:25
EmilienMiurygregory: same for https://review.openstack.org/#/c/483855, if you can17:26
iurygregoryEmilienM,  done ;)17:52
EmilienMiurygregory: thx17:56
iurygregoryanytime o/17:56
*** amoralej is now known as amoralej|off18:08
*** jpena is now known as jpena|off18:10
*** salmankhan has quit IRC18:12
*** social has quit IRC18:18
*** ntpttr_laptop has quit IRC18:33
openstackgerritBrent Eagles proposed openstack/puppet-octavia master: Change service-type to load-balancer  https://review.openstack.org/49006218:50
*** atoth has quit IRC18:57
*** jtomasek has quit IRC19:19
openstackgerritPradeep Kilambi proposed openstack/puppet-openstack-integration master: Add telemetry to POI scenario002  https://review.openstack.org/47505619:48
*** ntpttr_laptop has joined #puppet-openstack19:54
*** ntpttr_laptop has quit IRC19:54
*** sileht has quit IRC19:55
*** ansmith has quit IRC20:25
*** salmankhan has joined #puppet-openstack20:35
*** https_GK1wmSU has joined #puppet-openstack20:37
*** salmankhan has quit IRC20:39
LarsErikPmnaser: brilliant! thanks :) :)20:40
*** https_GK1wmSU has left #puppet-openstack20:40
LarsErikPthat'll make life easier for a lot of us I guess!20:43
openstackgerritEmilien Macchi proposed openstack/puppet-openstack-integration master: Deploy buildlogs from OpenStack Infra mirrors  https://review.openstack.org/49020621:03
openstackgerritMerged openstack/puppet-nova master: Fix resources for latest puppet  https://review.openstack.org/48972521:06
openstackgerritMerged openstack/puppet-swift master: Update resource references for dependencies  https://review.openstack.org/48385521:22
*** dprince has quit IRC21:23
*** morazi has quit IRC22:06
*** ansmith has joined #puppet-openstack22:15
*** https_GK1wmSU has joined #puppet-openstack22:21
*** https_GK1wmSU has left #puppet-openstack22:24
*** indistylo has quit IRC22:41
*** dfisher has quit IRC22:58
*** xarses has quit IRC23:00
*** simon-AS559 has quit IRC23:26
*** ansmith has quit IRC23:54
*** ansmith has joined #puppet-openstack23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!