| SpamapS | greghaynes: it worked for me when I did that too | 00:04 |
|---|---|---|
| *** sdake has quit IRC | 00:21 | |
| *** sdake has joined #tripleo | 00:22 | |
| *** barra204 has joined #tripleo | 00:26 | |
| *** barra204_ has joined #tripleo | 00:27 | |
| *** akrivoka has joined #tripleo | 00:27 | |
| *** barra204_ is now known as shakamunyi | 00:28 | |
| *** jcoufal has joined #tripleo | 00:32 | |
| *** akrivoka_ has joined #tripleo | 00:35 | |
| greghaynes | hrm | 00:35 |
| *** thrash is now known as thrash|g0ne | 00:36 | |
| *** akrivoka has quit IRC | 00:37 | |
| greghaynes | SpamapS: Well, did you find a way in which it didnt work? | 00:37 |
| *** ir2ivps10 has quit IRC | 00:37 | |
| *** sdake has quit IRC | 00:38 | |
| *** barra204_ has joined #tripleo | 00:40 | |
| *** barra204__ has joined #tripleo | 00:40 | |
| *** barra204 has quit IRC | 00:40 | |
| *** shakamunyi has quit IRC | 00:41 | |
| *** akrivoka__ has joined #tripleo | 00:43 | |
| *** barra204_ has quit IRC | 00:46 | |
| *** barra204__ has quit IRC | 00:46 | |
| *** akrivoka_ has quit IRC | 00:47 | |
| *** lazy_prince has joined #tripleo | 00:48 | |
| *** daneyon has quit IRC | 00:51 | |
| *** jcoufal has quit IRC | 00:51 | |
| *** akrivoka__ has quit IRC | 00:55 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tests for building *-minimal images https://review.openstack.org/181162 | 00:59 |
| greghaynes | mordred: we should make an installtype for the simple-init element that installs the rust version | 01:04 |
| mordred | ++ | 01:10 |
| clarkb | its no longer a beta language so you wont have to rebuild everyday | 01:10 |
| bkero | 1.0++ | 01:20 |
| bkero | it should be 'stable' | 01:20 |
| *** sdake has joined #tripleo | 01:37 | |
| *** sdake has quit IRC | 01:44 | |
| *** lazy_prince has quit IRC | 02:00 | |
| *** barra204 has joined #tripleo | 02:25 | |
| *** barra204_ has joined #tripleo | 02:25 | |
| *** barra204_ has quit IRC | 02:32 | |
| *** barra204 has quit IRC | 02:32 | |
| *** daneyon has joined #tripleo | 02:37 | |
| *** julim has joined #tripleo | 02:43 | |
| *** noslzzp has joined #tripleo | 02:55 | |
| *** jcoufal has joined #tripleo | 02:57 | |
| *** untriaged-bot has joined #tripleo | 03:00 | |
| untriaged-bot | Untriaged bugs so far: | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1455175 | 03:00 |
| openstack | Launchpad bug 1455175 in tripleo "Option to configure gateway through keepalived" [Undecided,New] - Assigned to Mayank (mayank0107) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1449852 | 03:00 |
| openstack | Launchpad bug 1449852 in diskimage-builder "Buidling ramdisk with ironic-agent behind proxy fails" [Undecided,In progress] - Assigned to Ramakrishnan G (rameshg87) (rameshg87) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1449854 | 03:00 |
| openstack | Launchpad bug 1449854 in diskimage-builder "Ironic agent ramdisk built using disk-image-create fails with iscsi_ilo driver" [Undecided,Fix committed] - Assigned to Ramakrishnan G (rameshg87) (rameshg87) | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1454803 | 03:00 |
| openstack | Launchpad bug 1454803 in tripleo "puppet: Neutron is not configured with L2 population" [Undecided,New] | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1452752 | 03:00 |
| openstack | Launchpad bug 1452752 in tuskar "keystone_authtoken section is wrong in default shipped tuskar.conf.sample" [Undecided,Confirmed] | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1454802 | 03:00 |
| openstack | Launchpad bug 1454802 in tripleo "puppet: Neutron does not use Nova notifications" [Undecided,New] | 03:00 |
| *** untriaged-bot has quit IRC | 03:00 | |
| *** MasterPiece has quit IRC | 03:01 | |
| *** MasterPiece has joined #tripleo | 03:02 | |
| *** barra204 has joined #tripleo | 03:08 | |
| *** shakamunyi has joined #tripleo | 03:08 | |
| *** panda has quit IRC | 03:14 | |
| *** panda has joined #tripleo | 03:14 | |
| *** jcoufal_ has joined #tripleo | 03:15 | |
| *** jcoufal has quit IRC | 03:19 | |
| *** jcoufal_ has quit IRC | 03:33 | |
| *** daneyon has quit IRC | 03:36 | |
| *** daneyon has joined #tripleo | 03:36 | |
| *** chlong has quit IRC | 03:54 | |
| *** julim has quit IRC | 03:59 | |
| *** chlong has joined #tripleo | 04:06 | |
| *** shakamunyi has quit IRC | 04:50 | |
| *** barra204 has quit IRC | 04:50 | |
| *** eghobo has joined #tripleo | 04:51 | |
| *** lazy_prince has joined #tripleo | 04:52 | |
| *** chlong has quit IRC | 04:52 | |
| *** julim has joined #tripleo | 04:54 | |
| *** chlong has joined #tripleo | 05:04 | |
| *** eghobo_ has joined #tripleo | 05:14 | |
| *** eghobo has quit IRC | 05:16 | |
| *** eghobo has joined #tripleo | 05:17 | |
| *** eghobo_ has quit IRC | 05:21 | |
| *** dasm|afk is now known as dasm | 05:29 | |
| dasm | o/ | 05:31 |
| *** eghobo_ has joined #tripleo | 05:39 | |
| *** eghobo has quit IRC | 05:39 | |
| *** julim has quit IRC | 05:41 | |
| *** masco has joined #tripleo | 05:54 | |
| *** julim has joined #tripleo | 05:54 | |
| *** julim has quit IRC | 06:06 | |
| *** dasm has quit IRC | 06:06 | |
| *** dasm has joined #tripleo | 06:07 | |
| *** dasm has quit IRC | 06:07 | |
| *** dasm has joined #tripleo | 06:08 | |
| *** dasm has quit IRC | 06:08 | |
| *** dasm_ has joined #tripleo | 06:09 | |
| *** ukalifon has joined #tripleo | 06:10 | |
| *** eghobo_ has quit IRC | 06:11 | |
| *** eghobo has joined #tripleo | 06:12 | |
| *** julim has joined #tripleo | 06:16 | |
| *** eghobo has quit IRC | 06:24 | |
| *** yog__ has joined #tripleo | 06:34 | |
| *** dasm has joined #tripleo | 06:36 | |
| *** yamahata has joined #tripleo | 06:37 | |
| *** dasm has quit IRC | 06:39 | |
| *** dasm has joined #tripleo | 06:40 | |
| *** regebro has joined #tripleo | 06:48 | |
| *** jprovazn has joined #tripleo | 06:58 | |
| *** mmagr has joined #tripleo | 07:07 | |
| *** noslzzp has quit IRC | 07:08 | |
| *** panda has quit IRC | 07:13 | |
| *** panda has joined #tripleo | 07:14 | |
| *** ifarkas has joined #tripleo | 07:17 | |
| *** jistr has joined #tripleo | 07:18 | |
| jistr | morning | 07:19 |
| *** ishant has joined #tripleo | 07:25 | |
| *** aufi has joined #tripleo | 07:29 | |
| *** gfidente has joined #tripleo | 07:59 | |
| gfidente | jistr, morning :) | 07:59 |
| jistr | morning :) | 07:59 |
| gfidente | looks like we got something yesterday | 07:59 |
| gfidente | it seems to work fine for me | 07:59 |
| jistr | gfidente: neat, which patch were you on? | 08:00 |
| gfidente | my WIP which included yours | 08:00 |
| gfidente | I see CI failing apparently on the running time | 08:00 |
| gfidente | so I merged the change which was increasing the HA job timeout | 08:01 |
| gfidente | jistr, so I tested this https://review.openstack.org/#/c/184078/ | 08:03 |
| gfidente | and also https://review.openstack.org/#/c/184043/ and both worked | 08:03 |
| gfidente | marios, jistr can you check this (and the dep) https://review.openstack.org/#/c/183097/ | 08:05 |
| gfidente | it's be nice to merge that and then https://review.openstack.org/#/c/183472/ | 08:06 |
| gfidente | *it'd | 08:06 |
| *** yamahata has quit IRC | 08:06 | |
| jistr | gfidente: yeah i'm going to test this https://review.openstack.org/#/c/183097/ (+ its long dep chain :) ) and if that gives us a successful deployment, then i think we should merge away | 08:08 |
| jistr | gonna do the remaining visual reviews first | 08:09 |
| gfidente | FWIW the commit here is wrong https://review.openstack.org/184072 | 08:10 |
| gfidente | it is only moving VIPs | 08:10 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Enable VIPs via Pacemaker from step 2 instead of step 1 https://review.openstack.org/184072 | 08:11 |
| marios | gfidente: sure man gimme few (just done one round of reviews) | 08:12 |
| gfidente | jistr, the thing I found about clustercheck is that it doesn't work the way it is now | 08:14 |
| gfidente | we need to add the service into haproxy | 08:14 |
| gfidente | which gives back status of synchronization to the resource agent | 08:14 |
| gfidente | I was going to add that today | 08:14 |
| jistr | gfidente: by "doesn't work" you mean it reports OK even though the cluster is not ready yet | 08:15 |
| jistr | ? | 08:15 |
| gfidente | jistr, so from what I understand reading the script | 08:16 |
| *** mcornea has joined #tripleo | 08:16 | |
| gfidente | the script itself is started by xinetd and it does work | 08:16 |
| gfidente | but we miss in haproxy the service which is polling the service | 08:17 |
| gfidente | let me point at the code which is easier | 08:17 |
| jistr | gfidente: ack. btw the commit message change caused the later patches to depend on [outdated], it should go away if you submit the whole branch | 08:19 |
| gfidente | https://github.com/redhat-openstack/astapor/blob/master/puppet/modules/quickstack/manifests/load_balancer/galera.pp | 08:19 |
| gfidente | L22 there is playing with the results of the xinetd service on 9200 | 08:20 |
| jistr | ah ok | 08:21 |
| gfidente | jistr, the galera resource agent itself doesn't call it https://github.com/ClusterLabs/resource-agents/blob/master/heartbeat/galera | 08:24 |
| gfidente | so I suspect the mechanism is nodes are removed from balancer if unsynched | 08:24 |
| jistr | yeah that sounds sensible | 08:26 |
| jistr | ok | 08:26 |
| jistr | so i'm rebuilding from scratch | 08:26 |
| jistr | with this https://review.openstack.org/#/c/184078/ | 08:27 |
| * jistr fingers crossed | 08:27 | |
| gfidente | jistr, so that makes me think | 08:29 |
| gfidente | if nodes are only removed from balancer | 08:29 |
| gfidente | what is one supposed to do at full cluster restart? | 08:30 |
| gfidente | I'll ping jayg|g0n3 when he is online to see if we miss pieces | 08:30 |
| jistr | yeah. IIRC full cluster restarts are an issue in general. Not sure if it's solved in Astapor ATM. | 08:31 |
| gfidente | so to add that into the balancer we need to make sure clustercheck works in step1 | 08:35 |
| *** Goneri has joined #tripleo | 08:39 | |
| *** dguerri is now known as dguerri_ | 08:39 | |
| jprovazn | Morning, could some of cores take a look at https://review.openstack.org/#/c/173283/ ? | 08:42 |
| * jistr looking | 08:42 | |
| jprovazn | jistr: thanks | 08:44 |
| *** chlong has quit IRC | 08:45 | |
| jistr | jprovazn: is the method only for scaling up? scaling down is going to be different? | 08:46 |
| jprovazn | jistr: yes | 08:47 |
| jistr | jprovazn: then i wonder then if it's possible and/or useful to add a check that the new count of the nodes is >= than the original count | 08:48 |
| jistr | s/then// | 08:49 |
| jprovazn | jistr: yes, it's possible, useful too | 08:49 |
| *** dguerri_ is now known as dguerri | 08:50 | |
| jistr | jistr: ack. Not a blocker, i'll +2 and if you add it to this patch i'll +2 the new patch set too | 08:50 |
| *** dguerri is now known as dguerri_ | 08:51 | |
| *** jang has joined #tripleo | 08:52 | |
| *** jang1 has joined #tripleo | 08:52 | |
| jprovazn | jistr: thanks, I'm about to send scaledown patch, so I would lean to add count check in a separate patch, but if nobody +2 it soon, I might have it done sooner :) | 08:53 |
| gfidente | jprovazn, can stack_id and plan_id really be None? | 08:53 |
| marios | jprovazn: thanks man, added commented, i completely missed https://github.com/openstack/tripleo-common | 08:53 |
| marios | jprovazn: have added it to my review list for tomorrow morning | 08:53 |
| jprovazn | marios: thanks | 08:54 |
| jistr | gfidente: so re clustercheck in step 1. I'm not experienced in this area, but could it be that we add it to HAProxy when it's still reporting failure, which means HAProxy would have no backends, and then when galera comes up, clustercheck starts reporting OK and HAProxy notices that and starts balancing over those nodes? | 08:54 |
| *** jang1 has quit IRC | 08:54 | |
| *** jang has quit IRC | 08:54 | |
| jistr | because i'm not sure we can get galera up in step 1... | 08:54 |
| jistr | we need to write the config a step earlier | 08:55 |
| gfidente | jistr, yeah 1 is actually 2, where pcmk is starting services | 08:55 |
| gfidente | ack on letting haproxy/galera race | 08:56 |
| jistr | cool | 08:56 |
| jprovazn | gfidente: re none value for plan/stack - the method would fail if not proper ids are passed, but user input is checked in CLI part - https://review.gerrithub.io/#/c/231550/4/rdomanager_oscplugin/v1/overcloud_scale.py | 08:56 |
| *** dguerri_ is now known as dguerri | 08:57 | |
| gfidente | jprovazn, yeah I suppose L32 or L36 will raise something? would it be worth removing the =None default? | 08:59 |
| jprovazn | gfidente: yep, doing it now including jistr's check | 08:59 |
| gfidente | ^_^ | 08:59 |
| jprovazn | thanks for feedback :) | 09:00 |
| *** untriaged-bot has joined #tripleo | 09:00 | |
| untriaged-bot | Untriaged bugs so far: | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1455175 | 09:00 |
| openstack | Launchpad bug 1455175 in tripleo "Option to configure gateway through keepalived" [Undecided,New] - Assigned to Mayank (mayank0107) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1449852 | 09:00 |
| openstack | Launchpad bug 1449852 in diskimage-builder "Buidling ramdisk with ironic-agent behind proxy fails" [Undecided,In progress] - Assigned to Ramakrishnan G (rameshg87) (rameshg87) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1449854 | 09:00 |
| openstack | Launchpad bug 1449854 in diskimage-builder "Ironic agent ramdisk built using disk-image-create fails with iscsi_ilo driver" [Undecided,Fix committed] - Assigned to Ramakrishnan G (rameshg87) (rameshg87) | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1454803 | 09:00 |
| openstack | Launchpad bug 1454803 in tripleo "puppet: Neutron is not configured with L2 population" [Undecided,New] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1452752 | 09:00 |
| openstack | Launchpad bug 1452752 in tuskar "keystone_authtoken section is wrong in default shipped tuskar.conf.sample" [Undecided,Confirmed] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1454802 | 09:00 |
| openstack | Launchpad bug 1454802 in tripleo "puppet: Neutron does not use Nova notifications" [Undecided,New] | 09:00 |
| *** untriaged-bot has quit IRC | 09:00 | |
| gfidente | jistr, how went the deployment? it worked for me a couple of time | 09:01 |
| gfidente | *times | 09:01 |
| jistr | devtest_overcloud.sh@495: wait_for_stack_ready -w 3600 10 overcloud | 09:01 |
| jistr | :P | 09:01 |
| gfidente | marios, +A! :) | 09:03 |
| marios | gfidente: i _will_ hit you | 09:05 |
| marios | gfidente: done :) | 09:05 |
| gfidente | marios, we have an entire week to break CI ... and FIX it! :) | 09:05 |
| marios | gfidente: you do, i'm off on thursday | 09:05 |
| marios | gfidente: thus i have an entire day to break stuff for you | 09:05 |
| * marios goes to work | 09:05 | |
| jistr | now the bad spot | 09:06 |
| jistr | devtest_overcloud.sh@601: wait_for -w 300 --delay 10 -- nova service-list --binary nova-compute '2>/dev/null' '|' grep 'enabled.*\ up\ ' | 09:06 |
| gfidente | jistr, marios, so apparently no OPM build is out yet? | 09:06 |
| * jistr fingers crossed | 09:06 | |
| gfidente | jistr, I also noticed tpe seems to have been rebased actually? | 09:06 |
| gfidente | jistr, I didn't go that far! | 09:07 |
| marios | gfidente: till yesterday no | 09:07 |
| marios | gfidente: i was going to revisit that now and see what to do about a test env... o_O | 09:07 |
| gfidente | marios, please please please https://review.openstack.org/#/c/183096/ | 09:07 |
| marios | gfidente: i also need to update my neutron-* to look like jistr and spredzy|afk with the puppet-pacemaker | 09:07 |
| gfidente | marios, to I think we have cinder and glance and neutron and keystone pending | 09:08 |
| marios | gfidente: its like you enjoy the pain | 09:08 |
| gfidente | all of which need to be updated | 09:08 |
| jistr | gfidente, marios: hmm so it's still failing... That's exactly the same spot where it was failing yesterday when i tested just my patches. I like the refactors you made though, so i'd like to merge all that stuff anyway. | 09:10 |
| *** regebro has quit IRC | 09:10 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Add a directory for overcloud heat environments https://review.openstack.org/183096 | 09:10 |
| gfidente | jistr, so on the messaging part | 09:10 |
| *** regebro has joined #tripleo | 09:10 | |
| gfidente | I think we need this: https://review.openstack.org/#/c/181081/ | 09:11 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Environment which configures puppet pacemaker. https://review.openstack.org/183097 | 09:11 |
| gfidente | AND we need to https://github.com/redhat-openstack/astapor/blob/master/puppet/modules/quickstack/manifests/openstack_common.pp#L15 | 09:11 |
| jistr | yeah that does look like it might affect the issue | 09:12 |
| gfidente | and if after those it still won't work, we might want to make some pressure on the depends | 09:12 |
| jistr | so... | 09:12 |
| jistr | currently the master is broken | 09:12 |
| jistr | it doesn't finish stack-create at all | 09:12 |
| gfidente | HA master? | 09:12 |
| jistr | yeah i meant HA | 09:12 |
| jistr | now we have a bunch of patches that get us to a successful stack-create at least | 09:13 |
| jistr | i'd say let's merge them and continue from there | 09:13 |
| gfidente | ^_^ | 09:13 |
| jistr | gfidente, marios: does it sound sensible? | 09:14 |
| jistr | i'm not sure we should keep piling up the changes and rebasing | 09:14 |
| gfidente | it'd be nice to get some eyes | 09:14 |
| gfidente | but I can't think of many except jayg | 09:14 |
| *** shardy_ has joined #tripleo | 09:15 | |
| *** shardy has quit IRC | 09:17 | |
| *** jrist has quit IRC | 09:18 | |
| *** shardy_ has quit IRC | 09:21 | |
| *** dguerri is now known as dguerri_ | 09:21 | |
| *** shardy has joined #tripleo | 09:22 | |
| *** mmagr is now known as mmagr|afk | 09:28 | |
| *** dguerri_ is now known as dguerri | 09:28 | |
| gfidente | mandre, while you're playing with the environments ... https://review.openstack.org/#/c/183472/ :) | 09:28 |
| gfidente | marios, ^^ | 09:29 |
| *** pelix has joined #tripleo | 09:29 | |
| marios | jistr: yes +100 | 09:29 |
| marios | jistr: we haven't seen green build yet on any of them? | 09:30 |
| marios | jistr: (ha) | 09:30 |
| *** mmagr|afk is now known as mmagr | 09:30 | |
| marios | jistr: been checking progress periodically, | 09:30 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Move sysctl settings into hieradata https://review.openstack.org/184210 | 09:31 |
| jistr | marios: not green e2e, it fails on post-deploy initialization. But the stack-create (all of the puppet parts) succeed. | 09:31 |
| marios | jistr: is this the horizon thing waiting for opm (was what i was hitting yesterday ) | 09:31 |
| gfidente | marios, so I am attempting https://review.openstack.org/#/c/184078/ + https://review.openstack.org/#/c/184210/ + https://review.openstack.org/#/c/181081/ | 09:31 |
| gfidente | jistr, ^^ | 09:32 |
| jistr | marios: no it's some problem in communication between nova compute and the rest of nova services. Could be rabbitmq related but we don't know for sure yet. | 09:32 |
| *** mmagr is now known as mmagr|afk | 09:38 | |
| gfidente | sysctl though should have been set by the element anyway, jistr can you check on your env? | 09:40 |
| gfidente | marios, the horizon thing only applies to instack which installs OPM, devtest does checkout of puppet modules from git | 09:56 |
| marios | gfidente: thanks | 10:02 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Move sysctl settings into hieradata https://review.openstack.org/184210 | 10:23 |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-common: Scale out heat stack https://review.openstack.org/173283 | 10:25 |
| jprovazn | gfidente: jistr: marios: ^ when you have a sec | 10:26 |
| *** trown|outttypeww is now known as trown | 10:31 | |
| *** dguerri is now known as dguerri_ | 10:36 | |
| gfidente | jistr, IT PASSED! | 10:50 |
| gfidente | jistr, marios and the sysctl change can land later because we already to it via sysctl element, so just this: https://review.openstack.org/#/c/181081/ + https://review.openstack.org/#/c/184078/ | 10:51 |
| gfidente | and we get back green again! | 10:51 |
| jistr | gfidente: wow that's awesome news! | 10:58 |
| gfidente | jistr, try for yourself :) | 10:58 |
| *** mmagr|afk is now known as mmagr | 10:58 | |
| jistr | gfidente: so should we rebase this on top of the HA patches? https://review.openstack.org/#/c/181081/ | 10:59 |
| gfidente | they don't really depend on each other but I can | 11:00 |
| gfidente | you want to see it green | 11:01 |
| gfidente | I know | 11:01 |
| gfidente | let me try | 11:01 |
| *** dguerri_ is now known as dguerri | 11:06 | |
| *** dguerri is now known as dguerri_ | 11:08 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Provide RabbitMQ clients with a list of servers instead of VIP https://review.openstack.org/181081 | 11:09 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Enable VIPs via Pacemaker from step 2 instead of step 1 https://review.openstack.org/184072 | 11:09 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Consolidate use of $pacemaker_master in step 2 https://review.openstack.org/184078 | 11:09 |
| jistr | gfidente: thx! i handed out the ticks there ;) Gonna test manually too. | 11:11 |
| * jistr wants to land green HA so much | 11:11 | |
| gfidente | jistr, bus as last time ... we'd only be half-there | 11:11 |
| gfidente | *but | 11:12 |
| jistr | yeah, still missing services pacemaker coverage and maybe diverging from recommended arch here and there, but all the subsequent changes would be tested by CI then instead of manual testing, that's a huge win | 11:14 |
| *** panda has quit IRC | 11:14 | |
| *** panda has joined #tripleo | 11:14 | |
| *** masco has quit IRC | 11:19 | |
| gfidente | jistr, didn't jayg|g0n3 and cwolferh have more changes? | 11:21 |
| marios | jistr: so the pcmk_resource_create stuff shouldn't be necessary for current instack packages right (puppet-pacemaker puppet-tripleo etc?) | 11:22 |
| marios | jistr: gfidente: I set export DIB_INSTALLTYPE_puppet_modules=source in instack-build-images -and then also grabbed the pcmk changes ... haven't seen pcs status for a few days ;) | 11:23 |
| marios | gfidente: your patches go ontop? ^^^ | 11:23 |
| * marios reads bak | 11:23 | |
| gfidente | so this should be live CI of topmost https://jenkins06.openstack.org/job/check-tripleo-ironic-overcloud-f20puppet-ha/61/ | 11:23 |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-common: Scale out heat stack https://review.openstack.org/173283 | 11:24 |
| jistr | marios: yeah with that you'd also have to switch to a custom branch of t-h-t with my and gfidente's patches | 11:24 |
| marios | jistr: basically i've been looking for an env i can work with, i think this is it... (add horizon and tidy up neutron-* pcmk resources) | 11:25 |
| marios | (i mean even if it doesn't copmlete 100% if pcs is doing its thing by that point) | 11:25 |
| gfidente | yeah problem is they diverged a lot recently | 11:26 |
| marios | still running though let's see | 11:26 |
| jistr | mandre: with DIB_INSTALLTYPE_puppet_modules=source you won't need any customizations for puppet modules i think | 11:26 |
| gfidente | so you want updated OPM, updated TPE and merge updates to THT | 11:26 |
| marios | gfidente: i think i'm missing opm from these | 11:26 |
| gfidente | jistr, does instack honor that? | 11:27 |
| jistr | mandre: sorry for the noise | 11:27 |
| marios | gfidente: i rebuilt images to pull pe from src and also patched templates (and rebuilt roles) | 11:27 |
| gfidente | marios, or you move to devtest | 11:27 |
| jistr | gfidente: i think it should use the same tooling, it only overrides the variable if it wasn't set previously it seems https://github.com/rdo-management/instack-undercloud/blob/e921062e7751a48af09f9a9f5f275fc31a9657e3/elements/undercloud-package-install/environment.d/00-package-install#L10 | 11:28 |
| marios | gfidente: you move to devtest | 11:28 |
| jistr | lol | 11:28 |
| gfidente | jistr, ack, thanks | 11:29 |
| gfidente | I thought was pulled in by some RPM as dependency | 11:29 |
| gfidente | marios, it is not so terrible nowdays pretty stable actually | 11:30 |
| marios | gfidente: indeed last time i poked was end of march, according to DAS LOG | 11:31 |
| marios | gfidente: but you're there now, so i'm ok for a bit longer | 11:32 |
| marios | May 19 07:19:27 localhost pengine[17336]: warning: unpack_rsc_op_failure: Processing failed op start for galera:0 on ov-jbgefv6jimp-0-uzushvxqjdlv-controller-sg72b4wylo36.novalocal: not configured (6) | 11:33 |
| marios | is this the startup race (looks like) | 11:33 |
| marios | (might be i only grabbed the 'rabbitmq startup race' and not the other one) | 11:34 |
| gfidente | marios, those images also still have .novalocal | 11:35 |
| gfidente | this is going to be epic rebase | 11:36 |
| jistr | epic rebase, yeah :D | 11:37 |
| gfidente | loads of things could either get fixed OR BREAK! :) | 11:39 |
| *** thrash|g0ne is now known as thrash | 11:39 | |
| *** jistr is now known as jistr|class | 11:40 | |
| *** pblaho has joined #tripleo | 11:41 | |
| *** jrist has joined #tripleo | 11:46 | |
| *** dguerri_ is now known as dguerri | 11:49 | |
| *** jrist has quit IRC | 11:52 | |
| *** rlandy has joined #tripleo | 11:59 | |
| *** ishant has quit IRC | 12:04 | |
| *** jayg|g0n3 is now known as jayg | 12:14 | |
| lsmola_ | gfidente: ping | 12:31 |
| lsmola_ | gfidente: when I want to deploy ceph, should I use this export CINDER_ISCSI=1 | 12:31 |
| lsmola_ | ? | 12:31 |
| lsmola_ | gfidente: the docs are unclear for me :-) | 12:31 |
| gfidente | hi lsmola_ we need to add some documentation about ceph cause things changed a bit | 12:32 |
| gfidente | are you trying via instack or via devtest? | 12:32 |
| lsmola_ | gfidente: the rdo-manager docs, with rhel | 12:32 |
| gfidente | so you mean the bits here: https://repos.fedorapeople.org/repos/openstack-m/docs/master/basic_deployment/basic_deployment.html#deploy-the-overcloud ? | 12:33 |
| lsmola_ | gfidente: there is basically just this param and number of ceph nodes for configuration documented | 12:33 |
| lsmola_ | gfidente: https://repos.fedorapeople.org/repos/openstack-m/docs/internal/master/basic_deployment/basic_deployment.html | 12:33 |
| lsmola_ | gfidente: the internal for rhel | 12:33 |
| *** shardy_ has joined #tripleo | 12:33 | |
| lsmola_ | gfidente: but it's the same :-) | 12:34 |
| gfidente | lsmola_, so we support multibackend in cinder now | 12:34 |
| gfidente | if you use CINDER_ISCSI=1 you will get both Ceph and LVM backends enabled | 12:34 |
| gfidente | if you set CINDER_ISCSI=0, only Ceph | 12:34 |
| gfidente | (backend name in that message should really refer to LVM not ISCSI) | 12:34 |
| gfidente | you comfortable with updating the docs to word it better? | 12:35 |
| *** shardy has quit IRC | 12:35 | |
| lsmola_ | gfidente: ok | 12:35 |
| lsmola_ | gfidente: I guess only ceph is good for me, since I will dpeloy only ceph ndoes now | 12:36 |
| lsmola_ | gfidente: I'll send it to jcoufal to reword it, I don't have access to the docs | 12:36 |
| gfidente | so to be clear, upstream we do support scaling the LVM nodes as well, not in instack yet though | 12:36 |
| lsmola_ | gfidente: or do I? never tried it :-) | 12:36 |
| lsmola_ | gfidente: ok | 12:36 |
| gfidente | lsmola_, I think we all do, it is on gerrithub | 12:36 |
| gfidente | so from instack, when using LVM backend, only the controllers will contribute to the LVM space | 12:37 |
| lsmola_ | gfidente: is there any doc for the doc? :-) | 12:37 |
| gfidente | lsmola_, you have to use git-review | 12:37 |
| gfidente | doc is built from instack inline | 12:37 |
| lsmola_ | gfidente: ah | 12:37 |
| gfidente | lsmola_, my fault, not for instack | 12:38 |
| gfidente | instack doc https://github.com/rdo-management/instack-undercloud/blob/master/doc/source/basic_deployment/basic_deployment.rst | 12:38 |
| lsmola_ | gfidente: ook, I'll ask jcoufal, he will send me how to contribute to the docs :-) | 12:39 |
| *** shardy_ has quit IRC | 12:39 | |
| *** shardy has joined #tripleo | 12:40 | |
| *** jprovazn has quit IRC | 12:46 | |
| *** adrianopetrich has joined #tripleo | 12:57 | |
| adrianopetrich | hey folks | 12:57 |
| *** jistr|class is now known as jistr | 12:59 | |
| gfidente | so looks like we'll have to do a recheck | 13:17 |
| gfidente | because CI failed with Error: Could not start Service[httpd]: Execution of '/sbin/service httpd start' returned 1 | 13:17 |
| gfidente | only on controller-2 | 13:17 |
| jistr | gfidente: ack on recheck, in the meantime we can investigate | 13:17 |
| jistr | could be a race condition again | 13:18 |
| gfidente | sigh | 13:18 |
| jistr | i don't see any httpd logs written on the ctrl 2 | 13:18 |
| gfidente | jistr, my fault, only controller-0 | 13:19 |
| gfidente | http://logs.openstack.org/81/181081/7/check-tripleo/check-tripleo-ironic-overcloud-f20puppet-ha/879ff88/logs/ov-zk2rcjgdr5g-0-jizscepwkcaz-Controller_logs/httpd.txt.gz | 13:20 |
| marios | guys which one am i missing to still be seeing http://paste.openstack.org/show/228197/ | 13:20 |
| jistr | gfidente: ERROR:scss.expression:Function not found: twbs-font-path:1 | 13:20 |
| gfidente | jistr, I also noticed from host_info that httpd is actually running on the other nodes even though there is no mention of httpd in os-collect-config | 13:21 |
| *** dasm is now known as dasm|afk | 13:21 | |
| gfidente | marios, I think you wanted to take on horizon/ha ? | 13:21 |
| marios | gfidente: when i get an env i will :) | 13:22 |
| marios | i may have borked somthing on a rebase with heat templates... gonna try tidy that up a bit and go again | 13:23 |
| marios | but first 5 minutes afk | 13:23 |
| *** jprovazn has joined #tripleo | 13:23 | |
| gfidente | marios, looks like it couldn't start haproxy | 13:24 |
| gfidente | can you check systemctl status haproxy? | 13:24 |
| gfidente | or the journalctl to see if you can spot anything about haproxy? | 13:24 |
| jistr | so that twbs-font-path thing -- twbs stands for twitter bootstrap :) | 13:25 |
| jayg | gfidente jistr: so if I want to do a fresh deploy to test HA, is there a set of patches you recommend? or perhaps a single on that is the base for others? | 13:27 |
| gfidente | jayg, we were waiting for you!@ | 13:27 |
| jayg | :) | 13:27 |
| gfidente | jayg, get back to master | 13:27 |
| gfidente | checkout the entire tree from here: https://review.openstack.org/#/c/181081 | 13:27 |
| gfidente | and make sure you get overcloud deployed! :) | 13:27 |
| jistr | ^ yeah | 13:28 |
| jayg | cool, I'll give it a shot, thanks! | 13:28 |
| jistr | that works for both gfidente and me | 13:28 |
| jayg | is there a way in gerrit to grabs _all_ those patches at once? | 13:29 |
| jistr | so re that failure, i'm not sure if it's the twitter bootstrap errors that crash it or if it's just that the initial operation (whatever it does) takes too long | 13:29 |
| jistr | httpd.service start-pre operation timed out. Terminating. | 13:29 |
| gfidente | jistr, yeah was thinking same, have to compare with nonha | 13:29 |
| jistr | jayg: just take the last one, it will include the ~10 others | 13:29 |
| gfidente | jayg, use 'checkout' | 13:29 |
| jistr | git fetch https://review.openstack.org/openstack/tripleo-heat-templates refs/changes/81/181081/7 && git checkout FETCH_HEAD | 13:30 |
| jayg | jistr: thx | 13:30 |
| gfidente | from the top-right 'download' menu | 13:30 |
| jayg | I prefer to pull to a new local branch, but I get the idea, thx | 13:30 |
| jayg | also, any other patches like the puppet-triple one that bit me that other day, which I need to get on my control images? | 13:30 |
| gfidente | jistr, same messages but then it started http://logs.openstack.org/81/181081/7/check-tripleo/check-tripleo-ironic-overcloud-f20puppet-nonha/9fa3962/logs/ov-sdfgdlh7b3x-0-3mtvyb4vjsu7-Controller_logs/httpd.txt.gz | 13:31 |
| jistr | jayg: nothing special is required right now i think | 13:31 |
| gfidente | jistr, instead of timing out | 13:31 |
| jistr | gfidente: ack, so it's just horizon trying to eat the world on httpd startup | 13:32 |
| gfidente | looks like | 13:32 |
| gfidente | in nonha it takes from 21:28 to 21:47 to start | 13:32 |
| jayg | jistr: cool, thx | 13:33 |
| gfidente | in ha at 55:27 starts but at 57:18 times out | 13:33 |
| jayg | jistr: are you using apache in the resource type like in the ref arch? | 13:33 |
| jayg | crag had problems with that yesterday | 13:34 |
| gfidente | jayg, horizon is not in pacemaker yet | 13:34 |
| jistr | jayg: i think at this point we don't have it as a resource | 13:34 |
| jayg | ah, k | 13:34 |
| gfidente | jayg, so this is the puppet-horizon module starting httpd at some point | 13:34 |
| jayg | why not just disable it until it is managed? | 13:35 |
| gfidente | well, none of the openstack services is at this point, but if it helps in making CI green, we might do it | 13:36 |
| jistr | +1 | 13:36 |
| gfidente | sadly leaving work on the head of marios | 13:36 |
| jistr | so the scary thing is that the timeout comes from systemd itself | 13:37 |
| marios | gfidente: i will hit you many times | 13:37 |
| gfidente | who can push changes until he gets green CI with horizon | 13:37 |
| jistr | ..which means that value might be hard to change | 13:37 |
| marios | gfidente: my latest run is using your branch above (I see it has all the things pcmk_ etc) | 13:38 |
| gfidente | jistr, on the other hand, almost 2mins is reasonable timeout | 13:38 |
| marios | gfidente: if it doesn't complete sucessfully | 13:38 |
| marios | gfidente: i think you know what happens | 13:38 |
| marios | gfidente: should i expect the horizon error then? | 13:38 |
| gfidente | marios, so I haven't seen it on the local dev env, but upstream CI is failing on horizon yet | 13:39 |
| gfidente | *yes | 13:39 |
| jistr | gfidente: yeah that's right. Possibly something went wrong there really, not just taking its time. | 13:39 |
| marios | gfidente: looks like haproxy started ok this time... | 13:39 |
| jayg | guys, /7 doesn't apply to master without a merge commit, should it be rebased? | 13:39 |
| marios | jayg: i'd do fresh git clone and then git review -d changid | 13:40 |
| marios | jayg: assuming you have gerrit id review.openstack.org | 13:40 |
| jistr | jayg: yeah are you sure you have current master? | 13:40 |
| gfidente | marios, but you still got CREATE_FAILED? | 13:40 |
| marios | gfidente: waiting still | 13:40 |
| jayg | marios: ok, I will try that, I think I set up gerrit on test box | 13:40 |
| * gfidente pushing a temporary thing to disable horizon on top | 13:41 | |
| marios | jayg: yeah if new box you'll need to cp the .ssh/id_rsa.pum to gerrit | 13:41 |
| * gfidente still have hopes of not disabling it though | 13:41 | |
| jistr | gfidente: ack | 13:41 |
| * marios palmface forgot to change registry | 13:43 | |
| marios | fuuuuuu | 13:43 |
| gfidente | ahahhaa | 13:43 |
| jayg | marios: that did the trick, thanks, will try to redeploy now | 13:43 |
| marios | np | 13:44 |
| * jayg still gerrit n00b | 13:44 | |
| jistr | gfidente: so regarding the instance check timeout i mentioned to you, the overcloud instance didn't get created at all, this is from nova-api log: http://fpaste.org/223328/14320430/raw/ | 13:45 |
| jistr | aand when i tried to re-run the nova boot command that devtest runs: | 13:47 |
| jistr | [root@dell-t5810ws-rdo-10 ~]# nova boot --key-name default --flavor m1.tiny --block-device source=image,id=855b0b2e-9fe6-4789-b58c-aee37dc44a0c,dest=volume,size=3,shutdown=preserve,bootindex=0 demo | 13:47 |
| jistr | ERROR (BadRequest): Multiple possible networks found, use a Network ID to be more specific. (HTTP 400) (Request-ID: req-45b0ab52-3dbb-412c-bb37-bec7f06a3463) | 13:47 |
| gfidente | jistr, that is because in CI it runs with demo user credentials | 13:47 |
| gfidente | jistr, so it doesn't have multiple networks | 13:47 |
| jistr | duh thx | 13:47 |
| jistr | ah so the instance *is* up, and has the correct ip assigned, but i can't ping it | 13:50 |
| * jistr proceeds to investigate further | 13:50 | |
| gfidente | jistr, I think I know this :) | 13:50 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Temporarily disable Horizon in HA job https://review.openstack.org/184252 | 13:51 |
| * jistr is one big ear | 13:51 | |
| gfidente | jistr, jprovazn probably remembers as well | 13:51 |
| * jistr hopes that translates from czech correctly | 13:51 | |
| gfidente | so the reconnect to rabbit from neutron-ovs-agent | 13:51 |
| gfidente | might cause desync of ovs-agent with neutron-server | 13:51 |
| gfidente | and you end up with only 'some' of the ovs tunnels in between controller/compute | 13:52 |
| * jprovazn reads back | 13:52 | |
| gfidente | I used to do this: | 13:52 |
| gfidente | ovs-vsctl show | 13:52 |
| gfidente | on all three controllers AND compute | 13:52 |
| gfidente | compute should have a tunnel to each controller | 13:52 |
| *** dguerri is now known as dguerri`away | 13:53 | |
| gfidente | and controller to each other controller + to compute | 13:53 |
| jprovazn | jistr, gfidente is the right guy you want to ask about this :) - all I remember is just that he debugged&solved it | 13:54 |
| gfidente | jprovazn, sure | 13:54 |
| gfidente | especially solved | 13:54 |
| jistr | hmm interesting. seems all the nodes have 3 tunnels present (to all the remaining nodes of the four) | 13:57 |
| gfidente | jistr, sigh so it's not the same :( | 13:57 |
| *** lblanchard has joined #tripleo | 13:58 | |
| openstackgerrit | John Trowbridge proposed openstack/diskimage-builder: rhel-common element should not attach when using activation key https://review.openstack.org/184253 | 14:04 |
| *** Marga_ has joined #tripleo | 14:06 | |
| *** Marga_ has quit IRC | 14:06 | |
| *** Marga_ has joined #tripleo | 14:07 | |
| *** jtomasek has quit IRC | 14:09 | |
| *** lazy_prince has quit IRC | 14:09 | |
| *** dguerri`away is now known as dguerri | 14:14 | |
| gfidente | jistr, I would ping ajo! | 14:18 |
| gfidente | :) | 14:18 |
| jistr | we might give the original auth problem a more search | 14:19 |
| *** jrist has joined #tripleo | 14:21 | |
| gfidente | also yes | 14:23 |
| jayg | hrm, so the good news is I finally get a cluster | 14:25 |
| jayg | the bad news is it appears puppet did not actually try to add any of the resources to that cluster | 14:25 |
| gfidente | jayg, any at all sounds like it failed | 14:25 |
| jayg | the last Pacemaker ref I see in my puppet log is turning off stonith (no fails I see at end either) | 14:25 |
| *** jrist has quit IRC | 14:25 | |
| gfidente | and never goes past that? | 14:26 |
| jayg | no | 14:26 |
| gfidente | and the deployment is in create_failed? | 14:26 |
| jayg | yes | 14:26 |
| *** regebro has quit IRC | 14:26 | |
| gfidente | so I think puppet failed on one of the three nodes | 14:27 |
| jayg | ok, I'll log into the other 3 and look further | 14:27 |
| *** Marga_ has quit IRC | 14:29 | |
| *** dguerri is now known as dguerri`away | 14:29 | |
| *** dguerri`away is now known as dguerri | 14:29 | |
| jayg | gfidente: ok, it appears that on one node, mongo failed to start, due to a timeout | 14:33 |
| * jayg considers setting smallfiles=true and retrying deployment | 14:33 | |
| *** ukalifon has quit IRC | 14:33 | |
| gfidente | jayg, mongo is not supposed to start until pacemaker does | 14:33 |
| gfidente | but there is an issue with the module which doesn't allow that yet | 14:33 |
| gfidente | so it starts together with the cluster | 14:33 |
| gfidente | not sure why it timed out though | 14:33 |
| jayg | well, if smallfiles is not true, it takes forever to allocate disk space | 14:34 |
| jayg | what module doesn't allow this ordering though? I am pretty sure we never had mongo start before the cluster in quickstack | 14:34 |
| gfidente | mongodb | 14:35 |
| gfidente | it starts the daemon when doing the config | 14:35 |
| marios | gfidente: i also saw the same as jayg i think to mongodb server! (192.0.2.19:27017)\u001b[0m\n\u001b[1;31mError: /Stage[main]/Mongodb::Server::Service/Mongodb_conn_validator[mongodb]/ensure: change from absent to present failed: Unable to connect to mongodb server! (192.0.2.19:27017)\u001b[0m\n\u001 | 14:35 |
| jayg | marios: that one sometimes fails a couple times while waiting for service to come up | 14:36 |
| jayg | but the service should eventually come up (mine did not) | 14:36 |
| marios | sorry, i wasn't overly excited about reporting that, the ! was part of the log :) | 14:36 |
| jayg | you know you were excited | 14:36 |
| jayg | everyone loves to see mongo fai | 14:36 |
| jayg | l | 14:36 |
| marios | :( | 14:37 |
| *** jrist has joined #tripleo | 14:39 | |
| *** jrist has joined #tripleo | 14:39 | |
| *** sdake has joined #tripleo | 14:42 | |
| *** sdake_ has joined #tripleo | 14:43 | |
| gfidente | jayg, can we make some resource agent verbose? | 14:44 |
| gfidente | looks like we ended up with pacemaker saying the rabbitmq cluster is up but rabbitmqctl says they are isolted | 14:44 |
| jayg | gfidente: I am not sure what you mean by agent being verbose - pacemaker only reports on if service responds as running or not, not whether it is working properly | 14:46 |
| gfidente | jayg, yeah so rabbitmq-cluster ocf | 14:46 |
| gfidente | logging cluster bootstrapped | 14:47 |
| gfidente | but the rabbitmq nodes are isolated | 14:47 |
| *** akrivoka has joined #tripleo | 14:47 | |
| *** sdake has quit IRC | 14:47 | |
| jayg | let me take a look at that part of the puppet in my checkout here | 14:47 |
| jistr | presently we're missing ordered=true interleave=true as clone params though, i'm wondering if that could make a difference. | 14:47 |
| * jistr will try | 14:48 | |
| jayg | jistr: you have switched to newest puppet-pacemaker, right? | 14:48 |
| jistr | jayg: yes | 14:48 |
| jistr | i know adding them is easy | 14:49 |
| jayg | there was a patch from spredzy|afk after crag's stuff, which we merged, just want to make sure you have that too | 14:49 |
| jistr | i rebuilt the images today so i'm hoping i do | 14:49 |
| jayg | ok | 14:49 |
| gfidente | jistr, looks like ordered is pretty important | 14:50 |
| *** zbitter has joined #tripleo | 14:50 | |
| jayg | yeah, those two look like the biggest diffs in config atm | 14:52 |
| lsmola_ | gfidente: is it possible we don't have cinder registered to keystone? | 14:52 |
| gfidente | lsmola_, don't think so, something failed if you don't have it | 14:52 |
| lsmola_ | gfidente: I see only object store there | 14:53 |
| lsmola_ | gfidente: damn | 14:53 |
| *** aufi has quit IRC | 14:53 | |
| lsmola_ | gfidente: which step does the registration? | 14:53 |
| *** mmagr has quit IRC | 14:53 | |
| gfidente | lsmola_, a script launched after the deployment finishes | 14:53 |
| gfidente | automatically by instack | 14:53 |
| gfidente | adding users and endpoints | 14:54 |
| lsmola_ | gfidente: hmm, wait, I should be talking to overcloud cinder right? :-) | 14:54 |
| jistr | gfidente, jayg: so looks like ordered=true fixed that | 14:54 |
| jistr | gfidente, jayg: i'll submit a patch | 14:54 |
| jayg | jistr: awesome | 14:54 |
| lsmola_ | gfidente: so my bad again :-D | 14:54 |
| *** zb has joined #tripleo | 14:57 | |
| *** akrivoka_ has joined #tripleo | 14:58 | |
| *** pblaho has quit IRC | 14:59 | |
| *** untriaged-bot has joined #tripleo | 15:00 | |
| untriaged-bot | Untriaged bugs so far: | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1455175 | 15:00 |
| openstack | Launchpad bug 1455175 in tripleo "Option to configure gateway through keepalived" [Undecided,New] - Assigned to Mayank (mayank0107) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1449852 | 15:00 |
| openstack | Launchpad bug 1449852 in diskimage-builder "Buidling ramdisk with ironic-agent behind proxy fails" [Undecided,In progress] - Assigned to Ramakrishnan G (rameshg87) (rameshg87) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1449854 | 15:00 |
| openstack | Launchpad bug 1449854 in diskimage-builder "Ironic agent ramdisk built using disk-image-create fails with iscsi_ilo driver" [Undecided,Fix committed] - Assigned to Ramakrishnan G (rameshg87) (rameshg87) | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1454803 | 15:00 |
| openstack | Launchpad bug 1454803 in tripleo "puppet: Neutron is not configured with L2 population" [Undecided,New] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1454802 | 15:00 |
| openstack | Launchpad bug 1454802 in tripleo "puppet: Neutron does not use Nova notifications" [Undecided,New] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1452752 | 15:00 |
| openstack | Launchpad bug 1452752 in tuskar "keystone_authtoken section is wrong in default shipped tuskar.conf.sample" [Undecided,Confirmed] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1456648 | 15:00 |
| openstack | Launchpad bug 1456648 in diskimage-builder "rhel-common element tries to attach when using activation key" [Undecided,In progress] - Assigned to John Trowbridge (trown) | 15:00 |
| *** untriaged-bot has quit IRC | 15:01 | |
| *** zbitter has quit IRC | 15:01 | |
| *** marzif has joined #tripleo | 15:01 | |
| *** akrivoka has quit IRC | 15:02 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: Clone params for pacemaker rabbitmq resource https://review.openstack.org/184263 | 15:03 |
| gfidente | jistr, on top or outside that tree? | 15:04 |
| *** akrivoka__ has joined #tripleo | 15:04 | |
| *** yamahata has joined #tripleo | 15:04 | |
| jistr | gfidente: on top, sans the horizon bit | 15:04 |
| gfidente | I'm even more convinced we need to merge things now :) | 15:04 |
| jistr | (it has to be on top of at least some of the moves, otherwise it would conflict) | 15:04 |
| jistr | yeah :D | 15:04 |
| gfidente | ah right | 15:04 |
| gfidente | jayg, any chance to cherry-pick https://review.openstack.org/#/c/184263 on top of what you have already? | 15:05 |
| jayg | gfidente: already grabbing it :) | 15:05 |
| *** shardy_ has joined #tripleo | 15:05 | |
| jayg | found why my last setup failed, repairing then trying again | 15:05 |
| gfidente | yeah hopefully mongo won't stop you halfway there | 15:05 |
| gfidente | jayg, what was it? | 15:06 |
| jayg | I set smallfiles=true for that this time | 15:06 |
| jayg | well | 15:06 |
| gfidente | jayg, if you think it is wortj | 15:06 |
| jayg | in addition to smallfiles my puppet-pacemaker was not up to date like we thought it was | 15:06 |
| gfidente | just push it on the dance floor! :) | 15:06 |
| jayg | gfidente: it is not for production, afaik, but sometimes needed for VMs | 15:06 |
| jayg | we never included it in ofi/quickstack | 15:07 |
| gfidente | ah | 15:07 |
| jayg | but I hacked it in for dev all the time | 15:07 |
| gfidente | got it | 15:07 |
| *** julim has quit IRC | 15:07 | |
| *** shardy has quit IRC | 15:07 | |
| gfidente | jayg, you default to neutron l3_ha for multiple nodes? | 15:07 |
| gfidente | I wanted to enable that as well | 15:07 |
| jayg | yes we do | 15:07 |
| *** akrivoka_ has quit IRC | 15:07 | |
| *** dguerri is now known as dguerri`away | 15:07 | |
| jayg | gfidente: a big one there is to make sure l2pop is off | 15:08 |
| gfidente | yeah we don't support it yet | 15:08 |
| jayg | there is a bug in neutron that makes the two not work together | 15:09 |
| gfidente | so it is always off AFAIK | 15:09 |
| jayg | l2pop? | 15:09 |
| jayg | so if you dont have l3_ha, what _do_ you have? | 15:09 |
| jayg | we do either or | 15:09 |
| *** dguerri`away is now known as dguerri | 15:09 | |
| gfidente | l3 relocation | 15:10 |
| gfidente | and l3_ha either one or the other | 15:10 |
| *** zbitter has joined #tripleo | 15:10 | |
| * jayg has never used that :) | 15:10 | |
| gfidente | work for dvr probably paused, but some is in there already | 15:10 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates: Clone params for pacemaker rabbitmq resource https://review.openstack.org/184263 | 15:11 |
| *** shardy_ has quit IRC | 15:11 | |
| *** julim has joined #tripleo | 15:11 | |
| *** shardy has joined #tripleo | 15:11 | |
| *** panda has quit IRC | 15:13 | |
| *** panda has joined #tripleo | 15:14 | |
| *** zb has quit IRC | 15:14 | |
| *** zaneb has joined #tripleo | 15:14 | |
| lsmola_ | gfidente: so running service list, but I see only one volume service, for 2 deployed ceph nodes | 15:16 |
| gfidente | lsmola_, correct, you have cinder-volume running only on controller | 15:17 |
| gfidente | ceph osd dump | 15:17 |
| gfidente | should tell you about the ceph storage status | 15:17 |
| gfidente | or | 15:17 |
| gfidente | ceph -s | 15:17 |
| lsmola_ | gfidente: and hostname is weird, controller servicer has hostname of controller node, but volume doesn't match any ceph node | 15:17 |
| *** zbitter has quit IRC | 15:17 | |
| gfidente | hostname of the tripleo_ceph instance is customized to arbitrary string on purpose, jistr ^^ | 15:18 |
| gfidente | if you had more controllers they were all sharing same string for that backend | 15:18 |
| gfidente | insted of their hostname | 15:18 |
| *** cwolferh has quit IRC | 15:19 | |
| gfidente | jayg, and you were probably enabling l3_ha based on number of controllers right? because it doesn't work with 1 node | 15:19 |
| *** akrivoka__ has quit IRC | 15:20 | |
| *** ParsectiX has joined #tripleo | 15:21 | |
| gfidente | jayg, I also wanted to ask about clustercheck | 15:22 |
| gfidente | ping when you're not testing :P | 15:22 |
| lsmola_ | gfidente: hmm, so the volume <-> host relation is not exposed in APIs? | 15:22 |
| *** zb has joined #tripleo | 15:22 | |
| jayg | gfidente: we allow l3_ha even on one node, but there are a couple other settings that vary if you have one node or more | 15:23 |
| * jayg wrapping up call :) | 15:23 | |
| gfidente | call? | 15:23 |
| *** akrivoka has joined #tripleo | 15:23 | |
| gfidente | jayg, isn't it breaking neutron-server on 1 node preventing it from starting? | 15:23 |
| jayg | gfidente: let me double check myself, but that has not been a problem | 15:25 |
| gfidente | ack thanks, then I can ask about clusterchek | 15:25 |
| gfidente | you should put a bot in the channel | 15:25 |
| gfidente | capturing questions | 15:25 |
| gfidente | and giving known good responses | 15:25 |
| gfidente | ahahaha | 15:25 |
| jayg | haha | 15:25 |
| gfidente | lsmola_, I am not sure about 'not exposed' ? | 15:26 |
| *** akrivoka_ has joined #tripleo | 15:26 | |
| lsmola_ | gfidente: similar to VMs, you can see on which host it is running | 15:27 |
| *** zaneb has quit IRC | 15:27 | |
| jayg | this is what we do https://github.com/redhat-openstack/astapor/blob/master/puppet/modules/quickstack/manifests/pacemaker/neutron.pp#L102 | 15:27 |
| gfidente | lsmola_, ah so cinder-volume is always running on all controllers | 15:27 |
| lsmola_ | gfidente: so here it's hidden behind the cluster? | 15:27 |
| gfidente | lsmola_, which piece of information is hidden? | 15:27 |
| lsmola_ | gfidente: and the actual deployed volume? | 15:27 |
| *** zbitter has joined #tripleo | 15:27 | |
| *** daneyon has quit IRC | 15:28 | |
| *** akrivoka__ has joined #tripleo | 15:28 | |
| gfidente | lsmola_, the volume is not hosted by a specific node, that is the very purpose of customizing the host setting | 15:28 |
| gfidente | if we were to do it, volume would only be available if backing host is up | 15:28 |
| gfidente | jayg, YOU HACK THE NUMBERS! :P | 15:29 |
| * gfidente crying | 15:29 | |
| *** akrivoka__ has quit IRC | 15:29 | |
| gfidente | jayg, maybe we should do that too :) | 15:29 |
| lsmola_ | gfidente: I though it will be just replicated on few hosts? | 15:29 |
| gfidente | lsmola_, it is, but ceph is doing that, not cinder | 15:29 |
| jistr | gfidente, jayg: :))) | 15:29 |
| lsmola_ | gfidente: right, so that info is not exposed through cinder? | 15:30 |
| jayg | gfidente: I don't hack, them, I set them correctly :) | 15:30 |
| gfidente | lsmola_, ack now I get it, that info is not even known to cinder | 15:30 |
| lsmola_ | gfidente: any idea whic command can list this talking to ceph? | 15:30 |
| *** akrivoka has quit IRC | 15:30 | |
| gfidente | jayg, YOU HACK THE NUMBER! | 15:30 |
| *** zaneb has joined #tripleo | 15:30 | |
| gfidente | and I mean YOU | 15:30 |
| gfidente | not you | 15:30 |
| jayg | haha | 15:31 |
| gfidente | and now I WILL too : | 15:31 |
| gfidente | :P | 15:31 |
| *** weshay has joined #tripleo | 15:31 | |
| gfidente | thanks | 15:31 |
| *** akrivoka_ has quit IRC | 15:31 | |
| jayg | ooooh, I am watching a second puppet run that may be doing what I want for a change here.... | 15:31 |
| gfidente | jayg, good :) | 15:32 |
| *** zb has quit IRC | 15:32 | |
| *** zbitter has quit IRC | 15:34 | |
| *** whayutin_ has joined #tripleo | 15:35 | |
| *** julim has quit IRC | 15:37 | |
| *** CheKoLyN has joined #tripleo | 15:38 | |
| *** weshay has quit IRC | 15:38 | |
| openstackgerrit | Pino Toscano proposed openstack/diskimage-builder: Cleanup the build directories earlier https://review.openstack.org/184268 | 15:38 |
| *** CheKoLyN has quit IRC | 15:38 | |
| *** saguilar has joined #tripleo | 15:39 | |
| *** athomas has joined #tripleo | 15:40 | |
| * gfidente wait_for ping | 15:45 | |
| gfidente | lsmola_, so cinder doesn't know about what ceph is doing in terms of replication | 15:46 |
| gfidente | jistr, IT REPLIED TO PING! | 15:47 |
| lsmola_ | gfidente: ok, I'll try to investigate if I can get that relation from ceph API | 15:47 |
| jistr | gfidente: /me wait_for ping | 15:47 |
| lsmola_ | gfidente: if not, I guess we don't need it that much :-) | 15:47 |
| gfidente | lsmola_, with rbd lspool volumes | 15:48 |
| gfidente | you get list of objects stored from cinder | 15:48 |
| gfidente | and uuid matches the cinder volume itself | 15:48 |
| gfidente | but you don't get which nodes are hosting the volume | 15:48 |
| gfidente | ceph is, in the background, maintaining 2/3 replicas at all times | 15:48 |
| *** whayutin_ has quit IRC | 15:49 | |
| jistr | gfidente: IT DID REPLY TO PING. which means i've just had a first END 2 END SUCCESSFUL HA DEPLOYMENT | 15:49 |
| gfidente | AHAH :) | 15:49 |
| lsmola_ | gfidente: where do I run this command? | 15:49 |
| gfidente | lsmola_, controllers | 15:49 |
| gfidente | jistr, including horizon, as it was for me as well | 15:50 |
| gfidente | so I am not sure what to do with it | 15:50 |
| jayg | gfidente jistr: ok, so after my deploy, I have one seemingly transient failure, but galera running - http://paste.fedoraproject.org/223415/14320505/ | 15:50 |
| gfidente | upstream CI still failing instead | 15:50 |
| jayg | and no rabbit partitions - http://paste.fedoraproject.org/223414/05054114/ | 15:50 |
| gfidente | jayg, I have seen the galera_monitor to fail as well | 15:50 |
| gfidente | I vote for merging THE WHOLE THING | 15:51 |
| jistr | gfidente, jayg: yeah i've seen the error too | 15:51 |
| lsmola_ | gfidente: seems like wrong command, rbd lspool volumes, running it on overcloud controller | 15:51 |
| gfidente | and then get back on galera | 15:51 |
| jistr | gfidente: we don't have enough +2s on some | 15:51 |
| gfidente | marios, ^^ :) | 15:51 |
| gfidente | jayg, question about galera clustercheck is | 15:52 |
| gfidente | I see it is polled by haproxy | 15:52 |
| gfidente | to remove unsynced nodes | 15:52 |
| jistr | gfidente: should we start landing those which do have enough +2s? i'd say yes | 15:52 |
| gfidente | is it used for full cluster restart as well? | 15:52 |
| gfidente | jistr, sure! | 15:53 |
| gfidente | from where we are, it's better to merge | 15:53 |
| jayg | gfidente: in what way do you mean? | 15:53 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fix RabbitMQ startup race https://review.openstack.org/181398 | 15:53 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Update to reflect puppet-pacemaker changes https://review.openstack.org/183103 | 15:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Configure HAProxy, Galera and MongoDB before start https://review.openstack.org/184043 | 15:54 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Remove unused enable_pacemaker setting from templates https://review.openstack.org/184057 | 15:55 |
| *** eghobo has joined #tripleo | 15:55 | |
| * jistr EOD ttyl | 15:57 | |
| jistr | o/ | 15:57 |
| *** jistr has quit IRC | 15:57 | |
| gfidente | marios, you around for some merging? | 15:57 |
| lsmola_ | gfidente: rbd ls volumes --long | 15:57 |
| jayg | gfidente: so unless I read /usr/lib/ocf/resource.d/heartbeat/galera incorrectly, I dont see it using clustercheck wrt restarts | 15:58 |
| lsmola_ | gfidente: but don;t see the any link to hosts, or replications | 15:58 |
| gfidente | jayg, yeah that is why I was wondering | 15:58 |
| lsmola_ | gfidente: have to run, will try that tomorrow again | 15:58 |
| gfidente | what is purpose of clustercheck, just to report about sync status to haproxy? | 15:58 |
| jayg | we use it also to make sure galera is ready before trying to set up anything that depends on it | 15:59 |
| jayg | and haproxy takes no action, that is just how it monitors for issues | 15:59 |
| *** Marga_ has joined #tripleo | 16:01 | |
| gfidente | isn't it removing nodes from sticky table out of sync? | 16:01 |
| *** saguilar has quit IRC | 16:01 | |
| *** cwolferh has joined #tripleo | 16:02 | |
| *** mestery has joined #tripleo | 16:04 | |
| *** dguerri is now known as dguerri`away | 16:05 | |
| jayg | gfidente: if the node is down, it would move traffic to a different one, but I think it keeps checking | 16:06 |
| *** eghobo has quit IRC | 16:07 | |
| *** daneyon has joined #tripleo | 16:07 | |
| gfidente | so we have something which defines different nodes as master/backup | 16:07 |
| gfidente | in haproxy | 16:07 |
| *** mcornea has quit IRC | 16:07 | |
| gfidente | I can see we prefer the master node when it is up, when we really shouldn't | 16:07 |
| gfidente | but is there any other difference with the sticky-table approach that you can tell? | 16:08 |
| jayg | cwolferh: maybe you can answer this question better? wrt stick table+galera+haproxy | 16:09 |
| *** yamahata has quit IRC | 16:10 | |
| *** dguerri`away is now known as dguerri | 16:10 | |
| gfidente | currently we do deploy clustercheck but we don't use it from haproxy yet because of the master/backup pre-existing approach | 16:10 |
| *** ParsectiX has quit IRC | 16:10 | |
| cwolferh | er, what is the question? | 16:10 |
| gfidente | cwolferh, sec code is easier | 16:11 |
| *** ParsectiX has joined #tripleo | 16:11 | |
| gfidente | we don't have this in tripleo https://github.com/redhat-openstack/astapor/blob/master/puppet/modules/quickstack/manifests/load_balancer/galera.pp#L22 | 16:11 |
| openstackgerrit | Pino Toscano proposed openstack/diskimage-builder: Cleanup the build directories earlier https://review.openstack.org/184268 | 16:11 |
| gfidente | instead we append backup key to all-except-one node | 16:12 |
| gfidente | yey we deploy clustercheck | 16:12 |
| *** athomas has quit IRC | 16:13 | |
| jayg | hmm, well the linked quickstack bit is what the ref arch recommends... | 16:13 |
| jayg | so why arent we doing that? | 16:13 |
| gfidente | so the questions are: 1) is it needed for full cluster restart in some way? is there more than haproxy pollin 9200? and 2) how does sticktable in haproxy compares to the master/backup thing? shall we use sticktable instead? | 16:13 |
| gfidente | jayg, because some of this stuff was in tripleo already | 16:13 |
| gfidente | jayg, it aimed at multiple controllers without pacemaker | 16:13 |
| *** mestery has quit IRC | 16:14 | |
| cwolferh | i don't understand what the master/backup thing is, i thought all nodes were masters when galera was deployed as a pacemaker service | 16:14 |
| gfidente | jayg, so we're slowly 'migrating' the config | 16:14 |
| jayg | ah, ok | 16:14 |
| gfidente | cwolferh, all galera nodes are, it is in haproxy we define all-but-one as backup so they only get proxied if master is down | 16:14 |
| gfidente | cwolferh, https://github.com/stackforge/puppet-tripleo/blob/master/manifests/loadbalancer.pp#L571-L588 | 16:15 |
| cwolferh | gfidente, n-1 masters and 1 backup, or 1 master and n-1 backups? | 16:15 |
| gfidente | n-1 backups | 16:15 |
| cwolferh | either way though, i think you are better off with stick table | 16:15 |
| cwolferh | if the master goes down, then you are in a round robin scenario between backups it seems to me (naively, not really familiar with master/backup) | 16:16 |
| gfidente | nah it is only using 1 backup at a time | 16:16 |
| gfidente | as long as one is available it uses the first one it can find | 16:16 |
| gfidente | anyway, I'll track this as a bug so we get on it with some medium priority | 16:16 |
| *** zaneb has quit IRC | 16:17 | |
| *** saguilar has joined #tripleo | 16:19 | |
| gfidente | jayg, so regarding the l3_ha setting instead | 16:20 |
| gfidente | https://github.com/redhat-openstack/astapor/blob/master/puppet/modules/quickstack/manifests/pacemaker/neutron.pp#L102 < I see minimum set to 2 | 16:20 |
| gfidente | but I get InternalServerError: Not enough l3 agents available to ensure HA. Minimum required 2, available 1. | 16:20 |
| gfidente | with single node, do you disable it with single node then> | 16:21 |
| gfidente | ? | 16:21 |
| *** daneyon has quit IRC | 16:21 | |
| *** Marga_ has quit IRC | 16:27 | |
| *** Marga_ has joined #tripleo | 16:27 | |
| jayg | gfidente: hmm, not explicitly that I recall, unless staypuft was doing so | 16:28 |
| gfidente | yeah because if I enforce min to 1 I get | 16:29 |
| gfidente | HAMinimumAgentsNumberNotValid: min_l3_agents_per_router config parameter is not valid. It has to be equal to or more than 2 for HA. | 16:29 |
| jayg | gfidente: can you paste your neutron config? | 16:31 |
| gfidente | jayg sure | 16:31 |
| gfidente | not anymore I deleted stack | 16:31 |
| jayg | ah, ok | 16:32 |
| jayg | because if you look, even with l3_ha= true, if the cluster size were 1, we would set dhcp_agents_per_network=1, and min is the same in either case | 16:33 |
| gfidente | dhcp_agents is fine | 16:33 |
| jayg | the only bits that change are clone-max and max_l3_agents_per_router | 16:33 |
| gfidente | it is min_l3_agents the issue | 16:33 |
| jayg | that value is the default anyway | 16:33 |
| jayg | so there must be a different setting triggering this | 16:34 |
| gfidente | yes indeed if you don't change it and set l3_ha with 1 neutron server, the neutron client returns the error I pasted | 16:34 |
| gfidente | clone is only affecting the pacemaker resource no? | 16:34 |
| jayg | correct | 16:34 |
| jayg | ah, looking at neutron::server, it must be as you say, that 'DEFAULT/l3_ha': value => true; | 16:36 |
| jayg | must break it | 16:36 |
| *** mestery has joined #tripleo | 16:37 | |
| gfidente | https://github.com/openstack/neutron/blob/master/neutron/common/constants.py#L65 | 16:39 |
| gfidente | yep it won't work with less than 2 | 16:39 |
| jayg | gfidente: you know, now that I have been trying to remember for a bit, I think I have heard reports of this before, and that staypuft would set it to false if one node | 16:40 |
| gfidente | ack | 16:40 |
| gfidente | you DO NOT HACK THE NUMBERS! | 16:40 |
| jayg | haha | 16:40 |
| gfidente | see you tomorrow | 16:41 |
| gfidente | I am done for today | 16:41 |
| jayg | good night! | 16:41 |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Enable NeutronL3HA by default in Pacemaker scenario https://review.openstack.org/184289 | 16:42 |
| *** ParsectiX has quit IRC | 16:47 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates: Enable NeutronL3HA by default in Pacemaker scenario https://review.openstack.org/184289 | 16:47 |
| *** ParsectiX has joined #tripleo | 16:47 | |
| gfidente | jayg, can you vote the deps tree as well? | 16:49 |
| jayg | gfidente: do I just do each individually? | 16:50 |
| gfidente | yeah you have to do individually | 16:50 |
| gfidente | topmost can't be merged untill the deps also are | 16:50 |
| gfidente | even if it gets all the votes | 16:50 |
| jayg | sure thing, I'll go through them each as well | 16:51 |
| gfidente | we switched rabbit client to list of hosts as wel | 16:51 |
| gfidente | and there was some missing sync_db | 16:52 |
| gfidente | the other three are minor restructuring | 16:52 |
| gfidente | again, ttyt :) | 16:52 |
| jayg | k, ttyt | 16:52 |
| *** gfidente has quit IRC | 16:53 | |
| *** sdake_ is now known as sdake | 16:55 | |
| *** ParsectiX has quit IRC | 16:57 | |
| *** ParsectiX has joined #tripleo | 16:57 | |
| *** trown is now known as trown|lunch | 17:01 | |
| *** Marga_ has quit IRC | 17:01 | |
| *** adrianopetrich_ has joined #tripleo | 17:03 | |
| *** adrianopetrich has quit IRC | 17:05 | |
| *** noslzzp has joined #tripleo | 17:09 | |
| *** noslzzp has quit IRC | 17:13 | |
| *** yog__ has quit IRC | 17:14 | |
| *** mestery has quit IRC | 17:14 | |
| *** adrianopetrich_ has quit IRC | 17:22 | |
| *** mestery has joined #tripleo | 17:28 | |
| *** saguilar has quit IRC | 17:32 | |
| *** sdake has quit IRC | 17:40 | |
| *** sdake has joined #tripleo | 17:42 | |
| *** eghobo has joined #tripleo | 17:47 | |
| *** Marga_ has joined #tripleo | 17:48 | |
| *** daneyon has joined #tripleo | 17:50 | |
| *** MasterPiece has quit IRC | 17:50 | |
| *** sdake has quit IRC | 17:51 | |
| *** david-lyle has joined #tripleo | 17:53 | |
| *** sdake has joined #tripleo | 17:56 | |
| *** daneyon has quit IRC | 17:59 | |
| *** mestery has quit IRC | 17:59 | |
| *** daneyon has joined #tripleo | 18:00 | |
| *** david-lyle has quit IRC | 18:01 | |
| *** adrianopetrich has joined #tripleo | 18:03 | |
| *** eghobo has quit IRC | 18:03 | |
| *** david-lyle has joined #tripleo | 18:07 | |
| *** saguilar has joined #tripleo | 18:10 | |
| *** daneyon has quit IRC | 18:14 | |
| *** daneyon has joined #tripleo | 18:16 | |
| *** daneyon has quit IRC | 18:18 | |
| *** trown|lunch is now known as trown | 18:18 | |
| *** sdake has quit IRC | 18:18 | |
| *** spredzy|afk is now known as spredzy | 18:18 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Replace ci.o.o links with docs.o.o/infra https://review.openstack.org/183306 | 18:34 |
| *** gfidente has joined #tripleo | 18:41 | |
| *** gfidente has quit IRC | 18:44 | |
| *** alop has joined #tripleo | 18:48 | |
| *** barra204 has joined #tripleo | 18:50 | |
| *** barra204_ has joined #tripleo | 18:50 | |
| *** adrianopetrich has quit IRC | 18:54 | |
| *** david-lyle has quit IRC | 18:57 | |
| *** david-lyle has joined #tripleo | 19:01 | |
| *** jprovazn has quit IRC | 19:02 | |
| *** Goneri has quit IRC | 19:03 | |
| *** cwolferh has quit IRC | 19:04 | |
| *** barra204__ has joined #tripleo | 19:05 | |
| *** barra204_ has quit IRC | 19:05 | |
| *** openstackgerrit has quit IRC | 19:06 | |
| *** openstackgerrit has joined #tripleo | 19:06 | |
| *** barra204 has quit IRC | 19:06 | |
| *** barra204 has joined #tripleo | 19:06 | |
| *** panda has quit IRC | 19:13 | |
| *** panda has joined #tripleo | 19:14 | |
| *** barra204__ has quit IRC | 19:22 | |
| *** barra204 has quit IRC | 19:22 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Install debian locales https://review.openstack.org/183891 | 19:23 |
| *** MasterPiece has joined #tripleo | 19:23 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add debian build test case https://review.openstack.org/181161 | 19:23 |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tests for building *-minimal images https://review.openstack.org/181162 | 19:23 |
| *** alop has quit IRC | 19:28 | |
| *** akrivoka has joined #tripleo | 19:33 | |
| *** barra204__ has joined #tripleo | 19:35 | |
| *** barra204 has joined #tripleo | 19:35 | |
| *** barra204 has quit IRC | 19:37 | |
| *** barra204__ has quit IRC | 19:37 | |
| *** barra204__ has joined #tripleo | 19:37 | |
| *** barra204 has joined #tripleo | 19:37 | |
| *** ParsectiX has quit IRC | 19:39 | |
| *** ParsectiX has joined #tripleo | 19:40 | |
| *** Marga_ has quit IRC | 19:42 | |
| openstackgerrit | greghaynes proposed openstack/diskimage-builder: Add tests for building *-minimal images https://review.openstack.org/181162 | 19:42 |
| *** daneyon has joined #tripleo | 19:45 | |
| *** akrivoka has quit IRC | 19:46 | |
| *** cwolferh has joined #tripleo | 19:48 | |
| *** david-lyle has quit IRC | 19:52 | |
| *** dguerri is now known as dguerri`away | 19:54 | |
| *** sdake has joined #tripleo | 20:06 | |
| *** jayg is now known as jayg|g0n3 | 20:09 | |
| *** dasm|afk has quit IRC | 20:14 | |
| *** ParsectiX has quit IRC | 20:18 | |
| *** ParsectiX has joined #tripleo | 20:18 | |
| *** ParsectiX has quit IRC | 20:22 | |
| *** ParsectiX has joined #tripleo | 20:22 | |
| *** daneyon has quit IRC | 20:24 | |
| *** akrivoka has joined #tripleo | 20:29 | |
| *** ifarkas has quit IRC | 20:31 | |
| *** dsneddon has joined #tripleo | 20:39 | |
| *** sdake has quit IRC | 20:39 | |
| *** radez_g0n3 is now known as radez | 20:41 | |
| *** daneyon has joined #tripleo | 20:41 | |
| *** eghobo has joined #tripleo | 20:42 | |
| *** dsneddon has quit IRC | 20:42 | |
| *** daneyon has quit IRC | 20:45 | |
| *** eghobo_ has joined #tripleo | 20:45 | |
| *** radez is now known as radez_g0n3 | 20:46 | |
| openstackgerrit | Christopher Dearborn proposed openstack/tripleo-image-elements: Have all os-refresh-config elements use su instead of sudo https://review.openstack.org/171303 | 20:47 |
| *** eghobo has quit IRC | 20:48 | |
| *** daneyon has joined #tripleo | 20:53 | |
| *** daneyon has quit IRC | 20:54 | |
| *** david-lyle has joined #tripleo | 20:55 | |
| *** akrivoka has quit IRC | 20:57 | |
| *** david-lyle has quit IRC | 20:58 | |
| *** untriaged-bot has joined #tripleo | 21:00 | |
| untriaged-bot | Untriaged bugs so far: | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1455175 | 21:00 |
| openstack | Launchpad bug 1455175 in tripleo "Option to configure gateway through keepalived" [Undecided,New] - Assigned to Mayank (mayank0107) | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1449852 | 21:00 |
| openstack | Launchpad bug 1449852 in diskimage-builder "Buidling ramdisk with ironic-agent behind proxy fails" [Undecided,In progress] - Assigned to Ramakrishnan G (rameshg87) (rameshg87) | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1449854 | 21:00 |
| openstack | Launchpad bug 1449854 in diskimage-builder "Ironic agent ramdisk built using disk-image-create fails with iscsi_ilo driver" [Undecided,Fix committed] - Assigned to Ramakrishnan G (rameshg87) (rameshg87) | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1454803 | 21:00 |
| openstack | Launchpad bug 1454803 in tripleo "puppet: Neutron is not configured with L2 population" [Undecided,New] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1454802 | 21:00 |
| openstack | Launchpad bug 1454802 in tripleo "puppet: Neutron does not use Nova notifications" [Undecided,New] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1452752 | 21:00 |
| openstack | Launchpad bug 1452752 in tuskar "keystone_authtoken section is wrong in default shipped tuskar.conf.sample" [Undecided,Confirmed] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1456648 | 21:00 |
| openstack | Launchpad bug 1456648 in diskimage-builder "rhel-common element tries to attach when using activation key" [Undecided,In progress] - Assigned to John Trowbridge (trown) | 21:00 |
| *** untriaged-bot has quit IRC | 21:00 | |
| *** david-lyle has joined #tripleo | 21:01 | |
| *** eghobo_ has quit IRC | 21:05 | |
| *** trown is now known as trown|outttypeww | 21:13 | |
| *** dguerri`away is now known as dguerri | 21:16 | |
| *** lblanchard has quit IRC | 21:18 | |
| *** barra204__ has quit IRC | 21:23 | |
| *** barra204_ has joined #tripleo | 21:23 | |
| *** barra204__ has joined #tripleo | 21:23 | |
| *** thrash is now known as thrash|g0ne | 21:23 | |
| *** barra204 has quit IRC | 21:24 | |
| *** rlandy has quit IRC | 21:35 | |
| *** david-lyle has quit IRC | 21:41 | |
| *** eghobo has joined #tripleo | 21:43 | |
| *** eghobo_ has joined #tripleo | 21:46 | |
| *** david-lyle has joined #tripleo | 21:49 | |
| *** eghobo has quit IRC | 21:50 | |
| *** eghobo_ has quit IRC | 21:56 | |
| *** barra204 has joined #tripleo | 21:57 | |
| *** barra204__ has quit IRC | 21:57 | |
| *** barra204_ has quit IRC | 21:58 | |
| *** barra204_ has joined #tripleo | 21:58 | |
| *** barra204_ is now known as shakamunyi | 22:04 | |
| *** athomas has joined #tripleo | 22:08 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Update neutron local_ip to use the tenant network https://review.openstack.org/178716 | 22:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add a network ports IP mapping resource https://review.openstack.org/178714 | 22:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add isolated network ports to block storage roles https://review.openstack.org/180824 | 22:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add isolated network ports to swift roles https://review.openstack.org/180823 | 22:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add isolated network ports to ceph roles https://review.openstack.org/180822 | 22:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add isolated network ports to controller roles https://review.openstack.org/177846 | 22:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add isolated network ports to compute roles https://review.openstack.org/180821 | 22:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add a ports (ip address) abstraction layer https://review.openstack.org/177845 | 22:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Add isolated net parameters to net-config stacks https://review.openstack.org/180820 | 22:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Wire in optional network creation for overcloud https://review.openstack.org/177844 | 22:15 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Switch net-config templates to use OS::stack_id https://review.openstack.org/184343 | 22:15 |
| *** david-lyle has quit IRC | 22:19 | |
| *** david-lyle has joined #tripleo | 22:21 | |
| *** david-lyle has quit IRC | 22:27 | |
| openstackgerrit | Merged openstack/diskimage-builder: Update install docs to be more user friendly https://review.openstack.org/172723 | 22:31 |
| *** barra204 has quit IRC | 22:46 | |
| *** shakamunyi has quit IRC | 22:46 | |
| *** rainya has joined #tripleo | 22:50 | |
| *** athomas has quit IRC | 22:54 | |
| *** saguilar has quit IRC | 23:00 | |
| *** Guest38176 is now known as mgagne | 23:05 | |
| *** mgagne has joined #tripleo | 23:05 | |
| *** panda has quit IRC | 23:13 | |
| *** panda has joined #tripleo | 23:14 | |
| *** chlong has joined #tripleo | 23:19 | |
| *** chlong_ has joined #tripleo | 23:20 | |
| *** rainya has quit IRC | 23:24 | |
| *** Marga_ has joined #tripleo | 23:28 | |
| *** chlong has quit IRC | 23:31 | |
| *** david-lyle has joined #tripleo | 23:35 | |
| *** rainya has joined #tripleo | 23:36 | |
| *** daneyon has joined #tripleo | 23:49 | |
| *** eghobo has joined #tripleo | 23:54 | |
| *** daneyon has quit IRC | 23:59 | |
| *** daneyon has joined #tripleo | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!