| *** zcourts_ has quit IRC | 00:30 | |
| *** zcourts has joined #openstack-ansible | 00:31 | |
| *** zcourts has quit IRC | 00:38 | |
| *** thorst_afk has joined #openstack-ansible | 00:41 | |
| *** thorst_afk has quit IRC | 00:46 | |
| *** thorst_afk has joined #openstack-ansible | 00:51 | |
| *** yifei has joined #openstack-ansible | 00:54 | |
| *** thorst_afk has quit IRC | 01:06 | |
| *** thorst_afk has joined #openstack-ansible | 01:07 | |
| *** thorst_afk has quit IRC | 01:11 | |
| *** chas has joined #openstack-ansible | 01:17 | |
| *** chas has quit IRC | 01:21 | |
| *** armaan has joined #openstack-ansible | 01:38 | |
| *** vikrant has joined #openstack-ansible | 01:59 | |
| *** thorst_afk has joined #openstack-ansible | 02:23 | |
| *** thorst_afk has quit IRC | 02:24 | |
| *** perniciouscaffei has joined #openstack-ansible | 02:31 | |
| *** vikrant has quit IRC | 02:40 | |
| *** armaan has quit IRC | 03:06 | |
| *** armaan has joined #openstack-ansible | 03:07 | |
| *** armaan has quit IRC | 03:11 | |
| *** chas has joined #openstack-ansible | 03:18 | |
| *** chas has quit IRC | 03:22 | |
| *** thorst_afk has joined #openstack-ansible | 03:25 | |
| *** thorst_afk has quit IRC | 03:30 | |
| *** gkadam has joined #openstack-ansible | 03:33 | |
| *** armaan has joined #openstack-ansible | 03:49 | |
| *** udesale has joined #openstack-ansible | 03:49 | |
| *** armaan has quit IRC | 03:54 | |
| *** hw_wutianwei has joined #openstack-ansible | 04:00 | |
| cloudnull | evenings | 04:09 |
|---|---|---|
| cloudnull | nomatics on infra nodes delete all the containers and then delete /openstack | 04:10 |
| *** armaan has joined #openstack-ansible | 04:10 | |
| cloudnull | on compute/cinder/swift nodes stop the services delete /openstack and disable the init scripts | 04:10 |
| cloudnull | zcourts https://gist.github.com/cloudnull/67a66141d2da6e1908514ba3cae74393 -- that's a gist I used on single interface deployments which do not have the ability to use VLANs. I use a setup like that gist so I can still use the multiple bridges and have pseudo separation of traffic. | 04:13 |
| cloudnull | armaan: looks like its already merged | 04:14 |
| cloudnull | and the tag has been pushed https://github.com/openstack/openstack-ansible/tree/14.2.8 | 04:15 |
| armaan | cloudnull: glance installation failed in Newton 14.2.8 branch. http://paste.openstack.org/show/619581/ | 04:15 |
| cloudnull | however if ever you find yourself needing a specific release you can always use the sha | 04:15 |
| *** hybridpollo has quit IRC | 04:16 | |
| cloudnull | armaan: if you login to the glance container, can you run `/openstack/venvs/glance-14.2.8/bin/glance-manage db_sync`? | 04:16 |
| cloudnull | does that work ? | 04:16 |
| cloudnull | also does the old venv still exist ? | 04:16 |
| armaan | cloudnull: ok, let me check | 04:17 |
| cloudnull | # /openstack/venvs/glance-14.X.X ? | 04:17 |
| cloudnull | if 14.2.8 is broken I wonder if the db sync would would with the old venv? | 04:17 |
| cloudnull | maybe a regression in the latest releases of glance? | 04:17 |
| armaan | cloudnull: It worked on running the playbook again. I am surprised ! | 04:18 |
| armaan | still, let me check the version of glance venv | 04:18 |
| cloudnull | ah, could've been a transient error in the db migration? | 04:18 |
| cloudnull | you could look into the logs and see if there's anything telling | 04:19 |
| armaan | it is glance-14.2.8 | 04:19 |
| armaan | ok | 04:19 |
| armaan | cloudnull: this is from the glance logs, http://paste.openstack.org/show/619582/ | 04:21 |
| *** thorst_afk has joined #openstack-ansible | 04:26 | |
| cloudnull | looks like "ix_namespaces_namespace" did not exist ? | 04:30 |
| cloudnull | so maybe we need to have the db migration retry ? | 04:31 |
| *** thorst_afk has quit IRC | 04:31 | |
| cloudnull | https://github.com/openstack/openstack-ansible-os_glance/blob/master/tasks/glance_db_setup.yml#L16-L20 | 04:31 |
| cloudnull | we could have that wraped in a retry which would've worked in this case | 04:32 |
| armaan | cloudnull: Should i be worried that my glance installation won't work? I am installing nova, neutron atm -- it will take few minutes before i could test glance. | 04:33 |
| cloudnull | no | 04:34 |
| cloudnull | I would not be worried about it | 04:34 |
| cloudnull | you could upload an image into glance to test | 04:34 |
| armaan | cool :) | 04:34 |
| cloudnull | but I'd just carry on | 04:35 |
| cloudnull | if the playbook has worked | 04:35 |
| armaan | roger! | 04:35 |
| *** chas has joined #openstack-ansible | 05:19 | |
| *** chas has quit IRC | 05:23 | |
| *** markvoelker_ has joined #openstack-ansible | 05:25 | |
| *** thorst_afk has joined #openstack-ansible | 05:27 | |
| *** markvoelker has joined #openstack-ansible | 05:29 | |
| *** markvoelker_ has quit IRC | 05:29 | |
| *** thorst_afk has quit IRC | 05:32 | |
| *** markvoelker has quit IRC | 05:33 | |
| *** eumel8 has quit IRC | 05:34 | |
| *** markvoelker has joined #openstack-ansible | 05:34 | |
| *** udesale has quit IRC | 05:35 | |
| *** udesale__ has joined #openstack-ansible | 05:35 | |
| *** jvidal has joined #openstack-ansible | 06:02 | |
| *** chigang has quit IRC | 06:17 | |
| armaan | cloudnull: glance is not working, service unavailable http 503 | 06:23 |
| *** thorst_afk has joined #openstack-ansible | 06:28 | |
| *** thorst_afk has quit IRC | 06:32 | |
| *** pcaruana has joined #openstack-ansible | 06:36 | |
| *** gkadam_ has joined #openstack-ansible | 06:45 | |
| *** gkadam has quit IRC | 06:47 | |
| *** dmsimard has quit IRC | 06:50 | |
| *** drifterza has joined #openstack-ansible | 06:51 | |
| *** eumel8 has joined #openstack-ansible | 07:01 | |
| *** armaan has quit IRC | 07:06 | |
| *** sxc731 has joined #openstack-ansible | 07:08 | |
| openstackgerrit | lidong proposed openstack/openstack-ansible-os_watcher master: Update links in README https://review.openstack.org/498338 | 07:11 |
| *** armaan has joined #openstack-ansible | 07:12 | |
| *** andreas_s has joined #openstack-ansible | 07:14 | |
| *** dmsimard has joined #openstack-ansible | 07:19 | |
| openstackgerrit | lidong proposed openstack/openstack-ansible-os_glance master: Replace http with https for doc links in openstack-ansible-os_glance https://review.openstack.org/498345 | 07:24 |
| *** chas has joined #openstack-ansible | 07:25 | |
| *** markus_z has joined #openstack-ansible | 07:37 | |
| *** mbuil has joined #openstack-ansible | 07:49 | |
| *** mrch has joined #openstack-ansible | 07:53 | |
| openstackgerrit | Hengqing Hu proposed openstack/openstack-ansible-os_octavia master: Add blank line to avoid malformed jinja2 template https://review.openstack.org/498354 | 07:53 |
| *** coolkil has joined #openstack-ansible | 08:11 | |
| *** zcourts has joined #openstack-ansible | 08:28 | |
| *** thorst_afk has joined #openstack-ansible | 08:30 | |
| openstackgerrit | lidong proposed openstack/openstack-ansible-os_glance master: Replace http with https for doc links https://review.openstack.org/498345 | 08:30 |
| MasterofJOKers | I think I found a bug in the pip_install role. There are multiple tasks that are supposed to run when "user_external_repo_key is not defined". Afaics, that variable is no longer in use since 6dd2d44b022, so the check doesn't work as expected. | 08:33 |
| *** thorst_afk has quit IRC | 08:34 | |
| MasterofJOKers | It should probably check for user_external_repo_keys_list to be empty | 08:34 |
| *** armaan has quit IRC | 08:53 | |
| *** armaan has joined #openstack-ansible | 08:53 | |
| *** armaan has quit IRC | 08:58 | |
| *** armaan has joined #openstack-ansible | 09:00 | |
| *** fxpester has joined #openstack-ansible | 09:01 | |
| openstackgerrit | Manuel Buil proposed openstack/openstack-ansible master: Modify tacker port in haproxy config https://review.openstack.org/498382 | 09:02 |
| *** zcourts has quit IRC | 09:06 | |
| *** zcourts has joined #openstack-ansible | 09:06 | |
| *** chigang_ has joined #openstack-ansible | 09:13 | |
| *** markvoelker has quit IRC | 09:15 | |
| *** thorst_afk has joined #openstack-ansible | 09:30 | |
| *** chas has quit IRC | 09:33 | |
| *** thorst_afk has quit IRC | 09:35 | |
| *** yifei has quit IRC | 09:40 | |
| *** zcourts_ has joined #openstack-ansible | 09:45 | |
| *** zcourts has quit IRC | 09:46 | |
| Tahvok | Any chance there will be a new release for ocata? There are several bugs that affect our deployment that were fixed, but since there was no release I don't have this fixes.. | 09:49 |
| *** vnogin has joined #openstack-ansible | 09:49 | |
| coolkil | can someone tel me how i can upload a new patch set from a diffrent computer? i want to update https://review.openstack.org/#/c/479844/ but im working from a diffrent pc | 10:21 |
| coolkil | or should i just abbandon that change and upload a new one? | 10:23 |
| *** armaan has quit IRC | 10:28 | |
| *** armaan has joined #openstack-ansible | 10:30 | |
| eumel8 | coolkil: on the right corner on the review website is a download button. Behind that are links for checkout/fetch/etc. | 10:30 |
| *** thorst_afk has joined #openstack-ansible | 10:31 | |
| coolkil | thnx!! | 10:33 |
| *** thorst_afk has quit IRC | 10:36 | |
| *** hw_wutianwei has quit IRC | 10:38 | |
| *** sxc731 has quit IRC | 10:45 | |
| *** zcourts_ has quit IRC | 10:50 | |
| *** zcourts has joined #openstack-ansible | 10:51 | |
| *** jamielennox has quit IRC | 10:51 | |
| *** jamielennox has joined #openstack-ansible | 10:52 | |
| openstackgerrit | Michael Davies proposed openstack/openstack-ansible master: Fix os-cmd cross-distro compatibility https://review.openstack.org/498421 | 11:00 |
| *** zcourts_ has joined #openstack-ansible | 11:01 | |
| *** sxc731 has joined #openstack-ansible | 11:01 | |
| *** mrda has joined #openstack-ansible | 11:02 | |
| *** drifterza has quit IRC | 11:03 | |
| *** drifterza has joined #openstack-ansible | 11:04 | |
| *** zcourts has quit IRC | 11:05 | |
| *** chas has joined #openstack-ansible | 11:12 | |
| *** markvoelker has joined #openstack-ansible | 11:15 | |
| *** armaan has quit IRC | 11:25 | |
| *** udesale has joined #openstack-ansible | 11:31 | |
| *** dave-mccowan has joined #openstack-ansible | 11:32 | |
| *** szaher has quit IRC | 11:32 | |
| *** thorst_afk has joined #openstack-ansible | 11:33 | |
| *** sxc731 has quit IRC | 11:33 | |
| *** udesale__ has quit IRC | 11:33 | |
| *** sxc731 has joined #openstack-ansible | 11:35 | |
| *** szaher has joined #openstack-ansible | 11:36 | |
| *** armaan has joined #openstack-ansible | 11:37 | |
| *** thorst_afk has quit IRC | 11:40 | |
| mhayden | happy monday | 11:41 |
| eumel8 | happy monday, how was the weather? | 11:42 |
| *** chas has quit IRC | 11:43 | |
| *** markvoelker has quit IRC | 11:50 | |
| mhayden | it was windy/rainy in san antonio, but the coast and houston were much worse | 11:53 |
| mhayden | houston has it really bad at the moment -- if anyone feels inclined to contribute money, that's where it's most needed. | 11:54 |
| *** sxc731 has quit IRC | 11:54 | |
| *** armaan has quit IRC | 11:56 | |
| eumel8 | yes, there a some horror pictures on the net and tv | 11:56 |
| *** armaan has joined #openstack-ansible | 11:56 | |
| *** udesale has quit IRC | 12:03 | |
| openstackgerrit | Chris Beukers proposed openstack/openstack-ansible-os_nova master: [WIP] adding nova-serialconsole support https://review.openstack.org/479844 | 12:15 |
| *** armaan has quit IRC | 12:17 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client stable/newton: Remove duplicate package pinning variable https://review.openstack.org/498159 | 12:17 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client stable/ocata: Remove duplicate package pinning variable https://review.openstack.org/498158 | 12:19 |
| mhayden | i have family that lives on the west side of houston and they've been okay so far, but they saw water *coming upwards* out of their front yard | 12:20 |
| mhayden | that has to be creepy | 12:20 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client stable/pike: Remove duplicate package pinning variable https://review.openstack.org/498157 | 12:20 |
| openstackgerrit | Merged openstack/ansible-hardening stable/newton: Updated from OpenStack Ansible Tests https://review.openstack.org/497873 | 12:23 |
| openstackgerrit | Merged openstack/ansible-hardening stable/newton: Change default prohibit root sshd password auth https://review.openstack.org/494524 | 12:23 |
| *** gouthamr has quit IRC | 12:24 | |
| *** japestinho has joined #openstack-ansible | 12:25 | |
| eumel8 | we had the same some weeks ago: http://www.maz-online.de/Brandenburg/Land-unter-in-Brandenburg | 12:25 |
| *** jafeha has joined #openstack-ansible | 12:26 | |
| eumel8 | but it was "only" rain - without storm or hurricane | 12:26 |
| *** thorst_afk has joined #openstack-ansible | 12:30 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/newton: Remove duplicate package pinning variable https://review.openstack.org/498162 | 12:30 |
| openstackgerrit | Major Hayden proposed openstack/ansible-hardening master: Fedora 26 support https://review.openstack.org/497975 | 12:33 |
| *** dave-mccowan has quit IRC | 12:38 | |
| *** gouthamr has joined #openstack-ansible | 12:45 | |
| *** dave-mccowan has joined #openstack-ansible | 12:49 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/ocata: Remove duplicate package pinning variable https://review.openstack.org/498161 | 12:54 |
| mgariepy | morning everyone | 12:55 |
| cloudnull | mornings all | 12:57 |
| cloudnull | armaan did you get glance working ? | 12:57 |
| cloudnull | MasterofJOKers: ++ can you raise an issue for that? | 12:58 |
| *** eumel8 is now known as eumel8_away | 12:58 | |
| *** markvoelker has joined #openstack-ansible | 13:01 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops stable/pike: Updated from global requirements https://review.openstack.org/498174 | 13:03 |
| *** gkadam_ has quit IRC | 13:04 | |
| *** armaan has joined #openstack-ansible | 13:04 | |
| *** lucasxu has joined #openstack-ansible | 13:05 | |
| *** esberglu has joined #openstack-ansible | 13:06 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_watcher master: Update links in README https://review.openstack.org/498338 | 13:06 |
| mhayden | eumel8_away: yikes, that doesn't look fun | 13:17 |
| *** esberglu has quit IRC | 13:22 | |
| *** esberglu has joined #openstack-ansible | 13:22 | |
| *** esberglu has quit IRC | 13:23 | |
| *** esberglu has joined #openstack-ansible | 13:23 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_zaqar stable/pike: Updated from global requirements https://review.openstack.org/498176 | 13:25 |
| *** esberglu has quit IRC | 13:27 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Add pre- and post- stage hooks to leap redeploy process https://review.openstack.org/498167 | 13:33 |
| *** esberglu has joined #openstack-ansible | 13:38 | |
| *** markvoelker has quit IRC | 13:40 | |
| *** lbragstad has joined #openstack-ansible | 13:42 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/pike: Updated from global requirements https://review.openstack.org/498177 | 13:46 |
| openstackgerrit | Merged openstack/openstack-ansible-tests stable/pike: Check for lxc-ls/paths before collecting logs https://review.openstack.org/498186 | 13:46 |
| openstackgerrit | Major Hayden proposed openstack/ansible-hardening master: Fix AppArmor idempotency https://review.openstack.org/498468 | 13:51 |
| *** eumel8 has joined #openstack-ansible | 13:53 | |
| *** drifterza has quit IRC | 13:54 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/pike: Set serial to 100% for nova_compute https://review.openstack.org/498184 | 13:57 |
| openstackgerrit | Merged openstack/openstack-ansible-os_monasca master: Updated from global requirements https://review.openstack.org/495230 | 14:02 |
| openstackgerrit | Marc Gariépy (mgariepy) proposed openstack/openstack-ansible stable/ocata: Remove global pin for ldappool https://review.openstack.org/479913 | 14:04 |
| openstackgerrit | Merged openstack/openstack-ansible master: playbooks: os-lxc-container-setup: Force kill a container on openSUSE if it takes too long to stop https://review.openstack.org/498146 | 14:14 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest stable/ocata: Add testscenarios to tempest venv https://review.openstack.org/498165 | 14:15 |
| *** sxc731 has joined #openstack-ansible | 14:15 | |
| *** weezS has joined #openstack-ansible | 14:25 | |
| *** sxc731 has quit IRC | 14:33 | |
| *** vnogin has quit IRC | 14:35 | |
| *** vnogin has joined #openstack-ansible | 14:36 | |
| firebat | Morning gents. Do any of you know how large the galera cluster will grow with normal operation? It should stay relatively small right? (This is for a dev environment maybe 30-40 users) | 14:36 |
| cloudnull | it shouldn't grow that large. | 14:38 |
| cloudnull | the biggest write is normally keystone tokens and nova instances. by default we use fernet tokens so that only leaves nova instances | 14:38 |
| firebat | So if I've got 120gb of space for it that should be fine? I was thinking it shouldn't grow too much | 14:38 |
| mgariepy | the biggest db is usually nova. | 14:39 |
| cloudnull | ++ | 14:39 |
| eumel8 | depends more on the count of VMs, not user | 14:40 |
| mgariepy | and it really depends on what your user are doing, if they start vms with 20M of cloud-init script and run them for 20 minnutes day-in and day-out it will grow faster. | 14:40 |
| firebat | Hmmm | 14:41 |
| firebat | I've got 3 total compute nodes for this system so far which can each run about 32 VMs... I'm thinking I'll be sub 300 instances all said and done | 14:41 |
| firebat | Are you guys going san for this stuff? I can do that too | 14:42 |
| *** sxc731 has joined #openstack-ansible | 14:42 | |
| firebat | and resizing would be easier then | 14:42 |
| openstackgerrit | Major Hayden proposed openstack/ansible-hardening master: Fix AppArmor idempotency https://review.openstack.org/498468 | 14:42 |
| eumel8 | I think this would be a little bit of oversized :) | 14:43 |
| eumel8 | 120 GB is more then enough | 14:45 |
| mgariepy | I run a 36 nodes hypervisor cluster, and my nova db is about 8gb. for a ~~3y run. | 14:47 |
| mgariepy | with a couple users booting instance, crunching data for a few hours and then deleting them. and starting over. | 14:48 |
| mgariepy | so 120gb should be enough indeedl. | 14:48 |
| *** dxiri has joined #openstack-ansible | 14:48 | |
| *** sxc731 has quit IRC | 14:54 | |
| *** chyka has joined #openstack-ansible | 14:55 | |
| firebat | Alright cool thanks guys, and thanks for the real numbers! | 14:59 |
| *** hw_wutianwei has joined #openstack-ansible | 15:01 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Ensure nova knows online migrations are required https://review.openstack.org/498488 | 15:02 |
| *** sxc731 has joined #openstack-ansible | 15:02 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Ensure nova knows online migrations are required https://review.openstack.org/498488 | 15:04 |
| *** trevormc has joined #openstack-ansible | 15:05 | |
| *** weezS has quit IRC | 15:07 | |
| *** vikrant has joined #openstack-ansible | 15:12 | |
| *** jvidal has quit IRC | 15:15 | |
| openstackgerrit | Merged openstack/openstack-ansible master: tests: bootstrap-host: Add SUSE support in the RedHat network scripts https://review.openstack.org/498198 | 15:18 |
| *** eumel8 has quit IRC | 15:19 | |
| *** coolkil has quit IRC | 15:20 | |
| *** trevormc has left #openstack-ansible | 15:20 | |
| *** eumel8 has joined #openstack-ansible | 15:20 | |
| *** Donckers has joined #openstack-ansible | 15:22 | |
| *** trevormc has joined #openstack-ansible | 15:24 | |
| *** japestinho has quit IRC | 15:25 | |
| *** sxc731 has quit IRC | 15:28 | |
| *** jvidal has joined #openstack-ansible | 15:30 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Declare openSUSE Leap 42.X support as WIP https://review.openstack.org/495880 | 15:32 |
| *** chas has joined #openstack-ansible | 15:33 | |
| *** hw_wutianwei has quit IRC | 15:35 | |
| *** chas has quit IRC | 15:35 | |
| *** eumel8 has quit IRC | 15:39 | |
| *** eumel8 has joined #openstack-ansible | 15:39 | |
| *** dxiri has quit IRC | 15:40 | |
| *** dxiri has joined #openstack-ansible | 15:40 | |
| *** markus_z has quit IRC | 15:41 | |
| *** eumel8 has quit IRC | 15:44 | |
| *** dxiri has quit IRC | 15:44 | |
| *** mxevgenis has joined #openstack-ansible | 15:45 | |
| *** eumel8 has joined #openstack-ansible | 15:45 | |
| mxevgenis | hi everyone! is there anybody who has enable the trove service in an OSA Deployment? | 15:45 |
| *** weezS has joined #openstack-ansible | 15:47 | |
| *** pcaruana has quit IRC | 15:47 | |
| cloudnull | we've had a few, but IDK if those folks are around today? | 15:48 |
| eumel8 | mxevgenis: there is an additional role os_trove and a remark in the doc: https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/configure.html#installing-additional-services | 15:48 |
| cloudnull | today is a UK bank holiday, so a good many of our people are not around. | 15:49 |
| *** woodard has joined #openstack-ansible | 15:49 | |
| eumel8 | hahaha, good for the UKs :) | 15:49 |
| mxevgenis | i had no problem with enabling the service. the problem is that the datastore section remains empty after the installation | 15:51 |
| mxevgenis | thats a problem because i cannot launch a trove instance | 15:51 |
| *** armaan has quit IRC | 15:51 | |
| mxevgenis | do you have any idea about that problem? | 15:51 |
| dmsimard | andymccr: you still have that liberasure issue on ocata RDO right ? | 15:51 |
| mxevgenis | sorry but i am not informed about that issue! i am new to comunity | 15:52 |
| *** vnogin has quit IRC | 15:56 | |
| eumel8 | mxevgenis: you have trove images already installed? | 15:57 |
| mxevgenis | no i have not should i first download trove images into glance? | 15:58 |
| *** sxc731 has joined #openstack-ansible | 15:58 | |
| *** dxiri has joined #openstack-ansible | 16:00 | |
| eumel8 | there are some information: https://docs.openstack.org/openstack-ansible-os_trove/latest/configure-trove.html#building-trove-images | 16:00 |
| mxevgenis | thank you very much for your help | 16:01 |
| eumel8 | you're welcome | 16:02 |
| *** andreas_s has quit IRC | 16:07 | |
| *** mrch has quit IRC | 16:07 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Fix LXC container start order https://review.openstack.org/497721 | 16:12 |
| *** trevormc has left #openstack-ansible | 16:12 | |
| *** marc_ab has joined #openstack-ansible | 16:23 | |
| *** perniciouscaffei has quit IRC | 16:36 | |
| *** palendae has joined #openstack-ansible | 16:37 | |
| *** weezS has quit IRC | 16:40 | |
| *** jvidal has quit IRC | 16:45 | |
| *** woodard_ has joined #openstack-ansible | 16:50 | |
| *** woodard has quit IRC | 16:52 | |
| *** mxevgenis has quit IRC | 16:56 | |
| *** mbuil has quit IRC | 17:00 | |
| *** perniciouscaffei has joined #openstack-ansible | 17:11 | |
| *** armaan has joined #openstack-ansible | 17:12 | |
| *** vikrant has quit IRC | 17:18 | |
| *** dxiri has quit IRC | 17:37 | |
| *** dxiri has joined #openstack-ansible | 17:37 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Optimize CentOS Erlang installation https://review.openstack.org/496376 | 17:40 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-rabbitmq_server master: Upgrade to RabbitMQ 3.6.11 https://review.openstack.org/496801 | 17:40 |
| *** Alex__ has joined #openstack-ansible | 17:40 | |
| *** dxiri has quit IRC | 17:41 | |
| Alex__ | hi, is this a bug? https://github.com/openstack/openstack-ansible/blob/14.2.8/scripts/upgrade-utilities/scripts/migrate_openstack_vars.py#L68 says NEWTON, but I think it should say MIKATA. upgrading from mikata -> newton is failing in deploy-config-changes.yml | 17:42 |
| Alex__ | fails with: [Errno 2] No such file or directory: '/etc/openstack_deploy.NEWTON/VARS_MIGRATED_user_secrets | 17:42 |
| Alex__ | in Update OpenStack variable names task | 17:42 |
| Alex__ | (MITAKA not MIKATA). =) | 17:50 |
| *** sxc731 has quit IRC | 17:50 | |
| *** jwitko has joined #openstack-ansible | 17:53 | |
| openstackgerrit | melissaml proposed openstack/openstack-ansible master: Fix to use "." to source script files https://review.openstack.org/498548 | 17:53 |
| *** eumel8 has quit IRC | 17:54 | |
| *** eumel8 has joined #openstack-ansible | 17:55 | |
| *** zcourts_ has quit IRC | 17:58 | |
| *** zcourts has joined #openstack-ansible | 17:58 | |
| *** armaan_ has joined #openstack-ansible | 17:58 | |
| *** poopcat has joined #openstack-ansible | 18:00 | |
| *** armaan has quit IRC | 18:02 | |
| cloudnull | Alex__: quite likely a bug | 18:02 |
| firebat | Do you guys have any tips/tricks for debugging lxc failures? About 4-5 of my containers are failing to be created... I thought it was because I was running out of drive space, but I've fixed that issue and they're still failing | 18:03 |
| cloudnull | Alex__: well , maybe not | 18:03 |
| cloudnull | https://github.com/openstack/openstack-ansible/blob/13.1.1/scripts/upgrade-utilities/scripts/migrate_openstack_vars.py#L68 | 18:03 |
| cloudnull | from mitaka | 18:04 |
| cloudnull | are they failing to be created or start ? | 18:04 |
| *** albertcard1 has joined #openstack-ansible | 18:05 | |
| firebat | Failing to be created cloudnull and I'm on ocata... here's my paste: https://pastebin.com/VGE1Rmhz | 18:05 |
| Alex__ | cloudnull: I don't see any /etc/openstack_deploy.NEWTON dir created, only /etc/openstack_deploy is copied to /etc/openstack_deploy.MITAKA | 18:05 |
| Alex__ | as per: https://github.com/openstack/openstack-ansible/blob/13.1.1/scripts/upgrade-utilities/playbooks/deploy-config-changes.yml#L39 | 18:05 |
| Alex__ | I don't see where /etc/openstack_deploy.NEWTON would ever get created | 18:05 |
| Alex__ | but your right.. liberty->mitaka worked fine with that code.. | 18:05 |
| Alex__ | so strange. =) | 18:05 |
| *** poopcat has quit IRC | 18:07 | |
| Alex__ | sorry i mean here - https://github.com/openstack/openstack-ansible/blob/14.2.8/scripts/upgrade-utilities/playbooks/deploy-config-changes.yml#L62 - this playbook copies your current dir to dir.MITAKA | 18:07 |
| cloudnull | firebat: can you run `/usr/bin/lxc-create --name LXC_NAME --quiet --template download --bdev dir -- --dist ubuntu --release xenial --arch amd64 --force-cache --server images.linuxcontainers.org --variant default --keyserver hkp://p80.pool.sks-keyservers.net:80` on the failing node and see if that works by itself ? | 18:07 |
| firebat | Trying to now | 18:08 |
| firebat | Ok that worked | 18:08 |
| cloudnull | Alex__: the .NEWTON dir is created here https://github.com/openstack/openstack-ansible/blob/stable/newton/scripts/upgrade-utilities/playbooks/deploy-config-changes.yml#L29 | 18:09 |
| cloudnull | at least it should be | 18:09 |
| cloudnull | firebat: can you rerun lxc-container-create.yml with a limit of just the failing host? | 18:10 |
| Alex__ | cloudnull: source_series is mitaka: https://github.com/openstack/openstack-ansible/blob/stable/newton/scripts/upgrade-utilities/playbooks/deploy-config-changes.yml#L24 | 18:10 |
| cloudnull | openstack-ansible lxc-container-create.yml --limit $HOSTNAME | 18:10 |
| cloudnull | just to see if maybe it was a transient error? | 18:10 |
| cloudnull | maybe the keyserver was unreachable ? | 18:10 |
| cloudnull | Alex__: so that looks like a bug | 18:11 |
| cloudnull | :D | 18:11 |
| armaan_ | Alex__: https://bugs.launchpad.net/openstack-ansible/+bug/1711335 | 18:11 |
| openstack | Launchpad bug 1711335 in openstack-ansible "Playbook fails to create required directory" [Undecided,New] | 18:11 |
| cloudnull | scratch that | 18:12 |
| cloudnull | https://github.com/openstack/openstack-ansible/blob/13.3.18/scripts/upgrade-utilities/playbooks/deploy-config-changes.yml | 18:12 |
| cloudnull | its following the same pattern | 18:12 |
| firebat | Yeah it's weird because it keeps failing on me every time no matter what | 18:12 |
| cloudnull | does it work if you create that dir? | 18:14 |
| firebat | cloudnull You talking to me? Seems like the same 4 containers fail every time | 18:20 |
| Alex__ | cloudnull: for my issue, I updated 1711335 bug, same issue I hit.. can't explain why same pattern worked on liberty->mitaka though.. appreciate a second set of eyes on it! =) | 18:21 |
| *** weezS has joined #openstack-ansible | 18:23 | |
| openstackgerrit | Marc Gariépy (mgariepy) proposed openstack/openstack-ansible stable/newton: Since upstream is now fixed. https://review.openstack.org/498556 | 18:28 |
| *** palendae has left #openstack-ansible | 18:28 | |
| openstackgerrit | Marc Gariépy (mgariepy) proposed openstack/openstack-ansible stable/newton: Remove global pin for ldappool https://review.openstack.org/498556 | 18:29 |
| *** dxiri has joined #openstack-ansible | 18:37 | |
| *** dxiri has quit IRC | 18:37 | |
| *** dxiri has joined #openstack-ansible | 18:37 | |
| Alex__ | working on mitaka->neutron upgrade, ran setup-hosts, and containers restart, everything is good, but lbaasv2 don't start up automatically.. had this issue as well in liberty->mitaka, and ended up dropping + recreating them.. anyone seen this before? thoughts on what controls lbaas to start up? | 18:41 |
| *** vnogin has joined #openstack-ansible | 18:41 | |
| Alex__ | scratch that, just took 2 min to start up.. | 18:45 |
| Alex__ | paranoid from liberty->mitaka upgrade where they never came up =) | 18:45 |
| *** mwynne has quit IRC | 18:51 | |
| *** mwynne has joined #openstack-ansible | 18:52 | |
| cloudnull | sorry was eating | 19:00 |
| cloudnull | firebat: can you reduce the forks | 19:01 |
| cloudnull | and run again | 19:01 |
| cloudnull | I wonder if your hitting an issue with too many tasks on a signle host ? | 19:01 |
| cloudnull | also which 4 containers are failing? | 19:01 |
| cloudnull | Alex__: did you get past that upgrade step ? | 19:01 |
| Alex__ | yup, thanks! hit a new one though. =) repo_build_prepare.yml fails on Initialize local facts with: | 19:04 |
| Alex__ | Unable to look up a name or access an attribute in template string ({% if ('ansible_local' is not defined) or ('openstack_ansible' not in ansible_local) or ('repo_build' not in ansible_local['openstack_ansible']) or ('need_wheel_build' not in ansible_local['openstack_ansible']['repo_build']) %} True {% else %} False {% endif %}).\nMake sure your variable name does not contain invalid characters like '-': argument of type | 19:04 |
| openstackgerrit | Matt Thompson proposed openstack/openstack-ansible-ops master: Create /root/.tmux.conf if it does not exist https://review.openstack.org/498570 | 19:04 |
| Alex__ | code is here: https://git.openstack.org/cgit/openstack/openstack-ansible-repo_build/tree/tasks/repo_build_prepare.yml#n16 | 19:08 |
| cloudnull | Alex__: likely due to uninitialized facts? | 19:09 |
| Alex__ | how can i check or reinit? =) | 19:09 |
| cloudnull | if you run `ansible -m setup repo_all` and then the repo-install.yml playbook does it get past that? | 19:10 |
| Alex__ | checking.. i do see facts in /etc/openstack_deploy/ansible_facts/ for repo1/repo2.. but will try above | 19:11 |
| cloudnull | you can always remove all facts from that dir if we think maybe they've been poisoned. | 19:12 |
| *** jwitko has quit IRC | 19:13 | |
| Alex__ | cloudnull: running setup seemed to have fixed it, it's passed that point now. | 19:16 |
| *** chyka_ has joined #openstack-ansible | 19:17 | |
| *** marst has joined #openstack-ansible | 19:18 | |
| *** chyka has quit IRC | 19:20 | |
| *** armaan has joined #openstack-ansible | 19:30 | |
| *** chyka_ has quit IRC | 19:31 | |
| *** armaan_ has quit IRC | 19:33 | |
| cloudnull | great ! | 19:36 |
| kysse | what?! | 19:38 |
| *** sxc731 has joined #openstack-ansible | 19:39 | |
| cloudnull | who? | 19:42 |
| cloudnull | o/ kysse | 19:42 |
| kysse | where?! | 19:46 |
| cloudnull | 3rd base | 19:46 |
| kysse | when?! | 19:47 |
| cloudnull | When he bunts the ball | 19:50 |
| *** vnogin has quit IRC | 19:51 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Fix os-cmd cross-distro compatibility https://review.openstack.org/498421 | 19:51 |
| *** chyka has joined #openstack-ansible | 19:51 | |
| armaan | Alex__: https://bugs.launchpad.net/openstack-ansible/+bug/1711340 | 19:52 |
| openstack | Launchpad bug 1711340 in openstack-ansible "wheel build fails during upgrade" [Medium,Fix released] - Assigned to Jesse Pretorius (jesse-pretorius) | 19:52 |
| firebat | cloudnull: Sorry was away working on stuff... I need to change the lxc dir I should be able to override those variables in my user_variables.yml right? | 19:52 |
| kysse | so It's 22minutes until president of Finland and Mr. Trump holds a press conference together | 19:53 |
| kysse | I'm excited | 19:53 |
| *** armaan has quit IRC | 19:54 | |
| *** chyka has quit IRC | 19:56 | |
| *** vnogin has joined #openstack-ansible | 20:01 | |
| cloudnull | oh should be exciting ! | 20:12 |
| kysse | yep, starts in 3min. There should be livestream somewhere. | 20:12 |
| Alex__ | armaan: thanks! | 20:13 |
| firebat | Changing these variables should move my lxc from /var/lib right? lxc_container_directory: "/var/lib/lxc" lxc_container_cache_path: "/var/cache/lxc" lxc_container_log_path: "/var/log/lxc" | 20:15 |
| cloudnull | firebat: yes it should. though I remember some hard coded pathing in LXC itself making it difficult to more the container directories. | 20:29 |
| cloudnull | IDK if that's still a problem | 20:29 |
| cloudnull | I've not tried in a VERY long time | 20:29 |
| cloudnull | if cores are around today | 20:30 |
| cloudnull | https://review.openstack.org/#/c/497721/ | 20:30 |
| cloudnull | that would be a good one to get back sooner rather than later | 20:30 |
| firebat | cloudnull: Yeah I changed my configs, and it doesn't seem to work | 20:32 |
| firebat | Would it F my system up if I create a link at /var/lib/lxc to the /openstack directory I've made? | 20:32 |
| cloudnull | idk | 20:33 |
| cloudnull | i mean it should work ? | 20:33 |
| firebat | haha | 20:33 |
| openstackgerrit | Bjoern Teipel proposed openstack/openstack-ansible-ops master: Allow for undefined hooks https://review.openstack.org/498590 | 20:33 |
| cloudnull | i mean its nothing that you couldn't revert if you had to | 20:33 |
| *** chyka has joined #openstack-ansible | 20:45 | |
| *** chyka has quit IRC | 20:46 | |
| *** lucasxu has quit IRC | 20:46 | |
| *** chyka has joined #openstack-ansible | 20:46 | |
| *** eumel8 has quit IRC | 20:47 | |
| firebat | cloudnull Now it's complaining that it is a symbolic link | 20:57 |
| firebat | When setting up base dirs | 20:57 |
| cloudnull | maybe use a bind mount ? | 21:03 |
| *** albertcard1 is now known as albertcard | 21:07 | |
| *** albertcard is now known as poopcat | 21:07 | |
| *** woodard has joined #openstack-ansible | 21:08 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/ocata: Update all SHAs for 15.1.9 https://review.openstack.org/497791 | 21:09 |
| *** vnogin has quit IRC | 21:10 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/newton: Update all SHAs for 14.2.9 https://review.openstack.org/497797 | 21:10 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops stable/pike: delete the leap tools https://review.openstack.org/498601 | 21:11 |
| *** woodard_ has quit IRC | 21:12 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops stable/ocata: delete the leap tools https://review.openstack.org/498602 | 21:12 |
| *** woodard has quit IRC | 21:13 | |
| *** gouthamr has quit IRC | 21:23 | |
| *** thorst_afk has quit IRC | 21:32 | |
| *** sxc731 has quit IRC | 21:35 | |
| *** thorst_afk has joined #openstack-ansible | 21:35 | |
| *** aludwar has quit IRC | 21:37 | |
| *** aludwar has joined #openstack-ansible | 21:37 | |
| *** thorst_afk has quit IRC | 21:40 | |
| Alex__ | anyone seen this on mitaka->newton? haproxy horizon config is not correct... https://pastebin.com/Y17KmUX5 - can see x.y.z.10:443 is sending it to "default_backend horizon-back" not the horizon ssl backend.. so get an infinite 301 loop | 21:41 |
| Alex__ | config problem on my end, or anyone seen this before? as far as i can see, don't have any special horizon_ssl or haproxy_ssl settings.. | 21:41 |
| Alex__ | hmm, looks like haproxy.cfg is generated from files in /etc/haproxy/conf.d/ (where they used to be in earlier versions).. i removed all, reran haproxy, and now the second ansible block is gone, but still no go as we have 443 sending to horizon:80 | 21:50 |
| Alex__ | so why is https://github.com/openstack/openstack-ansible/blob/14.2.7/playbooks/vars/configs/haproxy_config.yml#L171 set to port 80? shouldn't this be 443? otherwise haproxy accepts https (443) requests, and sends http (80) to horizon which 301's saying it needs https | 21:54 |
| *** chyka_ has joined #openstack-ansible | 22:04 | |
| *** woodard has joined #openstack-ansible | 22:07 | |
| *** chyka has quit IRC | 22:08 | |
| *** esberglu has quit IRC | 22:09 | |
| *** esberglu has joined #openstack-ansible | 22:10 | |
| *** esberglu has quit IRC | 22:10 | |
| Alex__ | i might be jumping the gun as os-horizon.yml hasn't run yet, so maybe upgraded horizon doesn't enforce ssl. will confirm | 22:20 |
| *** perniciouscaffei has quit IRC | 22:23 | |
| *** weezS has quit IRC | 22:23 | |
| *** perniciouscaffei has joined #openstack-ansible | 22:24 | |
| *** esberglu has joined #openstack-ansible | 22:28 | |
| *** marst has quit IRC | 22:31 | |
| *** esberglu has quit IRC | 22:33 | |
| *** markvoelker has joined #openstack-ansible | 22:42 | |
| Alex__ | ok, ignore me. =) after upgrading horizon to newton, it's working again as horizon now runs on port 80 instead of 443 (seems odd, but working, ssl from end user to haproxy) | 22:42 |
| *** esberglu has joined #openstack-ansible | 22:49 | |
| *** Donckers has quit IRC | 22:53 | |
| *** Donckers has joined #openstack-ansible | 22:53 | |
| *** Donckers has quit IRC | 22:54 | |
| *** esberglu has quit IRC | 23:15 | |
| cloudnull | Alex__: sorry was afk, its all working now? | 23:17 |
| Alex__ | yup! all working, now on newton. =) | 23:20 |
| cloudnull | sweet! | 23:20 |
| cloudnull | was it all miserable ? | 23:20 |
| cloudnull | anything that we can add to newton to make that upgrade better? | 23:21 |
| * cloudnull i guess I could go back through our chats here | 23:21 | |
| *** weezS has joined #openstack-ansible | 23:23 | |
| Alex__ | heh, no, it was pretty good.. easier then liberty -> mitaka (mainly due to migration of lbaasv2), had a few oddities, but nothing major | 23:23 |
| Alex__ | most were already in bug reports.. and some specific to the install (i.e. we were using openstack hardening as separate project, and i see newton roled that in, so had to merge things in | 23:24 |
| Alex__ | all in all, so much better then trying to manage os manually. =) | 23:24 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Create /root/.tmux.conf if it does not exist https://review.openstack.org/498570 | 23:31 |
| *** chyka_ has quit IRC | 23:34 | |
| *** chyka has joined #openstack-ansible | 23:35 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest stable/newton: Add ironic plugin tests https://review.openstack.org/497951 | 23:36 |
| cloudnull | nice ! | 23:36 |
| cloudnull | good to hear its all online now :D | 23:37 |
| cloudnull | now time to migration 14.04 to 16.04 and upgrade to ocata :D | 23:37 |
| cloudnull | hahaha | 23:37 |
| *** chyka has quit IRC | 23:39 | |
| *** weezS_ has joined #openstack-ansible | 23:44 | |
| *** weezS has quit IRC | 23:45 | |
| *** weezS_ is now known as weezS | 23:45 | |
| *** markvoelker has quit IRC | 23:46 | |
| Alex__ | cloudnull: is 16.04 required for ocata? | 23:52 |
| Alex__ | we were planning on moving to ocata. =) would be good to get on 16.06, are there upgrade steps outlined anywhere for best practices? | 23:53 |
| *** gouthamr has joined #openstack-ansible | 23:54 | |
| prometheanfire | iirc 16.04 is planed to be talked about at the ptg | 23:56 |
| prometheanfire | 14.04 -> 16.04 that is | 23:56 |
| prometheanfire | 16.04 is req'd for ocata iirc | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!