| *** goldyfruit_ has joined #openstack-ansible | 00:00 | |
| *** markvoelker has quit IRC | 00:02 | |
| *** ansmith has quit IRC | 00:07 | |
| *** devx has quit IRC | 00:14 | |
| *** gyee has quit IRC | 00:14 | |
| *** devx has joined #openstack-ansible | 00:14 | |
| *** nicolasbock has quit IRC | 00:15 | |
| *** brokencycle has quit IRC | 00:36 | |
| *** BjoernT has joined #openstack-ansible | 01:24 | |
| *** macz has quit IRC | 01:36 | |
| *** nicolasbock has joined #openstack-ansible | 01:55 | |
| *** markvoelker has joined #openstack-ansible | 02:03 | |
| *** markvoelker has quit IRC | 02:08 | |
| *** nicolasbock has quit IRC | 02:14 | |
| *** csmart has quit IRC | 02:19 | |
| *** masterpe has quit IRC | 02:19 | |
| *** csmart has joined #openstack-ansible | 02:24 | |
| *** masterpe has joined #openstack-ansible | 02:30 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_murano master: Initial commit to os_murano role https://review.opendev.org/677830 | 02:39 |
|---|---|---|
| *** masterpe has quit IRC | 02:50 | |
| *** sum12 has quit IRC | 02:50 | |
| *** persia has quit IRC | 02:50 | |
| *** nyloc has quit IRC | 02:50 | |
| *** masterpe has joined #openstack-ansible | 02:51 | |
| *** sum12 has joined #openstack-ansible | 02:56 | |
| *** persia has joined #openstack-ansible | 02:56 | |
| *** nyloc has joined #openstack-ansible | 02:56 | |
| *** radeks has quit IRC | 03:00 | |
| *** dave-mccowan has quit IRC | 03:00 | |
| *** BjoernT has quit IRC | 03:06 | |
| *** sum12 has quit IRC | 03:18 | |
| *** persia has quit IRC | 03:18 | |
| *** nyloc has quit IRC | 03:18 | |
| *** sum12 has joined #openstack-ansible | 03:24 | |
| *** persia has joined #openstack-ansible | 03:24 | |
| *** nyloc has joined #openstack-ansible | 03:24 | |
| *** rmcallis has quit IRC | 03:59 | |
| *** macz has joined #openstack-ansible | 04:28 | |
| *** macz has quit IRC | 04:33 | |
| *** udesale has joined #openstack-ansible | 05:01 | |
| *** radeks has joined #openstack-ansible | 05:01 | |
| *** radeks has quit IRC | 05:03 | |
| *** pcaruana has joined #openstack-ansible | 05:16 | |
| *** goldyfruit_ has quit IRC | 05:19 | |
| *** pcaruana has quit IRC | 05:29 | |
| *** sshnaidm|afk is now known as sshnaidm|pto | 05:35 | |
| *** spsurya has joined #openstack-ansible | 05:55 | |
| jrosser | morning | 06:27 |
| *** kopecmartin|off is now known as kopecmartin | 06:31 | |
| jrosser | evrardjp: I have a question about a test patch I made https://review.opendev.org/#/c/682460/ | 06:36 |
| jrosser | the sha change for tempest does not seem to do anything, is that expected? | 06:37 |
| jrosser | I mean there that the change I wanted to pull in from tempest does not seem to happen with the updated sha | 06:39 |
| *** markvoelker has joined #openstack-ansible | 06:47 | |
| *** markvoelker has quit IRC | 06:52 | |
| *** cshen has joined #openstack-ansible | 07:03 | |
| jrosser | dmsimard: we got some py3 going, we can try a newer ara now I think? | 07:06 |
| *** jbadiapa has quit IRC | 07:08 | |
| masterpe | I do a installation with OSA 18.1.8 based on source, when it is building it failes at building the repo at task: | 07:13 |
| masterpe | repo_build : Create OpenStack-Ansible requirement wheels | 07:13 |
| masterpe | It is running the command: | 07:14 |
| masterpe | set -o pipefail; /openstack/venvs/repo-build-undefined/bin/pip wheel --timeout 120 --wheel-dir /tmp/openstack-wheel-output --find-links /var/www/repo/links --find-links /tmp/openstack-wheel-output --constraint /var/www/repo/os-releases/undefined/ubuntu-18.04-x86_64/requirements_constraints.txt --no-binary libvirt-python --index-url https://pypi.python.org/simple --trusted-host pypi.python.org --build | 07:14 |
| masterpe | /tmp/openstack-builder --requirement /var/www/repo/os-releases/undefined/ubuntu-18.04-x86_64/requirements.txt 2>&1 | ts > /var/log/repo/wheel_build.log | 07:14 |
| masterpe | This command fails with the error message: | 07:16 |
| masterpe | Could not satisfy constraints for 'openstack-heat': installation from path or url cannot be constrained to a version | 07:16 |
| ChosSimbaOne | Morning :-) | 07:18 |
| *** ivve has joined #openstack-ansible | 07:21 | |
| *** trident has quit IRC | 07:22 | |
| jrosser | masterpe: https://github.com/pypa/pip/issues/6310 | 07:22 |
| jrosser | I don’t know why you see that though | 07:22 |
| *** jbadiapa has joined #openstack-ansible | 07:24 | |
| *** tosky has joined #openstack-ansible | 07:27 | |
| *** ygk_12345 has joined #openstack-ansible | 07:27 | |
| *** rpittau|afk is now known as rpittau | 07:28 | |
| jrosser | masterpe: actually the “undefined” in the path to the requirements file suggests something has gone wrong | 07:29 |
| *** trident has joined #openstack-ansible | 07:31 | |
| ChosSimbaOne | Hi. I think I am a bit thick skulled, and can't quite graspe the concept of the ext_lb_vip_address. If that should be on an external routed IP, that network should be trunked into the infrastructure host as well right? | 07:32 |
| ChosSimbaOne | and then untagged at some bridge interface so that OSA can add it to the ha-proxy? | 07:32 |
| ChosSimbaOne | I am having a hard time finding documentation for this, it seems a bit like magic to me from the documentation. | 07:33 |
| evrardjp | jrosser: I am not sure this reference would work for pip | 07:36 |
| *** trident has quit IRC | 07:36 | |
| masterpe | jrosser: Didn't seen that. I will look into it. | 07:37 |
| jrosser | evrardjp: this seems a bit misleading that we bump the sha for tempest every time and it's not used | 07:40 |
| jrosser | misleading/confusing | 07:40 |
| *** brokencycle has joined #openstack-ansible | 07:41 | |
| jrosser | is it becasue this is commented out? https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L47 | 07:41 |
| evrardjp | yeah so there are two things in there | 07:41 |
| evrardjp | one is the fact that multiple things can mask | 07:42 |
| evrardjp | and the fact that we masked in tempest in the past | 07:42 |
| evrardjp | I think this is legacy | 07:42 |
| jrosser | so i have a situation where it is necessary to take tempest from git | 07:43 |
| evrardjp | so ... two things: | 07:44 |
| evrardjp | 1) why don't you _merge_ the change in your own repo, and point to it? That would prevent the review.openstack refs/ formatted url for pip, so that would work | 07:44 |
| evrardjp | 2) shouldn't we revert the tempest role to use our defaults again? | 07:45 |
| jrosser | for keytstone? thats working | 07:45 |
| evrardjp | It was due to a a problem | 07:45 |
| evrardjp | oh that's interesting | 07:45 |
| evrardjp | it used to not work | 07:45 |
| jrosser | i wanted to test an as-yet unmerged patch to keystone and that did the right thing | 07:45 |
| evrardjp | ok | 07:46 |
| jrosser | but that patch is requiring updated tempest, else tempest fails | 07:46 |
| *** trident has joined #openstack-ansible | 07:46 | |
| evrardjp | could you update the tempest role to make sure it uses defaults ? | 07:46 |
| evrardjp | it was due to a problem of upgrades IIRC, but with the fact we cahnged repo build I am not sure this is required anymore | 07:47 |
| jrosser | is that just uncommenting https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L47 ? | 07:47 |
| evrardjp | not really sure if this is using the same as the other roles (python_venv_build) | 07:49 |
| evrardjp | I think it would be also possible to remove tempest from those defaults files | 07:49 |
| evrardjp | and make sure the roles are bumped, but I seriously don't have the time to change this. | 07:49 |
| *** kaiokmo has quit IRC | 08:04 | |
| *** kaiokmo has joined #openstack-ansible | 08:13 | |
| ygk_12345 | hi all | 08:35 |
| ygk_12345 | glance uploads from external networks is failing in OSA | 08:35 |
| ygk_12345 | it is timing out | 08:35 |
| ygk_12345 | is this a known issue or a bug ? | 08:35 |
| ygk_12345 | the image is stuck in queued state | 08:39 |
| evrardjp | hi ygk_12345 | 08:44 |
| ygk_12345 | evrardjp is this a known issue with glance ? | 08:44 |
| evrardjp | I seem to recall multiple things involved with that | 08:44 |
| evrardjp | it's most likely a configuration thing | 08:44 |
| *** luksky has joined #openstack-ansible | 08:44 | |
| evrardjp | I can't help right now | 08:45 |
| ygk_12345 | evrardjp it is mostly failing when trying to upload images fro external networks | 08:45 |
| ygk_12345 | *from | 08:45 |
| ygk_12345 | what exactly to enable in the config ? | 08:46 |
| masterpe | somehow the env variable CURRENT_OSA_VERSION is not getting set thats why I get the undefined string | 08:59 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Install current ARA version for python3 ansible-runtime venv https://review.opendev.org/682587 | 09:04 |
| *** cshen has quit IRC | 09:10 | |
| *** pcaruana has joined #openstack-ansible | 09:19 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Install current ARA version for python3 ansible-runtime venv https://review.opendev.org/682587 | 09:26 |
| *** cshen has joined #openstack-ansible | 09:27 | |
| *** ygk_12345 has quit IRC | 09:31 | |
| *** cshen has quit IRC | 09:32 | |
| *** stuartgr has joined #openstack-ansible | 09:36 | |
| noonedeadpunk | monrings | 09:41 |
| *** cshen has joined #openstack-ansible | 09:43 | |
| jrosser | o/ | 09:45 |
| *** tlunkw has joined #openstack-ansible | 10:01 | |
| *** pcaruana has quit IRC | 10:07 | |
| *** ansmith has joined #openstack-ansible | 10:12 | |
| *** ondrejburian has joined #openstack-ansible | 10:19 | |
| *** cshen has quit IRC | 10:28 | |
| noonedeadpunk | so, keystone patch is still not merged:( | 10:28 |
| *** luksky has quit IRC | 10:29 | |
| *** macz has joined #openstack-ansible | 10:30 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Freeze roles for Train milestone https://review.opendev.org/681002 | 10:32 |
| *** udesale has quit IRC | 10:34 | |
| *** udesale has joined #openstack-ansible | 10:34 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add nova placement to placement migration https://review.opendev.org/664867 | 10:34 |
| *** macz has quit IRC | 10:35 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add metal upgrade jobs https://review.opendev.org/671105 | 10:41 |
| *** prometheanfire has quit IRC | 10:41 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Install current ARA version for python3 ansible-runtime venv https://review.opendev.org/682587 | 10:43 |
| *** prometheanfire has joined #openstack-ansible | 10:43 | |
| *** ansmith has quit IRC | 10:43 | |
| *** cshen has joined #openstack-ansible | 10:44 | |
| *** ygk_12345 has joined #openstack-ansible | 10:46 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: [DNM] test swift / py3 https://review.opendev.org/680946 | 10:48 |
| *** pcaruana has joined #openstack-ansible | 10:55 | |
| *** nicolasbock has joined #openstack-ansible | 11:05 | |
| *** luksky has joined #openstack-ansible | 11:05 | |
| *** goldyfruit_ has joined #openstack-ansible | 11:07 | |
| dmsimard | jrosser: o/ I'll follow 682587 out of curiosity, let me know if you have any questions | 11:09 |
| jrosser | dmsimard: hello! actually i'm just watching the console of one of the jobs now | 11:10 |
| jrosser | this http://paste.openstack.org/show/777078/ | 11:10 |
| dmsimard | There are limitations for the static generation in 1.x right now | 11:10 |
| dmsimard | It's only in master | 11:11 |
| jrosser | ooh ok | 11:11 |
| jrosser | maybe i'm a bit early with this then | 11:11 |
| jrosser | although we do have the source code available in the zuul jobs i think | 11:11 |
| dmsimard | It's still useful to start working through this | 11:11 |
| openstackgerrit | kourosh vivan proposed openstack/openstack-ansible-ceph_client master: Update ceph cinder backup driver name https://review.opendev.org/682625 | 11:52 |
| *** goldyfruit_ has quit IRC | 12:02 | |
| *** brokencycle has quit IRC | 12:05 | |
| *** markvoelker has joined #openstack-ansible | 12:11 | |
| cshen | hi all. is there a way to override LimitNOFILE in systemd for os_cinder? | 12:18 |
| cshen | I've checked ansible role systemd_service. And there seemed to be no variable for overriding LimitNOFILE in systemd. | 12:18 |
| jrosser | chandankumar: oh it's not that you can't override that, you can override *anything* :) | 12:24 |
| jrosser | oh whoops | 12:24 |
| jrosser | cshen: ^^ | 12:24 |
| jrosser | https://github.com/openstack/ansible-role-systemd_service/blob/master/defaults/main.yml#L86 | 12:24 |
| *** dave-mccowan has joined #openstack-ansible | 12:25 | |
| cshen | jrosser this systemd_service_config_overrides will affect all systemd services, or? | 12:26 |
| jrosser | cshen: so for cinder specifically, i think that gets hooked up here https://github.com/openstack/openstack-ansible-os_cinder/blob/master/defaults/main.yml#L317 | 12:26 |
| jrosser | so per service | 12:26 |
| cshen | jrosser that's /etc/cinder/cinder-foobar.conf | 12:27 |
| noonedeadpunk | jrosser: seems that swift feels not rly good with py3 https://ae9838ffd3992ec5dadc-b7e8e61786ee9ade333147a7e52e8568.ssl.cf2.rackcdn.com/680946/3/check/openstack-ansible-deploy-aio_metal-debian-stable/9913e96/logs/host/glance-api.service.journal-12-03-58.log.txt.gz https://ae9838ffd3992ec5dadc-b7e8e61786ee9ade333147a7e52e8568.ssl.cf2.rackcdn.com/680946/3/check/openstack-ansible-deploy-aio_metal-debian-stable/9913e96/logs/host/swift-account- | 12:27 |
| noonedeadpunk | server.service.journal-12-03-58.log.txt.gz | 12:27 |
| noonedeadpunk | * https://ae9838ffd3992ec5dadc-b7e8e61786ee9ade333147a7e52e8568.ssl.cf2.rackcdn.com/680946/3/check/openstack-ansible-deploy-aio_metal-debian-stable/9913e96/logs/host/swift-account-server.service.journal-12-03-58.log.txt.gz | 12:27 |
| *** pcaruana has quit IRC | 12:27 | |
| cshen | jrosser I want to override /etc/systemd/system/cinder-volume.service | 12:27 |
| noonedeadpunk | I guess the way it parse conf might change | 12:27 |
| *** openstackstatus has quit IRC | 12:28 | |
| *** openstack has joined #openstack-ansible | 12:32 | |
| *** ChanServ sets mode: +o openstack | 12:32 | |
| noonedeadpunk | It's from https://review.opendev.org/#/c/680946/ | 12:32 |
| cshen | jrosser thanks, I will test. | 12:32 |
| *** macz has quit IRC | 12:36 | |
| *** tlunkw has quit IRC | 12:39 | |
| ChosSimbaOne | Hi. The infra controller node should not be running a mysql on metal, right? All mysql for openstack is in the galera containers right? | 12:40 |
| ChosSimbaOne | I am having a problem where the keystone container failes to connect to the galera container. | 12:40 |
| *** ansmith has joined #openstack-ansible | 12:41 | |
| ChosSimbaOne | fatal: [infra1_keystone_container-74d74dc1 -> 172.21.234.236]: FAILED! => {"changed": false, "failed": true, "msg": "unable to connect to database, check login_user and login_password are correct or /root/.my.cnf has the credentials. Exception message: (2003, 'Can\\'t connect to MySQL server on \\'172.21.232.202\\' (111 \"Connection refused\")')"} | 12:43 |
| ChosSimbaOne | from the anisble fail it seems like it is trying to connect to my infra host which is the physical machine alle the lxc containers run on. | 12:43 |
| *** tlunkw has joined #openstack-ansible | 12:48 | |
| cshen | jrosser you're right. I just need to add this config http://paste.openstack.org/show/777116/, and systemd config is overridden. Thanks. | 12:51 |
| *** pcaruana has joined #openstack-ansible | 12:59 | |
| *** sep has quit IRC | 13:00 | |
| *** ygk_12345 has quit IRC | 13:00 | |
| *** sep has joined #openstack-ansible | 13:04 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_murano master: Initial commit to os_murano role https://review.opendev.org/677830 | 13:09 |
| *** goldyfruit_ has joined #openstack-ansible | 13:09 | |
| *** pcaruana has quit IRC | 13:28 | |
| *** macz has joined #openstack-ansible | 13:38 | |
| *** goldyfruit_ has quit IRC | 13:39 | |
| *** macz has quit IRC | 13:43 | |
| cjloader | morning | 13:43 |
| cjloader | any further changes noonedeadpunk? | 13:44 |
| * noonedeadpunk working on it right now | 13:44 | |
| cjloader | weird right? | 13:45 |
| *** BjoernT has joined #openstack-ansible | 13:51 | |
| noonedeadpunk | not really | 13:52 |
| jrosser | noonedeadpunk: are you looking at the swift thing? | 13:52 |
| noonedeadpunk | it's because of obsoleted UcsSdk | 13:52 |
| noonedeadpunk | jrosser: right now at ironic | 13:52 |
| jrosser | ok, np, we maybe get some advice on that | 13:52 |
| cjloader | not sure if this is helpful https://github.com/openstack/ironic/commit/5f18e52b6443e0f624aaaa6f0b096e91bc34f796 | 13:55 |
| cjloader | noonedeadpunk ^ | 13:55 |
| cjloader | where ironic removed UCS | 13:55 |
| noonedeadpunk | yeah, so no need to carry them at all | 13:56 |
| cjloader | does that help? | 13:56 |
| noonedeadpunk | I've found that UcsSdk was replaced with ucsmsdk for a while https://community.cisco.com/t5/cisco-developed-ucs-integrations/deprecated-cisco-ucs-python-sdk-deprecated/ta-p/3642711 | 13:56 |
| cjloader | i tried that | 13:57 |
| cjloader | locally | 13:57 |
| cjloader | and didn't work | 13:57 |
| noonedeadpunk | cjloader: so you can offer dropping out UcsSdk from https://opendev.org/openstack/openstack-ansible-os_ironic/src/branch/master/defaults/main.yml#L198 | 13:57 |
| cjloader | i'll try that | 13:58 |
| cjloader | also ImcSdk | 13:59 |
| *** tlunkw has quit IRC | 13:59 | |
| *** goldyfruit_ has joined #openstack-ansible | 13:59 | |
| jrosser | timburke: would you have an idea on this? https://ae9838ffd3992ec5dadc-b7e8e61786ee9ade333147a7e52e8568.ssl.cf2.rackcdn.com/680946/3/check/openstack-ansible-deploy-aio_metal-debian-stable/9913e96/logs/host/swift-account-server.service.journal-12-03-58.log.txt.gz | 13:59 |
| noonedeadpunk | yep | 13:59 |
| *** pcaruana has joined #openstack-ansible | 13:59 | |
| jrosser | timburke: with this config file https://zuul.opendev.org/t/openstack/build/60dad9dd6d8541e6a42ec56f4dc17ec8/log/logs/etc/host/swift/account-server/account-server.conf.txt.gz | 14:00 |
| noonedeadpunk | so adding extra % removes the error message | 14:01 |
| noonedeadpunk | like "fallocate_reserve = 1%" | 14:01 |
| noonedeadpunk | irc dropped it:) | 14:02 |
| noonedeadpunk | ok, let me check if it will work | 14:02 |
| openstackgerrit | Cam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: [DNM] testing os_ironic master https://review.opendev.org/682446 | 14:02 |
| noonedeadpunk | jrosser: I guess it comes from configparser https://docs.python.org/3.6/library/configparser.html#configparser.ConfigParser.get | 14:05 |
| noonedeadpunk | https://stackoverflow.com/questions/14340366/configparser-and-string-with | 14:05 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: [DNM] test swift / py3 https://review.opendev.org/680946 | 14:07 |
| jrosser | yeah looks like here https://github.com/openstack/swift/blob/master/swift/account/server.py#L66 | 14:08 |
| *** rpittau is now known as rpittau|afk | 14:10 | |
| jrosser | noonedeadpunk: do you think that needs "raw=True" option on conf.get? | 14:10 |
| noonedeadpunk | jrosser: hope that https://review.opendev.org/#/c/680946/4/defaults/main.yml is going to work as well | 14:12 |
| noonedeadpunk | but... probably adding raw is better option:) | 14:12 |
| noonedeadpunk | jrosser: I guess we should at least try to place a patch | 14:13 |
| cjloader | ty noonedeadpunk for helping with ironic yesterday/today | 14:13 |
| noonedeadpunk | but since ppl might be already using % in their configs - this may break behaviour | 14:14 |
| noonedeadpunk | argh 2*% :) | 14:14 |
| noonedeadpunk | cjloader: ironic will probably breqak on swift right now | 14:14 |
| cjloader | good to know | 14:15 |
| noonedeadpunk | but it should pass pip install :) | 14:15 |
| noonedeadpunk | jrosser: I'm gonna ping ironic team about what's the best thing to do here | 14:16 |
| *** goldyfruit___ has joined #openstack-ansible | 14:17 | |
| *** goldyfruit_ has quit IRC | 14:20 | |
| *** cshen has quit IRC | 14:28 | |
| jrosser | noonedeadpunk: i ask swift about the %'s thing - seems very quiet in their IRC | 14:31 |
| noonedeadpunk | arhg, right, swift we were talking about:) | 14:31 |
| cjloader | looks to me like swiftclient version might need a bump? | 14:33 |
| cjloader | version bump | 14:33 |
| noonedeadpunk | jrosser: starnge that it worked on py2, since that part of configparser seems to be the same. I mean such behavior was described on py2 as well | 14:36 |
| *** BjoernT has quit IRC | 14:42 | |
| *** BjoernT has joined #openstack-ansible | 14:45 | |
| *** kaiokmo has quit IRC | 14:51 | |
| cjloader | noonedeadpunk: jrosser i'm testing that fix for swift on my aio | 14:52 |
| jrosser | i got confirmation from swift that its a bug | 14:52 |
| noonedeadpunk | jrosser: oh, great | 14:52 |
| noonedeadpunk | Will you place a patch or they're gonna fix it? | 14:53 |
| jrosser | noonedeadpunk: you confirmed that double percent is a workaround? | 14:53 |
| noonedeadpunk | So it stopped placing errors in log | 14:53 |
| noonedeadpunk | But I dunno how to check if this option really works as expected | 14:54 |
| cjloader | i'm running swift/ironic | 14:54 |
| noonedeadpunk | And, I know that generally in configparser this workaround is valid | 14:54 |
| cjloader | lets see if it passes | 14:54 |
| noonedeadpunk | I guess we can wait for CI result | 14:54 |
| noonedeadpunk | https://review.opendev.org/#/c/680946/ | 14:55 |
| *** pcaruana has quit IRC | 14:55 | |
| cjloader | noonedeadpunk: my tempur fixed | 14:56 |
| cjloader | with the double % | 14:56 |
| noonedeadpunk | jrosser: so this can be a feature as well:) | 14:57 |
| jrosser | https://bugs.launchpad.net/swift/+bug/1844368 | 14:58 |
| openstack | Launchpad bug 1844368 in OpenStack Object Storage (swift) "fallocate_reserve cannot be specified as a percentage running under python3" [Undecided,New] | 14:58 |
| jrosser | noonedeadpunk: so the keystone bug - i still can't make a test pass https://review.opendev.org/#/c/682460/ | 15:04 |
| jrosser | and thats now becasue setting an updated sha for tempest doesnt actually install that version | 15:04 |
| noonedeadpunk | and are they waiting for it? | 15:07 |
| noonedeadpunk | Ah, yep, I see | 15:07 |
| *** udesale has quit IRC | 15:08 | |
| cjloader | so noonedeadpunk when the swift bug is fixed, my patch *should* pass gates btw | 15:10 |
| noonedeadpunk | cjloader: yep, it's great:) | 15:10 |
| *** luksky has quit IRC | 15:11 | |
| cjloader | I just made a few conditional changes | 15:11 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Install current ARA version for python3 ansible-runtime venv https://review.opendev.org/682587 | 15:14 |
| dmsimard | anyone here going to ansiblefest next week ? | 15:15 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_murano master: Initial commit to os_murano role https://review.opendev.org/677830 | 15:22 |
| openstackgerrit | Cam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: Adds configuration for the Ironic Inspector https://review.opendev.org/680284 | 15:26 |
| *** ivve has quit IRC | 15:27 | |
| cjloader | noonedeadpunk: btw added the package changes in my patch too | 15:29 |
| noonedeadpunk | cjloader: it's batter to place these changes with separate patch | 15:29 |
| cjloader | okay ill remove and submit separate patch | 15:30 |
| noonedeadpunk | so I'd suggested to update commit msg for https://review.opendev.org/#/c/682446/ and rebase your patch on top of it | 15:30 |
| noonedeadpunk | and drop this noop patch from commit:) | 15:30 |
| noonedeadpunk | *noop file | 15:30 |
| cjloader | yea | 15:31 |
| cjloader | i'll do that | 15:31 |
| *** gyee has joined #openstack-ansible | 15:32 | |
| openstackgerrit | Cam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: Remove UCS packages from os_ironic https://review.opendev.org/682446 | 15:34 |
| cjloader | noonedeadpunk: ^ | 15:34 |
| *** CeeMac has joined #openstack-ansible | 15:35 | |
| *** spatel has joined #openstack-ansible | 15:39 | |
| *** goldyfruit_ has joined #openstack-ansible | 15:50 | |
| *** goldyfruit___ has quit IRC | 15:53 | |
| *** brokencycle has joined #openstack-ansible | 15:56 | |
| tiffanie | #startmeeting openstack_ansible_meeting | 16:00 |
| openstack | Meeting started Tue Sep 17 16:00:13 2019 UTC and is due to finish in 60 minutes. The chair is tiffanie. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 16:00 | |
| openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:00 |
| tiffanie | #topic office hours | 16:00 |
| guilhermesp | o/ | 16:00 |
| *** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)" | 16:00 | |
| cjloader | o/ | 16:00 |
| jrosser | o/ | 16:01 |
| chandankumar | \o/ | 16:04 |
| noonedeadpunk | o/ | 16:04 |
| noonedeadpunk | so, upgrade jobs passing https://review.opendev.org/#/c/671105/ !!! | 16:05 |
| cjloader | nice! | 16:06 |
| noonedeadpunk | and, milestone https://review.opendev.org/#/c/681002/ was updated today | 16:06 |
| noonedeadpunk | But due to keystone bug we can't merge it now | 16:06 |
| guilhermesp | nice noonedeadpunk | 16:07 |
| jrosser | we are going to need to work on tempest to land the keystone bug | 16:07 |
| jrosser | becasue it needs this https://review.opendev.org/678379 | 16:08 |
| noonedeadpunk | jrosser: so, they're waiting our CI to pass before merging the patch? | 16:08 |
| jrosser | no, i think it just needs review on the keystone side tbh | 16:08 |
| jrosser | we have other issues :) | 16:08 |
| cjloader | like swift | 16:08 |
| mnaser | awesome work on ugprades, noonedeadpunk | 16:08 |
| cjloader | lol | 16:08 |
| mnaser | this is _very_ good | 16:08 |
| noonedeadpunk | probably it's worth to include upgrade to milestone as well? | 16:09 |
| spotz | o/ | 16:10 |
| mnaser | i personally think its very valuable to have that locked in | 16:10 |
| mnaser | what are thoughts from others? | 16:10 |
| *** weshay has joined #openstack-ansible | 16:11 | |
| jrosser | the centos upgrade is a long job - i hope we don't hit timeouts | 16:11 |
| noonedeadpunk | yeah... | 16:12 |
| noonedeadpunk | but I know how to reduce time | 16:13 |
| noonedeadpunk | we need https://review.opendev.org/#/c/682103/ | 16:13 |
| noonedeadpunk | to be able to skip tempest tests after stein deployment | 16:14 |
| *** gillesMo has joined #openstack-ansible | 16:15 | |
| noonedeadpunk | https://review.opendev.org/#/c/671105/33/scripts/gate-check-commit.sh | 16:15 |
| gillesMo | Hello ! I've just added a compute node on my cluster (Rocky/Ubuntu16.04). This node is Ubuntu 18.04, and I don't see how to make the repo build venvs and co for Ubuntu 18.04, it does not running all the playbooks | 16:17 |
| jrosser | noonedeadpunk: so i guess the upgrade is surviving a py2 -> py3 transition of some sort? | 16:19 |
| jrosser | i figured that the ansible-runtime venv won't be recreated as py3 though | 16:19 |
| noonedeadpunk | I guess I haven't rebased on top of py3 yet | 16:20 |
| noonedeadpunk | :( | 16:20 |
| jrosser | actually you may be ok https://zuul.opendev.org/t/openstack/build/8922b05644d6462ca472b071ba824187/log/job-output.txt#12667 | 16:24 |
| spatel | gillesMo: You should hold on for sometime, look like weekly meeting going on. | 16:25 |
| noonedeadpunk | oh, indeed | 16:25 |
| noonedeadpunk | but it's for ansible. Dunno about projects | 16:25 |
| noonedeadpunk | But seems that uwsgi has python3 suffix as well | 16:26 |
| jrosser | cool | 16:26 |
| noonedeadpunk | since aio don't contain swift or ironic - I'm ok :p | 16:27 |
| cjloader | ... | 16:27 |
| cjloader | lol | 16:27 |
| cjloader | speaking of swift | 16:29 |
| noonedeadpunk | jrosser: btw, regarding swift - should we edit our template as for now and keep track on the reported bug? | 16:29 |
| cjloader | +1 noonedeadpunk | 16:29 |
| noonedeadpunk | To rollback if they'll decide to use raw | 16:29 |
| jrosser | you could propose a patch a revert at the same time so we remember | 16:29 |
| jrosser | *and a | 16:30 |
| jrosser | there are generally a few broken things we need to address | 16:30 |
| cjloader | i'm all for that jrosser | 16:30 |
| noonedeadpunk | sure:) | 16:31 |
| jrosser | swift like we just mentioned which we can deal with | 16:31 |
| cjloader | it'd help unblock the ironic efforts as well | 16:31 |
| jrosser | neutron/calico is a python3 problem too | 16:31 |
| jrosser | keystone bug + related tempest update | 16:31 |
| jrosser | and i would like to land bind-to-mgmt too which needs some more work | 16:32 |
| jrosser | plus i think we are about to learn what breaks with centos7.7 | 16:32 |
| noonedeadpunk | :) | 16:32 |
| jrosser | and haproxy on metal looks very close too | 16:32 |
| guilhermesp | Yeah I put a hold on the galera issue but will come back to it | 16:33 |
| noonedeadpunk | I guess it's ok | 16:33 |
| noonedeadpunk | regarding haproxy) | 16:33 |
| jrosser | and one all that is sorted out there is a bunch of stuff folk have contributed which has got a bit backed up | 16:34 |
| noonedeadpunk | jrosser: btw, I guess we need to walk through distro variables and ensure that ubuntu at least uses py3 everywhere | 16:38 |
| *** goldyfruit___ has joined #openstack-ansible | 16:40 | |
| noonedeadpunk | or leave it afterwards | 16:42 |
| *** goldyfruit_ has quit IRC | 16:43 | |
| jrosser | so for bind-to-mgmt i want to tidy this up https://review.opendev.org/#/c/670051/ | 16:46 |
| jrosser | far far too many variables, that needs cutting back and a global one introducing a bit like the py2/3 switch variable | 16:46 |
| *** luksky has joined #openstack-ansible | 16:50 | |
| guilhermesp | jrosser: you mean by like adding a global var in each role correspondent to the mgmt-adddr? | 16:50 |
| jrosser | yes, it's a bunch of one line patches to os_* i think | 16:50 |
| jrosser | i was going to leave all the infrastructure things as they are | 16:51 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_swift master: Update fallocate_reserve to work with py3 https://review.opendev.org/682697 | 16:52 |
| jrosser | guilhermesp: nova_service_bind_address: "{{ openstack_service_bind_address | default('0.0.0.0') }}" | 16:53 |
| jrosser | something like that | 16:53 |
| noonedeadpunk | jrosser: for swift I've updated your's dnm if you don't mind:) | 16:53 |
| guilhermesp | sounds clearer jrosser | 16:53 |
| guilhermesp | for galera, we have abandoned the patch to replace the bind addrs but i need to figure out why it is still breaking on the integrated repo | 16:53 |
| guilhermesp | practically on a production env it works as it is proposed in the patch | 16:54 |
| jrosser | noonedeadpunk: thats fine | 16:54 |
| jrosser | mnaser: anything from you on all this stuff? :) | 16:55 |
| *** pcaruana has joined #openstack-ansible | 16:55 | |
| noonedeadpunk | guilhermesp: https://review.opendev.org/#/c/677830/ seems to be passing CI. Going to check what';s wrong with CLI | 16:55 |
| guilhermesp | yeah noonedeadpunk it was passing all the time | 16:56 |
| mnaser | jrosser: about galera.. everything we've used to deploy is all that i've handed to guilhermesp .. so im not sure ~how~ | 16:56 |
| guilhermesp | now I guess murano-api is up, but cli returns bad request | 16:56 |
| noonedeadpunk | not the last one:) | 16:56 |
| guilhermesp | yeah I kinda of reproduced the vars we needed to set in 2 metal deployments | 16:56 |
| guilhermesp | but was a mutlinode deployment | 16:57 |
| guilhermesp | things could bahave differenctly in aio | 16:57 |
| guilhermesp | in terms of galera | 16:57 |
| *** gillesMo has quit IRC | 16:58 | |
| mnaser | yeah, im not sure how/why it would behave different, but it does. | 16:58 |
| tiffanie | #endmeeting | 17:00 |
| *** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC" | 17:00 | |
| openstack | Meeting ended Tue Sep 17 17:00:11 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-09-17-16.00.html | 17:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-09-17-16.00.txt | 17:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-09-17-16.00.log.html | 17:00 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add support to deploy murano https://review.opendev.org/679496 | 17:03 |
| *** kopecmartin is now known as kopecmartin|off | 17:06 | |
| *** gillesMo has joined #openstack-ansible | 17:06 | |
| jrosser | gillesMo: I think without an 18.04 infra node you are a bit stuck | 17:19 |
| gillesMo | jrosser: ? repo build is based on OS of infra nodes only ? | 17:20 |
| jrosser | the repo server is on the infra nodes | 17:20 |
| gillesMo | Yes, but Ansible facts have all OS versions of all nodes | 17:21 |
| jrosser | and as building the python wheels involves all sorts of compiling C code it’s very much linked to the distro | 17:21 |
| jrosser | how many nodes do you have in total? | 17:21 |
| jrosser | the idea in the past was that you could have a mixed control plane of different OS and the appropriate repo server would be selected | 17:23 |
| jrosser | but I can’t say for certain that works | 17:23 |
| mnaser | what release is this | 17:23 |
| jrosser | rocky I believe | 17:24 |
| mnaser | so this is pre python_venv_build | 17:24 |
| mnaser | eh | 17:24 |
| gillesMo | jrosser: 18.1.11 Rocky. 3 controlers, 4 compute, 3 computes with local storage. External Ceph cluster | 17:25 |
| jrosser | what do you reckon mnaser? control plane upgrade to bionic? | 17:25 |
| mnaser | there is one really bad idea | 17:26 |
| mnaser | that you shouldnt do | 17:26 |
| mnaser | but you can setup a temp vm, add it to repo_hosts | 17:26 |
| mnaser | and then run and hopefully it builds 18.04 stuff | 17:26 |
| jrosser | yeah, and I think you can override the host that is the venv build host to make sure it is that one | 17:27 |
| gillesMo | Instead of adding a new compute node, I could add a controler, and convert an old (xenial) controler to new (bionic) compute (reinstalling). But it's a bit harsh ! | 17:27 |
| jrosser | with three controllers you can upgrade them one at a time to bionic | 17:27 |
| jrosser | I’ve done this and come out the other side working, with a little bit of fixing up to do along the way | 17:28 |
| gillesMo | I can also add my new compute node to repo-infra_hosts group, but it will install lxc and co... | 17:28 |
| jrosser | you could even try an apt-dist upgrade | 17:28 |
| mnaser | yes thats an even worse idea | 17:28 |
| mnaser | :p | 17:29 |
| mnaser | (compute not to repo-infra) | 17:29 |
| jrosser | but imho that would need an awesome amount of post upgrade fixing up | 17:29 |
| jrosser | gillesMo: I think you should think about what future upgrades you want to do, you’re stuck at rocky with 16.04 so this needs to happen on bionic at some point anyway | 17:30 |
| gillesMo | I know, it seemed easier to first add or upgrade compute nodes (bionic) with live-migrating instances instead of upgrading first controlers. Seemed less risky | 17:32 |
| *** primeministerp has joined #openstack-ansible | 17:33 | |
| jrosser | I don’t believe you can do it easily without in some way introducing an 1804 repo server, either by re-doing an existing infra node, or by somehow adding a 4th member to the repo servers group | 17:34 |
| gillesMo | So OS upgrade start from controlers (at least repo-infra_hosts)Reading th ansible role repo_build, I wonder if I can run the playbook overridding some vars : repo_build_os_distro_version ? | 17:39 |
| gillesMo | Mmmm, if there's compilation dependancies, the repo LXC container should be 18.04... | 17:41 |
| jrosser | yes you’d need to rebuild that to be 1804, somehow | 17:42 |
| gillesMo | When you have upgraded your controlers, how many did you have ? how many active while rolling upgrading, for how long ? No problems with galera/rabbitmq clusters ? | 17:47 |
| jrosser | I had 3 infra nodes and 3 others with galera/rabbit/memcached on | 17:49 |
| jrosser | so more to do than yours | 17:49 |
| jrosser | and I did one at once, leaving two active | 17:49 |
| jrosser | and I won’t claim it all went smoothly, but going step by step and checking stuff along the way was important | 17:50 |
| cjloader | noonedeadpunk: your swift workaround failed on centos 7/opensuse on the keystone issue | 17:51 |
| gillesMo | jrosser: thanks for your experience, I'll go this way... | 17:54 |
| jrosser | I have some notes if you get stuck | 17:54 |
| jrosser | just make sure that the gamer cluster is in a good state after redoing the first one | 17:55 |
| jrosser | *galera | 17:55 |
| jrosser | same with rabbitmq | 17:55 |
| jrosser | and I found some services like keystone really didn’t like the rabbit cluster being upgraded, and needed restarting | 17:56 |
| goldenfri | gillesMo I did a hacky thing when I needed 16.04 compute nodes on an 18.04 rocky setup. I created an AIO 16.04 rocky, then just copied all the repos over to my 18.04 infra, and it worked just fine. I probably wouldn't suggest doing that, but just putting that out there haha | 17:57 |
| jrosser | that’s totally valid, to create the repo contents with some CI process and dump it in | 17:58 |
| *** theintern_ has joined #openstack-ansible | 18:03 | |
| gillesMo | goldenfri: Yes, but as I would had to upgrade my controlers one time or another, better starting from there | 18:03 |
| *** spatel has quit IRC | 18:22 | |
| *** goldyfruit___ has quit IRC | 18:31 | |
| cjloader | jrosser: looks like OSA is completely blocked on the keystone thing | 18:48 |
| cjloader | lol | 18:48 |
| *** theintern_ has quit IRC | 18:49 | |
| jrosser | cjloader: yes we have to unbreak things starting with that | 18:53 |
| *** theintern_ has joined #openstack-ansible | 19:05 | |
| admin0 | if I cahnge the mtu of br-vlan and rerun the playbook, what do I need to do to have the new MTU reflected in the instances ? is a reboot enough ? | 19:16 |
| *** goldyfruit___ has joined #openstack-ansible | 19:40 | |
| *** spsurya has quit IRC | 19:48 | |
| cjloader | these are going to be fun | 19:52 |
| *** theintern_ has quit IRC | 20:05 | |
| *** goldyfruit_ has joined #openstack-ansible | 20:15 | |
| *** goldyfruit___ has quit IRC | 20:18 | |
| *** ansmith has quit IRC | 20:30 | |
| *** weshay is now known as weshay|ruck | 20:32 | |
| *** BjoernT_ has joined #openstack-ansible | 20:37 | |
| *** BjoernT has quit IRC | 20:38 | |
| noonedeadpunk | cjloader: yep, it's expected. everything is blocked for several days already | 20:40 |
| cjloader | eww | 20:40 |
| cjloader | lol | 20:40 |
| BjoernT_ | @admin0 you need to update the MTU in neutron and restart the dhcp agents so that the leases handed out include a different MTU. The first part was not easy possible in neutron on old versions | 20:41 |
| *** BjoernT_ is now known as bjoernT | 20:41 | |
| *** bjoernT is now known as BjoernT | 20:41 | |
| cjloader | at least we should have my role changes pass gate when unblocked noonedeadpunk | 20:42 |
| noonedeadpunk | ++ | 20:42 |
| *** trident has quit IRC | 20:48 | |
| *** luksky has quit IRC | 20:55 | |
| *** idlemind has joined #openstack-ansible | 20:56 | |
| *** pcaruana has quit IRC | 20:58 | |
| *** trident has joined #openstack-ansible | 21:00 | |
| *** ansmith has joined #openstack-ansible | 21:15 | |
| *** markvoelker has quit IRC | 21:35 | |
| *** prometheanfire has quit IRC | 21:50 | |
| *** prometheanfire has joined #openstack-ansible | 21:51 | |
| *** BjoernT has quit IRC | 21:52 | |
| *** spatel has joined #openstack-ansible | 22:38 | |
| *** macz has joined #openstack-ansible | 22:40 | |
| *** macz has quit IRC | 22:47 | |
| *** tosky has quit IRC | 23:11 | |
| *** goldyfruit_ has quit IRC | 23:17 | |
| *** markvoelker has joined #openstack-ansible | 23:22 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!