| *** brokencycle has quit IRC | 00:01 | |
| *** macz has quit IRC | 00:57 | |
| *** markvoelker has joined #openstack-ansible | 01:53 | |
| *** markvoelker has quit IRC | 01:58 | |
| *** idlemind has quit IRC | 02:46 | |
| *** markvoelker has joined #openstack-ansible | 03:24 | |
| *** markvoelker has quit IRC | 03:29 | |
| *** gkadam has joined #openstack-ansible | 03:46 | |
| *** gkadam has quit IRC | 03:47 | |
| *** jhesketh has joined #openstack-ansible | 03:50 | |
| *** udesale has joined #openstack-ansible | 04:11 | |
| *** jawad_axd has joined #openstack-ansible | 04:59 | |
| *** macz has joined #openstack-ansible | 05:09 | |
| *** pcaruana has joined #openstack-ansible | 05:11 | |
| *** macz has quit IRC | 05:17 | |
| *** cp has quit IRC | 05:20 | |
| *** radeks_ has joined #openstack-ansible | 05:22 | |
| *** kopecmartin|off is now known as kopecmartin | 06:16 | |
| *** Garyx has quit IRC | 06:22 | |
| *** Garyx has joined #openstack-ansible | 06:22 | |
| *** owalsh has quit IRC | 06:23 | |
| *** logan- has quit IRC | 06:23 | |
| *** owalsh has joined #openstack-ansible | 06:23 | |
| *** markvoelker has joined #openstack-ansible | 06:24 | |
| *** arbrandes has quit IRC | 06:25 | |
| *** arbrandes has joined #openstack-ansible | 06:26 | |
| *** markvoelker has quit IRC | 06:30 | |
| jrosser | morning | 06:31 |
|---|---|---|
| *** radeks_ has quit IRC | 06:32 | |
| *** sshnaidm_ is now known as sshnaidm|rover | 06:37 | |
| *** trident has quit IRC | 06:48 | |
| jrosser | noonedeadpunk: master is blocked on the centos distro job failing | 06:52 |
| *** radeks has joined #openstack-ansible | 06:53 | |
| jrosser | I know what happens, keystone-manage db_sync —check is failing internally and always return code 0, so the keystone db never gets set up properly | 06:54 |
| jrosser | but I don’t know why that happens yet | 06:54 |
| *** rpittau|afk is now known as rpittau | 06:55 | |
| *** cshen has joined #openstack-ansible | 06:55 | |
| *** trident has joined #openstack-ansible | 06:57 | |
| *** cshen has quit IRC | 07:01 | |
| *** cshen has joined #openstack-ansible | 07:01 | |
| *** trident has quit IRC | 07:03 | |
| *** tosky has joined #openstack-ansible | 07:08 | |
| *** trident has joined #openstack-ansible | 07:12 | |
| *** macz has joined #openstack-ansible | 07:18 | |
| *** macz has quit IRC | 07:23 | |
| *** ivve has joined #openstack-ansible | 07:32 | |
| *** gchamoul has joined #openstack-ansible | 07:38 | |
| *** cp has joined #openstack-ansible | 07:38 | |
| *** sshnaidm|rover is now known as sshnaidm|afk | 07:39 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata https://review.opendev.org/682287 | 07:42 |
| kaiokmo | morning | 07:44 |
| *** wpp has joined #openstack-ansible | 08:15 | |
| *** markvoelker has joined #openstack-ansible | 08:27 | |
| *** luksky has joined #openstack-ansible | 08:30 | |
| *** markvoelker has quit IRC | 08:32 | |
| *** brokencycle has joined #openstack-ansible | 08:41 | |
| *** sshnaidm|afk is now known as sshnaidm|rover | 08:43 | |
| noonedeadpunk | jrosser: Yep, I saw it on Saturday but didn't have a chance to check that. Will have a look a bit later unless you are already on it;) | 09:13 |
| noonedeadpunk | wondering if https://review.opendev.org/#/c/681002/1 is going to fail now | 09:14 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-specs master: fix misspelling https://review.opendev.org/682305 | 09:15 |
| *** macz has joined #openstack-ansible | 09:19 | |
| *** macz has quit IRC | 09:24 | |
| *** mgoddard has quit IRC | 09:26 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Imported Translations from Zanata https://review.opendev.org/682287 | 09:31 |
| *** mgoddard has joined #openstack-ansible | 09:39 | |
| jrosser | noonedeadpunk: the centos distro job failed on #681002 | 10:06 |
| jrosser | the problem on all of these is TASK [os_keystone : Bootstrap keystone admin and endpoint] | 10:06 |
| noonedeadpunk | yeah... so at least it's not our work who made it to fail:) | 10:08 |
| noonedeadpunk | already deploying sandbox to see what's going on there as logs in zuul don't contain details | 10:08 |
| jrosser | i have one | 10:12 |
| jrosser | just a moment | 10:12 |
| jrosser | noonedeadpunk: i can put your ssh keys on if you like? | 10:12 |
| noonedeadpunk | yep, sure:) | 10:13 |
| jrosser | so, i found some interesting stuff, just dont understand why it breaks | 10:14 |
| jrosser | this is where the bad things start https://zuul.opendev.org/t/openstack/build/13380c48e2ab4edaadbf9bac9d4ceca5/log/job-output.txt#9776-9782 | 10:16 |
| jrosser | if you run keystone-manage db_sync --check at the command line | 10:16 |
| jrosser | then look at whats at the end of the journal there is a database error | 10:17 |
| jrosser | which stops at this point http://paste.openstack.org/show/776709/ | 10:18 |
| jrosser | result is that the return code from keystone-manage is always zero | 10:19 |
| jrosser | so none of these tasks ever get run https://github.com/openstack/openstack-ansible-os_keystone/blob/master/tasks/keystone_db_sync.yml#L25-L37 | 10:19 |
| noonedeadpunk | yeah.... | 10:20 |
| jrosser | and then it's game over becasue the keystone db isn't created | 10:20 |
| jrosser | so i don't know if this is a keystone problem or some db middleware issue | 10:21 |
| jrosser | becasue keystone is the first thing that tries to do this it could be either | 10:21 |
| noonedeadpunk | Have any of bind-to-mgmt got merged last week? | 10:21 |
| noonedeadpunk | Ah, it's only for distro install, so unlikely it's related | 10:22 |
| *** markvoelker has joined #openstack-ansible | 10:28 | |
| *** udesale has quit IRC | 10:28 | |
| *** cshen has quit IRC | 10:33 | |
| *** markvoelker has quit IRC | 10:33 | |
| *** cshen has joined #openstack-ansible | 10:48 | |
| *** cshen has quit IRC | 10:54 | |
| *** macz has joined #openstack-ansible | 11:19 | |
| *** cshen has joined #openstack-ansible | 11:22 | |
| *** macz has quit IRC | 11:24 | |
| *** cshen has quit IRC | 11:27 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Move debian jobs to buster https://review.opendev.org/681777 | 11:34 |
| *** jawad_ax_ has joined #openstack-ansible | 11:37 | |
| *** cshen has joined #openstack-ansible | 11:38 | |
| *** jawad_axd has quit IRC | 11:40 | |
| *** udesale has joined #openstack-ansible | 11:45 | |
| *** ansmith has quit IRC | 11:53 | |
| *** ygk_12345 has joined #openstack-ansible | 11:57 | |
| *** bhenc has left #openstack-ansible | 12:02 | |
| *** dave-mccowan has joined #openstack-ansible | 12:08 | |
| ygk_12345 | hi all I am facing this issue when trying to upload images from horiozn | 12:08 |
| *** luksky has quit IRC | 12:09 | |
| ygk_12345 | CORS request from origin not permitted | 12:09 |
| *** dave-mccowan has quit IRC | 12:12 | |
| *** dave-mccowan has joined #openstack-ansible | 12:13 | |
| *** goldyfruit___ has quit IRC | 12:15 | |
| cshen | ygk_12345: have you overridden the cors part in glance conf? | 12:25 |
| ygk_12345 | cshen i have changed the horizon url to https and now its allowing but the images r getting stuck in queued state | 12:26 |
| cshen | cshen: check your glance-api.conf in glance container. | 12:27 |
| ygk_12345 | cshen what to check for ? | 12:27 |
| jrosser | chandankumar: you around? | 12:27 |
| cshen | you have to add something like allowed_origin: https://foo.bar in that? | 12:27 |
| ygk_12345 | cshen i have added and now it is allowing but, the images r getting stuck in queued state | 12:28 |
| cshen | enable browser developer mode, and check what blocked your upload. | 12:28 |
| cshen | you should be able to see some errors there. | 12:29 |
| ygk_12345 | cshen u see the problem is not blocking but queueing | 12:29 |
| ygk_12345 | the images r stuck in queued state | 12:30 |
| cshen | iirc, we had the same problem. the server waited us to upload. but browser blocked the upload. | 12:30 |
| ygk_12345 | its google chrome | 12:30 |
| cshen | so the image was always in queueing status. | 12:30 |
| ygk_12345 | how to debug this ? | 12:31 |
| *** nicolasbock has joined #openstack-ansible | 12:31 | |
| cshen | enable 'developer tools' mode in chrome. | 12:31 |
| cshen | and check "console" and "network" tab when you try to upload an image. | 12:31 |
| ygk_12345 | cshen i see that it is in pending status in the browser network | 12:37 |
| chandankumar | jrosser: yes | 12:38 |
| ygk_12345 | cshen r u there ? | 12:38 |
| ygk_12345 | is this a bug in glance ? | 12:40 |
| cshen | ygk_12345 check "network" tab and do you see any errors? | 12:40 |
| *** ansmith has joined #openstack-ansible | 12:40 | |
| ygk_12345 | no errors but the file is in pending state | 12:40 |
| cshen | ygk_12345 which osa are you running? | 12:40 |
| ygk_12345 | rocky 18.1.2 branch | 12:40 |
| *** prometheanfire has quit IRC | 12:40 | |
| *** prometheanfire has joined #openstack-ansible | 12:41 | |
| cshen | maybe a newer release. we're using 18.1.8 | 12:41 |
| cshen | ygk_12345 last time, we saw the errors in "network" tab. If you don't see any errs, then I don't know how to help you now. | 12:43 |
| ChosSimbaOne | Hi. So a "dumb" questions. Just to be sure. So have external_lb_vip_address accessible from www, I just need to add my public range to the vlan trunk to the infra nodes, configure a network interface, so OSA can setup haproxy correct, right? Nothing special needs to be done? | 12:54 |
| *** luksky has joined #openstack-ansible | 12:57 | |
| noonedeadpunk | chandankumar: we have suggestion, that kystone package for centos is somehow broken | 12:59 |
| noonedeadpunk | since populating db for keystone is incorrect and missing rows for table | 13:00 |
| chandankumar | noonedeadpunk: what is the package version | 13:00 |
| *** ykarel has joined #openstack-ansible | 13:01 | |
| chandankumar | ykarel: Hello | 13:01 |
| chandankumar | noonedeadpunk: and which release? | 13:01 |
| ykarel | chandankumar, hi | 13:01 |
| chandankumar | noonedeadpunk: ykarel can help here with the broken package getting it fixed | 13:01 |
| noonedeadpunk | http://paste.openstack.org/show/776798/ | 13:02 |
| chandankumar | ykarel: ^^ | 13:02 |
| * ykarel looks | 13:02 | |
| ykarel | noonedeadpunk, chandankumar, any logs where issue is seen | 13:04 |
| *** markvoelker has joined #openstack-ansible | 13:04 | |
| ykarel | as we are running puppet and tripleo jobs, so it's doubtful that package is broken | 13:04 |
| noonedeadpunk | so if we run "# su -s /bin/sh -c "keystone-manage db_sync" keystone" and "keystone-manage credential_migrate --keystone-user keystone --keystone-group keystone" | 13:05 |
| noonedeadpunk | we have in logs "2019-09-16 12:35:34.006 8681 ERROR keystone DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'credential.encrypted_blob' in 'field list'") [SQL: u'SELECT credential.id AS credential_id, credential.user_id AS credential_user_id, credential.project_id AS credential_project_id, credential.encrypted_blob AS credential_encrypted_blob, credential.type AS credential_type, credential.key_hash AS credential_key_hash, | 13:05 |
| noonedeadpunk | credential.extra AS credential_extra \nFROM credential'] (Background on this error at: http://sqlalche.me/e/2j85)" | 13:05 |
| ykarel | okk /me runs locally | 13:06 |
| noonedeadpunk | there are failing tasks here as well https://zuul.opendev.org/t/openstack/build/2f7ab7e5a00a4c4aa27f853dd7bbbc03 | 13:06 |
| noonedeadpunk | probably jrosser may explain things better... | 13:06 |
| jrosser | ykarel: for maybe 4 days now our jobs which install centos distro packages all fail in the same way - db setup for keystone | 13:07 |
| jrosser | unclear if it is keystone or some underlying library as there is not a helpful error message | 13:08 |
| *** markvoelker has quit IRC | 13:09 | |
| ykarel | noonedeadpunk, so both those keystone-manage command passed for me locally atleast | 13:13 |
| ykarel | jrosser, noonedeadpunk is db manage failure logs in CI job somewhere? | 13:13 |
| noonedeadpunk | ykarel: https://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_2f7/681002/1/check/openstack-ansible-deploy-aio_distro_metal-centos-7/2f7ab7e/logs/host/keystone/keystone.log.txt.gz | 13:15 |
| noonedeadpunk | but I guess it's the result that "keystone-manage db_sync --check" returns 0 even when it shouldn't | 13:16 |
| noonedeadpunk | s/returns/has exit code/ | 13:16 |
| *** KeithMnemonic has joined #openstack-ansible | 13:18 | |
| noonedeadpunk | so when keystone db is not populated (it's empty) "keystone-manage db_sync --check" should return appropriate exit code | 13:19 |
| noonedeadpunk | https://docs.openstack.org/keystone/pike/admin/identity-upgrading.html#using-db-sync-check | 13:19 |
| *** macz has joined #openstack-ansible | 13:20 | |
| noonedeadpunk | ykarel: which is not the case for centos in case of installation from packages | 13:21 |
| *** macz has quit IRC | 13:25 | |
| -openstackstatus- NOTICE: The Gerrit service on review.opendev.org will be offline briefly starting at 14:00 UTC (that's roughly 30 minutes from now) for maintenance: http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009064.html | 13:27 | |
| ykarel | noonedeadpunk, hmm need_db_expand, need_db_migrate and need_db_contract are set to False in failing job | 13:29 |
| ykarel | so --check is misbehaving | 13:29 |
| jrosser | ykarel: when we look in the journal after the --check cli command there is this http://paste.openstack.org/show/776709/ | 13:30 |
| noonedeadpunk | so, they are set to false since return code is 0: https://github.com/openstack/openstack-ansible-os_keystone/blob/master/tasks/keystone_db_sync.yml#L16-L37 | 13:31 |
| ykarel | hmm i see All db_sync commands are upgraded to the same version and up-to-date. for --check output | 13:37 |
| ykarel | The latest installed migration script version is: 66.#012Current repository versions:#012Expand: 66 #012Migrate: 66#012Contract: 66 | 13:38 |
| *** pcaruana has quit IRC | 13:45 | |
| ioni | cve CVE-2019-15753 is only present in stein? | 13:47 |
| ioni | https://opendev.org/openstack/openstack-ansible/commit/fdabf04869815c9f9ef5a92bca5c575dbb9e5239 | 13:47 |
| *** ygk_12345 has quit IRC | 13:48 | |
| jrosser | ioni: as i understand it there was some refactoring of os-vif which introduced this, so it doesnt extend back beyond when that was done | 13:49 |
| *** goldyfruit___ has joined #openstack-ansible | 13:50 | |
| ykarel | jrosser, noonedeadpunk looks like it caused by https://review.opendev.org/#/c/678322/11 | 13:51 |
| ykarel | but how it's not affected in non centos jobs | 13:51 |
| noonedeadpunk | ykarel: jrosser and I know why source installs are not affected http://paste.openstack.org/show/776804/ | 13:51 |
| noonedeadpunk | centos package seems to be too modern:) | 13:51 |
| ykarel | noonedeadpunk, yes centos packages follow latest commits | 13:52 |
| ykarel | noonedeadpunk, so it's worth to be reported against keystone as recent commit seems broken for --check, https://review.opendev.org/#/c/678322/11 | 13:52 |
| noonedeadpunk | ++ | 13:52 |
| jrosser | well we will pick this up whenever we bump our openstack sha | 13:52 |
| noonedeadpunk | sorry for bothering you ykarel | 13:52 |
| ykarel | np | 13:52 |
| jrosser | noonedeadpunk: do you understand enough to continue this in openstack-keystone? | 13:54 |
| noonedeadpunk | jrosser: they don't have a tag on it, so it's not yet in pip. But yes, since we rely on SHA's | 13:54 |
| jrosser | i'm not sure i could explain what is actually broken | 13:54 |
| noonedeadpunk | I'm looking through this patch. But I think we should say about broken keystone-manage db_sync --check first of all | 13:55 |
| *** gchamoul has quit IRC | 13:58 | |
| -openstackstatus- NOTICE: The Gerrit service on review.opendev.org is offline briefly for maintenance: http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009064.html | 14:01 | |
| *** ChanServ changes topic to "The Gerrit service on review.opendev.org is offline briefly for maintenance: http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009064.html" | 14:01 | |
| *** markvoelker has joined #openstack-ansible | 14:02 | |
| *** jawad_ax_ has quit IRC | 14:02 | |
| *** ykarel is now known as ykarel|afk | 14:03 | |
| *** pcaruana has joined #openstack-ansible | 14:07 | |
| *** gchamoul has joined #openstack-ansible | 14:10 | |
| *** markvoelker has quit IRC | 14:11 | |
| *** markvoelker has joined #openstack-ansible | 14:12 | |
| *** markvoelker has quit IRC | 14:17 | |
| *** ykarel_ has joined #openstack-ansible | 14:26 | |
| *** ykarel_ has quit IRC | 14:27 | |
| cjloader | noonedeadpunk: looks like ironic proper updated to py3 in late june, removing that package | 14:30 |
| *** ykarel|afk has quit IRC | 14:30 | |
| cjloader | and thats why its not working | 14:30 |
| *** BjoernT has joined #openstack-ansible | 14:33 | |
| *** ChanServ changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC" | 14:33 | |
| -openstackstatus- NOTICE: The Gerrit outage portion of the current maintenance is complete and the service is back on line, however reindexing for renamed repositories is still underway and some Zuul job fixes are in the process of being applied | 14:33 | |
| *** goldyfruit_ has joined #openstack-ansible | 14:36 | |
| *** macz has joined #openstack-ansible | 14:37 | |
| *** goldyfruit___ has quit IRC | 14:39 | |
| *** goldyfruit___ has joined #openstack-ansible | 15:03 | |
| cjloader | jrosser: does haproxy normally get run in gating? | 15:05 |
| cjloader | meaning aio | 15:05 |
| jrosser | yes it does, for lxc jobs | 15:05 |
| *** goldyfruit_ has quit IRC | 15:05 | |
| cjloader | ah for lxc jobs | 15:05 |
| cjloader | metal no? | 15:06 |
| jrosser | not currently, but soon | 15:06 |
| *** openstackgerrit has quit IRC | 15:08 | |
| cjloader | because i'm seeing 503 errors with posting swift tempurl, and just tried looking at the hatop -s /var/run/haproxy.stat, was not there how do we check status of openstack services w/o haproxy? | 15:09 |
| *** BjoernT_ has joined #openstack-ansible | 15:09 | |
| *** BjoernT has quit IRC | 15:10 | |
| jrosser | you interact with the service directly in that case | 15:14 |
| cjloader | ok | 15:15 |
| *** cshen has quit IRC | 15:18 | |
| *** ivve has quit IRC | 15:20 | |
| *** luksky has quit IRC | 15:44 | |
| *** openstackgerrit has joined #openstack-ansible | 15:47 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add nova placement to placement migration https://review.opendev.org/664867 | 15:47 |
| *** gyee has joined #openstack-ansible | 15:47 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add metal upgrade jobs https://review.opendev.org/671105 | 15:55 |
| *** markvoelker has joined #openstack-ansible | 16:13 | |
| *** brokencycle has quit IRC | 16:17 | |
| *** markvoelker has quit IRC | 16:18 | |
| *** kopecmartin is now known as kopecmartin|off | 16:18 | |
| *** goldyfruit_ has joined #openstack-ansible | 16:28 | |
| *** nicolasbock has quit IRC | 16:29 | |
| *** goldyfruit___ has quit IRC | 16:31 | |
| *** udesale has quit IRC | 16:32 | |
| *** theintern_ has joined #openstack-ansible | 16:35 | |
| *** markvoelker has joined #openstack-ansible | 16:36 | |
| *** nicolasbock has joined #openstack-ansible | 16:38 | |
| *** markvoelker has quit IRC | 16:40 | |
| *** sshnaidm|rover is now known as sshnaidm|afk | 16:49 | |
| *** rpittau is now known as rpittau|afk | 16:59 | |
| *** gshippey_ has joined #openstack-ansible | 17:05 | |
| *** goldyfruit_ has quit IRC | 17:28 | |
| *** theintern_ has quit IRC | 17:35 | |
| *** theintern_ has joined #openstack-ansible | 17:53 | |
| chandankumar | noonedeadpunk: jrosser so the wait is over centos8 is coming on 24th Sept https://twitter.com/CentOSProject/status/1173652996305170432 | 17:59 |
| jrosser | chandankumar: ooh interesting | 18:01 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/stein: [DNM] Noop patch to test stein https://review.opendev.org/682443 | 18:04 |
| *** goldyfruit has joined #openstack-ansible | 18:05 | |
| cjloader | so the os_ironic role master is broken =( | 18:06 |
| cjloader | I just ran the os_ironic role straight from master | 18:06 |
| cjloader | not my PR | 18:06 |
| noonedeadpunk | cjloader: it was centos distro install?:) | 18:10 |
| cjloader | no ubuntu 18.04 | 18:10 |
| noonedeadpunk | The latest patch there was https://review.opendev.org/#/c/681541/ | 18:10 |
| noonedeadpunk | and it's passing | 18:10 |
| noonedeadpunk | cjloader: just try to place noop patch like that to check this theory https://review.opendev.org/682443 | 18:11 |
| cjloader | ok | 18:11 |
| cjloader | i cloned down osa/ ran metal scenario for ironic | 18:12 |
| cjloader | and it failed | 18:12 |
| cjloader | but i'll submit noop | 18:12 |
| noonedeadpunk | if it's regular scenario - it shoudl fail the same way both in gates and locally | 18:16 |
| cjloader | yeah | 18:17 |
| cjloader | aio_metal_ironic | 18:17 |
| openstackgerrit | Cam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: [DNM] testing os_ironic master https://review.opendev.org/682446 | 18:18 |
| cjloader | noonedeadpunk: ^ | 18:19 |
| noonedeadpunk | yep, let's just wait for result) distro centos will fail - it's expected | 18:19 |
| *** luksky has joined #openstack-ansible | 18:24 | |
| *** markvoelker has joined #openstack-ansible | 18:37 | |
| *** markvoelker has quit IRC | 18:42 | |
| *** openstackgerrit has quit IRC | 18:52 | |
| *** openstackgerrit has joined #openstack-ansible | 18:56 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [DNM] Check that source installs fail keystone-manage similar to RDO https://review.opendev.org/682459 | 18:56 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [DNM] test keystone fix for LP bug #1844157 https://review.opendev.org/682460 | 18:59 |
| openstack | Launchpad bug 1844157 in OpenStack Identity (keystone) "keystone-manage db_sync --check misbehaves, version 15.1.0" [Critical,In progress] https://launchpad.net/bugs/1844157 - Assigned to Morgan Fainberg (mdrnstm) | 18:59 |
| *** cshen has joined #openstack-ansible | 19:03 | |
| *** goldyfruit_ has joined #openstack-ansible | 19:07 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_murano master: Initial commit to os_murano role https://review.opendev.org/677830 | 19:08 |
| *** goldyfruit has quit IRC | 19:09 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_murano master: Initial commit to os_murano role https://review.opendev.org/677830 | 19:10 |
| *** gshippey_ has quit IRC | 19:13 | |
| cjloader | noonedeadpunk: it failed btw | 19:20 |
| cjloader | on ubuntu 18.04 | 19:20 |
| cjloader | https://zuul.opendev.org/t/openstack/stream/8d23a75ae1b949da915501dc7c5bac62?logfile=console.log | 19:21 |
| *** cshen has quit IRC | 19:22 | |
| jrosser | noonedeadpunk: https://opendev.org/openstack/openstack-ansible/src/branch/stable/stein/tests/roles/bootstrap-host/tasks/prepare_aio_config.yml#L82-L95 | 19:25 |
| *** theintern_ has quit IRC | 20:02 | |
| *** luksky has quit IRC | 20:16 | |
| *** luksky has joined #openstack-ansible | 20:17 | |
| *** theintern_ has joined #openstack-ansible | 20:17 | |
| guilhermesp | noonedeadpunk: jrosser are you aware of these centos jobs failing on bootstrap keystone admin adn endpoint ? https://zuul.opendev.org/t/openstack/build/976a6f253095406b9e919b5dff2f925c/log/job-output.txt#9987 | 20:20 |
| guilhermesp | I've seen happening in three different patches | 20:20 |
| jrosser | guilhermesp: oh yes! | 20:20 |
| jrosser | guilhermesp: see this https://launchpad.net/bugs/1844157 | 20:20 |
| openstack | Launchpad bug 1844157 in OpenStack Identity (keystone) "keystone-manage db_sync --check misbehaves, version 15.1.0" [Critical,In progress] - Assigned to Morgan Fainberg (mdrnstm) | 20:20 |
| guilhermesp | ah just above | 20:21 |
| * guilhermesp didnt scroll up | 20:21 | |
| jrosser | yes we figure it out in #openstack-keystone today | 20:21 |
| jrosser | we will need their patch to land and RDO packages to be build before the centos distro jobs pass again though | 20:21 |
| jrosser | chandankumar: ^^ | 20:21 |
| guilhermesp | ahhhh that's good, we are already in progress | 20:22 |
| guilhermesp | thanks for that jrosser ! | 20:22 |
| guilhermesp | i was going to debug locally but I'd waste some time | 20:22 |
| cjloader | jrosser: fyi https://review.opendev.org/#/c/682446/ | 20:22 |
| cjloader | this is a noop patch | 20:22 |
| cjloader | cc noonedeadpunk | 20:22 |
| jrosser | cjloader: 404 Client Error: Not Found for url: http://mirror.regionone.fortnebula.opendev.org/wheel/debian-9.11-x86_64/ucssdk/ - skipping | 20:38 |
| *** markvoelker has joined #openstack-ansible | 20:38 | |
| *** pcaruana has quit IRC | 20:38 | |
| cjloader | hmm | 20:40 |
| openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible-os_keystone master: [DNM] test only https://review.opendev.org/682478 | 20:43 |
| *** markvoelker has quit IRC | 20:43 | |
| noonedeadpunk | wooot - upgrade jobs passed CI https://review.opendev.org/#/c/671105/ | 20:44 |
| noonedeadpunk | except our centos :) | 20:45 |
| noonedeadpunk | but it should be ok soon | 20:45 |
| noonedeadpunk | and in all that work I don't like this particular thing https://review.opendev.org/#/c/664867/15/playbooks/os-placement-install.yml | 20:45 |
| noonedeadpunk | That we're stopping old nova placement before deploying new one. | 20:46 |
| *** BjoernT_ has quit IRC | 20:46 | |
| noonedeadpunk | I was thinking about placing that in handlers - that will reduce service downtime | 20:47 |
| *** trident has quit IRC | 20:47 | |
| noonedeadpunk | But dunno how appropriate place that is | 20:47 |
| chandankumar | jrosser: sorry which keystone patch? | 20:48 |
| chandankumar | dlrn will take care of that, once it merges in master | 20:48 |
| chandankumar | automatically | 20:48 |
| openstackgerrit | Maksim Malchuk proposed openstack/openstack-ansible-os_octavia master: [DNM] test only https://review.opendev.org/682481 | 20:49 |
| *** markvoelker has joined #openstack-ansible | 20:49 | |
| noonedeadpunk | chandankumar: https://review.opendev.org/#/c/682447/ | 20:50 |
| chandankumar | noonedeadpunk: once it merges, dlrn will built it | 20:51 |
| chandankumar | it will be soon available | 20:51 |
| noonedeadpunk | ok, that's great. Btw, one more question. Since rdo is smth pretty new for me, can you share if it has some stable build for branches? | 20:51 |
| chandankumar | noonedeadpunk: https://trunk.rdoproject.org/ has almost all the info | 20:52 |
| noonedeadpunk | because it seems that we're installing latest packages for stein now https://opendev.org/openstack/openstack-ansible-openstack_hosts/src/branch/stable/stein/defaults/main.yml#L151-L153 | 20:52 |
| noonedeadpunk | hm, sorry | 20:53 |
| chandankumar | noonedeadpunk: https://www.rdoproject.org/what/trunk-repos/ it might help | 20:53 |
| noonedeadpunk | yep, thanks | 20:53 |
| noonedeadpunk | I read it wrong | 20:54 |
| chandankumar | noonedeadpunk: if still not clear, I will try to get answers tomorrow | 20:54 |
| noonedeadpunk | yep, I guess it answers all questions:) | 20:54 |
| chandankumar | sorry for that, I will feeling sleepy | 20:54 |
| noonedeadpunk | thanks | 20:54 |
| chandankumar | noonedeadpunk: amoralej has written awesome blog on pipelines https://blogs.rdoproject.org/author/amoralej/ it might help | 20:56 |
| *** ansmith has quit IRC | 20:56 | |
| noonedeadpunk | chandankumar: yep, many thanks) | 20:58 |
| *** trident has joined #openstack-ansible | 20:59 | |
| *** markvoelker has quit IRC | 21:00 | |
| *** theintern_ has quit IRC | 21:06 | |
| *** goldenfri has joined #openstack-ansible | 21:10 | |
| noonedeadpunk | cjloader: yep, that's strange that ucssdk is missing on mirrors... | 21:11 |
| noonedeadpunk | jrosser: so I'd say that it's more likely because of switching to py3, porbably Ironic is not ready for it at all... | 21:18 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ironic master: [DNM] testing os_ironic master https://review.opendev.org/682446 | 21:20 |
| noonedeadpunk | cjloader: hope you don't mind updating your noop patch to test this out | 21:20 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: [DNM] test keystone fix for LP bug #1844157 https://review.opendev.org/682460 | 21:31 |
| openstack | Launchpad bug 1844157 in OpenStack Identity (keystone) "keystone-manage db_sync --check misbehaves, version 15.1.0" [Critical,In progress] https://launchpad.net/bugs/1844157 - Assigned to Morgan Fainberg (mdrnstm) | 21:31 |
| jrosser | noonedeadpunk: slightly surprising references to python2.7 here https://a3e174dd787d1569c081-614f3af0609b64225912d2a4919c81df.ssl.cf5.rackcdn.com/682460/1/check/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/feb5da0/logs/ara-report/result/0117a50d-68fc-4f52-90f5-4563f258a97d/ | 21:34 |
| *** markvoelker has joined #openstack-ansible | 21:35 | |
| noonedeadpunk | ++ | 21:44 |
| *** markvoelker has quit IRC | 21:45 | |
| cjloader | noonedeadpunk: okay will do | 21:57 |
| noonedeadpunk | cjloader: sorry I mean that you don't mind if I update your patch:) as I already did it) | 21:58 |
| cjloader | np | 21:58 |
| cjloader | its pretty broken lol | 21:58 |
| *** brokencycle has joined #openstack-ansible | 22:03 | |
| *** spatel has joined #openstack-ansible | 22:08 | |
| *** spatel has quit IRC | 22:12 | |
| *** markvoelker has joined #openstack-ansible | 22:26 | |
| *** tosky has quit IRC | 22:35 | |
| *** macz has quit IRC | 22:37 | |
| *** macz has joined #openstack-ansible | 22:38 | |
| *** ansmith has joined #openstack-ansible | 22:47 | |
| *** goldyfruit_ has quit IRC | 22:50 | |
| *** ansmith has quit IRC | 23:11 | |
| *** ansmith has joined #openstack-ansible | 23:39 | |
| *** prometheanfire has quit IRC | 23:52 | |
| *** prometheanfire has joined #openstack-ansible | 23:53 | |
| *** brokencycle has quit IRC | 23:54 | |
| *** brokencycle has joined #openstack-ansible | 23:54 | |
| *** luksky has quit IRC | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!