Friday, 2019-09-13

openstackgerritCam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: Adds configuration for the Ironic Inspector  https://review.opendev.org/68028400:29
*** Garyx_ has quit IRC00:49
*** gyee has quit IRC00:53
*** markvoelker has joined #openstack-ansible01:01
*** Garyx has joined #openstack-ansible01:03
*** markvoelker has quit IRC01:05
*** dave-mccowan has quit IRC01:31
*** markvoelker has joined #openstack-ansible02:26
*** markvoelker has quit IRC02:36
*** markvoelker has joined #openstack-ansible02:38
*** markvoelker has quit IRC02:43
*** nicolasbock has quit IRC03:40
*** markvoelker has joined #openstack-ansible04:16
*** markvoelker has quit IRC04:21
*** radeks has quit IRC04:35
*** pcaruana has joined #openstack-ansible05:03
*** udesale has joined #openstack-ansible05:08
*** radeks has joined #openstack-ansible05:17
*** rpittau|afk is now known as rpittau06:08
*** cshen has joined #openstack-ansible06:46
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110506:50
*** trident has quit IRC06:55
toabctlevrardjp, hey. how often is COM synced into the openstack infra? daily? or where can I find that config?06:58
evrardjptoabctl: I think it's in project config. It might be a reverse proxy cache nowadays07:04
*** udesale has quit IRC07:04
*** jbadiapa has joined #openstack-ansible07:06
toabctlevrardjp, thx07:06
*** trident has joined #openstack-ansible07:07
evrardjpsystem-config sorry07:07
evrardjplet me check07:07
evrardjptoabctl: https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/mirror-update/files/opensuse-mirror-update07:09
evrardjpnot sure if it's still that, but if it's the case, then it's still mirrored07:10
evrardjpwe should ask dirk to be sure07:10
*** kaiokmo has quit IRC07:12
*** tosky has joined #openstack-ansible07:12
*** tosky_ has joined #openstack-ansible07:18
*** tosky has quit IRC07:21
*** prometheanfire has quit IRC07:36
*** prometheanfire has joined #openstack-ansible07:38
*** tosky_ is now known as tosky07:38
noonedeadpunkevrardjp: I'm a bit worried that for milestone we'll have broken upgrade because of placement07:41
noonedeadpunkprobably we can merge https://review.opendev.org/#/c/664867/ - it kinda solves problem for my sandbox, and I'll continue work on upgrade jobs afterwards07:42
*** kaiokmo has joined #openstack-ansible07:45
cshenmorning, we found in our setup, neutron-server didn't process rabbitmq messages fast enough. Do you have any suggestion to tune up the message processing speed of neutron-server?07:53
noonedeadpunkOr we may ignore it at place milestone as is:)07:56
noonedeadpunkand https://review.opendev.org/#/c/680284/ still not passes CI, due to which we've postponed milestone07:57
*** ivve has joined #openstack-ansible08:00
* noonedeadpunk should get used to check comments before putting his recheck....08:13
jrosserfor that one i guess ironic needs its own ipmi network a bit like br-lbaas etc08:15
jrossernoonedeadpunk: also what about this - they seem very keen but i wonder if the whole thing can be done with config overrides08:17
jrosserquestion really is if we want use wire up the defaults for octavia to use cinder volume in the AIO or make it opt-in08:18
noonedeadpunkyou mean upgrades or ironic inspector?:)08:20
jrosseroh sorry08:22
noonedeadpunkor it was not for me?:)08:22
jrosserpaste failure https://review.opendev.org/#/c/681649/08:22
noonedeadpunkah08:22
noonedeadpunkyeah, so from one side we're trying to reduce variables but from other side it's more conveniet and understandable for deployer to use such vars08:25
noonedeadpunkSo I dunno where this balance is...08:25
jrosserindeed - seems they were not using config overrides at all, and comment they are 'ugly'08:25
noonedeadpunkSo probably we should think one more time regarding it, porbably on meeting. As for config overrides are great, but, if we expect smth to be heavily overriden - there's a reason to add an easy variable for this08:27
jrossermaybe for this is is ok becasue it documents in the defaults that cinder-volume backed amphora is possible08:27
jrosserbut i don't just vote on it now becasue not sure what the right thing to do is08:27
noonedeadpunkYeah, so for this case I'd said it's ok. Despite missing reno:)08:28
jrossernoonedeadpunk: btw i'm not around much today but if you need stuff reviewing give me a shout08:31
noonedeadpunkyep, sure, thanks)08:31
toabctlif I get the current failure for openSUSE correctly, it's failing with "ERROR keystone.common.fernet_utils [-] Either [credential] key_repository does not exist or Keystone does not have sufficient permission to access it: /etc/keystone/credential-keys" (see bottom of https://aa0c79db170eeebf8946-cd8ab335a7f9ba6d128b245d61019e15.ssl.cf1.rackcdn.com/periodic/opendev.org/openstack/openstack-ansible-os_ceilometer/master/openstack-ansible-de08:33
toabctlploy-aio_distro_metal-opensuse-15/e00f752/logs/host/keystone/keystone-manage.log.txt.gz )08:33
toabctlthis is already fixed. so waiting for a) a repo republish and b) a mirror sync hopefully fixes this.08:33
toabctlevrardjp, dirk ^^08:33
*** markvoelker has joined #openstack-ansible08:44
*** markvoelker has quit IRC08:49
evrardjpthanks  toabctl09:09
*** udesale has joined #openstack-ansible09:15
*** jawad_axd has joined #openstack-ansible09:19
ChosSimbaOnemorning.09:19
kaiokmomorning09:32
*** ivve has quit IRC09:32
ChosSimbaOneWhen neutron-servers fails to start due to it not beeing able to find the typedriver is thtat becuase the neutron python module is missing it?09:46
*** udesale has quit IRC09:56
*** udesale has joined #openstack-ansible09:57
*** ivve has joined #openstack-ansible10:05
*** pcaruana has quit IRC10:11
*** luksky has joined #openstack-ansible10:36
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_horizon master: Retire neutron-lbaas UI plugin  https://review.opendev.org/68201810:38
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_horizon master: Resolve metal conflict with haproxy  https://review.opendev.org/68171810:38
*** jawad_axd has quit IRC10:55
*** jawad_axd has joined #openstack-ansible10:55
*** ansmith has joined #openstack-ansible11:04
*** nicolasbock has joined #openstack-ansible11:06
*** jbadiapa has quit IRC11:08
*** luksky has quit IRC11:09
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Start using uWSGI role  https://review.opendev.org/68038911:15
noonedeadpunkOMG, it merged! ^11:15
*** cshen has quit IRC11:19
*** cshen has joined #openstack-ansible11:24
*** pcaruana has joined #openstack-ansible11:24
*** luksky has joined #openstack-ansible11:26
*** luksky11 has joined #openstack-ansible11:28
*** luksky has quit IRC11:31
ChosSimbaOnenoonedeadpunk: grats :-)11:36
*** jawad_axd has quit IRC11:37
*** jawad_axd has joined #openstack-ansible11:37
*** sshnaidm|rover is now known as sshnaidm|off11:40
*** udesale has quit IRC11:40
*** luksky11 has quit IRC11:40
*** udesale has joined #openstack-ansible11:41
*** luksky11 has joined #openstack-ansible11:56
*** markvoelker has joined #openstack-ansible12:04
*** strattao_ has joined #openstack-ansible12:08
*** goldyfruit has quit IRC12:12
*** luksky11 has quit IRC12:22
*** luksky11 has joined #openstack-ansible12:23
*** dave-mccowan has joined #openstack-ansible12:24
*** dave-mccowan has quit IRC12:28
*** kupu-sama has joined #openstack-ansible12:31
*** strattao_ has left #openstack-ansible12:32
*** kupu-sama has quit IRC12:38
*** jawad_ax_ has joined #openstack-ansible12:38
*** jawad_axd has quit IRC12:41
*** jbadiapa has joined #openstack-ansible12:44
*** dave-mccowan has joined #openstack-ansible12:44
*** EmilienM is now known as EvilienM12:55
*** dave-mccowan has quit IRC12:58
*** ygk_12345 has joined #openstack-ansible12:58
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add nova placement to placement migration  https://review.opendev.org/66486713:05
*** luksky11 has quit IRC13:06
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110513:09
noonedeadpunkevrardjp mnaser: can you also take a look at https://review.opendev.org/#/c/679101/16 ?13:17
*** jawad_ax_ has quit IRC13:18
*** jawad_axd has joined #openstack-ansible13:19
*** jawad_ax_ has joined #openstack-ansible13:22
*** jawad_axd has quit IRC13:24
*** jawad_ax_ has quit IRC13:28
*** goldyfruit has joined #openstack-ansible13:28
*** jawad_axd has joined #openstack-ansible13:29
*** jawad_axd has quit IRC13:33
*** ygk_12345 has quit IRC13:59
*** kaiokmo has quit IRC14:01
*** kaiokmo has joined #openstack-ansible14:13
*** goldyfruit has quit IRC14:14
*** radeks has quit IRC14:21
*** nicolasbock has quit IRC14:21
*** nicolasbock has joined #openstack-ansible14:21
*** cshen has quit IRC14:28
*** goldyfruit has joined #openstack-ansible14:34
*** strattao_ has joined #openstack-ansible14:40
*** strattao_ has left #openstack-ansible14:40
*** goldyfruit_ has joined #openstack-ansible14:42
*** goldyfruit has quit IRC14:44
openstackgerritRalf Haferkamp proposed openstack/openstack-ansible-os_keystone master: Fix distro install on openSUSE  https://review.opendev.org/68207414:57
cjloadernoonedeadpunk: scrolled back, saw your comment wrt milestone, I thought evrardjp said not to block milestone for mmy PR15:01
cjloadercorrect evrardjp?15:02
noonedeadpunkI'm a bit lost about when we finished regarding ML)15:08
cjloaderML?15:08
noonedeadpunkah, milestone15:09
noonedeadpunksry, just friday evening15:09
cjloaderI recall they said not to block, but if I got it in fine, if not then we will worry about it when its ready15:10
cjloaderbut i'm very close -- although the venv_executable PR that merged complicated some stuff15:11
*** cp- has quit IRC15:12
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add nova placement to placement migration  https://review.opendev.org/66486715:15
cjloadernoonedeadpunk: i'd say if my PR is not ready by tomorrow morning early, don't worry about getting it into this milestone.15:15
cjloader(its morning here)15:15
cjloaderon friday15:16
*** cp- has joined #openstack-ansible15:17
noonedeadpunkI just wanted ^ to be merged for milestone as wel, since it fixes upgrades15:17
noonedeadpunkat least partially15:17
noonedeadpunkBut probably we'll do first milestone without it as well15:17
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110515:17
jrossercjloader: did you address the dnsmasq stuff and how to sensibly run an extra dhcp server15:18
cjloaderjrosser: BjoernT was going to fix that once we get my base patch in15:20
jrosserdo you have a reference setoup there at rax with an extra br-ipmi or something for dealing with this?15:20
jrosserwould be nice to get some baseline thing documented so folks know how to set it up15:20
jrosserlogan-: did you see this? calico maybe a but un-py3? https://review.opendev.org/#/c/681064/15:25
jrosser*bit15:25
cjloaderwe are trying to figure it out -- that was part of why we needed 1-2 weeks15:25
cjloaderthen we said that i'll get it passing CI15:26
*** ivve has quit IRC15:29
cjloaderjrosser: "Bjoern Teipel:red_circle:  Yes I will document that later once I test everything in my lab"15:29
jrosser:) ok15:30
cjloaderso more details to come15:30
*** udesale has quit IRC15:30
cjloaderi'm running into python venv issues atm15:30
cjloaderon my PR15:30
*** udesale has joined #openstack-ansible15:31
*** weshay|ruck has quit IRC15:31
cjloaderjrosser: noonedeadpunk what do you two think about seeing where my PR stands tomorrow to make call on milestone or not??15:32
cjloadergives me rest of today15:32
jrosserdon't worry15:33
noonedeadpunkso if I were you I won't be in hurry for the milestone with that patch15:33
*** macz has joined #openstack-ansible15:34
jrosserwe get a good window to get our house in order after the rest of openstack makes their release15:34
cjloaderok15:34
jrosseri think we will still find py3 things to fix15:35
cjloaderfairly heavy patch though =)15:35
cjloaderadds functionality15:35
noonedeadpunkYep, it's great :)15:36
jrosserso just have an eye to de-risking it in the code where you can15:36
noonedeadpunkI mean that moving things to py3 is smth wich influence project in more global and heavy way:)15:37
noonedeadpunkand which may break smth badly15:37
* jrosser worries we don't run period jobs for the roles15:37
jrosserbecasue the global switch to py3 is landed and we're not merging much to the roles right now to test that out15:38
* noonedeadpunk dunno how to check that :(15:39
cjloaderpy3 is going be difficult to handle15:41
cjloaderlol15:41
jrossernoonedeadpunk: we could just make a [DNM] to each os_<...> that’s not covered by the normal integrated repo test15:45
jrosserI think neutron already is the first victim of py315:45
noonedeadpunkbut neutron is covered, isn't it?15:45
logan-jrosser: yeah :/15:45
logan-looking15:46
jrosserNot all the extra things like calico15:46
noonedeadpunkah. But calico was kinda problematic far before py3 patch15:46
logan-noonedeadpunk: it was?15:47
logan-looks like it has been passing pretty reliably https://zuul.opendev.org/t/openstack/builds?job_name=openstack-ansible-deploy-aio_metal_calico-ubuntu-bionic15:47
noonedeadpunkyeah, some patch was instantly failing on it15:47
noonedeadpunktrying to find it...15:49
noonedeadpunkthgat one https://review.opendev.org/#/c/677311/15:50
noonedeadpunkthe first 3 checks were failing only on calico15:50
cjloaderi'm not sure why my python venv build with ironic is failing15:51
cjloadercan someone take a peek??15:51
*** spatel has joined #openstack-ansible15:52
cjloaderhttps://review.opendev.org/#/c/680284/15:52
noonedeadpunklogan-: yeah, it is. I mean that https://review.opendev.org/681064 probably worth rechecking since some floating problem for calico raised before py3 switch15:52
logan-noonedeadpunk: yeah you can see that on he build list. it looks like that patch and one or two others failed several times during that period. and then it hasn't happened since. maybe ci issues? idk15:53
logan-anyway the py3 issue is certainly an issue. can see the crash here https://f77da90f6772dc035516-f54a194f01fabbfbf1677f1f837bd08c.ssl.cf5.rackcdn.com/681064/3/gate/openstack-ansible-deploy-aio_metal_calico-ubuntu-bionic/b08d3b3/logs/host/calico-dhcp-agent.service.journal-22-08-39.log.txt.gz on dhcp-agent15:53
jrosserlogan-: did you see the neutron api log there? I found the code in networking-calico that looks suspect15:53
logan-looking into that, maybe that etcd dependency needs to be updated to something else15:53
noonedeadpunkah15:53
noonedeadpunkyou're right as usual:)15:54
logan-jrosser: yep and looking at https://github.com/openstack/networking-calico/commits/master i don't see anything obviously py3 fix related15:55
*** rmcallis has joined #openstack-ansible15:55
jrosserNo, that’s a bit surprising15:55
logan-asking in their slack atm, will let you know what i hear15:57
cjloadermy issue looks like setuptools issue: Command \"python setup.py egg_info\" failed with error code 115:57
noonedeadpunkmaybe some dev pkg is missing?..15:58
cjloadernoonedeadpunk: looks like I was calling a var wrong16:04
cjloaderlets see if this fixes16:04
openstackgerritCam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: Adds configuration for the Ironic Inspector  https://review.opendev.org/68028416:04
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova master: Convert dynamic includes to static imports  https://review.opendev.org/68210016:10
*** owalsh has quit IRC16:11
openstackgerritMerged openstack/openstack-ansible master: Change the order of params for openstack-ansible  https://review.opendev.org/68180616:11
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible stable/stein: Change the order of params for openstack-ansible  https://review.opendev.org/68210316:20
*** brokencycle has joined #openstack-ansible16:21
*** rpittau is now known as rpittau|afk16:22
*** owalsh has joined #openstack-ansible16:29
*** owalsh has quit IRC16:34
*** kopecmartin is now known as kopecmartin|off16:38
*** gyee has joined #openstack-ansible16:44
*** markvoelker has quit IRC16:45
*** markvoelker has joined #openstack-ansible16:49
*** markvoelker has quit IRC16:53
*** owalsh has joined #openstack-ansible16:54
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add nova placement to placement migration  https://review.opendev.org/66486717:07
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110517:08
*** luksky11 has joined #openstack-ansible17:25
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add nova placement to placement migration  https://review.opendev.org/66486717:27
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add metal upgrade jobs  https://review.opendev.org/67110517:28
*** udesale has quit IRC17:36
*** canori01 has joined #openstack-ansible17:36
canori01Is stable/queens supported on ubuntu 18.04?17:39
logan-canori01: nope, 18.04 support was added for rocky17:41
canori01Got it, thanks!17:41
*** goldyfruit_ has quit IRC17:46
*** goldyfruit_ has joined #openstack-ansible17:49
*** markvoelker has joined #openstack-ansible17:51
cjloadernoonedeadpunk: jrosser you guys still around?18:12
cjloader2019-09-13T18:08:16     Traceback (most recent call last):18:13
cjloader2019-09-13T18:08:16       File "<string>", line 1, in <module>18:13
cjloader2019-09-13T18:08:16       File "/tmp/pip-install-j198pvif/UcsSdk/setup.py", line 11, in <module>18:13
cjloader2019-09-13T18:08:16         raise DistutilsError("This package requires Python 2.4 or higher versions 2.x not Python3")18:13
cjloader2019-09-13T18:08:16     NameError: name 'DistutilsError' is not defined18:13
cjloaderlooks like compatibility18:13
cjloader  - UcsSdk18:17
cjloaderlooks to be not py3 supported18:20
*** prometheanfire has quit IRC18:30
*** prometheanfire has joined #openstack-ansible18:31
openstackgerritCam J. Loader (cjloader) proposed openstack/openstack-ansible-os_ironic master: Adds configuration for the Ironic Inspector  https://review.opendev.org/68028418:36
*** goldyfruit___ has joined #openstack-ansible18:59
*** goldyfruit_ has quit IRC19:02
*** markvoelker has quit IRC19:04
*** markvoelker has joined #openstack-ansible19:06
*** markvoelker has quit IRC19:16
*** markvoelker has joined #openstack-ansible19:17
noonedeadpunkcjloader: is it for Inspector itself? Or some linked package from requirements?19:28
noonedeadpunkwondering if inspector project is still alive19:29
noonedeadpunkbut it's disappointing anyway19:30
*** spatel has quit IRC20:06
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_nova master: Convert dynamic includes to static imports  https://review.opendev.org/68210020:12
jrossernoonedeadpunk: something odd going on with os_keystone tests now, not sure I understand what but old style role tests fail here https://review.opendev.org/#/c/682074/20:17
noonedeadpunkand no ara-report(20:22
noonedeadpunkand ansible verbose enabled for some reason....20:22
noonedeadpunkyah, that's wiered20:22
jrosserI wonder if the easiest thing is to just scrap those jobs and make a new scenario for the integrated repo20:24
*** csmart has quit IRC20:41
*** masterpe has quit IRC20:42
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_magnum master: Update fedora-atomic image to version 29 following upstream repo  https://review.opendev.org/68215920:46
guilhermespjrosser mnaser noonedeadpunk ^20:47
noonedeadpunkjrosser: it's probably not easier, but more correct:)20:47
*** csmart has joined #openstack-ansible20:48
noonedeadpunkguilhermesp: hm, it's just to update the docs?20:48
noonedeadpunkCan you describe purpose in the commit msg? Just for the history20:48
*** openstackgerrit has quit IRC20:51
*** masterpe has joined #openstack-ansible20:54
*** markvoelker has quit IRC20:57
guilhermespnoonedeadpunk: imho I think it's ok just the title... I checked out master in one production env and that the image works, then I saw the magnum commit I added in the commit message of the patch20:58
guilhermespbut seems that their docs is outdated https://docs.openstack.org/magnum/latest/install/launch-instance.html20:58
*** pcaruana has quit IRC21:03
noonedeadpunkI mean that it's not rly obvious why we ever need this patch, since it's doing nothing21:04
noonedeadpunkexcept updating docs for ppl21:04
*** brokencycle has quit IRC21:07
*** luksky11 has quit IRC21:14
*** KeithMnemonic has quit IRC21:19
*** cshen has joined #openstack-ansible21:20
*** jbadiapa has quit IRC21:37
jrosserthis is very odd - does anyone know why for centos the galera_server role uses the version numbers from the galera_client role https://github.com/openstack/openstack-ansible-galera_server/blob/master/vars/redhat.yml#L6321:50
jrosserthat feels dangerously circular as the server role has a meta dependancy on the client role21:51
logan-seems like a copypasta error21:52
*** EvilienM is now known as EmilienM21:52
logan-https://github.com/openstack/openstack-ansible-galera_server/commit/46262835384550d69d58611f136d23e93b5c245321:52
jrosseryeah that looks like an error21:53
jrosseri was trying to work out how to every land a major version number upgrade, and i don't think you can right now21:54
logan-heh21:54
jrosserand even so as the client and server need each other in each others tests it's still making my head hurt21:55
*** markvoelker has joined #openstack-ansible22:09
*** markvoelker has quit IRC22:14
*** cshen has quit IRC22:31
*** cshen has joined #openstack-ansible22:36
*** cshen has quit IRC22:41
*** goldyfruit___ has quit IRC22:49
*** macz has quit IRC22:58
*** tosky has quit IRC23:23
*** nicolasbock has quit IRC23:31
*** gyee has quit IRC23:32
*** gyee has joined #openstack-ansible23:35
*** gyee has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!