Wednesday, 2019-11-20

« Tuesday, 2019-11-19 Index Thursday, 2019-11-21 »
*** duksoo has joined #openstack-kolla00:52
*** goldyfruit_ has joined #openstack-kolla01:07
*** goldyfruit_ has quit IRC01:58
*** igordc has quit IRC02:18
*** goldyfruit_ has joined #openstack-kolla03:28
*** vmixor has quit IRC03:36
*** msalo has joined #openstack-kolla04:48
*** msalo has quit IRC04:52
*** goldyfruit_ has quit IRC05:00
*** skramaja has joined #openstack-kolla05:07
*** pcaruana has joined #openstack-kolla05:25
*** sri_ has joined #openstack-kolla05:43
*** zhanglong has joined #openstack-kolla06:20
osmanlicilegimorning06:58
*** dpawlik has joined #openstack-kolla07:14
sri_morning, quick question, when we set swift_devices_match_mode to prefix do we still need to create swift Rings ?07:18
Blinkizyoctozepto: Good morning. Can you please help me find where it failed on https://review.opendev.org/692179 . I can not find the error line in zuul logs but zuul says it failed.07:29
patchbotpatch 692179 - kolla-ansible - OpenStack cloud administration authentication. Use... - 15 patch sets07:29
mnasiadkaBlinkiz: https://zuul.opendev.org/t/openstack/build/2bcaa456a286465380fd7f66858266d8/log/primary/logs/ansible/init-runonce#2807:32
mnasiadkaBlinkiz: init-runonce failed07:32
Blinkizmnasiadka: Okay. Nice. How did you find that error?07:35
mnasiadkaBlinkiz: if you look at 'Console' view - https://zuul.opendev.org/t/openstack/build/2bcaa456a286465380fd7f66858266d8 - check the last line - this is where it failed07:36
mnasiadkaBlinkiz: and then click at logs, expand primary/logs/ansible - this is where all deployment logs land07:36
Blinkizmnasiadka: aha, okay. Got it!07:36
*** priteau has quit IRC07:38
*** dpawlik has quit IRC07:56
yoctozeptomorning08:03
mnasiadkamorning yoctozepto08:15
*** dpawlik has joined #openstack-kolla08:21
BlinkizOkay. So i have fixed tools/init-runonce and am about to upload that into opendev. Last time my commit message become the subject line of "Change 692179". Am I not supposed to write commit message explaining what I have changed?08:23
BlinkizThis will be my second time uploading to opendev, that is why am asking :-)08:23
yoctozeptoBlinkiz: if you are amending a change, then you should amend the commit - not sure if that is what you are asking about :-)08:31
mnasiadkaBlinkiz: have you read this https://docs.openstack.org/infra/manual/developers.html ?08:33
mnasiadkaespecially https://docs.openstack.org/infra/manual/developers.html#updating-a-change08:34
Blinkizmnasiadka: I have not. Thanks, I read that page08:35
*** ivve has joined #openstack-kolla08:36
*** vrdel has joined #openstack-kolla08:44
openstackgerritNiklas Hagman proposed openstack/kolla-ansible master: Support for Keystone scoped authentication  https://review.opendev.org/69217908:51
*** rpittau|afk is now known as rpittau08:53
hrwmorning08:53
hrwmnasiadka: delegate patch failed badly I see ;(09:01
mnasiadkahrw: let me check09:03
mnasiadkawell, pep8 sure09:03
mnasiadkaInternal Server Error (\"Get https://registry-1.docker.io/v2/kolla/ubuntu-source-glance-api/manifests/master: received unexpected HTTP status: 500 Internal Server Error\")\\n'09:04
mnasiadkaekhm09:04
mnasiadkathat's not my/our wrongdoing :D09:04
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: Change local_action to delegate_to: localhost  https://review.opendev.org/69495909:04
mnasiadkafixed pep8, let's see how it fails now09:05
hrw;D09:14
openstackgerritDincer Celik proposed openstack/kolla master: WIP: Upgrade RabbitMQ to 3.8  https://review.opendev.org/69479909:15
*** dougsz has joined #openstack-kolla09:17
openstackgerritDincer Celik proposed openstack/kolla master: WIP: Upgrade RabbitMQ to 3.8  https://review.opendev.org/69479909:21
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Add CentOS/source aarch64 experimental job  https://review.opendev.org/66245609:25
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Add Debian/source aarch64 experimental job  https://review.opendev.org/55765909:25
hrwlet's see how it will fail09:25
*** msalo has joined #openstack-kolla09:29
*** dpawlik has quit IRC09:45
*** priteau has joined #openstack-kolla09:52
*** gfidente has joined #openstack-kolla09:55
*** jovial[m] has joined #openstack-kolla10:04
*** priteau has quit IRC10:06
*** msalo has quit IRC10:13
*** msalo has joined #openstack-kolla10:13
hrwmnasiadka: +210:25
mnasiadkahrw: it was too easy ;)10:26
hrwmnasiadka: and still needed10:26
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible master: Some ansible-lint fixes  https://review.opendev.org/69479710:27
hrwrebased10:27
*** vrdel has quit IRC10:29
openstackgerritNiklas Hagman proposed openstack/kolla-ansible master: Support for Keystone scoped authentication  https://review.opendev.org/69217910:29
*** zhanglong has quit IRC10:46
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible master: Get rid of Python 2 support  https://review.opendev.org/69516810:49
hrwsimple removal of six10:49
openstackgerritMarcin Juszkiewicz proposed openstack/kolla master: Get rid of Python 2 support  https://review.opendev.org/69131610:50
hrwrebased10:50
*** dpawlik has joined #openstack-kolla10:51
hrwyoctozepto, mgoddard: https://review.opendev.org/#/c/694959 passed zuul11:01
patchbotpatch 694959 - kolla-ansible - Change local_action to delegate_to: localhost - 10 patch sets11:01
openstackgerritMichal Nasiadka proposed openstack/kolla master: Update skydive version to 0.26.0  https://review.opendev.org/69517011:07
*** PrinzElvis has quit IRC11:08
*** vmixor has joined #openstack-kolla11:11
*** dpawlik has quit IRC11:12
mnasiadkayoctozepto, hrw: the libssl-dev thing seems like not up to date openstack-infra mirrors... any idea when those get updated?11:52
hrwmnasiadka: give me link to failed job please11:52
yoctozeptomnasiadka: I guess a few times each day11:52
yoctozeptothere must be something wrong with runs11:52
mnasiadkahttps://046b6520e005cc815b3d-5ba6792c7427741c3f6f06d35721722e.ssl.cf5.rackcdn.com/695170/1/check/kolla-build-ubuntu-source/808dffa/kolla/build/000_FAILED_kolla-toolbox.txt.gz11:52
yoctozeptoor the mirror has broken metadata...11:53
yoctozeptoall ubuntu fail now11:53
yoctozepto:/11:53
mnasiadka18.04.5 is available directly from archive.ubuntu.com11:53
mnasiadkabut not from infra mirror11:53
hrwok.11:53
hrwsomeone spoke with infra? if not they I will11:53
mnasiadkanot yet, feel free to nag :)11:53
yoctozeptofeel free to ask for us11:54
hrwon it11:54
hrwis it only on that mirror or happened on ohters too?11:56
hrw12:57 < frickler> hrw: we have an issue with afs volumes in general, not sure about the current state, but this is being handled already11:57
hrwso fixes in progress11:58
yoctozeptoon all12:02
yoctozeptoso it's afs again, eh12:02
*** skramaja has quit IRC12:02
mnasiadkahrw: I saw it multiple times, yoctozepto is complaining also, so I guess not only this mirror12:03
hrwhttps://review.opendev.org/#/c/694797 goes nicely12:11
patchbotpatch 694797 - kolla-ansible - Some ansible-lint fixes - 3 patch sets12:11
hrw~botsnack12:11
*** PrinzElvis has joined #openstack-kolla12:15
*** dave-mccowan has quit IRC12:17
*** kplant has joined #openstack-kolla12:21
*** pcaruana has quit IRC12:24
*** msalo has quit IRC12:31
*** msalo has joined #openstack-kolla12:31
*** msalo has quit IRC12:32
hrwwhat would be easiest way to switch kolla-ansible's job's ansible to use py3?12:33
hrwansible.cfg with "ansible_python_interpreter=/usr/bin/python3" in it?12:33
hrwor just add it to zuul.d/base.yaml as one of vars?12:35
mgoddardhrw: there is also the local interpreter12:35
hrwmgoddard: both into kolla-ansible-base.vars in zuul.d/base.yaml, right?12:36
mgoddardhttps://docs.ansible.com/ansible/latest/reference_appendices/python_3_support.html12:36
mgoddardhrw: if we don't need to support py2 and py3, it's probably not necessary in zuul config12:37
hrwmgoddard: want to check in my 'go away py2' patch12:37
mgoddardhrw: I would do, but head down on a nova bug12:38
hrwnp12:38
*** dr_feelgood has joined #openstack-kolla12:40
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible master: Get rid of Python 2 support  https://review.opendev.org/69516812:41
*** pcaruana has joined #openstack-kolla12:50
kplantmgoddard: is there an easy path to 'graduate' an existing deployment from k-a to kob?12:54
mgoddardkplant: in theory, yes. We haven't tried it yet but it's on our list of things to do and document12:55
mgoddardkplant: are you interested or asking for a friend? :)12:55
kplantcurrently i use cobbler, but that's not very sexy anymore12:55
kplanti'm looking to automate the entire deployment from zero, kayobe looks to be a good chunk of that12:56
mgoddardkplant: a good starting point is to grab your /etc/kolla/ and place it in etc/kayobe/kolla/ in a kayobe-config repo (https://opendev.org/openstack/kayobe-config/)12:57
kplantalthough i've had bad experience with ironic killing idracs until they're hard rebooted (weird)12:57
mgoddardhmm, nasty12:57
kplantyeah.. with both the idrac driver and the redfish driver12:57
kplantcould never figure it out12:57
mgoddardwe typically use ipmitool drivers with idracs12:58
*** goldyfruit_ has joined #openstack-kolla12:59
mnasiadkain the end everybody uses ipmitool ;)12:59
kplantpls no :-(13:00
kplantipmi is the actual devil13:00
mnasiadkakplant: well, redfish is not better ;)13:00
kplantthe problem is it's a "standard" that everyone does differently13:00
kplantwhich is kind of unacceptable13:00
hrwipmitool...13:00
*** vmixor has quit IRC13:00
hrwI had to use two ipmitool binaries. one for every machine except that one which required a bit older one13:01
*** priteau has joined #openstack-kolla13:05
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: Fix deployment of Qinling  https://review.opendev.org/69519013:10
*** msalo has joined #openstack-kolla13:11
mnasiadkakplant: well, it's a standard with downstream changes - the worst thing is they are changing fundamentals (like API endpoint urls) :)13:13
mnasiadkakplant: it's like the OCP - in theory there are standards there, but who cares?13:14
*** goldyfruit_ has quit IRC13:16
openstackgerritMarcin Juszkiewicz proposed openstack/kolla-ansible master: Get rid of Python 2 support  https://review.opendev.org/69516813:18
*** dave-mccowan has joined #openstack-kolla13:22
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: WIP: CI: Test deployment of Qinling  https://review.opendev.org/69519213:25
*** vmixor has joined #openstack-kolla13:26
*** rouk has quit IRC13:28
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: WIP: CI: Test deployment of Qinling  https://review.opendev.org/69519213:28
*** vmixor has quit IRC13:31
*** mixor has joined #openstack-kolla13:31
*** mixor has quit IRC13:31
*** mixor has joined #openstack-kolla13:32
*** mixor is now known as vmixor13:32
openstackgerritViktor Michalek proposed openstack/kolla-ansible master: Neutron: Added loading ip6_tables kernel module  https://review.opendev.org/68596513:36
openstackgerritMichal Nasiadka proposed openstack/kolla-ansible master: WIP: Add additional logs for submit-logstash-jobs  https://review.opendev.org/69519713:38
*** dpawlik has joined #openstack-kolla13:39
*** priteau has quit IRC14:11
*** priteau has joined #openstack-kolla14:12
*** priteau has quit IRC14:13
*** msalo_ has joined #openstack-kolla14:17
*** msalo has quit IRC14:20
*** sri_ has quit IRC14:21
openstackgerritMichal Nasiadka proposed openstack/kolla master: Fix skydive source images  https://review.opendev.org/69520214:22
*** msalo has joined #openstack-kolla14:24
*** msalo_ has quit IRC14:27
*** munimeha1 has joined #openstack-kolla14:32
openstackgerritPierre Riteau proposed openstack/kayobe master: Add docker_registry_mirrors to docker.yml  https://review.opendev.org/69520614:33
*** msalo_ has joined #openstack-kolla14:37
*** msalo has quit IRC14:38
*** msalo has joined #openstack-kolla14:38
*** PrinzElvis has quit IRC14:38
*** msalo_ has quit IRC14:42
*** goldyfruit_ has joined #openstack-kolla14:43
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: WIP: CI: Test deployment of Qinling  https://review.opendev.org/69519214:48
mnasiadkamgoddard: do we have the meeting today? :)14:58
mgoddardmnasiadka: yep14:59
*** msalo has quit IRC14:59
yoctozeptomgoddard: then it's like in 2 secs14:59
*** msalo has joined #openstack-kolla15:00
yoctozepto:-)15:00
mgoddardpatience!15:00
mgoddard#startmeeting kolla15:00
openstackMeeting started Wed Nov 20 15:00:20 2019 UTC and is due to finish in 60 minutes.  The chair is mgoddard. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: kolla)"15:00
openstackThe meeting name has been set to 'kolla'15:00
mgoddardping mgoddard mnasiadka hrw egonzalez yoctozepto rafaelweingartne15:00
mgoddard#topic rollcall15:00
*** openstack changes topic to "rollcall (Meeting topic: kolla)"15:00
mgoddard\o15:00
mnasiadkao/15:00
yoctozeptoo/15:00
osmanlicilegio/15:02
openstackgerritZhuo Zhen proposed openstack/kolla-ansible master: Fix hard-coded admin project name and username in blazar task  https://review.opendev.org/69521415:02
mgoddard#topic agenda15:03
*** openstack changes topic to "agenda (Meeting topic: kolla)"15:03
mgoddard* Roll-call15:03
hrwo\15:03
mgoddard* Announcements15:03
mgoddard ** yoctozepto wishes to invite people to Białystok (on 2020-02-04) to talk about clouds (will explain)15:03
mgoddard* Review action items from last meeting15:03
mgoddard* CI status15:03
mgoddard* Train release planning15:03
mgoddard ** old Erlang for RMQ still scary: https://bugs.launchpad.net/kolla/+bug/1853167 - better update and take the risk of upgrade or leave it b0rken?15:03
openstackLaunchpad bug 1853167 in kolla ussuri "CentOS RabbitMQ Unsupported Erlang Version" [Medium,Triaged] - Assigned to Radosław Piliszek (yoctozepto)15:03
mgoddard* Ussuri release planning15:03
mgoddard* Review priorities15:03
mgoddard#topic announcements15:03
*** openstack changes topic to "announcements (Meeting topic: kolla)"15:03
mgoddard#info yoctozepto wishes to invite people to Białystok (on 2020-02-04) to talk about clouds (will explain)15:03
yoctozeptoyes, exactly15:03
yoctozeptowe are organizing a little conference15:04
hrwyoctozepto: bad timing - right after fosdem15:04
*** msalo has quit IRC15:04
yoctozeptonot me to decide, maybe I can still get some of you to join15:04
yoctozeptoI can let bosses know about it but that's it :-)15:04
yoctozeptothe point is15:04
mnasiadkafosdem, maybe I would finally go ;)15:05
yoctozeptoI have money to spend on one international (read: european) guest and one local guest15:05
yoctozeptoit would cover travel and accommodation costs15:05
*** duksoo has quit IRC15:05
mgoddardThanks for sharing yoctozepto, keep us updated with details15:06
yoctozeptothe auditorium would consist of academia and education workers (i.e. researchers and educators plus other staff), students and local IT business people15:06
yoctozeptotopics include15:06
yoctozeptocloud for hpc15:06
yoctozeptocloud for science15:06
yoctozeptoscience for cloud15:07
yoctozeptohence asking around ppl from the so-called stackhpc company :-)15:07
yoctozeptoI will let you know if I can amend the schedule still15:07
yoctozeptobut please let me know if you are interested at any rate15:08
*** msalo has joined #openstack-kolla15:08
mgoddardwhat sort of size do you expect the event to be?15:08
*** dpawlik has quit IRC15:08
yoctozeptoone day, about 6-7 presenters15:09
*** johnthetubaguy has joined #openstack-kolla15:09
yoctozeptomostly depends on who I and others manage to "hire"15:09
mgoddardsounds like an interesting event15:10
*** JamesBenson has joined #openstack-kolla15:11
mgoddardI'll pass it on15:11
mgoddard#topic Review action items from last meeting15:11
yoctozeptothanks, mgoddard15:11
*** openstack changes topic to "Review action items from last meeting (Meeting topic: kolla)"15:11
mgoddardmgoddard to check stable/train backports15:11
mgoddardyoctozepto: to get in touch with cloudnull and find a time to discuss kolla image consumers, e.g. next week's meeting15:11
yoctozeptoI notified cloudnull15:11
mgoddardI did mine, although it's an ongoing effort15:11
yoctozeptohe promised to be around15:11
yoctozeptochecking mine now15:11
cloudnullo/15:11
yoctozeptohah :D15:11
mgoddardhi cloudnull15:11
yoctozeptohi-ya15:11
JamesBensono/15:12
* cloudnull is around. though very split-brained, so situation normal :D 15:12
yoctozeptooh my15:12
yoctozeptoit can be cured15:12
mgoddardadded to agenda15:12
mgoddard#topic CI status15:12
*** openstack changes topic to "CI status (Meeting topic: kolla)"15:12
cloudnullhowever I am here for this meeting, and will do my best to not be distracted :D15:12
yoctozeptocloudnull: thanks15:12
mgoddardthanks cloudnull. I added it the end of the agenda15:13
mgoddardI've been a bit distracted from kolla this past week15:13
mgoddardI saw there were some ubuntu CI issues, possibly mirror related. Still present?15:13
yoctozeptostill a few hours ago15:14
yoctozeptono idea now15:14
yoctozeptochecked, last failure less than an hour ago15:14
mnasiadkaYeah, infra has some AFS problems, I saw they mentioned some lock issues ;-)15:15
yoctozeptoso still15:15
yoctozeptoso this week is kolla-release-less definitely15:15
mnasiadkayeah, especially we're failing on openssl update from bionic-security ;-)15:15
*** msalo has quit IRC15:15
yoctozeptoand we drop usage of infra mirrors as a workaround if they don't fix it by Friday lol15:15
mgoddardouch15:17
mgoddardhopefully they will15:17
* yoctozepto hopes too15:17
mgoddardany other CI issues?15:17
yoctozeptonah15:17
mgoddardcool15:18
mgoddard#topic Train release planning15:18
*** openstack changes topic to "Train release planning (Meeting topic: kolla)"15:18
mgoddardfrom agenda:15:18
mgoddardold Erlang for RMQ still scary: https://bugs.launchpad.net/kolla/+bug/1853167 - better update and take the risk of upgrade or leave it b0rken?15:18
openstackLaunchpad bug 1853167 in kolla ussuri "CentOS RabbitMQ Unsupported Erlang Version" [Medium,Triaged] - Assigned to Radosław Piliszek (yoctozepto)15:18
yoctozeptothe question is included15:19
mgoddardthis seems a bit nasty15:19
yoctozeptoupgrading would bring my plan to keep 3.7.x in train (stein?) but upgrade erlang to a supported version15:19
yoctozeptothe upgrade in stein was clumsy, discovered lated I know15:20
yoctozeptolate*15:20
hrwso I would need to prepare erlang 22 for aarch64?15:20
mgoddardhow does one install an updated erlang?15:20
yoctozeptomgoddard: rmq provides dedicated binaries15:21
yoctozeptofor x86_6415:21
yoctozeptothen we run their supported platform for rmq15:21
yoctozeptohrw would need to build for aarch64 to keep it on par15:21
mgoddardI assume this comes with all required libraries?15:21
yoctozeptootherwise we diverge with compatibility15:21
yoctozeptoyeah15:21
yoctozeptoonly hipe is gone now, from erlang vm  I mean15:22
yoctozeptobut that is upstream erlang thingy15:22
yoctozeptonot much on rmq or us15:22
mgoddardwould upgrading erlang cause any headaches on upgrades?15:24
mnasiadkarabbitmq equals headache I guess - so we can't be certain15:24
yoctozeptomgoddard: need to test that15:24
yoctozeptoconsidering it's actually erlang vm that does the heavy networking/clustering stuff15:25
mnasiadkabut the in place upgrade for rmq is 1) check that everything is stable 2) stop node 3) upgrade 4) start node15:25
yoctozeptoit could well cause some15:25
mnasiadkahttps://www.rabbitmq.com/upgrade.html#rolling-upgrades15:26
mnasiadka#link https://www.rabbitmq.com/upgrade.html#rolling-upgrades15:26
mgoddardit sounds like we need this long term. we probably need to try it out to decide on the risk/reward for a backport15:26
mgoddardis anyone actively working on it?15:26
yoctozeptomgoddard: nope but I can15:26
yoctozeptomnasiadka: I learn the chat bot collects all http stuff anyway, no #link needed15:27
yoctozeptolearnt*15:27
mnasiadkayoctozepto: allrighty15:27
yoctozeptoI asked to know if you are not 100% against15:27
yoctozepto:D15:27
yoctozeptoalso, it means work for hrw15:28
hrwwhich I would need to do in ussuri anyway15:28
yoctozeptoright you are, sir15:28
yoctozeptojust not it becomes urgent ;p15:28
yoctozeptonow*15:29
osmanlicilegiyoctozepto: I can adopt this bug if you let me. you know I have the upgrade bp also.15:29
yoctozeptoosmanlicilegi: yeah, you are welcome to - could you deliver something by tomorrow?15:29
osmanlicilegiI will15:30
mnasiadkayoctozepto: around erlang - have you tried to talk with the RDO guys to bump it up in RDO? (looking at the bug it's a bit non-compatible?)15:31
yoctozeptomnasiadka: we are using another source of rabbitmq15:31
mnasiadkaah, packagecloud I guess15:31
yoctozeptonot checked rdo version15:31
yoctozeptomaybe they package the right combination15:31
mnasiadkayoctozepto: well, RDO provides rmq 3.6.1615:32
mnasiadkaI doubt you are interested in that :)15:32
yoctozeptoyou have answered all the questions15:32
mnasiadka3.6 is end of life from May 2018? huh15:33
mnasiadkahttps://www.rabbitmq.com/versions.html15:33
mgoddardok, let's move on. Thanks to osmanlicilegi for picking it up, and yoctozepto for offering.15:36
mgoddardAre there any other train blockers?15:37
mgoddardOr should we consider putting out a GA release soon?15:37
mgoddardhttps://launchpad.net/kolla-ansible/+milestone/9.0.015:37
mgoddardhttps://bugs.launchpad.net/kolla-ansible/+bug/1853201 is marked high15:38
openstackLaunchpad bug 1853201 in kolla-ansible ussuri "deploy fails with qinling_dev_mod is undefined" [High,In progress] - Assigned to Radosław Piliszek (yoctozepto)15:38
yoctozeptomgoddard: already addressed15:38
yoctozeptowe add qinling in Train15:38
yoctozeptoand it seems b0rken since inception ;p15:38
mgoddardinterestingly, seems people run train on xenial15:38
*** msalo has joined #openstack-kolla15:39
yoctozeptoyeah, saw that15:39
mgoddardwell, needs to merge & backport to get into the releaase15:39
yoctozeptothough it does not break qinling15:39
yoctozeptoyeah15:39
yoctozeptoand it is still b0rken after that15:39
mgoddardmarked RP+115:39
yoctozeptohttps://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_593/695192/3/check/kolla-ansible-ubuntu-source-qinling/59377d1/primary/logs/ansible/deploy15:39
yoctozeptoso we need a patchset to get qinling to work15:39
yoctozeptonot tested = not working15:39
yoctozeptocite me15:40
mgoddardis that CI test new?15:40
mgoddardadded to reproduce?15:40
yoctozeptoyeah, I am trying to reproduce and fix15:40
mnasiadkawell, if we would have a support matrix for k-a, we could state qinling is not tested, and only community supported == bug priority is low15:41
yoctozeptomnasiadka: still, I feel bad having Qinling in prelude and knowing it failing ;p15:41
mgoddardgoldyfruit_ was the author of qinling, right15:41
mgoddardaround goldyfruit_?15:41
mgoddardare you planning to get qinling fixed before release yoctozepto?15:42
yoctozeptoyeah, that's my plan indeed15:42
mgoddardok15:42
mnasiadkawell, then we could have a CI with Magnum, Qinling and so on - I guess, but it wasn't done as part of pushing the actual code15:42
yoctozeptothe code looked nice overally15:42
yoctozeptoshould not be broken completely15:43
yoctozeptolet it at least deploy and answer on API :D15:43
mgoddardsure, that's a good start15:43
yoctozepto;P15:43
mgoddardwould be nice to get your CI test committed15:43
yoctozeptoyeah, when it is ready for it15:43
yoctozeptonow I am a bit glad that we might be bumping rmq for centos15:44
yoctozeptoit enables ipv6 as long as one does not need mariadb ha15:44
yoctozepto;D15:44
yoctozeptomakes our support sound much nicer15:44
* yoctozepto caring for its baby15:45
mgoddardI'll go through the in progress bugs and add RP+1 where possible15:45
yoctozeptohis*15:45
yoctozeptogeez, I write weird today15:45
mgoddard#topic Ussuri release planning15:45
*** openstack changes topic to "Ussuri release planning (Meeting topic: kolla)"15:45
yoctozeptomgoddard: nice, I tried keeping up with it15:45
goldyfruit_mgoddard, o/15:45
yoctozeptobut you are welcome to fill-in the gaps :-)15:45
goldyfruit_yoctozepto, o/15:46
yoctozeptogoldyfruit_: hi15:46
goldyfruit_What's wrong with Qinling?15:46
mgoddardoh hai goldyfruit_15:46
goldyfruit_We are using the master/train code from kolla-ansible to deploy Qinling15:46
yoctozeptogoldyfruit_: oddly, it does not deploy :-)15:46
yoctozeptounless you have the missing somewhere else15:46
goldyfruit_Hum15:46
yoctozeptolike in your inventories :-)15:47
mgoddardgoldyfruit_: https://bugs.launchpad.net/bugs/185320115:47
openstackLaunchpad bug 1853201 in kolla-ansible ussuri "deploy fails with qinling_dev_mod is undefined" [High,In progress] - Assigned to Radosław Piliszek (yoctozepto)15:47
yoctozeptoand after fixing that, another: https://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_593/695192/3/check/kolla-ansible-ubuntu-source-qinling/59377d1/primary/logs/ansible/deploy15:47
mgoddardmaybe you can work with yoctozepto to get it fixed15:47
yoctozeptoyeah, I appreciate being around for my questions if need be :-)15:47
mgoddardlet's move on15:48
goldyfruit_Will do my best to be around15:48
mgoddard#info Ussuri priority voting is finished15:48
mgoddard#link https://bugs.launchpad.net/bugs/185320115:48
openstackLaunchpad bug 1853201 in kolla-ansible ussuri "deploy fails with qinling_dev_mod is undefined" [High,In progress] - Assigned to Radosław Piliszek (yoctozepto)15:48
mgoddard#undo15:48
openstackRemoving item from minutes: #link https://bugs.launchpad.net/bugs/185320115:48
mgoddard#link https://etherpad.openstack.org/p/kolla-ussuri-priorities15:48
mgoddardI've ordered them, but they need some tidying up15:48
mgoddardremove our PTG discussion, replace with owners & status etc.15:49
yoctozeptomgoddard: will you handle this?15:50
mgoddardyes15:50
yoctozeptocool15:50
mgoddard#action mgoddard to tidy up ussuri priorities and add to whiteboard15:50
yoctozeptoI added ceilosca after the voting to let people know it is a valid option15:50
mgoddardfirst impressions - there are a lot of things listed15:50
yoctozepto;D15:50
mgoddardmaybe we should just have one liners for anything with X or less votes?15:51
mgoddarddoesn't mean we won't do it15:51
mnasiadkawell, ideally maybe not to pollute the whiteboard - we should have a bp link and an owner?15:51
osmanlicilegisounds better15:52
yoctozepto+115:52
mgoddardmeans we won't have it all in one place15:52
mgoddardwill be hard to see the TODO/unassigned tasks15:53
mgoddardI'll see how it looks after the tidy up15:54
mnasiadkawell, you click in the bp, and we can have dependencies, larger chunks of work tidied up and so on15:54
mgoddardoh ok15:54
mnasiadkaI just feel that we are too lazy to update the statuses in the whiteboard :)15:54
mgoddardyes15:55
mnasiadkaand if changes are bound to bp - those will be visible on the bp itself15:55
mgoddardand blueprints will not be automatically updated :)15:55
goldyfruit_the bug in qinling has been introduced by this: https://github.com/openstack/kolla-ansible/commit/e610a73e9863bcc63f6e6c907f7eb654aa1ee37f#diff-669ed79df1cdc81f33b7527aa8e1faba15:55
*** gfidente has quit IRC15:56
mgoddard#topic Image consumers15:56
*** openstack changes topic to "Image consumers (Meeting topic: kolla)"15:56
mnasiadkamgoddard: well, something will be updated there :)15:56
mgoddardcloudnull: ping15:56
cloudnullo/15:56
mgoddardyoctozepto: you're up15:56
yoctozeptogoldyfruit_: yeah, I felt you would not propose something broken right away :-)15:56
yoctozeptomgoddard: sure15:57
yoctozeptoso, I had this idea that we could document kolla consumers15:57
yoctozeptomostly about which images are used15:57
yoctozeptoconsumers actually consist of tripleo and k-a15:58
yoctozeptoso we do the k-a part15:58
yoctozeptobut someone needs to do the tripleo part15:58
yoctozeptoand, more importanlty, such that it will be kept up to date15:58
cloudnullOK. so you're looking for the list of images we use?15:58
mgoddardhttps://docs.openstack.org/kolla/latest/support_matrix.html15:58
yoctozeptolist of images is a start, but we would prefer to get consensus on how to keep it current15:59
cloudnullhum. how is that current list generated?16:00
mnasiadkait's not, but there's room for improvement - it's a csv :)16:00
cloudnullOK16:00
cloudnullhum...16:01
mgoddardwell that list is our support matrix. I think we're looking at a new table on that page16:01
cloudnullI can get you a list, and we can provide updated lists for new releases, but updating that CSV may be difficult from our point of view16:01
yoctozeptowe can do either in csv16:02
mgoddardI think what we'd be looking at is a list of:16:02
cloudnullin an automated fashion that is16:02
mgoddard<service> <TripleO (Y/N)> <Kolla Ansible (Y/N)>16:02
yoctozepto+116:03
yoctozeptoif changes are rare16:03
yoctozeptowe can as well synchronize on our cycle end16:03
openstackgerritViktor Michalek proposed openstack/kolla-ansible master: Adds support of CADF notifying for other APIs next to keystone.  https://review.opendev.org/67457916:04
mgoddardan alternative is that tripleo provides a list of containers they use which we could link to16:04
mnasiadkacloudnull: can't we generate a list of container images used by tripleo and then transform them into a csv that could be rendered by sphinx-doc?16:04
mgoddardSkipping back, I think the goal here is to have a place to check which downstream projects will be affected by a change to an image16:04
cloudnullmnasiadka you could16:05
yoctozeptomgoddard: yeah, exactly16:05
mnasiadkamgoddard: you were investigating the proposal bot for something similar, right?16:07
cloudnullif the goal is to notify potential consumers, then maybe a release note is all that is really required ?16:07
yoctozeptocloudnull: they would need aggregating16:07
mnasiadkaif somebody really reads the release notes... :)16:07
mgoddardcloudnull: I think we were hoping to encourage feedback earlier in the cycle than that16:08
mgoddardrather than hit you with it16:08
* cloudnull reads release notes 16:08
mgoddardthen find it doesn't work for tripleo and we need to revert16:08
cloudnull++16:08
cloudnullthis makes some sense16:08
*** ivve has quit IRC16:09
mgoddardanyway, we're out of time. Hopefully we've got the problem across. Implementation details can be determined down the line16:10
cloudnullI will work on getting you a list of images16:10
cloudnulland an easy way to pull that info16:10
mgoddardthanks16:10
cloudnullsomething that we will maintain as a downstream16:10
*** numans_ has quit IRC16:10
yoctozeptothanks, cloudnull16:10
mgoddardthanks all16:11
mgoddard#endmeeting16:11
*** openstack changes topic to "Topic for #openstack-kolla is: support: ask.openstack.org | New to Kolla: docs @ https://docs.openstack.org/kolla/latest/ | | Kolla IRC meetngs on Wednesdays @ 15:00 UTC - see agenda @ https://goo.gl/OXB0DL - IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b"16:11
openstackMeeting ended Wed Nov 20 16:11:12 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:11
openstackMinutes:        http://eavesdrop.openstack.org/meetings/kolla/2019/kolla.2019-11-20-15.00.html16:11
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/kolla/2019/kolla.2019-11-20-15.00.txt16:11
openstackLog:            http://eavesdrop.openstack.org/meetings/kolla/2019/kolla.2019-11-20-15.00.log.html16:11
*** numans has joined #openstack-kolla16:12
mnasiadkayoctozepto: didn’t we want also to talk about tripleo-ci containers build job, that always takes master branch instead of patchset?16:12
yoctozeptomnasiadka: I think that is a separate thing16:12
yoctozeptobut while cloudnull is around, we can always remind him :-)16:13
mnasiadkacloudnull: any plan to change it?:)16:13
*** dpawlik has joined #openstack-kolla16:18
yoctozeptoand we introduced the 2nd bug in qinling with https://review.opendev.org/645966 mgoddard, goldyfruit_16:19
patchbotpatch 645966 - kolla-ansible - Add a job that *only* deploys updated containers (MERGED) - 16 patch sets16:19
goldyfruit_yoctozepto, what is the bug introduced by this review?16:22
yoctozeptogoldyfruit_: the one I pasted, https://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_593/695192/3/check/kolla-ansible-ubuntu-source-qinling/59377d1/primary/logs/ansible/deploy16:23
goldyfruit_yoctozepto, missed this link, checking!16:24
goldyfruit_yoctozepto, yep, there is no environment variable into Qinling16:26
yoctozeptoyeah, fixing that later, I must attend to something else atm16:27
goldyfruit_I guest the commit has been prepared before this commit: https://github.com/openstack/kolla-ansible/commit/b1c28e95b0b661de3e9a227661bc771604c3f28a#diff-669ed79df1cdc81f33b7527aa8e1faba16:27
*** dpawlik has quit IRC16:29
* hrw off16:32
openstackgerritZhuo Zhen proposed openstack/kolla-ansible master: Fix hard-coded admin project name and username in blazar task  https://review.opendev.org/69521416:34
*** dpawlik has joined #openstack-kolla16:35
*** numans has quit IRC16:35
*** dougsz has quit IRC16:38
openstackgerritGaëtan Trellu proposed openstack/kolla-ansible master: Fix missing environment variable for Qinling  https://review.opendev.org/69524516:40
*** dpawlik has quit IRC16:41
*** k_mouza has joined #openstack-kolla16:46
*** k_mouza has quit IRC16:50
*** k_mouza has joined #openstack-kolla16:52
*** dougsz has joined #openstack-kolla16:53
*** goldyfruit___ has joined #openstack-kolla16:53
*** goldyfruit___ is now known as goldyfruit16:54
*** goldyfruit_ has quit IRC16:56
*** k_mouza_ has joined #openstack-kolla16:56
*** k_mouza has quit IRC16:57
*** gfidente has joined #openstack-kolla16:57
*** k_mouza_ has quit IRC16:58
*** k_mouza has joined #openstack-kolla16:58
*** vrdel has joined #openstack-kolla17:06
*** k_mouza has quit IRC17:07
*** k_mouza has joined #openstack-kolla17:09
yoctozeptogoldyfruit: I guess you couldn't wait :-)17:09
goldyfruityoctozepto, :)17:10
yoctozeptoI don't mind, though, sure better to review than author :-)17:11
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: CI: Test deployment of Qinling  https://review.opendev.org/69519217:12
*** dpawlik has joined #openstack-kolla17:12
*** rpittau is now known as rpittau|afk17:18
*** dpawlik has quit IRC17:21
yoctozeptogoldyfruit: since you are around: https://bugs.launchpad.net/kolla-ansible/+bug/184705017:22
openstackLaunchpad bug 1847050 in kolla-ansible "CI: masakari-instancemonitor reports an error" [Medium,Triaged]17:22
goldyfruityoctozepto, will check17:22
*** goldyfruit has quit IRC17:27
*** gfidente is now known as gfidente|afk17:28
*** goldyfruit has joined #openstack-kolla17:30
*** goldyfruit has quit IRC17:31
*** dpawlik has joined #openstack-kolla17:35
*** vrdel has quit IRC17:37
*** dpawlik has quit IRC17:51
*** k_mouza has quit IRC17:55
*** k_mouza has joined #openstack-kolla17:57
*** igordc has joined #openstack-kolla18:00
openstackgerritDoug Szumski proposed openstack/kolla master: Add Elasticsearch Curator Docker image  https://review.opendev.org/69434118:00
*** k_mouza has quit IRC18:00
*** dougsz has quit IRC18:00
*** jovial[m] has quit IRC18:04
*** k_mouza has joined #openstack-kolla18:05
*** k_mouza has quit IRC18:10
openstackgerritViktor Michalek proposed openstack/kolla-ansible master: Adds support of CADF notifying for other APIs next to keystone.  https://review.opendev.org/67457918:15
*** msalo has quit IRC18:25
*** msalo has joined #openstack-kolla18:25
*** msalo has quit IRC18:32
*** k_mouza has joined #openstack-kolla18:32
*** k_mouza has quit IRC18:37
*** k_mouza has joined #openstack-kolla18:46
openstackgerritRadosław Piliszek proposed openstack/kolla-ansible master: CI: Test deployment of Qinling  https://review.opendev.org/69519218:48
*** k_mouza_ has joined #openstack-kolla18:50
*** k_mouza has quit IRC18:50
*** bjoernt has quit IRC18:53
*** k_mouza_ has quit IRC18:54
openstackgerritMerged openstack/kolla-ansible master: Remove Neutron integration with ONOS  https://review.opendev.org/69479618:57
*** bjoernt has joined #openstack-kolla18:58
*** msalo has joined #openstack-kolla19:01
*** msalo has quit IRC19:06
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/stein: Fix restart policy after MariaDB recovery  https://review.opendev.org/69528919:11
openstackgerritMark Goddard proposed openstack/kolla-ansible stable/rocky: Fix restart policy after MariaDB recovery  https://review.opendev.org/69529019:12
*** munimeha1 has quit IRC19:29
*** k_mouza has joined #openstack-kolla19:50
*** k_mouza has quit IRC19:55
*** gfidente|afk has quit IRC20:12
*** k_mouza has joined #openstack-kolla20:22
*** k_mouza has quit IRC20:25
*** k_mouza has joined #openstack-kolla20:29
*** k_mouza has quit IRC20:32
*** k_mouza has joined #openstack-kolla20:38
*** k_mouza has quit IRC20:43
*** kplant has quit IRC20:53
*** msalo has joined #openstack-kolla20:54
*** k_mouza has joined #openstack-kolla21:00
*** k_mouza has quit IRC21:04
openstackgerritMerged openstack/kolla-ansible master: Fix missing environment variable for Qinling  https://review.opendev.org/69524521:07
*** msalo has joined #openstack-kolla21:18
openstackgerritMerged openstack/kolla-ansible master: Parse MariaDB log messages in different formats into Fluentd  https://review.opendev.org/68642821:21
*** msalo has quit IRC21:22
*** k_mouza has joined #openstack-kolla21:29
*** k_mouza has quit IRC21:33
*** msalo has joined #openstack-kolla21:37
*** pcaruana has quit IRC21:42
*** msalo has quit IRC21:46
*** k_mouza has joined #openstack-kolla22:01
*** vmixor has quit IRC22:02
*** k_mouza has quit IRC22:05
*** chrizl has joined #openstack-kolla22:06
*** k_mouza has joined #openstack-kolla22:07
*** k_mouza has quit IRC22:11
*** k_mouza has joined #openstack-kolla22:14
*** k_mouza has quit IRC22:15
*** k_mouza has joined #openstack-kolla22:15
*** k_mouza has quit IRC22:20
*** dave-mccowan has quit IRC22:29
*** JamesBen_ has joined #openstack-kolla22:31
*** JamesBen_ has quit IRC22:32
*** JamesBen_ has joined #openstack-kolla22:32
*** JamesBenson has quit IRC22:34
*** JamesBen_ has quit IRC22:36
*** k_mouza has joined #openstack-kolla22:42
*** k_mouza has quit IRC22:47
*** k_mouza has joined #openstack-kolla22:48
*** k_mouza has quit IRC22:52
*** k_mouza has joined #openstack-kolla23:15
*** k_mouza has quit IRC23:19
*** k_mouza has joined #openstack-kolla23:20
*** k_mouza has quit IRC23:24
*** k_mouza has joined #openstack-kolla23:38
*** k_mouza has quit IRC23:43
*** zhanglong has joined #openstack-kolla23:54
*** k_mouza has joined #openstack-kolla23:55
*** zhanglong has quit IRC23:59
« Tuesday, 2019-11-19 Index Thursday, 2019-11-21 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!