Monday, 2021-06-07

*** LinPeiWen has joined #openstack-kolla00:34
*** jpic has quit IRC01:40
*** brtknr has quit IRC01:40
*** mrunge has quit IRC01:40
*** mgoddard has quit IRC03:33
*** mgoddard has joined #openstack-kolla03:33
*** sorin-mihai has joined #openstack-kolla04:44
*** shyamb has joined #openstack-kolla05:30
*** shyam89 has joined #openstack-kolla05:36
*** shyamb has quit IRC05:43
yoctozeptomorning06:17
hrwmorning06:17
*** lvdombrkr has joined #openstack-kolla06:27
*** vishalmanchanda has joined #openstack-kolla06:33
*** luksky has joined #openstack-kolla06:45
*** shyam89 has quit IRC07:11
*** lvdombrkr89 has joined #openstack-kolla07:12
*** lvdombrkr has quit IRC07:16
*** andrewbonney has joined #openstack-kolla07:21
*** rpittau|afk is now known as rpittau07:26
mnasiadkamorning07:31
parallaxhi07:33
*** brtknr has joined #openstack-kolla07:42
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible master: Add forgotten 'Restart container' handler for swift  https://review.opendev.org/c/openstack/kolla-ansible/+/79503007:50
mgoddardmorning08:02
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible master: Add forgotten 'Restart container' handler for swift  https://review.opendev.org/c/openstack/kolla-ansible/+/79503008:02
*** shyamb has joined #openstack-kolla08:08
opendevreviewJohn Garbutt proposed openstack/kolla-ansible master: Improve docs on rabbitmq tuning params  https://review.opendev.org/c/openstack/kolla-ansible/+/79480508:09
opendevreviewMark Goddard proposed openstack/kolla master: horizon: add various dashboard plugins for ubuntu/binary  https://review.opendev.org/c/openstack/kolla/+/79505408:09
opendevreviewJohn Garbutt proposed openstack/kolla-ansible master: Reduce Rabbit busy waiting, lowering CPU load  https://review.opendev.org/c/openstack/kolla-ansible/+/72337408:13
opendevreviewJohn Garbutt proposed openstack/kolla-ansible master: Robustify elasticserach output tag matching  https://review.opendev.org/c/openstack/kolla-ansible/+/79465208:16
opendevreviewJohn Garbutt proposed openstack/kolla-ansible master: Robustify fluentd output tag matching  https://review.opendev.org/c/openstack/kolla-ansible/+/79465208:16
*** shyam89 has joined #openstack-kolla08:24
*** jpic has joined #openstack-kolla08:29
*** shyamb has quit IRC08:29
*** fuhrmannb|2 has quit IRC08:34
*** fuhrmannb|2 has joined #openstack-kolla08:36
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible master: Add forgotten 'Restart container' handler for swift  https://review.opendev.org/c/openstack/kolla-ansible/+/79503008:36
opendevreviewPiotr Parczewski proposed openstack/kolla-ansible master: Reduce container metrics cardinality  https://review.opendev.org/c/openstack/kolla-ansible/+/78388708:46
*** kklimonda has joined #openstack-kolla08:51
opendevreviewMerged openstack/kolla-ansible master: chrony: allow to remove the container  https://review.opendev.org/c/openstack/kolla-ansible/+/79211908:55
opendevreviewMark Goddard proposed openstack/kayobe master: CI: test base container image build in seed jobs  https://review.opendev.org/c/openstack/kayobe/+/79460108:55
opendevreviewMerged openstack/kolla-ansible master: Bump min Docker version  https://review.opendev.org/c/openstack/kolla-ansible/+/79258309:00
opendevreviewMark Goddard proposed openstack/kayobe master: Ubuntu: ensure /usr/bin/python is python3  https://review.opendev.org/c/openstack/kayobe/+/79506809:02
opendevreviewPiotr Parczewski proposed openstack/kolla-ansible master: Reduce container metrics cardinality  https://review.opendev.org/c/openstack/kolla-ansible/+/78388709:03
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/wallaby: chrony: allow to remove the container  https://review.opendev.org/c/openstack/kolla-ansible/+/79503609:08
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/wallaby: Bump min Docker version  https://review.opendev.org/c/openstack/kolla-ansible/+/79503709:08
*** gfidente has joined #openstack-kolla09:27
jpichi all, is it possible that I need to retry this build ? https://zuul.opendev.org/t/openstack/build/938e9111ca6b47c7a27f92e5f75a6aa6 because I'm not convinced that this patch would break it https://review.opendev.org/c/openstack/kolla/+/79415309:32
opendevreviewTakashi Kajinami proposed openstack/kolla master: Horizon: Install policy files for manila-ui  https://review.opendev.org/c/openstack/kolla/+/79491009:33
jpicI would really like to have that in master during the next days if possible (support for pip install --user kolla-ansible)09:33
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/wallaby: grafana: add bootstrap during upgrade  https://review.opendev.org/c/openstack/kolla-ansible/+/79507209:37
yoctozeptojpic: yeah, that failure is seemingly irrelevant09:38
yoctozeptoI left some comments09:38
opendevreviewMark Goddard proposed openstack/kayobe master: CI: test base container image build in seed jobs  https://review.opendev.org/c/openstack/kayobe/+/79460109:42
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible master: Add forgotten 'Restart container' handler for swift  https://review.opendev.org/c/openstack/kolla-ansible/+/79503009:44
opendevreviewjpic proposed openstack/kolla master: Fix _get_images_dir when pip-installed with --user  https://review.opendev.org/c/openstack/kolla/+/79415309:50
jpicI assumed I wasn't supposed to copy/paste the whole git commit message and went for a short release note, inspired by another release note I found in the repo, please let me know if you require any more detail in the release note09:51
yoctozeptojpic: it's very nice09:54
yoctozeptoyou missed my inline comment though09:54
opendevreviewjpic proposed openstack/kolla master: Fix _get_images_dir when pip-installed with --user  https://review.opendev.org/c/openstack/kolla/+/79415309:56
jpicindeed, sorry about that09:56
*** shyam89 has quit IRC10:02
*** shyamb has joined #openstack-kolla10:05
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible master: Add forgotten 'Restart container' handler for swift  https://review.opendev.org/c/openstack/kolla-ansible/+/79503010:06
opendevreviewMark Goddard proposed openstack/kolla-ansible master: Reduce RabbitMQ busy waiting, lowering CPU load  https://review.opendev.org/c/openstack/kolla-ansible/+/72337410:20
opendevreviewjpic proposed openstack/kolla-ansible master: Fix pip install --user --editable kolla-ansible-clone  https://review.opendev.org/c/openstack/kolla-ansible/+/79508310:27
jpicdo I need to open a launchpad bug for every patch or are some patches "so minor" that it's not required?10:29
mgoddardjpic: you can use a TrivialFix tag in the commit message, others will judge if it is actually trivial :)10:32
jpicok, please do not review my patches for now, as I discovered another use case I need to backport to the first patch, and the second is not documented, but I'm going to miss my train if I don't leave *now* :P10:35
mgoddardyoctozepto: did you notice this comma? https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/site.yml#L49210:51
mgoddardyoctozepto: which is referenced here: https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/rabbitmq/defaults/main.yml#L710:51
mgoddardyoctozepto: then here: https://opendev.org/openstack/kolla-ansible/src/branch/master/ansible/roles/rabbitmq/handlers/main.yml#L1010:52
mgoddardand I don't understand how that doesn't blow up10:52
mgoddardminimal reproducer blows up for me10:52
yoctozeptomgoddard: this comma is a part of yaml syntax10:53
yoctozeptowe are using an alternative dictionary syntax there10:53
yoctozeptowhich follows json rules10:53
mgoddardwha?10:53
yoctozeptoyup10:53
mgoddardyoctozepto: cannot make that work locally10:54
mgoddardeven so, it would end up indexing as groups[['rabbitmq']]10:55
yoctozeptomgoddard: https://yaml.org/spec/1.2/spec.html#id2790832 (this is 7.4.2 if the anchor fails)10:56
yoctozeptomgoddard: the rabbitmq group is fine, no? why double [ ?10:57
* mgoddard needed to zoom out10:58
mgoddarddoh10:58
* yoctozepto always here to reset my fellow koalas10:59
mnasiadkasounded like a huge red reset button ;)11:02
yoctozeptowhatever it takes!11:06
mnasiadkayoctozepto: this release blocker needs your attention - https://review.opendev.org/c/openstack/kolla/+/794589 ;)11:08
opendevreviewDoug Szumski proposed openstack/kolla master: Pin td-agent to 4.0.* to fix missing logs  https://review.opendev.org/c/openstack/kolla/+/79508611:08
yoctozeptolooking11:09
yoctozeptothat's wallaby+ only, right?11:09
yoctozeptodid you check debian?11:10
opendevreviewDoug Szumski proposed openstack/kolla master: Pin td-agent to 4.0.* to fix missing logs  https://review.opendev.org/c/openstack/kolla/+/79508611:10
yoctozeptoit looks like it should work11:12
yoctozeptoapproved11:12
*** shyamb has quit IRC11:14
*** kevko has joined #openstack-kolla11:16
opendevreviewMerged openstack/kayobe stable/wallaby: Optimise order of inspector_processing_hooks  https://review.opendev.org/c/openstack/kayobe/+/79481811:29
*** hrw has quit IRC11:30
*** hrw has joined #openstack-kolla11:32
mnasiadkaseems we're getting close to clean up the release blockers...11:35
yoctozeptowe surely are11:37
yoctozeptoalso, I'm going to get back to the cinder-ceph issue this week11:37
yoctozeptobut it's optional to fit in the releas11:37
opendevreviewMerged openstack/kolla-ansible stable/wallaby: chrony: allow to remove the container  https://review.opendev.org/c/openstack/kolla-ansible/+/79503611:39
*** stingrayza has joined #openstack-kolla11:40
hrwmorning11:41
*** luksky has quit IRC11:42
*** luksky has joined #openstack-kolla11:42
*** stingrayza is now known as also_stingrayza11:43
hrwdid someone had a situation when 'docker-ce' is installed but no docker0?11:44
*** also_stingrayza is now known as stingrayza11:44
hrwand no networking in containers11:45
*** stingrayza has left #openstack-kolla11:45
mnasiadkahrw: no networking in --network host ?11:46
mnasiadkas/in/with/11:46
hrwmnasiadka: with '--network host' it works11:46
hrwmnasiadka: but it is not default so I can not build images for example11:47
mnasiadkahrw: since we default to disabling bridge in Docker since Wallaby/master - maybe we should default to --network_mode host when building :)11:48
hrw;D11:48
hrwok, let me run with it11:49
hrwthanks mnasiadka11:49
opendevreviewMichal Nasiadka proposed openstack/kolla master: Change network_mode default to host  https://review.opendev.org/c/openstack/kolla/+/79508911:58
*** jpic has quit IRC12:02
*** stingrayza has joined #openstack-kolla12:02
opendevreviewMark Goddard proposed openstack/kolla-ansible master: Fix RabbitMQ restart ordering  https://review.opendev.org/c/openstack/kolla-ansible/+/79509112:11
opendevreviewMichal Nasiadka proposed openstack/kolla master: Change network_mode default to host  https://review.opendev.org/c/openstack/kolla/+/79508912:18
opendevreviewMark Goddard proposed openstack/kolla-ansible master: Reduce RabbitMQ busy waiting, lowering CPU load  https://review.opendev.org/c/openstack/kolla-ansible/+/72337412:18
opendevreviewMerged openstack/kolla master: Add missing default policy files for ubuntu-binary-horizon  https://review.opendev.org/c/openstack/kolla/+/79458912:29
oklhosthello. enable_neutron_qos: "yes" in globals.conf causes random neutron_server container restarts: 2021-06-07 14:30:35.395 7 ERROR neutron neutron.plugins.ml2.common.exceptions.ExtensionDriverNotFound: Extension driver qos required for service plugin qos not found. Ubuntu/Victoria12:31
yoctozeptooklhost: binary or source?12:32
oklhostsorry, source12:33
mnasiadkaqos should be in-tree, so probably enabling debug and a bigger logs snippet will be required12:37
opendevreviewMichal Nasiadka proposed openstack/kolla master: Change network_mode default to host  https://review.opendev.org/c/openstack/kolla/+/79508912:40
yoctozeptomnasiadka: it seems it sees the service plugin, but not the ml2 extension driver though12:41
yoctozeptobut it should be in tree nonetheless12:41
yoctozeptoand present in source too12:41
opendevreviewRadosÅ‚aw Piliszek proposed openstack/kolla stable/wallaby: Add missing default policy files for ubuntu-binary-horizon  https://review.opendev.org/c/openstack/kolla/+/79503812:41
oklhostyoctozepto, mnasiadka: http://paste.openstack.org/show/806418/ maybe this is more informational.12:46
oklhostI enabled debug logging and will run reconfigure now12:48
opendevreviewMerged openstack/kolla-ansible stable/wallaby: Bump min Docker version  https://review.opendev.org/c/openstack/kolla-ansible/+/79503712:49
opendevreviewMerged openstack/kolla-ansible stable/wallaby: grafana: add bootstrap during upgrade  https://review.opendev.org/c/openstack/kolla-ansible/+/79507212:50
opendevreviewjinyuanliu proposed openstack/kolla master: venus: add log management system  https://review.opendev.org/c/openstack/kolla/+/79379512:50
opendevreviewjinyuanliu proposed openstack/kolla-ansible master: ADD venus for kolla-ansible  https://review.opendev.org/c/openstack/kolla-ansible/+/79389713:00
oklhostMhm... not really more to see.13:03
yoctozeptowell, debug at least shows the current config13:09
yoctozeptoperhaps something wrong there13:09
oklhostI'll dig deeper tomorrow and keep you updated, my two ladies (girlfriend and dog) want go out now. ;)13:11
opendevreviewMark Goddard proposed openstack/kayobe master: CI: test base container image build in seed jobs  https://review.opendev.org/c/openstack/kayobe/+/79460113:22
*** mrunge has joined #openstack-kolla13:32
*** samcat116 has joined #openstack-kolla13:34
*** samcat116 has quit IRC13:47
*** samcat116 has joined #openstack-kolla13:48
opendevreviewMark Goddard proposed openstack/kayobe master: WIP: Test control plane deployment using tenks  https://review.opendev.org/c/openstack/kayobe/+/62007413:57
*** samcat11_ has joined #openstack-kolla14:14
*** sorin-mihai has quit IRC14:15
opendevreviewMark Goddard proposed openstack/kayobe master: Revert "Use OpenStack Wallaby release"  https://review.opendev.org/c/openstack/kayobe/+/79176414:21
opendevreviewMark Goddard proposed openstack/kayobe master: Use ansible_facts to reference facts  https://review.opendev.org/c/openstack/kayobe/+/79130414:21
opendevreviewjpic proposed openstack/kolla-ansible master: Fix pip install --user --editable kolla-ansible  https://review.opendev.org/c/openstack/kolla-ansible/+/79508314:22
*** samcat116 has quit IRC14:22
opendevreviewjpic proposed openstack/kolla-ansible master: Fix pip install --user --editable kolla-ansible  https://review.opendev.org/c/openstack/kolla-ansible/+/79508314:30
*** jpic has joined #openstack-kolla14:32
opendevreviewMark Goddard proposed openstack/kayobe master: WIP: add support for molecule  https://review.opendev.org/c/openstack/kayobe/+/79511614:32
*** jpic has quit IRC14:33
*** samcat11_ has quit IRC14:33
opendevreviewMark Goddard proposed openstack/kayobe master: WIP: Test control plane deployment using tenks  https://review.opendev.org/c/openstack/kayobe/+/62007414:47
*** wuchunyang has joined #openstack-kolla14:59
opendevreviewVerification of a change to openstack/kayobe failed: Fix container image builds  https://review.opendev.org/c/openstack/kayobe/+/79459915:12
opendevreviewMark Goddard proposed openstack/kayobe master: Fix container image builds  https://review.opendev.org/c/openstack/kayobe/+/79459915:19
opendevreviewMark Goddard proposed openstack/kayobe master: CI: test base container image build in seed jobs  https://review.opendev.org/c/openstack/kayobe/+/79460115:27
*** wuchunyang has quit IRC15:40
*** gfidente has quit IRC15:59
*** rpittau is now known as rpittau|afk16:01
opendevreviewMerged openstack/kolla stable/wallaby: Add missing default policy files for ubuntu-binary-horizon  https://review.opendev.org/c/openstack/kolla/+/79503816:06
opendevreviewMark Goddard proposed openstack/kayobe master: WIP: add support for molecule  https://review.opendev.org/c/openstack/kayobe/+/79511616:23
*** shyamb has joined #openstack-kolla16:25
*** shyamb has quit IRC16:27
opendevreviewMark Goddard proposed openstack/kayobe master: CI: test base container image build in seed jobs  https://review.opendev.org/c/openstack/kayobe/+/79460116:41
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible stable/ussuri: neutron: Add become for copying sriov_agent.ini  https://review.opendev.org/c/openstack/kolla-ansible/+/79515716:58
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible stable/ussuri: neutron: Add become for copying sriov_agent.ini  https://review.opendev.org/c/openstack/kolla-ansible/+/79515717:00
*** fuhrmannb|2 has quit IRC17:04
*** andrewbonney has quit IRC17:04
*** hrw has quit IRC17:55
*** hrw has joined #openstack-kolla17:58
*** hrw is now known as Guest117517:59
opendevreviewMerged openstack/kayobe master: chrony: cleanup during overcloud host upgrade  https://review.opendev.org/c/openstack/kayobe/+/79224318:05
opendevreviewMerged openstack/kayobe master: Ubuntu: ensure /usr/bin/python is python3  https://review.opendev.org/c/openstack/kayobe/+/79506818:05
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible master: Add forgotten 'Restart container' handler for swift  https://review.opendev.org/c/openstack/kolla-ansible/+/79503018:15
*** Guest1175 is now known as hrw18:59
*** hrw is now known as Guest118719:00
*** kevko has quit IRC19:02
*** vishalmanchanda has quit IRC19:12
*** kevko has joined #openstack-kolla19:30
*** lvdombrkr89 has quit IRC19:46
*** lvdombrkr has joined #openstack-kolla19:49
*** Guest1187 is now known as hrw20:00
*** hrw is now known as Guest119720:01
opendevreviewPierre Riteau proposed openstack/kayobe stable/wallaby: chrony: cleanup during overcloud host upgrade  https://review.opendev.org/c/openstack/kayobe/+/79517820:28
opendevreviewPierre Riteau proposed openstack/kayobe stable/wallaby: Ubuntu: ensure /usr/bin/python is python3  https://review.opendev.org/c/openstack/kayobe/+/79517920:30
*** lvdombrkr has quit IRC20:52
*** redcavalier has joined #openstack-kolla20:53
*** kevko has quit IRC20:54
redcavalierI've been testing out kolla in my staging environment with an older ceph cluster as backend (nautilus). The cluster is set to have cinder use an erasure-coded pool. However, despite the ceph client being properly configured, cinder can't seem to write anything in the erasure-coded pool (it writes the rbd header in the replicated pool though).20:55
redcavalierI get no error at all in cinder-volume, only that the volume was created succesfully. Yet, no new object's written in the pool and the VM won't boot on the RBD.20:57
redcavalierFurthermore, cirros works, but any other OS that's bigger doesn't.20:57
redcavalier(I also have data pool set in my config and I doublechecked it's there in the container)20:58
*** Guest1197 is now known as hrw21:01
*** hrw is now known as Guest120821:02
*** kevko has joined #openstack-kolla21:03
*** luksky has quit IRC21:34
*** Guest1208 is now known as hrw22:02
*** hrw is now known as Guest121722:03
*** hrww has joined #openstack-kolla22:13
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible master: Add forgotten 'Restart container' handler for swift  https://review.opendev.org/c/openstack/kolla-ansible/+/79503022:14
*** Guest1217 has quit IRC22:15
*** redcavalier has quit IRC22:29
*** hrww is now known as hrw23:03
*** hrw is now known as Guest122123:04
*** kevko has quit IRC23:20
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible master: Add forgotten 'Restart container' handler for swift  https://review.opendev.org/c/openstack/kolla-ansible/+/79503023:49
opendevreviewMerged openstack/kayobe master: Fix container image builds  https://review.opendev.org/c/openstack/kayobe/+/79459923:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!