Tuesday, 2020-08-18

*** cshen has joined #openstack-ansible00:28
*** cshen has quit IRC00:32
*** gyee has quit IRC01:49
*** cshen has joined #openstack-ansible01:50
*** cshen has quit IRC01:54
*** csmart has quit IRC03:27
*** Brace has quit IRC03:28
*** ioni has quit IRC03:29
*** fridtjof[m] has quit IRC03:29
*** masterpe has quit IRC03:29
*** masterpe has joined #openstack-ansible03:36
*** dave-mccowan has quit IRC03:47
*** fridtjof[m] has joined #openstack-ansible04:09
*** ioni has joined #openstack-ansible04:09
*** csmart has joined #openstack-ansible04:09
*** raukadah is now known as chkumar|rover04:25
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-ansible04:33
*** cshen has joined #openstack-ansible05:41
*** cshen has quit IRC05:45
*** cshen has joined #openstack-ansible06:00
*** cshen has quit IRC06:04
noonedeadpunkmornings!06:19
*** miloa has joined #openstack-ansible06:24
*** cshen has joined #openstack-ansible06:47
openstackgerritJonathan Rosser proposed openstack/openstack-ansible stable/ussuri: Remove mapping of gnocchi_dentity_only to swift  https://review.opendev.org/74664207:14
jrossermorning07:17
noonedeadpunkbtw ceilometer merged fix, I think we should get telemetry unblocked...07:23
noonedeadpunkI issued single recheck to verify that07:23
jrosserthat should be just recheck everything on master i guess?07:23
jrosserthe things that look stuck on master currently are these https://review.opendev.org/#/q/branch:master+status:open+topic:openstack/openstack-ansible-tests/sync-tests+(status:open+OR+status:merged)07:25
noonedeadpunkI wasn't able to reproduce magnum issue... I think I will ask for a hold then...07:35
noonedeadpunkand I think that mania is just out of ram to finish on centos07:38
*** tosky has joined #openstack-ansible07:40
admin0mornings07:54
admin0 "A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection" -- i see this only in nova_api_wsgi .. is there a way to increase timeouts or figure this out ?07:54
admin0or if its a known issue07:54
*** andrewbonney has joined #openstack-ansible07:55
noonedeadpunkI think it's even as excpected07:56
noonedeadpunkwhen nova re-spawn threads07:56
admin0ok08:00
admin0journal2gelf started to die out due to this error: https://gist.github.com/a1git/7d2c4a88126d70a27013aff48165b7fa  .. invalid syntax08:03
admin0and i am still nowhwere near to figure out why the instances are in spawn only state :(08:03
*** fridtjof[m] has quit IRC08:12
*** masterpe has quit IRC08:12
*** ioni has quit IRC08:12
*** csmart has quit IRC08:12
admin0[instance: fd14724b-8e52-49c9-b906-9f9a5ab5a651] Skipping network cache update for instance because it is Building. --- if nova is displaying this much in the logs .. its the libvirt proces that does the actual build right ?08:12
jrossernoonedeadpunk: which release is congress deprecated, we should fix things in ussuri and drop in master?08:15
*** csmart has joined #openstack-ansible08:22
*** andrea10 has joined #openstack-ansible08:27
openstackgerritAndrew Bonney proposed openstack/openstack-ansible-os_congress stable/ussuri: Replace py2 packages with py3  https://review.opendev.org/74665908:28
*** andrea15 has quit IRC08:28
*** masterpe has joined #openstack-ansible08:57
*** fridtjof[m] has joined #openstack-ansible08:57
*** ioni has joined #openstack-ansible08:57
noonedeadpunkjrosser: oh, it's right after ussuri relase09:57
noonedeadpunkso it's for victoria and no reason for backporting09:57
noonedeadpunkso yeah, we should fix ussuri generally09:59
noonedeadpunkbut tbh....09:59
noonedeadpunkshouldn't give much effort for it09:59
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Bump ceilometer SHA to ublock telemetry  https://review.opendev.org/74667910:21
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_ceilometer master: Updated from OpenStack Ansible Tests  https://review.opendev.org/74584210:22
openstackgerritMerged openstack/openstack-ansible-os_barbican stable/ussuri: Remove py2 packages  https://review.opendev.org/74657410:33
*** shyamb has joined #openstack-ansible11:09
*** cshen has quit IRC11:14
openstackgerritMerged openstack/openstack-ansible stable/train: ceph: remove invalid logging options  https://review.opendev.org/73506611:33
*** cshen has joined #openstack-ansible11:47
*** mathlin has joined #openstack-ansible11:47
noonedeadpunkdamn, ceilometer still fails...12:00
*** dave-mccowan has joined #openstack-ansible12:02
masterpesince a couple of days I get on a new install the following https://gist.github.com/mpiscaer/dab88f98a68d51000eb4b51643a8baca error on masakari API and masakari-engine when I want to start masakari.12:04
masterpeI'm using OSA 19.1.012:05
masterpewhen I do /openstack/venvs/neutron-19.1.0/bin/pip freeze | grep vine I get vine==1.2.012:05
openstackgerritAndrew Bonney proposed openstack/openstack-ansible stable/ussuri: Pull congress from GitHub to address CI failures after deprecation  https://review.opendev.org/74669312:05
openstackgerritAndrew Bonney proposed openstack/openstack-ansible-os_congress stable/ussuri: Replace py2 packages with py3  https://review.opendev.org/74665912:06
masterpeon the masakari container I get vine==5.0.0a112:10
jrossermasterpe: that suggests that somehow upper-constraints are not applied becasue you'd expect to be capped here even for master https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L13312:12
*** miloa has quit IRC12:13
openstackgerritMerged openstack/openstack-ansible master: Run tempest install when tempest_run is False  https://review.opendev.org/73980912:26
*** shyam89 has joined #openstack-ansible12:27
*** shyamb has quit IRC12:30
*** rohit02 has joined #openstack-ansible12:35
rohit02hi team,by when OSA ussuri will be available on Centos8 and ubuntu20?12:39
guilhermesphey there! does anyone see a problem here where im trying to split neutron-server and neutron-agents to different hosts? http://paste.openstack.org/show/796908/12:40
*** shyam89 has quit IRC12:42
noonedeadpunkrohit02: I think it already is:)12:43
noonedeadpunkhttps://opendev.org/openstack/openstack-ansible/src/tag/21.0.012:43
rohit02@noonedeadpunk but it documentation in support matrix centos 8 and ubuntu20 not mentioned12:47
rohit02is doc updated12:47
noonedeadpunkit might be not:(12:47
noonedeadpunklet me check it out12:47
noonedeadpunkrohit02: would be helpful if you provided link to that doc :p12:50
*** rohit02 has quit IRC12:53
*** rohit02 has joined #openstack-ansible13:21
rohit02hi team,OSA ussuri available for both centos 8 and centos 7 or only centos 8?13:28
noonedeadpunkfor both 7 and 813:33
noonedeadpunkbut in V we will drop 713:33
noonedeadpunkexception is for distro install type13:33
noonedeadpunkas rdo has no ussuri distro packages for centos713:33
rohit02@noonedeadpunk:have u chk the openstack doc13:35
rohit02is there any change for deployment on centos 813:35
noonedeadpunkyeah, doing patch for docs13:37
rohit02thanx...by when updated doc will be available13:39
admin0is it easy to move a osa+ceph managed platform to decouble osa and ceph .. and move ceph to ceph-ansible13:51
admin0because i am on ubuntu 16.04, without upgrading osa, i cannot upgrade ceph13:51
admin0plus i think its good that they are managed separately for them to be independent13:51
admin0has anyone done it before and have experience on this13:51
admin0i just don't want the cluster to go format itself and lose all data13:52
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Fix neutron-server default serial  https://review.opendev.org/74654614:03
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Adjust docs for Ussuri  https://review.opendev.org/74672914:06
noonedeadpunkrohit02: here's the patch ^14:07
*** spatel has joined #openstack-ansible14:10
spatelWhere is jamesdeton?14:15
spateldenton*14:16
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Make has_offline_migrations output predictable  https://review.opendev.org/74649614:29
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_neutron stable/ussuri: Make has_offline_migrations output predictable  https://review.opendev.org/74673814:30
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Adjust docs for Ussuri  https://review.opendev.org/74672914:31
*** cshen has quit IRC14:39
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: [doc] Adjustmtnts for Victoria release cycle  https://review.opendev.org/74674114:42
*** rohit02 has quit IRC14:56
*** chkumar|rover is now known as raukadah14:57
*** cshen has joined #openstack-ansible15:08
*** cshen has quit IRC15:12
*** gyee has joined #openstack-ansible15:16
*** cshen has joined #openstack-ansible15:27
*** cshen has quit IRC15:34
noonedeadpunk#startmeeting openstack_ansible_meeting16:01
openstackMeeting started Tue Aug 18 16:01:41 2020 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.16:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:01
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:01
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:01
noonedeadpunk#topic office hours16:01
*** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)"16:01
* noonedeadpunk should write a bot to start/stop meetings...16:02
noonedeadpunkso, despite having tag 21.0.0, I think we still things to backport back and to fix in U16:03
noonedeadpunkRegarding telemetry and magnum failing, I'm not sure why is that happening at the moment, and didn't have chance today to return to that16:05
noonedeadpunklike magnum I wasn't able to reproduce in the sandbox, so worth asking for hold I guess. Regarding telemetery, despite "fix" has been released it still fails. Not sure if it's because of the need of the bump or not...16:06
noonedeadpunkalso jobs are failing weirdly a lot16:07
noonedeadpunkregarding manila I feel we're just oom...16:08
noonedeadpunkand not sure I see how we can save up some ram...16:08
openstackgerritMerged openstack/openstack-ansible stable/ussuri: Install required modules for utility env  https://review.opendev.org/74634816:17
*** pfsmorigo has quit IRC16:20
* noonedeadpunk needs to leave16:35
noonedeadpunk#endmeeting16:52
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://bit.ly/2SAcGAn"16:52
openstackMeeting ended Tue Aug 18 16:52:26 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:52
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2020/openstack_ansible_meeting.2020-08-18-16.01.html16:52
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2020/openstack_ansible_meeting.2020-08-18-16.01.txt16:52
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2020/openstack_ansible_meeting.2020-08-18-16.01.log.html16:52
*** cshen has joined #openstack-ansible17:30
*** cshen has quit IRC17:34
*** andrewbonney has quit IRC17:36
openstackgerritMerged openstack/ansible-config_template master: Fix section overrides when commented option persist  https://review.opendev.org/74402317:41
watersjanyone using fencing w/pacemaker_remote configs? any pointers would be appreciated18:28
*** jopdorp has quit IRC19:01
*** jopdorp has joined #openstack-ansible19:04
noonedeadpunknot me(19:17
*** cshen has joined #openstack-ansible19:30
*** cshen has quit IRC19:35
watersjnoonedeadpunk, did you turn stonith off?19:38
noonedeadpunkeventually I run all defaults)19:39
noonedeadpunkwe had regions with less 64 nodes each, so had no problems with that19:39
watersjnoonedeadpunk, so you did not configure corosync/pacemaker for masakari hostmonitor?19:43
watersjfor those few vm pets we all need to have19:44
noonedeadpunkI just run role and it got installed and working - no extra configuration has been ever done :p19:45
watersjrole being os_masakari19:45
noonedeadpunkI mean I run https://github.com/noonedeadpunk/ansible-pacemaker-corosync19:45
watersjah19:45
watersjty19:45
noonedeadpunkWe're almost add it to be included for run for V19:46
noonedeadpunkie https://review.opendev.org/#/c/739146/19:47
watersjso just needs to be present20:10
watersjnothing else20:10
watersjjeeze20:10
spatelnoonedeadpunk: how do you guys access rabbitMQ 15672 port with AIO20:28
spatelI am trying SSH tunnel but somehow not working for me..20:28
spatelis there any other magic you guys doing?20:28
noonedeadpunkssh -D 8080 and set in firefox socks5 proxy20:29
noonedeadpunkthen in firefox 127.0.0.1 is an aio host20:29
noonedeadpunkbut there are other ways to proxy port for sure)20:30
spatelI did use ssh -L XXX:1.1.1.1:XXXX method before in production and it works but its not working with AIO20:30
spatelAnyway let me try iptables port forwarding20:31
spatelnoonedeadpunk: iptables -t nat -A PREROUTING -i eno1 -p tcp --dport 15672 -j DNAT --to-destination 10.255.255.198:1567220:47
spatelit works!20:47
spatelwe should add this in AIO iptables rules20:48
noonedeadpunkor you can deploy metal aio :p20:54
noonedeadpunkeventually I alost never go to the rabbit management console...20:54
noonedeadpunkas there rabbitmqadmin for that20:55
spatelnoonedeadpunk: totally agreed, not one can beat CLI but sometime you are lazy and like to see some color graphs to see progress :)21:01
*** cshen has joined #openstack-ansible21:31
*** spatel has quit IRC21:35
*** cshen has quit IRC21:35
*** tosky has quit IRC22:18
*** sri_ has quit IRC22:42
*** sri_ has joined #openstack-ansible22:51
*** cshen has joined #openstack-ansible23:31
*** cshen has quit IRC23:35

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!