| *** sep has quit IRC | 00:14 | |
| *** DanyC has quit IRC | 00:31 | |
| *** zbr|rover has quit IRC | 01:11 | |
| *** zbr has joined #openstack-ansible | 01:21 | |
| *** zbr has quit IRC | 01:24 | |
| *** zbr has joined #openstack-ansible | 01:27 | |
| *** zbr has quit IRC | 02:16 | |
| *** zbr_ has joined #openstack-ansible | 02:16 | |
| *** zbr_ has quit IRC | 02:17 | |
| *** gyee has quit IRC | 02:23 | |
| *** zbr has joined #openstack-ansible | 02:29 | |
| *** macz has joined #openstack-ansible | 03:24 | |
| macz | hey all, im running into an issue on a pike deployment, nothing can reach the galera servers from the VIP, I get the following error: ERROR 2013 (HY000): Lost connection to MySQL server at 'reading initial communication packet', system error: 0 "Internal error/check (Not system error)" | 03:26 |
|---|---|---|
| poopcat | @macz, in the galera container, is there a service called 'xinetd' running? | 03:34 |
| macz | hi @poopcat yup its up, i see the mysqlchk config in the /etc/xinetd.d/ dir too | 03:35 |
| poopcat | k... Do you see a list where IPs are? on the same line, add 0.0.0.0/0 ans restart xinetd service | 03:36 |
| poopcat | If that resolves it, you can add the following override | 03:37 |
| poopcat | 'galera_monitoring_allowed_source: 0.0.0.0/0' | 03:38 |
| poopcat | or you can scope it to the IPs you need, you can do that as well | 03:40 |
| macz | thanks, i tried that but i'm still getting the issue | 04:00 |
| macz | @poopcat does anything else need a restart? galera or haproxy? | 04:03 |
| *** macz_ has joined #openstack-ansible | 04:07 | |
| *** macz has quit IRC | 04:08 | |
| *** macz_ has quit IRC | 04:14 | |
| *** macz has joined #openstack-ansible | 04:15 | |
| macz | i ended up removing check port 9200 from the galera haproxy configs and it works. ill have to look into this some more, im not getting the issue on a dev env with the same configs | 04:16 |
| *** hwoarang has quit IRC | 04:24 | |
| *** hwoarang has joined #openstack-ansible | 04:26 | |
| *** goldyfruit has quit IRC | 05:30 | |
| *** goldyfruit has joined #openstack-ansible | 05:30 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-ansible | 05:34 | |
| *** macz has quit IRC | 05:46 | |
| *** macz has joined #openstack-ansible | 06:04 | |
| *** macz has quit IRC | 06:14 | |
| *** gregwork has quit IRC | 06:42 | |
| *** cshen has joined #openstack-ansible | 06:55 | |
| *** jawad_axd has joined #openstack-ansible | 07:12 | |
| *** DanyC has joined #openstack-ansible | 07:37 | |
| *** rpittau|afk is now known as rpittau | 07:44 | |
| *** DanyC has quit IRC | 07:47 | |
| *** pcaruana has joined #openstack-ansible | 07:53 | |
| *** cshen has quit IRC | 07:56 | |
| *** cshen has joined #openstack-ansible | 08:01 | |
| *** tosky has joined #openstack-ansible | 08:12 | |
| jawad_axd | Hi all, morning question is, In stein centos7 linux bridge environment, firewall v1 is deprecated while firewall v2 is not supported with linux bridge, so which option do we have in specified environment for Firewall ? | 08:30 |
| *** jbadiapa has joined #openstack-ansible | 08:43 | |
| *** pcaruana has quit IRC | 08:46 | |
| *** cshen has quit IRC | 08:49 | |
| *** DanyC has joined #openstack-ansible | 08:53 | |
| *** pcaruana has joined #openstack-ansible | 08:53 | |
| *** DanyC has quit IRC | 08:53 | |
| *** cshen has joined #openstack-ansible | 08:59 | |
| *** DanyC has joined #openstack-ansible | 08:59 | |
| *** sep has joined #openstack-ansible | 09:00 | |
| *** cshen has quit IRC | 09:03 | |
| *** zbr is now known as zbr|rover | 09:19 | |
| *** cshen has joined #openstack-ansible | 10:04 | |
| *** aedc has joined #openstack-ansible | 10:58 | |
| *** aedc has quit IRC | 11:03 | |
| *** rpittau is now known as rpittau|bbl | 11:21 | |
| *** ansmith_ has joined #openstack-ansible | 11:29 | |
| *** ansmith has quit IRC | 11:32 | |
| noonedeadpunk | jawad_axd: sorry, not really an expert... Maybe jamesdenton can help you to answer this question... | 11:47 |
| *** sshnaidm is now known as sshnaidm|off | 11:52 | |
| *** cshen has quit IRC | 12:20 | |
| *** pcaruana has quit IRC | 12:34 | |
| *** DanyC has quit IRC | 12:34 | |
| *** pcaruana has joined #openstack-ansible | 12:38 | |
| *** mgariepy has joined #openstack-ansible | 12:41 | |
| *** DanyC has joined #openstack-ansible | 12:43 | |
| *** DanyC has quit IRC | 12:44 | |
| *** DanyC has joined #openstack-ansible | 12:53 | |
| *** rpittau|bbl is now known as rpittau | 12:55 | |
| *** goldyfruit has quit IRC | 13:05 | |
| *** goldyfruit has joined #openstack-ansible | 13:06 | |
| *** openstackgerrit has joined #openstack-ansible | 13:09 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Add image for manila test https://review.opendev.org/674653 | 13:09 |
| mgariepy | s | 13:09 |
| *** trident has quit IRC | 13:13 | |
| *** trident has joined #openstack-ansible | 13:15 | |
| *** aedc has joined #openstack-ansible | 13:35 | |
| *** ansmith has joined #openstack-ansible | 13:40 | |
| *** ansmith_ has quit IRC | 13:40 | |
| *** aedc has quit IRC | 13:51 | |
| *** cshen has joined #openstack-ansible | 13:53 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Update ansible to 2.9.1 https://review.opendev.org/681003 | 14:15 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Update ansible to 2.9.2 https://review.opendev.org/681003 | 14:15 |
| mnaser | noonedeadpunk: so wrt to manila, i was thinking of a way we can test it in a simpler way for a more popular likely use case | 14:19 |
| mnaser | noonedeadpunk: im thinking instead of using the hosted image one, why dont we use the ceph job, deploy cephfs and use the cephfs+nfs/ganesha driver by default? -- https://docs.openstack.org/manila/latest/admin/cephfs_driver.html | 14:20 |
| mnaser | specifically the "CephFS NFS shares" here, not the native shares | 14:20 |
| noonedeadpunk | I kinda adjusted to use ceph https://review.opendev.org/#/c/674653/ | 14:20 |
| noonedeadpunk | But I thought that we need to use their image anyway? | 14:21 |
| mnaser | noonedeadpunk: if you're using ceph native, i dont think its needed anymroe. i think you only need the image if you're using a specific driver | 14:22 |
| * mnaser looks for it | 14:22 | |
| noonedeadpunk | Oh, I think that makes sense | 14:22 |
| noonedeadpunk | Anyway I'm trying now to deploy aio, and weirdly fail while deploying ceph... | 14:23 |
| *** theintern_ has joined #openstack-ansible | 14:23 | |
| mnaser | noonedeadpunk: interesting read here -- https://object-storage-ca-ymq-1.vexxhost.net/swift/v1/6e4619c416ff4bd19e1c087f27a43eea/www-assets-prod/presentation-media/What-the-heck-DHSS.pdf | 14:23 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: Drop unnecessary sections https://review.opendev.org/675934 | 14:23 |
| mnaser | so we can decide to use dhss or not | 14:24 |
| tbarron | noonedeadpunk: mnaser that service image was used for the "generic" driver for nova VMs, but also in some scenario tests for VMs that mount shares. | 14:24 |
| noonedeadpunk | I think ceph native do not use it | 14:24 |
| noonedeadpunk | https://docs.openstack.org/manila/latest/contributor/development-environment-devstack.html#sample-local-conf-files-that-get-you-started | 14:24 |
| mnaser | tbarron: ah i see, how's your luck with running nested virt in CI? | 14:24 |
| tbarron | noonedeadpunk: mnaser: you probably dont' need it for ceph or ceph-nfs unless you are running those scenario tests (which | 14:25 |
| tbarron | I'd like to redo with contqiner based mounts anyways to be lighter weight) | 14:25 |
| mnaser | tbarron: a k8s driver? that'd be neat. | 14:25 |
| tbarron | noonedeadpunk: mnaser: and cephfs back ends (with or without nfs) are dhss=false | 14:25 |
| tbarron | some day we may do a dhss=true variant but not yet | 14:26 |
| cjloader | mnaser: I know theintern_ is trying to get manila/cephfs with ganesha working | 14:26 |
| mnaser | ok cool, so this simplifies our stuff a lot for someone whos trying to get a ceph based deployment | 14:26 |
| cjloader | might want to pick his brain too | 14:26 |
| mnaser | tbarron: would the scenario jobs be compatible with these backends too so we can just run them? | 14:26 |
| noonedeadpunk | tbarron: so, what tempest scenraios can be passed with cephfs native? I'm was thinking about smth basic, like test_share_basic_ops | 14:27 |
| theintern_ | well, more that I've gotten it working. What would y'all need? | 14:27 |
| theintern_ | also, howdy. Long time no see | 14:27 |
| mnaser | theintern_: oh cool, can you share the actual configs so we can update the CI so we can test that its working? afaik there's no proper CI for it right now | 14:27 |
| theintern_ | I've got a doc that I can send to you that details how I got it installed on Stien | 14:27 |
| tbarron | noonedeadpunk: i'd recommend just getting the api tempest tests working first, though called "api" they'll do CRUD of share/snapshot resources | 14:28 |
| noonedeadpunk | that would be really helpfull | 14:28 |
| tbarron | noonedeadpunk: just in the spirt of walk then run | 14:28 |
| mnaser | noonedeadpunk: i think it would be easier for us to test cephfs with nfs because thats more likely of a popular use case cause its easier to mount nfs than use ceph | 14:28 |
| theintern_ | https://gist.github.com/Alfano93/6eccf28bdbd6a95ac594956740bc2e2e | 14:28 |
| noonedeadpunk | tbarron: oh, I see. Just usually API tests do just api mocks, which do not represent in most cases really correctly configured service | 14:29 |
| theintern_ | most providers are using CephFS with NFS because it isolates the ceph networks from VM users | 14:29 |
| tbarron | mnaser: if ou are interested in k8s and cephfs-with-nfs then there's a manila-csi-plugin referenced here: | 14:29 |
| mnaser | tbarron: we already know it works fwiw, as theintern_ is using it there, we're trying to actaully get an integration test going | 14:29 |
| *** cshen has quit IRC | 14:29 | |
| theintern_ | it also makes it so we don't have to provide VMs with the admin key | 14:29 |
| mnaser | theintern_: ++ i agree, that's why i think going to cephfs+nfs is a much better option out of the box generally | 14:30 |
| tbarron | https://github.com/shiftstack/manila-kube | 14:30 |
| theintern_ | with K8s, the game changes a bit | 14:30 |
| mnaser | tbarron: yeah i was thinking actually more of manila using k8s for dhss=true with an openstack deployment :p | 14:30 |
| tbarron | and here: https://github.com/tombarron/pocketmanilakube | 14:30 |
| cjloader | mnaser: sorry I saw you discussing it, was trying to help point to a user of it | 14:31 |
| mnaser | cjloader: yeah no those docs are ultra useful from theintern_ ! if we can get those integrated into ci, EXTREMELY useful | 14:31 |
| tbarron | mnaser: well I'm intereseted in that too but so far that's slideware | 14:31 |
| mnaser | tbarron: agreed :) | 14:31 |
| theintern_ | I usually lurk in here, but I can be more active if I can be of use to y'all | 14:31 |
| mnaser | i think that doc is ultra useful for noonedeadpunk :> | 14:32 |
| noonedeadpunk | ++ | 14:32 |
| cjloader | I saw a perfect opportunity theintern_ | 14:34 |
| cjloader | lol | 14:34 |
| tbarron | theintern_: that's a cool doc; we use pacemaker (in tripleo context) for ganesha HA but I am *delighted* to see this lighter weight/simpler (in good sense) approach | 14:35 |
| cjloader | FWIW: I used these docs to install Manila with Train mnaser noonedeadpunk | 14:36 |
| *** jawad_axd has quit IRC | 14:36 | |
| cjloader | manila playbooks may need some work | 14:36 |
| *** jawad_axd has joined #openstack-ansible | 14:37 | |
| cjloader | theintern_ helped me wwith it | 14:37 |
| *** jawad_axd has quit IRC | 14:37 | |
| cjloader | with* | 14:37 |
| theintern_ | tbarron lol, I looked at pacemaker and honestly it scared me | 14:39 |
| theintern_ | that's why keepalived got used | 14:39 |
| mnaser | theintern_: the cool thing is we already run keepalived inside OSA | 14:39 |
| mnaser | so in this case we can leverage that for the ganesha nfs! | 14:39 |
| theintern_ | yup, for haproxy. That's where I copied my initial config from | 14:40 |
| *** jawad_axd has joined #openstack-ansible | 14:41 | |
| tbarron | theintern_: we were already using pacemaker all over the place in tripleo or I liekly would have avoided it | 14:42 |
| tbarron | in upstream ganesha/ceph/rook jeff layton has WIP to make ganesha run active-active, etc. and have its HA more or less self-managed like the ceph daemons | 14:44 |
| theintern_ | yea, I think in N ceph it's a first class process | 14:45 |
| theintern_ | actually monitored by the status collecting | 14:45 |
| *** jawad_axd has quit IRC | 14:45 | |
| theintern_ | the only way I can think of making ganesha active-active in its current state is to do some HAProxy magic | 14:46 |
| theintern_ | but I haven't gone too far down that rabbit hole, so not too sure if it's possible | 14:47 |
| tbarron | noonedeadpunk: so back to scenario tests. They launch a VM to mount shares. Cirros image NFS client doesn't work right. But you might be able to use | 14:47 |
| tbarron | a lighter weight VM image than the one we have. | 14:47 |
| tbarron | Scenario tests in manila are a pain in OpenStack CI, always running out of resoruces, etc. and failing for extraneours reasons. | 14:48 |
| tbarron | extraneous | 14:48 |
| mnaser | :< | 14:48 |
| noonedeadpunk | Yeah, I've actually faced with that when was trying to achieve the same some time ago... Now have some time to return back to it... | 14:49 |
| noonedeadpunk | So then we'll probably do at least api tests, if you say they're testing share resources | 14:50 |
| tbarron | noonedeadpunk: here are the tests we're running in upstream manila for cephfs with nfs gateway, including some scenario tests: | 14:50 |
| tbarron | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_781/697957/4/check/manila-tempest-minimal-dsvm-cephfs-nfs/7817237/logs/testr_results.html.gz | 14:50 |
| tbarron | using this tempest.conf (which defines the manila capabilities to be tested against): | 14:51 |
| tbarron | https://zuul.opendev.org/t/openstack/build/7817237f809e4adb8f38207c4e8d84ea/log/logs/tempest_conf.txt.gz | 14:51 |
| noonedeadpunk | oh, this is super helpful! | 14:51 |
| tbarron | noonedeadpunk: I pulled these from the manila-tempest-minimal-dsvm-cephfs-nfs job logs in this review: https://review.opendev.org/#/c/697957/ | 14:52 |
| tbarron | review selection was pretty much arbitrary, it's just a review that triggers that job | 14:52 |
| noonedeadpunk | I was kinda deploying devstack with tempest, but I think it wasn't configured enough (maybe I've missed to define smth).... | 14:53 |
| tbarron | noonedeadpunk: the local.conf used in upstream manila ci is unnecessarily complicated, the ones cited earlier are probably a better base in general | 14:53 |
| tbarron | upstream manila has weird legacy jobs with pre and post hook setup stuff and conventions about LONDON, PARIS back ends etc. that are obscure | 14:54 |
| tbarron | none of that stuff is essential if you are working in another green(er) field context | 14:55 |
| noonedeadpunk | ok, I see. Thanks for your help! I need to investigate things, as there was lot's of information here. Won't mind if I ping you in case of some questions? | 14:55 |
| tbarron | noonedeadpunk: feel free to ping, and maybe also do it in #openstack-manila if you don't get action here right away. There are others there who would be glad to help as well. | 14:56 |
| noonedeadpunk | tbarron: sure! thanks again | 14:57 |
| theintern_ | if y'all could keep me in the loop as well, I'll try and help as best I can | 15:02 |
| *** macz has joined #openstack-ansible | 15:02 | |
| noonedeadpunk | theintern_: much appreciated :) | 15:04 |
| cjloader | I think between tbarron and theintern_ we should be able to setup manila testing in OSA | 15:07 |
| cjloader | (knowledge wise) | 15:07 |
| *** theintern_ has quit IRC | 15:08 | |
| *** DanyC has quit IRC | 15:09 | |
| *** theintern_ has joined #openstack-ansible | 15:19 | |
| *** zul has joined #openstack-ansible | 15:21 | |
| *** DanyC has joined #openstack-ansible | 15:42 | |
| *** DanyC has quit IRC | 15:48 | |
| openstackgerrit | Merged openstack/openstack-ansible-memcached_server master: Document access memcached via haproxy https://review.opendev.org/700570 | 15:55 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: tox: Keeping going with docs https://review.opendev.org/690674 | 16:08 |
| *** jawad_axd has joined #openstack-ansible | 16:08 | |
| *** jawad_axd has quit IRC | 16:13 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_congress master: tox: Keeping going with docs https://review.opendev.org/690643 | 16:20 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: tox: Keeping going with docs https://review.opendev.org/690686 | 16:21 |
| openstackgerrit | Merged openstack/openstack-ansible-os_placement master: tox: Keeping going with docs https://review.opendev.org/690646 | 16:22 |
| openstackgerrit | Merged openstack/openstack-ansible-os_trove master: tox: Keeping going with docs https://review.opendev.org/690639 | 16:22 |
| openstackgerrit | Merged openstack/openstack-ansible-rabbitmq_server master: tox: Keeping going with docs https://review.opendev.org/690651 | 16:22 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_server master: tox: Keeping going with docs https://review.opendev.org/690663 | 16:23 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: tox: Keeping going with docs https://review.opendev.org/690627 | 16:23 |
| *** DanyC has joined #openstack-ansible | 16:29 | |
| *** jawad_axd has joined #openstack-ansible | 16:44 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance master: tox: Keeping going with docs https://review.opendev.org/690645 | 16:47 |
| *** jawad_axd has quit IRC | 16:49 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: tox: Keeping going with docs https://review.opendev.org/690684 | 16:51 |
| *** gyee has joined #openstack-ansible | 16:56 | |
| *** rpittau is now known as rpittau|afk | 17:10 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible master: Update ansible to 2.8.7 https://review.opendev.org/702013 | 17:16 |
| *** jawad_axd has joined #openstack-ansible | 17:20 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_zun master: tox: Keeping going with docs https://review.opendev.org/690638 | 17:20 |
| *** jawad_axd has quit IRC | 17:25 | |
| *** evrardjp has quit IRC | 17:33 | |
| *** evrardjp has joined #openstack-ansible | 17:34 | |
| *** errr_ has quit IRC | 17:38 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_manila master: Add manila CI https://review.opendev.org/675934 | 18:02 |
| *** pcaruana has quit IRC | 18:09 | |
| *** theintern_ has quit IRC | 18:09 | |
| *** DanyC has quit IRC | 18:12 | |
| *** theintern_ has joined #openstack-ansible | 18:34 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Deploy heat with magnum https://review.opendev.org/701233 | 18:41 |
| *** aedc has joined #openstack-ansible | 18:51 | |
| *** pcaruana has joined #openstack-ansible | 18:57 | |
| *** citil has joined #openstack-ansible | 19:18 | |
| citil | I'm following https://docs.openstack.org/project-deploy-guide/openstack-ansible/train/overview.html and using a setup similar to Production Environment. setup-openstack fails while deploying the first compute node. Infra nodes seem to work fine. Failure in nova-status upgrade check to validate a healthy configuration task. The upgrade check fails | 19:21 |
| citil | for "Placement API endpoint not found".Do I need to configure anything special for placement that's missing in the docs? Please point me in the right direction. | 19:21 |
| *** theintern_ has quit IRC | 19:33 | |
| jrosser | citil: check that you have a host for the placement service defined - thats missing from some of the example configs and should be a bit like this https://review.opendev.org/#/c/701548/ | 19:34 |
| citil | jrosser: thanks much. I'll add it now and try again. Appreciate it. | 19:47 |
| *** macz has quit IRC | 19:51 | |
| *** jawad_axd has joined #openstack-ansible | 20:15 | |
| *** jawad_axd has quit IRC | 20:20 | |
| *** jawad_axd has joined #openstack-ansible | 20:36 | |
| *** jawad_axd has quit IRC | 20:41 | |
| *** jawad_axd has joined #openstack-ansible | 20:57 | |
| *** jawad_axd has quit IRC | 21:01 | |
| *** hwoarang has quit IRC | 21:16 | |
| *** hwoarang has joined #openstack-ansible | 21:16 | |
| *** DanyC has joined #openstack-ansible | 21:39 | |
| *** gokhani has quit IRC | 21:43 | |
| *** ahosam has joined #openstack-ansible | 21:57 | |
| openstackgerrit | Merged openstack/openstack-ansible master: [doc] Add placement definition to config sample https://review.opendev.org/701548 | 22:01 |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Updates to Grafana role https://review.opendev.org/701350 | 22:04 |
| *** ivve has quit IRC | 22:26 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_horizon stable/rocky: Fix panels enable/disable for distro install. https://review.opendev.org/692804 | 22:29 |
| *** KeithMnemonic has quit IRC | 22:46 | |
| *** DanyC has quit IRC | 22:46 | |
| *** pcaruana has quit IRC | 23:35 | |
| *** jbadiapa has quit IRC | 23:35 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!