| *** jamesmcarthur has joined #openstack-meeting | 00:02 | |
| *** jbadiapa has quit IRC | 00:04 | |
| *** jamesmcarthur has quit IRC | 00:06 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:10 | |
| *** slaweq has joined #openstack-meeting | 00:11 | |
| *** slaweq has quit IRC | 00:16 | |
| *** tetsuro has joined #openstack-meeting | 00:26 | |
| *** jamesmcarthur has quit IRC | 00:27 | |
| *** armax has quit IRC | 00:32 | |
| *** ekcs has quit IRC | 00:34 | |
| *** mahatic has quit IRC | 00:39 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:39 | |
| *** eharney has quit IRC | 00:42 | |
| *** gyee has quit IRC | 00:42 | |
| *** jamesmcarthur has quit IRC | 00:44 | |
| *** tetsuro has quit IRC | 00:54 | |
| *** armax has joined #openstack-meeting | 00:56 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:02 | |
| *** tetsuro has joined #openstack-meeting | 01:02 | |
| *** ykatabam has joined #openstack-meeting | 01:05 | |
| *** mriedem has joined #openstack-meeting | 01:06 | |
| *** XSM_HUST has joined #openstack-meeting | 01:11 | |
| *** tetsuro has quit IRC | 01:15 | |
| *** liuyulong has joined #openstack-meeting | 01:25 | |
| *** lbragstad has quit IRC | 01:26 | |
| *** lbragstad has joined #openstack-meeting | 01:26 | |
| *** tetsuro has joined #openstack-meeting | 01:28 | |
| *** hyunsikyang has quit IRC | 01:34 | |
| *** tetsuro has quit IRC | 01:40 | |
| *** tetsuro has joined #openstack-meeting | 01:40 | |
| *** liuyulong has quit IRC | 01:55 | |
| *** jamesmcarthur has quit IRC | 01:59 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:04 | |
| *** slaweq has joined #openstack-meeting | 02:11 | |
| *** slaweq has quit IRC | 02:15 | |
| *** lseki has quit IRC | 02:18 | |
| *** carloss has quit IRC | 02:21 | |
| *** njohnston|lunch has quit IRC | 02:22 | |
| *** tetsuro has quit IRC | 02:47 | |
| *** mriedem has quit IRC | 02:48 | |
| *** yamamoto has joined #openstack-meeting | 02:56 | |
| *** tetsuro has joined #openstack-meeting | 03:00 | |
| *** jamesmcarthur has quit IRC | 03:00 | |
| *** tetsuro has quit IRC | 03:05 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:06 | |
| *** jamesmcarthur has quit IRC | 03:13 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:25 | |
| *** rfolco has quit IRC | 03:32 | |
| *** patrickeast has quit IRC | 03:39 | |
| *** PrinzElvis has quit IRC | 03:39 | |
| *** larainema has joined #openstack-meeting | 03:39 | |
| *** datasundae has quit IRC | 03:41 | |
| *** knikolla has quit IRC | 03:42 | |
| *** ildikov has quit IRC | 03:42 | |
| *** csatari has quit IRC | 03:42 | |
| *** patrickeast has joined #openstack-meeting | 03:43 | |
| *** datasundae has joined #openstack-meeting | 03:44 | |
| *** knikolla has joined #openstack-meeting | 03:45 | |
| *** ildikov has joined #openstack-meeting | 03:45 | |
| *** csatari has joined #openstack-meeting | 03:45 | |
| *** PrinzElvis has joined #openstack-meeting | 03:45 | |
| *** jamesmcarthur has quit IRC | 03:57 | |
| *** rbudden has quit IRC | 04:09 | |
| *** rbudden has joined #openstack-meeting | 04:10 | |
| *** rbudden has joined #openstack-meeting | 04:10 | |
| *** joxyuki has left #openstack-meeting | 04:24 | |
| *** ianychoi_ has joined #openstack-meeting | 04:25 | |
| *** ianychoi has quit IRC | 04:27 | |
| *** pcaruana has joined #openstack-meeting | 04:42 | |
| *** links has joined #openstack-meeting | 04:51 | |
| *** brault has joined #openstack-meeting | 05:00 | |
| *** links has quit IRC | 05:04 | |
| *** brault has quit IRC | 05:05 | |
| *** Luzi has joined #openstack-meeting | 05:07 | |
| *** slaweq has joined #openstack-meeting | 05:11 | |
| *** links has joined #openstack-meeting | 05:12 | |
| *** pcaruana has quit IRC | 05:12 | |
| *** slaweq has quit IRC | 05:16 | |
| *** rubasov has quit IRC | 05:21 | |
| *** rcernin has quit IRC | 05:22 | |
| *** redrobot has quit IRC | 05:25 | |
| *** rcernin has joined #openstack-meeting | 05:38 | |
| *** kopecmartin|off is now known as kopecmartin | 05:46 | |
| *** brinzhang_ has joined #openstack-meeting | 05:50 | |
| *** rcernin has quit IRC | 05:51 | |
| *** jraju__ has joined #openstack-meeting | 05:53 | |
| *** links has quit IRC | 05:53 | |
| *** brinzhang has quit IRC | 05:54 | |
| *** yamamoto has quit IRC | 06:06 | |
| *** rcernin has joined #openstack-meeting | 06:09 | |
| *** slaweq has joined #openstack-meeting | 06:10 | |
| *** slaweq has quit IRC | 06:15 | |
| *** slaweq has joined #openstack-meeting | 06:21 | |
| *** pcaruana has joined #openstack-meeting | 06:21 | |
| *** tetsuro has joined #openstack-meeting | 06:26 | |
| *** radeks has joined #openstack-meeting | 06:35 | |
| *** ricolin has joined #openstack-meeting | 06:38 | |
| *** ricolin has quit IRC | 06:39 | |
| *** ociuhandu has joined #openstack-meeting | 06:42 | |
| *** tetsuro_ has joined #openstack-meeting | 06:46 | |
| *** ociuhandu has quit IRC | 06:46 | |
| *** tetsuro has quit IRC | 06:48 | |
| *** lpetrut has joined #openstack-meeting | 06:52 | |
| *** XSM_HUST has quit IRC | 06:52 | |
| *** brault has joined #openstack-meeting | 06:57 | |
| *** ociuhandu has joined #openstack-meeting | 07:04 | |
| *** rubasov has joined #openstack-meeting | 07:04 | |
| *** ociuhandu has quit IRC | 07:04 | |
| *** ociuhandu has joined #openstack-meeting | 07:07 | |
| *** ociuhandu has quit IRC | 07:08 | |
| *** trident has quit IRC | 07:08 | |
| *** tetsuro_ has quit IRC | 07:09 | |
| *** tesseract has joined #openstack-meeting | 07:11 | |
| *** trident has joined #openstack-meeting | 07:17 | |
| *** ralonsoh has joined #openstack-meeting | 07:19 | |
| *** tetsuro has joined #openstack-meeting | 07:21 | |
| *** trident has quit IRC | 07:22 | |
| *** ociuhandu has joined #openstack-meeting | 07:24 | |
| *** trident has joined #openstack-meeting | 07:31 | |
| *** radeks has quit IRC | 07:34 | |
| *** rcernin has quit IRC | 07:38 | |
| *** ykatabam has quit IRC | 07:43 | |
| *** tetsuro has quit IRC | 07:45 | |
| *** e0ne has joined #openstack-meeting | 07:56 | |
| *** jbadiapa has joined #openstack-meeting | 08:01 | |
| *** tssurya has joined #openstack-meeting | 08:02 | |
| *** rubasov has quit IRC | 08:05 | |
| *** rubasov has joined #openstack-meeting | 08:06 | |
| *** e0ne has quit IRC | 08:12 | |
| *** ociuhandu has quit IRC | 08:12 | |
| *** ociuhandu has joined #openstack-meeting | 08:15 | |
| *** links has joined #openstack-meeting | 08:17 | |
| *** jraju__ has quit IRC | 08:19 | |
| *** tssurya has quit IRC | 08:22 | |
| *** radeks has joined #openstack-meeting | 08:24 | |
| *** jawad_axd has joined #openstack-meeting | 08:29 | |
| *** rubasov has quit IRC | 08:29 | |
| *** tssurya has joined #openstack-meeting | 08:36 | |
| *** rubasov has joined #openstack-meeting | 08:40 | |
| *** e0ne has joined #openstack-meeting | 08:40 | |
| *** ykatabam has joined #openstack-meeting | 08:51 | |
| *** priteau has joined #openstack-meeting | 08:53 | |
| *** ttsiouts has joined #openstack-meeting | 09:00 | |
| *** lpetrut has quit IRC | 09:04 | |
| *** ianychoi_ has quit IRC | 09:09 | |
| *** rcernin has joined #openstack-meeting | 09:11 | |
| *** zhubx has joined #openstack-meeting | 09:26 | |
| *** boxiang has quit IRC | 09:29 | |
| *** links has quit IRC | 09:34 | |
| *** links has joined #openstack-meeting | 09:34 | |
| *** jraju__ has joined #openstack-meeting | 09:38 | |
| *** links has quit IRC | 09:39 | |
| *** rcernin has quit IRC | 09:41 | |
| *** ociuhandu has quit IRC | 09:43 | |
| *** brinzhang_ has quit IRC | 09:45 | |
| *** brinzhang_ has joined #openstack-meeting | 09:46 | |
| *** brinzhang_ has quit IRC | 09:46 | |
| *** ociuhandu has joined #openstack-meeting | 09:49 | |
| *** ociuhandu has quit IRC | 09:54 | |
| *** dkushwaha has quit IRC | 10:07 | |
| *** tssurya has quit IRC | 10:10 | |
| *** brinzhang has joined #openstack-meeting | 10:19 | |
| *** ykatabam has quit IRC | 10:20 | |
| *** ykatabam has joined #openstack-meeting | 10:22 | |
| *** ttsiouts has quit IRC | 10:23 | |
| *** ttsiouts has joined #openstack-meeting | 10:23 | |
| *** ttsiouts has quit IRC | 10:28 | |
| *** ianychoi has joined #openstack-meeting | 10:30 | |
| *** ianychoi has quit IRC | 10:45 | |
| *** belmoreira has joined #openstack-meeting | 10:45 | |
| *** ianychoi has joined #openstack-meeting | 10:45 | |
| *** janders has joined #openstack-meeting | 11:00 | |
| janders | g'day | 11:01 |
|---|---|---|
| *** ttsiouts has joined #openstack-meeting | 11:03 | |
| *** ttsiouts has quit IRC | 11:07 | |
| *** b1airo has joined #openstack-meeting | 11:11 | |
| *** ttsiouts has joined #openstack-meeting | 11:12 | |
| b1airo | o/ | 11:12 |
| *** janders has quit IRC | 11:14 | |
| *** carloss has joined #openstack-meeting | 11:16 | |
| *** janders has joined #openstack-meeting | 11:19 | |
| janders | g'day again | 11:19 |
| ildikov | b1airo: I'm around if you wanna chat :) | 11:19 |
| janders | sorry my Poisoned Apple crapped out again | 11:19 |
| b1airo | oh hai | 11:19 |
| janders | actually, I do have some potentially interesting AOB bits to share | 11:19 |
| b1airo | was briefly distracted in Slack-land | 11:19 |
| janders | 1) I did get HDR200 to work eventually | 11:19 |
| ildikov | Slack-land is very distracting | 11:19 |
| janders | yeah I need to rejoin that group again.. for some reason my slack config lost it | 11:20 |
| b1airo | want a fresh invite? | 11:20 |
| janders | yes please | 11:21 |
| janders | jacob.anders.au@gmail.com | 11:21 |
| janders | thanks! | 11:21 |
| janders | --------------------------------------------------------------------------------------- RDMA_Write BW Test Dual-port : OFF Device : mlx5_3 Number of qps : 1 Transport type : IB Connection type : RC Using SRQ : OFF TX depth : 128 CQ Moderation : 100 Mtu : | 11:21 |
| janders | 4096[B] Link type : IB Max inline data : 0[B] rdma_cm QPs : OFF Data ex. method : Ethernet--------------------------------------------------------------------------------------- local address: LID 0x01 QPN 0x08a7 PSN 0xef254c RKey 0x0a28af VAddr | 11:21 |
| janders | 0x007fcb0b3d0000--------------------------------------------------------------------------------------- RDMA_Write BW Test Dual-port : OFF Device : mlx5_1 Number of qps : 1 Transport type : IB Connection type : RC Using SRQ : OFF TX depth : 128 CQ Moderation : 100 Mtu | 11:21 |
| janders | : 4096[B] Link type : IB Max inline data : 0[B] rdma_cm QPs : OFF Data ex. method : Ethernet--------------------------------------------------------------------------------------- local address: LID 0x09 QPN 0x0ca1 PSN 0xc0192b RKey 0x0dc5cf VAddr 0x007f2058230000 remote address: LID 0x02 QPN 0x08aa PSN 0x17ff6e RKey 0x0a299e VAddr | 11:21 |
| janders | 0x007f3dcb190000 remote address: LID 0x07 QPN 0x0c9f PSN 0x90ffb4 RKey 0x0dbcc3 VAddr 0x007f2cb58f0000--------------------------------------------------------------------------------------- #bytes #iterations BW peak[MB/sec] BW average[MB/sec] | 11:21 |
| janders | MsgRate[Mpps]--------------------------------------------------------------------------------------- #bytes #iterations BW peak[MB/sec] BW average[MB/sec] MsgRate[Mpps]65536 5000 11805.88 11498.61 0.183978---------------------------------------------------------------------------------------65536 5000 11537.78 11504.88 | 11:21 |
| janders | 0.184078---------------------------------------------------------------------------------------[root@hdr200-2 ~]# | 11:21 |
| janders | oops, what a mess | 11:21 |
| janders | --------------------------------------------------------------------------------------- #bytes #iterations BW peak[MB/sec] BW average[MB/sec] MsgRate[Mpps]--------------------------------------------------------------------------------------- #bytes #iterations BW peak[MB/sec] BW average[MB/sec] MsgRate[Mpps]65536 5000 | 11:21 |
| janders | 11805.88 11498.61 0.183978---------------------------------------------------------------------------------------65536 5000 11537.78 11504.88 0.184078---------------------------------------------------------------------------------------[root@hdr200-2 ~]# | 11:21 |
| janders | still a mess | 11:21 |
| janders | okay I will give up pasting ib_write_bw outputs here | 11:21 |
| janders | :) | 11:21 |
| janders | long story short I can get 2x10GB/s | 11:21 |
| janders | (after a long series of battles) | 11:22 |
| *** gibi is now known as gibi_fly | 11:22 | |
| janders | HDR200 is essentially 2xHDR100 sharing a cable | 11:22 |
| janders | hence 2x10GB/s as opposed to 1x20GB/s | 11:22 |
| janders | but in any case it should make a nice interconnect for those NVMe boxes I was talking about in the past weeks | 11:22 |
| janders | all of this is applicable to PCIe3 HDR200s - the non-Intel cards probably go 1x20GB/s :) | 11:23 |
| janders | due to PCIe4 goodness | 11:23 |
| janders | VPI still isn't GA but hopefully soon. The above results are from the all-IB mode | 11:24 |
| b1airo | yeah i figured there would be some interesting caveats like that around squeezing full-bandwidth out of it | 11:25 |
| *** ykatabam has quit IRC | 11:25 | |
| janders | ib_write_bw can't do it | 11:26 |
| janders | needs wrappers | 11:26 |
| b1airo | hmm, couldn't reinvite you. tried deactivating and reactivating your account, see if that gives you any notification | 11:26 |
| janders | I think that might be pretty telling in regards to other apps being able to use it | 11:26 |
| janders | thanks! I will keep an eye on the notification | 11:27 |
| b1airo | yeah, i wonder/guess that means a single QP can't do it...? | 11:27 |
| janders | if not will fire up another laptop, that browser hopefull still has it | 11:27 |
| janders | indeed | 11:27 |
| janders | I think you need at least two threads to be able to get 20GB/s | 11:27 |
| janders | however - I'm mostly thinking of HDR200 as a badass storage interconnect, so not too worried (yet) | 11:28 |
| janders | with HDR200 you essentially get ib0 and ib1, each with separate IP | 11:28 |
| b1airo | yeah fair enough. i guess latency-wise it isn't any different from 100G | 11:28 |
| janders | so I think software that used to run cool on dual-port older cards (or just dual cards) will probably work okay | 11:28 |
| janders | hmm good question | 11:29 |
| janders | I dont have any latency numbers from the CX5 nodes handy but can get fresh ones from CX6 | 11:29 |
| janders | was around 1.0 usec if I remember correctly | 11:29 |
| janders | and that rings a bell | 11:29 |
| janders | 1.09-1.10 usec avt | 11:30 |
| b1airo | for 0 bit datagrams? | 11:30 |
| janders | that was just from a default run | 11:31 |
| janders | that's 2 bytes I think | 11:31 |
| janders | would you like me to test any specific settings? | 11:31 |
| b1airo | nah, don't have any specific applications in mind at this point | 11:33 |
| b1airo | but thanks! | 11:33 |
| janders | no worries! | 11:33 |
| janders | I hope to get GPFS going on those in the coming couple weeks, so should have better idea how the NVMe fitout and HDR200 works together | 11:33 |
| janders | my gut feel is the servers will probably be cool given enough parallelism | 11:34 |
| janders | clients will probably suck unless there's enough parallelism | 11:34 |
| janders | which probably won't be the case for | 11:34 |
| b1airo | lol, usual case for storage then | 11:34 |
| janders | "organic" workloads (it's a small system for now) | 11:34 |
| janders | the other funky thing I'm playing with is ansibleising onboarding OpenStack users/projects | 11:35 |
| janders | and that includes assigning roles, quotas, creating default networking so that the users don't need to know/care, etc | 11:35 |
| janders | I came across an interesting challenge | 11:35 |
| janders | how to auto-generate reasonably strong passwords and store them in a reasonably secure way? | 11:36 |
| janders | ideally from ansible | 11:36 |
| janders | (obviously everything can be wrapped in shell module in the worst case...) | 11:36 |
| janders | I was hoping that ansible can nicely write into ansible-vaults but doesn't seem to be the case | 11:36 |
| janders | I'm using lookup/password with a flat file with locked down perms as a fallback | 11:37 |
| b1airo | that's a bit sad | 11:37 |
| janders | do you have any suggestions how to do this better? | 11:37 |
| b1airo | i wonder if `pass` could help | 11:40 |
| janders | is that a third party app, or an ansible module? | 11:40 |
| b1airo | yep, looks like: https://docs.ansible.com/ansible/2.5/plugins/lookup/passwordstore.html | 11:41 |
| b1airo | https://www.passwordstore.org/ | 11:42 |
| janders | nice! | 11:42 |
| janders | it's a very similar mechanism to my flat file, except more secure | 11:42 |
| janders | I was hoping to use ansible-vault like this, but given lack of support, this might do what I need | 11:42 |
| janders | thanks Blair! :) | 11:42 |
| b1airo | :-) | 11:42 |
| janders | in general what I'm trying to achieve is being able to define projects like this: | 11:43 |
| janders | projects: sample-one: name: sample-one enabled: true description: comment-1 quota: instances: 2 cores: 2 ram: 2048 volumes: 2 gigabytes: 2 snapshots: 2 floatingips: 2 networks: 1 subnets: 1 routers: 1 ports: 50 members: - user1 - user2 networking: | 11:43 |
| janders | create_default: true create_router: true credentials: create_cli_creds: true create_api_creds: true sample-two: name: sample-two ... | 11:43 |
| janders | oops | 11:43 |
| janders | it's pretty yaml, trust me :) | 11:43 |
| janders | essentially this defines quota, members, what "automagic" features are supposed to be in, etc | 11:44 |
| janders | when finished I will set defaults such that it will work reasonably well with almost no information except project name and memberships | 11:44 |
| *** raildo has joined #openstack-meeting | 11:44 | |
| janders | instead of gettins support guys to waste time helping new users create networks, etc, I figured I'll template *everything* and if the users know enough to go beyond that, they can go ahead | 11:45 |
| janders | otherwise this is enough to start spinning up VMs using another template I will give em | 11:45 |
| b1airo | yeah, sounds like a plan. i always wanted us to do something like this with secgroups etc for Nectar | 11:46 |
| janders | did you guys have a similar cleanup mechanism for decom projects? | 11:46 |
| b1airo | yeah, let me dig it up... | 11:47 |
| janders | I'm thinking how do approach that without onboarding too much risk of someone accidentally deleting everything on the Cloud | 11:47 |
| b1airo | https://github.com/NeCTAR-RC/nectar-tools/tree/master/nectar_tools/expiry | 11:48 |
| b1airo | yeah gotta automate that for sure | 11:49 |
| janders | nice, great work! | 11:49 |
| janders | I just got my ansible to parse that yaml defining all project memberships - and create credsfile for each user for each project they are a part of | 11:50 |
| janders | now need to do the same for the API stuff | 11:50 |
| janders | do you know if it's possible to have the CLI tools use .config/openstack/clouds.yml? | 11:50 |
| janders | traditionally CLIs tend to prefer some sort of a creds file with environment variables and APIs take clouds.yml | 11:51 |
| janders | one could script populating creds from clouds.yml | 11:51 |
| janders | but I wonder if it's possible to just have the CLIs read it "natively" | 11:51 |
| janders | do you know? | 11:51 |
| b1airo | looks like it is | 11:53 |
| b1airo | have never used it personally, but... https://docs.openstack.org/python-openstackclient/stein/cli/authentication.html | 11:54 |
| *** brault has quit IRC | 11:54 | |
| janders | thanks! I will keep digging | 11:54 |
| b1airo | "The command line arguments are processed and a configuration is loaded from clouds.yaml if --os-cloud is provided" | 11:55 |
| janders | I think general consensus is it should work, but I haven't had much success just yet | 11:55 |
| janders | ah | 11:55 |
| janders | it was just a stupid default keystone version | 11:55 |
| *** brault has joined #openstack-meeting | 11:55 | |
| *** brault has quit IRC | 11:55 | |
| *** brault has joined #openstack-meeting | 11:56 | |
| janders | okay... last one of my "interesting" questions | 11:56 |
| janders | :) | 11:56 |
| janders | it seems that | 11:56 |
| janders | depending on the kind of a loop used in ansible | 11:56 |
| janders | it is or it is not possible to reference the "key" variable | 11:56 |
| b1airo | on this week's episode of The Chaser (OpenStack edition) | 11:56 |
| janders | projects: sample-one: name: sample-one | 11:56 |
| *** lseki has joined #openstack-meeting | 11:57 | |
| b1airo | oh yeah? that doesn't surprise me tbh | 11:57 |
| janders | if I use with_dict I can reference the name either via item.key or item.0.name | 11:58 |
| janders | which would allow me to kill the name field entirely | 11:58 |
| janders | this, however, does not seem to work with with_subelements | 11:58 |
| janders | which I need for those bits where I have to traverse a two-dimensional array (sort, of) | 11:58 |
| janders | I might be messing up the syntax slightly, but I think I got the challenge right | 11:59 |
| janders | have you come across this limitation? | 11:59 |
| janders | googled a ton of ppl running into this but no solution - hence the redundant "name" field is still there | 12:00 |
| janders | not a big deal, just puzzling me | 12:00 |
| janders | okay - we're out of time | 12:00 |
| janders | thanks for all the hints Blair! :) | 12:00 |
| b1airo | nah 'fraid not, only messed with simple loops in ansible thus far | 12:00 |
| janders | right! no worries | 12:01 |
| b1airo | suspect oneswig et al might have some hints though given kayobe is mainly ansible | 12:01 |
| janders | indeed! | 12:01 |
| janders | might try again next week then! :) | 12:01 |
| b1airo | right, i'm off to make my eyes bleed in peoplesoft again.. :-/ | 12:02 |
| *** rfolco has joined #openstack-meeting | 12:06 | |
| *** lpetrut has joined #openstack-meeting | 12:13 | |
| *** ociuhandu has joined #openstack-meeting | 12:13 | |
| *** ociuhandu has quit IRC | 12:14 | |
| *** ociuhandu has joined #openstack-meeting | 12:16 | |
| *** ociuhandu has quit IRC | 12:16 | |
| *** jamesmcarthur has joined #openstack-meeting | 12:25 | |
| *** jraju__ is now known as links | 12:29 | |
| *** jamesmcarthur has quit IRC | 12:30 | |
| *** ociuhandu has joined #openstack-meeting | 12:38 | |
| *** njohnston has joined #openstack-meeting | 12:46 | |
| *** e0ne has quit IRC | 12:46 | |
| *** mriedem has joined #openstack-meeting | 12:49 | |
| *** eharney has joined #openstack-meeting | 12:51 | |
| *** e0ne has joined #openstack-meeting | 12:52 | |
| *** rbudden has joined #openstack-meeting | 13:03 | |
| *** dhellmann has quit IRC | 13:06 | |
| *** ociuhandu has quit IRC | 13:12 | |
| *** ociuhandu has joined #openstack-meeting | 13:13 | |
| *** ociuhandu has quit IRC | 13:18 | |
| *** ociuhandu has joined #openstack-meeting | 13:26 | |
| *** ociuhandu has quit IRC | 13:31 | |
| *** eharney has quit IRC | 13:32 | |
| *** eharney has joined #openstack-meeting | 13:32 | |
| *** enriquetaso has joined #openstack-meeting | 13:36 | |
| *** panda is now known as panda|ruck | 13:40 | |
| *** ociuhandu has joined #openstack-meeting | 13:41 | |
| *** panda|ruck is now known as panda|rover | 13:45 | |
| *** redrobot has joined #openstack-meeting | 13:50 | |
| *** jawad_axd has quit IRC | 13:55 | |
| *** liuyulong has joined #openstack-meeting | 13:59 | |
| *** Luzi has quit IRC | 13:59 | |
| *** liuyulong_ has joined #openstack-meeting | 14:00 | |
| liuyulong | test | 14:00 |
| liuyulong_ | test | 14:00 |
| slaweq | hi liuyulong_ :) | 14:00 |
| liuyulong_ | hi | 14:00 |
| liuyulong | #startmeeting neutron_l3 | 14:00 |
| openstack | Meeting started Wed Sep 11 14:00:40 2019 UTC and is due to finish in 60 minutes. The chair is liuyulong. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: neutron_l3)" | 14:00 | |
| openstack | The meeting name has been set to 'neutron_l3' | 14:00 |
| liuyulong | #chair liuyulong_ | 14:01 |
| openstack | Current chairs: liuyulong liuyulong_ | 14:01 |
| *** liuyulong has left #openstack-meeting | 14:01 | |
| *** liuyulong has joined #openstack-meeting | 14:01 | |
| liuyulong | #chair haleyb | 14:02 |
| openstack | Current chairs: haleyb liuyulong liuyulong_ | 14:02 |
| liuyulong | #chair slaweq | 14:02 |
| openstack | Current chairs: haleyb liuyulong liuyulong_ slaweq | 14:02 |
| haleyb | hi | 14:02 |
| liuyulong | Just in case, :) | 14:02 |
| liuyulong | #topic Announcements | 14:02 |
| *** openstack changes topic to "Announcements (Meeting topic: neutron_l3)" | 14:02 | |
| liuyulong | I have no announcement this week. | 14:03 |
| liuyulong | If you guys have, please tap the keyboard directly. : ) | 14:04 |
| ralonsoh | hi | 14:05 |
| slaweq | I have one short thing | 14:05 |
| slaweq | (or 2) | 14:05 |
| slaweq | just a reminders: | 14:05 |
| slaweq | Shanghai PTG planning etherpad | 14:05 |
| slaweq | https://etherpad.openstack.org/p/Shanghai-Neutron-Planning | 14:05 |
| slaweq | Shanghai Forum brainstorming etherpad | 14:05 |
| slaweq | https://etherpad.openstack.org/p/neutron-shanghai-forum-brainstorming | 14:05 |
| slaweq | please put there Your proposals for topics | 14:05 |
| slaweq | that's all from me :) | 14:06 |
| liuyulong | I have a lot of ideas. | 14:07 |
| liuyulong | Any other announcements? | 14:09 |
| liuyulong | OK, let's move on. | 14:09 |
| liuyulong | #topic Bugs | 14:10 |
| *** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 14:10 | |
| liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-September/009261.html | 14:11 |
| liuyulong | Nate Johnston was our bug deputy last week, thanks. | 14:11 |
| njohnston | my pleasure | 14:11 |
| liuyulong | Most of those bugs are related to CI. IMO | 14:11 |
| njohnston | I agree, I think the one most aligned with L3 is: https://bugs.launchpad.net/bugs/1842937 | 14:12 |
| openstack | Launchpad bug 1842937 in neutron "Some ports assigned to routers don't have the correspondent routerport register" [Undecided,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:12 |
| liuyulong | Yes, it is | 14:14 |
| ralonsoh | sorry, I was in other chat | 14:15 |
| ralonsoh | I have a patch in gerrit for this | 14:15 |
| ralonsoh | one sec | 14:15 |
| *** diablo_rojo has joined #openstack-meeting | 14:15 | |
| ralonsoh | #link https://review.opendev.org/#/c/680413/ | 14:15 |
| ralonsoh | the point is this patch is not solving the problem | 14:15 |
| liuyulong | I'm looking at that. : ) | 14:15 |
| ralonsoh | but mitigating it: when the port, during the sync, does not have all the ips (and subnets) | 14:16 |
| ralonsoh | although in the Neutron DB the information is correctly populated | 14:16 |
| ralonsoh | this patch is forcing the DHCP agent to retrieve, at this point, the correct information from the server | 14:16 |
| liuyulong | One small concern is that we may take care of such DB query, do not make it slow like others once we had. | 14:16 |
| ralonsoh | that's the point | 14:17 |
| ralonsoh | if the port does not have this information, we'll force a full resync | 14:18 |
| ralonsoh | this is going to be slower, for sure | 14:18 |
| *** ricolin has joined #openstack-meeting | 14:18 | |
| ralonsoh | this is happening ONLY when the port information is not correct/not totally populated | 14:18 |
| ralonsoh | eventually, if the port does not have those IPs, the server will generate other IPs and the agent will resync the whole subnet | 14:19 |
| liuyulong | This new query is related to remove router interface only? | 14:20 |
| ralonsoh | remove? no, we are not removing it | 14:21 |
| ralonsoh | the DHCP port is present in the system | 14:21 |
| liuyulong | OK, I may have to take a deep look of that patch. | 14:22 |
| liuyulong | One more interesting thing is that I noticed our local queens performance, the attach interface API will takes more than 60s+. | 14:22 |
| liuyulong | That's will be another story. | 14:23 |
| *** electrofelix has joined #openstack-meeting | 14:26 | |
| liuyulong | Next | 14:26 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1843285 | 14:27 |
| openstack | Launchpad bug 1838760 in neutron "duplicate for #1843285 Security groups don't work for trunk ports with iptables_hybrid fw driver" [High,Confirmed] - Assigned to Slawek Kaplonski (slaweq) | 14:27 |
| liuyulong | #undo | 14:27 |
| openstack | Removing item from minutes: #link https://bugs.launchpad.net/neutron/+bug/1843285 | 14:27 |
| liuyulong | Wrong link. | 14:28 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1842327 | 14:29 |
| openstack | Launchpad bug 1842327 in neutron "Report in logs when FIP associate and disassociate" [Medium,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:29 |
| liuyulong | This patch looks good to me now. | 14:29 |
| liuyulong | For the log one. | 14:29 |
| liuyulong | #link https://review.opendev.org/#/c/679667/ | 14:30 |
| *** rubasov has quit IRC | 14:30 | |
| liuyulong | And it has a l3_db change here: https://review.opendev.org/#/c/680976/ | 14:30 |
| ralonsoh | yes, the second one requested by Terry | 14:31 |
| ralonsoh | Ryan | 14:31 |
| ralonsoh | and makes sense to implement this patch https://review.opendev.org/#/c/680976/ | 14:31 |
| *** b1airo has quit IRC | 14:31 | |
| ralonsoh | we should have only one place to decide if FIP is associated, disassociated or nothing | 14:31 |
| liuyulong | Make sense, I've changed these code a long time ago. | 14:33 |
| liuyulong | And once we have a potential consensus which is updating the floating IP by empty "{}" API input, l3 plugin which change nothing, and no errors. | 14:34 |
| *** priteau has quit IRC | 14:34 | |
| liuyulong | So please consider such scenario. And maybe make sure that association_event will not be added for such scenario. | 14:35 |
| ralonsoh | ok | 14:36 |
| *** ttsiouts has quit IRC | 14:37 | |
| *** zhubx has quit IRC | 14:37 | |
| *** zhubx has joined #openstack-meeting | 14:37 | |
| *** ttsiouts has joined #openstack-meeting | 14:37 | |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1843025 | 14:37 |
| openstack | Launchpad bug 1843025 in neutron "FWaaS v2 fails to add ICMPv6 rules via horizon" [High,In progress] - Assigned to Brian Haley (brian-haley) | 14:38 |
| liuyulong | It is fixed IMO, just need a backport. | 14:38 |
| haleyb | i just did a cherry-pick on that one | 14:38 |
| haleyb | so maybe it's just a duplicate? | 14:39 |
| liuyulong | No, I noticed the bug assignee change, so I have no actions. : ) | 14:40 |
| liuyulong | OK, that's all bugs from me. | 14:40 |
| liuyulong | Any other bugs? | 14:41 |
| *** zhubx has quit IRC | 14:41 | |
| *** zhubx has joined #openstack-meeting | 14:41 | |
| *** ttsiouts has quit IRC | 14:42 | |
| liuyulong | OK, let's move on. | 14:42 |
| liuyulong | #topic On demand agenda | 14:42 |
| *** openstack changes topic to "On demand agenda (Meeting topic: neutron_l3)" | 14:42 | |
| *** belmoreira has quit IRC | 14:43 | |
| *** zhubx has quit IRC | 14:43 | |
| liuyulong | Last week I started the topic of "IPv6", and I read lots of neutron specs about floating IPv6. | 14:43 |
| *** zhubx has joined #openstack-meeting | 14:44 | |
| liuyulong | #link https://review.opendev.org/#/q/status:abandoned+project:openstack/neutron+branch:master+topic:bp/ipv6-router-and-dvr | 14:44 |
| liuyulong | #link https://review.opendev.org/#/q/ndp | 14:44 |
| liuyulong | We have this merged and implemented:https://review.opendev.org/#/c/139731/ | 14:45 |
| liuyulong | Bad link, it should be this: https://review.opendev.org/#/c/101306/ " | 14:46 |
| liuyulong | Support Router Advertisement Daemon (radvd) for IPv6" | 14:46 |
| liuyulong | #link https://review.opendev.org/#/c/139731/ | 14:46 |
| haleyb | that and floating IPv6 are different things | 14:46 |
| liuyulong | this is the spec for floating IPv6. | 14:46 |
| *** links has quit IRC | 14:46 | |
| liuyulong | haleyb, yes, just a gerrit query. : ) | 14:47 |
| haleyb | i think only one plugin supports floating IPv6, we had decided years ago not to do it in the core code | 14:47 |
| haleyb | is there a use case for doing it? it's not like there's a shortage of IPv6 addresses :) | 14:49 |
| liuyulong | Yes, IIRC, midonet may support floating IPv6. | 14:49 |
| liuyulong | After the L3 meeting last week, Donny Davis gave me their IPv6 deployment details. | 14:50 |
| haleyb | i know swami has been working on "fast exit" IPv6 w/DVR, which would be useful | 14:50 |
| liuyulong | They uses the BGP. | 14:51 |
| *** panda|rover is now known as panda|ruck | 14:52 | |
| liuyulong | But it may also need some extra works. | 14:52 |
| haleyb | right, it's a good use of BGP, assuming your infrastructure supports it | 14:52 |
| liuyulong | 1. Access the public network until the user apply or pay for it. | 14:53 |
| liuyulong | 2. Qos for IPv6 traffic to external world. | 14:53 |
| *** jbadiapa has quit IRC | 14:54 | |
| liuyulong | Oure IPv4 floating IP has both abilities now. | 14:54 |
| haleyb | so floating IP allocation costs $$ ? | 14:56 |
| *** janders has quit IRC | 14:56 | |
| liuyulong | To achive these, neutron may need some new resource "IPv6 address" or "Floating IPv6 Address" and the QoS binding for it. | 14:57 |
| liuyulong | haleyb, no, bandwidth costs money. | 14:57 |
| haleyb | liuyulong: i was wondering how the user "paid" for external access in 1) above | 14:58 |
| haleyb | one way is to charge for a floating IP address | 14:58 |
| liuyulong | It can be one way. | 14:59 |
| haleyb | i hope not to have floating IPv6 | 14:59 |
| liuyulong | In my experience, pay for some bandwidth is more popular in China. | 15:00 |
| haleyb | we are at time | 15:00 |
| liuyulong | OK, then let's end here. | 15:01 |
| liuyulong | #endmeeting | 15:01 |
| slaweq | o/ | 15:01 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:01 | |
| openstack | Meeting ended Wed Sep 11 15:01:05 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-09-11-14.00.html | 15:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-09-11-14.00.txt | 15:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-09-11-14.00.log.html | 15:01 |
| ralonsoh | bye | 15:01 |
| haleyb | bye | 15:01 |
| *** liuyulong_ has quit IRC | 15:02 | |
| *** ayoung has quit IRC | 15:07 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:08 | |
| *** ayoung has joined #openstack-meeting | 15:10 | |
| *** zhengMa has joined #openstack-meeting | 15:20 | |
| *** rubasov has joined #openstack-meeting | 15:21 | |
| *** gyee has joined #openstack-meeting | 15:23 | |
| *** macz has joined #openstack-meeting | 15:29 | |
| *** rosmaita has joined #openstack-meeting | 15:29 | |
| *** igordc has joined #openstack-meeting | 15:31 | |
| *** mattw4 has joined #openstack-meeting | 15:34 | |
| *** eharney has quit IRC | 15:37 | |
| *** e0ne has quit IRC | 15:42 | |
| *** e0ne has joined #openstack-meeting | 15:42 | |
| *** ayoung has quit IRC | 15:43 | |
| *** ayoung has joined #openstack-meeting | 15:45 | |
| *** eharney has joined #openstack-meeting | 15:50 | |
| *** Garyx has quit IRC | 15:53 | |
| *** Garyx has joined #openstack-meeting | 15:54 | |
| *** diablo_rojo has quit IRC | 15:59 | |
| *** diablo_rojo has joined #openstack-meeting | 15:59 | |
| jungleboyj | #startmeeting Cinder | 16:00 |
| whoami-rajat | Hi | 16:00 |
| openstack | Meeting started Wed Sep 11 16:00:29 2019 UTC and is due to finish in 60 minutes. The chair is jungleboyj. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: Cinder)" | 16:00 | |
| openstack | The meeting name has been set to 'cinder' | 16:00 |
| smcginnis | o/ | 16:00 |
| jungleboyj | courtesy ping: jungleboyj whoami-rajat rajinir lseki carloss pots woojay erlon geguileo eharney rosmaita enriquetaso e0ne smcginnis davidsha walshh_ xyang hemna _hemna tosky sfernand | 16:00 |
| eharney | hi | 16:00 |
| rosmaita | o/ | 16:00 |
| walshh_ | hi | 16:01 |
| jungleboyj | @! | 16:01 |
| _pewp_ | jungleboyj |ʘ‿ʘ)╯ | 16:01 |
| *** deiter has joined #openstack-meeting | 16:01 | |
| *** geguileo has joined #openstack-meeting | 16:01 | |
| jungleboyj | Looks like we have the usual suspects here and I need to try to wrap up the meeting early this week if possible. | 16:02 |
| jungleboyj | So ... #announcements | 16:03 |
| jungleboyj | #topic announcements | 16:03 |
| *** openstack changes topic to "announcements (Meeting topic: Cinder)" | 16:03 | |
| jungleboyj | All the announcements are actually rosmaita 's . So, I will hand the mic to him. | 16:03 |
| e0ne | hi | 16:03 |
| rosmaita | thanks | 16:03 |
| rosmaita | ok, release update | 16:03 |
| rosmaita | os-brick for train (0.11.0) was released last week | 16:04 |
| rosmaita | and we have a stable/train branch for os-brick | 16:04 |
| jungleboyj | \o/ | 16:04 |
| *** mattw4 has quit IRC | 16:04 | |
| rosmaita | so just a reminder that bugfixes need to go into master and then be proposed to stable/train | 16:04 |
| smcginnis | We should probably do a 1.0 release for os-brick. I think it's "production ready" now. | 16:04 |
| *** mattw4 has joined #openstack-meeting | 16:04 | |
| smcginnis | For ussuri ^ | 16:04 |
| eharney | os-brick is past 2.0 already :) | 16:04 |
| rosmaita | ok, we can schedule a major release for brick in U | 16:05 |
| jungleboyj | Yeah. 2.10.0 | 16:05 |
| rosmaita | we could do like java and release 6.0 | 16:05 |
| smcginnis | OK, that's what I thought. | 16:05 |
| enriquetaso | o/ | 16:05 |
| rosmaita | sorry, i had the wrong version number there | 16:06 |
| jungleboyj | :-) | 16:06 |
| rosmaita | the brick cincerclient ext is 0.11.0, was released earlier this week | 16:06 |
| rosmaita | and it has a stable branch too, so same deal with any bugfixes -- master then stable/train | 16:07 |
| rosmaita | finally, the cinderclient new major release 5.0.0 is almost ready | 16:07 |
| rosmaita | one patch remains: | 16:07 |
| rosmaita | #link https://review.opendev.org/#/c/653831/ | 16:07 |
| rosmaita | it's still in check, will need some reviews later today please | 16:08 |
| rosmaita | then we can release as soon as the change merges | 16:08 |
| jungleboyj | rosmaita: ++ | 16:08 |
| smcginnis | At least the gate seems a little better today. | 16:08 |
| rajinir | o/ | 16:08 |
| rosmaita | and when we release cinderclient, we'll have a stable/train branch, etc | 16:09 |
| jungleboyj | So, other than the one patch we are good to have all the libraries out on time? | 16:09 |
| rosmaita | yes, i think we are in good shape | 16:09 |
| rosmaita | cinderlib is a cycle-trailing release model | 16:09 |
| rosmaita | so that one comes after cinder train release | 16:10 |
| jungleboyj | Ok. rosmaita Did anyone make sure that the client changes that are being released match up with what looks to go into the server for Train? | 16:10 |
| rosmaita | ummm ... not sure | 16:10 |
| rosmaita | i forgot to check | 16:10 |
| *** mattw4 has quit IRC | 16:10 | |
| jungleboyj | :-) We should probably do that before we cut the client. | 16:10 |
| rosmaita | yes, i will take that action item | 16:11 |
| jungleboyj | rosmaita: Awesome. Thank you. | 16:11 |
| rosmaita | #action rosmaita verify MAX_VERSION for client | 16:11 |
| rosmaita | i think that's all for releases unless anyone has a question | 16:11 |
| *** deiter has quit IRC | 16:11 | |
| jungleboyj | Thank you again for shepherding all that. | 16:12 |
| enriquetaso | rosmaita++ | 16:12 |
| smcginnis | Hmm, according to https://opendev.org/openstack/cinder/src/branch/master/cinder/api/openstack/rest_api_version_history.rst, we haven't added any MV's in train? | 16:12 |
| rosmaita | that should make things easy | 16:13 |
| jungleboyj | That is possible. | 16:13 |
| jungleboyj | :-) | 16:13 |
| smcginnis | Huh, I guess so - https://opendev.org/openstack/cinder/src/branch/master/cinder/api/microversions.py#L160 | 16:13 |
| rosmaita | and https://opendev.org/openstack/python-cinderclient/src/branch/master/cinderclient/api_versions.py#L32 | 16:14 |
| rosmaita | so looks like we are ok | 16:15 |
| jungleboyj | Good news. :-) | 16:15 |
| jungleboyj | Ok. So I think we can move along then. | 16:16 |
| rosmaita | ok, Shanghai Forum Topics | 16:16 |
| jungleboyj | ++ | 16:16 |
| rosmaita | #link https://etherpad.openstack.org/p/cinder-shanghai-forum-proposals | 16:16 |
| rosmaita | so, the forum is supposed to give us a chance to discuss long term strategy with users/operators/packagers | 16:17 |
| rosmaita | geguileo suggested a general feedback topic, so that's on the etherpad | 16:17 |
| jungleboyj | rosmaita: I have a couple to put in there that came up at the mid-cycle. Will do that today. | 16:17 |
| rosmaita | but if anyone has a particular topic, that would be good | 16:18 |
| geguileo | jungleboyj: thanks | 16:18 |
| jungleboyj | rosmaita: ++ Would be great if we got people to show up for that and give feedback. | 16:18 |
| rosmaita | i sent a note to the ML [ops] to see if any operators want us to address anything | 16:18 |
| rosmaita | anyway, we have to formally submit topics at the end of next week, so if you could get topics on the etherpad before the next cinder meeting, that would be awesome | 16:19 |
| rosmaita | the idea is we are supposed to be "brainstorming" and then vote for what the team wants to submit | 16:19 |
| jungleboyj | Sounds like a good plan. | 16:20 |
| rosmaita | one other thing, even if you won't be there, please add a topic if you have one | 16:20 |
| rosmaita | ok, that's all for that | 16:20 |
| rosmaita | one more etherpad for you: | 16:20 |
| rosmaita | #link https://etherpad.openstack.org/p/cinder-ussuri-ptg-planning | 16:20 |
| * jungleboyj sits back and relaxes | 16:21 | |
| jungleboyj | :-) | 16:21 |
| rosmaita | i don't think our sessions have been confirmed yet, but we can start collecting discussion points | 16:21 |
| rosmaita | also, i don't know if we'll be able to do remote joining for this | 16:21 |
| jungleboyj | I had requested a 2 day session with 2 to 4 hours separate for on-boarding. | 16:21 |
| rosmaita | i haven't heard much about the facilities | 16:21 |
| *** ricolin has quit IRC | 16:22 | |
| rosmaita | ok, so we should expect at least 1.5 days | 16:22 |
| jungleboyj | Theoretically BlueJeans should work again. My co-workers can join from China. | 16:22 |
| smcginnis | No projectors. Zoom blocked by the great firewall. Shared large rooms. | 16:22 |
| * jungleboyj gags | 16:22 | |
| rosmaita | yeah ... so this should be fun | 16:23 |
| smcginnis | Paris all over again, with the fun parties and good pastries. | 16:23 |
| smcginnis | *without | 16:23 |
| jungleboyj | You mean without? | 16:23 |
| jungleboyj | Yeah. | 16:23 |
| e0ne | :( | 16:23 |
| eharney | i'd settle for an IRC live stream of the discussions | 16:23 |
| *** thgcorrea has joined #openstack-meeting | 16:23 | |
| rosmaita | well, we'll always have paris | 16:23 |
| eharney | :P | 16:23 |
| rosmaita | i guess we could do IRC | 16:23 |
| rosmaita | if we use our channel, we get an automatic transcript | 16:23 |
| jungleboyj | Yeah, Well, isn't that kind of what the ehterpad is? | 16:23 |
| smcginnis | Hopefully we can get to freenode. | 16:24 |
| whoami-rajat | IRC live stream? | 16:24 |
| jungleboyj | OMG, so we will all be in the same room typing to each other. | 16:24 |
| rosmaita | smcginnis: you are Mr. Cheerful today | 16:24 |
| jungleboyj | Do I have to go to China? | 16:24 |
| smcginnis | rosmaita: :) | 16:24 |
| jungleboyj | smcginnis: Dude you were cheerful on Monday. | 16:24 |
| geguileo | we could always VPN out of the country and use whatever we want | 16:24 |
| smcginnis | Sorry, trying not to be too pessimistic, but there are a lot of little concerns with how things are shaping up. | 16:24 |
| smcginnis | geguileo: That's what I've had to do while there. | 16:25 |
| jungleboyj | geguileo: Yeah, I think I have some freedom with Lenovo VPN. I am working on setting up a backup but no idea what the latency will be jumping through my house. | 16:25 |
| smcginnis | Works well, as long as you have a VPN that doesn't get blocked. | 16:25 |
| geguileo | jungleboyj: I doubt my house would be any better XD | 16:25 |
| rosmaita | yeah, i thought there was some kind of vpn-detection-and-blocking ability | 16:25 |
| smcginnis | rosmaita: Many are blocked, but a few still work. | 16:25 |
| rosmaita | ok, so for now, let's pretend we'll all be able to have a great discussion, and please add ideas to the etherpad | 16:26 |
| jungleboyj | Anyway, no point grumbling about what we can't control. | 16:26 |
| jungleboyj | rosmaita: That a boy. | 16:26 |
| smcginnis | Yep, let's focus on what we want to accomplish. | 16:26 |
| rosmaita | https://etherpad.openstack.org/p/cinder-ussuri-ptg-planning | 16:26 |
| rosmaita | ok, that's all from me | 16:26 |
| jungleboyj | Well, this is good to see names going into the etherpad as attendees. | 16:27 |
| jungleboyj | Ok. So, it looks like the next topic is ... | 16:27 |
| jungleboyj | #topic Please review my Train feature ... | 16:27 |
| *** openstack changes topic to "Please review my Train feature ... (Meeting topic: Cinder)" | 16:27 | |
| smcginnis | Hah | 16:27 |
| jungleboyj | We need to add a louder horn, better fuel efficiency, | 16:28 |
| jungleboyj | Other ideas? | 16:28 |
| jungleboyj | So, it looks like we have a few features that need review. | 16:29 |
| eharney | yes | 16:29 |
| eharney | volume rekey is one: https://review.opendev.org/#/c/664976/ | 16:30 |
| * jungleboyj is clicking through them. | 16:30 | |
| rosmaita | i need to re-review that and the image compression patch | 16:30 |
| *** ociuhandu has quit IRC | 16:30 | |
| zhengMa | thanks! | 16:30 |
| rosmaita | e0ne's patch looks pretty straightforward, assuming everyone is good with removing BackupDriverWithVerify | 16:31 |
| e0ne | :) | 16:31 |
| jungleboyj | Yeah. | 16:31 |
| eharney | looks sensible to me | 16:31 |
| jungleboyj | smcginnis: Loves removing code. | 16:31 |
| jungleboyj | :-) | 16:31 |
| e0ne | we discussed in during the last PTG... | 16:31 |
| rosmaita | i thought i remembered something like that | 16:32 |
| rosmaita | i don't mean to leave out whoami-rajat's patch, we definitely want to get that into Train | 16:33 |
| jungleboyj | Don't we need a release note on that? | 16:33 |
| jungleboyj | rosmaita: ++ | 16:33 |
| eharney | release note for which? | 16:33 |
| rosmaita | jungleboyj: i don't think there's really anything to say, it's an unused interface | 16:33 |
| jungleboyj | e0ne's patch. | 16:33 |
| eharney | rosmaita: i agree | 16:33 |
| rosmaita | i assumed you meant e0ne's patch | 16:33 |
| e0ne | jungleboyj: I can add it but I don't think somebody uses it | 16:33 |
| rosmaita | i think the less said the better | 16:34 |
| jungleboyj | Ah, ok. I guess you are right if it isn't being used. | 16:34 |
| e0ne | 5 years and nothing in cinder repo | 16:34 |
| jungleboyj | Ok. I am good as is and will look at the other patches. It looks like they all are pretty close. | 16:35 |
| smcginnis | Yeah, release note might just be confusing on that one. | 16:35 |
| *** ekcs has joined #openstack-meeting | 16:35 | |
| jungleboyj | gotcha. | 16:35 |
| jungleboyj | Ok, anything else to cover on reviews? | 16:35 |
| eharney | i added a question to the default vol type patch | 16:35 |
| rosmaita | i have a question about a feature freeze exception | 16:36 |
| jungleboyj | rosmaita: Go ahead | 16:36 |
| rosmaita | the change to glance that introduces 'cinder_encryption_key_deletion_policy' merged last week | 16:36 |
| *** ralonsoh has quit IRC | 16:37 | |
| rosmaita | do i need a FFE for a patch for us to start using it? | 16:37 |
| rosmaita | it's not really a feature, but it's not really a bug either | 16:37 |
| * jungleboyj defers to the release guy in the room | 16:37 | |
| jungleboyj | smcginnis: ... | 16:37 |
| eharney | that mostly just consists of adding a field to the glance metadata from cinder, right? | 16:37 |
| rosmaita | exactly | 16:37 |
| jungleboyj | That doesn't sound like it requires an FFE. | 16:38 |
| rosmaita | i don't think we want any configuration on our end? | 16:38 |
| jungleboyj | To enable a feature that has merged in Glance. | 16:38 |
| e0ne | jungleboyj: +1 | 16:38 |
| eharney | IMO we need to land it either way, an FFE is probably overhead w/o a lot of benefit for a small change like that | 16:38 |
| jungleboyj | eharney: ++ | 16:38 |
| smcginnis | FFE is up to the PTL, but if we need that, we should get the change in. | 16:38 |
| rosmaita | yeah, i'll get a patch up today or early tomorrow | 16:39 |
| jungleboyj | It was something we agreed to at the PTG. I think we are good to get that in without complicating things. | 16:39 |
| rosmaita | ok, cool | 16:39 |
| jungleboyj | It is unlikely to break Cinder. | 16:39 |
| jungleboyj | I assume? | 16:39 |
| rosmaita | pretty unlikely | 16:39 |
| rosmaita | fairly unlikely | 16:39 |
| jungleboyj | Ok. And we still have a bit of runtime. | 16:39 |
| jungleboyj | Lets get the patch up and take a look. | 16:40 |
| rosmaita | ok | 16:40 |
| *** lpetrut has quit IRC | 16:40 | |
| jungleboyj | #topic open discussion | 16:40 |
| *** openstack changes topic to "open discussion (Meeting topic: Cinder)" | 16:40 | |
| jungleboyj | Anyone have other topics for today? | 16:40 |
| jungleboyj | That sounds like a no. | 16:41 |
| jungleboyj | So, going to give people 19 minutes of their day back. | 16:41 |
| rosmaita | \o/ | 16:42 |
| jungleboyj | Thank you all for coming. | 16:42 |
| jungleboyj | rosmaita: Thanks for helping get this release out properly! | 16:42 |
| whoami-rajat | Thanks ! | 16:42 |
| jungleboyj | #endmeeting | 16:42 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 16:42 | |
| openstack | Meeting ended Wed Sep 11 16:42:23 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:42 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-09-11-16.00.html | 16:42 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-09-11-16.00.txt | 16:42 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-09-11-16.00.log.html | 16:42 |
| rosmaita | oh yeah, core reviewers please keep an eye on https://review.opendev.org/#/c/653831/ | 16:42 |
| jungleboyj | Will do. | 16:42 |
| *** ociuhandu has joined #openstack-meeting | 16:46 | |
| *** geguileo has quit IRC | 16:46 | |
| *** ayoung has quit IRC | 16:51 | |
| *** ayoung has joined #openstack-meeting | 16:53 | |
| *** e0ne has quit IRC | 16:54 | |
| *** tesseract has quit IRC | 16:57 | |
| *** gibi_fly is now known as gibi_bus | 16:58 | |
| *** mriedem is now known as gibi_zeppelin | 16:58 | |
| *** gibi_zeppelin is now known as gibi_submarine | 16:58 | |
| *** gibi_submarine is now known as mriedem | 16:58 | |
| *** zhengMa has left #openstack-meeting | 17:02 | |
| *** ociuhandu has quit IRC | 17:08 | |
| *** ayoung has quit IRC | 17:14 | |
| *** ayoung has joined #openstack-meeting | 17:17 | |
| *** ociuhandu has joined #openstack-meeting | 17:27 | |
| *** ociuhandu has quit IRC | 17:31 | |
| *** brault has quit IRC | 17:33 | |
| *** brault has joined #openstack-meeting | 17:35 | |
| *** brault has quit IRC | 17:35 | |
| *** brault has joined #openstack-meeting | 17:35 | |
| *** kopecmartin is now known as kopecmartin|off | 17:38 | |
| *** ayoung has quit IRC | 17:39 | |
| *** ayoung has joined #openstack-meeting | 17:42 | |
| *** liuyulong has quit IRC | 17:45 | |
| *** e0ne has joined #openstack-meeting | 17:55 | |
| *** electrofelix has quit IRC | 17:56 | |
| *** e0ne has quit IRC | 17:59 | |
| *** jamesmcarthur has quit IRC | 18:06 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:07 | |
| *** jamesmcarthur has quit IRC | 18:11 | |
| *** Garyx has quit IRC | 18:12 | |
| *** Garyx has joined #openstack-meeting | 18:16 | |
| *** e0ne has joined #openstack-meeting | 18:17 | |
| *** panda|ruck is now known as panda|ruck|off | 18:21 | |
| *** jbadiapa has joined #openstack-meeting | 18:27 | |
| *** radeks has quit IRC | 18:40 | |
| *** eharney has quit IRC | 18:55 | |
| *** enriquetaso has quit IRC | 19:00 | |
| *** senrique_ has joined #openstack-meeting | 19:01 | |
| *** brault has quit IRC | 19:02 | |
| SotK | #startmeeting storyboard | 19:02 |
| openstack | Meeting started Wed Sep 11 19:02:41 2019 UTC and is due to finish in 60 minutes. The chair is SotK. Information about MeetBot at http://wiki.debian.org/MeetBot. | 19:02 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 19:02 |
| *** openstack changes topic to " (Meeting topic: storyboard)" | 19:02 | |
| openstack | The meeting name has been set to 'storyboard' | 19:02 |
| *** senrique_ has quit IRC | 19:02 | |
| *** thgcorrea has quit IRC | 19:03 | |
| SotK | #link https://wiki.openstack.org/wiki/Meetings/StoryBoard Agenda | 19:03 |
| SotK | I don't think there's anything to announce this week, and assume nothing new on the migrations front too | 19:03 |
| SotK | #topic PTG + Forum | 19:04 |
| *** openstack changes topic to "PTG + Forum (Meeting topic: storyboard)" | 19:04 | |
| fungi | diablo_rojo: you're up! | 19:05 |
| diablo_rojo | Oh jeez that was fast. | 19:05 |
| diablo_rojo | I wrote a thing a while back | 19:05 |
| diablo_rojo | if it looks alright. I will submit it. | 19:06 |
| fungi | #link https://etherpad.openstack.org/p/storyboard-shanghai-ptg-planning | 19:06 |
| fungi | that thing? | 19:06 |
| *** enriquetaso has joined #openstack-meeting | 19:08 | |
| *** eharney has joined #openstack-meeting | 19:08 | |
| diablo_rojo | Thats the one | 19:08 |
| SotK | looks good to me | 19:09 |
| fungi | seems great. thanks! | 19:09 |
| fungi | ship it | 19:09 |
| diablo_rojo | Cool. | 19:11 |
| diablo_rojo | At some point we should discuss an outline for both of the different onboardings | 19:12 |
| diablo_rojo | But that can wait to see if the Forum session gets selected. | 19:12 |
| diablo_rojo | Thats all I had on this topic for now. | 19:12 |
| SotK | thanks :) | 19:13 |
| SotK | #topic In Progress Work | 19:13 |
| *** openstack changes topic to "In Progress Work (Meeting topic: storyboard)" | 19:13 | |
| SotK | I've not done a huge amount other than a quick look over the slow query digest | 19:15 |
| fungi | any first impressions? | 19:16 |
| fungi | i'm happy to refresh it again too if need be | 19:16 |
| diablo_rojo | mordred, around by chance? | 19:17 |
| fungi | #link http://files.openstack.org/user/fungi/storyboard/ slow query analysis | 19:17 |
| fungi | i think mordred is still out of pocket until next week | 19:18 |
| fungi | i think that digest-output.txt.gz is telling us that 50.5% of the total query time was spent on "SELECT stories tasks stories" | 19:19 |
| *** rubasov has quit IRC | 19:19 | |
| fungi | not quite sure what that abbreviation means | 19:22 |
| fungi | (it doesn't seem to be actual sql) | 19:22 |
| SotK | I think its just the tables being queried, the full query is further down in the file | 19:22 |
| fungi | yeah, i'm guessing that's the one marked "Query 1" | 19:23 |
| SotK | yep | 19:23 |
| fungi | average exec time is 91s | 19:23 |
| SotK | I think that query is the generic story getting query, but I'm not certain | 19:23 |
| SotK | its certainly ugly and slow | 19:23 |
| fungi | the query itself wraps 22 lines on my 80-column terminal, yes | 19:25 |
| diablo_rojo | Ouch | 19:25 |
| fungi | well, that's the explain expansion of it | 19:25 |
| SotK | I've not done enough database optimising to immediately know which the worst parts are, but I'll try to experiment with ways to simplify it | 19:25 |
| fungi | so basically as verbose an interpretation of the query as possible, but that's indeed still big | 19:26 |
| fungi | i wonder whether there's some way to decorate queries in the application so that we get useful backtracking breadcrumbs in the query logs | 19:26 |
| fungi | corvus: if you're around, maybe you know whether that's a thing? | 19:27 |
| corvus | ack; catching up | 19:28 |
| *** artom has quit IRC | 19:28 | |
| corvus | that is an excellent idea; i don't know of a way to do that, but i don't consider my knowledge there exhaustive. i'd probably look into not using the slow query log and instead doing something in python | 19:30 |
| fungi | hrm, like wrap all orm calls in some timer code? | 19:31 |
| corvus | yeah, something like that | 19:31 |
| fungi | that would indeed give us the ability to, say, raise non-terminating exceptions in the application logs which include tracebacks | 19:31 |
| fungi | whenever a query runs over a certain threshold | 19:32 |
| fungi | though maybe harder to identify frequently-run queries which in aggregate add up to a lot of waiting | 19:32 |
| corvus | #link https://docs.sqlalchemy.org/en/13/faq/performance.html | 19:32 |
| corvus | that may not be too hard | 19:32 |
| fungi | yeah, i guess they could be bucketed | 19:33 |
| fungi | that's a very helpful-looking document. thanks!!! | 19:33 |
| SotK | indeed, I can try some of the things described there this weekend sometime hopefully | 19:34 |
| fungi | that would be awesome | 19:35 |
| fungi | i'll try to digest the recommendations there too | 19:35 |
| fungi | we can probably couple it with slow query logging to correlate the views from the db end and teh app end | 19:35 |
| fungi | one other thing i noticed when turning the slow log back on... it took a while to start registering any queries slower than 1s, and days to start hitting any over 20s, but eventually started regularly logging some which took minutes | 19:36 |
| *** artom has joined #openstack-meeting | 19:37 | |
| fungi | it may just be coincidence, but i wonder whether we're seeing some sort of degradation over time | 19:37 |
| fungi | as i did restart mysqld in the process of troubleshooting whether i had properly reenabled the slow log | 19:37 |
| diablo_rojo | Huh | 19:38 |
| SotK | interesting, sounds like maybe yes | 19:38 |
| diablo_rojo | that does sound likely | 19:39 |
| fungi | checking our cacti graphs, that production server is fairly under-utilized, but it does use the majority of available memory for cache | 19:41 |
| fungi | #link http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=66356&rra_id=all | 19:41 |
| fungi | not really sure if giving it more memory would help or not | 19:42 |
| fungi | according to top, apache is using more resident memory than mysqld, but mysqld is using more virtual memory | 19:42 |
| fungi | also rabbit is using rather a lot of virtual memory | 19:43 |
| fungi | i wonder if cache memory for mysqld is getting starved out over time by one of its competitors there | 19:43 |
| fungi | i suppose i could do some experiments tracking query times before and after restarts of apache and rabbit | 19:44 |
| fungi | and ultimately, also restarts of mysql | 19:44 |
| SotK | seems worth trying | 19:45 |
| *** eharney has quit IRC | 19:45 | |
| fungi | i've put those experiments on my to do list | 19:46 |
| SotK | thanks :) | 19:46 |
| SotK | #topic Open Discussion | 19:47 |
| *** openstack changes topic to "Open Discussion (Meeting topic: storyboard)" | 19:47 | |
| diablo_rojo | thanks fungi :) | 19:47 |
| diablo_rojo | I got nothing for open discussion. | 19:47 |
| SotK | fungi: you also mentioned external group management in the channel earlier | 19:47 |
| fungi | so one thing i'm finding is increasing in urgency is group management | 19:47 |
| fungi | yeah | 19:47 |
| diablo_rojo | Makes sense. | 19:47 |
| fungi | there are an increasing number of openstack projects which are under vmt oversight and migrating to storyboard | 19:48 |
| fungi | we have several at my last count | 19:48 |
| *** vishalmanchanda has quit IRC | 19:48 | |
| diablo_rojo | Thats good news I suppose. Though I suppose we should write some script or something to import the groups. | 19:49 |
| diablo_rojo | Maybe an addition onto the current migration script? | 19:49 |
| fungi | well, before that even, i want to start publishing recommended practices for manitaining core security reviewer groups and for lp we already have a self-managed solution for that. for sb i think what we've discussed in the past is either synchronizing groups from gerrit or creating them from structured data files in git | 19:49 |
| SotK | that matches my memory | 19:49 |
| fungi | the challenge i've run up aganist in trying to plan that mechanism (either of them) is that we don't necessarily have preexisting accounts in sb | 19:50 |
| fungi | so i'm trying to figure out how best to deal with that | 19:50 |
| SotK | will a similar method to the one used by the migration scripts work | 19:51 |
| fungi | but also, we need a good discoverable unique handle for each user which we can use to perform lookups | 19:51 |
| SotK | ? | 19:51 |
| SotK | yeah | 19:51 |
| diablo_rojo | I guess we skip the ones that don't have accounts | 19:51 |
| diablo_rojo | and add them later? | 19:51 |
| SotK | I guess the closest we have to that is openid | 19:52 |
| fungi | yeah, i think i can say that users need to create an account in sb before they'll be added to the group by whatever automated process we settle on | 19:52 |
| diablo_rojo | That works for me | 19:52 |
| SotK | then as long as they use the same openid for gerrit and storyboard it should be reasonably easy to match them right? | 19:53 |
| fungi | but right we'd for example need to map an openid which the person creating the list of users (think... a ptl) can find and add to the list | 19:53 |
| SotK | unless gerrit makes it hard to find users' openids | 19:53 |
| SotK | oh I was only considering the "mirror gerrit groups" approach | 19:54 |
| fungi | well, yeah, gerrit doesn't expose openids last i checked so that would need a direct db query (and recreatnig from scratch when users move into notedb in later gerrit versions) | 19:54 |
| SotK | far less than ideal then | 19:54 |
| SotK | hmm | 19:54 |
| fungi | also using gerrit as a proxy for group management means creating groups in gerrit which are unused by acls, and we don't (currently) have any self-service automation for that either | 19:54 |
| *** panda|ruck|off has quit IRC | 19:55 | |
| SotK | maybe we need to revisit the "unique nicknames" thing we've talked about in the past | 19:55 |
| *** gibi_bus is now known as gibi | 19:55 | |
| fungi | right, or make it possible to look up openids in sb | 19:55 |
| fungi | for the structured data file in git approach anyway | 19:55 |
| fungi | alternatively, we can do the same thing gerrit does and assume e-mail addresses are unique to a single user | 19:56 |
| fungi | and then work out a way to add users to a group via e-mail address lookup | 19:56 |
| SotK | you mean make it possible for PTLs to find the openids of their team members' storyboard accounts? | 19:57 |
| fungi | even just exposing a unique account id number somewhwere could do the trick though, as long as we added api support to convert that to an account or to be able to use it directly in group member addition calls | 19:57 |
| *** panda has joined #openstack-meeting | 19:57 | |
| SotK | I think that's already possible with the API, we just need to add some sensible UI for viewing information about users | 19:58 |
| fungi | but yeah, whatever unique identifier we settle on, we need some means for a non-admin sb user to figure out another sb user's unique id | 19:58 |
| SotK | people have requested a "user profile" type page in the past, probably we should bump that idea up the priority list since it also implies a way to find users | 19:59 |
| fungi | if we had that, i think i have enough to put together some simple automation driven from structured data in git and a workflow around it | 19:59 |
| fungi | anyway, i mainly wanted to explain the current challenges, and get folks thinking if there are any elegant solutions | 19:59 |
| * SotK will apply some thought to it | 20:00 | |
| fungi | or at least to help identify which solution would be most preferable | 20:00 |
| fungi | thanks! | 20:00 |
| fungi | and looks like we're out of time | 20:00 |
| SotK | yep | 20:00 |
| SotK | thanks for coming folks! | 20:00 |
| SotK | #endmeeting | 20:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 20:00 | |
| openstack | Meeting ended Wed Sep 11 20:00:28 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 20:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/storyboard/2019/storyboard.2019-09-11-19.02.html | 20:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/storyboard/2019/storyboard.2019-09-11-19.02.txt | 20:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/storyboard/2019/storyboard.2019-09-11-19.02.log.html | 20:00 |
| fungi | thanks for chairing, SotK! | 20:00 |
| diablo_rojo | thanks SotK! | 20:04 |
| *** jamesmcarthur has joined #openstack-meeting | 20:06 | |
| *** e0ne has quit IRC | 20:06 | |
| *** rosmaita has left #openstack-meeting | 20:14 | |
| *** e0ne has joined #openstack-meeting | 20:15 | |
| *** e0ne has quit IRC | 20:16 | |
| *** e0ne has joined #openstack-meeting | 20:16 | |
| *** ayoung has quit IRC | 20:24 | |
| *** ayoung has joined #openstack-meeting | 20:24 | |
| *** markvoelker has quit IRC | 20:27 | |
| *** e0ne has quit IRC | 20:29 | |
| *** e0ne_ has joined #openstack-meeting | 20:29 | |
| *** ayoung has quit IRC | 20:35 | |
| *** markvoelker has joined #openstack-meeting | 20:36 | |
| *** ayoung has joined #openstack-meeting | 20:38 | |
| *** markvoelker has quit IRC | 20:41 | |
| *** ociuhandu has joined #openstack-meeting | 20:50 | |
| *** enriquetaso has quit IRC | 20:54 | |
| *** ociuhandu has quit IRC | 20:57 | |
| *** alecuyer has joined #openstack-meeting | 20:59 | |
| timburke | #startmeeting swift | 21:00 |
| openstack | Meeting started Wed Sep 11 21:00:04 2019 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
| openstack | The meeting name has been set to 'swift' | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| alecuyer | o/ | 21:00 |
| mattoliverau | o/ | 21:01 |
| tdasilva | o/ | 21:01 |
| timburke | agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:02 |
| timburke | #topic Shanghai | 21:02 |
| *** openstack changes topic to "Shanghai (Meeting topic: swift)" | 21:02 | |
| timburke | just a quick reminder that we ought to put things we want to talk about on the etherpad so we won't forget | 21:03 |
| timburke | #link https://etherpad.openstack.org/p/swift-ptg-shanghai | 21:03 |
| timburke | not that i'm concerned about us finding something to talk about ;-) | 21:03 |
| timburke | just want to make sure we remember to cover what we wanted to | 21:03 |
| timburke | on to updates! | 21:04 |
| timburke | #topic py3 | 21:04 |
| *** openstack changes topic to "py3 (Meeting topic: swift)" | 21:04 | |
| timburke | i'm inclined to approve the probe tests (https://review.opendev.org/#/c/671333/) based on zaitcev's +2 and mattoliverau's prior generally-approving review, barring objections | 21:05 |
| timburke | after that i need to start looking at making a py3 probe tests job | 21:06 |
| mattoliverau | did you remove the print? | 21:06 |
| timburke | yup :-) | 21:06 |
| mattoliverau | ok, give me a sec ;) | 21:06 |
| timburke | hehe | 21:06 |
| mattoliverau | done | 21:07 |
| tdasilva | fwiw, I haven't been able to run probetests on my fedora-saio, i still need to find time to debug it | 21:07 |
| tdasilva | i'm assuming zaitcev is able thou, so i'm not super concerned, it's most likely my env. | 21:08 |
| *** ykatabam has joined #openstack-meeting | 21:08 | |
| timburke | the main other thing i'd like people to think about is which func test jobs we can drop. at the moment we've got 5 in-process func test jobs running for each of py2 and py3 | 21:09 |
| timburke | i've got this feeling like a lot of that's repeating testing of things where we already have good coverage | 21:09 |
| *** slaweq has quit IRC | 21:10 | |
| timburke | it gets particularly annoying when we have spurious failures because of a resource-constrained gate | 21:10 |
| mattoliverau | that is alot. though we do test different configurations which is good. | 21:10 |
| mattoliverau | Dropping some from say py2 and py3 might be good. _OR_ do we want to move some as periodic jobs | 21:10 |
| timburke | but, that situation also seems like it might be improving? idk. i'm not in a *big* hurry... just wanted to put it out there | 21:11 |
| *** slaweq has joined #openstack-meeting | 21:11 | |
| mattoliverau | so they get tested say weekly, to make sure py2 encryption doesn't die, for example | 21:11 |
| mattoliverau | yeah, just brain storming :) | 21:11 |
| tdasilva | I always forget why we have a separate s3api? why can't that be enabled by default such that tests are run in the regular func tests | 21:12 |
| alecuyer | Is there a way to trigger them all, for example after a patch has been reviewed, updated etc.. before merging ? | 21:12 |
| timburke | mattoliverau, yeah, i was thinking about something like run ec on py3 and encryption on py2 or similar, relying on unit test coverage to catch ec-py2 and encryption-py3 bugs | 21:12 |
| timburke | maybe move some to experimental? | 21:12 |
| timburke | that sounds a lot like alecuyer's suggestion :-) | 21:13 |
| mattoliverau | or trigger some func tests based on patch contents. Ie only run py3 encryption if something happens in the encryption middleware | 21:14 |
| mattoliverau | otherwise run py2 encryption each time | 21:14 |
| mattoliverau | a dunno, we may need a matrix :) | 21:14 |
| timburke | ^^^ not a bad idea... we tend to compartmentalize functionality pretty well... | 21:15 |
| *** rcernin has joined #openstack-meeting | 21:15 | |
| timburke | anyway, maybe something to talk about more in the coming weeks (or even shanghai) | 21:15 |
| timburke | #topic versioning | 21:15 |
| *** openstack changes topic to "versioning (Meeting topic: swift)" | 21:15 | |
| tdasilva | but we also know that swift tests do not put a big load on the gate, so i'm not sure we would see better results, would we? | 21:16 |
| timburke | tdasilva, true... mainly i don't want to type "recheck" so much :P | 21:16 |
| tdasilva | +1 | 21:17 |
| timburke | assuming a more-or-less constant rate of spurious failures, fewer jobs mean fewer rechecks | 21:18 |
| timburke | (our removing jobs would almost certainly be rounding-error in terms of gate-resource-constraints) | 21:18 |
| *** slaweq has quit IRC | 21:18 | |
| timburke | looks like clayg's not around ATM; i can give an update on versioning (unless tdasilva would like to) | 21:19 |
| *** boxiang has joined #openstack-meeting | 21:19 | |
| tdasilva | timburke: go ahead | 21:20 |
| *** jamesmcarthur has quit IRC | 21:20 | |
| timburke | so clayg, tdasilva, and i have been talking about what design would get us to S3-style versioning a lot lately | 21:20 |
| *** zhubx has quit IRC | 21:20 | |
| timburke | i think what we're landing on is two separate filters so we only have to have a single "mode" loaded in our heads at a time while coding and reviewing | 21:21 |
| timburke | but with a single entrypoint, similar to what we did with encryption wrapping up encrypter and decrypter | 21:21 |
| mattoliverau | 2 filters? for different modes? | 21:23 |
| mattoliverau | Do we have an ethernet page or something where the rough idea/plan lives? | 21:23 |
| mattoliverau | can we make one, so I can live vicariously though you guys.. or ask silly questions :P | 21:24 |
| timburke | mattoliverau, yep. keep versioned_writes more or less as it is to deal with x-versions/history-location, add another one that wraps it (or is wrapped by it) for the new data layout | 21:24 |
| timburke | no etherpad yet -- can try to get that going | 21:25 |
| mattoliverau | cool, I know clayg asked if I was free to talk about some of this. Which is cool, but we should try and keep the discussion open. Having said that, thanks guys for all the hard work :) | 21:26 |
| timburke | this still gives us something of an opportunity for a clean break, which means we can have the new mode only use symlinks when writing new versions or restoring versions, rather than having this extra bifurcation | 21:27 |
| mattoliverau | I like that | 21:27 |
| *** slaweq has joined #openstack-meeting | 21:27 | |
| tdasilva | mattoliverau: it's definitely not set in stone, it's just the latest idea we had and liked it, but please do share your ideas too | 21:27 |
| mattoliverau | if we can get symlinks + new layout + backwards compat. That'll be amazing | 21:27 |
| timburke | tdasilva or i will work on getting https://review.opendev.org/#/c/678962/ and https://review.opendev.org/#/c/681054/ consolidated | 21:28 |
| timburke | mattoliverau, it's that last one that's always tricky ;-) | 21:28 |
| tdasilva | mattoliverau: what do you mean by backwards compat? | 21:28 |
| mattoliverau | yeah, I was OK with loosing the last, so long as we're careful | 21:28 |
| timburke | so... what's your opinion on what "backwards compat" means? yeah, tdasilva get's it ;-) | 21:28 |
| timburke | does it mean "this old mode continues working, but you can do this new thing for new stuff", or do we need a migration path to get people from the old to the new? | 21:29 |
| mattoliverau | sorry, I mean that we can use the same API and things auto migrate over. Not introducing a new versioning API, or middleware what makes old versions incompatable | 21:30 |
| mattoliverau | by auto migrate, I mean from when you start adding new items | 21:30 |
| mattoliverau | not something in the back ground | 21:30 |
| mattoliverau | so old continues working, but new stuff uses the new thing.. but it is all accessible via the same API | 21:31 |
| mattoliverau | with some enhancements to the API if we want to add some s3api-isms | 21:31 |
| *** slaweq has quit IRC | 21:32 | |
| mattoliverau | The biggest thing I want to see is that any awesome new feature is accessible via the swift API not just s3api. I just want our swift api to always be a first class citizen in swift (obviously). even if we have to talk about a new seperate versioning API. But if you can make them work together.. I'm all for that. | 21:33 |
| timburke | so, if i had a container using x-history-location (since that was the best we had available) and it's accumulated some versions of objects... what are your expectations if/when you try to switch it to the new mode? | 21:33 |
| timburke | yes, definitely want this to be a swift api first, with s3api shimming into it. the smaller we can make that shim, the better | 21:34 |
| *** zaitcev has joined #openstack-meeting | 21:34 | |
| mattoliverau | I dunno, either there is a new API, so you have to keep the old versioned writes middleware if you still want to access them. And start using the new API for 2.0.. or ideally, any new versioning uses symlinks. but if you delete it'll reach back into the old naming and bring them back | 21:35 |
| *** rbudden has quit IRC | 21:35 | |
| *** rbudden has joined #openstack-meeting | 21:36 | |
| mattoliverau | though, I obviously haven't really thought it through too deeply | 21:36 |
| timburke | yeah, and that last part is where it gets messy fast :-( | 21:36 |
| *** rbudden has quit IRC | 21:36 | |
| *** rbudden has joined #openstack-meeting | 21:37 | |
| *** rbudden has quit IRC | 21:37 | |
| mattoliverau | I bet. Which is why I was thinking it might be out of scope.. but if we can.. sweet :) | 21:37 |
| *** rbudden has joined #openstack-meeting | 21:37 | |
| timburke | i'll make sure we get an etherpad up so we can continue to think & talk this through. maybe we could even find a time to get a video chat going ahead of shanghai ;-) | 21:38 |
| *** rbudden has quit IRC | 21:38 | |
| *** rbudden has joined #openstack-meeting | 21:38 | |
| mattoliverau | I'll try and look into the patches so I can better grok the probs :) | 21:38 |
| timburke | i'd appreciate it 👍 | 21:39 |
| *** rbudden has quit IRC | 21:39 | |
| *** rbudden has joined #openstack-meeting | 21:39 | |
| timburke | keeping moving... | 21:39 |
| timburke | #topic lots of small files | 21:39 |
| *** openstack changes topic to "lots of small files (Meeting topic: swift)" | 21:39 | |
| *** rbudden has quit IRC | 21:39 | |
| timburke | so we haven't had review bandwidth to spare for poor alecuyer :-( | 21:39 |
| *** rbudden has joined #openstack-meeting | 21:40 | |
| alecuyer | no worries I know everyone is busy :) | 21:40 |
| timburke | but meanwhile he's looking to push to prod -- i kinda feel like that's sufficiently good for merging to a feature branch ;-) | 21:40 |
| *** rbudden has quit IRC | 21:40 | |
| timburke | anyone have objections there? | 21:40 |
| *** e0ne_ has quit IRC | 21:41 | |
| timburke | it seems like this represents the current state-of-the-art, and i definitely don't want to slow down alecuyer on any of this, or otherwise make life more difficult | 21:41 |
| mattoliverau | sorry, I'm slow, you mean patches are sitting open and we should get them landed to the feature branch? | 21:42 |
| mattoliverau | quicker. | 21:42 |
| mattoliverau | if so, feature branches should be quick to merge. | 21:43 |
| timburke | https://review.opendev.org/#/c/679022/ is the patch on feature/losf to drop grpc for http | 21:43 |
| alecuyer | One thing I can say about it is that it only changes the way the index-server communicates with the python. But nothing on disk changes. So if changes are required it shouldn't be a problem (no backward compatibility issue) | 21:43 |
| mattoliverau | push a patch. leave it open for x time and land it even if people haven't reviewed it too hard.. the idea of a feature branch is to move fast.. leave it open long enough to give people a chance to know its there and see it. | 21:44 |
| mattoliverau | but don't feel bad about landing code. It will have to be reviewed again anyway. | 21:44 |
| mattoliverau | Well that's how Al and I worked on the sharding stuff. | 21:44 |
| timburke | mattoliverau, that's basically the conclusion i reached this morning when i saw kota_ apologizing for not reviewing it ;-) | 21:45 |
| timburke | merging. just wanted to confirm that we're on the same page about it | 21:45 |
| mattoliverau | if the patch breaks something we can fix it. or revert it, so no stress :) | 21:45 |
| mattoliverau | that's why feature branches are awesome. So if it's holding you up, merge it ;) | 21:46 |
| timburke | alecuyer, what are the next steps we need for losf? | 21:47 |
| alecuyer | first thing after that patch, I think, would be to rebase https://review.opendev.org/#/c/666378/ | 21:47 |
| alecuyer | (and adress your latest comments!) | 21:47 |
| alecuyer | then I need to push a few patches for issues we found (sorry I haven't pushed these earlier) | 21:48 |
| *** ykatabam is now known as yuko | 21:48 | |
| *** yuko is now known as ykatabam | 21:48 | |
| alecuyer | and one last thing to mention, wrt to the CPU usage (that I think you also noticed at swiftstack while testing), | 21:49 |
| timburke | sounds great! i'll try harder to make time to review them, and get them merged even if i can't spare time for a thorough review ;-) | 21:49 |
| mattoliverau | alecuyer: how dare you find issues and fix them.. and then want to share them.. shame on you :P | 21:49 |
| alecuyer | mattoliverau: yeah I know ;) still I should share them quicker :) | 21:50 |
| alecuyer | forgot half of my last sentence, sorry - CPU usage : we are considering using the hashes.pkl | 21:50 |
| alecuyer | Just discussing this, happy to discuss it here or later (i think we're short on time, leave time for other topics) | 21:51 |
| timburke | oh... does it skip that entirely at the moment, and recompute every time? interesting... | 21:51 |
| alecuyer | it does | 21:51 |
| timburke | i think we also tend to tune our replicators/reconstructors aggressively, which would compound the issue | 21:52 |
| timburke | er, maybe "to be aggressive" would be more clear | 21:53 |
| alecuyer | yes, so that was probably a bad call. the good news is is should be easy to reuse (just change the path so we don't have to create on dir per hashes.pkl file, prefix the filename with the partition, for example) | 21:53 |
| *** mriedem is now known as mriedem_afk | 21:53 | |
| alecuyer | (the bad call -> doing away the hashes.pkl I mean - not being aggressive while reconstrucing) | 21:53 |
| timburke | love it | 21:53 |
| timburke | thanks for keeping us updated | 21:53 |
| mattoliverau | +1 | 21:53 |
| timburke | #topic sharding | 21:53 |
| *** openstack changes topic to "sharding (Meeting topic: swift)" | 21:53 | |
| timburke | sorry mattoliverau -- still haven't gotten to reviewing :-( | 21:54 |
| mattoliverau | nps | 21:54 |
| mattoliverau | As I mentioned last week | 21:54 |
| mattoliverau | I've reworked the empty broker patch | 21:55 |
| timburke | also, we got a new bug! and mattoliverau already has the beginnings of a patch :-) | 21:55 |
| mattoliverau | yeah | 21:55 |
| mattoliverau | was about to mention that. I went and worked on a patch to clean up cleave contexts | 21:55 |
| mattoliverau | it's currently attached to the bug. But will add some tests and push it up as an actual patch | 21:56 |
| mattoliverau | I'll try and get that done in the next few days | 21:56 |
| timburke | https://bugs.launchpad.net/swift/+bug/1843313 | 21:56 |
| openstack | Launchpad bug 1843313 in OpenStack Object Storage (swift) "Sharding handoffs creates a *ton* of container-server headers" [Undecided,New] | 21:56 |
| mattoliverau | thanks timburke I was looking for that :) | 21:56 |
| mattoliverau | and thanks timburkefor the bug report with a good solution idea. Makes life easier. | 21:57 |
| timburke | thanks mattoliverau! | 21:57 |
| mattoliverau | that's all I've got | 21:58 |
| timburke | #topic open discussion | 21:58 |
| *** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:58 | |
| *** hemna has joined #openstack-meeting | 21:58 | |
| timburke | anything else to bring up real quick? | 21:58 |
| mattoliverau | I've been looking into the PDF train goal | 21:58 |
| timburke | oh, right! | 21:58 |
| timburke | thanks for that | 21:58 |
| mattoliverau | making progress, I've pulled Nick, a suse guy who did the designate PDF stuff | 21:59 |
| mattoliverau | to help point me in the right direction re latex and sphinx debugging | 21:59 |
| *** markvoelker has joined #openstack-meeting | 21:59 | |
| timburke | anything you need the rest of us to help with? proofreading, i suppose | 21:59 |
| mattoliverau | I think tables get messed up when we use ``tag`` s in the columns | 22:00 |
| mattoliverau | So I might need to remove them to get it to build properly | 22:00 |
| mattoliverau | or hard code table column lengths.. which I'd rather not do. | 22:00 |
| mattoliverau | anyway. I'll kjeep playing :) | 22:00 |
| timburke | ...probably fine to give them normal formatting. *shrug* | 22:00 |
| *** panda has quit IRC | 22:00 | |
| timburke | all right, time to wrap up | 22:01 |
| mattoliverau | yeah, especailly if it means they'll work and in a table I assume they'll still stand out. | 22:01 |
| mattoliverau | kk | 22:01 |
| timburke | thank you all for coming, and thank you for working on swift! | 22:01 |
| timburke | #endmeeting | 22:01 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 22:01 | |
| openstack | Meeting ended Wed Sep 11 22:01:30 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:01 |
| zaitcev | yay | 22:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-09-11-21.00.html | 22:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-09-11-21.00.txt | 22:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-09-11-21.00.log.html | 22:01 |
| timburke | lol sorry zaitcev | 22:01 |
| zaitcev | too slow | 22:01 |
| *** zaitcev has left #openstack-meeting | 22:02 | |
| *** panda has joined #openstack-meeting | 22:03 | |
| *** slaweq has joined #openstack-meeting | 22:11 | |
| *** whoami-rajat has quit IRC | 22:11 | |
| *** slaweq has quit IRC | 22:16 | |
| *** ykatabam has quit IRC | 22:19 | |
| *** ykatabam has joined #openstack-meeting | 22:28 | |
| *** raildo has quit IRC | 22:49 | |
| *** mtreinish has quit IRC | 22:54 | |
| *** mtreinish has joined #openstack-meeting | 22:55 | |
| *** macz has quit IRC | 23:01 | |
| *** hemna has quit IRC | 23:04 | |
| *** slaweq has joined #openstack-meeting | 23:10 | |
| *** slaweq has quit IRC | 23:15 | |
| *** igordc has quit IRC | 23:18 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:32 | |
| *** igordc has joined #openstack-meeting | 23:33 | |
| *** igordc has quit IRC | 23:40 | |
| *** igordc has joined #openstack-meeting | 23:42 | |
| *** hemna has joined #openstack-meeting | 23:42 | |
| *** jamesmcarthur has quit IRC | 23:46 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:46 | |
| *** mriedem_afk has quit IRC | 23:49 | |
| *** jamesmcarthur has quit IRC | 23:51 | |
| *** carloss has quit IRC | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!