Thursday, 2020-07-09

*** Dmitrii-Sh has quit IRC00:02
*** Dmitrii-Sh has joined #openstack-oslo00:07
*** hamalq has quit IRC00:09
*** gouthamr_ has quit IRC00:59
*** gouthamr_ has joined #openstack-oslo01:05
*** gouthamr_ has quit IRC01:25
*** gouthamr_ has joined #openstack-oslo01:37
*** gouthamr_ has quit IRC02:52
*** gouthamr_ has joined #openstack-oslo02:56
*** rcernin has quit IRC03:00
*** rcernin has joined #openstack-oslo03:03
*** HenryG has quit IRC03:06
*** HenryG has joined #openstack-oslo03:07
*** gouthamr_ has quit IRC03:26
*** gouthamr_ has joined #openstack-oslo03:32
*** gouthamr_ has quit IRC04:00
*** gouthamr_ has joined #openstack-oslo04:11
*** gouthamr_ has quit IRC04:29
*** gouthamr_ has joined #openstack-oslo04:30
*** gouthamr_ has quit IRC04:35
*** gouthamr_ has joined #openstack-oslo04:40
*** Luzi has joined #openstack-oslo05:12
*** Luzi has quit IRC05:19
*** zzzeek has quit IRC05:19
*** Luzi has joined #openstack-oslo05:19
*** zzzeek has joined #openstack-oslo05:23
*** moguimar has joined #openstack-oslo06:05
moguimarhberaud, around?06:07
*** ralonsoh has joined #openstack-oslo06:10
*** moguimar has quit IRC06:38
*** moguimar has joined #openstack-oslo06:39
*** gouthamr_ has quit IRC06:50
*** gouthamr_ has joined #openstack-oslo06:52
*** knikolla has quit IRC06:54
*** knikolla has joined #openstack-oslo06:56
*** csatari has quit IRC06:58
*** csatari has joined #openstack-oslo07:01
*** gouthamr_ has quit IRC07:04
*** gouthamr_ has joined #openstack-oslo07:05
*** gouthamr_ has quit IRC07:15
*** gouthamr_ has joined #openstack-oslo07:22
*** geguileo has joined #openstack-oslo07:32
*** geguileo is now known as Guest7526507:42
*** gouthamr_ has quit IRC07:46
*** gouthamr_ has joined #openstack-oslo07:52
*** gouthamr_ has quit IRC07:57
hberaudmoguimar: yep08:02
*** gmann has quit IRC08:03
*** andrewbogott has quit IRC08:03
*** andrewbogott has joined #openstack-oslo08:04
*** gmann has joined #openstack-oslo08:06
*** gouthamr_ has joined #openstack-oslo08:09
*** iurygregory has quit IRC08:10
moguimarhberaud, I'm looking at the pre-commit patch08:13
moguimarhow do you plan to integrate it?08:13
hberaudmoguimar: you speak about this patch https://review.opendev.org/#/c/720771/ ?08:14
*** moguimar has quit IRC08:15
*** moguimar has joined #openstack-oslo08:16
hberaudmoguimar: I seen you was disconnected so I'm not sure you seen my previous message: "you speak about this patch https://review.opendev.org/#/c/720771/ ?"08:17
moguimaryep08:17
moguimarcause I downloaded it for review08:18
moguimarand pre-commit doesn't work out of the box08:18
moguimaryou need to manually put the hook in place08:18
moguimarbut I've seen people also putting pre-commit in tox08:19
hberaudmoguimar: so my plan is to copy this patch (submit a similar) on all the oslo's repo if everyone is ok with this original patch08:19
hberaudmoguimar: for now I just plan to use pre-commit with 'pre-commit install'08:20
moguimarso lets review one thing08:20
hberaudbut I agree in few months it could be interesting to try to call pre-commit from tox to centralize things08:21
moguimarwhat is the purpose (benefit) you want to achieve?08:21
hberaudpersonnaly I often forget to check pep before submit my patches08:22
moguimarhttps://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/tox.ini#L36-L4408:22
hberaudand I think I'm not the only one08:22
hberaudso the benefits here is to avoid to run the CI against patches who have pep8 errors08:23
hberaudand also save time08:23
hberaudbut this patch is a starting point08:24
hberaudthanks for the links08:24
*** iurygregory has joined #openstack-oslo08:24
moguimarthere is also another comment in the mailing list I'm trying to fetch08:28
moguimarthis one from dtantsur|afk08:29
moguimar"That's what pep8 jobs are for. They cannot be replaced with a pre-commit hooks, because people who are mostly likely to screw up formatting are also most likely to not have it installed."08:29
moguimarin the python black discussion08:30
moguimarwhile pre-commit as a hook tests only what is staged or modified we would like to maybe test the last commit only08:32
moguimarin the tox08:33
hberaudso what's about a tox run on uncommited changes?08:33
hberaudthey will be ignored?08:34
hberaud(if only committed changes are under consideration)08:35
hberaudon a git hook point of view I don't think this is an issue08:36
hberaudbut on a tox call which will call pre-commit under the hood I'm not sure this will detect issues, isn't?08:37
hberaudI mean when I run tox I expect to analyze everything committed or not, unstagged changes, etc....08:38
moguimaryep, I see08:38
moguimarmaybe we can compound last commit and changes?08:38
moguimarI'm checking pre-commit run args08:39
moguimar--hook-stage {commit,merge-commit,prepare-commit-msg,commit-msg,post-commit,manual,post-checkout,push}08:39
moguimarI'm not sure if it will accept this option multiple times08:39
moguimarcause we wanna catch changes locally or last commit on CI08:40
hberaud"maybe we can compound last commit and changes?" I know we can call pre-commit run --all-files (https://pre-commit.com/#4-optional-run-against-all-the-files)08:40
hberaudmaybe this one is the one we need in tox08:40
moguimarhberaud, sounds good08:41
moguimarwill -a also catch changes?08:41
moguimarlet me test it08:41
hberaudack08:41
*** benj_ has quit IRC08:41
moguimarit catches staged stuff as well08:43
moguimarso `pre-commit run -a` seems fine usage in tox08:43
hberaudmoguimar: anyway I personnaly think we need to create a binding between pre-commit and tox to centralize things, by example find a way to call tox's jobs from pre-commit to ensure to use centralized test-requirements and the venv given by tox08:44
hberaudnice!08:44
moguimarfrom pre-commit you mean the hook or the tool?08:44
hberaudI mean it could worth to call tox jobs from pre-commit when the git hook is triggered08:45
hberaudinstead of redeclare testing requirements in pre-commit config08:46
moguimarfrom past experiences in other projects, that takes a long time for a commit08:46
hberaudI agree08:46
moguimarand sometimes you just want to "commit --amend --no-edit"08:47
moguimarto fix a typo or some minor changes08:47
hberaudyep08:47
moguimarthe hook is nice, but we don't have a way to enforce it08:47
moguimarbut as a tox job, we can gate that08:47
hberaudright08:47
moguimarand have some impact on reviews reducing the concern about code formating and such08:48
hberaudthat's it, this is the goal :)08:48
moguimarso let's add the tox part on that patch and bring it up for discussion next moday?08:49
hberaudyes good idea08:49
hberauddo you want to submit the tox part and co-author this patch?08:50
moguimarok08:50
moguimarcan do08:50
hberaudnice08:50
hberaudmoguimar: thanks for these words08:52
moguimarhberaud, I'm just trying to learn more as well =D08:52
hberaudgood approach :)08:53
hberaudmoguimar: else, here is another topic that I want to discuss a bit with you => SSL + eventlet08:53
moguimardo you have a patch?08:53
hberaudI know you're the security guy and SSL is your topic :)08:54
hberaudyep08:54
hberaudsec08:54
hberaudmoguimar: take a look to these changes (and to the 4 others related patches) => https://review.opendev.org/#/c/735900/ , by discussing with you now I just want to highlight this problem08:56
moguimarok08:57
hberaudmoguimar: here is another example of possible impacts => https://github.com/celery/py-amqp/pull/32708:57
hberaudI opened this previous patch mostly to highlight the situation08:57
*** benj_ has joined #openstack-oslo08:58
hberaudmoguimar: moving away from eventlet is unlikely to happen because it's everywhere and we use it to green our world (stdlib and third parties modules) and we can't find a plug&play similar solution so we are stuck with eventlet for a long time09:00
moguimarwhat do you mean with "to green our world"?09:02
hberaudbut in other hand our python supported runtimes continue increase... and so one day deprecated stuff in the stdlib will be removed09:02
hberaudgreen the world = async09:02
hberaudgreen thread = async thread09:02
moguimarso basically we use eventlet for non-blocking sockets, right?09:03
hberaudamong others09:03
moguimarI see09:04
hberaudso the shortest path to fix the SSL issue is to fix eventlet ssl side09:04
* moguimar remembers when we used to work with credit card machines with 200mhz processors and 2mb disk09:04
hberaudlol09:05
moguimaryou can't have thread issues if you can't have threads at all09:05
hberaudhahahaha09:05
moguimarok, I'll take a look at the patches and the PR on github09:06
hberaudack thanks, here a mostly want to make you aware about this possible issue with SSL in monkey patched env with eventlet.09:07
hberauds/here a/here I/09:07
hberaudthat's all for me09:08
moguimarok09:09
moguimarthanks herve09:09
hberaudthanks :)09:10
*** tosky has joined #openstack-oslo09:10
openstackgerritElod Illes proposed openstack/oslo.messaging stable/queens: Simplify tools/test-setup.sh  https://review.opendev.org/73992209:22
*** rcernin has quit IRC09:23
*** dtantsur|afk is now known as dtantsur09:29
openstackgerritStephen Finucane proposed openstack/oslo.db master: requirements: Drop os-testr  https://review.opendev.org/74023610:38
*** tkajinam has quit IRC11:02
*** dave-mccowan has joined #openstack-oslo11:18
openstackgerritJohannes Kulik proposed openstack/oslo.vmware master: Add moref helper functions  https://review.opendev.org/73944711:23
*** jungleboyj_ is now known as jungleboyj11:46
*** raildo has joined #openstack-oslo12:23
*** raildo has quit IRC12:47
*** raildo has joined #openstack-oslo12:50
*** kgiusti has joined #openstack-oslo13:37
moguimarhberaud, any special reason to create a local repo for flake8 in the pre-commit config?14:29
*** lbragstad_ has joined #openstack-oslo14:29
*** lbragstad has quit IRC14:29
moguimarother than using the one provided by flake814:29
hberaudIIRC it was related to nova's repo where I took the example => https://github.com/openstack/nova/blob/master/.pre-commit-config.yaml#L2614:34
hberaudmoguimar: ^^^^14:34
moguimarah I see14:35
moguimarthey have their own now, it was a hook in https://github.com/pre-commit/pre-commit-hooks but now they recomend https://gitlab.com/pycqa/flake814:35
moguimarand we can still set additional_dependencies: [hacking>=3.0.1,<3.1.0]14:36
moguimarand ignore the rest of the config, as flake8 will still fetch config from tox.ini14:36
hberaudah nice14:37
*** Luzi has quit IRC14:56
moguimarhberaud, I think I've found something interesting for the tox job14:57
moguimarpre-commit run --from-ref HEAD~ --to-ref HEAD14:57
moguimarI'm just not sure yet wether to use HEAD~ or HEAD^14:57
hberaudthey are not similar as with git?14:58
moguimarthis way the tox job will blame only files in the change14:58
moguimarthey are14:58
moguimarI have a call now14:58
hberaudack14:58
moguimarwill continue on this tomorrow14:58
moguimaro/14:58
hberaudthanks14:58
hberaudgood job14:58
*** hamalq has joined #openstack-oslo16:18
*** hamalq_ has joined #openstack-oslo16:19
*** hamalq has quit IRC16:22
*** andreaf has quit IRC16:48
*** dasp_ has joined #openstack-oslo16:49
openstackgerritStephen Finucane proposed openstack/pbr master: trivial: Improve logging of run commands  https://review.opendev.org/74033716:54
*** coreycb has quit IRC16:55
*** rm_work has quit IRC16:55
*** dasp has quit IRC16:55
*** hberaud has quit IRC16:55
*** coreycb has joined #openstack-oslo16:58
*** rm_work has joined #openstack-oslo16:58
*** hberaud has joined #openstack-oslo16:58
openstackgerritBen Nemec proposed openstack/oslo.policy master: Don't deepcopy objects before mask_dict_password  https://review.opendev.org/74006817:03
*** lbragstad_ is now known as lbragstad17:21
*** dtantsur is now known as dtantsur|afk17:45
*** ralonsoh has quit IRC17:57
*** tosky has quit IRC19:26
*** moguimar has quit IRC19:50
*** kgiusti has left #openstack-oslo20:25
*** raildo has quit IRC21:22
*** tkajinam has joined #openstack-oslo23:00
*** dmellado has quit IRC23:39

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!