*** GoceVida has joined #openstack-security | 00:06 | |
*** JAHoagie has quit IRC | 00:06 | |
*** markvoelker has joined #openstack-security | 00:11 | |
*** edmondsw has quit IRC | 01:04 | |
*** browne has quit IRC | 01:17 | |
*** sdake has quit IRC | 01:27 | |
*** sdake has joined #openstack-security | 01:29 | |
*** amitkqed has quit IRC | 01:43 | |
*** amitkqed has joined #openstack-security | 01:43 | |
*** vinaypotluri has quit IRC | 02:21 | |
openstackgerrit | He Qing proposed openstack/anchor: Allow a domain start with a number https://review.openstack.org/352672 | 02:25 |
---|---|---|
*** knangia has quit IRC | 02:50 | |
*** GoceVida has quit IRC | 03:06 | |
*** GoceVida has joined #openstack-security | 03:08 | |
*** dave-mccowan has quit IRC | 04:24 | |
*** GoceVida has quit IRC | 04:40 | |
*** GoceVida has joined #openstack-security | 04:42 | |
*** JAHoagie has joined #openstack-security | 04:59 | |
*** rcernin has joined #openstack-security | 05:21 | |
*** sdake has quit IRC | 05:26 | |
*** sdake has joined #openstack-security | 05:29 | |
*** dstufft has quit IRC | 05:41 | |
*** dstufft has joined #openstack-security | 05:41 | |
openstackgerrit | zhangyanxian proposed openstack/bandit: Fix some errors in utils.py & calls.py https://review.openstack.org/352712 | 05:46 |
openstackgerrit | zhangyanxian proposed openstack/bandit: Fix some errors in utils.py & calls.py https://review.openstack.org/352712 | 05:51 |
*** vinaypotluri has joined #openstack-security | 06:01 | |
*** xut_xut has joined #openstack-security | 06:13 | |
*** sweston has quit IRC | 06:26 | |
*** sweston has joined #openstack-security | 06:26 | |
*** sdake has quit IRC | 06:38 | |
*** pcaruana has joined #openstack-security | 06:39 | |
*** shohel has joined #openstack-security | 06:45 | |
*** tesseract- has joined #openstack-security | 06:45 | |
*** liverpooler has joined #openstack-security | 06:45 | |
*** JAHoagie has quit IRC | 07:01 | |
*** browne has joined #openstack-security | 07:15 | |
*** browne has quit IRC | 07:15 | |
*** elo has quit IRC | 07:31 | |
*** sdake has joined #openstack-security | 07:51 | |
*** xut_xut has left #openstack-security | 07:51 | |
*** markvoelker has quit IRC | 07:59 | |
*** sdake has quit IRC | 08:06 | |
*** markvoelker has joined #openstack-security | 09:00 | |
*** markvoelker has quit IRC | 09:05 | |
openstackgerrit | Merged openstack/bandit: Fix some errors in utils.py & calls.py https://review.openstack.org/352712 | 09:49 |
*** markvoelker has joined #openstack-security | 10:01 | |
*** markvoelker has quit IRC | 10:05 | |
*** sdake has joined #openstack-security | 10:53 | |
*** markvoelker has joined #openstack-security | 11:02 | |
*** shohel has quit IRC | 11:02 | |
*** markvoelker has quit IRC | 11:06 | |
openstackgerrit | Doug Chivers proposed openstack/security-doc: Added templates for security review notes and findings https://review.openstack.org/352102 | 11:07 |
*** sdake has quit IRC | 11:08 | |
*** vinaypotluri has quit IRC | 11:11 | |
*** markvoelker has joined #openstack-security | 12:02 | |
*** markvoelker has quit IRC | 12:07 | |
*** markvoelker has joined #openstack-security | 12:23 | |
*** dave-mccowan has joined #openstack-security | 12:39 | |
*** catintheroof has joined #openstack-security | 12:46 | |
*** jass93 has quit IRC | 12:48 | |
*** _elmiko is now known as elmiko | 12:57 | |
*** zul_ has quit IRC | 13:00 | |
*** zul_ has joined #openstack-security | 13:06 | |
*** sdake has joined #openstack-security | 13:09 | |
*** cleong has joined #openstack-security | 13:12 | |
*** sdake has quit IRC | 13:17 | |
*** sdake has joined #openstack-security | 13:19 | |
*** edmondsw has joined #openstack-security | 13:19 | |
*** sdake_ has joined #openstack-security | 13:23 | |
*** sdake has quit IRC | 13:24 | |
*** JAHoagie has joined #openstack-security | 13:46 | |
openstackgerrit | Doug Chivers proposed openstack/security-doc: Added templates for security review notes and findings https://review.openstack.org/352102 | 13:51 |
*** dikonoor has joined #openstack-security | 13:53 | |
*** edtubill has joined #openstack-security | 14:12 | |
*** liverpooler has quit IRC | 14:19 | |
*** JAHoagie has quit IRC | 14:20 | |
*** sdake_ is now known as sdake | 14:30 | |
*** edtubill has quit IRC | 14:34 | |
*** subscope has joined #openstack-security | 14:39 | |
*** knangia has joined #openstack-security | 14:40 | |
*** B_Smith has quit IRC | 14:43 | |
*** dikonoor has quit IRC | 14:45 | |
*** catintheroof has quit IRC | 14:47 | |
*** catintheroof has joined #openstack-security | 14:48 | |
*** catintheroof has quit IRC | 14:53 | |
*** diazjf has joined #openstack-security | 14:55 | |
*** B_Smith has joined #openstack-security | 14:57 | |
*** edtubill has joined #openstack-security | 14:59 | |
*** vinaypotluri has joined #openstack-security | 15:06 | |
*** mvaldes has joined #openstack-security | 15:20 | |
*** mdong has joined #openstack-security | 15:21 | |
*** catintheroof has joined #openstack-security | 15:25 | |
openstackgerrit | Aastha Dixit proposed openstack/syntribos: Implement config loading schema https://review.openstack.org/352497 | 15:37 |
*** mdong has quit IRC | 15:42 | |
*** pcaruana has quit IRC | 15:48 | |
*** rcernin has quit IRC | 15:50 | |
*** tesseract- has quit IRC | 15:50 | |
*** mdong has joined #openstack-security | 15:58 | |
*** dikonoor has joined #openstack-security | 16:07 | |
*** diazjf has quit IRC | 16:15 | |
*** ccneill has joined #openstack-security | 16:18 | |
*** austin987 has joined #openstack-security | 16:23 | |
*** dikonoor has quit IRC | 16:35 | |
*** JAHoagie has joined #openstack-security | 16:36 | |
*** jmckind has joined #openstack-security | 16:37 | |
openstackgerrit | Merged openstack/syntribos: Logger not registered bug fixed https://review.openstack.org/352162 | 16:45 |
*** subscope has quit IRC | 16:51 | |
*** mvaldes has quit IRC | 17:28 | |
*** zul_ has quit IRC | 17:30 | |
*** zul has joined #openstack-security | 17:34 | |
openstackgerrit | Vinay Potluri proposed openstack/syntribos: Overwriting config options from CLI https://review.openstack.org/353039 | 17:39 |
*** zul has quit IRC | 17:40 | |
*** diazjf has joined #openstack-security | 17:42 | |
*** pcaruana has joined #openstack-security | 17:44 | |
openstackgerrit | Vinay Potluri proposed openstack/syntribos: Overwriting config options from CLI https://review.openstack.org/353039 | 17:45 |
openstackgerrit | Rahul U Nair proposed openstack/syntribos: Adding sub commands to Syntribos https://review.openstack.org/350325 | 17:49 |
*** zul has joined #openstack-security | 17:52 | |
*** liverpooler has joined #openstack-security | 17:53 | |
*** nkinder has quit IRC | 17:53 | |
*** browne has joined #openstack-security | 17:53 | |
*** mvaldes has joined #openstack-security | 18:03 | |
*** nkinder has joined #openstack-security | 18:04 | |
*** liverpooler has quit IRC | 18:08 | |
*** rcernin has joined #openstack-security | 18:51 | |
*** diazjf has quit IRC | 19:00 | |
*** browne has quit IRC | 19:04 | |
*** catintheroof has quit IRC | 19:12 | |
*** kragniz has joined #openstack-security | 19:15 | |
*** diazjf has joined #openstack-security | 19:31 | |
*** MARIAVICTORIA-MM has joined #openstack-security | 19:37 | |
*** MARIAVICTORIA-MM has quit IRC | 19:44 | |
*** MARIAVICTORIA-MM has joined #openstack-security | 19:46 | |
MARIAVICTORIA-MM | hola | 19:49 |
*** austin987 has quit IRC | 19:52 | |
MARIAVICTORIA-MM | hola como estan | 19:52 |
MARIAVICTORIA-MM | holaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa | 19:55 |
*** diazjf has quit IRC | 19:56 | |
*** diazjf has joined #openstack-security | 19:58 | |
mdong | ccneill, unrahul: I was just looking through the changes that merged last week, and I just a minor question | 20:00 |
ccneill | yep | 20:00 |
mdong | so https://review.openstack.org/#/c/345286/20/syntribos/runner.py@179 | 20:01 |
mdong | line 179, in this CR, we’ve turned the generator into a list | 20:01 |
mdong | for the sake of counting them, it seems like | 20:01 |
MARIAVICTORIA-MM | hola diazjf | 20:02 |
MARIAVICTORIA-MM | hola | 20:02 |
MARIAVICTORIA-MM | que hacen | 20:02 |
ccneill | mdong: yep.. | 20:02 |
unrahul | Yup.. The progress bar | 20:02 |
mdong | the point of having get_test_cases yield a generator is so that we don’t actually have all the test cases in memory | 20:02 |
unrahul | Had an issue otherwise | 20:02 |
mdong | but now calling list() on it puts all the tests into memory, doesn | 20:02 |
mdong | doesn’t it? | 20:02 |
ccneill | I believe it would | 20:02 |
unrahul | But the list is not that big ryt.. | 20:02 |
unrahul | To have any sort of memory issues | 20:02 |
ccneill | we should see if we can profile the memory usage | 20:03 |
ccneill | I didn't have much luck using pycallgraph to do that | 20:03 |
mdong | right, in practice it’s not like I’m noticing any slowdowns or anything, but the original design intent was to avoid that specifically | 20:03 |
ccneill | but I don't think we should keep trying to solve for this supposed memory consumption problem when we don't know that it's actually a problem | 20:03 |
ccneill | so if it's a drastic difference we should figure out how to solve for it, but if it's negligible, I'm okay with letting the whole generator approach go | 20:04 |
unrahul | I ran it several times and the memory consumption /performance degradation was not showing up. M | 20:04 |
unrahul | And if we check the size of the list returned it shouldn't have much of an impact | 20:05 |
MARIAVICTORIA-MM | help | 20:05 |
MARIAVICTORIA-MM | :-X | 20:05 |
*** MARIAVICTORIA-MM has left #openstack-security | 20:05 | |
ccneill | at the same time, I'm not sure that we should just create this list on the fly for the sole purpose of checking its length.. if we're going to make a list of tests, we might as well do it purposefully | 20:06 |
ccneill | ¯\_(ツ)_/¯ | 20:06 |
ccneill | anyone have experience with any python memory profilers? | 20:07 |
mdong | unrahul: is that list used for anything except counting? | 20:07 |
mdong | I dont’ have any experience myself, unfortunately | 20:07 |
unrahul | Not just for length, we are using that list to iterate through the tests | 20:08 |
unrahul | So replacing the generator for the list | 20:08 |
ccneill | I have a feeling we're going to have to replace the generator approach if we ever want to do multithreading | 20:08 |
ccneill | so it's probably worthwhile for us to figure out what the respective memort footprints are anyway | 20:08 |
ccneill | memory* | 20:08 |
mdong | I was under the impression that generators can be shared across threads | 20:09 |
ccneill | I'm actually not sure on that one.. | 20:09 |
ccneill | but I bet Nathan would know :D | 20:09 |
mdong | regardless, yeah, finding out the memory footprint would be valuable | 20:09 |
mdong | lol yeah, though he’d have strong opinions about the generator for sure lol | 20:10 |
ccneill | yeah.. | 20:10 |
unrahul | Yeah.. +1 | 20:10 |
ccneill | I'll look into it | 20:10 |
openstackgerrit | Aastha Dixit proposed openstack/syntribos: Implement config loading schema https://review.openstack.org/352497 | 20:11 |
mdong | so the list is generated only once per test type right? so the maximum size the list can be is (number of payload strings) * (size of testcase class) | 20:12 |
ccneill | I *think* that's right | 20:13 |
mdong | the biggest file in our data folder is os-cmd-execution.txt at 1200 lines, which we don’t actually use for anything… | 20:14 |
ccneill | oh actually we have list_of_tests and test_cases | 20:14 |
ccneill | nvm | 20:15 |
ccneill | test_cases should be the list of all tests cases for one endpoint, and would (maybe) get garbage collected after each iteration of the loop | 20:15 |
ccneill | I'll see what I can come up with in terms of profiling the difference | 20:15 |
ccneill | brb | 20:15 |
*** singlethink has joined #openstack-security | 20:16 | |
mdong | yeah, rough mental math tells me that the list shouldn’t get too big to cause any problems, unless someone decides to pass in a gigantic data file, which isn’t necessarily out of the question | 20:17 |
unrahul | i liked the statement "os-cmd-execution.txt at 1200 lines, which we dont use" .. hehe.. | 20:24 |
mdong | lol yeah, we really dont use most of whats in our data folder | 20:25 |
unrahul | hehe..yeah.. i think we need to clean it up.. | 20:25 |
unrahul | i think ccneill had a card up on trello for cleaning up the data folder.. | 20:31 |
ccneill | unrahul: actually I don't know if we have a trello card for it yet | 20:42 |
ccneill | but we probably should | 20:42 |
unrahul | oh... i remember.. somewhere seeing something like that.. with cleaning up data folder.. may be u had mentioned it in our meetings ... hmmm.. | 20:43 |
unrahul | can't remember. | 20:43 |
*** diazjf1 has joined #openstack-security | 20:43 | |
*** diazjf has quit IRC | 20:45 | |
ccneill | https://trello.com/c/HOGEpKYW/117-sectest-syn-clean-up-revise-files-outside-codebase-docs-etc | 20:48 |
ccneill | just added a few things there | 20:48 |
ccneill | might rename this card "preparation for 0.5" or something since it encompasses most of what we were talking about earlier for the 0.5 release (accurate docs, no extra cruft, etc.) | 20:50 |
*** edtubill has quit IRC | 20:51 | |
*** MARIAVICTORIA-MM has joined #openstack-security | 20:52 | |
MARIAVICTORIA-MM | hola | 20:55 |
*** MARIAVICTORIA-MM has left #openstack-security | 20:55 | |
ccneill | boom! just closed out our "Remove OpenCAFE" card :D | 20:56 |
ccneill | https://trello.com/c/jH4gDppe/27-sectest-syn-remove-opencafe-from-syntribos | 20:56 |
*** diazjf1 has quit IRC | 21:00 | |
unrahul | :D .. good bye old friend, aka OpenCAFE | 21:00 |
openstackgerrit | Rahul U Nair proposed openstack/syntribos: Standardizing the way we diff signals https://review.openstack.org/349403 | 21:11 |
vinaypotluri | ccneill: mdong | 21:15 |
mdong | whats up? | 21:15 |
ccneill | sup | 21:15 |
vinaypotluri | ccneill: mdong i'm trying to overwrite the existing config values from cmd line but it reads the config values from the file and then the values of the variables change | 21:16 |
vinaypotluri | https://review.openstack.org/#/c/353039/ | 21:16 |
vinaypotluri | i used CONF.set_override method to override the values but not sure how to go ahead with it | 21:17 |
ccneill | vinaypotluri: so first, I don't think we want to create a method for EVERY override | 21:17 |
ccneill | it should be more generalized | 21:17 |
vinaypotluri | ok | 21:18 |
ccneill | I think to start with | 21:18 |
ccneill | we should support overriding each of the "syntribos" options (those in list_syntribos_opts) | 21:18 |
ccneill | instead of return [all the cli opts], you can make it a list of options | 21:19 |
ccneill | then merge it with the list from list_syntribos_opts | 21:19 |
ccneill | since they're in different namespaces they shouldn't clash | 21:19 |
vinaypotluri | ok | 21:20 |
ccneill | then you can have a method that goes through each opt in list_syntribos_opts, sees if it's defined in the DEFAULT namespace, and override if so | 21:20 |
ccneill | (same name, but looking at CONF.___ vs. CONF.syntribos.___) | 21:21 |
ccneill | make sense? | 21:21 |
vinaypotluri | cool | 21:21 |
vinaypotluri | got it | 21:21 |
ccneill | cool, let me know if you have any other questions or if you need a code review | 21:22 |
vinaypotluri | also when i try to overwrite the values it first takes the values from the config file and then overwrites | 21:23 |
vinaypotluri | is there anything i can do to force to it read the overwritten values | 21:24 |
*** diazjf has joined #openstack-security | 21:26 | |
*** diazjf has quit IRC | 21:28 | |
*** zigo has quit IRC | 21:32 | |
*** zigo has joined #openstack-security | 21:35 | |
*** cleong has quit IRC | 21:36 | |
ccneill | hmmm | 21:37 |
ccneill | so you mean like make it skip the part where it reads the values from the config file? | 21:38 |
ccneill | I don't think that's necessary | 21:38 |
ccneill | hmm.. I guess it might be a problem if you don't want to specify it in the config file, but only want to define it on the command line | 21:39 |
ccneill | you might be able to handle that in syntribos.config.handle_config_exception | 21:39 |
ccneill | so if it complains that it didn't find a value in the config file, you can check and see if it's specified in the command line opts | 21:41 |
ccneill | hopefully that doesn't require parsing sys.argv[1:]... | 21:41 |
*** jmckind has quit IRC | 21:41 | |
vinaypotluri | ok | 21:42 |
vinaypotluri | will do that | 21:43 |
*** mvaldes has quit IRC | 21:45 | |
*** sdake has quit IRC | 21:57 | |
*** rcernin has quit IRC | 22:02 | |
*** jass93 has joined #openstack-security | 22:03 | |
*** dave-mccowan has quit IRC | 22:08 | |
*** sdake has joined #openstack-security | 22:30 | |
*** sdake has quit IRC | 22:30 | |
*** sdake has joined #openstack-security | 22:30 | |
*** sdake_ has joined #openstack-security | 22:33 | |
*** sdake has quit IRC | 22:34 | |
*** edmondsw has quit IRC | 22:36 | |
*** sdake_ is now known as sdake | 22:38 | |
*** singlethink has quit IRC | 22:40 | |
*** browne has joined #openstack-security | 22:43 | |
*** mdong has quit IRC | 22:53 | |
*** mdong has joined #openstack-security | 23:07 | |
unrahul | Hey ccneill mdong any interesting presentations from #DEFCON ? | 23:23 |
unrahul | that we should check out.? | 23:23 |
mdong | oh man, there’s lots, though the craziest one I saw was “How to overthrow a government" | 23:23 |
mdong | I don’t know if it’s up anywhere | 23:23 |
ccneill | they haven't put them on youtube yet | 23:24 |
ccneill | https://www.youtube.com/user/DEFCONConference/videos | 23:24 |
ccneill | but that's where they'll be when they are posted | 23:24 |
unrahul | how to overthrow a govt.. that seems interesting ..hmm.. | 23:25 |
unrahul | yeah.. waiting for them to upload.. i guess by the week end.. | 23:25 |
mdong | took em a few months to upload them last time, I think | 23:25 |
ccneill | https://www.defcon.org/html/defcon-24/dc-24-news.html#dc24cdtorrents | 23:26 |
unrahul | whoa! | 23:26 |
unrahul | that long. | 23:26 |
ccneill | well, they sell them to companies first lol | 23:27 |
unrahul | hehe | 23:27 |
mdong | speaking of, did we buy the usb drive? | 23:27 |
unrahul | that makes sense.. | 23:27 |
ccneill | :X I hope so | 23:27 |
ccneill | we have the last 2 years | 23:27 |
unrahul | In the CTF there was that AI from CMU competing ryt, u guys know how the team did? | 23:28 |
unrahul | usb drive..? of the slides and stuff.? | 23:28 |
mdong | of the videos, the slides are already up somewhere | 23:28 |
mdong | at one point the AI team was leading, but I think they ended up near the bottom | 23:28 |
ccneill | https://techcrunch.com/2016/08/05/carnegie-mellons-mayhem-ai-takes-home-2-million-from-darpas-cyber-grand-challenge/ | 23:29 |
mdong | ah, then the other AI was leading for a bit before finishing near last, idk how CMU’s did | 23:29 |
ccneill | they're probably not TOO sad at the CTF loss lol | 23:29 |
mdong | but the other AI had humans working too , they just let CMU’s run on its own | 23:30 |
unrahul | rofl | 23:30 |
unrahul | yeah , that they got the 2 mil prize.. | 23:30 |
unrahul | whoa!>. | 23:30 |
unrahul | it would be really cool how they even do that ryt.. | 23:30 |
unrahul | just saw this paper https://users.ece.cmu.edu/~arebert/papers/mayhem-oakland-12.pdf | 23:34 |
unrahul | some light reading for the evening. | 23:34 |
ccneill | haha yeah | 23:35 |
ccneill | pretty crazy stuff | 23:35 |
openstackgerrit | Rahul U Nair proposed openstack/syntribos: Standardizing the way we diff signals https://review.openstack.org/349403 | 23:38 |
*** sdake has quit IRC | 23:45 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!