Friday, 2019-08-02

*** rcernin has quit IRC06:58
*** tesseract has joined #openstack-sahara07:17
*** tosky has joined #openstack-sahara07:48
openstackgerritOpenStack Proposal Bot proposed openstack/sahara-plugin-spark master: Imported Translations from Zanata  https://review.opendev.org/67423208:55
openstackgerritOpenStack Proposal Bot proposed openstack/sahara-plugin-storm master: Imported Translations from Zanata  https://review.opendev.org/67425210:04
openstackgerritMerged openstack/sahara-plugin-spark master: Imported Translations from Zanata  https://review.opendev.org/67423210:20
openstackgerritMerged openstack/sahara-plugin-storm master: Imported Translations from Zanata  https://review.opendev.org/67425210:33
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Python 3 fixes  https://review.opendev.org/67281812:40
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara-plugin-cdh master: Fixes on CDH for python 3 compatibility  https://review.opendev.org/67389212:48
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara-plugin-mapr master: Python 3 compatibility fixes  https://review.opendev.org/67281112:51
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara-plugin-mapr master: Python 3 compatibility fixes  https://review.opendev.org/67281112:56
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Python 3 fixes  https://review.opendev.org/67281812:57
tellesnobregatosky, as you probably saw already I have sent some patches for review12:57
tellesnobregaturns out I could read all as bytes12:57
toskyoh12:58
tellesnobregaand for python2 I decoded12:58
tellesnobregaand this allows me to write all as bytes as well12:58
tellesnobregatake a look and let me know what you think12:58
toskytellesnobrega: is that .encode('utf-8') going to work with files read using 'rb' on python2? I think it may not work when the files have at least one non-ascii character13:15
tosky(that's the CDH patch)13:18
tellesnobregatosky, encode or decode?13:23
tellesnobregaoh13:24
tellesnobregafound it13:24
tellesnobregait works because we don't send non-ascii characters there, at least non showed up on tests13:25
tellesnobregait was mostly dicts on configuration13:26
tellesnobregaand so on13:26
toskybut configuration files may contain non-ascii characters13:26
toskyor better, encode is called on the db_password13:27
tellesnobregaI don't think we send the config files here, just what we need to execute, the config files are written on the instances using the ssh_remote.py13:27
toskyfine, ok; .encode is called on db_password13:28
toskywhich is extracted using get_hive_db_password nad get_sentry_db_password13:28
tellesnobregatosky, the db_password one is because we are getting the script as bytes and db_password is str so we need to make them match13:28
toskyok; so is db_password always of the right type to make encode work?13:30
toskywhat about a unit test? :)13:30
tellesnobregatosky, I will double check the db_password part13:34
tellesnobregaand will look for places to add tests13:34
tellesnobregabut I just hit an issue when running on python313:34
toskyis the getmaintype/get_content_maintype also a change related to... uhm... urllib?13:37
tellesnobregayes13:37
tellesnobregahttpmessage use to have getmaintype now it has get_content_maintype13:37
tellesnobregalooked for some documentation on a way to get the info without the try but looks the other option would be a lot uglier13:38
tellesnobregaget the property, split by '/' get the last part13:38
tellesnobregait would work, but I thought the way I did looked bette13:38
tellesnobregabetter13:38
tellesnobregado you have a better idea for that?13:39
tellesnobregaalso, do you have specific places where you would like to see unit tests?13:45
toskyI don't have better ideas about that; if the method changed, well, it changed; it was more a question on whether the new method works on python 2.713:45
tellesnobregaI see13:46
tellesnobregabut it fails :(13:46
tellesnobregatried it13:46
toskyregarding the specific place, theoretically speaking, every time a string which may potentially have a strange encoding or unsure whether byte or string is touched13:46
tellesnobregasure13:47
tellesnobregaI will probably work on tests next week13:48
tellesnobregaI will try to have the patches working today13:49
tellesnobregaand work on tests next week13:49
toskyok, thanks13:53
toskyI would argue that in order to have the patches working, you need the tests, but that's my inner QE :)13:53
tellesnobregaI fully understand you13:55
tellesnobregaand also I agree with you13:55
tellesnobregaI will try my best13:55
tellesnobreganow I'm hitting different issues on python3 that I wasn't seeing13:56
openstackgerritJeremy Freudberg proposed openstack/sahara master: DNM build spark image on ubuntu  https://review.opendev.org/67403213:57
*** pcaruana has quit IRC16:14
*** altlogbot_0 has quit IRC16:29
*** irclogbot_0 has quit IRC16:33
*** altlogbot_0 has joined #openstack-sahara16:37
*** irclogbot_0 has joined #openstack-sahara16:42
*** rickflare has joined #openstack-sahara16:51
*** tesseract has quit IRC16:58
*** openstackgerrit has quit IRC17:22
*** guimaluf has joined #openstack-sahara18:41
*** tosky has quit IRC19:32
*** irclogbot_0 has quit IRC19:39
*** irclogbot_3 has joined #openstack-sahara19:43

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!