Monday, 2020-08-31

*** frenzyfriday has quit IRC00:01
ianwhrm, yeah i agree the console page isn't working great00:20
ianwi get scrollbars down to nothing00:20
ianwand it starts out too wide00:20
ianwbut the tabbed overview pages i really like00:22
ianwfirst things first the functional nodepool jobs broken with "/usr/local/bin/keystone-manage --config-file /etc/keystone/keystone.conf db_sync"00:29
ianwsetuptools 50.0.0 ... what's the bet that it's somehow changed the install location ...00:35
fungihttps://github.com/pypa/setuptools/issues/235000:39
fungilook like our old friend distutils overwrite on ubuntu once again?00:40
fungiinstalling to /usr/lib instead of /usr/local/lib00:40
fungii'm increasingly sure `sudo pip install` just can't be a thing for much longer. there seems to be pretty much nobody upstream in pypa interested in keeping that working reliably00:42
ianwyeah, i forget what happened last time.  wasn't there workarounds put in?  looking ...00:43
*** frenzyfriday has joined #zuul00:44
ianwhttp://lists.openstack.org/pipermail/openstack-discuss/2020-July/015779.html was what i was thinking00:46
ianwof00:46
fungihttps://github.com/pypa/setuptools/issues/2232 was the earlier issue00:48
ianwyep, i'm just trying to figure out if they deliberately reverted that00:49
ianwhttps://github.com/pypa/setuptools/commit/04e3df22df840c6bb244e9b27bc56750c44b7c8500:50
ianwit looks like it :/00:50
fungiso we need to export SETUPTOOLS_USE_DISTUTILS=stdlib pretty much everywhere we install things as root on debian/ubuntu, i guess00:53
*** frenzyfriday has quit IRC00:54
ianwyeah, i can add this to stack.sh.  but you know, everything else ...00:54
fungii had some brief hope that i would spend some of this week catching up on my todo backlog00:55
fungibut nope, setuptools instead00:55
ianwseems likely00:56
ianwprobably more an #opendev topic at this point00:59
fungimaybe. i mean i don't know what we're likely to do opendev-wide to address it. implementation is going to be in the various projects where jobs are defined00:59
fungior which have scripts running pip install as root01:00
*** saneax has joined #zuul01:17
ianwyeah, "luckily" for zuul/nodepool's interest in this it's under the umbrella of getting a test stack up with devstack01:20
*** saneax has quit IRC01:29
*** frenzyfriday has joined #zuul01:38
ianw2020-08-31 01:37:17.495094 | controller | + lib/keystone:init_keystone:448           :   /usr/bin/keystone-manage --config-file /etc/keystone/keystone.conf db_sync01:42
ianw2020-08-31 01:37:17.538762 | controller | Traceback (most recent call last):01:42
ianw2020-08-31 01:37:17.538847 | controller |   File "/usr/bin/keystone-manage", line 6, in <module>01:42
ianw2020-08-31 01:37:17.538886 | controller |     from keystone.cmd.manage import main01:42
ianw2020-08-31 01:37:17.538920 | controller | ModuleNotFoundError: No module named 'keystone'01:42
*** frenzyfriday has quit IRC01:42
ianwright, /usr/lib/python3.6/site-packages/ isn't in the path for the interpreter01:44
*** frenzyfriday has joined #zuul02:33
*** frenzyfriday has quit IRC02:37
*** frenzyfriday has joined #zuul03:27
*** rfolco has joined #zuul03:31
*** bhavikdbavishi has joined #zuul03:55
*** evrardjp has quit IRC04:33
*** evrardjp has joined #zuul04:33
*** saneax has joined #zuul04:34
*** vishalmanchanda has joined #zuul04:35
openstackgerritJan Kubovy proposed zuul/zuul master: Separate connection registries in tests  https://review.opendev.org/71295805:44
openstackgerritJan Kubovy proposed zuul/zuul master: Prepare Zookeeper for scale-out scheduler  https://review.opendev.org/71726905:44
openstackgerritJan Kubovy proposed zuul/zuul master: Mandatory Zookeeper connection for ZuulWeb in tests  https://review.opendev.org/72125405:44
openstackgerritJan Kubovy proposed zuul/zuul master: Driver event ingestion  https://review.opendev.org/71729905:45
openstackgerritJan Kubovy proposed zuul/zuul master: Connect merger to Zookeeper  https://review.opendev.org/71622105:45
openstackgerritJan Kubovy proposed zuul/zuul master: Connect fingergw to Zookeeper  https://review.opendev.org/71687505:45
openstackgerritJan Kubovy proposed zuul/zuul master: Connect executor to Zookeeper  https://review.opendev.org/71626205:45
openstackgerritJan Kubovy proposed zuul/zuul master: WIP: Switch to using zookeeper instead of gearman for jobs (keep gearman for mergers)  https://review.opendev.org/74441605:45
*** bhavikdbavishi has quit IRC06:03
*** bhavikdbavishi has joined #zuul06:11
*** sshnaidm|afk is now known as sshnaidm06:17
*** bhavikdbavishi1 has joined #zuul06:17
*** bhavikdbavishi has quit IRC06:19
*** bhavikdbavishi1 is now known as bhavikdbavishi06:19
*** bhavikdbavishi has quit IRC06:34
*** PrinzElvis has quit IRC06:46
*** PrinzElvis has joined #zuul06:46
*** jfoufas116 has joined #zuul06:54
*** frenzyfriday has quit IRC06:57
*** PrinzElvis has quit IRC07:03
*** PrinzElvis has joined #zuul07:04
*** PrinzElvis has quit IRC07:07
*** PrinzElvis has joined #zuul07:08
*** hashar has joined #zuul07:08
*** PrinzElvis has quit IRC07:10
*** bhavikdbavishi has joined #zuul07:11
*** PrinzElvis has joined #zuul07:11
*** nils has joined #zuul07:19
*** PrinzElvis has quit IRC07:30
*** PrinzElvis has joined #zuul07:31
*** tosky has joined #zuul07:39
*** PrinzElvis is now known as Prinz-Elvis07:58
*** tosky has quit IRC08:00
*** sgw has quit IRC08:00
*** decimuscorvinus has quit IRC08:00
*** aluria has quit IRC08:00
*** irclogbot_0 has quit IRC08:02
*** Prinz-Elvis is now known as PrinzElvis08:04
*** tosky has joined #zuul08:05
*** sgw has joined #zuul08:05
*** decimuscorvinus has joined #zuul08:05
*** aluria has joined #zuul08:05
*** PrinzElvis is now known as Prinz_Elvis08:05
*** fbo has joined #zuul08:08
*** irclogbot_1 has joined #zuul08:08
*** Prinz_Elvis is now known as PrinzElvis08:12
*** holser has joined #zuul08:32
*** jfoufas116 has quit IRC08:51
*** jfoufas1 has joined #zuul09:00
-openstackstatus- NOTICE: due to a new release of setuptools (50.0.0), a lot of jobs are currently broken, please do not recheck blindly. see http://lists.openstack.org/pipermail/openstack-discuss/2020-August/016905.html09:18
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: improve tenant scoping of autohold, authorizations  https://review.opendev.org/72811809:45
openstackgerritMatthieu Huin proposed zuul/zuul master: [WIP] web UI: add Autoholds Requests page  https://review.opendev.org/72930709:49
openstackgerritTobias Henkel proposed zuul/zuul master: Support emitting warnings via zuul_return  https://review.opendev.org/65152609:54
openstackgerritTobias Henkel proposed zuul/zuul master: Report executor stats per zone  https://review.opendev.org/74044810:02
*** hashar has quit IRC10:02
*** jfoufas1 has quit IRC10:07
openstackgerritTobias Henkel proposed zuul/zuul master: Annotate getBranch with event id  https://review.opendev.org/74714210:07
*** tosky has quit IRC10:13
*** tosky has joined #zuul10:13
openstackgerritTobias Henkel proposed zuul/zuul master: Move reports from FakeGithubConnection to github data  https://review.opendev.org/74510710:14
openstackgerritTobias Henkel proposed zuul/zuul master: Remove unneeded api requests when commenting in github  https://review.opendev.org/74419410:14
openstackgerritTobias Henkel proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check  https://review.opendev.org/64455710:14
*** wuchunyang has joined #zuul11:21
*** bhavikdbavishi has quit IRC11:39
*** saneax has quit IRC11:40
*** weshay is now known as weshay|ruck11:44
openstackgerritTobias Henkel proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check  https://review.opendev.org/64455711:50
openstackgerritTobias Henkel proposed zuul/zuul master: WIP: Handle review requirements in canMerge  https://review.opendev.org/74904011:50
*** sshnaidm has quit IRC11:57
*** rlandy has joined #zuul12:01
*** sshnaidm has joined #zuul12:07
*** bhavikdbavishi has joined #zuul12:22
openstackgerritJan Kubovy proposed zuul/zuul master: Scheduler's pause/resume functionality  https://review.opendev.org/70973513:00
openstackgerritJan Kubovy proposed zuul/zuul master: Separate connection registries in tests  https://review.opendev.org/71295813:00
openstackgerritJan Kubovy proposed zuul/zuul master: Prepare Zookeeper for scale-out scheduler  https://review.opendev.org/71726913:00
openstackgerritJan Kubovy proposed zuul/zuul master: Mandatory Zookeeper connection for ZuulWeb in tests  https://review.opendev.org/72125413:00
openstackgerritJan Kubovy proposed zuul/zuul master: Driver event ingestion  https://review.opendev.org/71729913:00
openstackgerritJan Kubovy proposed zuul/zuul master: Connect merger to Zookeeper  https://review.opendev.org/71622113:00
openstackgerritJan Kubovy proposed zuul/zuul master: Connect fingergw to Zookeeper  https://review.opendev.org/71687513:00
openstackgerritJan Kubovy proposed zuul/zuul master: Connect executor to Zookeeper  https://review.opendev.org/71626213:00
openstackgerritJan Kubovy proposed zuul/zuul master: WIP: Switch to using zookeeper instead of gearman for jobs (keep gearman for mergers)  https://review.opendev.org/74441613:00
*** wuchunyang has quit IRC13:06
*** bhavikdbavishi has quit IRC13:18
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: improve tenant scoping of autohold, authorizations  https://review.opendev.org/72811813:22
openstackgerritMatthieu Huin proposed zuul/zuul master: CLI: add autohold-info, autohold-delete via REST  https://review.opendev.org/72841013:22
openstackgerritMatthieu Huin proposed zuul/zuul master: REST API: improve promote endpoint testing  https://review.opendev.org/72848913:23
openstackgerritMatthieu Huin proposed zuul/zuul master: Builds: add "held" attribute  https://review.opendev.org/72899413:24
*** rlandy is now known as rlandy|training13:51
*** rlandy|training has quit IRC13:52
*** rlandy has joined #zuul13:59
*** rlandy is now known as rlandy|training13:59
*** cloudnull has joined #zuul14:06
*** openstackgerrit has quit IRC14:37
*** felixedel has quit IRC14:37
*** felixedel has joined #zuul14:37
*** mattd01 has joined #zuul15:07
*** sshnaidm is now known as sshnaidm|bbl15:11
johnsomIs there a way to get the old results patch UI back, like a user cookie based setting or something. Needing to scroll right a long way to be able to get at the logs is no fun. https://zuul.opendev.org/t/openstack/build/81dbd69b47534170bfaf857e87feb87d for example15:20
clarkbjohnsom: I think you'd need to loda the old js somehow (run a local zuul-web on the old version maybe) there isn't a built in method for that15:21
johnsomYeah, I expected there wasn't a magic feature I didn't know about. It's just 99% of the time I click into a result, I'm looking for logs. Having that easily accessible would be handy. I will open a story for it.15:23
clarkbI think there may already be a fix15:24
fungijohnsom: you might want to weigh in on https://review.opendev.org/72360315:24
clarkboh its pre on the actual contents15:25
clarkbI think we can keep the tabs within in the window size not the log size15:25
clarkb(I don't know how to do that myself, but I'm sure its possible)15:25
*** Goneri has joined #zuul15:25
johnsomYeah. Well, I will open a story to track it so it's at least on the books.15:27
tobiashyeah, I'd consider this a bug since only that logs part should scroll, not the whole page15:27
johnsomhttps://storyboard.openstack.org/#!/story/200809615:33
*** bhavikdbavishi has joined #zuul16:08
*** hamalq has joined #zuul16:10
tobiashsomehow https://review.opendev.org/723603 seems to fix this in the preview even in the non-wrap mode16:11
tobiashhowever I have no idea how that is working16:12
*** rlandy|training is now known as rlandy16:12
*** bhavikdbavishi1 has joined #zuul16:24
*** bhavikdbavishi has quit IRC16:26
*** bhavikdbavishi1 is now known as bhavikdbavishi16:26
*** mattd01 has quit IRC16:40
*** mattd01 has joined #zuul16:41
clarkbis the --wrap in the css there some react magic? or is that a normal property and I'm just failing t ogoogle?16:46
clarkbtobiash: I expect that the :root {} css block is why it works in the config disable case since that affects the root document16:46
clarkbaha its css variable magic til16:49
fungitoday i learned that css *has* variable magic16:49
*** mattd01 has quit IRC16:50
clarkbso ya confused why it would change anything if you've disabled the setting16:50
clarkbas it should only apply if you've toggled it on16:50
clarkboh wait I get it. white-space: pre is set globally16:50
clarkbthen its toggled to white-space: pre-wrap if you enable that toggle16:51
clarkbthat is why it works16:51
clarkb(but it should only affect pre content)16:51
*** zenkuro has joined #zuul16:52
clarkband the tabs are in a ul16:52
clarkb(so ya I have no idea why that would help in the default off case)16:52
clarkbthe reason is that the ul has a max-width set to 100% which is then determined by its containing elements17:04
clarkbso I think the change there works because it defaults to pre?17:05
clarkbya and the Tabs stuff from pf seems to assume a header and content implemented that way17:10
clarkbwe may be able to build our own thing and separate the selector header content from the nested content in the html17:10
*** tosky has quit IRC17:14
*** bhavikdbavishi has quit IRC17:32
*** rfolco has quit IRC17:54
*** mattd01 has joined #zuul18:06
corvuswow, i was not expecting that :/18:07
corvusclarkb, fungi, tobiash, zbr, felixedel: i don't think there is any case where a user should have to horizontally scroll to see the tabs on the build result page18:08
corvusjust in case you think i'm in favor of horizontal scrolling there, i'm not.  i've never seen the build page do that before, so i think that's just something we missed in review18:08
*** rfolco has joined #zuul18:08
zbrcorvus: that is related to 723603, right?18:13
*** rfolco has quit IRC18:14
corvuszbr: i'm looking at 723603 now18:14
zbrgo to it, open sitepreview for openstack and search for build  7a6d497f09f349ed9fd5135ec31f160e18:14
corvuszbr: i'm familiar with the process, thanks :)18:14
zbri know, just trying to show a build that has output that wraps or not18:14
zbrstdout  lines are not wrapped by default, which is not what a terminal would do.18:15
zbri do remember at least one person mentioning that they do like current behavior of not having the wrapping18:16
corvuszbr: what's happening now on the build page is new since the pf4 work and i don't think anyone wants it18:16
clarkbits due to the change of the tabulated things18:17
corvusclarkb: yeah18:17
zbri think we talk about different things, the lack of wrapping was there before, otherwise i would not have started the change long time before pf418:18
corvusit's different now because of the tabs18:19
corvusit makes the other functions of the page unusable since you have to horizontal-scroll to access the tabs18:19
corvus723603 does 2 things on the results tab of the build page: if you enable wrapping, it works as you would expect.  but if you disable the wrapping preference, it puts a horizontal scroll bar at the bottom of the results tab container, which is not a good situation, because then you need to scroll down to access the horozintal bar to scroll right18:20
corvusin other words, the constraints for having horizontal scroll on the build page is that if lines are long, the horizontal scroll bar always needs to be visible, and the tabs need to never exceed the width of the display18:21
corvusi don't think it's trivial to be able to accomplish that18:21
corvusthe same is true for the "console" tab18:23
corvusi spent quite a bit of time/effort on the initial implementation of the console tab ensuring that wasn't the case18:23
zenkurohi, the proper way to send build log url is by setting success-url in job?18:24
zenkurosend to another gerrit(in openstack CI)18:24
corvuszenkuro: at this point it's best to avoid success-url and set the 'report build url' setting for the tenant18:25
corvuszenkuro: then it'll report the url to zuul's build page18:25
zbrcorvus: i am not sure what is the issue with the tabs that you are describing, or at least i am unable to reproduce it with my firefox.18:26
corvuszbr: visit the link that johnsom sent earlier18:26
corvuszbr: not with your change18:27
AJaegercorvus, could you review https://review.opendev.org/747127 to create zuul/zuul-client, please?18:27
corvuszbr: 81dbd69b47534170bfaf857e87feb87d18:27
johnsomhttps://zuul.opendev.org/t/openstack/build/81dbd69b47534170bfaf857e87feb87d18:27
corvuszbr: ^18:27
corvusclarkb, tobiash: this seems like quite a difficult situation, and i'm inclined to revert the pf4 build page change until we sort it out18:27
clarkbI'm not opposed to that18:30
zbrlol, that is horrible18:31
corvusi left a review on https://review.opendev.org/723603 explaining why i think it's not a fix for the immediate issue, but i don't think there's anything to change in 723603 immediately18:35
zbrit is related to the use of pre, which by default does not wrap, it needs the kind of tunning it did with https://review.opendev.org/#/c/723603/9/web/src/index.css18:35
corvusbasically, i think we have "long lines with pf3" working, and we don't have "long lines with pf4" working, and before we can do anything with user prefs, we need to have long lines working18:36
corvuswhich means we either need to stay with pf3, or fix the pf4 version to work with long lines first, then we can make a user toggle18:36
corvusfungi: ^ fyi18:37
corvusi'll work on the revert18:37
*** mattd01 has quit IRC18:37
*** mattd01 has joined #zuul18:37
*** openstackgerrit has joined #zuul18:43
openstackgerritJames E. Blair proposed zuul/zuul master: Revert PF4 build page  https://review.opendev.org/74909818:43
corvusclarkb, fungi, tobiash, felixedel, zbr, johnsom: ^18:43
zenkurocorvus: you are talking about report-build-page?18:43
corvuszenkuro: yes that's the one18:44
corvusit will be the default in the future18:44
johnsomcorvus Thanks, do you want to link the story to this? https://storyboard.openstack.org/#!/story/200809618:44
openstackgerritJames E. Blair proposed zuul/zuul master: Revert PF4 build page  https://review.opendev.org/74909818:45
corvusjohnsom: done18:45
zenkurocorvus: hm, according to documentation it is boolean. and I want to post link to independent server just for one job. While tennant config will affect everything18:46
corvuszenkuro: the build page will have links to the logs18:47
corvuszenkuro: if there's a special log url for a job (for instance, a documentation preview url) then you can return that as an 'artifact' in the job and it will have a prominent place on the build page18:48
corvuszenkuro: in opendev, we switched all of our doc preview builds to do that instead of using success-url18:48
zenkurocorvus: sorry Ive probably incorrectly described the issue: I want to report url to gerrit as link for success/fail18:49
corvuszenkuro: because if you use success-url, then yes, the user can quickly go to that log url, but they won't have a way to get to zuul's build page18:49
corvuszenkuro: why?18:49
zenkurocorvus: Openstack cinder third party ci requirment18:50
corvuszenkuro: why don't you want the user to go to zuul's build page18:50
corvuszenkuro: this is probably a better discussion for #openstack-infra, but i think that's a misunderstanding.18:50
zenkurocorvus: security, zuul is on privste network18:50
corvuszenkuro: then success-url is what you're looking for18:51
zenkurocorvus: I do not want to show zuul to the world18:51
corvuszenkuro: :(18:51
zenkurocorvus: ”my precious„ + Im not sure that ive configured things properly18:53
zenkuroIsn't it is more secure to raise arbitrary vps with apache to show logs, then expose zuul with access to local infrastructure to the world?19:02
fungizenkuro: zuul's webui is also read-only unless you set up an authenticated admin api for it19:13
fungiit's just a client-side rendering of json blobs served by the api and fetched from log storage19:14
*** nils has quit IRC19:15
zenkuroand in case success-urs was not disabled yet. What myght be the reason if it does not send lig url?19:47
zenkuro*log url, + Ive set report buld page to false19:48
corvuszenkuro: you're saying you set 'success-url' on the job and it did not report that url when the job succeeded?19:53
zenkurocorvus: it reports other url. hm, I think I might have some ideas. Let me check again and update you on the issue19:56
corvuszenkuro: you might check the scheduler log to see if it had trouble formatting the url20:07
corvusit may have logged an error20:07
*** tosky has joined #zuul20:15
*** frenzyfriday has joined #zuul20:20
*** frenzyfriday has quit IRC20:28
zenkurocorvus: yes, there is error thanks!20:31
clarkbcorvus: looking at the check build dashboard for your revert things look good to me. is there any checking you'd like to do or should I go ahead and approve it now?20:48
clarkbI guess I should check the py35 job to see if it is failing due to setuptools 5020:48
clarkbya I think it is :/20:48
clarkbfungi: do you know if anyone has debugged the os-testr post tasks on py35 yet?20:49
clarkbhttps://zuul.opendev.org/t/zuul/build/f0928f15f0e1423385c7cd5a9ebd454c is what they look like20:49
*** mattd01 has quit IRC20:51
clarkb"Thus it is unfortunately not just s,/usr/local/bin,/usr/bin,g because the new setuptools will install all the libraries into site-packages; which the packaged python intpreter doesn't know to look for." from ianw's email is likely related20:51
clarkb(why does it work with python38 then?)20:51
clarkbhttps://github.com/pypa/setuptools/issues/2363 https://github.com/pypa/setuptools/issues/2357 all look like they will be problems for us, but not the problem we are seeing20:56
clarkbhttps://github.com/pypa/setuptools/issues/2352 is the issue we are seeing I think20:57
clarkbI guess we should update our images /me writes some changes20:58
ianwclarkb: the quick look i had at 3.5 issues seemed to be setuptools, but maybe not related to that21:03
clarkbianw: ya its this bug https://github.com/pypa/setuptools/issues/235221:03
ianw50 thumbs ups but no patch :/21:07
*** vishalmanchanda has quit IRC21:15
fungiclarkb: i don't know much about the py35 post_failure results yet other than ianw saying it was related to setuptools 5021:36
clarkbfungi: ya I think I tracked it down to https://github.com/pypa/setuptools/issues/2352 and have a change up to pin setuptools on our image venvs as a result21:36
fungilooks reasonable, yep21:38
*** rlandy is now known as rlandy|bbl21:39
*** tosky has quit IRC23:03
*** hamalq has quit IRC23:33
*** Goneri has quit IRC23:33
*** armstrongs has joined #zuul23:40
*** armstrongs has quit IRC23:48

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!