Friday, 2018-06-01

*** d0ugal__ has quit IRC00:58
*** harlowja has quit IRC00:58
*** d0ugal__ has joined #openstack-mistral01:00
*** EmilienM_ has joined #openstack-mistral03:43
*** rbrady has quit IRC03:44
*** doriftoshoes____ has quit IRC03:44
*** EmilienM has quit IRC03:44
*** EmilienM_ is now known as EmilienM03:44
*** EmilienM has quit IRC03:46
*** EmilienM has joined #openstack-mistral03:46
*** d0ugal__ has quit IRC03:52
*** d0ugal__ has joined #openstack-mistral04:14
*** harlowja has joined #openstack-mistral04:17
*** harlowja has quit IRC04:20
*** hardikjasani has joined #openstack-mistral04:26
*** d0ugal__ has quit IRC04:49
*** AlexeyAbashkin has joined #openstack-mistral04:49
*** Alexey_Abashkin has joined #openstack-mistral04:52
*** AlexeyAbashkin has quit IRC04:53
*** Alexey_Abashkin is now known as AlexeyAbashkin04:53
*** d0ugal__ has joined #openstack-mistral04:58
*** AlexeyAbashkin has quit IRC05:22
*** mcdoker181818 has joined #openstack-mistral06:06
rakhmerovd0ugal__: hi06:17
rakhmerovhttps://review.openstack.org/#/c/477816 again failed on the TripleO gate06:18
rakhmerovwhat is the algorithm that I need to use to see what failed and where?06:18
rakhmerovwhat log files do I need to look at?06:18
*** d0ugal__ has quit IRC06:26
rakhmerovapetrich: hi, may be you can help understand that06:28
rakhmerovwhat exactly failed in http://logs.openstack.org/16/477816/8/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/e1abb77/06:28
apetrichrakhmerov, looking06:29
rakhmerovapetrich: thanks!06:29
rakhmerovI seem to have fixed the previous problem (and added a test for it) but I'm surprised that something else failed now06:30
apetrichrakhmerov, what I usually do is first look at logs/undercloud/home/zuul/ and see if there's a overcloud_deploy.log.txt.gz if that file is there means that we had a successful undercloud deploy06:32
rakhmerovok06:32
apetrichthen I scroll down that file. if it succeeded that means that the overcloud deployed06:32
apetrichas it did06:32
apetrichso it might have been a tempest issue06:32
rakhmerovI rechecked anyway, may be it will help06:33
rakhmerovbtw, I don't see this file in there06:34
rakhmerovapetrich: ^06:34
apetrichso that's not a tempest gate so I'm now my system failed and now I'm looking all over the place to find what it failed :)06:34
rakhmerovoh, sorry, I do see it )06:34
apetrichbut those are usually my first steps on tripleo gates06:34
rakhmerovgot it06:35
rakhmerovapetrich: so those mistral workflows run when the overcloud is being deployed, right?06:36
rakhmerovwhich means that the error is different now, not related to Mistral workflows?06:36
apetrichit says that the overcloud failed http://logs.openstack.org/16/477816/8/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/e1abb77/job-output.txt.gz#_2018-05-31_15_55_57_16464106:37
rakhmerovaha06:37
rakhmerovI see06:37
apetrichnot really06:37
apetrichyeah =>  so those mistral workflows run when the overcloud is being deployed06:38
rakhmerovok06:39
rakhmerovapetrich: where can I see a log from Mistral?06:40
apetrichlogs/undercloud/var/log/mistral/executor.log.txt.gz06:40
rakhmerovif it has errors they will tell me something I think06:40
rakhmerovok06:40
apetrichi'm not seeing anything obvious06:43
apetrichanother interesting place to look is logs/undercloud/var/log/extra/ specially errors.txt.gz06:43
apetrichthat's where all ERROR logs from the system are collected06:44
rakhmerovok06:45
apetrichit might be this Can not evaluate YAQL expression [expression=yaml_dump($.swift_message), error=cannot represent an object: {u'status':06:45
apetrichfrom here http://logs.openstack.org/16/477816/8/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/e1abb77/logs/undercloud/var/log/extra/errors.txt.gz#_2018-05-31_14_48_17_35706:46
rakhmerovI see for sure that the previous error has gone06:47
rakhmerovwhich is good06:47
rakhmerovooh06:47
rakhmerovnope, it's similar actually..06:48
rakhmerovhah06:48
*** d0ugal__ has joined #openstack-mistral06:48
rakhmerovapetrich: yeah, thanks06:49
apetrichno worries. glad to be helpful :)06:49
rakhmerovinteresting, it means I didn't fully fix the problem06:49
apetrichit looks like it is trying to do a yaml_dump on a python string of json object. is that it?06:55
apetrichnot on. off*06:55
apetrichof*06:55
* apetrich cna't type today06:55
openstackgerritRenat Akhmerov proposed openstack/mistral master: Add YAQL engine options  https://review.openstack.org/47781607:00
openstackgerritRenat Akhmerov proposed openstack/mistral master: Release note for adding YAQL engine options  https://review.openstack.org/57148107:00
rakhmerovapetrich: not sure exactly, I added a debug line to see what it is07:02
*** jaewook_oh has joined #openstack-mistral07:09
rakhmerovapetrich: according to the error message it can be either a dict or FrozenDict from YAQL. Both should be handled.. So I'm a little confused why this is happeninng07:17
apetrichit looks like a string from a converted dict07:18
rakhmerovapetrich: hm.. why a string?07:34
rakhmerovwell, with strings there shouldn't be any problems too07:34
apetrichno. I'm wrong. It is an object07:35
*** hardikjasani has quit IRC07:36
rakhmerovapetrich: ok, I'll look at the debug and we'll see07:42
rakhmerovapetrich: btw, just a crazy thought.. Is it possible that the gate somehow took a older version of this YAQL function somehow?07:43
rakhmerovI understand it's not likely but who knows..07:43
rakhmerovI remember something like that in the past.. Not sure though what it was exactly07:43
*** rbrady has joined #openstack-mistral07:47
*** doriftoshoes____ has joined #openstack-mistral07:47
*** jpich has joined #openstack-mistral08:00
*** d0ugal__ has quit IRC08:03
*** AlexeyAbashkin has joined #openstack-mistral08:03
*** d0ugal has joined #openstack-mistral08:03
d0ugalMorning folks08:04
d0ugal#startmeeting mistral08:04
openstackMeeting started Fri Jun  1 08:04:35 2018 UTC and is due to finish in 60 minutes.  The chair is d0ugal. Information about MeetBot at http://wiki.debian.org/MeetBot.08:04
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.08:04
*** openstack changes topic to " (Meeting topic: mistral)"08:04
openstackThe meeting name has been set to 'mistral'08:04
d0ugalFriday office hour!08:05
d0ugalHows everyone doing?08:05
d0ugalrakhmerov, apetrich, bobh, mcdoker181818: PING08:05
rakhmerovI'm here08:05
d0ugalhttps://etherpad.openstack.org/p/mistral-office-hours08:05
rakhmerovbut don't have much to update with )08:05
d0ugalAs usual, add your name to the ping list on line 16 if you want reminders ^08:05
rakhmerovbtw, I'm on vacation next week08:06
d0ugalrakhmerov: sure, that is fine :)08:06
d0ugalNice :)08:06
d0ugalAre you going away somewher?08:06
rakhmerovyeah08:07
rakhmerovTurkey08:07
d0ugaloh, nice and warm I bet.08:07
d0ugalrakhmerov: did you manage to resolve the tripleo gate failure?08:08
rakhmerovnot yet08:08
rakhmerovI added a debug line to see what I'm dealing with08:08
rakhmerovI thought I fixed it but it occurred again08:08
rakhmerovd0ugal: but it seems as if TripleO took an old yaml_dump() function08:10
d0ugaloh, strange08:10
rakhmerovnot likely, I understand though..08:10
rakhmerovyeah08:10
d0ugalCould be possible, but I'm not sure how :)08:10
apetricho/08:13
d0ugalrakhmerov: Can you set the Importance on https://bugs.launchpad.net/mistral/+bug/1774164 ?08:13
openstackLaunchpad bug 1774164 in Mistral ""Create execution" API request may lead to creation of more than one workflow execution object" [Undecided,Confirmed]08:13
rakhmerovyes08:14
d0ugalIt is our only untriaged bug :)08:14
d0ugalopetrenko_: Are you around? Did you want to chat about EBNF?08:14
opetrenko_yes, want to chat about all the staff that can help newcomers quickly take apart mistral08:16
d0ugalstaff? do you mean stuff?08:16
rakhmerov:))08:17
d0ugalI am not very familiar with EBNF. I have never written it before at least, just read it a few times.08:18
opetrenko_Yeah, stuff :)08:19
opetrenko_I would like to document mistral dsl as detailed as possible08:20
d0ugalYeah, that makes sense08:21
rakhmerovopetrenko_: usually EBNF is requested by someone who wants to write a parser for a language08:21
rakhmerovwhy do you think you need EBNF to understand the Mistral workflow language?08:21
d0ugalI wonder if we could generate something08:22
rakhmerovI think the spec is pretty detailed. Although I agree that there are some gaps08:22
mcdoker181818Hi, all. Please take a look https://review.openstack.org/#/c/499790/ and https://review.openstack.org/#/c/569643/08:22
opetrenko_Probably, if we describe our dsl, adding new abilities to it will become much easier I guess08:23
d0ugalIt does change sometimes, but not very often now.08:23
opetrenko_Well, if you think it's not needed it's ok. We can just skip this topic.08:25
d0ugalI'm not sure we need EBNF exactly08:26
d0ugalHowever I do think a better description of the syntax would be useful.08:26
d0ugalI found it difficult originally and relied on looking at examples.08:26
rakhmerovopetrenko_: well it's kind of nice to have it (and I thought about adding it at some point) but haven't seen strong reasons so far08:26
rakhmerovd0ugal: yes08:26
rakhmerovagree08:26
*** shardy has joined #openstack-mistral08:27
opetrenko_So we can discuss what should be documented08:27
d0ugalEBNF has a very specific purpose and it is good for that, but I don't think it will be easy for most new users to understand.08:28
d0ugalAre there any alternatives?08:28
rakhmerovd0ugal: yes, I think you're right :) From what I've seen, only computer science guru ever look at it )08:31
rakhmerovso generally, we have a task to improve our doc and it also includes improving the language spec08:32
d0ugalYeah08:32
rakhmerovwe know that it has a number of issues: gaps, not the same style everywhere, not the best structure etc.08:32
rakhmerovbut someone needs to volunteer to fix it at the end of the day )08:33
d0ugalIndeed08:33
opetrenko_agree08:33
opetrenko_We can restructure our docs to make them more structured and verbose08:34
d0ugalFixing the documentation is difficult.08:34
rakhmerovyeah08:34
d0ugalI have been trying to think of a prgamatic way to start working through it, but I don't have any great ideas.08:35
d0ugalWe have a legacy documentation problem, it is hard to refactor :)08:35
rakhmerovthe challenge is that it doesn't make a lot of sense to fix individual sections, we rather need to look at the docs as a whole and restructure it first08:35
rakhmerovand come up with the unified style etc.08:35
d0ugalrakhmerov: You were going to write a guideline for that style.08:35
opetrenko_We would rather not refactor our docs but write new one08:35
d0ugal:)08:35
rakhmerovno, not for that style :)08:36
rakhmerovI was going to write a guideline for coding style )08:36
opetrenko_We can discuss the structure of docs, than create skeleton and after that fill out everything as verbose as possible08:36
d0ugalopetrenko_: true, do you want to propose a structure? :)08:37
rakhmerovopetrenko_: that may be a good idea. Write a structure of the new doc first, then start moving individual sections into it step by step applying the new rules08:37
opetrenko_Wow, not so fast)08:37
d0ugalrakhmerov: for code style, I wish we just used Black https://pypi.org/project/black/) and then didn't have to worry about code style!08:37
d0ugallol08:37
rakhmerovopetrenko_: what do you mean by "as verbose as possible"?08:37
d0ugalbrb08:38
d0ugal"as detailed as possible" perhaps08:38
rakhmerovI mean "can you give an example where our docs are not verbose enough"?08:38
opetrenko_I mean that we should write our docs the way that student of 3rd year comes looks at it and will understand how he can use it08:39
opetrenko_afk for 5 mins08:39
rakhmerovd0ugal: I'll look at Black, may be it's ok08:39
rakhmerovopetrenko_: the goal is good, yes. Agree. I just found that the idea of the project itself is often hard to explain08:40
rakhmerovnot even to students08:40
rakhmerovanyway, we've always had this idea in mind too. And we've actually improved docs significantly over the last 1-1.5 years08:41
rakhmerovso we keep improving it but yes, I agree, we need to restructure it soon08:41
d0ugalI keep wanting to propose a new documentation structure08:42
d0ugalbut never get to doing it08:42
opetrenko_I have an idea08:47
opetrenko_Lets keep the structure of documentation that way08:47
opetrenko_The first topic is quick overview of the project. Idea, purpose of the project. Some examples of what can you do with mistral, with some aka screenshots of results.08:49
opetrenko_Next, we provide topics for each group of users. For devs, operators etc08:49
d0ugalYup08:50
d0ugalWe have talked about this a few times - we just need somebody with the time and motivation to do it :)08:50
opetrenko_The first thing we should describe it the overview of the project. It can help encourage new user, devs  to participate in life of mistral08:50
opetrenko_IMO, the second thing should be dev guide. It's the crucial part to devs08:51
opetrenko_If you come to project and cant get an idea of what's going on there, you are 50% to leave the idea to join08:52
d0ugalSure08:52
d0ugalI think we all agree the documentation can and should be better.08:52
d0ugalThe question is, how do we start working on it instead of just talking about it?08:53
opetrenko_The dev guide should contain architecture of the project, explanation of project structure08:53
d0ugaland who can do the work?08:53
opetrenko_I can try, but I'll need a lot of help, because I'm not familiar with mistral yet :)08:53
d0ugalRight08:53
d0ugalbut being new also gives you a better insight into the problems.08:54
opetrenko_Yeah, that's why I started doc topic08:54
d0ugalI think the first step is for somebody to try writing a documentation outline08:54
d0ugalWhat sections there should be and what should be in them08:55
d0ugalThen we can discuss that and hopefully agree on a structure08:55
opetrenko_Yeah I can try do this, but still need some help from you guys08:55
d0ugalSure08:55
opetrenko_So where should I start describing skeleton?08:56
opetrenko_probably some visualization feature can help in that08:56
opetrenko_maybe we can try out some conference tool with ability to speak, make remarks and draw09:01
d0ugalopetrenko_: usually when we want to propose larger ideas like this we would propose a patch to the mistral-specs repo09:02
d0ugalhttps://github.com/openstack/mistral-specs09:02
d0ugaland then the discussion would happen via gerrit and code review.09:02
opetrenko_ok09:03
d0ugal#endmeeting09:06
*** openstack changes topic to " (Meeting topic: test)"09:06
openstackMeeting ended Fri Jun  1 09:06:33 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)09:06
openstackMinutes:        http://eavesdrop.openstack.org/meetings/mistral/2018/mistral.2018-06-01-08.04.html09:06
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/mistral/2018/mistral.2018-06-01-08.04.txt09:06
openstackLog:            http://eavesdrop.openstack.org/meetings/mistral/2018/mistral.2018-06-01-08.04.log.html09:06
d0ugalThat is the end of the office hour - I'll be around for the rest of the day however09:06
d0ugalopenstack: if you want something less formal, you could start writing notes in a etherpad.09:14
d0ugalhttp://etherpad.openstack.org/09:14
opetrenko_And I have some ideas of what should better be done09:28
*** d0ugal has quit IRC09:33
*** d0ugal has joined #openstack-mistral09:53
rakhmerovapetrich, d0ugal: mistery :) http://logs.openstack.org/16/477816/9/check/tripleo-ci-centos-7-scenario003-multinode-oooq-container/7beaf58/logs/undercloud/var/log/mistral/engine.log.txt.gz#_2018-06-01_08_27_19_96209:56
rakhmerovso it's a FrozenDict that I specifically check and transform09:56
rakhmerovbut it still fails09:56
rakhmerovmaybe it's wrapped in a different way somehow.. ok, will be looking at it09:57
apetrichdamn09:57
rakhmerovyeah09:58
rakhmerovI was getting the same type in the unit test that I created09:58
rakhmerovafter I added sanitizing it worked fine09:58
rakhmerovanother theory is that it needs to be done recursively09:59
openstackgerritRenat Akhmerov proposed openstack/mistral master: Add YAQL engine options  https://review.openstack.org/47781610:07
openstackgerritRenat Akhmerov proposed openstack/mistral master: Release note for adding YAQL engine options  https://review.openstack.org/57148110:07
*** d0ugal has quit IRC10:16
*** d0ugal has joined #openstack-mistral10:25
*** thrash|g0ne is now known as thrash10:33
d0ugalrakhmerov: That is interesting.10:43
d0ugalI'm starting to get curious enough to look :-D10:43
*** hardikjasani has joined #openstack-mistral10:46
apetrichit is very odd. I did a test and didn't get that10:52
*** d0ugal has quit IRC11:06
*** d0ugal has joined #openstack-mistral11:23
*** apetrich has quit IRC11:29
*** apetrich has joined #openstack-mistral11:31
thrashd0ugal: apetrich https://review.openstack.org/#/c/569876/ is ready11:35
apetrichthrash, thanks! I will look in a bit when I come back from lunch11:36
thrashapetrich: ack. thanks.11:36
*** d0ugal has quit IRC11:53
*** d0ugal has joined #openstack-mistral11:59
*** d0ugal has quit IRC12:16
openstackgerritOleksiy Petrenko proposed openstack/mistral-specs master: New more user friendly documentation for Mistral  https://review.openstack.org/57171012:26
*** d0ugal has joined #openstack-mistral12:35
apetrichthrash, you doing lisp now? $(($(cat .stestr/next-stream) - 1))12:54
apetrichlgtm12:54
* toure thinks lisp is cool12:54
thrashapetrich: I didn't like the 3 lines... :D13:01
opetrenko_d0ugal, rakhmerov: Well, some skeleton of skeleton of new documentation is ready13:24
d0ugalopetrenko_: That was fast!13:31
d0ugalthrash: Thanks!13:32
opetrenko_it is just skeleton of skeleton13:32
d0ugal:)13:32
d0ugalSkeletons all the way down.13:32
opetrenko_and it should be modified a lot13:32
opetrenko_where should I publish it?13:33
d0ugalSure, but it is a strating point. That is important.13:33
d0ugalopetrenko_: What format is it in?13:33
d0ugalopetrenko_: etherpad? email to openstack-dev? WIP patch to mistral-specs?13:33
opetrenko_rst like that I can add on review to the main spec description13:34
d0ugalopetrenko_: sure, that works13:48
rakhmerovd0ugal, apetrich: so, I applied another fix, and it worked. The problem was that the structure that goes to YAQL functions can have nested internal types13:51
apetrichoh13:52
rakhmerovso registering another presenter in the YAML library helps13:52
rakhmerovyeah13:52
rakhmerovso please review and let me know if that's ok13:52
*** hardikjasani has quit IRC13:59
apetrichlgtm13:59
d0ugalrakhmerov: great, I'll take a look in a moment.14:02
rakhmerovok, thanks14:03
*** d0ugal has quit IRC14:31
*** d0ugal has joined #openstack-mistral14:35
d0ugalrakhmerov: still here?14:41
openstackgerritDougal Matthews proposed openstack/mistral stable/queens: Fix the README formatting  https://review.openstack.org/57174614:41
openstackgerritDougal Matthews proposed openstack/mistral stable/pike: Fix the README formatting  https://review.openstack.org/57174714:41
d0ugal^ we need these fixes to do releases.14:42
d0ugalI might just land them because they are so trivial14:42
d0ugalapetrich: ^ fancy doing a sanity check?14:42
apetrichd0ugal, looking14:43
apetrichtoo big of a change I might need until tuesday to test and +1 it14:44
apetrich:)14:44
d0ugallol14:44
d0ugalapetrich: just updating the commit message.14:44
apetrichdang the pike change is twice as big as the queens one14:45
openstackgerritDougal Matthews proposed openstack/mistral stable/pike: Fix the README formatting  https://review.openstack.org/57174714:46
openstackgerritDougal Matthews proposed openstack/mistral stable/queens: Fix the README formatting  https://review.openstack.org/57174614:47
apetrichyeah it works14:48
*** d0ugal has quit IRC14:49
*** d0ugal has joined #openstack-mistral14:57
*** gkadam has joined #openstack-mistral15:05
openstackgerritKupai József proposed openstack/mistral master: A mechanism to close stuck running action executions  https://review.openstack.org/52708515:16
*** gkadam_ has joined #openstack-mistral15:20
*** gkadam has quit IRC15:24
*** d0ugal has quit IRC15:34
*** jaosorior has quit IRC15:41
*** d0ugal has joined #openstack-mistral15:41
*** gkadam__ has joined #openstack-mistral15:46
*** d0ugal has quit IRC15:48
*** gkadam_ has quit IRC15:49
*** d0ugal has joined #openstack-mistral15:51
*** gkadam_ has joined #openstack-mistral15:52
*** gkadam__ has quit IRC15:55
*** jrist has quit IRC16:08
*** harlowja has joined #openstack-mistral16:11
*** jrist has joined #openstack-mistral16:25
*** gkadam__ has joined #openstack-mistral16:33
*** gkadam_ has quit IRC16:36
*** gkadam_ has joined #openstack-mistral16:37
*** EmilienM is now known as EvilienM16:40
*** gkadam__ has quit IRC16:40
*** gkadam__ has joined #openstack-mistral16:57
*** gkadam has joined #openstack-mistral17:00
*** gkadam_ has quit IRC17:00
*** AlexeyAbashkin has quit IRC17:02
*** jpich has quit IRC17:02
*** gkadam__ has quit IRC17:02
openstackgerritMerged openstack/mistral master: Add YAQL engine options  https://review.openstack.org/47781617:04
openstackgerritMerged openstack/mistral stable/queens: Fix the README formatting  https://review.openstack.org/57174617:04
openstackgerritMerged openstack/mistral stable/pike: Fix the README formatting  https://review.openstack.org/57174717:04
*** gkadam has quit IRC17:18
*** thrash is now known as thrash|biab17:21
*** harlowja has quit IRC17:22
*** harlowja has joined #openstack-mistral18:14
*** thrash|biab is now known as thrash18:57
*** openstackgerrit has quit IRC19:04
*** d0ugal has quit IRC19:47
*** d0ugal has joined #openstack-mistral20:05
*** d0ugal has quit IRC21:08
*** d0ugal has joined #openstack-mistral21:15
*** EvilienM has quit IRC21:18
*** EmilienM has joined #openstack-mistral21:19
*** EmilienM is now known as EvilienM21:19
*** harlowja has quit IRC23:18
*** openstackgerrit has joined #openstack-mistral23:51
openstackgerritMerged openstack/mistral master: Switch to using stestr  https://review.openstack.org/56987623:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!