| *** rlandy has quit IRC | 00:04 | |
| *** sai- has left #oooq | 00:17 | |
| *** yolanda_ has joined #oooq | 00:29 | |
| *** yolanda__ has quit IRC | 00:31 | |
| *** yolanda__ has joined #oooq | 00:55 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7 (1 more message) | 00:57 |
|---|---|---|
| *** yolanda_ has quit IRC | 00:58 | |
| *** yolanda_ has joined #oooq | 01:06 | |
| *** yolanda__ has quit IRC | 01:08 | |
| *** yolanda__ has joined #oooq | 01:23 | |
| *** yolanda_ has quit IRC | 01:26 | |
| *** ykarel|away has joined #oooq | 01:56 | |
| *** ykarel|away has quit IRC | 02:02 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7 (1 more message) | 02:57 |
| *** sanjayu__ has joined #oooq | 03:09 | |
| *** jaganathan has joined #oooq | 03:09 | |
| *** skramaja has joined #oooq | 03:09 | |
| *** udesale has joined #oooq | 03:46 | |
| *** ykarel|away has joined #oooq | 03:47 | |
| *** ykarel|away is now known as ykare | 03:47 | |
| *** ykare is now known as ykarel | 03:47 | |
| ykarel | is there known issue with promoter, all required jobs passing but there is no promotion in master/queens Tripleo and RDO phase 1 | 04:05 |
| ykarel | chkumar|ruck, sshnaidm|rover weshay ^^ | 04:05 |
| *** ccamacho has joined #oooq | 04:33 | |
| *** yolanda_ has joined #oooq | 04:55 | |
| *** pgadiya has joined #oooq | 04:57 | |
| *** pgadiya has quit IRC | 04:57 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (1 more message) | 04:57 |
| *** yolanda__ has quit IRC | 04:58 | |
| *** yolanda__ has joined #oooq | 05:05 | |
| *** yolanda_ has quit IRC | 05:09 | |
| *** yolanda__ has quit IRC | 05:09 | |
| *** ratailor has joined #oooq | 05:12 | |
| chkumar|ruck | %gatestatus | 05:27 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (1 more message) | 05:27 |
| *** chkumar|ruck has quit IRC | 05:30 | |
| *** udesale has quit IRC | 05:31 | |
| *** udesale has joined #oooq | 05:31 | |
| *** chandankumar has joined #oooq | 05:32 | |
| *** chandankumar is now known as chkumar|ruck | 05:32 | |
| *** bogdando has joined #oooq | 05:39 | |
| *** quiquell|off is now known as quiquell|rover | 05:40 | |
| quiquell|rover | chkumar|ruck: Good morning | 05:40 |
| quiquell|rover | ykarel: Did you say something about promoter ? | 05:40 |
| ykarel | quiquell|rover, yes | 05:40 |
| ykarel | promoter is not promoting | 05:41 |
| ykarel | can you check | 05:41 |
| chkumar|ruck | quiquell|rover: Good morning :-) | 05:41 |
| quiquell|rover | chkumar|ruck: Are you ruck already ? | 05:41 |
| chkumar|ruck | quiquell|rover: yup, But I am totally noob. | 05:42 |
| chkumar|ruck | quiquell|rover: I am going through noop jobs failures | 05:42 |
| *** quiquell|rover is now known as quiquell | 05:42 | |
| quiquell | chkumar|ruck: Join #tripleo-ci, we have a toy there | 05:43 |
| quiquell | chkumar|ruck: Found the issue | 05:48 |
| chkumar|ruck | quiquell: what was that | 05:50 |
| quiquell | chkumar|ruck: Missing pip dependency after some changes in promoter | 05:51 |
| chkumar|ruck | quiquell: do we gate promoter script also? | 05:52 |
| quiquell | chkumar|ruck: Now it has some unit tests | 05:52 |
| quiquell | chkumar|ruck: I have to change the test to use the requirements.txt from promoter | 05:52 |
| chkumar|ruck | quiquell: sshnaidm|rover nopp job failures https://review.rdoproject.org/etherpad/p/chkumar-ruck-rover-sprint16-notes | 05:52 |
| quiquell | chkumar|ruck: It was using its own | 05:52 |
| chkumar|ruck | on master | 05:52 |
| quiquell | chkumar|ruck: Take a look at this documen t | 05:53 |
| quiquell | chkumar|ruck: https://docs.google.com/document/d/1lTTOW-UDXTvxkJofGKS7wptmwifh2TVRdmMEcHuKl-o/edit#heading=h.6mividzgm94r | 05:53 |
| quiquell | chkumar|ruck: Not everything is true, and with the RR dashhboard it less manual process | 05:54 |
| chkumar|ruck | quiquell: sure, going through that | 05:54 |
| *** skramaja_ has joined #oooq | 06:00 | |
| *** skramaja has quit IRC | 06:02 | |
| *** ykarel_ has joined #oooq | 06:07 | |
| *** ykarel has quit IRC | 06:10 | |
| quiquell | chkumar|ruck: https://review.rdoproject.org/r/#/c/14594 and https://review.rdoproject.org/r/#/c/14574 | 06:13 |
| quiquell | To gate promoter | 06:13 |
| *** jfrancoa has joined #oooq | 06:15 | |
| quiquell | chkumar|ruck: Unit tests are passing https://review.rdoproject.org/r/#/c/14574 | 06:18 |
| quiquell | We are good for gating, let's get this merged | 06:18 |
| *** quiquell is now known as quiquell|bbl | 06:21 | |
| *** yolanda__ has joined #oooq | 06:28 | |
| *** ykarel__ has joined #oooq | 06:32 | |
| *** ykarel_ has quit IRC | 06:35 | |
| *** agopi has quit IRC | 06:39 | |
| *** amoralej|off is now known as amoralej | 06:44 | |
| chkumar|ruck | sshnaidm|rover: https://thirdparty.logs.rdoproject.org/jenkins-periodic-master-rdo_trunk-featureset020-1ctlr_1comp_64gb-87/undercloud/home/stack/install-undercloud.log.txt.gz and https://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-master-rdo_trunk-baremetal-hp_dl360_envD-single_nic_vlans-103/undercloud/home/stack/install-undercloud.log.txt.gz | 06:50 |
| chkumar|ruck | both are failing on master promotion with same error | 06:50 |
| chkumar|ruck | ssbarnea: I checked the respective heat logs but not found any traceback | 06:50 |
| chkumar|ruck | sshnaidm|rover: ^^ | 06:51 |
| chkumar|ruck | ssbarnea: sorry | 06:51 |
| chkumar|ruck | sshnaidm|rover: it is telling no more NO MORE HOSTS LEFT | 06:51 |
| *** ykarel__ is now known as ykarel | 06:52 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (1 more message) | 06:57 |
| *** quiquell|bbl is now known as quiquell | 06:58 | |
| ykarel | chkumar|ruck, sshnaidm|rover happening after this if ntp_servers is wrong or not reachable:- https://review.openstack.org/#/c/576888 | 07:00 |
| quiquell | ykarel, chkumar|ruck, sshnaidm|rover: I think the fix for https://bugs.launchpad.net/tripleo/+bug/1779642 | 07:07 |
| openstack | Launchpad bug 1779642 in tripleo "http://mirror.centos.org/centos/7/virt/x86_64/kvm-common/repodata/b58d947530c09c958e0d78c2c9029ef1fbb4d341c68ce99e3b0133561ca70421-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found"" [High,In progress] - Assigned to Quique Llorente (quiquell) | 07:07 |
| quiquell | Reduces the time for jobs | 07:08 |
| quiquell | The fix https://review.openstack.org/#/c/579803/ | 07:08 |
| ykarel | quiquell, Good, how much improvement u see | 07:09 |
| *** udesale_ has joined #oooq | 07:09 | |
| quiquell | ykarel: 10 minutes or so I think | 07:09 |
| quiquell | ykarel: I am comparing | 07:09 |
| quiquell | ykarel: This is the testing patch https://review.openstack.org/579815 | 07:10 |
| quiquell | ykarel: But maybe it was just lucky | 07:10 |
| *** udesale has quit IRC | 07:10 | |
| ykarel | quiquell, Good | 07:10 |
| quiquell | ykarel: Let's merge it | 07:11 |
| *** udesale__ has joined #oooq | 07:11 | |
| quiquell | marios, sshnaidm|rover: +1w https://review.openstack.org/#/c/579803/ | 07:11 |
| ykarel | quiquell, yes +1 | 07:11 |
| quiquell | To possible reduce job times | 07:11 |
| *** ykarel is now known as ykarel|mtg | 07:11 | |
| *** ykarel_ has joined #oooq | 07:13 | |
| *** udesale_ has quit IRC | 07:14 | |
| *** florianf has joined #oooq | 07:16 | |
| *** ykarel|mtg has quit IRC | 07:16 | |
| quiquell | chkumar|ruck, sshnaidm|rover: Going to open a ticket for the DELETE_COMPLETE stack at the RDO nodepool | 07:19 |
| *** yolanda__ is now known as yolanda | 07:21 | |
| marios | quiquell: o/ looking | 07:24 |
| quiquell | marios: Testing patch https://review.openstack.org/579815 | 07:24 |
| quiquell | Comparing with the noop change, feels like reducing job times https://review.openstack.org/#/c/560445/ | 07:26 |
| quiquell | For the ones that do the overcloud_prep_containers (but maybe it's just lucky) | 07:27 |
| marios | quiquell: nice, well lgtm but i've not seen this dockerfile.j2 before just now :) to be honest | 07:27 |
| *** tesseract has joined #oooq | 07:28 | |
| marios | quiquell: ah i see this tripleo-modify-image is pretty new thing https://review.openstack.org/#/c/570444/ ? | 07:28 |
| quiquell | marios: Yep, only stevebaker and EmilienM can +3 it | 07:29 |
| quiquell | marios: That's interesting, around 6 weeks we have started to feel the timeout pain | 07:30 |
| quiquell | marios: Just speculation | 07:30 |
| marios | quiquell: ;) | 07:30 |
| *** ykarel__ has joined #oooq | 07:34 | |
| *** ykarel_ has quit IRC | 07:37 | |
| *** tosky has joined #oooq | 07:37 | |
| *** gkadam__ has joined #oooq | 07:59 | |
| *** pliu_ has joined #oooq | 08:07 | |
| *** holser_ has joined #oooq | 08:08 | |
| *** kopecmartin has joined #oooq | 08:24 | |
| *** ykarel__ is now known as ykarel | 08:27 | |
| *** pliu_ has quit IRC | 08:30 | |
| *** pliu_ has joined #oooq | 08:33 | |
| *** panda|off is now known as panda | 08:39 | |
| *** Goneri has joined #oooq | 08:43 | |
| quiquell | panda: Good morning | 08:44 |
| panda | quiquell: top o the morning to ye | 08:45 |
| *** holser_ has quit IRC | 08:46 | |
| *** jaganathan has quit IRC | 08:48 | |
| quiquell | panda: Gating for promoter unit test https://review.rdoproject.org/r/#/c/14574 | 08:48 |
| panda | lucasagomes: morning, scenario007 failing even after the rebase http://logs.openstack.org/53/579653/3/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/90c84b2/job-output.txt.gz | 08:48 |
| panda | lucasagomes: if you have time to look | 08:49 |
| panda | quiquell: so all the tox configiuration patches merged ? | 08:50 |
| panda | quiquell: why are you testing also python3 ? | 08:51 |
| quiquell | panda: kind of for free, now we know that promoter also works for python3 | 08:51 |
| quiquell | panda: So we will be able to switch | 08:51 |
| quiquell | panda: The tox config is in the gates now | 08:51 |
| *** holser_ has joined #oooq | 08:54 | |
| panda | quiquell: one thing caught my attention in the previous patch, you use the new configparser even for python2 | 08:54 |
| panda | quiquell: do you need to installa a separate package for that ? | 08:55 |
| quiquell | panda: Yep, for python3 compatibility | 08:57 |
| quiquell | panda: ConfigParser doesn't work has to use configparser | 08:57 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci- (1 more message) | 08:57 |
| panda | quiquell: where do you ensure that we have it installed ? | 08:59 |
| quiquell | requirements.txt | 09:00 |
| quiquell | panda: https://review.rdoproject.org/r/#/c/14594/2/ci-scripts/dlrnapi_promoter/requirements.txt | 09:00 |
| lucasagomes | panda, oh right on! I will take a look at it soon-ish | 09:00 |
| *** matbu has quit IRC | 09:01 | |
| panda | lucasagomes: thanks! | 09:01 |
| panda | quiquell: A depends-on would have helped :) | 09:02 |
| quiquell | panda: Is the same repo, we can't do a Depends-On, have to use parenting | 09:02 |
| quiquell | panda: I want to separate the tox jobs and the fix | 09:03 |
| *** jaganathan has joined #oooq | 09:04 | |
| panda | quiquell: good, my local tests pass | 09:06 |
| quiquell | panda: nice !!! | 09:06 |
| *** matbu has joined #oooq | 09:07 | |
| panda | my super secret locally hidden shadowed private dark tests too | 09:10 |
| quiquell | panda: You mean new unit tests ? | 09:10 |
| sshnaidm|rover | quiquell, I wouldn't worry much about delete complete, it doesn't create any problems and doesn't take resources | 09:11 |
| panda | quiquell: can't tell you, it's a secret | 09:11 |
| quiquell | sshnaidm|rover: They appear as old stacks | 09:13 |
| quiquell | sshnaidm|rover: In the dashboard | 09:13 |
| quiquell | sshnaidm|rover: Would be nicer if rdocloud.py just push the current stacks and we count and filter at grafana | 09:16 |
| quiquell | sshnaidm|rover: What do you think ? | 09:16 |
| sshnaidm|rover | quiquell, hmm.. not sure grafana could do it same way as a script | 09:18 |
| quiquell | sshnaidm|rover: if we set states and timestamps it can | 09:18 |
| sshnaidm|rover | quiquell, how do you filter by timestamp? | 09:18 |
| quiquell | sshnaidm|rover: Also this way we can explore the problems from grafana | 09:18 |
| quiquell | sshnaidm|rover: where time [>] .... | 09:19 |
| quiquell | sshnaidm|rover: We can even add a timestamp field for it | 09:19 |
| sshnaidm|rover | quiquell, I mean timestamp of stack | 09:19 |
| quiquell | sshnaidm|rover: If we use the creationg time as influxdb timestamp | 09:19 |
| quiquell | the field "time" is the influxdb line timestamp | 09:20 |
| chkumar|ruck | quiquell: what about using six instead of configparser dependency/ | 09:20 |
| chkumar|ruck | ? | 09:20 |
| quiquell | chkumar|ruck: Don't know about six, but promoter is very delicate, in case we want to use it | 09:20 |
| quiquell | chkumar|ruck: Now we can add some unit tests to test it before merge | 09:21 |
| chkumar|ruck | quiquell: https://pythonhosted.org/six/. let me put a patch up for configparser | 09:21 |
| quiquell | chkumar|ruck: Add unit tests to it, if it's not unit tested it's not implemented | 09:22 |
| chkumar|ruck | quiquell: sure | 09:22 |
| panda | chkumar|ruck: what's the advantage of six over using backported configparser ? | 09:22 |
| sshnaidm|rover | quiquell, ok, will do second script, so we can test its results in grafana, although not sure why we need it, scripts are more powerful | 09:22 |
| chkumar|ruck | panda: with six, we can write py2 and py3 compatible code | 09:22 |
| chkumar|ruck | without much modification | 09:23 |
| chkumar|ruck | https://pythonhosted.org/six/ | 09:23 |
| quiquell | sshnaidm|rover: We open the door to explore the stacks | 09:23 |
| quiquell | sshnaidm|rover: btw, need a +3 at correct release file for periodics https://review.openstack.org/#/c/578793/ | 09:23 |
| panda | chkumar|ruck: configparser is already backported an dcompatible with both. I see six as a general framework, not for this specific case | 09:23 |
| panda | chkumar|ruck: I know, it's used all over openstack | 09:24 |
| quiquell | sshnaidm|rover: Already tested with reproducer and dry run and it's passing the correct one | 09:24 |
| sshnaidm|rover | quiquell, ack | 09:24 |
| sshnaidm|rover | quiquell, in stacks I don't see much to explore, tbh | 09:24 |
| quiquell | sshnaidm|rover: We can see the stuack ones, without accessing the tenant | 09:25 |
| quiquell | sshnaidm|rover: Good to open RDO issues and show | 09:25 |
| sshnaidm|rover | quiquell, yeah, we can see them now too | 09:26 |
| quiquell | sshnaidm|rover: where ? | 09:27 |
| sshnaidm|rover | quiquell, in grafana | 09:27 |
| quiquell | sshnaidm|rover: We get the counts but not the names of it | 09:27 |
| sshnaidm|rover | quiquell, seeing one individual stack won't help much and will overload db | 09:27 |
| sshnaidm|rover | quiquell, I don't think we need so detailed.. | 09:27 |
| quiquell | sshnaidm|rover: ok, let's just count, if wee need the info we can go back and add it | 09:28 |
| quiquell | sshnaidm|rover: btw, can we remove the STACK_DELETED from the old_stacks ? | 09:28 |
| sshnaidm|rover | quiquell, only by special treatment, but I'd like not to do it, it's a problem, we don't need to forget about it | 09:30 |
| sshnaidm|rover | quiquell, let's increase alarm to >1 | 09:30 |
| sshnaidm|rover | quiquell, it'll be still on graph, but won't alarm | 09:30 |
| quiquell | sshnaidm|rover: Ok, also has increase to 30m the time window | 09:31 |
| quiquell | sshnaidm|rover: To remove the fail NoData alerts | 09:31 |
| sshnaidm|rover | ok | 09:31 |
| quiquell | sshnaidm|rover: btw, we have to start to think on moving it elsewhere | 09:33 |
| sshnaidm|rover | quiquell, yeah, will try again to talk on #rdo.. | 09:34 |
| quiquell | sshnaidm|rover: Maybe for now moving it to tripleo-ci tenant | 09:35 |
| sshnaidm|rover | if not, maybe we can host on openshift, trown|outtypewww will help :) | 09:35 |
| quiquell | sshnaidm|rover: Then using triple-ci influxdb | 09:35 |
| quiquell | sshnaidm|rover: And later use rdo grafana with grafyaml (I have doubts about grafyaml) | 09:35 |
| sshnaidm|rover | quiquell, we don't have tripleo-ci influxdb | 09:35 |
| sshnaidm|rover | quiquell, I mean it's in rdo-infra, not in our tenant | 09:36 |
| quiquell | sshnaidm|rover: haha No problem on start playing with opensthift | 09:36 |
| quiquell | sshnaidm|rover: But we can access to it from our tenant | 09:36 |
| quiquell | sshnaidm|rover: Moving things step by step | 09:36 |
| sshnaidm|rover | quiquell, agree | 09:36 |
| quiquell | sshnaidm|rover: The easier is influxdb | 09:36 |
| quiquell | sshnaidm|rover: Just a mather of changing telegraf and datasouces at grafana | 09:36 |
| quiquell | s/mather/matter/ | 09:36 |
| quiquell | panda: About sprint16, do we have to convert emit_releases_file into a ansible module ? | 09:45 |
| panda | quiquell: yes, but I'm not surewe can do it in the next sprint | 09:47 |
| quiquell | panda: sprint16 is not about convert toci to ansible ? | 09:48 |
| quiquell | panda: To integrate with zuulv3 ' | 09:48 |
| panda | quiquell: sprint16 is about bringing tripleo CI a step closer to how zuulv3 support | 09:51 |
| panda | s/how/what | 09:52 |
| panda | quiquell: there's a lot to do to make this possible, and we need to choose a sustainable path | 09:52 |
| panda | quiquell: so, I can see in the end the python script will become a module, but if we want to do this as next step, I'm not sure. | 09:54 |
| chkumar|ruck | sshnaidm|rover: http://38.145.34.55/ if we go to promotion url, for each release there is a <release>.log but it is queens it is not there | 09:55 |
| chkumar|ruck | sshnaidm|rover: http://38.145.34.55/queens.log | 09:55 |
| quiquell | panda: So first we do like the low hanging fruit stuff ? | 09:56 |
| panda | quiquell: first we define a path | 09:57 |
| panda | quiquell: wnat to chat ? | 09:58 |
| *** jfrancoa has quit IRC | 09:58 | |
| quiquell | panda: Think so, or maybe understand where we are now from the previous sprint | 09:58 |
| quiquell | panda: Like like a converted job and similar | 09:58 |
| panda | quiquell: ok ok, sure sure | 09:59 |
| panda | quiquell: in my channel in my channel | 09:59 |
| *** holser_ has quit IRC | 09:59 | |
| sshnaidm|rover | chkumar|ruck, hmm... looking | 10:00 |
| *** jfrancoa has joined #oooq | 10:01 | |
| *** jaganathan has quit IRC | 10:02 | |
| *** holser_ has joined #oooq | 10:05 | |
| sshnaidm|rover | quiquell, do we still run promoter in tmux session? | 10:07 |
| quiquell | sshnaidm|rover: Nope, it's systemd now | 10:08 |
| quiquell | sudo service dlrn-promoter start/stop .. | 10:08 |
| sshnaidm|rover | quiquell, was there change in ci-scripts repo? | 10:08 |
| quiquell | sshnaidm|rover: just the requirements.txt | 10:09 |
| quiquell | and refresh | 10:10 |
| quiquell | from repo with the unit test and configparser | 10:10 |
| sshnaidm|rover | quiquell, why do we run telegraf on promoter..? | 10:13 |
| quiquell | sshnaidm|rover: To get the alarms in case promoter doesn't run | 10:13 |
| quiquell | sshnaidm|rover: http://38.145.34.131:3000/d/pgdr_WVmk/cockpit?orgId=1&panelId=130&fullscreen&from=1530526455445&to=1530699255445&var-launchpad_tags=alert&var-promotion_names=current-tripleo&var-promotion_names=current-tripleo-rdo&var-promotion_names=current-tripleo-rdo-testing&var-releases=master&var-releases=queens&var-releases=pike&var-releases=ocata | 10:14 |
| sshnaidm|rover | quiquell, can you please fix your commit? https://github.com/rdo-infra/ci-config/commit/677be5713b70112bc97dcb8cb9948cd8cda66c5a | 10:15 |
| sshnaidm|rover | quiquell, "service" should be with colon | 10:15 |
| *** jaganathan has joined #oooq | 10:15 | |
| *** holser_ has quit IRC | 10:15 | |
| sshnaidm|rover | quiquell, we need some ansible lint job there to cover it.. | 10:15 |
| chkumar|ruck | sshnaidm|rover: quiquell https://review.rdoproject.org/r/#/c/14598/ | 10:17 |
| *** holser_ has joined #oooq | 10:17 | |
| sshnaidm|rover | chkumar|ruck, did you talk about ImportError: No module named configparser errors? | 10:22 |
| quiquell | sshnaidm|rover, chkumar|ruck: need a fiew minutes | 10:22 |
| chkumar|ruck | sshnaidm|rover: in the mroning ykarel noticed promoter script was not working, quiquell found that it was import error issue | 10:23 |
| chkumar|ruck | sshnaidm|rover: https://review.rdoproject.org/r/#/c/14594/ | 10:23 |
| sshnaidm|rover | chkumar|ruck, yeah, also there is different issue with queens | 10:23 |
| sshnaidm|rover | quiquell, did you modify manually ci-scripts/container-push/container-push.yml and ci-scripts/dlrnapi_promoter/requirements.txt on promoter? | 10:24 |
| quiquell | requirements.txt yes, container-push.yml not | 10:25 |
| quiquell | Don't know who changeed container-push.yml | 10:25 |
| quiquell | sshnaidm|rover: the requirements.txt is aalready merge in master | 10:27 |
| quiquell | you can checkout that from master | 10:27 |
| sshnaidm|rover | quiquell, please, try to avoid in any way to change files manually | 10:28 |
| quiquell | sshnaidm|rover: Just did with requirement.txt to have queens promotion | 10:28 |
| sshnaidm|rover | now we don't know who change container file and why | 10:28 |
| chkumar|ruck | sshnaidm|rover: quiquell in last 2 months https://github.com/rdo-infra/ci-config/commit/f801e5c6d026944cd295cde9f41d9ae8bf7eec38 | 10:28 |
| quiquell | sshnaidm|rover: not idea on who did, asked Wes he didn't know either | 10:28 |
| chkumar|ruck | https://github.com/rdo-infra/ci-config/commit/99c64836ea50c1f3c3aad8e96d7fba3978fa1cca | 10:29 |
| sshnaidm|rover | quiquell, in this case you'd better to create a patch in ci-config repo that updates it, we have ansible running every 5 mins there | 10:29 |
| sshnaidm|rover | if we do infrastructure-as-code, but still manually change files, we did nothing | 10:29 |
| quiquell | sshnaidm|rover: agre, will do | 10:29 |
| sshnaidm|rover | quiquell, who was ruck/rover before you? | 10:30 |
| quiquell | rlandy and arx I think | 10:30 |
| *** udesale__ has quit IRC | 10:34 | |
| sshnaidm|rover | well, last change was in 2018-07-01 22:31:47.. | 10:34 |
| sshnaidm|rover | ok, seems like I just checkout it from repo.. | 10:34 |
| sshnaidm|rover | panda, weshay did you make some changes to ci-scripts/container-push/container-push.yml on promter server recently? | 10:35 |
| chkumar|ruck | sshnaidm|rover: what to do with the gate jobs failing with timed out? | 10:39 |
| sshnaidm|rover | chkumar|ruck, well, not much to do right now | 10:39 |
| chkumar|ruck | sshnaidm|rover: ack! | 10:39 |
| sshnaidm|rover | chkumar|ruck, I'm working on ara for them, it might help to discover longest parts of deployments | 10:40 |
| chkumar|ruck | arxcruz: hey | 10:40 |
| sshnaidm|rover | chkumar|ruck, so just let's keep an eye and maybe will discover some pattern | 10:40 |
| chkumar|ruck | sshnaidm|rover: sure | 10:40 |
| arxcruz | chkumar|ruck: hello | 10:40 |
| chkumar|ruck | arxcruz: you were working on a FS where we will run tempest tests without skip list | 10:40 |
| chkumar|ruck | na | 10:40 |
| arxcruz | chkumar|ruck: yes | 10:41 |
| arxcruz | i think was 55 | 10:41 |
| arxcruz | need to check | 10:41 |
| chkumar|ruck | arxcruz: it is the refstack one | 10:41 |
| arxcruz | or 48 | 10:41 |
| arxcruz | chkumar|ruck: just a sec, let me check | 10:41 |
| chkumar|ruck | arxcruz: checking | 10:41 |
| arxcruz | chkumar|ruck: yup, fs48 | 10:43 |
| *** jaganathan has quit IRC | 10:44 | |
| *** quiquell is now known as quiquell|mtg | 10:50 | |
| *** sanjayu__ has quit IRC | 10:53 | |
| arxcruz | sshnaidm|rover: is sova data being updated? | 10:56 |
| sshnaidm|rover | arxcruz, not for rdo cloud | 10:56 |
| arxcruz | i see | 10:56 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container @ (1 more message) | 10:57 |
| *** dtantsur|afk is now known as dtantsur | 11:10 | |
| *** quiquell|mtg is now known as quiquell | 11:35 | |
| panda | lucasagomes: any pointers on the failing scenario ? I see that we cant ping the floating ip of the test instance | 11:36 |
| chkumar|ruck | sshnaidm|rover: it is something new cames up http://logs.openstack.org/91/564291/15/check/tripleo-ci-centos-7-scenario003-multinode-oooq/f44bc41/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-04_09_39_40 | 11:38 |
| chkumar|ruck | on stable/ocata noop jobs | 11:38 |
| *** udesale__ has joined #oooq | 11:40 | |
| *** udesale has joined #oooq | 11:46 | |
| *** udesale__ has quit IRC | 11:47 | |
| *** ratailor has quit IRC | 11:51 | |
| *** quiquell is now known as quiquell|lunch | 12:03 | |
| lucasagomes | panda, yeah, I'm wondering if the problem is the same as we saw here: https://mail.openvswitch.org/pipermail/ovs-dev/2018-June/348812.html | 12:04 |
| lucasagomes | panda, I've tested the fix proposed in OVS but it's nor merged yet, I wonder if that's the same problem. We don't have an env to troubleshoot do we ? | 12:04 |
| lucasagomes | (the link to the patch with the fix is here https://mail.openvswitch.org/pipermail/ovs-dev/2018-June/348818.html) | 12:05 |
| panda | lucasagomes: we were able to reproduce the rpblem witht he reproducer script | 12:05 |
| chkumar|ruck | %gatestatus | 12:06 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq- (1 more message) | 12:06 |
| quiquell|lunch | sshnaidm|rover: Going to move rdo scripts of RR dashboard to zuulv3 | 12:06 |
| *** amoralej is now known as amoralej|lunch | 12:06 | |
| quiquell|lunch | all jobs are there now | 12:06 |
| sshnaidm|rover | quiquell|lunch, ack | 12:06 |
| sshnaidm|rover | quiquell|lunch, also promotions? | 12:06 |
| quiquell|lunch | sshnaidm|rover: Sorry about the promoter btw :-/ | 12:07 |
| sshnaidm|rover | quiquell|lunch, no worries | 12:07 |
| quiquell|lunch | sshnaidm|rover: periodics are there too I think | 12:07 |
| quiquell|lunch | Going to lunch now | 12:07 |
| sshnaidm|rover | quiquell|lunch, I don't see promotion jobs there.. | 12:07 |
| lucasagomes | panda, right yeah I can try that too. Cause I can't find anything specific in the logs | 12:08 |
| sshnaidm|rover | quiquell|lunch, there is no even pipeline openstack-periodic, I think Paul didn't move them yet | 12:08 |
| lucasagomes | panda, talking about the logs would be nice as well if we could collect the ovsdb's after the tests runs | 12:09 |
| panda | lucasagomes: are you seing this in any other place ? | 12:09 |
| lucasagomes | panda, we saw something similar in one of the tempest recently | 12:09 |
| lucasagomes | which is what daniel pointed out in that email | 12:09 |
| lucasagomes | in the same thread someone pointed to a patch that addressed that problem (I tested and it worked) | 12:10 |
| panda | lucasagomes: http://logs.openstack.org/53/579653/3/check/tripleo-ci-centos-7-scenario007-multinode-oooq-container/90c84b2/logs/undercloud/var/log/extra/network-bridges.gz | 12:10 |
| panda | lucasagomes: I think we are dumping something here, not sure if we are dumping ovsdb | 12:10 |
| lucasagomes | panda, no it's not there, in networking-ovn we collect the dbs here: http://logs.openstack.org/43/574743/3/check/networking-ovn-tempest-dsvm-ovs-release/998fb10/logs/ovs_dbs/ | 12:11 |
| lucasagomes | but it's just a enhancement | 12:11 |
| lucasagomes | it has nothing to do with the failure | 12:12 |
| panda | lucasagomes: ok, I'll try to reproduce this somewhere that can be reached by you too | 12:22 |
| panda | lucasagomes: doesnt' seem easy to tst this in a TripleO run | 12:23 |
| panda | the patch is not even in gerrit :( | 12:23 |
| *** saneax has joined #oooq | 12:24 | |
| sshnaidm|rover | quiquell|lunch, as I understood we stopped to use venv for promoter script? https://github.com/rdo-infra/ci-config/blob/b319c0b98c166ee799f598b93ca439f80a770526/ci-scripts/infra-setup/roles/promoter/tasks/main.yml#L159-L162 | 12:26 |
| panda | lucasagomes: can you comment here https://bugs.launchpad.net/tripleo/+bug/1780082 what commands are used to correctly gather ovsdb dump for OVN debugging ? | 12:28 |
| openstack | Launchpad bug 1780082 in tripleo "quickstart log collection does not collect OVN ovsdb dump" [Medium,Triaged] | 12:28 |
| *** saneax has quit IRC | 12:28 | |
| *** saneax has joined #oooq | 12:28 | |
| chkumar|ruck | sshnaidm|rover: weshay can we promote pike by disabling fs20 because of this fix https://review.openstack.org/#/c/579426/ ? | 12:30 |
| chkumar|ruck | we know this review fixes the tests | 12:30 |
| ykarel | and upstream queue is in bad shape currently, so that merge would take time | 12:31 |
| sshnaidm|rover | chkumar|ruck, so if it fixes, we'll see it in next run, right? | 12:31 |
| chkumar|ruck | sshnaidm|rover: yup | 12:31 |
| chkumar|ruck | sshnaidm|rover: but the patch is blocked on gates due to timed out | 12:32 |
| sshnaidm|rover | chkumar|ruck, well, anyway next run is tonight for pike, so we'll see later, if it's still not merged, maybe we'll do it | 12:33 |
| sshnaidm|rover | chkumar|ruck, does it solve problem for queens too? I see it's blocked by 020 job | 12:40 |
| chkumar|ruck | sshnaidm|rover: yup | 12:41 |
| chkumar|ruck | sshnaidm|rover: https://review.rdoproject.org/r/#/c/14521 | 12:41 |
| sshnaidm|rover | chkumar|ruck, ok, so I'll make a patch to unblock both branches.. | 12:41 |
| chkumar|ruck | sshnaidm|rover: https://review.rdoproject.org/r/14607 | 12:41 |
| chkumar|ruck | for pike | 12:41 |
| sshnaidm|rover | ykarel, chkumar|ruck hmm... but why queens promotion does still want 020 to pass? from tripleo-ci-testing to current-tripleo, missing successful jobs: [u'periodic-ovb-1ctlr_1comp-featureset020'] | 12:43 |
| sshnaidm|rover | http://38.145.34.55/queens.log | 12:43 |
| ykarel | i think we removed it from criteria | 12:44 |
| ykarel | checking, is promoter has old copy? | 12:44 |
| ykarel | sshnaidm|rover, that's also duplicated :( | 12:45 |
| ykarel | https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/queens.ini#L18 | 12:45 |
| sshnaidm|rover | ykarel, oh, I see | 12:46 |
| marios | sshnaidm|rover: updated when you have a chance thanks for review https://review.openstack.org/#/c/578081/9/roles/create-reproducer-script/templates/reproducer-quickstart.sh.j2 | 12:46 |
| arxcruz | weshay: chkumar|ruck kopecmartin I'm assuming there will not have the sprint plan today right ? | 12:50 |
| panda | arxcruz: you're missing the PM. your UA is rucking for the first time, your TC is on PTO and the rest of the team will be for the remainder of the sprint | 12:51 |
| *** quiquell|lunch is now known as quiquell | 12:54 | |
| arxcruz | panda: okay, just wanted to make sure :) | 12:55 |
| arxcruz | my calendar is a bit crazy with the timezone difference | 12:55 |
| quiquell | sshnaidm|rover: it's using venv | 12:56 |
| chkumar|ruck | sshnaidm|rover: ykarel let's promote the pike | 12:56 |
| ykarel | ack | 12:57 |
| sshnaidm|rover | quiquell, I don't see it.. where | 12:57 |
| quiquell | sshnaidm|rover: source ~/promoter_venv/bin/activate | 12:57 |
| chkumar|ruck | sshnaidm|rover: weshay needs +2 https://review.rdoproject.org/r/14598 | 12:57 |
| quiquell | sshnaidm|rover: wait... https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/dlrn-promoter.sh#L4 | 12:57 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq- (1 more message) | 12:57 |
| chkumar|ruck | quiquell: I have few more ideas for ruck-rover bot | 12:58 |
| sshnaidm|rover | quiquell, uh, now see it. sorry, need more coffee | 12:58 |
| chkumar|ruck | quiquell: like finding failed jobs and how many times it failed in a day | 12:58 |
| chkumar|ruck | show me logs for a particular failed jobs | 12:59 |
| quiquell | chkumar|ruck: you have that in the dashboard | 12:59 |
| sshnaidm|rover | chkumar|ruck, it could be done with variables in a graph | 12:59 |
| sshnaidm|rover | quiquell, this bar chart with jobs we need to do with variable "job_name" | 12:59 |
| quiquell | chkumar|ruck: Doing exploration with a IRC bot is not the best way | 13:00 |
| kopecmartin | arxcruz, I have labeled all cards mentioned in the planning etherpad as Sprint 16 Tempest | 13:00 |
| sshnaidm|rover | quiquell, chkumar|ruck then we can see the graph for one (or multiple) job only | 13:00 |
| quiquell | sshnaidm|rover: more than variables, using ad-hoc grafan varible | 13:00 |
| quiquell | look | 13:00 |
| arxcruz | kopecmartin: ack | 13:00 |
| quiquell | http://38.145.34.131:3000/d/2kHMNHvik/exploration?orgId=1 | 13:01 |
| kopecmartin | arxcruz, we're just missing epic card | 13:01 |
| chkumar|ruck | arxcruz: kopecmartin I am creating the epic card | 13:01 |
| quiquell | look at the last one | 13:01 |
| quiquell | in the influxdb_filter you can put whatever field you have at your influxdb lines | 13:01 |
| kopecmartin | chkumar|ruck, great then | 13:01 |
| marios | weshay: panda no call? | 13:01 |
| sshnaidm|rover | quiquell, yeah, but I'm talking about this one: http://38.145.34.131:3000/d/pgdr_WVmk/cockpit?orgId=1&panelId=80&fullscreen&from=1530536511291&to=1530709311291&var-launchpad_tags=alert&var-promotion_names=current-tripleo&var-promotion_names=current-tripleo-rdo&var-promotion_names=current-tripleo-rdo-testing&var-releases=master&var-releases=queens&var-releases=pike&var-releases=ocata | 13:02 |
| quiquell | sshnaidm|rover: We can add the ad-hoc filter to the cockpit too | 13:02 |
| quiquell | It will apply to all the graphs there | 13:03 |
| *** amoralej|lunch is now known as amoralej | 13:03 | |
| quiquell | sshnaidm|rover: reload the panel you paste me now | 13:04 |
| sshnaidm|rover | quiquell, mm.. not sure we want to apply to all graphs though.. need to play with it | 13:04 |
| quiquell | sshnaidm|rover: You can now select all the fields you want | 13:04 |
| quiquell | sshnaidm|rover: It's not permament just per user | 13:04 |
| quiquell | by default it's not filtered | 13:04 |
| quiquell | ad-hoc are very powerful | 13:04 |
| chkumar|ruck | arxcruz: kopecmartin https://trello.com/c/1v1dYRnP/844-closing-python-tempestconf-items-out | 13:06 |
| sshnaidm|rover | quiquell, well, you're right, it's much better | 13:06 |
| rfolco | July 4th today | 13:06 |
| sshnaidm|rover | quiquell, we can see also this job in failed and failed-gates.. | 13:06 |
| quiquell | sshnaidm|rover: It's really what you need for exploration | 13:06 |
| rfolco | I don't think US folks will join | 13:06 |
| sshnaidm|rover | quiquell, cool! great, let's save it! | 13:06 |
| quiquell | sshnaidm|rover: Sure | 13:06 |
| sshnaidm|rover | chkumar|ruck, you should try it ^^ | 13:07 |
| sshnaidm|rover | quiquell, maybe also will be useful - to have table with job name and amount of failures, sorted by fails | 13:08 |
| sshnaidm|rover | quiquell, so we can have most problematic jobs.. | 13:08 |
| chkumar|ruck | kopecmartin: arxcruz please add the related sprint 16 cards to epic | 13:08 |
| quiquell | sshnaidm|rover: That's why there is a exploration dashboard | 13:08 |
| sshnaidm|rover | quiquell, yep | 13:08 |
| quiquell | sshnaidm|rover: https://review.rdoproject.org/r/14610 | 13:08 |
| chkumar|ruck | sshnaidm|rover: will i file a bug for ocata failure http://logs.openstack.org/91/564291/15/check/tripleo-ci-centos-7-scenario003-multinode-oooq/f44bc41/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-04_09_39_42 ? | 13:11 |
| sshnaidm|rover | chkumar|ruck, the bug is "Timed out waiting for messages ..." line: http://logs.openstack.org/91/564291/15/check/tripleo-ci-centos-7-scenario003-multinode-oooq/f44bc41/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-04_09_46_38 | 13:14 |
| sshnaidm|rover | quiquell, so, how can we do table of most 10 failing jobs for example? | 13:16 |
| quiquell | Let me check if we can use count function in ad-hoc | 13:17 |
| quiquell | sshnaidm|rover: Trying to do a frequency table | 13:23 |
| quiquell | give me amin | 13:23 |
| quiquell | sshnaidm|rover: Check exploration dashboard now | 13:27 |
| quiquell | You have a frequency table | 13:27 |
| quiquell | you can short the table and add a filter with passed = False | 13:27 |
| sshnaidm|rover | quiquell, wow.. is it really 330 failures in last 3 days of containers-multinode?? | 13:32 |
| quiquell | sshnaidm|rover: Feels like too much... | 13:33 |
| quiquell | sshnaidm|rover: Going to remove the filter from table so everyone can change it with the global | 13:34 |
| sshnaidm|rover | quiquell, as I see from cockpit graph it should be about 20 | 13:35 |
| sshnaidm|rover | quiquell, maybe you need to add "when passed = false" there | 13:36 |
| quiquell | sshnaidm|rover: You can add this to the filter | 13:36 |
| quiquell | the exploration board is open | 13:36 |
| quiquell | by default it show you everything | 13:36 |
| quiquell | You play with the influxdb filte r | 13:37 |
| quiquell | sshnaidm|rover: So if I do the following | 13:37 |
| quiquell | http://38.145.34.131:3000/d/2kHMNHvik/exploration?orgId=1&var-influxdb_filter=passed%7C%3D%7CFalse&var-influxdb_filter=job_name%7C%3D%7Ctripleo-ci-centos-7-containers-multinode | 13:37 |
| quiquell | I get 32 | 13:37 |
| quiquell | Wich feels ok for 7 days | 13:37 |
| quiquell | It's super powerful this ad-hoc stuff | 13:38 |
| sshnaidm|rover | quiquell, I see.. but maybe would fine to have some graphs predefined, just to save time | 13:39 |
| quiquell | sshnaidm|rover: not so much time... what we can do is have queries perdefined | 13:39 |
| sshnaidm|rover | quiquell, I think we need to think about a documentation or tutorial :) | 13:39 |
| quiquell | or link | 13:39 |
| quiquell | the query is in the url, we can have links prefedined | 13:39 |
| quiquell | sshnaidm|rover: ack, I think we have to stop adding features, and productify | 13:40 |
| quiquell | sshnaidm|rover: btw, do you know how to make the dashboard apperas as selected items in the top left ? | 13:41 |
| sshnaidm|rover | quiquell, yeah, not everybody is aware of all these features | 13:41 |
| sshnaidm|rover | quiquell, not sure I understand | 13:41 |
| quiquell | sshnaidm|rover: me neither, I don't understand myself :-) | 13:41 |
| quiquell | sshnaidm|rover: Changint issues, I have do the ara-report for the undercloud | 13:42 |
| quiquell | sshnaidm|rover: And discover an issue at ara + ansible.cfg | 13:42 |
| quiquell | sshnaidm|rover: Will comment at your OC ara WIP patch | 13:42 |
| chkumar|ruck | sshnaidm|rover: first bug filed https://bugs.launchpad.net/tripleo/+bug/1780091 | 13:43 |
| openstack | Launchpad bug 1780091 in tripleo "containerized undercloud deployment failed on periodic jobs" [Undecided,New] | 13:43 |
| quiquell | chkumar|ruck: \o/ !!! | 13:43 |
| sshnaidm|rover | quiquell, currently I'm working on getting all ara undercloud to influxdb | 13:43 |
| sshnaidm|rover | quiquell, but ara with OC doesn't work well :( | 13:43 |
| quiquell | sshnaidm|rover: that's super cool, one influxdb line per task ? | 13:44 |
| sshnaidm|rover | quiquell, no, I think all tasks with their lengths in one line, we need to tie them to the job | 13:44 |
| sshnaidm|rover | quiquell, I think to take 15 longest of kind of | 13:44 |
| quiquell | sshnaidm|rover: Humm sure we don't want to do that at filtering ? | 13:45 |
| sshnaidm|rover | quiquell, and then we'll need to do graph for each of them.. *phew | 13:45 |
| quiquell | sshnaidm|rover: line per task is too much ? | 13:45 |
| sshnaidm|rover | quiquell, well, one job has a few tasks with lengths, why to separate them | 13:45 |
| quiquell | sshnaidm|rover: Depending on th eplaybook or position they can take longer | 13:46 |
| quiquell | sshnaidm|rover: we can count the frequency of them too | 13:46 |
| sshnaidm|rover | quiquell, frequency? | 13:46 |
| quiquell | if we put really raw data into influxdb, we will be able to count whatever we want | 13:47 |
| quiquell | sshnaidm|rover: The more we groom the date the lest we can do later on | 13:47 |
| quiquell | s/lest/less/ | 13:47 |
| sshnaidm|rover | quiquell, it will be raw data - job with tasks | 13:47 |
| quiquell | sshnaidm|rover: ack | 13:47 |
| sshnaidm|rover | quiquell, we need to identify in which jobs same tasks accidentally take longer time | 13:47 |
| quiquell | sshnaidm|rover: just one influxdbline per task can do that too and more stuff | 13:48 |
| sshnaidm|rover | quiquell, well, let me finish the tasks extraction part and then we'll see how to parse it in influx already.. | 13:48 |
| quiquell | sshnaidm|rover: Yep | 13:48 |
| quiquell | sshnaidm|rover: tuple for the line can be job,playbook,task duration | 13:49 |
| quiquell | From there we can do all the counts we want | 13:49 |
| quiquell | Have to leave earlier today | 13:49 |
| *** quiquell is now known as quiquell|off | 13:49 | |
| *** agopi has joined #oooq | 13:50 | |
| sshnaidm|rover | quiquell|off, sure | 13:50 |
| *** ykarel is now known as ykarel|away | 13:55 | |
| *** skramaja_ has quit IRC | 13:58 | |
| *** ykarel|away has quit IRC | 14:01 | |
| *** sshnaidm|rover is now known as sshnaidm|afk | 14:11 | |
| *** ykarel|away has joined #oooq | 14:31 | |
| *** ykarel|away is now known as ykarel | 14:32 | |
| *** bogdando has quit IRC | 14:40 | |
| chkumar|ruck | sshnaidm|afk: now scenario 001 and 002 is timing out on tempest and for 003 still on overcloud deploy | 14:51 |
| chkumar|ruck | sshnaidm|afk: on rdocloud node status rdocloud server delete Error state is 6, do we need to do something there? | 14:57 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq- (1 more message) | 14:58 |
| *** pliu_ has quit IRC | 15:04 | |
| ykarel | chkumar|ruck, pike promoted, and queens promotion started | 15:15 |
| chkumar|ruck | weshay: sshnaidm|afk ^^ sweet | 15:16 |
| *** sshnaidm|afk is now known as sshnaidm|rover | 15:38 | |
| *** udesale_ has joined #oooq | 15:40 | |
| *** udesale has quit IRC | 15:43 | |
| *** sanjay__u has quit IRC | 15:51 | |
| *** yolanda has quit IRC | 15:54 | |
| *** ykarel has quit IRC | 16:08 | |
| *** gkadam__ has quit IRC | 16:16 | |
| amoralej | could i get reviews on https://review.openstack.org/#/c/579888/ ? | 16:22 |
| amoralej | i need it for pike job in rdoinfo gate | 16:22 |
| *** tesseract has quit IRC | 16:30 | |
| *** ykarel has joined #oooq | 16:32 | |
| *** florianf has quit IRC | 16:38 | |
| *** ykarel has quit IRC | 16:39 | |
| *** udesale_ has quit IRC | 16:40 | |
| *** kopecmartin has quit IRC | 16:48 | |
| *** dtantsur is now known as dtantsur|afk | 16:56 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq- (1 more message) | 16:58 |
| *** amoralej is now known as amoralej|off | 17:11 | |
| chkumar|ruck | %gatestatus | 17:17 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq- (1 more message) | 17:17 |
| *** agopi has quit IRC | 18:34 | |
| *** jfrancoa has quit IRC | 18:39 | |
| *** agopi has joined #oooq | 18:53 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq- (1 more message) | 18:58 |
| *** agopi has quit IRC | 20:03 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ (1 more message) | 20:58 |
| *** holser_ has quit IRC | 21:23 | |
| *** Goneri has quit IRC | 21:35 | |
| *** holser_ has joined #oooq | 21:53 | |
| sshnaidm|rover | %gatestatus | 22:28 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ (1 more message) | 22:28 |
| *** holser_ has quit IRC | 22:48 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq-container @ https://review.openstack.org/560445, stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ (1 more message) | 22:58 |
| *** agopi has joined #oooq | 23:18 | |
| *** tosky has quit IRC | 23:55 | |
| *** matbu has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!