Wednesday, 2019-07-10

*** slaweq has joined #oooq00:08
*** slaweq has quit IRC00:13
*** rlandy has quit IRC00:25
*** altlogbot_2 has joined #oooq00:28
*** dsneddon has joined #oooq00:33
*** zbr has quit IRC00:34
*** dsneddon has quit IRC00:37
*** altlogbot_2 has quit IRC00:37
*** zbr has joined #oooq00:43
*** altlogbot_2 has joined #oooq01:06
*** altlogbot_2 has quit IRC01:15
*** apetrich has quit IRC01:58
*** vinaykns has quit IRC02:08
*** dsneddon has joined #oooq02:17
*** altlogbot_1 has joined #oooq02:18
*** irclogbot_1 has joined #oooq02:18
*** altlogbot_1 has quit IRC02:25
*** irclogbot_1 has quit IRC02:26
*** dsneddon has quit IRC02:54
*** irclogbot_1 has joined #oooq04:06
*** irclogbot_1 has quit IRC04:12
*** altlogbot_0 has joined #oooq04:12
*** jschlueter has quit IRC04:13
*** altlogbot_0 has quit IRC04:17
*** udesale has joined #oooq04:27
*** ykarel has joined #oooq04:47
*** altlogbot_2 has joined #oooq05:02
*** irclogbot_3 has joined #oooq05:06
*** jschlueter has joined #oooq05:07
*** ratailor has joined #oooq05:11
*** raukadah is now known as chandankumar05:14
*** sanjayu_ has joined #oooq05:19
*** marios has joined #oooq05:20
*** mjturek has quit IRC05:20
*** mjturek has joined #oooq05:21
*** altlogbot_2 has quit IRC05:21
*** irclogbot_3 has quit IRC05:22
*** jfrancoa has joined #oooq05:27
*** ratailor has quit IRC05:30
*** skramaja has joined #oooq05:30
*** ykarel_ has joined #oooq05:31
*** ratailor has joined #oooq05:32
*** jfrancoa has quit IRC05:33
*** ykarel has quit IRC05:33
*** sanjayu_ has quit IRC05:41
*** saneax has joined #oooq05:47
*** jfrancoa has joined #oooq05:47
*** mjturek has quit IRC05:50
*** mjturek has joined #oooq05:51
*** marios has quit IRC06:25
*** marios has joined #oooq06:27
jfrancoamarios: good morning sir!hey, maybe you know it, what's the status of the upstream RHEL7 third party jobs?06:48
*** dsneddon has joined #oooq06:50
mariosjfrancoa: morning you mean rdo jobs/periodics? which ones? i am not ruck/rovering so not really looking there06:51
mariosjfrancoa: sshnaidm|afk is ruck-rovering this sprint lemme find the etherpad maybe its known thing06:52
mariosjfrancoa: oh do you mean rhel *8* jobs?06:52
jfrancoamarios: exactly06:52
mariosjfrancoa: 'working on it' its the main focus for this sprint06:53
jfrancoamarios: I've heard they were on the works, but I lost track on what is its status06:53
mariosjfrancoa: sec finding pointer for you06:53
mariosjfrancoa: 'almost there' like we have a nodepool node and almost building containers ... standalone job/deployment is currently waiting for that (containers)06:53
jfrancoamarios: oh cool! it would be awesome to have some job to cover the upgrade there (you know, leapp only works on RHEL)06:53
mariosjfrancoa: https://tree.taiga.io/project/tripleo-ci-board/taskboard/unified-sprint-12   along the left hand side the stories 1127 1145 956 1100 1101 etc are all the rhel 8 stuff06:54
*** slaweq has joined #oooq06:54
mariosjfrancoa: hmmm well06:54
mariosjfrancoa: standalone upgrade easy but that might not cover what you want/leap06:54
mariosjfrancoa: like would it have to be multinode?06:54
*** dsneddon has quit IRC06:55
mariosjfrancoa: but anyway, why don't we do a sync, either your community call on friday or ours next tuesday for some initial discussions/ideas about  what we might approximate there06:55
mariosjfrancoa: first you have to tell us the latest version of the 8 upgrade ;)06:55
jfrancoamarios: well, with a standalone we could at lest cover the undercloud upgrade...but yes, the great thing would be a multinode (I guess that might take some more time, right?)06:56
mariosjfrancoa: yeah more resources but since its 3 party we should be fine to do what we want there06:56
jfrancoamarios: ack, that's a good idea. Lets' use next Tuesday's call (I'm flying on Friday), I'll send an invite to the rhos-upgrades team. do you still use https://etherpad.openstack.org/p/tripleo-meeting-items for tracking meeting items?06:58
jfrancoamarios: and the time? what time was at? ( I have this bj link from a placeholder I added in my calendar https://bluejeans.com/7050859455 )06:59
mariosjfrancoa: its now "half hour before tripleo weekly @ https://bluejeans.com/5878458097"07:01
*** tosky has joined #oooq07:02
mariosnf]07:02
*** altlogbot_0 has joined #oooq07:02
mariosjfrancoa: should be on rhos meetings calendar too07:02
jfrancoamarios: ohh thanks a lot I'll look for it then and add the topic into the etherpad07:03
*** altlogbot_0 has quit IRC07:08
*** dsneddon has joined #oooq07:11
*** holser_ has joined #oooq07:13
*** holser_ has quit IRC07:13
*** holser_ has joined #oooq07:14
*** dsneddon has quit IRC07:17
*** amoralej|off is now known as amoralej07:22
*** dtrainor_ has joined #oooq07:31
*** dtrainor has quit IRC07:33
*** ykarel__ has joined #oooq07:34
*** ratailor has quit IRC07:36
*** ykarel_ has quit IRC07:36
*** ratailor has joined #oooq07:37
*** ykarel__ is now known as ykarel07:37
*** irclogbot_1 has joined #oooq07:38
*** ratailor_ has joined #oooq07:39
*** ratailor has quit IRC07:41
*** dsneddon has joined #oooq07:42
*** irclogbot_1 has quit IRC07:44
slaweqarxcruz|rover: hi again, can I ask You once again for help with tobiko and tripleo-quickstart?07:50
slaweqarxcruz|rover: after Your changes in my patch it works better indeed - thx a lot for that :)07:50
slaweqarxcruz|rover: but I also wanted to use this playbook in tripleo-quickstart used locally07:51
slaweqso I was following this guide: https://docs.openstack.org/tripleo-quickstart/2.0.0/working-with-extras.html07:51
slaweqI first deployed oooq with command like:07:51
slaweqarxcruz|rover: ./quickstart.sh --clean --teardown all --tags all --requirements $REQUIREMENTS --no-clone --release master07:52
slaweqarxcruz|rover: and later I wanted to run tobiko.yml playbook on it too with command:07:52
slaweqarxcruz|rover: ./quickstart.sh  --tags all --requirements $REQUIREMENTS --no-clone --release master --playbook tobiko.ym07:53
slaweqbut it is saying me that "no hosts matched" when I want to run tasks from this playbook on "undercloud"07:53
slaweqshould I simply try to run tobiko.yml together with "include: quickstart-extras.yml" in it? and deploy everything from scratch all the time? or maybe is there any other way to do that?07:54
*** bogdando has joined #oooq07:57
*** marios has quit IRC08:04
*** gkadam has joined #oooq08:13
*** ykarel is now known as ykarel|lunch08:15
*** bogdando has quit IRC08:18
*** bogdando has joined #oooq08:18
*** dtantsur|afk is now known as dtantsur08:19
*** derekh has joined #oooq08:20
*** gkadam has quit IRC08:22
*** Goneri has joined #oooq08:42
*** dsneddon has quit IRC08:48
arxcruz|roverslaweq, i know there is, weshay already show me, but i don't remember :/08:52
arxcruz|roverpanda, chandankumar sorry, i have doctor appointment in 20 minutes can we move? I completely forgot about this08:52
slaweqarxcruz|rover: ok, I will try to figure it out somehow :)08:52
pandaarxcruz|rover: 1 hour later pok ?08:53
slaweqthx08:53
chandankumararxcruz|rover: works for me08:53
arxcruz|roverchandankumar, slaweq yup08:53
arxcruz|roverops08:53
arxcruz|roverchandankumar, panda yup08:53
pandaarxcruz|rover: ok08:53
*** bogdando has quit IRC08:53
arxcruz|roverslaweq, after you run tripleo-quickstart, you can use the inventory created and use it to run only tobiko.yml08:53
slaweqarxcruz|rover: yes, I found it but this inventory file contained only localhost defined :/08:54
slaweqand it looks that it's autogenerated when I run quickstart.sh so even if I do some changes it overrides it :/08:54
slaweqI will keep digging into this08:54
*** irclogbot_1 has joined #oooq08:56
*** irclogbot_1 has quit IRC09:02
arxcruz|roversshnaidm|afk https://review.rdoproject.org/r/#/c/21416/ when you have time to review :)09:02
*** ykarel|lunch is now known as ykarel09:03
*** ccamacho has joined #oooq09:03
ykarelslaweq, you need to use -I to retain inventory09:04
ykarelwith quickstart.sh in case u want to reuse inventory or environment created with previous quickstart command09:05
*** altlogbot_2 has joined #oooq09:10
*** altlogbot_2 has quit IRC09:14
*** mjturek has quit IRC09:15
*** mjturek has joined #oooq09:16
*** marios has joined #oooq09:16
*** dsneddon has joined #oooq09:20
*** altlogbot_2 has joined #oooq09:24
*** dsneddon has quit IRC09:25
*** altlogbot_2 has quit IRC09:28
*** altlogbot_2 has joined #oooq09:28
*** mjturek has quit IRC09:29
*** altlogbot_2 has quit IRC09:34
*** ykarel is now known as ykarel|afk09:35
*** irclogbot_1 has joined #oooq09:36
*** irclogbot_1 has quit IRC09:40
*** sshnaidm|afk is now known as sshnaidm|ruck09:42
*** dtrainor has joined #oooq09:43
*** altlogbot_1 has joined #oooq09:44
*** dtrainor_ has quit IRC09:45
chandankumarsshnaidm|ruck: panda https://review.opendev.org/#/c/668994/ it is good to go09:46
*** altlogbot_1 has quit IRC09:50
slaweqykarel|afk: ok, thx for info09:51
*** ykarel|afk is now known as ykarel09:52
*** dsneddon has joined #oooq09:52
sshnaidm|ruckarxcruz|rover, I don't think we need check jobs in grafana tbh. We see them anyway in the patch09:54
*** dsneddon has quit IRC09:57
pandaarxcruz|rover: you back ?09:57
pandaarxcruz|rover: we'll start as soon as you're back09:58
sshnaidm|ruckchandankumar, https://review.opendev.org/#/c/668994/ doesn't make a lot of sense, better to remove all legacy there10:00
sshnaidm|ruckchandankumar, all this trash with te-broker10:00
chandankumarsshnaidm|ruck: ack10:03
chandankumarpanda: bj link for meeting?10:03
arxcruz|roverpanda your bj?10:03
pandachandankumar: arxcruz|rover yes10:04
arxcruz|roverlink10:04
panda349250866910:05
chandankumararxcruz|rover: https://redhat.bluejeans.com/u/gcerami/10:05
pandaseriously guys, a text files with user/id ...10:05
pandaarxcruz|rover: ^10:07
chandankumararxcruz|rover: meeting time10:07
arxcruz|roversshnaidm|ruck fine by me, i remember weshay wanted check as well10:10
sshnaidm|ruckmarios, see also https://review.opendev.org/#/c/66997710:10
mariossshnaidm|ruck: cool. story. bro.10:19
sshnaidm|ruckmarios, am I too verbose? :(10:21
*** irclogbot_3 has joined #oooq10:22
mariossshnaidm|ruck: the opposite :D not verbose enough !10:22
mariossshnaidm|ruck: but that was more in combination with my other comment on that review and the one i made earlier on https://review.opendev.org/#/c/669913 - i.e. about the periodics when/how those run upstream?10:23
*** irclogbot_3 has quit IRC10:26
sshnaidm|ruckmarios, I tried to expand, first commit msg was "jobs" :D10:26
mariossshnaidm|ruck: haha10:27
*** dsneddon has joined #oooq10:27
*** Goneri has quit IRC10:28
*** dsneddon has quit IRC10:32
zbrsshnaidm|ruck: fyi, i am working on making molecule job to run on rdo, so we can use the rhel8 image. my WIP work on that is to assure that we can run it there too, not only upstream.10:36
sshnaidm|ruckzbr, great10:36
zbrthe hubbot just happened to be some already merged code that had molecule tests. -- so a good guineea pig to use for testing.10:37
zbri will ping you when I have them working10:37
*** bogdando has joined #oooq10:43
*** dsneddon has joined #oooq11:04
*** tesseract has joined #oooq11:08
*** dsneddon has quit IRC11:09
zbrdoes any one knows how to deal with: Depsolve Error occured: \n Problem: problem with installed package yum-utils-1.1.31-515.fc28.noarch\n  - package dnf-utils-2.1.5-4.fc28.noarch conflicts with yum-utils provided by yum-utils-1.1.31-515.fc28.noarch\n  - package dnf-utils-2.1.5-4.fc28.noarch conflicts with yum-utils provided by yum-utils-1.1.31-514.fc28.noarch\n  - conflicting requests11:10
zbrwhat is even more interesting is that this was generated by https://review.rdoproject.org/r/#/c/18627/25/bindep.txt11:11
zbrso I have no idea how it did endup matching both11:11
*** dsneddon has joined #oooq11:13
arxcruz|roversshnaidm|ruck yay, we have 3 new bugs, rocky and queens11:13
sshnaidm|ruckarxcruz|rover, cool11:16
arxcruz|roverwhich is weird because it says rocky was promoted, but all the promotion jobs fail11:16
*** apetrich has joined #oooq11:16
sshnaidm|ruckarxcruz|rover, who says?11:17
*** dsneddon has quit IRC11:17
chandankumarsshnaidm|ruck: does in standalone deployment, do we modify the /etc/containers/registeries.conf?11:19
*** dsneddon has joined #oooq11:22
sshnaidm|ruckchandankumar, idk, maybe for podman we do11:24
*** dsneddon has quit IRC11:27
*** udesale has quit IRC11:51
*** udesale has joined #oooq11:52
chandankumarsshnaidm|ruck: https://logs.rdoproject.org/18/21418/6/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/8498d28/job-output.txt.gz#_2019-07-10_06_47_23_50557011:55
chandankumarsshnaidm|ruck: please have a look at this review https://review.rdoproject.org/r/#/c/21418/11:56
arxcruz|roversshnaidm|ruck panda marios can we please, please merge https://review.opendev.org/#/c/618546/ ?11:56
*** rfolco has joined #oooq11:57
sshnaidm|ruckchandankumar, commented11:59
*** dsneddon has joined #oooq11:59
sshnaidm|ruckarxcruz|rover, did you test it and it worked?12:01
arxcruz|roversshnaidm|ruck yup12:02
*** Goneri has joined #oooq12:04
*** amoralej is now known as amoralej|lunch12:04
*** ratailor_ has quit IRC12:07
mariosarxcruz|rover: just readability fix afaics?12:07
arxcruz|rovermarios yup, but poor guy, this patch is from last year12:08
arxcruz|roverand i keep getting email from job runs12:08
rfolcomarios, o/12:16
rfolcomarios, have u seen this before? "No subuid ranges found for user "zuul" in /etc/subuid"12:17
weshayarxcruz|rover hey.. how's the workload atm?12:18
arxcruz|roverweshay which workload ?12:18
arxcruz|roverweshay we have 3 blockers on queens and rocky12:19
weshaygenerally.. you slammed w/ work or doing ok?12:19
arxcruz|roverweshay but master was promoted yesterday12:19
weshayI see I see12:19
arxcruz|roverweshay doing okay so far12:19
weshayarxcruz|rover sshnaidm|ruck was hoping we could read/comment on https://docs.google.com/document/d/1u2q7E6SceTo5AxJf4vr9mZK08iAGOhQNJQXSYW1nIVM/edit#heading=h.5lrjado14k4412:20
arxcruz|roverweshay yeah, i own this to zbr but i did not have time yet, i'll put it on priority for tomorrow12:21
mariosrfolco: not seen that one :/12:21
mariosrfolco: sorry12:21
rfolcomarios, that's ok, trying to reproduce it in quickvm and find a workaround12:22
rfolcothx marios12:22
*** dsneddon has quit IRC12:22
*** rlandy has joined #oooq12:24
*** bogdando has quit IRC12:27
weshaysshnaidm|ruck can you help me get on the hubbot server12:33
*** dsneddon has joined #oooq12:33
*** ykarel is now known as ykarel|afk12:33
sshnaidm|ruckweshay, sure12:33
weshayI just added a floating ip, but still can't ping it.. I tried to ssh to the promoter server and then to the hubbot server via 192.. but no go12:34
weshayperhaps it's fubard12:34
rlandymarios: ping re: images and ovb12:38
sshnaidm|ruckweshay, which user do you use?12:41
sshnaidm|ruckweshay, I'm in12:41
*** dsneddon has quit IRC12:41
sshnaidm|ruckweshay,  use "weshay"12:41
weshaysshnaidm|ruck oh cool.. previously weshay@ and an old key for me was used...   I've been updating nodes as I get to them w/  weshayutin@12:41
weshayand /me gets github key12:41
*** aakarsh has quit IRC12:42
sshnaidm|ruckweshay, you should change user and key here: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/tenant_vars/common.yml#L5112:43
weshayhttps://github.com/weshayutin.keys12:43
weshaysshnaidm|ruck roger that12:43
sshnaidm|ruckweshay, otherwise it will be overridden in next 5 mins12:43
*** tosky__ has joined #oooq12:44
sshnaidm|ruckweshay, enter now with "weshay"12:44
*** tosky is now known as Guest8732412:44
*** tosky__ is now known as tosky12:44
weshayk12:46
weshaysshnaidm|ruck 38.145.34.196 ?12:46
*** Guest87324 has quit IRC12:46
weshayhost 38.145.34.196 port 22: No route to host12:47
sshnaidm|ruckweshay, 38.145.32.9612:47
weshaysshnaidm|ruck ok.. I should use the jump host as the host for the script?12:49
sshnaidm|ruckweshay, well.. hubbot is in "paused" state12:50
chandankumarrlandy: we donot need weshay https://review.opendev.org/#/c/669891/ patch, we can abandon this12:51
chandankumarrlandy: https://review.opendev.org/#/c/669918/ but where we can fix the htacces issue?12:51
rlandychandankumar: I modified the originalc change12:52
sshnaidm|ruckweshay, try now to 38.145.34.19612:52
zbrrfolco: please ping me when we have an unlocked rhel8 container we can pull on rdo.12:52
*** holser_ is now known as holser|burned_by12:52
*** hubbot1 has joined #oooq12:52
rfolcozbr, k12:52
rlandychandankumar: let's chat at sync ... I don't know what causes those issues12:53
rlandyexactly12:53
* rlandy getting rid of all the shyaml stuff12:54
hubbot1All check jobs are working fine on master, stable/pike, master, stable/queens, stable/rocky, stable/ocata.12:54
mariosrlandy: zbr chandankumar panda weshay lets sync in 5 ?12:54
weshayaye12:55
rlandymarios: ack12:55
marios(should be on the calendar see bluejeans there)12:55
weshayzbr your patch merged, thanks.. is https://tree.taiga.io/project/tripleo-ci-board/task/1164?kanban-status=1447276 done?13:00
weshayrfolco welcome back, happy holidays :) can you jump on rhel 813:00
weshayrlandy you as well please13:01
*** skramaja has quit IRC13:04
*** irclogbot_2 has joined #oooq13:04
zbrweshay: work on enabling molecule on rdo requires lots of changes, it would be nice if we would have a story for it.13:04
zbri got a lot of progress but i am surprised how many repos i need to touch to make it happen, mainly because we cannot re-use jobs defined upstream13:05
*** dsneddon has joined #oooq13:08
*** irclogbot_2 has quit IRC13:08
*** altlogbot_1 has joined #oooq13:10
*** amoralej|lunch is now known as amoralej13:15
*** altlogbot_1 has quit IRC13:16
*** irclogbot_2 has joined #oooq13:16
*** tosky__ has joined #oooq13:20
*** tosky has quit IRC13:20
*** tosky__ is now known as tosky13:20
*** irclogbot_2 has quit IRC13:22
*** bogdando has joined #oooq13:28
*** dsneddon has quit IRC13:28
*** aakarsh has joined #oooq13:28
*** holser|burned_by is now known as holser_13:31
*** altlogbot_3 has joined #oooq13:34
*** altlogbot_3 has quit IRC13:36
weshayarxcruz|rover reviews on https://review.opendev.org/#/c/667423/  https://review.opendev.org/#/c/667427/13:39
weshaysshnaidm|ruck https://review.opendev.org/#/c/667427/  so on these two reviews... last sprint we just wanted something tangible.. we don't have to use these reviews.. but your input and pushing on the problem at hand would be great13:40
weshayto review the goal..  there are very long lead times on check jobs getting nodepool resources13:41
*** Goneri has quit IRC13:43
sshnaidm|ruckweshay, not sure I understand13:44
weshayk k13:44
*** tosky___ has joined #oooq13:44
weshayI can blue w/ you guys in a 15min13:44
*** yolanda has quit IRC13:46
*** dsneddon has joined #oooq13:46
*** tosky has quit IRC13:47
chandankumarrlandy: with enforcing mode, we are hitting the same issue13:48
rlandychandankumar" ugh - ok - let get on the node and poke around13:49
mariosrlandy: panda weshay rfolco zbr chandankumar sent invite as discussed for fri fyi thanks13:53
*** dsneddon has quit IRC13:54
rfolcomarios, great thx13:57
rlandymarios: thanks13:57
rfolcochandankumar, --add-subuids does not exist :(13:58
*** ykarel|afk is now known as ykarel13:59
weshayarxcruz|rover sshnaidm|ruck ok join my blue for two min14:03
chandankumarrlandy: I checked the EmilienM rhos-15 rhel-8 deployment14:04
chandankumareverything is same there14:04
*** Goneri has joined #oooq14:05
rlandychandankumar: what node did EmilienM use?14:05
rlandyrhos-15 - downstream?14:06
chandankumarrlandy: yes14:06
rlandywe have donwstream deployments to compare with14:06
rlandythey run every day :)14:06
rlandyand pass14:06
rfolcochandankumar, nm, ignore my previous comment.14:12
rfolcochandankumar, missing group now, thanks14:12
*** tosky___ is now known as tosky14:15
*** vinaykns has joined #oooq14:15
rlandychandankumar: problem is this is not osp15, it's master14:16
rlandyosp15 is an inter registry we keep a cert for14:16
chandankumarrlandy: ok14:17
chandankumarrlandy: I have added his keys to the holded zuul node14:18
chandankumarrlandy: /me needs to go home, will connect from there in an hour14:18
rlandychandankumar: ack - looks like this jobs is in progress though14:18
rlandychandankumar" ack - chat with you later14:19
sshnaidm|ruckmarios, do you know what does this job do? what is this upgrade from -> to? https://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L10814:22
mariossshnaidm|ruck: deploys rocky then runs stein upgrade tasks on it14:24
sshnaidm|ruckmarios, so it should run on stein branch only?14:25
*** ykarel is now known as ykarel|away14:25
mariossshnaidm|ruck: hm i think we're running it on stein and master too14:26
sshnaidm|ruckmarios, but does it make sense to run it on master?14:27
mariossshnaidm|ruck: yeah i mean it will test that the change under review doesn't break the stein upgrade for example14:28
mariossshnaidm|ruck: especially because the standalone-upgrade master job itself is non voting (by consensus)14:28
sshnaidm|ruckmarios, how can master change to break stein upgrade?14:28
mariossshnaidm|ruck: its not really 'stein' upgrade its more like run the stein upgrade tasks for the services you have. so if you post something to master upgrade tasks, the change will be applied onto zuul version of tht/packages and its run14:29
mariossshnaidm|ruck: sorry z/zuul/stein i mean, applied onto stein packages14:30
*** ykarel|away has quit IRC14:30
* sshnaidm|ruck is lost14:30
*** dsneddon has joined #oooq14:31
mariossshnaidm|ruck: say you change something in client/ or in common. on master. you can test that the stein upgrade tasks can still be executed by that code i.e. the thing that zuul will apply before running tests, the change itself14:32
mariosweshay: rlandy: any other ideas about that ssh key for rcm i've tried 'uploaded' but didn't work for me (from rdo vm)14:32
rlandymarios: looking14:33
mariossorry 'uploader' as per the secret in the config repo14:33
mariosrlandy: sorry its different14:34
mariosrlandy: should be loguser14:34
mariostrying14:34
rlandy   ssh_username: uploader14:34
rlandymarios: you are right14:34
marios  9       ssh_username: loguser$14:34
mariosrlandy: but still nop :/14:35
rlandymarios; loguser is the internal upshift log server14:35
mariosrlandy: ah14:35
mariosrlandy: yeah it is uploader but still didn't work for me .. thanks for looking lets see if -v helps me debug14:36
*** Vorrtex has joined #oooq14:37
rlandymarios: are you using the key from the doc?14:37
mariosrlandy: yeah in the google doc14:38
rlandymarios: can you share?14:38
rlandywhere you are trying this and what the error is?14:38
mariosrlandy: https://docs.google.com/a/redhat.com/document/d/1bHVPN-lcXyY7imLdvj2J7I55s-vtF3ffPG-y2Cj8u38/edit?disco=AAAADOrpx3U14:38
*** altlogbot_2 has joined #oooq14:38
mariosrlandy: well it has to be a rdo cloud vm since access is limited to the internal network14:39
mariosPermission denied (publickey,gssapi-keyex,gssapi-with-mic).14:39
rlandymarios: hmmm ... I had to get rid of some spaces in the key14:41
rlandymarios: jpena gave me that key14:42
*** altlogbot_2 has quit IRC14:42
mariosrlandy: ack (checking cant see any spaces ther)14:43
rlandymarios did you try just an ssh to the server or the upload command?14:44
zbrsshnaidm|ruck: i think i got the mo changes in order. do you have few minutes to walk through them?14:44
mariosrlandy: trying ssh uploader@14:44
rlandymarios: trying that ... sec14:44
mariosrlandy: thank you!14:46
mariosrlandy: wow centos@ works ...14:47
mariosrlandy: cool, thank you for help and sorry for distraction & noise14:48
rlandymarios: works for me14:48
mariosrlandy: which one you mean uploader works for you?14:49
rlandymarios: pasted in pvt14:49
mariosrlandy: thanks14:49
*** altlogbot_1 has joined #oooq14:50
hubbot1All check jobs are working fine on master, stable/pike, master, stable/queens, stable/rocky, stable/ocata.14:54
*** altlogbot_1 has quit IRC14:56
*** dsneddon has quit IRC14:56
rlandyamoralej: can you confirm for us the 38. address of the rdocloud log server?14:57
rlandylogs.rdoproject.org14:57
rlandymarios: ^^14:57
rlandyis it 38.145.32.13?  38.145.34.141?14:58
amoralejrlandy,  38.145.32.1314:59
rlandymarios: ^^ ok - thanks14:59
mariosthanks rlandy14:59
mariosrfolco: i'm trying to upload images to the rdo rcm guest space fyi (created that https://tree.taiga.io/project/tripleo-ci-board/task/1167 and attached rhel_8_repos_task_1167.txt to it with my repos fyi15:01
sshnaidm|ruckzbr, which changes?15:01
mariosrfolco: right now its just suuuper slow uploading the images15:01
rlandymarios++15:02
hubbot1rlandy: marios's karma is now 1215:02
mariosrfolco: i'm going to try upload the ones I already hav built since my quickvm dind't die yet15:02
rlandyimages - so exciting15:02
mariosrlandy: well, not sure it will complete today to be honest... the upload is ridiculous15:02
mariosrlandy: but tomorrow anyway... i mean looks like ssh is working now. currently uploading from laptop to rdo cloud, then from there can put onto the rcm space15:02
rlandymarios: we live for the ridiculous15:03
chandankumarhubbot1: welcome back15:05
hubbot1chandankumar: Error: "welcome" is not a valid command.15:05
mariosrlandy: just as i read that this was on my screen [centos@reprozuul ~]$ curl  http://38.145.34.141/rcm-guest/rhel8-imgs/test.txt15:05
marioswoo15:06
mariosrlandy: we live for the ridiculous "woo"15:06
marios(is the contents of test.txt)15:06
rlandycool15:06
*** altlogbot_1 has joined #oooq15:06
*** dsneddon has joined #oooq15:08
weshayhubbot1 wow.. who the f are you?15:09
hubbot1weshay: Error: "wow.." is not a valid command.15:09
*** altlogbot_1 has quit IRC15:12
*** ykarel|away has joined #oooq15:12
*** dsneddon has quit IRC15:14
* rlandy goes back to undoing all the shyaml damage15:14
zbrsshnaidm|ruck: take a look at the top 3 reviews listes on https://tree.taiga.io/project/tripleo-ci-board/task/1165 -- they are already in sorted by merge order.15:15
*** mjturek has joined #oooq15:17
weshayrlandy rfolco fyi.. added a userstory for sprint13 at the top.. "to RedHat or RHEL, that is the question"15:17
weshayhttps://tree.taiga.io/project/tripleo-ci-board/taskboard/unified-sprint-13?kanban-status=144727715:17
zbrlet me guess, that hubbot was in fact the one deployed by molecule during testing of the role. this would explain its sudden appearance.15:17
rlandyweshay: thanks - I appreciate the Shakespeare reference even if it not the one I asked for :)15:18
rfolcoweshay, I hate philosophy15:18
weshayya.. my memory :(15:18
*** irclogbot_1 has joined #oooq15:18
zbrweshay: is https://review.opendev.org/#/c/669932/8 documented correctly now?15:21
*** irclogbot_1 has quit IRC15:22
zbrweshay: rlandy sshnaidm|ruck: can I wipe hubbot from existence?15:23
*** yolanda has joined #oooq15:23
rlandyzbr: what do you have against hubbot?15:24
weshaypanda do we have any details on how often the mac address conflict happens in rdo-cloud?15:24
zbrmy impression was that we no longer want it, since use of CR was banned for checking status.15:25
rlandyzbr: ok by me15:27
weshaypanda fyi https://tree.taiga.io/project/tripleo-ci-board/us/1169?milestone=233954  work w/ me on this one15:29
weshaynot sure why some of this in bold15:29
sshnaidm|ruckzbr, go for it15:29
*** altlogbot_0 has joined #oooq15:30
pandaweshay: no, empirically I would say 10% but it could be less.15:31
weshaymarios so imho.. this is a fact finding mission  for the upload work.. https://tree.taiga.io/project/tripleo-ci-board/us/1169?milestone=233954   you, myself and panda should coordinate any future real work15:31
sshnaidm|ruckzbr, maybe it's easier to config rdo to include jobs from openstack-zuul-jobs?15:32
weshaypanda it shows up as either a introspection error or initial deployment error?15:32
sshnaidm|ruckzbr, let's just add it here: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul/rdo.yaml#L942-L94315:32
sshnaidm|ruckzbr, exactly as tripleo-ci configured15:32
mariosweshay: ack15:32
* marios almost out15:33
zbrsshnaidm|ruck: i chatted with ykarel this morning about that, there is a good reason why openstack-zuul-jobs was excluded. We cannot gate it and it will clearly break RDO.15:34
zbri kinda agree with him that duplicating is safer here.15:34
*** altlogbot_0 has quit IRC15:34
pandaweshay: I'm mainly focusing on the deployment part, but even discussing it with yatin, they are two different issues. During introspection, it's usually caused by stack delete errors. Yatin was suggesting that now that we don't have the te-broker anymore, we don't need to keep all the underclouds in the same network, and that would prevent conflict.15:35
rlandymarios: can you check your permissions on the rhui keys?15:35
sshnaidm|ruckzbr, we don't gate anything in upstream, including tripleo-ci15:35
sshnaidm|ruckzbr, but it's for inheriting job only15:35
pandaweshay: for the conflicts in deployment, until we have a packet trace, we can't even be sure from where those macs come from15:36
*** ykarel|away has quit IRC15:36
mariosrlandy: how do you mean/? which kys?15:36
rlandymarios: ls -la /etc/pki/rhui/ca.crt15:36
mariosrlandy: -rw-------. 1 root root 1781 Jun 27 18:53 /etc/pki/rhui/ca.crt15:36
rlandyls -la /etc/pki/rhui/product/content.crt15:36
rlandy ls -la /etc/pki/rhui/key.pem15:36
mariosrlandy: all same as -rw-------. 1 root root 1675 Jun 27 18:53 /etc/pki/rhui/key.pem15:37
zbrsshnaidm|ruck: it would have being more convenient, much less effort for me but as I was told, too many risks of being broken due to changes made outside our control.15:37
mariosrlandy: k ?15:37
rlandymarios: can you run sudp yum update?15:37
rlandysudo15:37
mariosrlandy: yeah it offers me the update15:38
rlandymarios: k - thanks15:38
*** irclogbot_0 has joined #oooq15:38
mariosrlandy: np15:38
*** Goneri has quit IRC15:41
*** marios is now known as marios|out15:41
*** ykarel|away has joined #oooq15:42
*** irclogbot_0 has quit IRC15:42
sshnaidm|ruckzbr, hmm.. can we redefine this job in tripleo-ci then?15:43
sshnaidm|ruckzbr, like inherit from openstack-zuul-jobs and set it like openstack-molecule-test-tripleo in tripleo-ci repo15:44
sshnaidm|ruckzbr, then it'll be partially under our control.. but it will help to know what exactly can be broken there15:44
*** altlogbot_3 has joined #oooq15:44
zbrsshnaidm|ruck: that is not the point, the point was about creating a job that we can enable on each repository. we cannot add a job in tripleoc-ci that runs on rdo and is using a parent from openstack-zuul-jobs, we can inherit only from zuul-jobs, but not openstack ones.15:44
sshnaidm|ruckzbr, if we define a job on tripleo-ci - we can inherit from it in rdo, isn't it?15:46
zbri learnt this the hardway, is by design, for protecting rdo zuul from upstream changes.15:46
zbryou cannot define it there because I need to refer to downstream-only nodesets.15:46
zbrupstream zuul will choke15:46
sshnaidm|ruckzbr, not sure I understand, we can change nodeset in job definition15:47
*** dsneddon has joined #oooq15:48
*** altlogbot_3 has quit IRC15:48
*** ykarel|away has quit IRC15:48
zbrsshnaidm|ruck: how about this: try to propose a change that does that and see what it happens. i almost spent two days to get this working, and my first attempts where like you described.15:49
*** ykarel has joined #oooq15:50
*** Goneri has joined #oooq15:53
*** altlogbot_1 has joined #oooq15:54
rlandychandankumar: hey ...15:55
chandankumarrlandy: Hello15:55
rlandychandankumar: can you increase your screen size?15:55
rlandyalso ...15:55
rlandyEmilienM found it15:55
chandankumarrlandy: I have increased it15:57
rlandymust be someone else then15:57
*** altlogbot_1 has quit IRC15:58
*** udesale has quit IRC16:01
*** marios|out has quit IRC16:06
*** dsneddon has quit IRC16:11
*** dsneddon has joined #oooq16:13
chandankumarrlandy: weshay rfolco https://github.com/openstack/ansible-role-redhat-subscription16:16
*** dsneddon has quit IRC16:17
*** holser_ has quit IRC16:23
*** altlogbot_1 has joined #oooq16:35
*** altlogbot_1 has quit IRC16:36
*** Goneri has quit IRC16:45
*** altlogbot_3 has joined #oooq16:48
*** dsneddon has joined #oooq16:48
*** jfrancoa has quit IRC16:54
hubbot1All check jobs are working fine on master, stable/pike, master, stable/queens, stable/rocky, stable/ocata.16:54
*** altlogbot_3 has quit IRC16:54
*** dsneddon has quit IRC16:54
*** ykarel is now known as ykarel|away16:56
zbrsshnaidm|ruck: still here? how can i test a new rdo job  I want to add that would run-on tripleo-ci?16:56
*** dtantsur is now known as dtantsur|afk16:57
zbri tried a depends-on on https://review.opendev.org/#/c/670132/ but it had no effect on the triggered jobs. are we forced to enable these without testing?16:57
*** Goneri has joined #oooq16:58
*** derekh has quit IRC17:01
*** dsneddon has joined #oooq17:03
sshnaidm|ruckzbr, not sure I understand17:04
chandankumarsshnaidm|ruck: rlandy weshay we have got reply from collect-logs email http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007618.html17:07
chandankumardoes someone wants to reply.17:07
chandankumarzbr: ^^17:07
rlandycool17:08
sshnaidm|ruckchandankumar, I think people don't understand what our collect logs role does, actual "collecting files" there is the smallest part, it runs a lot of checks and gather information about services, containers, etc17:14
sshnaidm|ruckchandankumar, if you make it "the simplest as possible, and flexible enough to get passed the list of things to log/not log", then we need to make additional role again which will run all these checks and tools17:15
chandankumarsshnaidm|ruck: so here we are taking about two things, collect logs from a host and also running checks for a particular services and we want to combine both in a single role?17:18
sshnaidm|ruckchandankumar, we have this combined now17:18
chandankumarok got it17:18
chandankumarsshnaidm|ruck: will try to compose the reply tomorrow17:19
sshnaidm|ruckchandankumar, all this tasks are about generating needed logs:https://github.com/openstack/ansible-role-collect-logs/blob/master/tasks/collect.yml#L17-L14817:20
sshnaidm|ruckeven whole collect.yml  file17:21
chandankumarsshnaidm|ruck: yup17:21
sshnaidm|ruckbut we can make all these checks conditional and enabled in our ci, but disabled by default17:28
weshaychandankumar that's nice feedback in the email.. sounds like we just want to organize things in the role17:29
chandankumarweshay: yes17:29
*** bogdando has quit IRC17:39
*** irclogbot_1 has joined #oooq18:05
*** amoralej is now known as amoralej|off18:06
*** irclogbot_1 has quit IRC18:08
*** Goneri has quit IRC18:25
weshayzbr trying to break out business model again .. lolz https://bugzilla.redhat.com/show_bug.cgi?id=172828118:41
openstackweshay: Error: Error getting bugzilla.redhat.com bug #1728281: NotPermitted18:41
zbrweshay: yeah, always trying to break something.18:42
weshayit's a good quality18:42
zbrlike a good knife, can be used to cut stuff, but owner needs to be careful not to cut himself ;)18:43
zbrI am glad we can (still) have discussions like this.18:44
hubbot1All check jobs are working fine on master, stable/pike, master, stable/queens, stable/rocky, stable/ocata.18:54
weshayrlandy you have anything? perhaps we should look at the doc updates I made?19:00
weshayrfolco how goes the manual build?19:00
rlandyweshay: not really19:00
rlandyweshay: joining19:00
*** altlogbot_3 has joined #oooq19:01
rfolcoweshay, trying to figure out why ~35/134 are really built19:01
rfolcoweshay, also, this works from laptop and from quickvm, but not from rdo19:02
weshayrfolco hrm.. we don't care where they are built19:02
weshayatm19:02
rfolcohttp://<rhui-location>/~apevec/OSP/rdo-rhui-2.1-1.noarch.rpm19:02
rfolcoweshay, I know, just saying... I'm focused on the manual build.... but also iterating over job19:02
*** altlogbot_3 has quit IRC19:04
rfolcoweshay, pvt19:06
*** ykarel|away has quit IRC19:09
*** tesseract has quit IRC19:16
*** irclogbot_0 has joined #oooq19:19
weshayzbr what's up19:21
*** irclogbot_0 has quit IRC19:22
zbrweshay: i am getting close to have the rdo-tox-molecule-rhel8 job running with rhel on rdo.19:23
*** tcw has quit IRC19:31
*** tcw has joined #oooq19:31
weshayrlandy is the client rpms for the rhui installed installed on the rhel8 nodepool image?19:34
rlandyweshay: http://logs.rdoproject.org/70/21270/31/check/periodic-tripleo-ci-rhel-8-standalone-master/0bc3673/logs/undercloud/etc/yum.repos.d/19:36
rlandynot sure what you mean by client19:36
rlandyhttp://logs.rdoproject.org/70/21270/31/check/periodic-tripleo-ci-rhel-8-standalone-master/0bc3673/logs/undercloud/etc/yum.repos.d/rh-cloud.repo.txt.gz19:36
zbrweshay: rlandy : it could be useful if you can have a look at https://review.rdoproject.org/r/#/c/21426/ -- afaik there is no way to test it before merging it.19:36
rlandyzbr: it's in rdo-jobs - that will run on check19:39
rlandyw/o merge19:39
rlandyif you include the trigger condition19:39
weshayrlandy where is your change that turns off ssl19:41
weshayfor the yum repos19:41
rlandyweshay: nowhere19:41
rlandywe never submitted it19:41
rlandyit's just in the window EmilienM worked on19:41
rlandy I can put it somewhere if you need it19:42
weshayrlandy k.. k.. join my blue pllease19:42
weshayrfolco http://logs.rdoproject.org/70/21270/31/check/periodic-tripleo-ci-rhel-8-standalone-master/0bc3673/logs/undercloud/etc/yum.repos.d/rh-cloud.repo.txt.gz19:43
zbrrlandy: maybe i am missing something but I do not see the jobs triggered by https://review.opendev.org/#/c/670132/ even if it has a depends-on19:44
rlandyzbr: on sec in meeting19:44
rlandywill look in a sec19:44
rlandyzbr: looking19:52
rlandyzbr: let's bj19:52
zbrhttps://bluejeans.com/265541792819:53
*** Vorrtex has quit IRC19:57
*** aakarsh has quit IRC19:58
zbrrlandy:  https://review.opendev.org/#/c/670132/20:05
zbrrlandy: https://review.rdoproject.org/r/#/c/18627/20:10
*** altlogbot_0 has joined #oooq20:27
*** altlogbot_0 has quit IRC20:32
*** saneax has quit IRC20:32
weshayrfolco http://logs.openstack.org/13/670013/1/check/tripleo-build-containers-centos-7-buildah/85e54a1/logs/build_containers.sh.txt.gz20:33
zbrrlandy: weshay: proud to show you https://review.rdoproject.org/r/#/c/18627/ -- look at molecule jobs.20:35
rlandyzbr: very cool20:36
zbrit was expected to fail on rhel as we never cared about it for this infra role, but a good way to test that we can run with overriden platforms.20:36
zbri kinda like this mode as it allows us to enable rhel8 testing as non voting.20:36
rlandysure20:36
rlandyzbr: which are reviewable for merge and which are just for test?20:37
zbrrlandy: ready to merge: https://review.opendev.org/#/c/669932/ and https://review.rdoproject.org/r/#/c/21426/20:39
rlandyzbr: +2'ed the tripleo-ci one - had one question on the second review20:44
*** dtrainor has quit IRC20:46
*** dtrainor has joined #oooq20:46
*** aakarsh has joined #oooq20:46
zbrrlandy: re voting false because i want to see them running stable for 1-2 weeks before making it voting. on rdo we do not have less than 24h of history.20:46
hubbot1All check jobs are working fine on master, stable/pike, master, stable/queens, stable/rocky, stable/ocata.20:54
*** holser_ has joined #oooq20:59
*** altlogbot_2 has joined #oooq21:03
*** altlogbot_2 has quit IRC21:08
*** altlogbot_1 has joined #oooq21:17
*** altlogbot_1 has quit IRC21:22
rlandyweshay: do you want me to update the pipeline reference guide where it is out of date>21:26
rlandy?21:27
weshayrlandy only for tripleo and rdo phase 121:27
rlandyk21:27
zbrweshay: rfolco: need https://review.opendev.org/#/c/669932/21:30
*** vinaykns has quit IRC21:31
weshayrlandy the 8 container w/ certs is /rhel/rhel8-rhui21:45
weshayrlandy uploaded21:45
weshaybuilding containers now21:45
weshayzbr ping21:46
weshayif you are working21:46
weshayzbr can chat tomorrow21:46
*** irclogbot_0 has joined #oooq21:47
rlandyweshay: you uploaded or you asked me if it is uploaded?21:47
weshayrlandy we did it..21:48
rlandyyou and rfolco?21:48
weshayrlandy hopefully you and chandankumar will have rhel8 containers soon.. we'll see.. but we're much closer21:48
weshayya.. rfolco21:48
rlandythanks21:48
weshaywe have a local run going well and https://review.rdoproject.org/zuul/stream/0980baccb00b48ca94a95eb38dfa2678?logfile=console.log21:49
weshaybbiab21:49
*** irclogbot_0 has quit IRC21:52
*** holser_ has quit IRC21:59
*** rlandy is now known as rlandy|bbl22:19
*** slaweq has quit IRC22:20
*** holser_ has joined #oooq22:39
*** holser_ has quit IRC22:44
hubbot1All check jobs are working fine on master, stable/pike, master, stable/queens, stable/rocky, stable/ocata.22:54
*** altlogbot_2 has joined #oooq23:03
*** altlogbot_2 has quit IRC23:08
*** tosky has quit IRC23:10
*** altlogbot_2 has joined #oooq23:13
*** altlogbot_2 has quit IRC23:18
*** altlogbot_3 has joined #oooq23:19
*** altlogbot_3 has quit IRC23:24
*** altlogbot_2 has joined #oooq23:25
*** altlogbot_2 has quit IRC23:30

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!