Friday, 2021-03-19

*** jmasud has quit IRC00:00
*** jmasud has joined #oooq00:04
*** tosky has quit IRC00:14
*** jmasud has quit IRC00:15
*** rlandy has quit IRC01:31
*** jmasud has joined #oooq03:00
*** jmasud has quit IRC03:56
*** jmasud has joined #oooq04:00
*** ratailor has joined #oooq04:47
*** jmasud has quit IRC04:48
*** jmasud has joined #oooq04:53
*** ykarel has joined #oooq04:59
*** jmasud has quit IRC05:53
*** jmasud has joined #oooq05:58
*** marios has joined #oooq06:02
*** ysandeep|away is now known as ysandeep06:15
*** ykarel has quit IRC07:00
*** jmasud has quit IRC07:01
*** ykarel has joined #oooq07:02
*** skramaja has joined #oooq07:03
*** udesale has joined #oooq07:09
akahatchkumar|ruck, marios pojadhav ykarel zbr please take a look when you are free: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3200707:22
mariosakahat: ack is in my list07:32
*** ysandeep is now known as ysandeep|lunch07:35
*** jpodivin has joined #oooq07:46
chkumar|ruckzbr: good morning my friend, Where to add new sova patterns?07:58
*** udesale_ has joined #oooq08:22
*** udesale has quit IRC08:24
*** udesale__ has joined #oooq08:40
zbrmorning08:43
*** udesale_ has quit IRC08:43
zbrat this moment in https://opendev.org/openstack/tripleo-ci-health-queries/src/branch/master/output/sova-patterns.json08:44
zbrbut with frenzy_friday help we will soon have a better way to do it08:44
zbrjoys of rdo gerrit which after login sends you to dashboard instead of original link...08:45
zbrakahat: that review is in merge conflict, not sure if I should look after that08:46
*** tosky has joined #oooq08:54
*** holser has joined #oooq09:00
*** holser has quit IRC09:02
*** holser has joined #oooq09:03
*** ykarel has quit IRC09:11
chkumar|ruckzbr: please update the merge conflict https://review.opendev.org/c/openstack/tripleo-common/+/780605 then we can merge it09:23
marioso/ folks grateful for reviews on tripleo-validations zuul layout optimisation please check master https://review.opendev.org/c/openstack/tripleo-validations/+/781066 victoria https://review.opendev.org/c/openstack/tripleo-validations/+/781081 ussuri  https://review.opendev.org/c/openstack/tripleo-validations/+/781082 train https://review.opendev.org/c/openstack/tripleo-validations/+/78108309:23
*** derekh has joined #oooq09:26
*** udesale_ has joined #oooq09:31
*** udesale__ has quit IRC09:33
*** ysandeep|lunch is now known as ysandee09:40
*** ysandee is now known as ysandeep09:56
*** ykarel|lunch has joined #oooq10:45
*** dtantsur|afk is now known as dtantsur10:52
*** ykarel|lunch is now known as ykarel11:06
chkumar|ruckstepping out for a bit11:17
chkumar|ruckstepping out for a bit11:18
mariossshnaidm|off: o/  hey please check comments when you are next back in the office ;) replied https://review.opendev.org/c/openstack/tripleo-ansible/+/781323/1/zuul.d/layout.yaml11:19
*** rlandy has joined #oooq11:37
chkumar|ruckcgoncalves: hello, please have a look https://review.rdoproject.org/r/c/rdo-jobs/+/32560 and https://review.rdoproject.org/r/c/rdo-jobs/+/32562 when free11:45
cgoncalveschkumar|ruck, done. thank you for the patches11:46
rlandychkumar|ruck: marios: hello there ... I missed yesterday's meeting - anyone taking the lead on wallaby branching?11:46
rlandyotherwise I;ll set up the hackmd to start that11:46
chkumar|ruckcgoncalves: I need your eyes on these failures also https://logserver.rdoproject.org/73/32573/2/check/periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-master/8891678/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz and here is error from whole node11:47
chkumar|ruckhttps://logserver.rdoproject.org/73/32573/2/check/periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-master/8891678/logs/undercloud/var/log/extra/errors.txt.txt.gz11:47
chkumar|ruckrlandy: ysandeep has raised his hand, I think frenzy_friday or bhagyashris was also interested11:47
frenzy_fridayrlandy, me me me11:48
frenzy_fridayI mean I am interested too11:48
rlandyfrenzy_friday: ysandeep: bhagyashris: ok - I am starting a hackmd11:49
mariosrlandy: o/11:49
rlandymeeting on monday?11:49
mariosrlandy: i believe we mainly said 'not the usual people' so would be good for someone who hasn't done the branching thing before11:49
chkumar|ruckmarios: rlandy sending invite for tripleo-repos monday call also11:49
marios13:49 < rlandy> meeting on monday?11:49
mariosrlandy: sounds right11:49
rlandychkumar|ruck: k - cool11:49
marios:)11:49
mariosrlandy: once we're ready we can create the tripleoclient wallaby branch to test (once we have the mvp)11:50
rlandymarios: going to set up the hackmd to get the group started11:50
mariosrlandy: ack11:50
chkumar|ruckrlandy: weshay|ruck https://review.rdoproject.org/r/c/rdo-jobs/+/32562 anmd https://review.rdoproject.org/r/c/rdo-jobs/+/3256011:50
cgoncalveschkumar|ruck, amphora VM create request -> nova/placement returned insufficient resources11:55
cgoncalves2021-03-19 02:41:30.578 7 INFO nova.scheduler.manager [req-45f3da66-436f-4401-b2a3-9dcb3c7916a6 5a6156ec87f7439d8fb2cf861874046f e3deb44830e7460cbf4b13457076d8b9 - default default] Got no allocation candidates from the Placement API. This could be due to insufficient resources or a temporary occurrence as compute nodes start up.11:55
cgoncalveschkumar|ruck, tempest is probably set with a high concurrency value11:55
rlandymarios: do you want to be in the branching meetings?11:58
rlandyysandeep: frenzy_friday: bhagyashris: marios: hackmd started https://hackmd.io/2sxlx1XzTa-Te47_zLv42Q - meetings being set up11:59
rlandyweshay|ruck: ^^ fyi11:59
chkumar|ruckcgoncalves: it is set to tempest_run_concurrency: 211:59
chkumar|rucklet me decrease it to one and see12:00
mariosrlandy: you mean wallaby yeah12:00
rlandyyep12:00
mariosrlandy: sure add me please thanks12:00
cgoncalveschkumar|ruck, decreasing to one would help at a cost of taking longer to run. I see the CI node has 8 GB RAM and that could be the bottleneck. is there an option to run the CI job on a node with more RAM?12:02
chkumar|ruckrlandy: ^^ need to check12:03
cgoncalveschkumar|ruck, upstream octavia scenario job runs also with tempest concurrency=2. my guess is a tripleo-based environment is much heavier on RAM than devstack12:03
rlandycgoncalves,: chkumar|ruck: we would have to create a new nodeset to do  that12:06
*** ykarel has quit IRC12:06
rlandyright now our nodes are all consistent12:07
*** ykarel has joined #oooq12:07
rlandyif you need a node with more ram, will have to create that - not sure it is allowed upstream12:07
rlandyrdo might12:07
cgoncalvesrlandy, ack. either that or run concurrency=1 as chkumar|ruck suggested12:07
rlandycgoncalves: ^^ much easier solution12:07
cgoncalvesrlandy, this is in RDO12:07
chkumar|rucklet me try that12:08
rlandycgoncalves: chkumar|ruck: ^^ if that does not help, pls get back to me, and I'll look into bigger nodes if possible12:08
cgoncalvesrlandy, the scenario010 job boots many amphorae (1GB service VMs). concurrency=1 would come at a cost of higher build times12:08
cgoncalvestrade offs need to be made. we could start by testing with concurrency=1  yeah12:09
rlandycgoncalves: as long as your job does not over run the job limit12:09
cgoncalves4h should be more than enough for nested KVM enabled envs12:09
rlandyk - see how  you go there12:10
rlandyif we need bigger nodes, we'll look into it12:10
cgoncalveschkumar|ruck, thanks! please point me to the review patch once you have one :)12:10
cgoncalvesrlandy, ack. thank you12:10
rlandymarios: ysandeep: bhagyashris: frenzy_friday: meeting invites sent for tuesday and friday mornings for the rest of the sprint12:11
mariosrlandy: thank you12:11
rlandycan start on monday12:11
ysandeeprlandy++ thanks!12:11
frenzy_fridayrlandy, could we pls postpone the meetings by 30 mins? I have german classes on tuesday mornings12:13
rlandyfrenzy_friday: sure ... looking at times12:14
rlandyfrenzy_friday: done - 30 mins later12:14
frenzy_fridaythanks!12:14
chkumar|ruckcgoncalves: testing here https://review.rdoproject.org/r/c/testproject/+/32573 thanks :-)12:15
chkumar|ruckrlandy: regarding larger nodes I will check with infra team on monday12:16
rlandychkumar|ruck: I can ping tristan about it later - he is on my timezone - will let you know12:16
rlandywe need just larger RAM?12:16
chkumar|ruckrlandy: yes12:16
rlandychkumar|ruck: only RDO?12:17
chkumar|ruckrlandy: yes12:17
rlandyand if it's scenario010 - probably downstream as well12:17
chkumar|ruckin vexxhost cloud and also for downstream12:17
rlandyok - on it12:17
rlandypsi  also12:17
chkumar|ruckyup12:17
chkumar|ruckwe have so many clouds now12:17
rlandyI know right ..12:18
rlandyso many releases12:18
rlandyso many clouds12:18
rlandyarxcruz: did you already meet with bhagyashris about the promoter container work?12:21
rlandyif not, can we meet sometime today to get an overview of that?12:21
chkumar|ruckrlandy: we met on promoter container, bhagyashris has recordings of the meeting12:22
rlandybhagyashris: could I get the link to those recordings?12:23
chkumar|ruckrlandy: but we need one more meeting on how to integrate and get rid of docker completley there12:23
rlandychkumar|ruck: I was interested to see arxcruz's go work12:24
chkumar|ruckrlandy: weshay|ruck ysandeep fyi https://bugs.launchpad.net/tripleo/+bug/192010112:25
openstackLaunchpad bug 1920101 in tripleo "Ovb jobs failing with RETRY_LIMIT while creating a stack giving 504 Gateway Time-out openresty/1.15.8.2" [High,Triaged]12:25
ysandeepchkumar|ruck, ack12:27
*** ysandeep is now known as ysandeep|afk12:27
rlandychkumar|ruck: how frequently? - ping me when you are EOD - will watch that in my afternooh hours if you wish12:27
chkumar|ruckrlandy: heat service is down on vexxhost, dpawlik is following on it12:29
rlandychkumar|ruck: are you rucking solo this sprint? someone roving with you>12:29
rlandyack ok12:29
chkumar|ruckrlandy: still happening, zbr is my partner in crime12:30
*** zbr is now known as zbr|rover12:30
rlandyah - ok12:31
rlandyzbr|rover: :)12:31
*** ykarel has quit IRC12:35
*** ykarel has joined #oooq12:35
bhagyashrisrlandy, https://drive.google.com/file/d/1wQ6tMSSkC0IEDCRhrkQKl8abl6jEwyH5/view12:36
bhagyashrisi have share over an email as well ...12:36
weshay|ruckchkumar|ruck, oof.. k12:36
weshay|ruckhttps://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset001&job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset00112:36
rlandybhagyashris: thanks12:36
chkumar|ruckweshay|ruck: not my fault, it's someone else computer12:37
weshay|rucklolz12:37
weshay|ruckclassic12:37
chkumar|ruckweshay|ruck: some work for you related to cockpit12:38
weshay|ruckchkumar|ruck, you talking about ovb or the cockpit now12:39
* weshay|ruck CON FUZ ED12:39
bhagyashrisrlandy, ack regarding wallaby branching work12:39
* bhagyashris setting out for bit12:39
chkumar|ruckweshay|ruck: montioring vexxhost cloud services, info added in the tripleo-ci chat room task list12:39
bhagyashrisstepping *12:39
weshay|ruckchkumar|ruck, like this? http://dashboard-ci.tripleo.org/d/_ZOYIidMk/vexxhost?orgId=112:40
chkumar|ruckweshay|ruck: yes, may be we can add an entry just for services status12:41
chkumar|ruckweshay|ruck: https://prometheus.monitoring.softwarefactory-project.io/prometheus/graph?g0.expr=stack_create_complete&g0.tab=0&g0.stacked=1&g0.range_input=1d12:42
chkumar|ruckweshay|ruck: they uses this https://softwarefactory-project.io/r/gitweb?p=software-factory/sf-infra.git;a=blob;f=roles/openstack-simply-reporter/files/openstack-simply-reporter.py to pull data into promethous12:43
arxcruzrlandy: i did, but we can go through it again, no problem12:43
weshay|ruckchkumar|ruck, http://dashboard-ci.tripleo.org/d/_ZOYIidMk/vexxhost?viewPanel=8&orgId=112:43
weshay|rucksame graph lolz12:43
rlandyarxcruz: np - I'll try the recording first12:43
weshay|ruckjebus12:43
chkumar|ruckweshay|ruck: yes12:43
weshay|ruckchkumar|ruck, /me done12:43
chkumar|ruckweshay|ruck: regarding ussuri and victoria upgrade those tempest failures were random, jobs are in good shape12:45
weshay|ruckchkumar|ruck, k.. thanks for checking it out :)12:45
weshay|ruckchkumar|ruck, I'll recheck those patches then12:46
chkumar|ruckweshay|ruck: I think owners have taken care of that12:46
weshay|ruckthey did.. ya.. all merged :)12:46
weshay|ruckwoot woot12:46
chkumar|ruckit's friday :-)12:46
weshay|ruckIT'S FRRRIIIIDAY!!!!12:47
weshay|ruckhttps://images.app.goo.gl/DC8M2cw7yVVGNCL2912:48
chkumar|ruckcgoncalves: does 8vcpu/12GB of ram for octavia kvm would be enough?12:56
weshay|ruckpojadhav++12:57
cgoncalveschkumar|ruck, I would think so but am not 100% certain13:02
chkumar|ruckcgoncalves: sure, thanks :-)13:04
chkumar|ruckweshay|ruck: now you should have +2 powers on rdo jobs as per this https://review.rdoproject.org/r/admin/groups/3066d3d50cccd31f9587392d50e02fa24d12281d,members13:08
weshay|ruckchkumar|ruck, aye.. alan got it fixed up for me :)13:09
weshay|ruckchkumar|ruck, there u go :)13:09
chkumar|ruckweshay|ruck: more powers to you :-) use it with caution :-)13:10
weshay|ruckchkumar|ruck, the power of RIF13:12
weshay|ruckchkumar|ruck, you can add an account if you like13:12
mariosxmlrpc.client.Fault: <Fault -32500: "RuntimeError: PyPI's XMLRPC API is currently disabled due to unmanageable load and will be deprecated in the near future. See https://status.python.org/ for more information.">13:14
marioswow13:14
rlandycharming13:14
marioshmm weird search does that ^^^ but install seemed to work... /me shrug13:15
Tenguit's been lurcking for a long time...13:21
Tenguno way to pip search13:21
mariosorly tengu :/ didn't try it for a while13:23
Tenguah. couple of months already13:23
marioszbr|rover: so once you're done with the other things please fix pip search before you leave for today thanks ^^^13:23
marios;)13:23
* marios runs13:24
Tengu:D13:25
Tengunot sure how we're supposed to search - apparently the web interface is the only current way.13:25
*** udesale__ has joined #oooq13:25
*** dviroel has joined #oooq13:25
*** ysandeep|afk is now known as ysandeep13:27
*** ratailor has quit IRC13:31
zbr|rovermarios: i am not sure if is in my power to fix pypi server degradation.13:33
*** udesale_ has quit IRC13:33
*** derekh has quit IRC13:33
*** irclogbot_2 has quit IRC13:33
marioszbr|rover: ;)13:35
*** irclogbot_0 has joined #oooq13:35
zbr|roveri don't even understand where this comes from, the status was from january.13:35
akahatweshay|ruck, chkumar|ruck zbr|rover bhagyashris should i go for updating promoter server for c8 releases? Talking about this: http://10.0.148.74/13:38
*** saneax has quit IRC13:40
chkumar|ruckakahat: you are working on prod deployment?14:04
akahatchkumar|ruck, no. i'm not setting up new server. I'll update the existing one.14:05
akahatchkumar|ruck, do you want to deploy new server?14:06
chkumar|ruckakahat: ok for updating,14:08
chkumar|ruckakahat: we can look into new server from next week14:08
chkumar|ruckakahat: may sure you keep a copy of current changes somewhere before updating14:08
chkumar|ruckakahat: remember it's friday, we should avoid prod update14:09
akahatchkumar|ruck, ack14:09
akahat:)14:10
akahatchkumar|ruck, that is one reason i asked you folks. :D14:11
chkumar|ruckakahat: let's do on monday on a call in daytime14:12
akahatchkumar|ruck, okay. cool.14:12
chkumar|ruckakahat: donot forgot to create a card to track the issues14:13
chkumar|ruckzbr|rover: ovb jobs are cleared now.14:22
chkumar|ruckweshay|ruck: can you take a look at https://logserver.rdoproject.org/73/32573/4/check/periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-ussuri/7813216/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz I am not getting why configuring octavia on overcloud is failing for train and ussuri14:35
ysandeepweshay|ruck, fyi.. sbaker proposed a patch to fix the baremetal provisioning issue we are facing on 17 line https://review.opendev.org/c/openstack/ironic-python-agent/+/781564 .. issue can only be detected with real baremetal.. Good to have those jobs.14:41
chkumar|ruckweshay|ruck: rlandy zbr|rover https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/78160814:46
ysandeepweshay|ruck, rlandy if 16.2 current run all passes,  i think we should promote.. In last promotion tempest container was missing.14:51
ysandeepFyi.. morning's run ran with same hash - only fs035 failed on tempest ).. lets see if fs035 passes in current run.14:51
rlandyysandeep: ok14:51
ysandeeprlandy, fyi.. https://review.opendev.org/c/openstack/tripleo-ci/+/780930 caused missing tempest container.. fixed with https://review.opendev.org/c/openstack/tripleo-ci/+/78108814:52
*** ykarel has quit IRC14:53
chkumar|ruckweshay|ruck: rlandy https://logserver.rdoproject.org/21/781721/1/openstack-check/tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001/ffd9f08/logs/undercloud/var/log/extra/errors.txt.txt.gz15:07
chkumar|ruckovb jobs are failing while Wait until nodes will be manageable]15:07
ysandeeplooks like infra issue ^^15:08
*** ysandeep is now known as ysandeep|dinner15:08
rlandyack15:08
*** ykarel has joined #oooq15:08
rlandyysandeep|dinner: weshay|ruck: just put in review so add labels to dockerfiles per rel del request15:09
rlandytesting out15:09
chkumar|ruckysandeep|dinner: will keep an eye on other ovb jobs15:18
chkumar|ruckrlandy: weshay|ruck zbr see ya on monday15:24
*** chkumar|ruck is now known as raukadah15:24
raukadahcgoncalves: https://logserver.rdoproject.org/73/32573/4/check/periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-victoria/3293e2c/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz15:26
raukadahcgoncalves: we need more space there, concurrency is not gona help15:26
raukadahrlandy: ^^ can we get the nodeset with increased ram?15:27
cgoncalvesraukadah, where are you seeing it needs more ram?15:28
rlandynice16:04
*** holser has quit IRC16:05
rlandywill do16:08
arxcruzraukadah: tosky https://review.opendev.org/c/osf/python-tempestconf/+/77519516:10
*** jmasud has joined #oooq16:12
*** jpodivin has quit IRC16:13
*** ysandeep|dinner is now known as ysandeep16:13
*** ykarel has quit IRC16:16
*** ykarel has joined #oooq16:17
*** holser has joined #oooq16:18
ysandeeprlandy, okay if i remove standalone-on-multinode-ipa from component criteria from 17.. if failing from long.. https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-rhel-8-standalone-on-multinode-ipa-tripleo-rhos-1716:20
ysandeepits* failing from long16:20
rlandyyes16:21
ysandeepthanks!16:21
*** udesale_ has joined #oooq16:22
ysandeeprlandy, i will try to fix standalone-on-multinode-ipa on monday for 17 line16:23
rlandyysandeep: I have a fix16:23
ysandeeprlandy, oh great!16:23
rlandyjust have not merged it yet16:23
*** udesale__ has quit IRC16:24
*** ykarel is now known as ykarel|away16:29
mariosweshay|ruck: fyi did a bit of digging example copy/pasted there if you wanted to play https://review.opendev.org/c/openstack/tripleo-ci/+/781769/1/test.dhall#2 ... not convinced yet we need this yet ;)16:38
ysandeepweshay|ruck, rlandy  https://code.engineering.redhat.com/gerrit/231759 Update 16.2 and 17 component riteria file16:42
ysandeepUpdate 16.2 and 17 component criteria file16:42
rlandyysandeep: voted16:43
*** ysandeep is now known as ysandeep|away16:50
raukadahcgoncalves: sorry just came back, weshay|ruck rlandy we can hold off kvm patches merge, we have issues there, we can work on monday to fix it17:09
weshay|ruckraukadah++17:09
raukadahrlandy: weshay|ruck more context here https://review.rdoproject.org/r/c/testproject/+/3257317:12
rlandysure17:13
*** marios is now known as marios|out17:17
*** jmasud has quit IRC17:19
*** jmasud has joined #oooq17:20
*** dtantsur is now known as dtantsur|afk17:21
*** ykarel|away has quit IRC17:31
*** marios|out has quit IRC17:32
*** jmasud has quit IRC17:43
*** udesale_ has quit IRC17:46
*** jmasud has joined #oooq17:51
*** jmasud has quit IRC17:51
*** skramaja has quit IRC18:28
*** rlandy is now known as rlandy|training18:57
*** jmasud has joined #oooq19:12
*** jmasud has quit IRC19:15
*** jmasud has joined #oooq19:35
*** jmasud has quit IRC19:38
*** jmasud has joined #oooq19:39
*** jmasud has quit IRC19:39
*** jmasud has joined #oooq19:43
*** jmasud has quit IRC19:50
*** jmasud has joined #oooq20:02
*** rlandy|training is now known as rlandy20:04
*** jmasud has quit IRC20:09
*** jmasud has joined #oooq20:11
rlandyweshay|ruck: re: https://code.engineering.redhat.com/gerrit/#/c/231752/ linters failure - node failure This build does not exist20:17
rlandyI know I always mess up there - but this time, it's actually not me :)20:17
*** jmasud has quit IRC20:17
rlandyweshay|ruck: ysandeep|away wanted us to promoted 16.220:20
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-16.2/3b8e731/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz20:20
rlandywe have that fs001 failure20:20
*** jmasud has joined #oooq20:22
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-16.2/3b3dc37/job-output.txt20:22
rlandy^^ passed on previous run20:22
rlandyweshay|ruck: ok to promote???20:23
weshay|rucksec20:23
rlandyon the promoter20:23
*** jmasud has quit IRC20:36
*** jmasud has joined #oooq20:52
weshay|ruckrlandy, ok.. looking20:57
weshay|ruckrlandy, aye... let's promote20:59
weshay|ruckbm passed w/ flying colors21:00
weshay|ruckrlandy, I'm running the promo for 16.221:02
rlandyweshay|ruck: cool - thanks21:03
*** jmasud has quit IRC21:05
*** jmasud has joined #oooq21:11
*** rlandy has quit IRC21:15
*** jmasud has quit IRC21:34
*** jmasud has joined #oooq21:38
*** jmasud has quit IRC21:48
*** jmasud has joined #oooq21:49
*** jmasud has quit IRC22:09
*** dpawlik has quit IRC22:11
*** akahat has quit IRC22:11
*** dpawlik9 has joined #oooq22:12
*** dpawlik9 is now known as dpawlik22:13
*** jmasud has joined #oooq22:13
*** jpena|off has quit IRC22:16
*** jmasud has quit IRC22:17
*** jpena|off has joined #oooq22:18
*** jmasud has joined #oooq22:18
*** akahat has joined #oooq22:19
*** jmasud has quit IRC22:37
*** jmasud has joined #oooq22:42
*** sshnaidm|off has quit IRC22:54
*** jmasud has quit IRC23:00
*** jmasud has joined #oooq23:14
*** jmasud has quit IRC23:20
*** jmasud has joined #oooq23:43
*** jmasud has quit IRC23:46
*** holser has quit IRC23:49

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!