Friday, 2019-05-10

*** igordc has quit IRC00:51
*** sarob has joined #kata-dev03:56
*** sameo has joined #kata-dev04:43
kata-irc-bot2<eric.ernst> @bergwolf @zhangwei555 PTAL @ https://github.com/kata-containers/runtime/pull/164805:10
kata-irc-bot2<eric.ernst> and https://github.com/kata-containers/packaging/pull/49705:10
kata-irc-bot2<eric.ernst> Want to get these in for the RC that *will* happen tomorrow!05:10
*** sarob has quit IRC05:17
*** tmhoang has joined #kata-dev05:28
*** gnawux has joined #kata-dev06:12
*** sarob has joined #kata-dev06:13
*** sarob has quit IRC06:19
*** gnawux has quit IRC06:22
*** sarob has joined #kata-dev06:46
*** sameo has quit IRC06:49
*** sgarzare has joined #kata-dev07:08
*** sarob has quit IRC07:19
*** gwhaley has joined #kata-dev07:23
*** jodh has joined #kata-dev07:25
*** sgarzare has quit IRC07:42
*** sameo has joined #kata-dev07:42
*** sgarzare has joined #kata-dev07:44
*** sarob has joined #kata-dev07:48
*** davidgiluk has joined #kata-dev08:04
brtknryankcrime: sorry it wasnt synced properly it seems, looking okay now?08:21
*** sarob has quit IRC08:22
yankcrimebrtknr: yeah looks good08:34
gwhaleybrtknr: is updated to Intel here now ;-)08:34
brtknrit was rsync playing up...08:35
yankcrimersync never plays up08:36
yankcrimesuspect pebcak08:36
brtknryankcrime: thats a true believer08:42
yankcrime:D08:43
brtknrstefanha: I am updating the blog now with the fio_jobfile used09:17
brtknrstefanha: Please refresh09:18
stefanhabrtknr: thanks!09:32
*** lpetrut has joined #kata-dev10:35
*** tmhoang has quit IRC10:48
*** tmhoang has joined #kata-dev10:49
*** tmhoang has quit IRC10:56
*** tmhoang has joined #kata-dev10:56
*** gwhaley has quit IRC11:00
*** gwhaley has joined #kata-dev12:06
*** eernst has joined #kata-dev14:20
*** lpetrut has quit IRC14:43
*** lpetrut has joined #kata-dev14:47
*** kgz has quit IRC14:50
*** kragniz has joined #kata-dev14:51
*** kragniz is now known as kgz14:51
*** sameo has quit IRC14:51
*** lpetrut has quit IRC14:57
kata-irc-bot2<james.o.hunt> whoa...! We're down to 48 PRs non-do-not-merge PRs in the backlog! Can we get it down to 40 by COB folks? :-)15:01
kata-irc-bot2<eric.ernst> how do you query this, @james.o.hunt15:02
gwhaleyhah, I think we just got a bunch of new release ones jodh... prolly bumped it again!15:02
gwhaleythe primary link to the search is on the herders page15:02
kata-irc-bot2<eric.ernst> I just merged most of those, so we may be ok Graham15:02
kata-irc-bot2<eric.ernst> oh, shame.15:03
gwhaleythen you tweak the search a little to only look at the DNM and do the head math - is what I do..15:03
gwhaleyso, here is the 'find all DNM pr's' link... https://github.com/search?q=org%3Akata-containers+is%3Apr+is%3Aopen+%21label%3Ado-not-merge15:04
gwhaleyI wonder if you can negate that label bit...15:04
gwhaley(I know github doesn't support multi label searches there - grrrr)15:04
gwhaleyoops, drop the not... https://github.com/search?q=org%3Akata-containers+is%3Apr+is%3Aopen+label%3Ado-not-merge15:05
kata-irc-bot2<james.o.hunt> @graham.whaley - you can negate a label by adding a leading dash: https://github.com/pulls?utf8=%E2%9C%93&q=is%3Aopen+is%3Apr+org%3Akata-containers+-label%3Ado-not-merge15:05
kata-irc-bot2<james.o.hunt> 47 y'all!15:06
kata-irc-bot2<james.o.hunt> 45 if we exclude wip too: https://github.com/pulls?utf8=%E2%9C%93&q=is%3Aopen+is%3Apr+org%3Akata-containers+-label%3Ado-not-merge+-label%3Awip15:07
kata-irc-bot2<james.o.hunt> 44!15:08
gwhaleyyep, got it - the magic is the '-' in front of the search item. thx15:08
kata-irc-bot2<james.o.hunt> low-hanging fruit @jose.carlos.venegas.m / @eric.ernst - https://github.com/kata-containers/osbuilder/pull/27615:09
kata-irc-bot2<james.o.hunt> 42 after adding missing wip labels to two wip PRs!15:11
kata-irc-bot2<james.o.hunt> down to 41 as another PR was missing a label15:12
stefanhaeric.ernst: Daniel Berrange <berrange@redhat.com> ("danpb" on IRC) from libvirt is happy to review code and answer questions about libvirt and the Go bindings.  API: https://godoc.org/github.com/libvirt/libvirt-go, XML API: https://godoc.org/github.com/libvirt/libvirt-go-xml15:13
kata-irc-bot2<eric.ernst> Thanks Stefan!15:15
kata-irc-bot2<james.o.hunt> Down to 40!: https://github.com/pulls?page=1&q=is%3Aopen+is%3Apr+org%3Akata-containers+-label%3Ado-not-merge+-label%3Awip&utf8=%E2%9C%9315:19
kata-irc-bot2<eric.ernst> 39!15:19
kata-irc-bot2<james.o.hunt> That isn't 40 factorial btw... ;)15:19
kata-irc-bot2<james.o.hunt> \o/15:19
kata-irc-bot2<james.o.hunt> :fireworks: :fire: :fire: :fire:15:19
kata-irc-bot2<xu> :,)15:20
kata-irc-bot2<eric.ernst> now if we could just merge https://github.com/kata-containers/osbuilder/pull/20015:20
kata-irc-bot2<eric.ernst> :)15:20
kata-irc-bot2Action: james.o.hunt whistles... and then goes to look at that ol' :chestnut: ...15:21
kata-irc-bot2<james.o.hunt> 38!15:22
kata-irc-bot2Action: graham.whaley wonders if james.o.hunt is just going around slapping DNM on everything :-)15:23
kata-irc-bot2<eric.ernst> hehe15:23
kata-irc-bot2<graham.whaley> so... fine - when we write our weekly reports, we can report both numbers - but, let's not completely ignore the big pile of DNMs eh :slightly_smiling_face:15:23
kata-irc-bot2<eric.ernst> @archana.m.shinde around?15:23
kata-irc-bot2<eric.ernst> I think we need someone to take over https://github.com/kata-containers/runtime/pull/1233, https://github.com/kata-containers/runtime/pull/120815:24
kata-irc-bot2<eric.ernst> stale-bot ftw?15:24
kata-irc-bot2<eric.ernst> GH is supposed to announce new feature today.. .maybe GH actions gA?15:25
kata-irc-bot2<james.o.hunt> @graham.whaley now there's an idea. That, or `hub-merge --all --jfdi` ;)15:26
kata-irc-bot2<graham.whaley> jodh, if you happen to add a link to show all non-dnm non-wip PRs to the herders wiki page... ;)  Otherwise, I'll probably do it on Monday when I do the next herding email15:27
kata-irc-bot2<graham.whaley> what we need is a banner/ticker that shows the counts....hehe15:28
kata-irc-bot2<james.o.hunt> @graham.whaley - I've tweaked https://github.com/kata-containers/community/wiki/Review-Team-Rota15:40
kata-irc-bot2<gmmaharaj> stefanha: have you ever tested virtio-fs with vm templating &/or initrd images?15:41
kata-irc-bot2<gmmaharaj> also i am thinking we will reduce the default cache size to 1024/2048 given that all our Ci will happen on VMs which are barely either 4G or 8G RAM size. and if i am right today, if the total ram is smaller than the cache size, virtio-fs fails to start.15:42
davidgilukhmm why should it fail to start15:45
davidgilukI'd have to check but I think I mmap a /dev/zero and give it no perms, but I'd hoped that wouldn't consume anything useful15:45
kata-irc-bot2Action: gmmaharaj goes to get the exact error message15:46
gmmahadavidgiluk: you will hit this error if the cache size is bigger than the total ram in the machine.15:48
gmmahadocker: Error response from daemon: OCI runtime create failed: qemu-system-x86_64: /home/ganeshma/qemu/memory.c:2155: memory_region_get_ram_ptr: Assertion `mr->ram_block' failed.: unknown.15:48
davidgilukgmmaha: My challenge is that I need to reserve virtual address space for the cache; it should never really get any memory15:49
davidgilukbut I can see depending on the ulimit perhaps ulimit is doing that15:49
kata-irc-bot2<eric.ernst> @james.o.hunt question on yq.... what's the rationale for checking for yq only in the GOPATH/bin directory?15:51
kata-irc-bot2<graham.whaley> iirc, there are two `yq`s in the wild, and our scripts always pull the one we want vi go/github. but, I could be confusing with jq...15:54
gmmahadavidgiluk: these are the ulimit settings.15:54
gmmahacore file size          (blocks, -c) 015:54
gmmahadata seg size           (kbytes, -d) unlimited15:54
gmmahascheduling priority             (-e) 015:54
gmmahafile size               (blocks, -f) unlimited15:54
gmmahapending signals                 (-i) 1970815:54
gmmahamax locked memory       (kbytes, -l) 1638415:54
gmmahamax memory size         (kbytes, -m) unlimited15:54
gmmahaopen files                      (-n) 102415:54
gmmahapipe size            (512 bytes, -p) 815:54
gmmahaPOSIX message queues     (bytes, -q) 81920015:54
gmmahareal-time priority              (-r) 015:54
gmmahastack size              (kbytes, -s) 819215:54
gmmahacpu time               (seconds, -t) unlimited15:54
gmmahamax user processes              (-u) 1970815:54
gmmahavirtual memory          (kbytes, -v) unlimited15:54
gmmahafile locks                      (-x) unlimited15:54
davidgilukgmmaha: So this is just running it inside a small VM with no overcommit/swap?15:55
gmmahadavidgiluk: yup.15:56
davidgilukgmmaha: OK, can you file a github issue against our qemu/github tree and that will keep me honest so I can't forget about it15:56
gmmahadavidgiluk: :) you got it. will do!15:57
davidgilukgmmaha: You should be OK running with say 256MB or 512MB cache if you're a bit tight for space15:57
gmmahadavidgiluk: right. anything smaller than the total ram and i am fine. given that we know kata's CI runs on VMs that are not really big, i think dropping the default to 1024 or 2048 in kata's config might be good for the mostpart15:58
davidgilukgmmaha: It should at least fail more cleanly than that16:02
kata-irc-bot2<james.o.hunt> @eric.ernst - yep, @graham.whaley's correct - we're trying to avoid using the python version (https://github.com/kislyuk/yq) by mistake.16:03
*** lpetrut has joined #kata-dev16:06
kata-irc-bot2<eric.ernst> sigh.  OK - cool.16:06
*** iamweswilson has joined #kata-dev16:22
*** sameo has joined #kata-dev16:23
*** sgarzare has quit IRC16:56
*** gwhaley has quit IRC17:05
*** jodh has quit IRC17:06
*** sarob has joined #kata-dev17:10
*** lpetrut has quit IRC17:17
*** tmhoang has quit IRC17:28
kata-irc-bot2<manohar.r.castelino> davidgiluk we have a second issue with virtio-fs... when running it with kubernetes we hotplug memory as we start with a small VM. So the hotplugged DIMMs are not visible to the the daemon... so we will need to support hotplug for us leverage virtio-fs in k8s17:42
davidgilukmanohar: Interesting, I'd not tried hotplugging, the theory is that we should get a new 'set_mem_table' message over the vhost user to tell us about the new mapping; how upset the daemon gets about it's mapping changing is an interesting question17:44
*** psyton has joined #kata-dev17:51
*** tmhoang has joined #kata-dev17:53
kata-irc-bot2<eric.ernst> davidgiluk one thing I notice in my testing is that if I use vsock, things fail.18:14
kata-irc-bot2<eric.ernst> "things fail" -- virtiofsd is defunct and timeout/failure for creating a container.18:14
kata-irc-bot2<eric.ernst> if I disable vsock, it starts up fine.18:14
*** sarob has quit IRC18:25
davidgilukmanohar: I had an idea; can you give me details about how you're hot plugging the dimm?  It has to be shared in the right way for the daemon to see it18:28
davidgilukeernst: That's fun, the two *should* be entirely separate18:28
davidgilukeernst: Again, can you file a github bug against one of our components please18:29
*** sarob has joined #kata-dev18:56
*** dklyle_ has joined #kata-dev19:02
*** david-lyle has quit IRC19:04
kata-irc-bot2<eric.ernst> @gmmaharaj PTAL: https://github.com/kata-containers/runtime/pull/166319:22
*** davidgiluk has quit IRC19:31
*** sarob has quit IRC19:43
kata-irc-bot2<gmmaharaj> @eric.ernst quick small feedback on the change. otherwise it's good.19:44
kata-irc-bot2<gmmaharaj> quick check and i can approve it.19:44
kata-irc-bot2<eric.ernst> that's just matching how it is done in qemu's toml19:45
kata-irc-bot2<gmmaharaj> alright.19:50
kata-irc-bot2<gmmaharaj> that ought to work19:50
kata-irc-bot2<gmmaharaj> ohh @eric.ernst you need to fix the commit msg. ``` Found 1 commit between commit c8c167caab5144409d75a6e24d45ff9dad40b2e1 and branch master ERROR: No "Fixes" found + rc=1 + '[' 1 -ne 0 ']' + cat ERROR: checkcommits failed. See the document below for help on formatting commits for the project.  https://github.com/kata-containers/community/blob/master/CONTRIBUTING.md#patch-format ```19:50
kata-irc-bot2<eric.ernst> repushed19:51
*** iamweswilson has left #kata-dev20:25
*** iamweswilson has joined #kata-dev20:25
*** sameo has quit IRC20:41
*** tmhoang has quit IRC20:48
*** gmmaharaj has joined #kata-dev21:04
*** gmmaha has quit IRC21:05
*** gmmaharaj is now known as gmmaha21:05
*** gmmaha has quit IRC21:34
*** gmmaha has joined #kata-dev21:36
*** sarob has joined #kata-dev21:45
*** sarob has quit IRC22:31
*** eernst has quit IRC22:32
*** eernst has joined #kata-dev22:36

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!