Friday, 2017-01-13

ianwok, what does losetup show /dev/loop2 connected to inside docker?00:00
pabelangerI created my own loop00:02
pabelangerbut00:02
pabelanger# losetup /dev/loop3 --show00:02
pabelanger/dev/loop3: [002d]:832 (/disk.img)00:02
pabelangerI can do it from DIB too00:02
pabelangerstrace http://paste.openstack.org/show/594790/00:02
ianwhmmm00:07
ianwthat's a file-system layer rejection?00:07
pabelangernot sure00:08
pabelanger/ is aufs00:08
pabelangerinside docker00:08
pabelangerbut loop3 is ext400:08
ianwi strongly suspect that is getting in the way somehow00:09
pabelangerand likely the reason why people don't run fstrim in docker :)00:10
ianwdamn it what has the kernel done with the fs ioctl path ...00:12
ianwyay, goes through a whole big compatability layer thing00:14
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Easy diskimage-builder development environment setup  https://review.openstack.org/41965500:22
pabelangerianw: ya, have no idea how to proceed here00:24
pabelangerI could try a different file system00:25
pabelangeroverlayfs00:26
pabelangerbut, don't think my kernel supports it00:26
ianwcan i log in to poke, or is this a local system?00:26
pabelangeryou should have credentials, this is infracloud-vanilla00:28
pabelangerianw: ssh 15.184.65.18300:29
pabelangerianw: https://review.openstack.org/#/c/415927/200:31
pabelangercheck out the comments00:31
pabelangerI'm going to build a xenial system tomorrow and try again00:31
pabelangerthen, maybe just update our docs00:31
ianwhow do i get into the docker container?00:32
ianw"sudo docker run --privileged=true --cap-add=ALL -t -i nodepool-builder /bin/bash" as you?  is that the one failed?00:33
pabelangersudo docker run --privileged=true --cap-add=ALL -t -i nodepool-builder /bin/bash00:33
pabelangerwill create a new container for you00:33
pabelanger/opt/venv/diskimage-builder is the virtualenv in the container00:34
pabelangerwith a wrapper script at /usr/local/bin/disk-image-create00:34
ianwok cool, right i got that failure00:36
pabelangerI'm building a xenial container now00:37
ianwpabelanger: http://paste.openstack.org/show/594792/ this suggests strongly to me that apparmor is getting involved here00:55
pabelangerHmm00:58
pabelangerianw: we can quickly disable apparmor00:59
pabelangerand try again00:59
ianwi think i did, or put it in complain mode00:59
ianwlet me see00:59
pabelangerjust import ubuntu-xenial container now01:00
ianwroot@pabelanger-test:/tmp# fstrim ./mnt01:09
ianwfstrim: ./mnt: FITRIM ioctl failed: Operation not supported01:09
ianwthis is from *outside* the docker container01:09
pabelangerHmm01:09
pabelangerI've just build a xenial node now01:09
pabelangerokay, command running01:10
pabelangerianw: I am not sure why it is failing, i have built qcow2 images on that server01:10
ianwthis is trying to use the loopback mount in the docker outside it01:11
pabelangeroh01:11
ianwhttp://paste.openstack.org/show/594793/01:12
ianwthat's the trace when it works01:12
pabelangerianw: how did you get it to graph like that?01:13
ianwtrace-cmd, uses ftrace01:13
pabelangerk01:13
ianw                if (!blk_queue_discard(q))01:14
ianw                        return -EOPNOTSUPP;01:14
ianwwhich is the error we see01:14
ianwi wonder what that means01:14
pabelangerianw: okay, just got it working under ubuntu-xenial01:14
pabelanger/dev/loop0: [64769]:4735612 (/var/lib/docker/aufs/diff/e3060103e9f402e9084b42da67d1fb9c4e5b32ae05a18873a5181617af328850/tmp/dib_image.X45D7ssy/image.raw)01:14
ianwif the device does not support discard01:15
ianwthat is so weird because both here are I think loopback devices to a ext4 image in tmpfs01:15
ianwpabelanger: wait, so under xenial you don't see this problem at all with fstrim?01:16
pabelangerianw: correct01:16
pabelangerianw: ssh 15.184.67.15901:16
pabelangersudo docker run --privileged=true --cap-add=ALL -t -i diskimage-builder /bin/bash01:16
pabelangerdisk-image-create --no-tmpfs -n -o ubuntu-minimal ubuntu-minimal01:17
pabelangerworks as expected01:17
pabelangerso, i wonder if the kernel I am running in trusty, has problems01:17
ianwi think it's quite likely that something has happened between the kernel, aufs, the block layers and who knows what01:18
pabelangeri would agree01:19
pabelangerso, for now, I can abandon my patch01:19
pabelangermaybe add something to docs about know issues01:19
pabelangerI was planning on switching to xenial anyways :)01:19
pabelangerk, going to drop for the night.01:22
pabelangerianw: thanks for yak shaving with me01:22
ianwhmm, yeah, i'll shave a bit more, but otherwise i think it's probably not worth chasing down too far01:22
ianwcertainly the xenial behavior, being able to trim the loopback from within docker, is what i would *expect* to see01:23
ianwcheers01:23
openstackgerritLeehom Li proposed openstack/diskimage-builder: Fix problem unable disable iptables service  https://review.openstack.org/41970301:35
ianwok, i think i get it now.  i'll drop a comment01:46
*** aparnav has joined #openstack-dib03:37
*** aparnav has quit IRC03:39
*** sudipto has joined #openstack-dib05:18
*** sudipto_ has joined #openstack-dib05:18
openstackgerritIan Wienand proposed openstack/diskimage-builder: Also check bin/ for tabs  https://review.openstack.org/41977006:01
openstackgerritMerged openstack/diskimage-builder: Make DHCP timeout configurable  https://review.openstack.org/41667506:19
*** aparnav has joined #openstack-dib06:40
*** TheJulia has quit IRC07:29
*** TheJulia has joined #openstack-dib07:34
*** yolanda has quit IRC08:18
*** yolanda has joined #openstack-dib08:19
*** hashar has joined #openstack-dib09:44
*** openstackgerrit has quit IRC10:18
*** yolanda has quit IRC10:23
*** yolanda has joined #openstack-dib10:24
*** yolanda has quit IRC10:26
*** yolanda has joined #openstack-dib10:27
*** yolanda has quit IRC10:39
*** yolanda has joined #openstack-dib10:41
*** yolanda has quit IRC10:46
*** yolanda has joined #openstack-dib10:49
*** yolanda has quit IRC10:49
*** yolanda has joined #openstack-dib10:49
*** sudipto_ has quit IRC11:05
*** sudipto has quit IRC11:05
*** owalsh has joined #openstack-dib11:11
*** appu103 has joined #openstack-dib11:14
*** aparnav has quit IRC11:17
*** appu103 has quit IRC12:08
*** sudipto_ has joined #openstack-dib13:19
*** sudipto has joined #openstack-dib13:19
*** hashar has quit IRC13:35
*** tommylikehu has quit IRC14:33
*** tommylikehu has joined #openstack-dib14:34
*** yolanda has quit IRC14:50
*** yolanda has joined #openstack-dib14:50
*** yolanda has quit IRC14:54
*** yolanda has joined #openstack-dib14:54
*** yolanda has quit IRC14:55
*** yolanda has joined #openstack-dib14:56
*** yolanda has quit IRC14:57
*** yolanda_ has joined #openstack-dib14:59
*** yolanda_ has quit IRC14:59
*** yolanda_ has joined #openstack-dib14:59
*** yolanda__ has joined #openstack-dib15:00
*** yolanda_ has quit IRC15:01
*** yolanda__ is now known as yolanda15:01
*** yolanda has quit IRC16:35
*** yolanda has joined #openstack-dib16:42
*** yolanda has quit IRC16:51
*** yolanda has joined #openstack-dib16:59
*** sudipto has quit IRC17:01
*** sudipto_ has quit IRC17:01
*** yolanda has quit IRC17:04
*** yolanda has joined #openstack-dib17:08
*** openstackgerrit has joined #openstack-dib18:01
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Easy diskimage-builder development environment setup  https://review.openstack.org/41965518:01
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Move evaluation of init system to chroot phases  https://review.openstack.org/41417918:09
*** owalsh has quit IRC18:28
*** owalsh has joined #openstack-dib18:29
openstackgerritMerged openstack/diskimage-builder: Also check bin/ for tabs  https://review.openstack.org/41977018:33
*** openstack has joined #openstack-dib18:58
*** jamielennox is now known as jamielennox|away19:12
*** openstack has joined #openstack-dib19:58
openstackgerritMerged openstack/diskimage-builder: Handle failure of carrier check in dhcp-all-interfaces.sh  https://review.openstack.org/41952720:11
*** openstack has joined #openstack-dib20:28
*** ashestakov has joined #openstack-dib21:11
openstackgerritAndrey Shestakov proposed openstack/diskimage-builder: Fix dhcp-all-interfaces for ubuntu-minimal xenial  https://review.openstack.org/40772521:12
openstackgerritAndrey Shestakov proposed openstack/diskimage-builder: Add DIB_IPA_COMPRESS_CMD option  https://review.openstack.org/41659321:13
*** jamielennox|away is now known as jamielennox21:59
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Bump fedora release to 25  https://review.openstack.org/41955922:34
*** pmannidi has quit IRC22:57
openstackgerritPaul Belanger proposed openstack/diskimage-builder: Start with an empty environment for chroot  https://review.openstack.org/41386823:41
*** tommylikehu has quit IRC23:46
*** tommylikehu has joined #openstack-dib23:46
*** ashestakov has quit IRC23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!