Thursday, 2014-03-13

openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Fix nova-bm race condition with cached images.  https://review.openstack.org/7863600:01
openstackgerrittom-howley proposed a change to openstack/tripleo-incubator: Wait for baremetal nodes before creating undercloud stack.  https://review.openstack.org/7863600:01
lifelesshah00:01
lifelesstomh_: hi ;) - sorry for stomping on your change, was meaning to save you effort (and I had to scratch the itch as I was hitting the race myself)00:01
lifelessalso LOL gerrit race conditions00:02
lifelessclarkb: ^00:02
lifelessclarkb: have a look at that patch00:02
clarkbthats awesome00:03
clarkbit thinks patchset 4 is the latest00:03
lifelessyeah00:04
lifeless*how* good was the timing on that00:04
lifelessSpamapS: real    23m8.952s00:04
lifelessuser    0m45.666s00:04
lifelesssys     0m13.251s00:04
*** lblanchard has quit IRC00:05
lifelessSpamapS: thats devtest end to tend with --trash-my-machine -c00:05
ccrouch1lifeless: Ng: thank you kindly re:  https://review.openstack.org/7200300:08
ccrouch1baremetal fedora deployments salute you!00:08
* lifeless runs another timing test00:09
*** CaptTofu has joined #tripleo00:12
*** lazy_prince has quit IRC00:12
openstackgerrittom-howley proposed a change to openstack/tripleo-incubator: Wait for baremetal nodes before creating undercloud stack.  https://review.openstack.org/7863600:13
*** killer_prince has joined #tripleo00:13
*** slagle has joined #tripleo00:17
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Set -x on under and overcloud scripts.  https://review.openstack.org/8012500:17
*** ramishra has quit IRC00:17
*** rpodolyaka has quit IRC00:17
*** ramishra has joined #tripleo00:18
*** ramishra has quit IRC00:18
*** ramishra has joined #tripleo00:18
SpamapSlifeless: I suspect I am waiting on my disk for some reason00:18
StevenKlifeless: 80104 failing on overcloud is likely very related to my review comments.00:19
slaglereview plz: https://review.openstack.org/#/c/78017/ (it has passed CI)00:20
lifelessStevenK: thanks00:20
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Stop editing config.json.  https://review.openstack.org/8011000:22
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Put overcloud state into testenv.json.  https://review.openstack.org/8010400:22
*** ramishra has quit IRC00:22
*** Lotus907efi is now known as Lotus907efi-00:23
tchayposlagle: i like your comments about not needing ./ at all00:25
lifelessslash dot dash dot00:25
tchayposlagle: but I'm thinking that in that case devtest.sh doesn't need to use $(dirname $0)/ either - it will have the scripts in the path as well00:25
tchayposo rather than trying to figure out some awk magic to make it replace $(dirname $0) with one string on some lines and a different string on other lines - I'll just remove it in all cases except for the line that sources devtest_variables00:26
*** matsuhashi has joined #tripleo00:27
*** rpodolyaka has joined #tripleo00:27
tchaypodoes that sound reasonable?00:27
StevenKlifeless: Okay, so, run testenv with one extra node, _seed, setup-baremetal and then _overcloud, right?00:27
StevenKlifeless: Or shall I spend time on a CI job for CIing CI changes? :-)00:27
*** saurabhs has left #tripleo00:28
SpamapSStevenK: that failed my internal CI00:28
SpamapSresult: english-language-parse: SUCCESS, recursive-logic-completion: SUCCESS, funny-or-serious: FAILED00:29
StevenKSpamapS: I have a ensure-test-env change I'd like to test, and while lifeless was telling me how to do so locally, came up with the idea that we could have a CI job that does it for us.00:30
*** sdague has quit IRC00:30
lifelessStevenK: I don't think thats an exclusive condition :>00:30
lifelessStevenK: but for now, suggest manual testing is all we need00:30
openstackgerritA change was merged to openstack/tripleo-heat-templates: Add heat.stack_domain_admin_password  https://review.openstack.org/7801700:30
lifelessStevenK: since the testenv plumbing is relatively rare to change00:31
* SpamapS wonders how those words will taste...00:32
SpamapS;)00:32
lifelessSpamapS: did not say does not, just relatively :)00:32
StevenKHaha00:32
SpamapSslagle: I recheck no bugged https://review.openstack.org/#/c/78020/00:34
SpamapSslagle: do you expect to push another revision?00:34
*** sdague has joined #tripleo00:35
*** victor_lowther_ has quit IRC00:49
*** hewbrocc` has joined #tripleo00:51
*** hewbrocca has quit IRC00:53
*** victor_lowther_ has joined #tripleo00:54
*** julim has quit IRC00:56
*** cwolferh has quit IRC01:03
SpamapSgah.. merge.py makes me cry01:11
*** matsuhashi has quit IRC01:11
*** matsuhashi has joined #tripleo01:14
*** rbrady-afk is now known as rbrady01:18
rbradySpamapS: if you have any time, I'm looking to get reviews on my cinder element refactor: https://review.openstack.org/#/c/74563/01:19
SpamapSrbrady: a bit head down on HA stuff right now, but I'll make sure it gets a look when I sweep reviews next01:19
rbradySpamapS: thanks.01:20
*** CaptTofu has quit IRC01:24
*** CaptTofu has joined #tripleo01:24
*** ramishra has joined #tripleo01:28
*** jp_at_hp has joined #tripleo01:28
*** CaptTofu has quit IRC01:29
*** fungi has quit IRC01:29
*** matsuhashi has quit IRC01:31
*** matsuhashi has joined #tripleo01:31
*** matsuhashi has quit IRC01:32
*** ramishra has quit IRC01:33
*** spzala has joined #tripleo01:35
*** matsuhashi has joined #tripleo01:35
slagleSpamapS: i don't plan to...unless it needs it01:37
*** jp_at_hp1 has joined #tripleo01:40
*** blamar has quit IRC01:41
*** ohadlevy has quit IRC01:41
*** jp_at_hp has quit IRC01:42
*** nosnos has joined #tripleo01:46
*** ohadlevy has joined #tripleo01:56
*** ohadlevy is now known as Guest6508101:56
*** rpodolyaka has quit IRC01:58
*** killer_prince is now known as lazy_prince02:07
*** rpodolyaka has joined #tripleo02:08
*** weshay has quit IRC02:10
*** CaptTofu has joined #tripleo02:10
StevenKlifeless: setup-baremetal died in the same way as yesterday with a fresh seed :-(02:16
StevenKIn other news, I have successfully battled EEM02:18
*** rpodolyaka has quit IRC02:21
lifelessStevenK: what way is that?02:22
*** vkozhukalov has quit IRC02:25
StevenKTiming out after 600 seconds:02:34
StevenKCOMMAND=nova baremetal-node-create devtest_canary 1 1 1 11:22:33:44:55:6602:34
StevenKThat's calling setup-baremetal $TE_DATAFILE --service-host seed --not-first with a fresh seed02:35
*** matsuhashi has quit IRC02:45
*** matsuhashi has joined #tripleo02:45
*** matsuhashi has quit IRC02:46
*** killer_prince has joined #tripleo02:46
*** matsuhashi has joined #tripleo02:46
*** matsuhashi has quit IRC02:47
*** matsuhashi has joined #tripleo02:47
*** matsuhashi has quit IRC02:48
*** lazy_prince has quit IRC02:48
*** matsuhashi has joined #tripleo02:49
*** matsuhashi has quit IRC02:49
*** matsuhashi has joined #tripleo02:50
lifelessStevenK: so what happens if you run that by hand02:53
*** rpodolyaka has joined #tripleo02:53
lifelessStevenK: after sourcing seedrc ?02:53
*** giulivo has quit IRC02:53
lifeless(or undercloudrc, if it times out on the undercloud)02:53
*** rpodolyaka has quit IRC02:54
lifelesserm, seed. right.02:54
*** rpodolyaka has joined #tripleo02:54
StevenKlifeless: Ah ha02:58
*** rbrady is now known as rbrady-afk03:00
lifelessStevenK: ...03:08
lifelessStevenK: by which I mean, tell me more.03:09
StevenKlifeless: sourcing in the seedrc was the step I was missing03:20
*** spzala has quit IRC03:26
lifelessStevenK: right, but whats happening, do you get an error ?03:33
openstackgerritA change was merged to openstack/diskimage-builder: Enable extlinux support for (non-Ubuntu) Debian platforms  https://review.openstack.org/7719003:34
StevenKlifeless: Hah, I just had undercloud die horribly03:38
StevenKEr, overcloud03:38
StevenKToo many clouds03:38
StevenKmv: writing '/tmp/image.9nVeGnDO/mnt/opt/stack/keystone/.git/objects/95/6126d8c830e3dd30cc39068a757c61a5816dc0': Read-only file system03:39
StevenK[58326.947957] loop: Write error at byte offset 16596992, length 4096.03:39
StevenK[58326.947959] loop: Write error at byte offset 16601088, length 4096.03:39
lifelessStevenK: you might try this patch https://review.openstack.org/#/c/79362/03:42
*** jp_at_hp1 has quit IRC03:48
*** matsuhashi has quit IRC03:49
StevenKlifeless: You don't seem convinced about that patch03:50
lifelessStevenK: I'm worried about the perf implications03:51
StevenKHmm03:51
*** vkozhukalov has joined #tripleo03:51
StevenK+ IMAGE_NAME=/home/steven/.cache/tripleo/deploy-ramdisk03:51
StevenK+ cp /tmp/image.m3nkqph6/mnt/tmp/ramdisk /home/steven/.cache/tripleo/deploy-ramdisk.initramfs03:51
lifelessStevenK: I'm also skeptical that the explanation about mv's behaviour is correct.03:51
StevenKcp: cannot open '/tmp/image.m3nkqph6/mnt/tmp/ramdisk' for reading: Permission denied03:51
lifelessmv -v might show it more usefully03:51
*** rpodolyaka has quit IRC03:51
StevenKI think mv does unlink() after a file is copied, but I'm not certain if mv -v shows that03:52
*** CaptTofu has quit IRC04:03
*** rpodolyaka has joined #tripleo04:22
StevenKWaiting for the overcloud stack to be ready04:45
StevenKlifeless: Do I then inject my image into the overcloud?04:46
*** matsuhashi has joined #tripleo04:47
*** lazy_prince has joined #tripleo04:49
lifelessStevenK: under04:52
lifelessStevenK: testenv is deployed on bm04:52
*** akuznetsov has joined #tripleo04:52
lifelessStevenK: unless you built it with vm, of course04:52
StevenKlifeless: It is built with the vm element, yes04:53
lifelessStevenK: in which case, yes :>04:53
StevenKlifeless: So I source overcloudrc and then glance it in?04:54
* lifeless fails at a droll but not nasty comeback04:55
lifelessStevenK: (yes, thats what you should do)04:58
openstackgerritOm Kumar proposed a change to openstack/diskimage-builder: Add build-essential for RHEL Cloud Images  https://review.openstack.org/7928605:01
*** xuhaiwei has joined #tripleo05:02
openstackgerritOm Kumar proposed a change to openstack/tripleo-image-elements: Adds local storage Boot support in case PXE boot fails.  https://review.openstack.org/7928905:02
*** blamar has joined #tripleo05:15
StevenK% glance image-list05:17
StevenKYou must provide a password via either --os-password or env[OS_PASSWORD]05:17
StevenKWAT ?05:17
xuhaiweiyou haven't set the environment variables05:18
StevenKOh, blah, it's $OVERCLOUD_ADMIN_PASSWORD05:18
StevenKSo it's probably ''05:19
StevenKWhich it is05:19
StevenKWhere did that get written too ...05:19
*** blamar has quit IRC05:19
*** blamar has joined #tripleo05:20
tchaypoI noticed that we set a bunch of passwords to something like "unset" or "undef" or something05:20
tchaypovery amusing05:20
StevenKThat's the default05:20
StevenKThey get overwritten05:21
xuhaiweiI think it's just the OS_PASSWORD for the openstack, not related to OVERCLOUD_ADMIN_PASSWORD05:21
StevenKHurray, glance image-list works05:25
lifelessStevenK: . os-overcloud-passwords05:41
lifelessxuhaiwei: see overcloudrc05:41
StevenKlifeless: Yeah, I've gotten the image into glance, now I'm trying to get nova to boot it05:42
lifelessStevenK: but https://review.openstack.org/#/c/80104/ will obviously change things05:42
StevenKERROR: Multiple possible networks found, use a Network ID to be more specific.05:42
StevenKa3dfcfa3-ab31-425b-9608-98cab306eae6 | testenv | BUILD  | spawning05:45
StevenKAwww, ERROR | -05:50
openstackgerritJames Polley proposed a change to openstack/tripleo-incubator: Give the user instructions they can follow instead of $(dirname $0)  https://review.openstack.org/7951705:57
*** blamar has quit IRC06:00
*** blamar has joined #tripleo06:01
StevenKlifeless: Do I need to console one of the bm VMs to get nova logs?06:01
lifelessStevenK: ssh heat-admin@....06:03
*** CaptTofu has joined #tripleo06:04
StevenKlifeless: Sorry to be dense, and then what?06:05
*** killer_prince has quit IRC06:05
lifelessStevenK: ubuntu? logs in /var/log/upstart06:05
StevenKHaha, heat-admin can't read them06:06
lifelesssudo su - :)06:06
StevenKITYM sudo -i06:06
lifelesswhatevs06:06
StevenKFile "/06:08
StevenKusr/lib/python2.7/dist-packages/libvirt.py", line 728, in createWithFlags\n    i06:08
StevenKf ret == -1: raise libvirtError (\'virDomainCreateWithFlags() failed\', dom=self06:08
*** CaptTofu has quit IRC06:08
StevenK)\n', u'libvirtError: Unable to read from monitor: Connection reset by peer\n'06:08
StevenKSo, firstly, tracebacks in logs makes me unhappy. Secondly, connection reset by peer in libvirt? :-(06:09
lifelessoh06:09
lifelessqemu right?06:09
lifelessif so flavors with > 2G of RAM simply won't work.06:10
lifelessno matter the size of the host VM06:10
lifelessif you needed a largish flavor for the disk image06:10
StevenKI picked flavor 2, which was 204806:10
lifelesstracebacks in logs are (in the absence of oopstools ;)) a great way to permit post-failure introspection06:10
StevenKSure, they absolutely have benefits, they just make me unhappy06:11
lifeless:)06:12
lifelessmisinterpreted, sorry06:12
* StevenK tries with flavor 106:12
lifelessso anyhow, last time I saw that, it was actually failing to create the domain due to a qemu limitation, the monitor thing was a distraction06:12
StevenKFlavorDiskTooSmall: Flavor's disk is too small for requested image.06:18
StevenKBlah06:18
StevenKSo now I need a new flavor06:18
lifelessyeah, see devtest_overcloud for an example that works with qemu06:19
openstackgerritJames Polley proposed a change to openstack/diskimage-builder: Extract move cache logic to a function  https://review.openstack.org/7944106:20
StevenKlifeless: I just created a new m2.tiny flavor with 1G and 20G of disk06:20
*** rcarrillocruz1 has joined #tripleo06:23
lifelessStevenK: when you deploy it be sure to override the testenv count heuristics06:25
lifelessStevenK: since the machine its deploying to is rather small :>06:25
*** rcarrillocruz has quit IRC06:25
* tchaypo is enjoying gerrit and git review06:28
tchaypomaybe it's my previous experience with its ancestor systems, but I'm more and more convinced that http://bitquabit.com/post/code-reviews-and-bad-habits/ is mostly driven by the author not understanding gerrit - most of the things he says it lacks are actually there06:30
*** rcarrillocruz1 has quit IRC06:30
*** rcarrillocruz has joined #tripleo06:30
SpamapStchaypo: agreed. If we were all git wizards with monk-like email discipline we could this without gerrit .. but we're not, so gerrit makes it all happy times06:31
tchaypothere's no incentive to lump unrelated change together, when git review -d makes it so easy to chain them. There's no hidden history, that's there in the patchsets on the change06:31
tchaypowe'd probably all have to use mutt06:31
tchayposo we could have fancy little shortcuts to do the right git things with the patches we got by email06:31
tchaypoi'm sure that would be popular06:31
SpamapStchaypo: wait till you find -x (cherry pick) .. :)06:31
tchaypooh really?06:32
SpamapStchaypo: well, I use sup.. which is a console email program. But only because it is the fastest e-mail deleter ever. :)06:32
tchaypoi've been doing that manually. hrmf.06:32
SpamapStchaypo: me too.. I'm glad I could save you a few weeks before finding it in anger like I did. :)06:32
*** pblaho has joined #tripleo06:32
tchaypoin other news. my hotel bill, converted to AUD, verifies that I am 133706:32
tchaypoalso, reimbursement has been processed already. I've never had anyone process a reimbursement that fast. I'm totes amaze.06:33
tchaypovery reimburse. much 1337. wow06:33
* tchaypo goes to german class06:33
SpamapStchaypo: HP has a deal with amex.. pay fast, get discount.06:33
StevenKSpamapS: Which tchaypo didn't use, since no corp card yet06:33
SpamapSsame system, different payment destination06:34
SpamapSthe point being, they have incentive to pay fast06:34
SpamapSwhereas many other corporate expense systems with no such deal find it in their best interest to drag things out as much as possible06:34
StevenKSpamapS: Discount on what, though?06:34
SpamapSStevenK: probably actually in the form of cash rebates.06:36
StevenKMmmmm06:36
StevenKMuch active.06:36
StevenK6017d97e-33e6-4927-b537-d5ff7330a968 | testenv | ACTIVE | -          | Running06:37
StevenKSo, now to figure out how to connect to the machine06:37
lifelessStevenK: nova floating-ip-create ; nova add-floating-ip06:41
*** rcarrillocruz1 has joined #tripleo06:43
StevenKAnd I guess I need to play with sec policies06:43
*** rcarrillocruz has quit IRC06:44
*** killer_p- has joined #tripleo06:45
*** killer_p- is now known as killer_prince06:45
lifelesspossibly06:45
lifelessneutron examples in overcloud.sh again06:45
StevenKI see them, but: Multiple security_group matches found for name 'default', use an ID to be more specific.06:50
StevenKlifeless: I need to head out, I'm going to pause the running VMs and pick it up tomorrow06:52
lifelessgnight06:52
openstackgerritOm Kumar proposed a change to openstack/diskimage-builder: Refactor code to select boot kernel  https://review.openstack.org/7987306:53
lazy_princein case if you have time, please review https://review.openstack.org/#/c/79286 and https://review.openstack.org/#/c/7928907:02
*** killer_prince has quit IRC07:05
*** rpodolyaka has quit IRC07:12
*** vkozhukalov has quit IRC07:16
*** morganfainberg is now known as morganfainberg_Z07:18
*** hewbrocc` is now known as hewbrocca07:22
*** jprovazn has joined #tripleo07:28
*** mrunge has joined #tripleo07:31
*** jtomasek has quit IRC07:32
*** matsuhashi has quit IRC07:32
*** matsuhashi has joined #tripleo07:32
*** nosnos has quit IRC07:32
*** nosnos_ has joined #tripleo07:32
*** linuxgeek has joined #tripleo07:39
*** linuxgeek has quit IRC07:40
*** killer_prince has joined #tripleo07:42
*** jcoufal has joined #tripleo07:47
GheRiveromorning all07:47
*** e0ne has joined #tripleo07:47
SpamapShrm.. pausing/resuming my vms doesn't seem to work very well07:48
SpamapSas in "at all"07:49
SpamapSoh lovely07:50
*** gcha has quit IRC07:51
SpamapShttp://ubuntuone.com/2ntytYziAb1psMXEa0XkQ2 .. that can't be good07:53
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Fix nova-bm race condition with cached images.  https://review.openstack.org/8020307:53
lifelessSpamapS: lol07:56
SpamapShm.. seed had to be rebooted07:57
SpamapSnow dhcp agent won't work07:57
SpamapSbecause of a _really_ nasty looking trace07:58
*** d0ugal has joined #tripleo07:58
*** d0ugal has joined #tripleo07:58
SpamapSahh, of course.. os-collect-config --one --force08:00
SpamapSthe answer to all that ails ye08:00
*** CaptTofu has joined #tripleo08:05
SpamapSlifeless: so, rebooted seed, rebooted undercloud.. now on seed I don't see replies to bootp reqs08:05
SpamapSlifeless: before I get too deep into analysis... seen this?08:05
*** gcha has joined #tripleo08:06
lifelessseed doesn't see *replies* ?08:06
lifelessSpamapS: what interface are you dumping?08:06
SpamapSI'm tcpdumping on br-ctlplane, and I don't see bootp replies08:06
SpamapSonly req's08:06
lifelesscheck the agent is running08:06
lifelesscheck that it sees the requests on the namespaced interface08:07
SpamapSMar 13 07:59:28 ubuntu dnsmasq-dhcp[2460]: DHCPDISCOVER(tap0d877eec-19) 52:54:00:b4:44:cd08:07
SpamapSMar 13 07:59:28 ubuntu dnsmasq-dhcp[2460]: DHCPOFFER(tap0d877eec-19) 192.0.2.2 52:54:00:b4:44:cd08:07
*** rdopieralski has joined #tripleo08:07
lifelessif it doesn't, restart the ovs agent and then the dhcp agent in that order08:07
lifelessthat looks like a reply to me08:07
SpamapSlifeless: yes, one that did not go out on br-ctlplane08:08
SpamapSlifeless: note that when I dump that interface inside the netns, I see no traffic08:09
*** CaptTofu has quit IRC08:10
lifelessSpamapS: add -nl to your dump08:11
SpamapSI reflexively always use -n08:11
lifelessyou'll need -l too08:13
lifelessnetns does something odd to the fd08:13
SpamapSlifeless: no change08:14
lifelessSpamapS: if dhcp is logging it08:15
SpamapSlifeless: in ovs-vswitchd.log .. http://paste.ubuntu.com/7083503/08:15
lifelessSpamapS: it must be seeing the request ;)08:15
SpamapSlifeless: ovs-vswitchd thinks the tap interface doesn't exist.08:16
SpamapSlifeless: anyway, this has drained the life out of me08:16
SpamapSso.. I am going to just leave it as-is and go sleep08:16
lifelessnight!08:16
*** jistr has joined #tripleo08:21
*** andreaf has joined #tripleo08:30
jprovaznlifeless: Hi, are you still around?08:30
*** Guest65081 is now known as ohadlevy08:39
*** ohadlevy has joined #tripleo08:39
lifelessjprovazn: yesish08:40
*** hashar has joined #tripleo08:45
jprovaznlifeless: I bet that what you need before sleep is one review ;) - any chance to look at https://review.openstack.org/#/c/68392/ ?08:46
lifelesswe're going to need two more nodes in the test cluster aren't we08:48
lifelessfor control plane08:48
lifelessjprovazn: its too much for me to sanely review, but I have the tab open and will look tomorrow08:49
lifelesstonight, I mean08:49
jprovaznlifeless: great, thanks08:50
*** petertoft has joined #tripleo08:52
lifelessbah still ambiguous. I mean, too much to look tonight, I will look tomorrow;)08:56
*** rlandy has joined #tripleo08:56
*** derekh has joined #tripleo09:00
*** matsuhashi has quit IRC09:07
*** athomas has joined #tripleo09:08
*** Qiming has joined #tripleo09:08
Qiminghello, anybody can help me debug this template?  http://paste.openstack.org/show/73350/09:09
*** jp_at_hp has joined #tripleo09:10
*** nosnos has joined #tripleo09:11
*** nosnos_ has quit IRC09:11
*** jrist has quit IRC09:11
*** matsuhashi has joined #tripleo09:12
*** xuhaiwei has quit IRC09:12
*** giulivo has joined #tripleo09:16
*** jrist has joined #tripleo09:24
*** lucasagomes has joined #tripleo09:24
*** martyntaylor has joined #tripleo09:34
*** matsuhashi has quit IRC09:44
*** matsuhashi has joined #tripleo09:47
dtantsurHi everyone. I'm currently using the following script to bootstrap Tuskar[-UI] on devtest: https://gist.github.com/Divius/9525147 Just wondering if it is of any use for someone but me :)09:50
*** Qiming has quit IRC09:54
openstackgerritGhe Rivero proposed a change to openstack/tripleo-image-elements: Adding more .deb dependencies for pypi-mirror on 13.10  https://review.openstack.org/7995109:55
lazy_princeHi all..09:56
lazy_princeI am building a RHEL 6.5 image using dib and tripleo-image-elements but its keeps failing at os-collect-config installtion. the relevant logs are http://paste.openstack.org/show/73360/. can someone please help me in finding out what is causing the failure..09:57
*** rcarrillocruz has joined #tripleo09:58
*** killer_p- has joined #tripleo09:59
openstackgerritGhe Rivero proposed a change to openstack/tripleo-image-elements: Adding more .deb dependencies for pypi-mirror on 13.10  https://review.openstack.org/7995109:59
*** killer_prince has quit IRC09:59
*** killer_p- is now known as killer_prince09:59
*** rcarrillocruz1 has quit IRC09:59
*** jtomasek has joined #tripleo10:00
*** athomas has quit IRC10:03
*** killer_prince has quit IRC10:03
openstackgerritJon-Paul Sullivan proposed a change to openstack/tripleo-incubator: Add source-repository element var setting script  https://review.openstack.org/7439310:04
*** killer_prince has joined #tripleo10:05
openstackgerritJon-Paul Sullivan proposed a change to openstack/tripleo-incubator: Add source-repository element var setting script  https://review.openstack.org/7439310:05
*** CaptTofu has joined #tripleo10:05
*** CaptTofu has quit IRC10:10
*** athomas has joined #tripleo10:11
openstackgerritA change was merged to openstack/tuskar: Remove tools/flakes.py  https://review.openstack.org/7978310:19
*** bauzas has joined #tripleo10:23
*** hashar has quit IRC10:24
*** blamar has quit IRC10:24
*** hashar has joined #tripleo10:26
*** jprovazn has quit IRC10:34
*** akrivoka has joined #tripleo10:34
*** markmc has joined #tripleo10:36
*** al has quit IRC10:40
*** al has joined #tripleo10:40
*** e0ne has quit IRC10:52
openstackgerritA change was merged to openstack/tuskar: Using flavors from Roles  https://review.openstack.org/7682611:09
openstackgerritA change was merged to openstack/tuskar: Fix of Overcloud Update  https://review.openstack.org/7685011:09
openstackgerritA change was merged to openstack/tripleo-image-elements: Adds NFS backend support for cinder-volume  https://review.openstack.org/7456311:11
*** matsuhashi has quit IRC11:11
*** matsuhashi has joined #tripleo11:12
*** jprovazn has joined #tripleo11:13
openstackgerritAna Krivokapic proposed a change to openstack/tuskar-ui: Enable sorting for the timestamp column  https://review.openstack.org/8025311:33
*** e0ne has joined #tripleo11:35
*** e0ne has quit IRC11:40
*** lazy_prince has quit IRC11:45
*** rbrady-afk is now known as rbrady11:52
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Node profile suggestions  https://review.openstack.org/7856312:00
*** lblanchard has joined #tripleo12:01
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Node profile suggestions  https://review.openstack.org/7856312:02
*** morazi has joined #tripleo12:03
*** weshay has joined #tripleo12:03
*** e0ne has joined #tripleo12:05
*** CaptTofu has joined #tripleo12:06
*** geerdest has joined #tripleo12:09
*** e0ne has quit IRC12:10
*** matsuhashi has quit IRC12:11
*** CaptTofu has quit IRC12:11
*** matsuhashi has joined #tripleo12:12
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Make @handle_errors support any kind of function  https://review.openstack.org/7815312:14
*** nosnos has quit IRC12:15
*** matsuhashi has quit IRC12:16
*** hashar has quit IRC12:20
*** hashar has joined #tripleo12:22
openstackgerritJan Provaznik proposed a change to openstack/diskimage-builder: Adds "element-provides" support to element dependencies  https://review.openstack.org/7942112:23
*** matsuhashi has joined #tripleo12:26
openstackgerritDerek Higgins proposed a change to openstack/tripleo-incubator: Ensure json file is initialised  https://review.openstack.org/8026512:29
*** e0ne has joined #tripleo12:31
openstackgerritTrent Geerdes proposed a change to openstack/tripleo-image-elements: Adding more .deb dependencies for pypi-mirror on 13.10  https://review.openstack.org/7995112:38
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Make @handle_errors support any kind of function  https://review.openstack.org/7815312:38
openstackgerritMichael Kerrin proposed a change to openstack/diskimage-builder: Add script to replay elements in an existing image  https://review.openstack.org/8026712:39
openstackgerritMichael Kerrin proposed a change to openstack/diskimage-builder: Add utility to mount and unmount images  https://review.openstack.org/7650912:39
*** CaptTofu has joined #tripleo12:39
*** lucasagomes is now known as lucas-hungry12:40
*** andreaf has quit IRC12:44
*** jcoufal has quit IRC12:50
*** jcoufal has joined #tripleo12:51
jp_at_hpIs anyone looking at the CI problems?  The gearman server appears to be out of action, and jobs are looping doing nothing for 2+ hours...12:51
*** dprince has joined #tripleo12:55
*** jprovazn is now known as jprovazn_afk13:02
*** rlandy_ has joined #tripleo13:08
*** rlandy has quit IRC13:10
*** matty_dubs|gone is now known as matty_dubs13:12
Ngmorning13:17
*** julim has joined #tripleo13:17
*** e0ne_ has joined #tripleo13:20
*** e0ne has quit IRC13:23
*** jdob has joined #tripleo13:26
*** hashar_ has joined #tripleo13:37
*** rbrady has quit IRC13:37
*** hashar has quit IRC13:40
*** rbrady has joined #tripleo13:40
*** matsuhashi has quit IRC13:42
*** e0ne_ has quit IRC13:43
*** spzala has joined #tripleo13:54
*** hashar_ has quit IRC13:54
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Fix the layout of deployment design page  https://review.openstack.org/8028313:55
openstackgerritA change was merged to openstack/tripleo-image-elements: Link db sync utilities to /usr/local/bin...  https://review.openstack.org/7657913:58
openstackgerritRadomir Dopieralski proposed a change to openstack/tuskar-ui: Refresh the deployment progress page every 30s  https://review.openstack.org/8029114:07
*** e0ne has joined #tripleo14:07
*** hashar has joined #tripleo14:10
openstackgerritDerek Higgins proposed a change to openstack/tripleo-incubator: Better describe the compt mode being echo'd  https://review.openstack.org/8029614:17
openstackgerritLadislav Smola proposed a change to openstack/tuskar-ui: Fix validation for scaling  https://review.openstack.org/8029814:22
*** lucas-hungry is now known as lucasagomes14:24
NobodyCamgood morning TripleO14:28
NobodyCamping StevenK14:28
openstackgerritA change was merged to openstack/tripleo-incubator: Delete obsolete template.  https://review.openstack.org/8003914:29
NgNobodyCam: it's the middle of the night in StevenK-land :)14:31
NobodyCamahh yes:)14:31
*** andreaf has joined #tripleo14:37
GheRiveromorning all14:38
rcarrillocruzmorning GheRivero14:42
*** CaptTofu has quit IRC14:43
*** CaptTofu has joined #tripleo14:44
GheRiveromorning rcarrillocruz14:48
*** jprovazn_afk is now known as jprovazn14:54
*** sdake has quit IRC14:55
*** sdake has joined #tripleo14:55
*** howleyt has quit IRC14:56
devanandaramdiskimage-create seems to be failing for me if not run as root. is that expected?15:02
*** julim has quit IRC15:02
*** cody-somerville- has quit IRC15:02
*** cody-somerville- has joined #tripleo15:03
*** hashar has quit IRC15:03
*** julim has joined #tripleo15:03
*** hashar has joined #tripleo15:03
*** bauzas has quit IRC15:04
*** CaptTofu has quit IRC15:05
killer_princeI am building a RHEL 6.5 image using dib and tripleo-image-elements but its keeps failing at os-collect-config installtion. the relevant logs are http://paste.openstack.org/show/73360/. can someone please help me in finding out what is causing the failure..15:06
*** mkerrin has quit IRC15:07
ifarkaskiller_prince, isn't it because the rhel instance is not registered?15:10
ifarkaskiller_prince, the line after + install-packages says: "This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register."15:10
killer_princeumm.. i have other fedora epel configured to workaround it.. this used to work but for a while it has stopped working..15:11
openstackgerritA change was merged to openstack/diskimage-builder: Create a git manifest from source-repositories  https://review.openstack.org/7582915:11
killer_princenot sure if there was any change in o-c-c that is anti RHEL or something else.. I can pass on complete log if needed..15:12
openstackgerritA change was merged to openstack/diskimage-builder: Better apt-sources docs.  https://review.openstack.org/7303515:13
*** funzo has quit IRC15:14
*** funzo has joined #tripleo15:14
killer_princeifarkas: if i just use rhel with base element, it works but i fi use any element which has dependency on o-*-*, it fails.. stange thing is i do not get any error message..15:14
ifarkaskiller_prince, that's weird... so you can run "sudo yum install build-essential" without problem and your workaround with epel repos works, right?15:15
killer_princeifarkas: yes.. it has worked in the past.. i am using https://review.openstack.org/#/c/79286/ patch for build essentials.. I have log for past working build15:18
*** rpodolyaka has joined #tripleo15:18
devanandais there an ENV flag to tell DIB not to rebuild an image if a cached copy exists?15:20
*** mrunge has quit IRC15:21
openstackgerrittom-howley proposed a change to openstack/tripleo-incubator: Wait for baremetal nodes before creating undercloud stack.  https://review.openstack.org/7863615:22
*** sballe has joined #tripleo15:22
openstackgerrittom-howley proposed a change to openstack/tripleo-incubator: Wait for baremetal nodes before creating undercloud stack.  https://review.openstack.org/7863615:23
killer_princelet me clear all cache and then try again..15:26
giulivokiller_prince, ifarkas that should be just an informative message, I think it went past that step and the problem arised when installing setuptools15:27
gilliarddevananda: USE_CACHE ?15:27
giulivoor actually, os-collect-config15:27
gilliarddevananda: https://github.com/openstack/tripleo-incubator/blob/master/scripts/devtest.sh#L1915:27
giulivokiall, are you able to build yourself the venv and perform installation of setuptools and os-collect-config in it?15:28
Nggilliard: that's not actually passed to di-b in any way :)15:28
Ngdevananda: no, we do that logic in the devtest scripts15:28
devanandaNg: right. I see --offline for dib, which avoids downloading a new base image15:29
Ngdevananda: right15:29
killer_princegiulivo: let me try that and get back to you.15:29
devanandaNg: but it still re-creates the target image, which in turn, requires downloading things, so it's not really offline :)15:29
Ngdevananda: yes, it is not a good name for the option ;)15:29
*** sballe has quit IRC15:29
devanandaNg: it seems the best way for devvstack $OFFLINE to work with DIB is simply not to call it15:29
Ngdevananda: agreed, which is what we do in the devtest scripts15:30
NgI think, without a fully-end-to-end declarative image builder, being able to say "what you asked for exists, so I refuse to build it again" would be super hard and not really in-scope for dib15:31
*** sballe has joined #tripleo15:31
*** mkerrin has joined #tripleo15:33
devanandaNg: fair enough15:33
*** rpodolyaka has left #tripleo15:35
*** jcoufal has quit IRC15:35
*** andrearosa has joined #tripleo15:38
ifarkasgiulivo, ahh, you are right15:39
*** lblanchard has quit IRC15:39
*** spzala_ has joined #tripleo15:39
*** vkozhukalov has joined #tripleo15:41
*** spzala has quit IRC15:41
*** spzala_ is now known as spzala15:41
*** dprince has quit IRC15:44
SpamapSo/15:49
*** matty_dubs is now known as matty_dubs|lunch15:52
GheRivero\o15:54
*** vkozhukalov has quit IRC15:54
openstackgerritLadislav Smola proposed a change to openstack/tuskar-ui: Fix validation for scaling  https://review.openstack.org/8029815:59
*** cwolferh has joined #tripleo16:02
*** jcoufal-mobile has joined #tripleo16:03
openstackgerritChris Krelle proposed a change to openstack/tripleo-incubator: Add Ironic bits to _undercloud  https://review.openstack.org/7296916:13
*** jcoufal-mobile has quit IRC16:17
openstackgerritA change was merged to openstack/diskimage-builder: 98-source-repositories tries to return from script  https://review.openstack.org/7801216:17
*** jcoufal-mobile has joined #tripleo16:18
*** rpodolyaka has joined #tripleo16:19
SpamapSlifeless: FYI, the weird ovs fail I was having: had to restart openvswitch-controller16:21
SpamapSnever had to touch that one before. :-P16:21
*** bogdando has quit IRC16:22
SpamapSHm.. I notice neutron-dhcp-agent sets the DNS server to the network-node's IP.. but that dnsmasq doesn't provide DNS services.16:22
SpamapSI wonder if we could just set it to the external IP of the seed/undercloud, configure vanilla dnsmasq, and have DNS work out of the box.16:23
*** bogdando has joined #tripleo16:24
*** vkozhukalov has joined #tripleo16:26
*** rdopieralski has quit IRC16:27
*** jcoufal-mobile_ has joined #tripleo16:28
*** jcoufal-mobile has quit IRC16:28
*** jcoufal-mobile_ has quit IRC16:28
*** jcoufal-mobile has joined #tripleo16:29
*** jcoufal-mobile_ has joined #tripleo16:31
*** jcoufal-mobile_ has quit IRC16:33
*** jcoufal-mobile has quit IRC16:33
* SpamapS tries hard not to spend time fixing reboots of the undercloud16:37
SpamapSSomething wrong in our sequencing.. hopefully that will be fixed by the HA setup and eventual removal of the seed.16:37
*** rcarrillocruz has quit IRC16:37
*** dprince has joined #tripleo16:40
openstackgerrittom-howley proposed a change to openstack/tripleo-incubator: Wait for baremetal nodes before creating undercloud stack.  https://review.openstack.org/7863616:46
*** killer_prince is now known as lazy_prince16:46
*** lblanchard has joined #tripleo16:48
openstackgerritDerek Higgins proposed a change to openstack/tripleo-image-elements: Install libffi-dev in the glance element  https://review.openstack.org/8033716:52
*** hashar has quit IRC16:57
*** jtomasek has quit IRC17:00
*** martyntaylor has quit IRC17:02
*** markmc has quit IRC17:08
*** e0ne has quit IRC17:09
*** rcarrillocruz has joined #tripleo17:09
*** morganfainberg_Z is now known as morganfainberg17:09
*** matty_dubs|lunch is now known as matty_dubs17:10
*** AaronGr has joined #tripleo17:12
*** akuznetsov has quit IRC17:18
*** petertoft has quit IRC17:18
openstackgerritRyan Brady proposed a change to openstack/tripleo-heat-templates: Add Wait Condition to Block Storage Templates  https://review.openstack.org/8034717:21
openstackgerrittom-howley proposed a change to openstack/tripleo-incubator: WIP: Add standalone script to build all images.  https://review.openstack.org/7746217:23
*** sballe has quit IRC17:24
*** derekh has quit IRC17:25
*** sballe has joined #tripleo17:25
*** blamar has joined #tripleo17:32
*** akuznetsov has joined #tripleo17:33
lifelessmorning17:41
greghaynesO/17:41
lifelessSpamapS: re DNS there are open bugs17:41
*** jistr has quit IRC17:42
*** sballe has quit IRC17:42
*** dprince_ has joined #tripleo17:45
*** Hefeweizen has quit IRC17:48
lifelessslagle: SpamapS: https://review.openstack.org/#/c/80104/ (passed CI) and the one above it too17:48
*** Hefeweizen has joined #tripleo17:48
*** athomas has quit IRC17:48
*** hewbrocca has quit IRC17:51
*** rcarrillocruz has quit IRC17:51
*** dprince has quit IRC17:54
*** pblaho has quit IRC17:54
*** lucasagomes has quit IRC17:56
*** rpodolyaka has quit IRC17:57
*** rcarrillocruz has joined #tripleo17:57
*** rcarrillocruz has quit IRC17:57
*** Lotus907efi- is now known as Lotus907efi17:58
*** rcarrillocruz has joined #tripleo17:58
*** mandeep has joined #tripleo17:59
*** rpodolyaka has joined #tripleo18:00
*** mandeep has left #tripleo18:01
greghaynesbnemec: You tried https://review.openstack.org/#/c/75540/ with 5.5?18:06
bnemecgreghaynes: I tried to build an image with 5.5, but it failed because of the issue I mentioned on the review.18:07
greghaynesArgh, was about to try that to see if it fixed18:07
*** retr0h has left #tripleo18:08
openstackgerritA change was merged to openstack/tripleo-incubator: Put overcloud state into testenv.json.  https://review.openstack.org/8010418:12
openstackgerritA change was merged to openstack/tripleo-incubator: Stop editing config.json.  https://review.openstack.org/8011018:12
SpamapShey, it kind of looks like we're already using wheels..18:15
SpamapS2014-03-13 17:34:12.815 | Downloading/unpacking setuptools>=1.0 from http://pypi.openstack.org/openstack/setuptools/setuptools-3.1-py2.py3-none-any.whl18:15
SpamapSoh, any18:15
SpamapSn/m18:15
*** akuznetsov has quit IRC18:16
SpamapSok so we need to start tracking failures due to network blips.. I think we should probably aim at having local mirrors and having CI use the 'pypi' element to help avoid this.18:16
SpamapSand also gooo fastttuurrr18:17
bnemecgreghaynes: https://review.openstack.org/#/c/79362/ might help in my case.  It's failing on the mv for me.18:18
* bnemec will try18:19
*** akuznetsov has joined #tripleo18:20
bnemecOh, I see SpamapS already pointed that out. :-)18:21
*** cwolferh_ has joined #tripleo18:21
SpamapSslagle: looks like we both triaged bug 1292141 at the same time. :)18:22
SpamapSslagle: Marking as critical.. we've been hitting it at an alarming rate.18:22
*** cwolferh has quit IRC18:23
slaglefair enough :)18:25
slaglei figured there was a workaround...try again.18:25
*** jang1 has joined #tripleo18:27
*** akrivoka has quit IRC18:27
openstackgerritRyan Brady proposed a change to openstack/tripleo-heat-templates: Add Wait Condition to Block Storage Templates  https://review.openstack.org/8034718:27
openstackgerritRyan Brady proposed a change to openstack/tripleo-heat-templates: Add Wait Condition to Block Storage Templates  https://review.openstack.org/8034718:28
SpamapSslagle: Totally, but it is a workaround which blocks patches for many hours. :-/18:29
SpamapSslagle: so I think the impact outweighs all else. :)18:30
*** ftcjeff has joined #tripleo18:33
SpamapSOh nice18:33
SpamapSGlance landed a backward compatibility patch for the known_stores issue.18:33
rcarrillocruzguys, I noticed that running devtest in a stock ubuntu 12.04 fails at some point with "/var/run/openvswitch/db.sock: connection attempt failed (No such file or directory)" . This is due to the fact that the OS does not have linux kernel sources package installed, thus openvswitch-datapath-dkms package installation hook is not able to compile the module18:35
rcarrillocruzshould I open a low bug for this to include the kernel source package as a requirement to tripleo?18:36
*** jp_at_hp has quit IRC18:38
openstackgerritDan Prince proposed a change to openstack/diskimage-builder: Support adding DHCP interfaces one at a time.  https://review.openstack.org/7871118:39
SpamapSslagle: https://review.openstack.org/#/c/78020/ passes CI now, so perhaps you can un-WIP it and we can "whip it good" ?18:40
SpamapSinto shape18:40
SpamapSgo forward18:40
SpamapSmove ahead18:40
* Shrews vomits18:40
SpamapSShrews: it's not too late18:40
rwsuhi, can someone approve https://review.openstack.org/#/c/76105/ ?18:40
openstackgerritA change was merged to openstack/tripleo-incubator: Set -x on under and overcloud scripts.  https://review.openstack.org/8012518:41
Shrewsthere should be a "no devo" rule... everywhere18:41
SpamapSrwsu: https://review.openstack.org/#/c/76105/4/elements/swift-storage/os-config-applier/etc/rsyncd.conf .. /var/lock is state as well...18:42
SpamapSShrews: except at 80's parties. But there should also be a no 80's parties rule.18:45
rwsuSpamapS: ok, for my understanding why do we count that as state? and what about the pid file?18:47
*** geerdest has quit IRC18:50
SpamapSrwsu: well it is more that it is a file that has to be written18:51
SpamapSrwsu: pid file too18:51
SpamapSrwsu: that should all be in /var/run18:51
SpamapSwhich I'm actually surprised the packages don't already do18:51
SpamapSunless there is something weird about rsync locks that you want them to survive reboot (seems unlikely)18:52
*** jehb has joined #tripleo18:52
rwsuSpamapS: ok and if they are in /var/run, they don't need to be on /mnt/state right?18:58
*** rcarrillocruz has quit IRC18:58
openstackgerritDan Prince proposed a change to openstack/tripleo-image-elements: Stop using all ports option w/ neutron-ovs-cleanup  https://review.openstack.org/6993719:02
openstackgerritDan Prince proposed a change to openstack/tripleo-image-elements: Refactor ensure-bridge for persistance  https://review.openstack.org/6991819:02
openstackgerritRyan Brady proposed a change to openstack/tripleo-heat-templates: Add Wait Condition to Block Storage Templates  https://review.openstack.org/8034719:04
SpamapSrwsu: right, /var/run is a tmpfs partition19:05
SpamapSand will be writable no matter what19:05
slagleSpamapS: i am pleasantly surprised that passed CI19:07
*** marun has quit IRC19:10
*** rpodolyaka has quit IRC19:13
*** geerdest has joined #tripleo19:17
*** vkozhukalov has quit IRC19:18
*** spzala has quit IRC19:20
*** geerdest has quit IRC19:20
SpamapSslagle: it is entirely possible that the bugs have been fixed in openstackclient and keystone. :)19:20
*** marun has joined #tripleo19:21
*** petertoft has joined #tripleo19:25
SpamapS$UNDERCLOUD_HEAT_STACK_DOMAIN_ADMIN_PASSWORD19:33
SpamapSmy god what have we done19:33
* slagle pleads the 5th19:38
SpamapSslagle: it is perfect in its logic and composition..19:38
SpamapSbut my god19:38
SpamapS;)19:38
*** jang1 has quit IRC19:39
Ngwe are the new java19:40
SpamapSjava is the old us19:40
Ngwe are the land java of the sea19:40
* SpamapS [knock knock]19:40
Ngwho's there?!19:41
SpamapSland java19:41
SpamapSerr19:41
SpamapSpizza man19:41
SpamapSwhoa what the heck is cffi tryign to do here? http://paste.openstack.org/show/7345019:43
SpamapSdoes it.. write/compile.. at runtime?!19:43
lifelessSpamapS: yes19:45
*** e0ne has joined #tripleo19:45
*** andreaf has quit IRC19:47
SpamapSlifeless: w ... t... f ?19:48
SpamapSso.. users be damned.. make sure to run the full unit test suite as root before you give it to users?19:49
*** akuznetsov has quit IRC19:52
*** jcoufal has joined #tripleo19:56
*** lblanchard has quit IRC20:03
* SpamapS lunches20:09
*** petertoft has quit IRC20:11
*** jtomasek has joined #tripleo20:13
*** rpodolyaka has joined #tripleo20:14
*** julim has quit IRC20:15
*** jcoufal has quit IRC20:16
openstackgerritA change was merged to openstack/tripleo-image-elements: Nova: don't hard code the venv dir  https://review.openstack.org/7661920:16
*** rpodolyaka has quit IRC20:19
openstackgerritJames Slagle proposed a change to openstack/diskimage-builder: Move install type enablement out of source-repositories  https://review.openstack.org/7879420:23
lifelessSpamapS: so thats a cryptography bug20:25
lifelessSpamapS: erm cfii bug20:25
lifelessarmin!!!!20:25
lifelessSpamapS: https://bitbucket.org/cffi/cffi/issue/109/enable-sane-packaging-for-cffi20:26
lifelessI suggest everyone vote for this :)20:26
greghayneshaha20:27
lifelesshttps://github.com/vincentbernat/snimpy/blob/master/snimpy/cffi_fix.py or https://github.com/pyca/pynacl/blob/master/src/nacl/_cffi_fix.py referenced from that issue may be suitable for fixing20:28
*** rpodolyaka has joined #tripleo20:32
*** vkozhukalov has joined #tripleo20:32
*** rcarrillocruz has joined #tripleo20:34
openstackgerritJames Slagle proposed a change to openstack/diskimage-builder: Always export IMAGE_NAME  https://review.openstack.org/8039520:36
* lifeless shaves yaks20:37
*** rpodolyaka has quit IRC20:39
*** rpodolyaka has joined #tripleo20:40
*** jprovazn has quit IRC20:47
*** jdob has quit IRC20:47
*** jehb has quit IRC21:03
*** dprince_ has quit IRC21:07
*** giulivo has quit IRC21:11
*** rcarrillocruz1 has joined #tripleo21:17
*** e0ne has quit IRC21:18
*** ccrouch1 has quit IRC21:18
*** rcarrillocruz has quit IRC21:19
*** petertoft has joined #tripleo21:21
*** ccrouch has joined #tripleo21:28
*** rbrady1 has joined #tripleo21:28
*** rbrady has quit IRC21:30
Lotus907efiif I am trying to setup a mirror system for the pypi repos how big are they?21:31
SpamapSLotus907efi: the whole of pypi or just for openstack?21:33
GheRiveroLotus907efi: with pypi-mirror ~ 200 megas, fll pypi > 50GB21:34
SpamapSGheRivero: 200MB of download, but you end up using 500M extracted and C modules built.21:34
GheRiveroanyway 500M <<<<<< 50GB  (or even 70GB) i don-t know21:35
SpamapSLotus907efi: entirely managable, and a smidge smaller than Ubuntu mirrors which run in the hundreds of GB.21:35
GheRiveromy current ubuntu saucy + debian sid (both i386 and amd64) is ~196GB21:37
lifelessSpamapS: btw21:39
lifelessreal    19m54.131s21:39
lifelessuser    0m49.715s21:39
lifelesssys     0m13.927s21:39
SpamapSlifeless: bragging?21:39
SpamapS:)21:39
lifelessSpamapS: full cached run using https://review.openstack.org/#/c/80203/21:39
SpamapSlifeless: my problem was that I didn't have the unsafe bit yet.21:40
*** petertoft has quit IRC21:40
SpamapSlifeless: and I don't have an SSD21:40
lifelessSpamapS: thats not on an SSD21:40
lifelessSpamapS: thats on my home server21:40
lifelessSpamapS: which is spinning rust21:40
*** ohadlevy has quit IRC21:42
SpamapSsingle laptop spinning rust?21:43
lifelessSpamapS: no, 8 WD RED's :)21:43
lifelessSpamapS: in RAID 6 for worst-case write performance though :>21:44
lifelessGheRivero: du -sh /var/spool/pypi/21:44
lifeless76G     /var/spool/pypi/21:44
lifelessLotus907efi: ^21:44
Lotus907efiok21:45
Lotus907efitanks21:45
Lotus907efiand guns21:45
SpamapSlifeless: straight line yes you'll get worst case write, but spinning up 3 vms in parallel you'll blow me away.21:45
tchaypothat awkward moment when you restart irssi and now your windows aren21:50
tchaypo't lined up the same so muscle-memory for finding your channel doesn't work21:50
greghaynesalt-a to victory21:51
SpamapSI seem to recall that you can assert window #'s in the config somehow21:51
SpamapSbut I always just move the important channels around :-P21:51
openstackgerritlifeless proposed a change to openstack/tripleo-incubator: Fix nova-bm race condition with cached images.  https://review.openstack.org/8020321:52
*** matty_dubs is now known as matty_dubs|gone21:52
lifelessGheRivero: ^ fixed by removing the echo; I propose adding -x elsewhere so its redundant21:53
StevenKSpamapS, tchaypo: I have important channels in the config so they have a static number.22:01
*** ramishra has joined #tripleo22:01
tchaypoStevenK: what's the config for that?22:05
openstackgerritA change was merged to openstack/tripleo-image-elements: Neutron: don't hard code the venv dir  https://review.openstack.org/7662622:05
*** sdake has quit IRC22:11
*** ramishra has quit IRC22:14
*** ramishra has joined #tripleo22:14
*** rlandy__ has joined #tripleo22:15
*** rpodolyaka has quit IRC22:15
*** jtomasek has quit IRC22:17
*** rlandy_ has quit IRC22:17
*** rpodolyaka has joined #tripleo22:18
*** ramishra has quit IRC22:18
StevenKtchaypo: It's in my config as windows = {};22:25
StevenKWith a bunch of data22:25
*** rlandy__ has quit IRC22:25
tchaypoyeah, i had been tinkering with that but it seemed to open them up in a random order on startup anyway. Now that I've done a /layout save; /save again, it seems to be consistent now22:26
tchaypoin other news, https://review.openstack.org/#/c/79441/ would love some attention from a core22:27
StevenKtchaypo: /layout save will have written out the list in windows = {}; to your config.22:28
openstackgerritstephen-mulcahy proposed a change to openstack/tripleo-incubator: Add basic timing instrumentation to devtest.sh  https://review.openstack.org/7756422:32
openstackgerritstephen-mulcahy proposed a change to openstack/tripleo-incubator: Add basic timing instrumentation to devtest.sh  https://review.openstack.org/7756422:34
SpamapStchaypo: https://review.openstack.org/#/c/79441/ whitespace issue.. otherwise cool22:34
*** rcarrillocruz has joined #tripleo22:35
openstackgerritJames Polley proposed a change to openstack/diskimage-builder: Extract move cache logic to a function  https://review.openstack.org/7944122:37
*** rcarrillocruz1 has quit IRC22:37
tchaypoSpamapS: fixed22:37
openstackgerritJames Slagle proposed a change to openstack/diskimage-builder: Move install type enablement out of source-repositories  https://review.openstack.org/7879422:37
SpamapStchaypo: cool +2'd22:38
lifelessgreghaynes: are you working with john still ?22:39
lifelessgreghaynes: seems to be back in the regular swing of things, but I've a bunch of stuff mid-air right now...22:39
greghaynesyep - hipchatting currently22:39
*** rbrady1 is now known as rbrady-afk22:39
greghaynes(woo hipchat :/)22:39
lifelessoh, I should log in22:39
clarkbit sends me an email when people say my name22:41
clarkbI don't know if it does that by default but it is amazing22:41
greghayneswah22:41
openstackgerritJames Slagle proposed a change to openstack/diskimage-builder: Move install type enablement out of source-repositories  https://review.openstack.org/7879422:41
greghayneslike, if they say your name anywhere?22:41
greghaynesor are there special rooms youre supposed to join?22:41
lifelessgreghaynes: which channel ?22:41
greghayneslifeless: just 1 on 122:42
greghayneschannels sounds like a good idea though22:42
lifelessthere is a tripleo channel22:42
* greghaynes joins22:42
clarkbgreghaynes: anywhere if I am not logged in22:42
greghaynesoh, so if I start talking about you in a 1 on 1....22:43
*** CaptTofu has joined #tripleo22:46
tchaypoyou have to @mention someone to trigger the email22:48
tchaypoI don't think @mentioning even works in a 1on122:48
tchaypo@all will spam everyone who is in the channel but not currently online though. @here will ping just the people currently online22:48
greghaynesoh, tchaypo is wise in the ways of hipchat22:49
greghaynessurprised you offer that info freely22:49
lifelessgreghaynes: his prior employer was atlassian22:49
greghaynesthat would do it22:49
*** julim has joined #tripleo22:51
tchaypoI need to build up my alibi22:52
tchayposo that when I go @greghaynes people go "haha, he hasn't recovered" rather than "what a weirdo, thinking this is hipchat"22:52
greghaynesAs long as you dont hashtag in IRC we can probably manage22:53
lifeless#WAT22:53
StevenKBlah, so <(cat file) > file doesn't work?22:53
lifelessStevenK: if you have a command it should, though note that > file may open the file early22:54
lifelessStevenK: whats the exact example ?22:54
StevenKlifeless: https://review.openstack.org/#/c/77741/2/elements/testenv-worker/bin/ensure-test-env22:54
StevenKI know enough that < file > file is terrible and won't work. The other way I can solve it is < file | sponge file, but that requires moreutils22:55
SpamapSStevenK: errrr22:57
SpamapSStevenK: jq takes a file as a parameter22:57
lifelessSpamapS: won't fix the issue22:57
lifelessSpamapS: fd's are setup before fork22:57
lifelessSpamapS: pipelines are assembled from the end backwards22:58
SpamapSoh I see the > is too early22:58
SpamapSso yes, > $tempfile && mv ..22:58
lifelessor DATA=$(...)22:58
lifelessthen write to the file22:58
*** julim has quit IRC22:59
SpamapSYeah we don't need no steenking tempfiles22:59
*** rpodolyaka has quit IRC22:59
lifelesswe need an atomic sponge I guess :)22:59
SpamapStrouble is you only want to overwrite the real target if the source was successful23:00
StevenKIt's *tiny*23:00
lifelessright23:00
lifelessso we need a call-this-and-handle thing23:00
lifelesssounds almost like a function23:00
lifelessexcept23:00
lifelesswe don't care here23:00
lifelessif it fails, it bails23:00
SpamapSso variable + printf to file seems simplest23:00
*** ftcjeff has quit IRC23:02
StevenKI was hoping jq would just deal by reading the file and then writing to it, but no such luck23:03
StevenKI ponder a variable and then using <<<23:03
*** rpodolyaka has joined #tripleo23:04
openstackgerritJames Polley proposed a change to openstack/tripleo-incubator: Remove $(dirname $0) from devtest.sh docs.  https://review.openstack.org/7951723:04
slaglelifeless: SpamapS : Ng : could i get some reviews on https://review.openstack.org/#/c/78794/ when you're able?23:05
*** rpodolyaka has quit IRC23:17
lifelessslagle: I'd like to get 80203 in if I could :) - its nearly passed overcloud23:19
*** rpodolyaka has joined #tripleo23:20
SpamapSslagle: reviewing now. That is a great change. :)23:26
lifelessslagle: reviewing your think in a secnod23:26
lifelessslagle: SpamapS:  https://review.openstack.org/#/c/80203/:)23:28
tchaypoSo I want to check to see if the user has enabled the serial-console element23:28
lifelessslagle: I love your commit message.23:28
tchaypoI was going to just check DIB-COMMON-ELEMENTS but then I realised it could be in DIB_EXTRA_WHATNOTS or SEED_DIB_EXTRA_THINGS or a few other places as well23:29
tchayposo then I came here to ask for brainwaves on how to check all of them and realised that the script must already be compilating them into something23:29
lifelesswhy do you want to check ?23:31
*** ramishra has joined #tripleo23:32
tchaypohttps://review.openstack.org/#/c/77951/9/scripts/boot-seed-vm - if serial-console is enabled I want to pass an extra flag configure-vm23:32
tchaypomaybe I'm doing this wrong, and the element should be setting an unambigious flag that configure-vm (and other things that need to do things to enable a serial console) can read?23:33
lifelesstchaypo: well you've got a fairly large ordering problem23:33
tchaypoq23:33
lifelesstchaypo: configure-vm is at the same level as buying hardware23:33
lifelesstchaypo: e.g. in CI it's not run at all23:34
* SpamapS -> kids23:35
tchaypowhen you said "ordering" i was going to pretend I'd misunderstood and say that my smartbuy order wasn't *that* big, but then you referred to "buying hardware" in your next sentence and now I really wish I had gotten the joke in in time23:35
lifeless:)23:35
lifelessLet me lol I like I would have.23:35
* lifeless lols23:35
lifelessso I *think* what you're doing is making it possible to use a serial console with the seed (why?)23:35
tchaypoI'm fine with it not being run in CI; this is something that is only ever going to be useful in the case where someone is manually running this manually on headless hardware where it's easier for them to "virsh console" then use vnc to check the console23:36
*** CaptTofu_ has joined #tripleo23:36
lifelesstchaypo: are you aware that virt-manager on your desktop can seamlessly glue the vnc stuff together23:36
lifelesstchaypo: in virt-manager 'File' , 'Add connection', SSH, whatever username and host name23:36
lifelessand then you can just open the VM and it will tunnel VNC for you23:37
tchaypoif i was running these scripts on my desktop, that'd be nifty. When I'm running them on a machine on the other side of the pacific via a macbook air, not so nifty (afaict virt-manager isn't even an option in that case)23:37
lifelesstchaypo: SSH doesn't work over the pacific?23:38
lifelesstchaypo: I'm happy to help you with the serial console patch structure23:38
lifelesstchaypo: just trying to understand all the things23:38
*** petertoft has joined #tripleo23:39
lifelesstchaypo: if you can SSH into the VM host you can use virt-manager locally with a connection to libvirt on the VM host via SSH. And consoles Just Work.23:39
*** andrearo1 has joined #tripleo23:39
*** tomh__ has joined #tripleo23:40
*** mkerrin1 has joined #tripleo23:40
*** julim has joined #tripleo23:42
*** petertoft has quit IRC23:44
*** CaptTofu has quit IRC23:45
*** andrearosa has quit IRC23:45
*** mkerrin has quit IRC23:45
*** tomh_ has quit IRC23:45
openstackgerritA change was merged to openstack/tripleo-incubator: Fix nova-bm race condition with cached images.  https://review.openstack.org/8020323:49
*** sdake has joined #tripleo23:54
*** ccrouch has quit IRC23:56
*** spzala has joined #tripleo23:57
lifelessslagle: reviewed; minor nits.23:57
slaglethanks23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!