*** sdake has quit IRC | 00:14 | |
*** ccrouch has joined #tripleo | 00:56 | |
*** ccrouch has joined #tripleo | 00:57 | |
*** akuznetsov has quit IRC | 01:08 | |
*** akuznetsov has joined #tripleo | 01:13 | |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Add more to the json file https://review.openstack.org/67686 | 01:15 |
---|---|---|
openstackgerrit | Derek Higgins proposed a change to openstack/tripleo-incubator: Use BASH_SOURCE[0] to find scripts directory https://review.openstack.org/67687 | 01:16 |
openstackgerrit | Derek Higgins proposed a change to openstack/tripleo-incubator: Upgrade setuptools to 1.10 or more in a newly created virtualenv https://review.openstack.org/67688 | 01:16 |
openstackgerrit | Derek Higgins proposed a change to openstack/tripleo-incubator: Change communication with remote host https://review.openstack.org/67689 | 01:16 |
derekh | lifeless: got to the point where the seed vm is booting on the testenv, doesn't look like it got a IP but I havn't looked into it yet, | 01:19 |
derekh | lifeless: pretty much all my patches are needed to do this along with the instructions on the etherpad. | 01:20 |
derekh | lifeless: One problem I hit and just kinda ignored is that DIB was failling towards the end of the image build, didn't even look at how to fix and just tried a cirros image instead | 01:21 |
*** derekh has quit IRC | 01:24 | |
lifeless | devananda: cool | 01:35 |
lifeless | bah | 01:35 |
lifeless | devananda: sorry, tab fail :) | 01:35 |
*** akuznetsov has quit IRC | 01:52 | |
lifeless | huh | 02:04 |
lifeless | there's no dkms datapath module in trusty? | 02:04 |
lifeless | oh, missing universe I bet | 02:05 |
openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Get IP for Test Host from neutron https://review.openstack.org/66942 | 02:30 |
*** ccrouch1 has joined #tripleo | 02:49 | |
*** ccrouch has quit IRC | 02:52 | |
lifeless | ci-overcloud controller down while i try to upgrade ovs on it | 03:06 |
openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Get seed IPs from configured network https://review.openstack.org/66943 | 03:07 |
openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Change to tripleo-ci directory https://review.openstack.org/67221 | 03:08 |
openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Change path to tripleo-incubator https://review.openstack.org/67222 | 03:08 |
*** tzumainn has joined #tripleo | 03:28 | |
*** noslzzp has quit IRC | 03:39 | |
*** noslzzp has joined #tripleo | 04:04 | |
*** noslzzp has quit IRC | 04:26 | |
*** noslzzp has joined #tripleo | 04:26 | |
*** RomAbptTHN has joined #tripleo | 04:33 | |
*** RomAbptTHN has left #tripleo | 04:33 | |
*** noslzzp has joined #tripleo | 05:05 | |
*** vkozhukalov has joined #tripleo | 05:38 | |
*** noslzzp has quit IRC | 05:56 | |
*** zIWYIiWPIS has joined #tripleo | 06:05 | |
*** zIWYIiWPIS has left #tripleo | 06:05 | |
*** tzumainn has quit IRC | 06:39 | |
lifeless | oh joy | 06:58 |
lifeless | @six.add_metaclass(abc.ABCMeta) | 06:58 |
lifeless | AttributeError: 'module' object has no attribute 'add_metaclass' | 06:58 |
*** rlandy has joined #tripleo | 07:11 | |
*** bnemec_ has joined #tripleo | 07:24 | |
*** bnemec has quit IRC | 07:25 | |
*** csd has quit IRC | 07:25 | |
*** lifeless has quit IRC | 07:25 | |
*** rbrady has quit IRC | 07:26 | |
*** rbrady has joined #tripleo | 07:26 | |
*** lifeless has joined #tripleo | 07:27 | |
*** ChanServ sets mode: +v lifeless | 07:27 | |
*** csd has joined #tripleo | 07:27 | |
*** akuznetsov has joined #tripleo | 08:07 | |
*** julim has joined #tripleo | 08:21 | |
*** julim has quit IRC | 08:25 | |
*** derekh has joined #tripleo | 08:27 | |
derekh | lifeless: for your problems with python.six https://review.openstack.org/#/c/67178/ | 08:30 |
lifeless | derekh: hey! | 08:31 |
lifeless | derekh: I'm currently debugging a weird gre tunnel issue | 08:31 |
lifeless | derekh: gre packets from the compute node to the controller node are not hitting the openflow flow on br-tun on the control node | 08:32 |
derekh | lifeless: cool, the net slowness is a PITA, I've been working around it with a proxy on the undercloud | 08:32 |
lifeless | derekh: they do hit br-untagged | 08:32 |
lifeless | derekh: I upgraded the network node to ovs 2.0.1 | 08:33 |
lifeless | I'm pondering whether upgrading the hypervisor will make it better... or worse ;) | 08:33 |
derekh | lifeless: it can't get much worse | 08:34 |
lifeless | hah | 08:34 |
lifeless | I see no flows on the gre incoming port (13) in dpctl dump-flows on the controller | 08:40 |
lifeless | but there is one on the hypervisor | 08:41 |
lifeless | tunnel(tun_id=0x1,src=10.10.16.175,dst=10.10.16.176,tos=0x0,ttl=64,flags(key)),in_port(3),eth(src=fa:16:3e:c7:fd:70,dst=ff:ff:ff:ff:ff:ff),eth_type(0x0806),arp(sip=10.0.0.1,tip=10.0.0.6,op=1,sha=fa:16:3e:c7:fd:70,tha=00:00:00:00:00:00), packets:3664, bytes:153888, used:0.424s, actions:push_vlan(vid=1,pcp=0),1,pop_vlan,8,16,14,push_vlan(vid=1,pcp=0),6,pop_vlan,12,10 | 08:41 |
derekh | lifeless: a lot of the openslow stuff goes over my head, the only I've seen missing flows it was because for firewall on fedora blocking gre but I guess that wouldn't be an issue here | 08:42 |
lifeless | I checked that already :) | 08:42 |
derekh | *openflow | 08:42 |
* derekh wonders if openslow was a freudian slip | 08:43 | |
lifeless | so definitely a missing flow | 08:46 |
lifeless | wonder wtf that is | 08:46 |
lifeless | ovs-appctl dpif/dump-flows br-tun | 08:46 |
lifeless | tunnel(tun_id=0x1,src=10.10.16.175,dst=10.10.16.176,tos=0x0,ttl=64,flags(key)),in_port(3),eth(src=fa:16:3e:c7:fd:70,dst=ff:ff:ff:ff:ff:ff),eth_type(0x0806),arp(sip=10.0.0.1,tip=10.0.0.6,op=1,sha=fa:16:3e:c7:fd:70,tha=00:00:00:00:00:00), packets:3963, bytes:166446, used:0.756s, actions:push_vlan(vid=1,pcp=0),1,pop_vlan,8,16,14,push_vlan(vid=1,pcp=0),6,pop_vlan,12,10 | 08:46 |
lifeless | in_port(2),eth(src=56:96:98:5e:94:4a,dst=ff:ff:ff:ff:ff:ff),eth_type(0x0800),ipv4(src=0.0.0.0,dst=255.255.255.255,proto=17,tos=0x10,ttl=128,frag=no),udp(src=68,dst=67), packets:0, bytes:0, used:4.610s, actions:drop | 08:46 |
lifeless | thats from the hypervisor | 08:46 |
lifeless | ovs-appctl dpif/dump-flows br-tun | 08:46 |
lifeless | # | 08:46 |
lifeless | from the controller | 08:46 |
lifeless | derekh: it's worth getting up to speed on ovs | 08:49 |
lifeless | http://openvswitch.org/slides/OVS-Debugging-110414.pdf for instance | 08:49 |
derekh | lifeless: thanks been meaning to for a while now, will move it up the list of priorities | 08:50 |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Change metadata names to match https://review.openstack.org/67600 | 09:00 |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Add more to the json file https://review.openstack.org/67686 | 09:00 |
openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Switch test environment users https://review.openstack.org/67614 | 09:00 |
derekh | lifeless: gotta run again, just wanted to unstick that branch (I've removed the heat resource name patch will sort that out later) | 09:01 |
*** derekh has quit IRC | 09:02 | |
*** kpavel has joined #tripleo | 09:13 | |
lifeless | ok, same behaviour with the hypervisor | 09:25 |
lifeless | fark | 09:25 |
*** e0ne has joined #tripleo | 10:37 | |
*** e0ne has quit IRC | 10:44 | |
*** e0ne has joined #tripleo | 10:46 | |
*** e0ne has quit IRC | 10:59 | |
*** e0ne has joined #tripleo | 10:59 | |
*** d0ugal has joined #tripleo | 11:42 | |
*** d0ugal has quit IRC | 12:05 | |
*** d0ugal has joined #tripleo | 12:06 | |
*** d0ugal has quit IRC | 12:14 | |
*** rushiagr has joined #tripleo | 12:33 | |
*** rushiagr has quit IRC | 12:47 | |
*** rushiagr_ has joined #tripleo | 12:48 | |
*** rushiagr has joined #tripleo | 12:49 | |
*** rushiagr_ has quit IRC | 12:56 | |
*** e0ne has quit IRC | 13:44 | |
*** e0ne has joined #tripleo | 13:45 | |
*** e0ne has quit IRC | 14:01 | |
*** e0ne has joined #tripleo | 14:02 | |
*** e0ne has quit IRC | 14:30 | |
*** rlandy has quit IRC | 14:51 | |
*** akrivoka has joined #tripleo | 14:57 | |
*** e0ne has joined #tripleo | 15:01 | |
*** e0ne has quit IRC | 15:02 | |
*** e0ne has joined #tripleo | 15:03 | |
*** e0ne has quit IRC | 15:05 | |
*** bauzas has joined #tripleo | 15:08 | |
*** d0ugal has joined #tripleo | 15:21 | |
*** coolsvap has joined #tripleo | 15:25 | |
*** e0ne has joined #tripleo | 15:29 | |
*** akrivoka has quit IRC | 15:29 | |
*** kpavel has quit IRC | 15:30 | |
*** noslzzp has joined #tripleo | 15:55 | |
*** noslzzp has quit IRC | 15:56 | |
*** tzumainn has joined #tripleo | 16:06 | |
*** ccrouch1 has quit IRC | 16:38 | |
*** ccrouch has joined #tripleo | 16:38 | |
*** ccrouch has quit IRC | 16:38 | |
*** ccrouch has joined #tripleo | 16:38 | |
*** sdake has joined #tripleo | 16:47 | |
*** shadower has joined #tripleo | 17:10 | |
*** ccrouch has quit IRC | 17:15 | |
*** ccrouch has joined #tripleo | 17:23 | |
*** sdake has quit IRC | 17:28 | |
*** sdague has quit IRC | 17:30 | |
*** sdague has joined #tripleo | 17:30 | |
*** coolsvap has quit IRC | 17:50 | |
*** ohadlevy_ is now known as ohadlevy | 18:03 | |
*** ohadlevy has joined #tripleo | 18:03 | |
*** csd has quit IRC | 18:19 | |
*** akuznetsov has quit IRC | 18:20 | |
*** bauzas has quit IRC | 18:29 | |
*** rlandy has joined #tripleo | 19:06 | |
*** bauzas has joined #tripleo | 19:20 | |
lifeless | SpamapS: which reminds me; why does oac know the occ cache path? | 19:46 |
*** sdake has joined #tripleo | 19:48 | |
rlandy | lifeless: hi - are there unit (or other specific) tests for tripleo? | 19:50 |
lifeless | rlandy: no - tripleo is a program not a project; for specific projects like e.g. os-collect-config, yes we have tests. | 19:51 |
lifeless | Not all projects do, and we're planning on tempest being the bulk of tests once we're at the 'it works in a CI loop' stage | 19:52 |
*** vkozhukalov has quit IRC | 19:58 | |
*** rlandy has quit IRC | 20:17 | |
*** noslzzp has joined #tripleo | 20:27 | |
openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Change metadata names to match https://review.openstack.org/67600 | 20:44 |
*** panda___ has joined #tripleo | 21:23 | |
*** e0ne has quit IRC | 21:24 | |
*** panda has quit IRC | 21:27 | |
SpamapS | lifeless: it doesn't have to, but it has been able to live without a config file and we'd still need a default. | 21:30 |
lifeless | SpamapS: I'm just wondering whether the layering is very wrong | 21:30 |
lifeless | SpamapS: like | 21:30 |
lifeless | SpamapS: maybe we shouldn't be offering oac direct use. | 21:30 |
lifeless | SpamapS: maybe it should be o-c-c --cached --run -- o-a-c --blah | 21:31 |
SpamapS | I'm entirely o-k with drawing that line. | 21:31 |
lifeless | cause right now oac works by knowing about occ plumbing | 21:31 |
SpamapS | well I don't think we ever want to run os-apply-config without the full o-r-c run really | 21:31 |
lifeless | which makes oac usage with e.g. chef or puppet harder | 21:31 |
SpamapS | it works that way out of convenience, and -m exists for such programs to override said plumbing | 21:32 |
SpamapS | but I'm fine with eliminating that. | 21:32 |
SpamapS | (also OS_CONFIG_FILES exists and overrides that happenstance knowledge too) | 21:33 |
lifeless | fuckity fuck fuck fuck | 21:33 |
lifeless | up10:32 <mordred> it is. when I say "have him do" I mean "I'm going to point the problem out to him" | 21:33 |
lifeless | 10:33 <lifeless> ok :) | 21:33 |
lifeless | 10:33 <mordred> otoh, he's the only hardcore js hacker, so there is a certain amount of self-selecting that | 21:33 |
lifeless | goes on | 21:33 |
lifeless | upstream kernel ovs datapath also naffed | 21:33 |
SpamapS | lifeless: seriously, I think it is fine to just say "this always has to be informed where the input is" | 21:33 |
SpamapS | lifeless: cat on the middle click? ;) | 21:34 |
lifeless | that too | 21:34 |
lifeless | root@ci-overcloud-notcompute-7sdhmmrtddid:/etc/apt# 2014-01-19T21:35:06.839Z|00014|ofproto_dpif_upcall(miss_handler)|INFO|received packet on unassociated datapath port 0 | 21:35 |
lifeless | but mainly openvswitch woes | 21:35 |
SpamapS | lifeless: so you're trying 2.0 and it is also not improving the throughput? | 21:36 |
lifeless | SpamapS: http://lists.openstack.org/pipermail/openstack-operators/2014-January/003893.html | 21:37 |
lifeless | SpamapS: (are you not on operators?) | 21:37 |
SpamapS | I am not | 21:38 |
lifeless | ah :) | 21:38 |
SpamapS | because I am not an operator. :) | 21:38 |
lifeless | SpamapS: you are | 21:38 |
SpamapS | worth adding more email reading time to me? | 21:38 |
lifeless | SpamapS: its fairly low traffic | 21:38 |
SpamapS | lifeless: ok | 21:40 |
SpamapS | I did recently unsub from all of the juju mailing lists.. :) | 21:40 |
SpamapS | lifeless: oh and doh you're right I am an operator now. :-P | 21:40 |
lifeless | :) | 21:44 |
SpamapS | lifeless: btw, Heat should be fine behind stunnel now | 21:49 |
lifeless | SpamapS: cool; that bug is closed ? | 21:51 |
SpamapS | lifeless: Fix Committed in Heat. Did we open a bug in TripleO? | 21:52 |
lifeless | SpamapS: don't think so | 21:52 |
lifeless | gnnnnar | 21:56 |
lifeless | 2.0.0 release userspace with ubuntu 3.11 kernel module fails in the same way | 21:57 |
lifeless | trying 1.11 | 21:58 |
SpamapS | lifeless: what about 3.13 from trusty? | 21:58 |
lifeless | SpamapS: haven't tried that yet | 21:58 |
lifeless | also haven't tried removing br-untagged | 21:58 |
lifeless | and running against the raw eth2 | 21:58 |
lifeless | oh thats interesting | 22:02 |
lifeless | now I'm not getting the arp responses from the hypervisor host etf | 22:02 |
lifeless | wtf | 22:02 |
lifeless | now stab | 22:08 |
lifeless | 2014-01-19T22:07:07Z|00051|dpif|WARN|system@ovs-system: failed to add gre-10.10.16.175 as port: Address family not supported by protocol | 22:08 |
lifeless | ok trying 1.11 with kernel datapath on both machines | 22:14 |
lifeless | wow, so much better. How I get 2.7KB/s. | 22:14 |
lifeless | W. | 22:14 |
lifeless | T. | 22:14 |
lifeless | F. | 22:14 |
lifeless | yanked the mtu down to 1400, and booyah | 22:15 |
lifeless | so its a pmtud problem | 22:15 |
lifeless | going to pull on the ovs version thing a little more | 22:16 |
lifeless | https://bugs.launchpad.net/tripleo/+bug/1270646 | 22:20 |
lifeless | I don't believe it... | 22:33 |
lifeless | Resume: pmtu 65535 hops 19 back 50 | 22:33 |
lifeless | nothing has a 64K pmtu across the internets | 22:34 |
lifeless | https://bugs.launchpad.net/tripleo/+bug/1270646 | 22:36 |
*** bauzas has quit IRC | 22:44 | |
openstackgerrit | Steve Kowalik proposed a change to openstack/diskimage-builder: Allow use of mirrors when building Ubuntu images https://review.openstack.org/66984 | 23:40 |
openstackgerrit | Steve Kowalik proposed a change to openstack/tripleo-incubator: Add a new remote ops JSON value to boot-seed-vm https://review.openstack.org/67366 | 23:48 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!