| lifeless | rwsu: oh - but thing to note | 00:02 |
|---|---|---|
| lifeless | rwsu: we'll have haproxy so the actual swift ports are irrelevant, its all haproxy changes, as far as the outside is concerned, so multiple listening sections | 00:02 |
| jerryz_ | lifeless: last friday, i ran into a problem that rabbitmq-server failed to be deployed on controller node. http://paste.openstack.org/show/86150/ , then i re-did stack creation but didn't reproduce the issue. | 00:03 |
| lifeless | dd on 10gb network is running ok - sdg 0.00 0.00 0.00 414.00 0.00 211968.00 1024.00 1.69 4.08 0.00 4.08 2.26 93.50 | 00:06 |
| lifeless | thats ~1.6G and there were four at once - so 6.4G of traffic | 00:06 |
| lifeless | suspect throttling to one would still make sense :) | 00:06 |
| lifeless | sdl 147.50 22.75 200.00 1698.75 825.62 868195.00 915.36 10.89 3.81 0.88 4.16 4.04 766.60 | 00:06 |
| lifeless | ^ when a single node gets a chance | 00:07 |
| lifeless | devananda: ^ FYI | 00:07 |
| *** Penick has quit IRC | 00:08 | |
| devananda | lifeless: column headers? | 00:09 |
| *** pmyers has quit IRC | 00:10 | |
| *** cinerama has joined #tripleo | 00:11 | |
| lifeless | devananda: Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz avgqu-sz await r_await w_await svctm %util | 00:14 |
| lifeless | thats 868MiBps, or 6.5Gibps | 00:14 |
| devananda | lifeless: wat sort of IO system? | 00:15 |
| lifeless | devananda: mellanox 10Gibps ethernet | 00:15 |
| devananda | that's disk stats, not net stats | 00:15 |
| lifeless | devananda: iscsi | 00:15 |
| devananda | ah | 00:16 |
| devananda | on the other end? | 00:16 |
| lifeless | devananda: 2xSATA in hw mirror, no batter cache. so == one SATA. | 00:16 |
| devananda | right. so FS cache | 00:16 |
| devananda | or some caching layer | 00:16 |
| lifeless | devananda: no; page cache :) | 00:16 |
| devananda | gah | 00:16 |
| devananda | yes | 00:16 |
| *** nati_ueno has quit IRC | 00:17 | |
| devananda | how long does iscsi disconnect take to wait for the flush? | 00:17 |
| lifeless | anyhow, yes it buffers upa nd then the fsync at the end of the dd waits for it to all flush to disk | 00:17 |
| devananda | k | 00:17 |
| lifeless | the iscsi disconnect doesn't need to wait, see ^ | 00:17 |
| devananda | yep yep | 00:17 |
| devananda | so. that's good. | 00:17 |
| devananda | also, i think your point was demonstrating a NIC saturation? | 00:18 |
| devananda | or did I miss the context completely? | 00:18 |
| *** dsneddon has quit IRC | 00:18 | |
| *** dsneddon has joined #tripleo | 00:20 | |
| devananda | oooh - parallel vs. throttle. | 00:20 |
| lifeless | right | 00:23 |
| lifeless | well | 00:23 |
| lifeless | parallel vs serial | 00:23 |
| lifeless | we get the same throughput, but the average time to live is slower with parallel(because it shifts all the reboots right) | 00:24 |
| devananda | lifeless: i would limit concurrency to some reasonable number, based on hardware | 00:28 |
| lifeless | devananda: I think ideally concurrency would equal bw-through-to-target/bw-at-target | 00:29 |
| devananda | compared to N!=1, with the N==1 case, your first reboot is sooner, but the last reboot takes longer | 00:29 |
| lifeless | devananda: e.g. 10G source, 10G nonblocking through to a moonshot chassis, 10G internally, but 1G on the blade => 10. | 00:29 |
| devananda | right | 00:29 |
| lifeless | devananda: on reboot timing, no the last reboot is identical. | 00:30 |
| devananda | actually i said that backwards | 00:31 |
| devananda | it's 5:30, i should get tea :) | 00:31 |
| openstackgerrit | Richard Su proposed a change to openstack/tripleo-image-elements: WIP: Load SELinux policy during image builds https://review.openstack.org/106908 | 00:31 |
| devananda | i am also thinking of the N >> # cpu's case | 00:32 |
| devananda | which i suspect would make it take longer | 00:32 |
| openstackgerrit | Richard Su proposed a change to openstack/tripleo-image-elements: WIP: Compile and install custom SELinux policies https://review.openstack.org/106909 | 00:35 |
| openstackgerrit | Ian Wienand proposed a change to openstack/diskimage-builder: Handle non-script grub2-install https://review.openstack.org/106912 | 00:53 |
| lifeless | devananda: cpu load shouldn't be a bottleneck in a modern arch, since its all zero-copy-or-near and then queued in the NIC | 01:00 |
| *** nosnos has quit IRC | 01:13 | |
| *** spzala has quit IRC | 01:16 | |
| *** eguz has joined #tripleo | 01:38 | |
| *** eghobo has quit IRC | 01:42 | |
| *** Yanyanhu has joined #tripleo | 01:51 | |
| openstackgerrit | Ian Wienand proposed a change to openstack/diskimage-builder: Initial centos7 support https://review.openstack.org/104449 | 01:57 |
| lifeless | man, why can't we have nice things | 01:59 |
| *** ci-overcloud has joined #tripleo | 02:00 | |
| ci-overcloud | ************** ci-overcloud complete status=1 ************ | 02:00 |
| *** ci-overcloud has quit IRC | 02:00 | |
| Yanyanhu | hi, SpamapS, are you around? | 02:03 |
| *** eguz has quit IRC | 02:15 | |
| *** pcrews has quit IRC | 02:16 | |
| *** tzumainn has quit IRC | 02:16 | |
| openstackgerrit | xu-haiwei proposed a change to openstack/tripleo-incubator: Make saving credentials files customerized https://review.openstack.org/97657 | 02:18 |
| *** yamahata has joined #tripleo | 02:39 | |
| lifeless | sigh another baddish node | 02:41 |
| *** Azher has joined #tripleo | 02:41 | |
| *** Yanyanhu has quit IRC | 02:42 | |
| *** openstackgerrit has quit IRC | 02:42 | |
| *** vinsh has quit IRC | 02:42 | |
| *** shardy has quit IRC | 02:42 | |
| *** vinsh has joined #tripleo | 02:42 | |
| *** Yanyanhu has joined #tripleo | 02:43 | |
| *** openstackgerrit has joined #tripleo | 02:44 | |
| *** shardy has joined #tripleo | 02:47 | |
| *** cinerama has quit IRC | 02:59 | |
| *** untriaged-bot has joined #tripleo | 03:00 | |
| untriaged-bot | Untriaged bugs so far: | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1340087 | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1341192 | 03:00 |
| uvirtbot | Launchpad bug 1340087 in tripleo "PXE deploy failed with nova.virt.baremetal" [Undecided,New] | 03:00 |
| uvirtbot | Launchpad bug 1341192 in tripleo "If MySQL initialization fails, restart is not attempted" [Undecided,New] | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1339986 | 03:00 |
| uvirtbot | Launchpad bug 1339986 in tripleo "when CONTROLSCALE>1 , services auth is still pointing at the local ip instead of virtual" [Undecided,In progress] | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1340467 | 03:00 |
| uvirtbot | Launchpad bug 1340467 in tripleo "services cannot be decoupled from the boot-stack element" [Undecided,In progress] | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1340776 | 03:00 |
| uvirtbot | Launchpad bug 1340776 in tripleo "Swift fails to start in overcloud" [Undecided,In progress] | 03:00 |
| *** untriaged-bot has quit IRC | 03:00 | |
| SpamapS | Yanyanhu: I'm here but just for a few minutes. | 03:00 |
| rwsu | lifeless: when you said we need to listen to both swift ports for some deprecation period, how would we go about that? afaict, swift can bind to a single port | 03:01 |
| lifeless | dib-run-parts Tue Jul 15 03:04:06 UTC 2014 Running /opt/stack/os-config-refresh/post-configure.d/79-heat-engine | 03:01 |
| lifeless | /opt/stack/venvs/heat/local/lib/python2.7/site-packages/sqlalchemy/engine/default.py:435: Warning: Specified key was too long; max key length is 767 bytes | 03:01 |
| lifeless | cursor.execute(statement, parameters) | 03:01 |
| Yanyanhu | SpamapS, thanks. I submitted a patch here https://review.openstack.org/#/c/104754/ which changed the default auth_url heat engine which pass to heat collector of os-collect config. | 03:02 |
| lifeless | rwsu: haproxy can bind to two ports and forward traffic from either to swift | 03:02 |
| rwsu | lifeless: and haproxy only proxies the swift-proxy, it doesn't currently proxy the individual object/container/account services | 03:02 |
| Yanyanhu | SpamapS, because the heat collector needs v3 keystone api to get the authentication through keystone client | 03:02 |
| lifeless | rwsu: or apache can | 03:02 |
| rwsu | lifeless: ok so need to setup haproxy to proxy those ports | 03:02 |
| rwsu | gotcha | 03:02 |
| lifeless | rwsu: now I'm confused again :) | 03:03 |
| lifeless | rwsu: we should have everything offered via haproxy/apache, no? | 03:03 |
| lifeless | rwsu: why aren't te obejct/container/account services *not* ? Do end users not use them ? | 03:03 |
| Yanyanhu | SpamapS, shardy helped to review the patach and suggestted me to try to use keystone discover to get the correct auth_url from os-collect-config side, I think I can fixed it like this. But I'm not sure which way is the best. So can I get you suggestion? Thank you so much. | 03:04 |
| lifeless | hmm, ovs-agent not coming up | 03:04 |
| Yanyanhu | SpamapS, the related bug report is here https://bugs.launchpad.net/heat/+bug/1337689 | 03:05 |
| uvirtbot | Launchpad bug 1337689 in heat "Require keystone v3 auth_url when creating software deployment metadata" [Undecided,In progress] | 03:05 |
| lifeless | ahhh | 03:05 |
| lifeless | 2014-07-15 03:07:12.877 11435 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-9f7467b5-5408-4483-af37-40e02fe3873d None] Bridge br-untagged for physical network tripleo-bm-test does not exist. Agent terminated | 03:05 |
| rwsu | lifeless: I don't think the users interact with them directly, the users/cli talk to the swift proxy service and that talks to object/container/account | 03:07 |
| lifeless | rwsu: you said earlier these were user services, not intra-cluster services | 03:09 |
| lifeless | rwsu: for clarity, do users interact with them directly? | 03:09 |
| rwsu | lifeless: the users do not, they talk to swift-proxy | 03:09 |
| lifeless | ok | 03:10 |
| lifeless | are their ports registered in keystone? | 03:10 |
| *** eghobo has joined #tripleo | 03:11 | |
| *** shardy has quit IRC | 03:12 | |
| *** Shrews has quit IRC | 03:12 | |
| *** hewbrocca has quit IRC | 03:12 | |
| *** tserong has quit IRC | 03:12 | |
| *** jogo has quit IRC | 03:12 | |
| *** dshulyak1 has quit IRC | 03:12 | |
| *** shadower has quit IRC | 03:12 | |
| *** anteaya has quit IRC | 03:12 | |
| *** yamahata__ has quit IRC | 03:12 | |
| *** morganfainberg has quit IRC | 03:12 | |
| *** Azher has quit IRC | 03:12 | |
| *** jerryz_ has quit IRC | 03:12 | |
| *** openstackgerrit has quit IRC | 03:12 | |
| *** dsneddon has quit IRC | 03:12 | |
| *** jml has quit IRC | 03:12 | |
| *** greghaynes has quit IRC | 03:12 | |
| *** bhunter71 has quit IRC | 03:12 | |
| *** gilliard has quit IRC | 03:12 | |
| *** otoolee has quit IRC | 03:12 | |
| *** jomara has quit IRC | 03:12 | |
| *** uvirtbot has quit IRC | 03:12 | |
| *** davidlenwell has quit IRC | 03:12 | |
| *** yamahata has quit IRC | 03:12 | |
| *** panda has quit IRC | 03:12 | |
| *** chuckC has quit IRC | 03:12 | |
| *** mikal has quit IRC | 03:12 | |
| *** lxsli has quit IRC | 03:12 | |
| *** tchaypo has quit IRC | 03:12 | |
| *** ekarlso has quit IRC | 03:12 | |
| *** vipul has quit IRC | 03:12 | |
| *** mkerrin has quit IRC | 03:12 | |
| *** NobodyCam has quit IRC | 03:12 | |
| *** GheRivero has quit IRC | 03:12 | |
| *** boris-42 has quit IRC | 03:12 | |
| *** sballe has quit IRC | 03:12 | |
| *** dtantsur|afk has quit IRC | 03:12 | |
| *** zigo has quit IRC | 03:12 | |
| *** adam_g has quit IRC | 03:12 | |
| *** therve has quit IRC | 03:12 | |
| *** jpeeler has quit IRC | 03:12 | |
| *** BadCub_ has quit IRC | 03:12 | |
| *** fungi has quit IRC | 03:12 | |
| *** gonery has quit IRC | 03:12 | |
| *** michchap has quit IRC | 03:12 | |
| *** lynxman has quit IRC | 03:12 | |
| *** agordeev has quit IRC | 03:12 | |
| *** zaro has quit IRC | 03:12 | |
| *** StevenK has quit IRC | 03:12 | |
| *** stevebaker has quit IRC | 03:12 | |
| *** dguerri has quit IRC | 03:12 | |
| *** Hazelesque has quit IRC | 03:12 | |
| *** vinsh has quit IRC | 03:12 | |
| *** marun_afk has quit IRC | 03:12 | |
| *** ccrouch has quit IRC | 03:12 | |
| *** lazy_prince has quit IRC | 03:12 | |
| *** mestery has quit IRC | 03:12 | |
| *** al has quit IRC | 03:12 | |
| *** ifarkas has quit IRC | 03:12 | |
| *** jtomasek has quit IRC | 03:12 | |
| *** dkehnx has quit IRC | 03:12 | |
| *** tteggel has quit IRC | 03:12 | |
| *** bnemec has quit IRC | 03:12 | |
| *** Lexis has quit IRC | 03:12 | |
| *** dkehn has quit IRC | 03:12 | |
| *** Ng has quit IRC | 03:12 | |
| *** bkero has quit IRC | 03:12 | |
| *** gothicmindfood has quit IRC | 03:12 | |
| *** ChanServ has quit IRC | 03:12 | |
| SpamapS | Yanyanhu: I don't know much about how keystoneclient works in that regard. | 03:15 |
| SpamapS | Yanyanhu: but it sounds like something that could be done. | 03:15 |
| *** ramishra has joined #tripleo | 03:17 | |
| *** akuznetsov has quit IRC | 03:17 | |
| *** imcsk8 has quit IRC | 03:18 | |
| *** jrist has quit IRC | 03:18 | |
| rwsu | lifeless: checking.. I don't believe they are, only swift-proxy | 03:18 |
| lifeless | rwsu: in which case I don't see a backwards compat issue | 03:19 |
| lifeless | rwsu: we update whever they *are* lsited (presumably the proxy config) and we're done, no?> | 03:19 |
| Yanyanhu | SpamapS, thanks a lot, so I will try to propose a patch for this bug. | 03:19 |
| *** jrist has joined #tripleo | 03:20 | |
| *** imcsk8 has joined #tripleo | 03:20 | |
| *** openstackgerrit has joined #tripleo | 03:20 | |
| *** vinsh has joined #tripleo | 03:20 | |
| *** Azher has joined #tripleo | 03:20 | |
| *** yamahata has joined #tripleo | 03:20 | |
| *** dsneddon has joined #tripleo | 03:20 | |
| *** jml has joined #tripleo | 03:20 | |
| *** marun_afk has joined #tripleo | 03:20 | |
| *** ccrouch has joined #tripleo | 03:20 | |
| *** lazy_prince has joined #tripleo | 03:20 | |
| *** Shrews has joined #tripleo | 03:20 | |
| *** mestery has joined #tripleo | 03:20 | |
| *** bkero has joined #tripleo | 03:20 | |
| *** panda has joined #tripleo | 03:20 | |
| *** sballe has joined #tripleo | 03:20 | |
| *** gilliard has joined #tripleo | 03:20 | |
| *** al has joined #tripleo | 03:20 | |
| *** hewbrocca has joined #tripleo | 03:20 | |
| *** dtantsur|afk has joined #tripleo | 03:20 | |
| *** tserong has joined #tripleo | 03:20 | |
| *** ifarkas has joined #tripleo | 03:20 | |
| *** jtomasek has joined #tripleo | 03:20 | |
| *** chuckC has joined #tripleo | 03:20 | |
| *** dkehnx has joined #tripleo | 03:20 | |
| *** morganfainberg has joined #tripleo | 03:20 | |
| *** greghaynes has joined #tripleo | 03:20 | |
| *** boris-42 has joined #tripleo | 03:20 | |
| *** ekarlso has joined #tripleo | 03:20 | |
| *** bhunter71 has joined #tripleo | 03:20 | |
| *** otoolee has joined #tripleo | 03:20 | |
| *** jogo has joined #tripleo | 03:20 | |
| *** zigo has joined #tripleo | 03:20 | |
| *** jerryz_ has joined #tripleo | 03:20 | |
| *** davidlenwell has joined #tripleo | 03:20 | |
| *** uvirtbot has joined #tripleo | 03:20 | |
| *** jomara has joined #tripleo | 03:20 | |
| *** tchaypo has joined #tripleo | 03:20 | |
| *** lxsli has joined #tripleo | 03:20 | |
| *** mikal has joined #tripleo | 03:20 | |
| *** GheRivero has joined #tripleo | 03:20 | |
| *** NobodyCam has joined #tripleo | 03:20 | |
| *** mkerrin has joined #tripleo | 03:20 | |
| *** vipul has joined #tripleo | 03:20 | |
| *** StevenK has joined #tripleo | 03:20 | |
| *** zaro has joined #tripleo | 03:20 | |
| *** dickson.freenode.net sets mode: +v davidlenwell | 03:20 | |
| *** agordeev has joined #tripleo | 03:20 | |
| *** lynxman has joined #tripleo | 03:20 | |
| *** michchap has joined #tripleo | 03:20 | |
| *** gonery has joined #tripleo | 03:20 | |
| *** fungi has joined #tripleo | 03:20 | |
| *** BadCub_ has joined #tripleo | 03:20 | |
| *** jpeeler has joined #tripleo | 03:20 | |
| *** therve has joined #tripleo | 03:20 | |
| *** adam_g has joined #tripleo | 03:20 | |
| *** Hazelesque has joined #tripleo | 03:20 | |
| *** dguerri has joined #tripleo | 03:20 | |
| *** stevebaker has joined #tripleo | 03:20 | |
| *** gothicmindfood has joined #tripleo | 03:20 | |
| *** Ng has joined #tripleo | 03:20 | |
| *** dkehn has joined #tripleo | 03:20 | |
| *** Lexis has joined #tripleo | 03:20 | |
| *** tteggel has joined #tripleo | 03:20 | |
| *** bnemec has joined #tripleo | 03:20 | |
| *** dshulyak1 has joined #tripleo | 03:20 | |
| *** shadower has joined #tripleo | 03:20 | |
| *** anteaya has joined #tripleo | 03:20 | |
| *** yamahata__ has joined #tripleo | 03:20 | |
| *** dickson.freenode.net sets mode: +v Ng | 03:20 | |
| rwsu | lifeless: I wish it was that simple, they are defaulted in the config files https://github.com/openstack/tripleo-image-elements/blob/master/elements/swift-storage/os-apply-config/etc/swift/object-server.conf | 03:21 |
| Yanyanhu | SpamapS, I will just use the keystone client discover to query the correct v3 auth_url in heat collector. And could you please help to review it if you are free. Thanks again. | 03:22 |
| rwsu | lifeless: the port number is then used to build the swift ring files, https://github.com/openstack/tripleo-image-elements/blob/master/elements/swift/os-refresh-config/configure.d/73-swift | 03:22 |
| *** shardy has joined #tripleo | 03:22 | |
| *** ChanServ has joined #tripleo | 03:23 | |
| *** dickson.freenode.net sets mode: +o ChanServ | 03:23 | |
| rwsu | lifeless: the port number in the ring file would be inconsistent with the one in config files | 03:24 |
| lifeless | right but we need to update rings for any number of reasons | 03:25 |
| lifeless | rwsu: so I think I'm saying that there would be a short outage while we update everything but thats ok | 03:29 |
| lifeless | rwsu: since we control the ring and the services and there's no API driven thing to update that we might need special casing on | 03:30 |
| rwsu | lifeless: so we just let swift rebuild the ring files or force a rebuild of the ring file? and does that affect the data that's already there? | 03:31 |
| lifeless | we already maintain the ring files | 03:32 |
| lifeless | there's a process for updating it | 03:32 |
| lifeless | we're probably not as graceful as should be:) | 03:32 |
| *** weshay has quit IRC | 03:36 | |
| rwsu | ok let me do some research on how to update them | 03:39 |
| rwsu | lifeless: in summary, file a bug to say why were are changing the port number, change the port numbers in the config files in tie, update the ring build script to add a device with the new port number and remove any devices using old port number | 03:41 |
| rwsu | does that sound right? | 03:41 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: HP1 region deploy config fixups. https://review.openstack.org/99799 | 03:46 |
| lifeless | rwsu: file a bug on swift saying the port numbers are an IANA violation; reference that bug in our overriding of the port. | 03:48 |
| lifeless | and the rest sounds right, IMO :) | 03:48 |
| rwsu | cool, I'll run with that | 03:49 |
| *** sseago has joined #tripleo | 03:56 | |
| SpamapS | rwsu: don't forget to shake your fist at them too | 03:56 |
| *** bmahalakshmi has joined #tripleo | 03:59 | |
| rwsu | haha ok ;) | 03:59 |
| *** nosnos has joined #tripleo | 04:01 | |
| *** sseago has quit IRC | 04:02 | |
| *** sseago has joined #tripleo | 04:17 | |
| openstackgerrit | Ian Wienand proposed a change to openstack/diskimage-builder: Initial centos7 support https://review.openstack.org/104449 | 04:21 |
| *** ramishra has quit IRC | 04:24 | |
| *** k4n0 has joined #tripleo | 04:27 | |
| lifeless | 04:27 | |
| lifeless | Boot failed: press a key to retry, or wait for reset... | 04:27 |
| lifeless | someday | 04:27 |
| lifeless | nice things will be mine | 04:27 |
| openstackgerrit | Richard Su proposed a change to openstack/tripleo-image-elements: Rename mariadb-rdo to mariadb-rpm https://review.openstack.org/102815 | 04:30 |
| StevenK | RescheduledException: Build of instance d06f4a41-c446-4ca3-aace-ecff41866c79 was re-scheduled: Insufficient compute resources: Free memory 0.00 MB < requested 2048 MB. | 04:30 |
| StevenK | :-( | 04:31 |
| *** rushiagr has joined #tripleo | 04:34 | |
| *** ramishra has joined #tripleo | 04:37 | |
| lifeless | StevenK: thats the bug alright | 04:39 |
| StevenK | Yeah | 04:39 |
| lifeless | StevenK: try my workaround - Ic9f625398b30bcdf81fb2796de0235713f4d4aa6 | 04:39 |
| StevenK | I'm hitting it locally | 04:39 |
| lifeless | StevenK: yes, I expect so :) | 04:39 |
| StevenK | lifeless: Your workaround is rather hideous, but you said so yourself. :-) | 04:40 |
| StevenK | Oh, it's no longer just time.sleep(5) | 04:42 |
| *** ci-overcloud has joined #tripleo | 04:42 | |
| ci-overcloud | ************** ci-overcloud complete status=1 ************ | 04:42 |
| *** ci-overcloud has quit IRC | 04:42 | |
| lifeless | still hideous | 04:43 |
| lifeless | + user-config | 04:43 |
| lifeless | ERROR (SSLError): [Errno 1] _ssl.c:510: error:14090086:SSL routines:SSL3_GET_SERVER_CERTIFICATE:certificate verify failed | 04:43 |
| lifeless | + RESULT=1 | 04:43 |
| lifeless | shazpot | 04:43 |
| * StevenK feeds in the magic DIB_REPO vars | 04:43 | |
| lifeless | rargh | 04:43 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: HP1 region deploy config fixups. https://review.openstack.org/99799 | 04:46 |
| openstackgerrit | Ian Wienand proposed a change to openstack/diskimage-builder: Initial centos7 support https://review.openstack.org/104449 | 04:49 |
| *** eghobo has quit IRC | 05:02 | |
| *** rushiagr has quit IRC | 05:03 | |
| *** rushiagr has joined #tripleo | 05:03 | |
| *** rushiagr has quit IRC | 05:08 | |
| *** eghobo has joined #tripleo | 05:12 | |
| tchaypo | tracking down why setup-endpoint fails, I've tracked it as far as a `keystone role-list` that it does to look up the admin role, that instead causes a log message from keystone saying "Signing error: unable to load certificate - ensure you have configured PKI with 'keystone-manage pki-setup'" | 05:16 |
| StevenK | Did init-keystone run? | 05:17 |
| tchaypo | yep | 05:18 |
| tchaypo | and when i run it again by handI get an error | 05:18 |
| tchaypo | "Conflict occurred attempting to store role - Duplicate entry" | 05:18 |
| tchaypo | that's in the keystone logs again | 05:18 |
| StevenK | Do you have init-keystone's initial output? | 05:19 |
| StevenK | That ssh's to the host to run keystone-manage pki_setup | 05:19 |
| tchaypo | http://paste.openstack.org/show/86501/ | 05:20 |
| tchaypo | timestamp there is 22:40:08.486 | 05:23 |
| tchaypo | looking at keystone logs | 05:23 |
| tchaypo | 2014-07-14 22:40:09.145 3551 ERROR keystoneclient.common.cms [-] Signing error: unable to load certificate | 05:23 |
| tchaypo | 3073726140:error:0906D06C:PEM routines:PEM_read_bio:no start line:pem_lib.c:703:Expecting: TRUSTED CERTIFICATE | 05:23 |
| tchaypo | suggests to me that init-keystone failed but didn't notice | 05:24 |
| tchaypo | does init-keystone log anywhere other than stdout? | 05:24 |
| StevenK | tchaypo: That output shows what I'd expect pki_setup to output, so I'd check what it did | 05:25 |
| tchaypo | how do I check that? | 05:25 |
| StevenK | I'm just about to run out the door, but I'd read pki_setup's code | 05:26 |
| tchaypo | kk | 05:26 |
| *** nati_ueno has joined #tripleo | 05:29 | |
| *** shausy has joined #tripleo | 05:30 | |
| *** eghobo has quit IRC | 05:35 | |
| *** eghobo has joined #tripleo | 05:35 | |
| *** lazy_prince is now known as killer_prince | 05:38 | |
| *** killer_prince is now known as lazy_prince | 05:39 | |
| *** rameshg87_afk is now known as rameshg87 | 05:42 | |
| *** eguz has joined #tripleo | 05:43 | |
| *** noslzzp has quit IRC | 05:43 | |
| *** eghobo has quit IRC | 05:45 | |
| *** noslzzp has joined #tripleo | 05:45 | |
| *** nati_ueno has quit IRC | 05:53 | |
| *** mrunge has joined #tripleo | 05:57 | |
| *** mrunge has quit IRC | 05:57 | |
| *** mrunge has joined #tripleo | 05:57 | |
| *** chuckC has quit IRC | 05:59 | |
| *** jcoufal has joined #tripleo | 06:03 | |
| *** pensu has joined #tripleo | 06:04 | |
| pensu | hi all, I have a doubt regarding tuskar.... | 06:05 |
| *** eguz has quit IRC | 06:05 | |
| pensu | I am trying to set up tripleO in ubuntu virtual machine..... | 06:05 |
| *** eghobo has joined #tripleo | 06:05 | |
| pensu | i deployed ironic with devstack using http://docs.openstack.org/developer/ironic/dev/dev-quickstart.html#deploying-ironic-with-devstack | 06:05 |
| pensu | then, installed tuskar-ui using http://docs.openstack.org/developer/ironic/dev/dev-quickstart.html#deploying-ironic-with-devstack | 06:05 |
| pensu | so, when i try to access the dashboard i get the error that stack (overcloud) not found... | 06:05 |
| pensu | any idea why am I getting this? | 06:05 |
| pensu | and in the browser it says filter error with /infrastructure/stack-id-1 | 06:06 |
| kviiri | Is there going to be an element for CentOS 6.5? | 06:08 |
| *** dshulyak1 has quit IRC | 06:08 | |
| *** akuznetsov has joined #tripleo | 06:16 | |
| *** rdopieralski has joined #tripleo | 06:17 | |
| *** lazy_prince has quit IRC | 06:31 | |
| *** nosnos has quit IRC | 06:32 | |
| *** bmahalakshmi has quit IRC | 06:32 | |
| *** bmahalakshmi has joined #tripleo | 06:38 | |
| *** eguz has joined #tripleo | 06:40 | |
| *** eghobo has quit IRC | 06:44 | |
| *** jang1 has joined #tripleo | 06:49 | |
| *** eguz has quit IRC | 06:51 | |
| *** killer_prince has joined #tripleo | 07:05 | |
| *** killer_prince is now known as lazy_prince | 07:05 | |
| *** mrunge has quit IRC | 07:08 | |
| *** xuhaiwei has joined #tripleo | 07:10 | |
| *** rameshg87 has quit IRC | 07:12 | |
| xuhaiwei | lifeless: if I use nova-baremetal to do the baremetal deployment, I should use the partition image, and if I use ironic, I can use disk image? | 07:14 |
| lifeless | xuhaiwei: its partition images in both cases | 07:14 |
| lifeless | xuhaiwei: ironic will be adding full disk image support, but tripleo is unlikely to use that, at least fo rnow. | 07:14 |
| xuhaiwei | Is cirros image a partition image? | 07:16 |
| lifeless | there are several sorts of cirros image | 07:16 |
| lifeless | if I recall correctly | 07:16 |
| StevenK | lifeless: patchset 2 didn't seem to fix it for me, I'm trying with patchset 1 | 07:18 |
| *** pblaho has joined #tripleo | 07:18 | |
| StevenK | My local pypi mirror is making installing dependencies so nice and fast. | 07:18 |
| lifeless | StevenK: 1 really didn't do anything, 2 has it consistently worked around for me | 07:19 |
| lifeless | StevenK: but - a) you may also be hitting the eventlet bug,w hich will look vaguely similar | 07:20 |
| lifeless | StevenK: and b) the timing figure you need may be different, because we can't have nice things | 07:20 |
| pblaho | o/ | 07:20 |
| *** mrunge has joined #tripleo | 07:23 | |
| *** mrunge has quit IRC | 07:25 | |
| *** mrunge has joined #tripleo | 07:25 | |
| StevenK | lifeless: Have we tried bisecting nova to see when this race was introduced? | 07:25 |
| lifeless | StevenK: years back; something was making it irrelevant to us. my hunch is heat improvements | 07:30 |
| *** jistr has joined #tripleo | 07:30 | |
| *** regebro has joined #tripleo | 07:31 | |
| *** dshulyak has joined #tripleo | 07:31 | |
| StevenK | lifeless: So we can fix it by making heat worse? :-P | 07:31 |
| lifeless | boom tish | 07:32 |
| *** ci-overcloud has joined #tripleo | 07:38 | |
| ci-overcloud | ************** ci-overcloud complete status=1 ************ | 07:38 |
| *** ci-overcloud has quit IRC | 07:38 | |
| greghaynes | Ive noticed that the scheduler bug is very dependent on the hardware too, FYI | 07:40 |
| greghaynes | I run into it constantly on my box with slower proc and almost not at all on one with a shiney haswell | 07:42 |
| lifeless | ok so | 07:43 |
| lifeless | ERROR: cannot verify ci-overcloud.hp1.tripleo.org's certificate, issued by ‘/C=US/O=GeoTrust, Inc./CN=RapidSSL CA’: | 07:43 |
| lifeless | Unable to locally verify the issuer's authority. | 07:43 |
| lifeless | I think that means my hosts ca-certificate setup is wrong | 07:43 |
| lifeless | but | 07:44 |
| lifeless | ii ca-certificates 20130906ubuntu2 all Common CA certificates | 07:44 |
| lifeless | now is my time to learn more ssl | 07:49 |
| lifeless | e.g. http://thenubbyadmin.com/2014/01/29/solving-wget-error-cannot-verify-site-certificate-unable-to-locally-verify-the-issuers-authority/ | 07:49 |
| lifeless | indeed geotrust rapidssl.. | 07:49 |
| lifeless | ok, so I believe that means I need to teach the certificate files ng got us about the intermediate certificate | 07:55 |
| Ng | lifeless: depending on the server that's serving the certs, there'll either be a separate config parameter to take a chain/intermediate cert, or you end up putting it the same .crt file as the actual cert (either before or after, I've seen SSL libraries that work either way or only one/other) | 07:57 |
| lifeless | Ng: the old certs worked, the new ones don't. | 07:57 |
| lifeless | Ng: I am presuming you did something different | 07:57 |
| lifeless | Ng: as for the server - its stunnel, of course. | 07:58 |
| Ng | lifeless: they've all required a chain, I'm pretty sure we hit this before too and ended up putting both intermediate and server cert in the same .crt | 07:58 |
| lifeless | Ng: how does one do that? | 07:58 |
| lifeless | Ng: just cat? | 07:58 |
| Ng | lifeless: yup, try intermediate before the server cert first | 07:59 |
| Ng | I wish there was more consistency, but lol ssl libraries :/ | 07:59 |
| lifeless | can you update your docs on the ssl certs to specify, so we don't have to remember so hard? | 07:59 |
| lifeless | Ng: https://knowledge.rapidssl.com/support/ssl-certificate-support/index?page=content&actp=CROSSLINK&id=AR1548 | 08:00 |
| StevenK | greghaynes: Huh, this machine is a 3.5GHz Ivy | 08:00 |
| lifeless | Ng: the bundled intermediate pem I presume? | 08:00 |
| Ng | lifeless: sec, 'tis call time :) | 08:00 |
| lifeless | Ng: yes, but I want CI nooooooow | 08:01 |
| *** derekh_ has joined #tripleo | 08:01 | |
| StevenK | Haha | 08:01 |
| Ng | lifeless: hrm, I should have uploaded .key, .crt and .chain (the latter being the intermediate) | 08:01 |
| lifeless | Ng: ah yes there is one | 08:01 |
| lifeless | so mv crt base; cat chain base crt ? | 08:01 |
| openstackgerrit | xu-haiwei proposed a change to openstack/tripleo-incubator: Make location of saved credentials files customerizable https://review.openstack.org/97657 | 08:03 |
| derekh_ | So quite a lot of our jobs are failing because of instances going to an error state, I *thought* this would help https://review.openstack.org/#/c/102248/6 | 08:03 |
| derekh_ | but its not, anybody have any ideas on whats going on | 08:03 |
| StevenK | derekh_: lifeless' pet bug | 08:03 |
| Ng | lifeless: if you mean >crt at the end there, yes | 08:04 |
| derekh_ | StevenK thanks, lifeless ahh so this is the same problem you hit with the hp1 deployment | 08:04 |
| StevenK | lifeless: Patchset 1 seems to working for me | 08:05 |
| StevenK | I have two contollers in spawning, but none in error | 08:06 |
| StevenK | Excellent, none spawning, all 5 active | 08:09 |
| *** athomas has joined #tripleo | 08:19 | |
| *** lazy_prince has quit IRC | 08:21 | |
| *** jang1 has quit IRC | 08:23 | |
| *** dtantsur|afk is now known as dtantsur | 08:24 | |
| openstackgerrit | Ghe Rivero proposed a change to openstack/tripleo-image-elements: Add pkg_map support to neutron element https://review.openstack.org/106960 | 08:26 |
| *** lucasagomes has joined #tripleo | 08:29 | |
| *** killer_prince has joined #tripleo | 08:29 | |
| *** killer_prince is now known as lazy_prince | 08:30 | |
| lifeless | derekh_: I think so, commented on it | 08:30 |
| *** jp_at_hp has joined #tripleo | 08:30 | |
| derekh_ | lifeless: ok, thanks | 08:31 |
| *** ramishra has quit IRC | 08:32 | |
| lifeless | lxsli: around ? | 08:33 |
| *** ramishra has joined #tripleo | 08:43 | |
| *** rushiagr has joined #tripleo | 08:48 | |
| openstackgerrit | Gregory Haynes proposed a change to openstack/os-cloud-config: WIP: Make keystone_pki less keystone specific https://review.openstack.org/103637 | 08:49 |
| openstackgerrit | xu-haiwei proposed a change to openstack/tripleo-incubator: Make location of saved credentials files customerizable https://review.openstack.org/97657 | 08:55 |
| *** gcha has joined #tripleo | 08:56 | |
| *** untriaged-bot has joined #tripleo | 09:00 | |
| untriaged-bot | Untriaged bugs so far: | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1340087 | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1341192 | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1340776 | 09:00 |
| uvirtbot | Launchpad bug 1340087 in tripleo "PXE deploy failed with nova.virt.baremetal" [Undecided,New] | 09:00 |
| uvirtbot | Launchpad bug 1341192 in tripleo "If MySQL initialization fails, restart is not attempted" [Undecided,New] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1339986 | 09:00 |
| uvirtbot | Launchpad bug 1340776 in tripleo "Swift fails to start in overcloud" [Undecided,In progress] | 09:00 |
| uvirtbot | Launchpad bug 1339986 in tripleo "when CONTROLSCALE>1 , services auth is still pointing at the local ip instead of virtual" [Undecided,In progress] | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/os-collect-config/+bug/1341936 | 09:00 |
| uvirtbot | Launchpad bug 1341936 in os-collect-config "Require keystone v3 auth_url in heat collector" [Undecided,New] | 09:00 |
| *** untriaged-bot has quit IRC | 09:00 | |
| *** cody-somerville has joined #tripleo | 09:02 | |
| openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Add an Architecture field to the Register Nodes dialog https://review.openstack.org/106707 | 09:02 |
| *** pelix has joined #tripleo | 09:11 | |
| openstackgerrit | Ghe Rivero proposed a change to openstack/tripleo-image-elements: openvswitch and openvswitch-datapath element https://review.openstack.org/95151 | 09:15 |
| openstackgerrit | Ghe Rivero proposed a change to openstack/tripleo-image-elements: Add pkg_map support to openvswitch elements https://review.openstack.org/106960 | 09:15 |
| openstackgerrit | Ghe Rivero proposed a change to openstack/tripleo-image-elements: Make use of openvswitch elements https://review.openstack.org/104115 | 09:15 |
| *** markmc has joined #tripleo | 09:18 | |
| *** martyntaylor has joined #tripleo | 09:24 | |
| *** cody-somerville has quit IRC | 09:25 | |
| lifeless | derekh_: ok so | 09:29 |
| lifeless | derekh_: on 'polluting' devtest_overcloud | 09:29 |
| lifeless | derekh_: we already have a bunch of stuff in there specifically for tripleo-cd/tripleo-ci, so its not a new thing | 09:29 |
| lifeless | derekh_: and | 09:30 |
| lifeless | derekh_: it means our use case is visible to other developers | 09:30 |
| lifeless | derekh_: also, my suggestion isn't meant to be about totally random stuff, but generalising the capabilities of devtest_overcloud to do more things, things reasonable folk like us may need to do | 09:30 |
| derekh_ | lifeless: ok, fair enough I can look into what should be merged into it | 09:31 |
| derekh_ | lifeless: I got a bit of other internal stuff todo today but will start it either this evening or tomorrow morning | 09:33 |
| *** akrivoka has joined #tripleo | 09:42 | |
| *** jang has quit IRC | 09:43 | |
| lifeless | derekh_: I think I've finally got all the glitches on the deploy; another flaky node :( | 09:43 |
| lifeless | Ng: how quickly can you make ci-overcloud.hp1.tripleo.org point at 138.35.77.5 ? | 09:46 |
| lifeless | Ng: (e.g. whats the current ttl on it?) | 09:47 |
| *** ChanServ has quit IRC | 09:55 | |
| *** dshulyak has quit IRC | 09:55 | |
| *** bmahalakshmi has quit IRC | 09:55 | |
| *** akuznetsov has quit IRC | 09:55 | |
| *** shardy has quit IRC | 09:55 | |
| *** shausy has quit IRC | 09:55 | |
| *** k4n0 has quit IRC | 09:55 | |
| *** Shrews has quit IRC | 09:55 | |
| *** hewbrocca has quit IRC | 09:55 | |
| *** tserong has quit IRC | 09:55 | |
| *** jogo has quit IRC | 09:55 | |
| *** shadower has quit IRC | 09:55 | |
| *** anteaya has quit IRC | 09:55 | |
| *** yamahata__ has quit IRC | 09:55 | |
| *** morganfainberg has quit IRC | 09:56 | |
| *** xuhaiwei has quit IRC | 09:56 | |
| *** pensu has quit IRC | 09:56 | |
| *** Azher has quit IRC | 09:56 | |
| *** jerryz_ has quit IRC | 09:56 | |
| *** gcha has quit IRC | 09:56 | |
| *** lucasagomes has quit IRC | 09:56 | |
| *** imcsk8 has quit IRC | 09:56 | |
| *** openstackgerrit has quit IRC | 09:56 | |
| *** dsneddon has quit IRC | 09:56 | |
| *** jml has quit IRC | 09:56 | |
| *** greghaynes has quit IRC | 09:56 | |
| *** bhunter71 has quit IRC | 09:56 | |
| *** gilliard has quit IRC | 09:56 | |
| *** otoolee has quit IRC | 09:56 | |
| *** jomara has quit IRC | 09:56 | |
| *** uvirtbot has quit IRC | 09:56 | |
| *** davidlenwell has quit IRC | 09:56 | |
| *** akrivoka has quit IRC | 09:56 | |
| *** jp_at_hp has quit IRC | 09:56 | |
| *** jrist has quit IRC | 09:56 | |
| *** yamahata has quit IRC | 09:56 | |
| *** panda has quit IRC | 09:56 | |
| *** mikal has quit IRC | 09:56 | |
| *** lxsli has quit IRC | 09:56 | |
| *** tchaypo has quit IRC | 09:56 | |
| *** ekarlso has quit IRC | 09:56 | |
| *** vipul has quit IRC | 09:56 | |
| *** mkerrin has quit IRC | 09:56 | |
| *** NobodyCam has quit IRC | 09:56 | |
| *** GheRivero has quit IRC | 09:56 | |
| *** boris-42 has quit IRC | 09:56 | |
| *** athomas has quit IRC | 09:56 | |
| *** regebro has quit IRC | 09:56 | |
| *** sballe has quit IRC | 09:56 | |
| *** dtantsur has quit IRC | 09:56 | |
| *** zigo has quit IRC | 09:56 | |
| *** adam_g has quit IRC | 09:56 | |
| *** therve has quit IRC | 09:56 | |
| *** jpeeler has quit IRC | 09:56 | |
| *** BadCub_ has quit IRC | 09:56 | |
| *** fungi has quit IRC | 09:56 | |
| *** gonery has quit IRC | 09:56 | |
| *** michchap has quit IRC | 09:56 | |
| *** lynxman has quit IRC | 09:56 | |
| *** agordeev has quit IRC | 09:56 | |
| *** zaro has quit IRC | 09:56 | |
| *** StevenK has quit IRC | 09:56 | |
| *** stevebaker has quit IRC | 09:56 | |
| *** dguerri has quit IRC | 09:56 | |
| *** Hazelesque has quit IRC | 09:56 | |
| *** martyntaylor has quit IRC | 09:56 | |
| *** rushiagr has quit IRC | 09:56 | |
| *** lazy_prince has quit IRC | 09:56 | |
| *** jistr has quit IRC | 09:56 | |
| *** jcoufal has quit IRC | 09:56 | |
| *** vinsh has quit IRC | 09:56 | |
| *** marun_afk has quit IRC | 09:56 | |
| *** ccrouch has quit IRC | 09:56 | |
| *** mestery has quit IRC | 09:56 | |
| *** al has quit IRC | 09:56 | |
| *** ifarkas has quit IRC | 09:56 | |
| *** jtomasek has quit IRC | 09:56 | |
| *** dkehnx has quit IRC | 09:56 | |
| *** tteggel has quit IRC | 09:56 | |
| *** bnemec has quit IRC | 09:56 | |
| *** Lexis has quit IRC | 09:56 | |
| *** dkehn has quit IRC | 09:56 | |
| *** Ng has quit IRC | 09:56 | |
| *** bkero has quit IRC | 09:56 | |
| *** gothicmindfood has quit IRC | 09:56 | |
| *** markmc has quit IRC | 09:56 | |
| *** pelix has quit IRC | 09:56 | |
| *** mrunge has quit IRC | 09:56 | |
| *** pleia2 has quit IRC | 09:56 | |
| *** rbrady has quit IRC | 09:56 | |
| *** ramishra has quit IRC | 09:56 | |
| *** pblaho has quit IRC | 09:56 | |
| *** sseago has quit IRC | 09:56 | |
| *** rwsu has quit IRC | 09:56 | |
| *** funzo has quit IRC | 09:56 | |
| *** antonym has quit IRC | 09:56 | |
| *** wendar has quit IRC | 09:56 | |
| *** nightfly has quit IRC | 09:56 | |
| *** jroll has quit IRC | 09:56 | |
| *** peoplemerge has quit IRC | 09:56 | |
| *** Daviey has quit IRC | 09:56 | |
| *** d0ugal has quit IRC | 09:56 | |
| *** phschwartz has quit IRC | 09:56 | |
| *** derekh_ has quit IRC | 09:56 | |
| *** rdopieralski has quit IRC | 09:56 | |
| *** noslzzp has quit IRC | 09:56 | |
| *** Yanyanhu has quit IRC | 09:56 | |
| *** ohadlevy has quit IRC | 09:56 | |
| *** bcrochet has quit IRC | 09:56 | |
| *** notq has quit IRC | 09:56 | |
| *** spiffxp_ has quit IRC | 09:56 | |
| *** sbadia has quit IRC | 09:56 | |
| *** sirushti has quit IRC | 09:56 | |
| *** SpamapS has quit IRC | 09:56 | |
| *** marios_ has quit IRC | 09:56 | |
| *** andrearosa has quit IRC | 09:56 | |
| *** chmouel has quit IRC | 09:56 | |
| *** proffalken has quit IRC | 09:56 | |
| *** clarkb has quit IRC | 09:56 | |
| *** devananda has quit IRC | 09:56 | |
| *** russell_h has quit IRC | 09:56 | |
| *** jeblair has quit IRC | 09:56 | |
| *** slagle has quit IRC | 09:56 | |
| *** rha has quit IRC | 09:56 | |
| *** SlickNik has quit IRC | 09:56 | |
| *** Kiall has quit IRC | 09:56 | |
| *** jcooley has quit IRC | 09:56 | |
| *** blkperl has quit IRC | 09:56 | |
| *** rdopieralski has joined #tripleo | 10:03 | |
| *** phschwartz has joined #tripleo | 10:03 | |
| *** d0ugal has joined #tripleo | 10:03 | |
| *** Daviey has joined #tripleo | 10:03 | |
| *** peoplemerge has joined #tripleo | 10:03 | |
| *** jroll has joined #tripleo | 10:03 | |
| *** wendar has joined #tripleo | 10:03 | |
| *** antonym has joined #tripleo | 10:03 | |
| *** funzo has joined #tripleo | 10:03 | |
| *** rwsu has joined #tripleo | 10:03 | |
| *** nightfly has joined #tripleo | 10:03 | |
| *** pblaho has joined #tripleo | 10:03 | |
| *** ramishra has joined #tripleo | 10:03 | |
| *** rbrady has joined #tripleo | 10:03 | |
| *** pleia2 has joined #tripleo | 10:03 | |
| *** mrunge has joined #tripleo | 10:03 | |
| *** pelix has joined #tripleo | 10:03 | |
| *** markmc has joined #tripleo | 10:03 | |
| *** sseago has joined #tripleo | 10:03 | |
| *** athomas has joined #tripleo | 10:03 | |
| *** akrivoka has joined #tripleo | 10:03 | |
| *** gcha has joined #tripleo | 10:03 | |
| *** rushiagr has joined #tripleo | 10:03 | |
| *** jp_at_hp has joined #tripleo | 10:03 | |
| *** lazy_prince has joined #tripleo | 10:03 | |
| *** lucasagomes has joined #tripleo | 10:03 | |
| *** dshulyak has joined #tripleo | 10:03 | |
| *** regebro has joined #tripleo | 10:03 | |
| *** jistr has joined #tripleo | 10:03 | |
| *** xuhaiwei has joined #tripleo | 10:03 | |
| *** bmahalakshmi has joined #tripleo | 10:03 | |
| *** akuznetsov has joined #tripleo | 10:03 | |
| *** pensu has joined #tripleo | 10:03 | |
| *** jcoufal has joined #tripleo | 10:03 | |
| *** shausy has joined #tripleo | 10:03 | |
| *** k4n0 has joined #tripleo | 10:03 | |
| *** ChanServ has joined #tripleo | 10:03 | |
| *** shardy has joined #tripleo | 10:03 | |
| *** yamahata__ has joined #tripleo | 10:03 | |
| *** anteaya has joined #tripleo | 10:03 | |
| *** shadower has joined #tripleo | 10:03 | |
| *** bnemec has joined #tripleo | 10:03 | |
| *** tteggel has joined #tripleo | 10:03 | |
| *** Lexis has joined #tripleo | 10:03 | |
| *** dkehn has joined #tripleo | 10:03 | |
| *** Ng has joined #tripleo | 10:03 | |
| *** gothicmindfood has joined #tripleo | 10:03 | |
| *** dickson.freenode.net sets mode: +ov ChanServ Ng | 10:03 | |
| *** stevebaker has joined #tripleo | 10:03 | |
| *** dguerri has joined #tripleo | 10:03 | |
| *** Hazelesque has joined #tripleo | 10:03 | |
| *** adam_g has joined #tripleo | 10:03 | |
| *** therve has joined #tripleo | 10:03 | |
| *** jpeeler has joined #tripleo | 10:03 | |
| *** BadCub_ has joined #tripleo | 10:03 | |
| *** fungi has joined #tripleo | 10:03 | |
| *** gonery has joined #tripleo | 10:03 | |
| *** michchap has joined #tripleo | 10:03 | |
| *** lynxman has joined #tripleo | 10:03 | |
| *** agordeev has joined #tripleo | 10:03 | |
| *** zaro has joined #tripleo | 10:03 | |
| *** StevenK has joined #tripleo | 10:03 | |
| *** vipul has joined #tripleo | 10:03 | |
| *** mkerrin has joined #tripleo | 10:03 | |
| *** NobodyCam has joined #tripleo | 10:03 | |
| *** GheRivero has joined #tripleo | 10:03 | |
| *** mikal has joined #tripleo | 10:03 | |
| *** lxsli has joined #tripleo | 10:03 | |
| *** tchaypo has joined #tripleo | 10:03 | |
| *** jomara has joined #tripleo | 10:03 | |
| *** uvirtbot has joined #tripleo | 10:03 | |
| *** davidlenwell has joined #tripleo | 10:03 | |
| *** jerryz_ has joined #tripleo | 10:03 | |
| *** zigo has joined #tripleo | 10:03 | |
| *** jogo has joined #tripleo | 10:03 | |
| *** otoolee has joined #tripleo | 10:03 | |
| *** bhunter71 has joined #tripleo | 10:03 | |
| *** ekarlso has joined #tripleo | 10:03 | |
| *** boris-42 has joined #tripleo | 10:03 | |
| *** greghaynes has joined #tripleo | 10:03 | |
| *** morganfainberg has joined #tripleo | 10:03 | |
| *** dkehnx has joined #tripleo | 10:03 | |
| *** jtomasek has joined #tripleo | 10:03 | |
| *** ifarkas has joined #tripleo | 10:03 | |
| *** tserong has joined #tripleo | 10:03 | |
| *** dtantsur has joined #tripleo | 10:03 | |
| *** hewbrocca has joined #tripleo | 10:03 | |
| *** al has joined #tripleo | 10:03 | |
| *** gilliard has joined #tripleo | 10:03 | |
| *** sballe has joined #tripleo | 10:03 | |
| *** panda has joined #tripleo | 10:03 | |
| *** bkero has joined #tripleo | 10:03 | |
| *** mestery has joined #tripleo | 10:03 | |
| *** Shrews has joined #tripleo | 10:03 | |
| *** ccrouch has joined #tripleo | 10:03 | |
| *** dickson.freenode.net sets mode: +v davidlenwell | 10:03 | |
| *** marun_afk has joined #tripleo | 10:03 | |
| *** jml has joined #tripleo | 10:03 | |
| *** dsneddon has joined #tripleo | 10:03 | |
| *** Azher has joined #tripleo | 10:03 | |
| *** vinsh has joined #tripleo | 10:03 | |
| *** openstackgerrit has joined #tripleo | 10:03 | |
| *** imcsk8 has joined #tripleo | 10:03 | |
| *** jrist has joined #tripleo | 10:03 | |
| *** rushiagr has quit IRC | 10:03 | |
| *** blkperl has joined #tripleo | 10:03 | |
| *** spiffxp_ has joined #tripleo | 10:03 | |
| *** sbadia has joined #tripleo | 10:03 | |
| *** sirushti has joined #tripleo | 10:03 | |
| *** SpamapS has joined #tripleo | 10:03 | |
| *** marios_ has joined #tripleo | 10:03 | |
| *** andrearosa has joined #tripleo | 10:03 | |
| *** chmouel has joined #tripleo | 10:03 | |
| *** proffalken has joined #tripleo | 10:03 | |
| *** clarkb has joined #tripleo | 10:03 | |
| *** devananda has joined #tripleo | 10:03 | |
| *** russell_h has joined #tripleo | 10:03 | |
| *** jeblair has joined #tripleo | 10:03 | |
| *** slagle has joined #tripleo | 10:03 | |
| *** rha has joined #tripleo | 10:03 | |
| *** SlickNik has joined #tripleo | 10:03 | |
| *** Kiall has joined #tripleo | 10:03 | |
| *** jcooley has joined #tripleo | 10:03 | |
| openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Use a MultiMACField in the Register Nodes form https://review.openstack.org/106366 | 10:05 |
| *** derekh_ has joined #tripleo | 10:08 | |
| *** noslzzp has joined #tripleo | 10:08 | |
| *** Yanyanhu has joined #tripleo | 10:08 | |
| *** ohadlevy has joined #tripleo | 10:08 | |
| *** bcrochet has joined #tripleo | 10:08 | |
| *** notq has joined #tripleo | 10:08 | |
| *** marun_afk has quit IRC | 10:09 | |
| *** Yanyanhu has quit IRC | 10:11 | |
| *** andreaf has joined #tripleo | 10:12 | |
| *** marun has joined #tripleo | 10:16 | |
| *** lazy_prince has quit IRC | 10:20 | |
| *** lazy_prince has joined #tripleo | 10:21 | |
| *** rushiagr has joined #tripleo | 10:28 | |
| *** rlandy has joined #tripleo | 10:29 | |
| *** lazy_prince has quit IRC | 10:36 | |
| *** michchap has quit IRC | 10:39 | |
| *** andreaf has quit IRC | 10:39 | |
| *** michchap has joined #tripleo | 10:40 | |
| *** dkehnx has quit IRC | 10:40 | |
| *** michchap has quit IRC | 10:40 | |
| *** dkehnx has joined #tripleo | 10:40 | |
| *** killer_prince has joined #tripleo | 10:41 | |
| *** killer_prince is now known as lazy_prince | 10:41 | |
| *** rushiagr_ has joined #tripleo | 10:42 | |
| *** tzumainn has joined #tripleo | 10:43 | |
| lxsli | lifeless: undead or sleeping? | 10:44 |
| *** rushiagr has quit IRC | 10:44 | |
| *** pmyers has joined #tripleo | 10:46 | |
| *** jang has joined #tripleo | 10:46 | |
| *** ramishra has quit IRC | 10:47 | |
| *** dsneddon has quit IRC | 10:48 | |
| *** pensu has quit IRC | 10:50 | |
| lifeless | lxsli: oh hi; just about to turn in - wanted to get more details on the hypervisor-stats race | 10:52 |
| lifeless | lxsli: since I thought it was a single step advertise, I'm thinking you ran into the scheduler race not hypervisor-stats mismatching | 10:52 |
| *** ramishra has joined #tripleo | 10:53 | |
| lxsli | it doesn't appear to be single step - I posted some output on the review, you can see a node appear with vcpus + memory at 0 | 10:54 |
| lxsli | I'm going to try to put together a grand spec for refactoring tripleo-incubator, I think there's a lot in the gestalt that hasn't been written down | 10:55 |
| *** chuckC has joined #tripleo | 10:56 | |
| lxsli | bringing together JP's parallelise image builds review, rationalise-ui and the less-env-vars push | 10:56 |
| openstackgerrit | Ramakrishnan G proposed a change to openstack/diskimage-builder: Add virtual media boot support in ramdisk element. https://review.openstack.org/97143 | 10:57 |
| lxsli | I think doing all the image-building at the start makes excellent narrative sense and will make reimplementing that in Python easier (similar to how Gantt is tidying up interfaces before splitting the scheduler out of Nova) | 10:57 |
| lxsli | well, I'll sling something together and we can have a good discussion. Game time. | 10:59 |
| *** Azher has quit IRC | 10:59 | |
| openstackgerrit | Matthew Gilliard proposed a change to openstack/tripleo-specs: Targeted node deployment https://review.openstack.org/106996 | 11:00 |
| openstackgerrit | Ramakrishnan G proposed a change to openstack/diskimage-builder: Add dhcp support for ramdisk element. https://review.openstack.org/97301 | 11:00 |
| *** martyntaylor has joined #tripleo | 11:02 | |
| TheJulia | good morning | 11:05 |
| *** xuhaiwei has quit IRC | 11:06 | |
| *** yamahata has joined #tripleo | 11:08 | |
| *** bmahalakshmi has quit IRC | 11:11 | |
| *** k4n0 has quit IRC | 11:15 | |
| lazy_prince | StevenK: were you able to take a look at https://review.openstack.org/#/c/103483/ (cross arch emulation)? | 11:17 |
| *** openstackgerrit has quit IRC | 11:21 | |
| *** martyntaylor has left #tripleo | 11:27 | |
| *** dkehnx has quit IRC | 11:29 | |
| StevenK | lazy_prince: Sorry about that. Done. | 11:29 |
| StevenK | TheJulia: O HAI | 11:29 |
| *** dkehnx has joined #tripleo | 11:29 | |
| *** rameshg87 has joined #tripleo | 11:30 | |
| rameshg87 | hello derekh_ | 11:31 |
| *** lucasagomes is now known as lucas-hungry | 11:31 | |
| lazy_prince | StevenK: Thanks for the feedback.. will work on the suggestions. | 11:32 |
| derekh_ | rameshg87: sorry I still have to get back to that patch, will do it today | 11:33 |
| rameshg87 | derekh_: thanks a lot :-) | 11:34 |
| *** ianw has joined #tripleo | 11:38 | |
| ianw | lazy_prince: so will the image without "vm" boot when uploaded to glance? | 11:39 |
| *** andreaf has joined #tripleo | 11:48 | |
| *** weshay has joined #tripleo | 11:49 | |
| ianw | lazy_prince: ok, don't worry about me, I see what's going on here. "vm" is being specified on the command-line as an extra element in https://review.openstack.org/#/c/88479/ ; you're right it shouldn't be part of the deps | 11:52 |
| *** martyntaylor1 has joined #tripleo | 11:53 | |
| *** andreaf has quit IRC | 11:53 | |
| *** andreaf has joined #tripleo | 11:54 | |
| jp_at_hp | lxsli: So I am already working on that. I have a spec up for review (yes, it does need updating), and I have another one being written to push up for review. Do you think you could talk to me to sync up before starting anything please? | 11:57 |
| *** yamahata has quit IRC | 11:58 | |
| *** weshay has quit IRC | 12:00 | |
| *** yamahata has joined #tripleo | 12:00 | |
| *** morazi has joined #tripleo | 12:01 | |
| *** jdob has joined #tripleo | 12:02 | |
| lifeless | Ng: chain base > crt leads to | 12:05 |
| lifeless | SSL_CTX_use_PrivateKey_file: B080074: error:0B080074:x509 certificate routines:X509_check_private_key:key values mismatch | 12:05 |
| lifeless | str_stats: 37 block(s), 7259 data byte(s), 2146 control byte(s) | 12:05 |
| lifeless | [Failed: /etc/stunnel/from-heat.conf] | 12:05 |
| *** weshay has joined #tripleo | 12:07 | |
| *** ramishra has quit IRC | 12:08 | |
| Ng | lifeless: hrm, weird, is that with cd- or ci-? | 12:08 |
| Ng | (this is on hp2, right?) | 12:08 |
| Ng | that error usually means that the crt doesn't match the key. I just checked the moduluses on the crt/key pairs on bastion.hp2∴./shared/ssl/ and they match up | 12:09 |
| Ng | it may be that that means stunnel wants "base chain >crt" | 12:10 |
| Ng | if only it were possible for the libraries to resolve the chain regardless of the order it's presented :< | 12:11 |
| lifeless | Ng: hp1 | 12:11 |
| lifeless | Ng: am trying the reverse order now | 12:11 |
| Ng | lifeless: k, checking the moduluses just in case | 12:12 |
| lifeless | Ng: if you want to bring up hp2 like I'm bringing up hp1 that would be the awesome | 12:12 |
| jp_at_hp | GheRivero: on https://review.openstack.org/#/c/104140 - you didn't adjust the dpkg element... | 12:12 |
| lifeless | Ng: /win goto mordred | 12:12 |
| lifeless | bah | 12:12 |
| *** ci-overcloud has joined #tripleo | 12:13 | |
| ci-overcloud | ************** ci-overcloud complete status=1 ************ | 12:13 |
| *** ci-overcloud has quit IRC | 12:13 | |
| jp_at_hp | GheRivero: I modified mine to just do dokg - we'll get tehre in the ned... | 12:14 |
| lifeless | Ng: e.g. use the same refs, but add a new one with a patch above mu 99799 adding an hp2 configuration | 12:14 |
| lifeless | ok, gotta sleep, will resume stabbing this in the morning | 12:15 |
| Ng | lifeless: will have a go if I get time, but I have a presentation to write about this update stuff | 12:15 |
| *** rushiagr__ has joined #tripleo | 12:16 | |
| Ng | which will be fun when the deployment of it is so broken ;) | 12:16 |
| *** openstackgerrit has joined #tripleo | 12:17 | |
| *** rushiagr_ has quit IRC | 12:19 | |
| *** dprince has joined #tripleo | 12:30 | |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Updated from global requirements https://review.openstack.org/106394 | 12:41 |
| *** martyntaylor1 has left #tripleo | 12:42 | |
| *** lucas-hungry is now known as lucasagomes | 12:44 | |
| *** rushiagr has joined #tripleo | 12:44 | |
| *** ramishra has joined #tripleo | 12:48 | |
| *** rushiagr__ has quit IRC | 12:48 | |
| *** cody-somerville has joined #tripleo | 12:48 | |
| openstackgerrit | Jon-Paul Sullivan (jp_at_hp) proposed a change to openstack/tripleo-incubator: Parallelise image builds https://review.openstack.org/106443 | 12:54 |
| *** rakesh_hs has joined #tripleo | 12:56 | |
| *** jcoufal has quit IRC | 12:58 | |
| *** pblaho has quit IRC | 12:59 | |
| *** jcoufal has joined #tripleo | 12:59 | |
| *** lynxman has quit IRC | 13:02 | |
| openstackgerrit | Dan Prince proposed a change to openstack/tripleo-image-elements: Revert "Adds passthrough config for cinder rootwra https://review.openstack.org/107041 | 13:02 |
| *** Yanyanhu has joined #tripleo | 13:02 | |
| *** pblaho has joined #tripleo | 13:03 | |
| *** jistr has quit IRC | 13:03 | |
| *** jistr has joined #tripleo | 13:05 | |
| *** Yanyanhu has quit IRC | 13:09 | |
| *** andreaf has quit IRC | 13:11 | |
| *** julim has joined #tripleo | 13:16 | |
| *** morazi has quit IRC | 13:16 | |
| *** ci-overcloud has joined #tripleo | 13:21 | |
| ci-overcloud | ************** ci-overcloud complete status=1 ************ | 13:21 |
| *** ci-overcloud has quit IRC | 13:21 | |
| *** morazi has joined #tripleo | 13:30 | |
| *** openstackgerrit has quit IRC | 13:31 | |
| *** 17SAAF480 has joined #tripleo | 13:33 | |
| 17SAAF480 | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Add a "driver" field to the Register Nodes dialog https://review.openstack.org/107052 | 13:35 |
| *** 17SAAF480 has quit IRC | 13:38 | |
| *** openstackgerrit has joined #tripleo | 13:40 | |
| *** rameshg87 has left #tripleo | 13:40 | |
| *** yanyanhu has joined #tripleo | 13:40 | |
| *** pcrews has joined #tripleo | 13:42 | |
| *** pblaho has quit IRC | 13:42 | |
| *** pblaho has joined #tripleo | 13:43 | |
| lazy_prince | can i get a +A on https://review.openstack.org/#/c/105966/. its has already 2 +2s.. | 13:44 |
| *** jeblair has quit IRC | 13:50 | |
| derekh_ | lazy_prince: This change was unable to be automatically merged with the current state of the repository. Please rebase your change and upload a new patchset. | 13:51 |
| derekh_ | :-( | 13:51 |
| *** jeblair has joined #tripleo | 13:51 | |
| *** lynxman has joined #tripleo | 13:56 | |
| GheRivero | jp_at_hp: about your parallel patch. Can it work in parts? (I mean, build only seed+undercloud or seed+overcloud) | 13:56 |
| jp_at_hp | GheRivero: it is limited by the parallelism of devtest.sh, but that is only a couple axtra switches, right? (--no-undercloud --no-overcloud) | 13:57 |
| GheRivero | jp_at_hp: I hope so. Will take a look to that later. Anyhow, on the tripleo-ci test, I also add parallelization to the boot phase, so cann't follow the devtest.sh story | 14:02 |
| *** michchap has joined #tripleo | 14:04 | |
| *** sballe has quit IRC | 14:04 | |
| jp_at_hp | GheRivero: but what you could do is run devtest.sh --parallel-build --build-only, then wait for images, then parallelise the boot phase in tripleo-ci | 14:04 |
| *** cody-somerville has quit IRC | 14:06 | |
| GheRivero | I will try that. | 14:07 |
| openstackgerrit | Om Kumar proposed a change to openstack/tripleo-image-elements: Fix argparse issue for RHEL 6.5. https://review.openstack.org/105966 | 14:07 |
| lazy_prince | derekh_: sorry.. but i have rebase it now. | 14:10 |
| openstackgerrit | Om Kumar proposed a change to openstack/diskimage-builder: Update RHEL 6.5 Image name. https://review.openstack.org/105354 | 14:17 |
| openstackgerrit | Om Kumar proposed a change to openstack/diskimage-builder: Support for UBoot. https://review.openstack.org/101577 | 14:17 |
| *** sballe has joined #tripleo | 14:22 | |
| *** lynxman has quit IRC | 14:23 | |
| *** lynxman has joined #tripleo | 14:25 | |
| *** cinerama has joined #tripleo | 14:36 | |
| *** nati_ueno has joined #tripleo | 14:38 | |
| *** cinerama has quit IRC | 14:40 | |
| *** robsparker has joined #tripleo | 14:48 | |
| *** ramishra has quit IRC | 14:49 | |
| *** ramishra has joined #tripleo | 14:49 | |
| openstackgerrit | A change was merged to openstack/tuskar-ui: Add an Architecture field to the Register Nodes dialog https://review.openstack.org/106707 | 14:50 |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Allow overwriting old images https://review.openstack.org/102744 | 14:52 |
| openstackgerrit | A change was merged to openstack/diskimage-builder: Detail 'other' directories in the README https://review.openstack.org/106048 | 14:52 |
| *** rushiagr_ has joined #tripleo | 14:52 | |
| *** sseago has quit IRC | 14:52 | |
| lazy_prince | can I get a +A on https://review.openstack.org/#/c/105966/. its has already 2 +2s after rebasing :). | 14:53 |
| *** nati_ueno has quit IRC | 14:53 | |
| *** ramishra has quit IRC | 14:54 | |
| *** rushiagr has quit IRC | 14:55 | |
| *** jtomasek has quit IRC | 14:56 | |
| *** untriaged-bot has joined #tripleo | 15:00 | |
| untriaged-bot | Untriaged bugs so far: | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1340087 | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1340776 | 15:00 |
| uvirtbot | Launchpad bug 1340087 in tripleo "PXE deploy failed with nova.virt.baremetal" [Undecided,New] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1339986 | 15:00 |
| uvirtbot | Launchpad bug 1340776 in tripleo "Swift fails to start in overcloud" [Undecided,In progress] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/os-collect-config/+bug/1341936 | 15:00 |
| uvirtbot | Launchpad bug 1339986 in tripleo "when CONTROLSCALE>1 , services auth is still pointing at the local ip instead of virtual" [Undecided,In progress] | 15:00 |
| uvirtbot | Launchpad bug 1341936 in os-collect-config "Require keystone v3 auth_url in heat collector" [Undecided,New] | 15:00 |
| *** untriaged-bot has quit IRC | 15:00 | |
| *** pblaho has quit IRC | 15:04 | |
| *** nati_ueno has joined #tripleo | 15:06 | |
| *** sseago has joined #tripleo | 15:08 | |
| openstackgerrit | Matthew Gilliard proposed a change to openstack/tripleo-specs: Targeted node deployment https://review.openstack.org/106996 | 15:08 |
| lxsli | Hello - can anyone point me at any materials about using Tuskar to | 15:09 |
| lxsli | build images? | 15:09 |
| openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Add a "driver" field to the Register Nodes dialog https://review.openstack.org/107052 | 15:10 |
| *** rushiagr_ has quit IRC | 15:12 | |
| *** yamahata has quit IRC | 15:15 | |
| openstackgerrit | Radomir Dopieralski proposed a change to openstack/tuskar-ui: Add a "driver" field to the Register Nodes dialog https://review.openstack.org/107052 | 15:16 |
| *** jistr has quit IRC | 15:20 | |
| *** jistr has joined #tripleo | 15:21 | |
| *** openstackgerrit has quit IRC | 15:21 | |
| *** jtomasek has joined #tripleo | 15:24 | |
| jdob | lxsli: tuskar isn't going to cover building images (at least, for the forseeable future), that's left to diskimage builder | 15:27 |
| *** IvanBerezovskiy has left #tripleo | 15:35 | |
| *** yanyanhu has quit IRC | 15:35 | |
| lxsli | OK thanks, getting contradictory messages | 15:36 |
| lxsli | jp_at_hp: ^^ | 15:36 |
| jp_at_hp | lxsli: well, that's interesting, and doesn't seem to match with what lifeless is saying, unless I've been misinterpeting the things he's been saying. | 15:37 |
| jdob | jp_at_hp, lxsli: read "forseeable future" as "Juno" | 15:37 |
| *** jcoufal has quit IRC | 15:38 | |
| jdob | in hindsight, i suppose my phrasing came off too much as "never going to happen" | 15:38 |
| jp_at_hp | yes, so we should still plan for tuskar to build images using whatever replacement to devtest.sh is created. Which is exactly what weas said. Thanks for the clarification jdob... | 15:38 |
| jp_at_hp | immediate deliverables can often seem like the end of the road ;) | 15:39 |
| jdob | haha, I know, i'm so used to telling the higher ups "Seriously, do not expect this in Juno" that my knee jerk reaction is to be conservative | 15:39 |
| jdob | this is actually a topic I'd really like to talk about again next week at summit, so good timing | 15:40 |
| *** nati_ueno has quit IRC | 15:40 | |
| *** rdopieralski has quit IRC | 15:40 | |
| jp_at_hp | yes - I added it to the agenda (kind of) with my spec | 15:40 |
| jp_at_hp | I am intending to update that this week, ready to go on Monday | 15:40 |
| jdob | sounds good to me | 15:41 |
| jp_at_hp | jdob: I think you've seen it already (it is in dire need of update, but deliverables, right) https://review.openstack.org/95536 | 15:41 |
| jp_at_hp | there may be a couple other specs to go with it too - if I can find the time | 15:41 |
| jdob | ah ya, i remember this now | 15:41 |
| *** shausy has quit IRC | 15:44 | |
| *** andreaf has joined #tripleo | 15:44 | |
| jp_at_hp | jdob: I know that's only the data definition, but I think that is the start, before a tool is written to consume it | 15:48 |
| *** andreaf has quit IRC | 15:50 | |
| *** andreaf has joined #tripleo | 15:50 | |
| *** jcoufal has joined #tripleo | 15:59 | |
| *** amitpp has joined #tripleo | 16:03 | |
| *** eghobo has joined #tripleo | 16:04 | |
| *** spzala has joined #tripleo | 16:07 | |
| *** rameshg87 has joined #tripleo | 16:07 | |
| *** lazy_prince is now known as killer_prince | 16:10 | |
| rameshg87 | hello derekh_ | 16:14 |
| rameshg87 | derekh_: thanks for the review :-) | 16:14 |
| rameshg87 | derekh_: request your review on this as well https://review.openstack.org/#/c/97301/ | 16:14 |
| derekh_ | rameshg87: np | 16:14 |
| *** dtantsur is now known as dtantsur|afk | 16:16 | |
| *** rushiagr_ has joined #tripleo | 16:16 | |
| *** regebro has quit IRC | 16:16 | |
| *** jistr has quit IRC | 16:16 | |
| *** cody-somerville has joined #tripleo | 16:19 | |
| *** athomas has quit IRC | 16:24 | |
| *** eghobo has quit IRC | 16:26 | |
| *** eghobo has joined #tripleo | 16:26 | |
| derekh_ | rameshg87: looking | 16:29 |
| rameshg87 | derekh_: thanks :-) | 16:29 |
| rameshg87 | dprince: request your review on https://review.openstack.org/97143 and https://review.openstack.org/97301 | 16:30 |
| rameshg87 | dprince: you had a look at both of them previously :-) | 16:30 |
| *** pblaho has joined #tripleo | 16:31 | |
| *** nati_ueno has joined #tripleo | 16:32 | |
| *** akrivoka has quit IRC | 16:32 | |
| *** jang1 has joined #tripleo | 16:33 | |
| *** dsneddon has joined #tripleo | 16:34 | |
| *** blackchip has joined #tripleo | 16:34 | |
| dprince | rameshg87: ack | 16:37 |
| rameshg87 | thanks dprince :-) | 16:37 |
| *** pblaho has quit IRC | 16:37 | |
| *** athomas has joined #tripleo | 16:38 | |
| *** blackchip has quit IRC | 16:40 | |
| *** killer_prince is now known as lazy_prince | 16:41 | |
| *** derekh_ has quit IRC | 16:42 | |
| *** cinerama has joined #tripleo | 16:46 | |
| *** nati_ueno has quit IRC | 16:50 | |
| *** pelix has quit IRC | 17:07 | |
| dprince | rameshg87: Hey. So on https://review.openstack.org/#/c/97143/7 would it be possible to make that a function? | 17:14 |
| dprince | rameshg87: sorry I didn't notice it the first time... | 17:14 |
| dprince | rameshg87: would be nice to keep scripts/init a bit cleaner by wrapping that in a function, and perhaps moving it into init-func | 17:15 |
| dprince | rameshg87: if it can be a function make those variables local too | 17:16 |
| *** rameshg871 has joined #tripleo | 17:17 | |
| rameshg871 | dprince: i agree. does it make sense to move lines 108-143 to a new function in init-func | 17:18 |
| rameshg871 | dprince: the functionality from 108-143 configures the ramdisk for vmedia parameters, so something like configure_vmedia_dir() makes sense ? | 17:19 |
| dprince | rameshg871: yep, that would work just fine | 17:19 |
| rameshg871 | dprince: okay, i will quickly refactor that :-) | 17:19 |
| rameshg871 | dprince: thanks .. | 17:19 |
| *** rameshg87 has quit IRC | 17:19 | |
| *** jtomasek has quit IRC | 17:21 | |
| *** Penick has joined #tripleo | 17:22 | |
| *** Penick has quit IRC | 17:24 | |
| *** Penick has joined #tripleo | 17:26 | |
| *** rameshg871 has quit IRC | 17:29 | |
| *** rushiagr_ has quit IRC | 17:34 | |
| *** dtantsur|afk is now known as dtantsur | 17:35 | |
| *** dkehn_ has joined #tripleo | 17:39 | |
| *** dkehnx has quit IRC | 17:42 | |
| *** rameshg87 has joined #tripleo | 17:47 | |
| *** rameshg87 has left #tripleo | 17:50 | |
| *** lucasagomes is now known as lucas-afk | 18:02 | |
| *** gcha has quit IRC | 18:05 | |
| *** gcha has joined #tripleo | 18:06 | |
| slagle | dprince: hey, got time for an ensure-bridge question? | 18:08 |
| dprince | slagle: sure, whats up? | 18:10 |
| slagle | dprince: on the overcloud control node, the mac address of br-ex should match that of the physical interface right? | 18:11 |
| slagle | i have 2 separate overclouds deployed from differnet underclouds | 18:11 |
| slagle | on one of the control nodes, networking is working, the other is not | 18:12 |
| slagle | and this is one difference i've found | 18:12 |
| slagle | on the control node where networking is not working the mac address of br-ex does not match that of eth0 | 18:12 |
| dprince | slagle: yes, assuming you have PHYSICAL_INTERFACE set in both. That should move the NIC onto the bridge... | 18:12 |
| slagle | and thus neutron-dhcp-agent is refusing to give it an IP | 18:12 |
| dprince | slagle: are you using VMs? | 18:13 |
| dprince | slagle: baremetal VMs | 18:13 |
| slagle | dprince: so afaict, everything in ensure-bridge is doing what its supposed to do, it's just that the mac doesn't end up the same | 18:13 |
| slagle | it's all vm's | 18:13 |
| slagle | ifcfg-eth0 and ifcfg-br-ex are exactly the same on both overclouds i'm comparing | 18:13 |
| dprince | slagle: can you double check the MACs of the VMs are like so: http://git.openstack.org/cgit/openstack/tripleo-incubator/tree/scripts/configure-vm#n14 | 18:14 |
| slagle | ah | 18:14 |
| slagle | they are not on the setup that isn't working | 18:14 |
| dprince | slagle: that is your issue then | 18:14 |
| slagle | ok. thx. will try again! | 18:15 |
| dprince | slagle: on a real (physical) machine this would always be the case... | 18:15 |
| dprince | slagle: This bit me too with some of the ensure-bridge re-work. I had tested things locally (on physical machines). Then I threw all my money on the table and said I'm all in, and everything turned red with failure | 18:16 |
| dprince | slagle: and that is why I'm now in the poor house | 18:17 |
| slagle | i'll buy ya a beer in raleigh | 18:17 |
| dprince | slagle: ah cool, bring your running shoes too | 18:18 |
| slagle | i will. even though my big race is over. i got nothing to train for now | 18:18 |
| *** dshurtle has joined #tripleo | 18:18 | |
| dprince | slagle: always train, then you are ready | 18:18 |
| slagle | good plan | 18:19 |
| dprince | slagle: we can always run cdub into the ground | 18:20 |
| * dprince thinks it is a good thing cdub is likely not in this channel | 18:20 | |
| slagle | that shouldn't be too hard :) | 18:20 |
| *** nati_ueno has joined #tripleo | 18:21 | |
| -openstackstatus- NOTICE: python2.6 jobs are failing due to bug 1342262 "virtualenv>=1.9.1 not found" A fix is out but there are still nodes built on the old stale images | 18:23 | |
| *** ChanServ changes topic to "python2.6 jobs are failing due to bug 1342262 "virtualenv>=1.9.1 not found" A fix is out but there are still nodes built on the old stale images" | 18:23 | |
| *** mrunge has quit IRC | 18:27 | |
| *** rakesh_hs has quit IRC | 18:30 | |
| *** dtantsur is now known as dtantsur|afk | 18:30 | |
| *** jp_at_hp1 has joined #tripleo | 18:30 | |
| *** jp_at_hp has quit IRC | 18:32 | |
| lifeless | morning | 18:36 |
| lifeless | Ng: ping | 18:37 |
| lifeless | slagle: morning! | 18:37 |
| *** Penick has quit IRC | 18:37 | |
| lifeless | hmmm | 18:39 |
| lifeless | Jul 15 18:39:46 ci-overcloud-controller0-ljblthpwm5j3 stunnel: LOG3[6494:139958845560576]: connect_blocking: connect 127.0.0.1:8774: Connection refused (111) | 18:39 |
| *** Penick has joined #tripleo | 18:40 | |
| lifeless | tcp 0 0 10.10.16.166:8774 0.0.0.0:* LISTEN 8719/python | 18:40 |
| lifeless | tcp 0 0 10.10.16.162:8774 0.0.0.0:* LISTEN 5448/haproxy | 18:40 |
| cinerama | lifeless: hi! | 18:41 |
| lifeless | cinerama: good morning! | 18:41 |
| greghaynes | lifeless: Thats waht id expect if you dont have the haproxy.stunnel.connect_ip properties defined | 18:41 |
| lifeless | hmm, I don't think I've got tchaypo's virtual ip patch set in, but HA won the race, so I need to mix that in | 18:44 |
| lifeless | which means I need 4 IPs in the UC neutron pool | 18:44 |
| lifeless | ok lets see about the connect_ip thing | 18:44 |
| lifeless | indeed no connect_ip in os-collect-config --print | 18:45 |
| greghaynes | If youre not trying to hack on ssl you shouldnt need that property though | 18:46 |
| greghaynes | since its currently off by default | 18:47 |
| greghaynes | I wonder why your stunnel is trying to connect to that though... | 18:47 |
| *** dshulyak_ has joined #tripleo | 18:48 | |
| lifeless | greghaynes: ci-overcloud, needs ssl | 18:48 |
| greghaynes | ah | 18:48 |
| Ng | lifeless: pong | 18:48 |
| lifeless | Ng: hey | 18:49 |
| lifeless | Ng: so stunnel doth work with that order | 18:49 |
| *** lazy_prince is now known as killer_prince | 18:49 | |
| Ng | lifeless: excellent | 18:49 |
| lifeless | cat ci-overcloud.hp1.tripleo.org.base ci-overcloud.hp1.tripleo.org.chain > ci-overcloud.hp1.tripleo.org.crt | 18:49 |
| lifeless | cinerama: you've started with us now, right? | 18:50 |
| cinerama | lifeless: i have! i'm at the office right now | 18:50 |
| cinerama | have to admit i like the coffee better at my other office tho :) | 18:50 |
| *** jp_at_hp has joined #tripleo | 18:51 | |
| lifeless | cinerama: naturally :) | 18:51 |
| lifeless | cinerama: you should post the same photo poolie did (of the blimp hangar) - its nearly exactly 180' out | 18:52 |
| cinerama | i happen to have one on my phone from earlier today | 18:52 |
| tchaypo | Ah | 18:55 |
| tchaypo | I think I can guess who cinerama is then | 18:55 |
| tchaypo | Even without a real name set ;) | 18:55 |
| tchaypo | Welcome! | 18:56 |
| cinerama | thanks! | 18:56 |
| lifeless | greghaynes: so is ssl known broken right now? (e.g. no testing == break?) | 18:56 |
| greghaynes | Yes, in that its not tested | 18:56 |
| lifeless | greghaynes: are there patchsets up for it, do you know? | 18:56 |
| greghaynes | None for fixes that I knwo of | 18:56 |
| lifeless | ok, so we need the snakeoil cert stuff for the vlan test job too - I really want to lock this in:) | 18:57 |
| lifeless | tchaypo: btw can you give me the review ids for your public vip stuff, at the point where I need it. | 18:57 |
| greghaynes | Ive been hacking on the os-cloud-config for us to turn turn it on by default though, bit its still WIP | 18:57 |
| lifeless | greghaynes: there was another HP patchset to do snakeoil certificates, may want to align with that | 18:57 |
| greghaynes | hrm | 18:57 |
| lifeless | +1 on getting it on by default :) | 18:58 |
| greghaynes | in -incubator? | 18:58 |
| lifeless | yeah | 18:58 |
| jp_at_hp | lifeless, is that from stuart? didnt he abandon it? | 18:58 |
| tchaypo | lifeless: Yep, let me get to a real computer. From memory they're rebased on top of the rest of the chain though so just following dependencies up the tree should find it | 18:59 |
| jp_at_hp | or am i thinking of something different? | 18:59 |
| *** derekh_ has joined #tripleo | 18:59 | |
| *** dshurtle has quit IRC | 18:59 | |
| tchaypo | lifeless: I think it's incomplete but im not sure where it's missing | 18:59 |
| *** jdob_ has joined #tripleo | 19:00 | |
| *** Penick has quit IRC | 19:01 | |
| *** jdob_ has quit IRC | 19:01 | |
| lifeless | jp_at_hp: he asked me about it and I said it was a wanted feature and he should work with greghaynes and jprovazn | 19:01 |
| lifeless | ok meeting time | 19:01 |
| lifeless | I think | 19:01 |
| greghaynes | ah | 19:02 |
| *** weshay has quit IRC | 19:03 | |
| *** weshay has joined #tripleo | 19:04 | |
| *** jistr has joined #tripleo | 19:06 | |
| *** spzala has quit IRC | 19:06 | |
| *** panda has quit IRC | 19:08 | |
| *** panda has joined #tripleo | 19:08 | |
| *** jp_at_hp1 has quit IRC | 19:11 | |
| *** pblaho has joined #tripleo | 19:16 | |
| lifeless | cinerama: btw meeting is on now in #openstack-meeting-alt | 19:21 |
| cinerama | lifeless: thanks! | 19:21 |
| *** jang has quit IRC | 19:25 | |
| tchaypo | my VIP tips are https://review.openstack.org/104368 for t-i-e and https://review.openstack.org/101438 for t-h-t | 19:27 |
| *** Penick has joined #tripleo | 19:28 | |
| *** Penick has quit IRC | 19:28 | |
| tchaypo | I'm not sure where they're at; the last few days I've been working through issues trying to build out the vlan changes on my no-vlan test setup | 19:29 |
| tchaypo | cinerama: your change to the wiki page upset me | 19:30 |
| tchaypo | cinerama: in a "i can't believe i let that slide for so long" way | 19:30 |
| tchaypo | cinerama: thanks :) | 19:31 |
| cinerama | tchaypo: well, i did get a nudge in that direction from Ng :) | 19:31 |
| tchaypo | lxsli: oh dear, that email went to launchpad? | 19:31 |
| *** Penick has joined #tripleo | 19:32 | |
| tchaypo | lxsli: I'd wondered why you were emailing me directly... I missed the reply-to mangling | 19:32 |
| greghaynes | tchaypo: did you just email all of launchpad? ;) | 19:32 |
| tchaypo | just one bug | 19:33 |
| *** spzala has joined #tripleo | 19:33 | |
| tchaypo | but I might have worded my email differently if I'd realised it was going to a bug and wasn't just a casual private chat between lxsli and i | 19:33 |
| *** pblaho has quit IRC | 19:39 | |
| *** lucas-afk has quit IRC | 19:40 | |
| *** openstackgerrit has joined #tripleo | 19:44 | |
| openstackgerrit | Dan Prince proposed a change to openstack/tripleo-incubator: Revert "Set default OVERCLOUD_CONTROLSCALE to 3" https://review.openstack.org/106852 | 19:48 |
| *** jcoufal has quit IRC | 19:52 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Passthrough-enable for nova-<service>.conf https://review.openstack.org/98357 | 19:57 |
| tchaypo | slagle: so on the topic of a default tripleorc | 19:57 |
| tchaypo | slagle: do you think the values are stable enough that we could provide a sample in the repo? | 19:57 |
| *** nibalizer has joined #tripleo | 19:59 | |
| lifeless | ok so | 20:00 |
| lifeless | wheee | 20:00 |
| lifeless | tchaypo: are you going back to sleep or hanging around? | 20:01 |
| slagle | tchaypo: well, i think the sample is devtest_variables.sh | 20:01 |
| lifeless | slagle: how is the docker stuff going? | 20:01 |
| *** jp_at_hp has quit IRC | 20:01 | |
| lifeless | slagle: cause I think that can reduce pressure on dev machines too | 20:01 |
| greghaynes | lifeless: didnt want to derail meeting - but I think pessimistic vs optimisic is about whether there is contension, not whether the request succeeds | 20:01 |
| tchaypo | I'm up for the day now. | 20:01 |
| lifeless | greghaynes: so lxsli described it to me as pessmimistic | 20:01 |
| tchaypo | slagle: but it's so big and messy, and not something people should be hacking. | 20:01 |
| lifeless | greghaynes: there may well be contending definitions | 20:01 |
| lifeless | I want much of devtest_variables to DIAF | 20:02 |
| jdob | lifeless: what do you mean by "see the approved specs actioned", as in work progressing on them, or is there another step in the spec workflow I missed? | 20:02 |
| slagle | tchaypo: right, so source devtest_variables, write-tripleorc. edit tripleorc | 20:02 |
| lifeless | jdob: work on them | 20:02 |
| jdob | kk, thanks | 20:02 |
| greghaynes | ah | 20:02 |
| lifeless | jdob: no point having a billion plans and nothing actually landed :) | 20:02 |
| slagle | tchaypo: much easier to edit | 20:02 |
| jdob | i thought the intention was a clear spec and gerrit codes it for me :) | 20:02 |
| lifeless | jdob: oh man | 20:03 |
| lifeless | jdob: you are in for such a surprise! :) | 20:03 |
| jdob | hahaha | 20:03 |
| lifeless | so anyhow | 20:03 |
| lifeless | folk with time to help get CI fixed up | 20:03 |
| greghaynes | that sounds amazing | 20:03 |
| *** cinerama` has joined #tripleo | 20:04 | |
| lifeless | https://etherpad.openstack.org/p/tripleo-ci-hp1-rebuild | 20:04 |
| tchaypo | slagle: mayhap we can autogenerate tripleorc just by doing before-and-after snapshots of the env and writing anything that was added into the file? | 20:04 |
| lifeless | is the etherpad | 20:04 |
| lifeless | I'm going to put a list of HELP NEEDED a tthe top | 20:05 |
| lifeless | right now we need | 20:05 |
| lifeless | a public VIP setup on the VLAN | 20:05 |
| lifeless | SSL support reinstated | 20:05 |
| lifeless | tchaypo: greghaynes: ^ I'm picking you as volunteers due to a) prior expression of interest and b) you know exactly how it broke :)) | 20:05 |
| lifeless | one reason each :> | 20:06 |
| lifeless | [you can of course say no] | 20:06 |
| *** dkehn_ is now known as dkehnx | 20:07 | |
| greghaynes | By the SSL bit, you mean one off make it work for CI? | 20:07 |
| greghaynes | / possible bugfices | 20:07 |
| greghaynes | actually, I guess we use real certs in CI so its a moot point | 20:08 |
| greghaynes | itll always be one-off in the way im thinking | 20:08 |
| * greghaynes -> tacos | 20:08 | |
| greghaynes | Will check out the ssl stuff post-taco | 20:08 |
| slagle | tchaypo: sorry, got distracted | 20:09 |
| lifeless | greghaynes: in the first instance, sufficient to be mixed in with tripleo-end-to-end into the hp1 region will be fine | 20:10 |
| lifeless | greghaynes: obviously following up with a CI lock-in is ideal | 20:10 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Rename mariadb-rdo to mariadb-rpm https://review.openstack.org/102815 | 20:11 |
| lifeless | derekh_: what hypervisor / testenv counts would you suggest for hp1 ? | 20:13 |
| *** jtomasek has joined #tripleo | 20:14 | |
| tchaypo | greghaynes: you're already working on the SSL bit, right? | 20:14 |
| lifeless | derekh_: when HA is in CI we'll be doing seed + 3 + 2 = 6 VMs live per CI job, and if we do the i386 2G thing thats 12G, so 8 in theory on one machine, but there's no space for the OS then, so 7 testenvs per, I think, no ? | 20:14 |
| lifeless | derekh_: (some machines are 64G too, which complicates :)) | 20:15 |
| derekh_ | lifeless: I had some notes jotted into the etherpad, let me take another look, | 20:16 |
| lifeless | slave are still 16 GB yeah? | 20:17 |
| derekh_ | lifeless: 8G | 20:17 |
| lifeless | ok 8 | 20:17 |
| lifeless | so 12G:8G | 20:17 |
| lifeless | or 3:2 | 20:17 |
| lifeless | so 24 TEs 12 hypervisors | 20:18 |
| slagle | tchaypo: right, so there is a step to run write-tripleorc at the end of devtest, but it really only "works" if you're following manual process | 20:18 |
| tchaypo | slagle: and even then, it happens right at the end | 20:19 |
| tchaypo | most new devs don't make it to the end | 20:19 |
| slagle | yea | 20:19 |
| tchaypo | because they run out of RAM, or because they don't have a local apt repo and it's going to take 3 days to download all the packages | 20:19 |
| slagle | which is why i like the generate and tweak up front | 20:19 |
| * tchaypo checks his tripleorc | 20:20 | |
| tchaypo | yeah, doesn't seem to be anything in there we wouldn't already know at the end of devtest_variables.sh | 20:20 |
| tchaypo | plus it sources devtest_variables.sh | 20:21 |
| slagle | lifeless: re: docker spec, not actively working it atm. got bumped down a bit in the priority queue. i do have some WIP patches though | 20:22 |
| tchaypo | so we can change the standard workflow from "source ~/.devtestrc; source $TRIPLEO_ROOT/tripleo-incubator/scripts/devtest_variables.sh" to just "source $TRIPLEO_ROOT/tripleorc" | 20:22 |
| slagle | lifeless: an approved spec would likely mean something in arguing for me to carve out some cycles to work on it :) | 20:22 |
| tchaypo | slagle: I'm going to open a bug about this and put it on my personal to-do list, but it's going to have to be on the back-burner behind the HA stuff | 20:23 |
| slagle | tchaypo: cool, sounds good to me | 20:25 |
| derekh_ | lifeless: 3:2 is right , wouldn't that about 21 TE hosts : 15 compute nodes | 20:25 |
| *** julim has quit IRC | 20:33 | |
| lifeless | slagle: I think its this close || to approving | 20:33 |
| lifeless | derekh_: doh I broke at math | 20:33 |
| lifeless | 36/5=7, so 21:15 indeed | 20:34 |
| tchaypo | slagle: https://bugs.launchpad.net/tripleo/+bug/1342333 | 20:34 |
| uvirtbot | Launchpad bug 1342333 in tripleo "Simpler path for developers to tweak settings" [Medium,Confirmed] | 20:34 |
| tchaypo | now that that's done.. I'm going to go get some power for my laptop, make another coffee, and start poking at my stack again | 20:34 |
| lifeless | but this is too low | 20:37 |
| *** rlandy has quit IRC | 20:37 | |
| lifeless | we have 44 working machines, 44-3 = 41 / 5 = 8.mumble, so 25:16 | 20:38 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: HP1 region deploy config fixups. https://review.openstack.org/99799 | 20:39 |
| openstackgerrit | Ryan Brady proposed a change to openstack/diskimage-builder: Don't try to install if packages is empty https://review.openstack.org/107169 | 20:40 |
| lifeless | slagle: ah missed your comment | 20:41 |
| *** dprince has quit IRC | 20:41 | |
| *** dshulyak_ has quit IRC | 20:41 | |
| lifeless | slagle: so the thing I was objecting too was conflating 'enable multiple hyperviors in the deploy cloud such that the OC can use it' | 20:41 |
| lifeless | slagle: and 'change the OC topology to scale very differently' | 20:42 |
| lifeless | slagle: thats why the pushback on the api splitout stuff, it seems like natural follow on work but not needed to be able to get a lot of benefits from docker/lxc/kvm in the deploy cloud | 20:42 |
| lifeless | slagle: and is in its own way a complex discussion | 20:43 |
| openstackgerrit | Ryan Brady proposed a change to openstack/diskimage-builder: Don't try to install if packages is empty https://review.openstack.org/107171 | 20:46 |
| greghaynes | tchaypo: Re having started on SSL: I havent started on fixing the CI issues with ssl, I have started on getting us to a point where we can ssl all the clientside things by default | 20:47 |
| greghaynes | tchaypo: was going to poke at the CI stuff once im done with some food though | 20:47 |
| tchaypo | yerp. | 20:49 |
| tchaypo | I've been poking at trying to get HA and the extra VIPs working | 20:49 |
| tchaypo | so if we both pursue our things and come together next week to try to get them both happening at once it sounds like we're on the right track | 20:50 |
| *** cinerama` has quit IRC | 20:54 | |
| *** jistr has quit IRC | 20:55 | |
| *** cinerama` has joined #tripleo | 20:56 | |
| *** morazi has quit IRC | 20:56 | |
| *** morazi has joined #tripleo | 20:57 | |
| *** sballe has quit IRC | 20:58 | |
| *** SlickNik has left #tripleo | 20:59 | |
| *** SlickNik has joined #tripleo | 20:59 | |
| *** untriaged-bot has joined #tripleo | 21:00 | |
| untriaged-bot | Untriaged bugs so far: | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1340087 | 21:00 |
| uvirtbot | Launchpad bug 1340087 in tripleo "PXE deploy failed with nova.virt.baremetal" [Undecided,New] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1340776 | 21:00 |
| uvirtbot | Launchpad bug 1340776 in tripleo "Swift fails to start in overcloud" [Undecided,In progress] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1339986 | 21:00 |
| uvirtbot | Launchpad bug 1339986 in tripleo "when CONTROLSCALE>1 , services auth is still pointing at the local ip instead of virtual" [Undecided,In progress] | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/os-collect-config/+bug/1341936 | 21:00 |
| uvirtbot | Launchpad bug 1341936 in os-collect-config "Require keystone v3 auth_url in heat collector" [Undecided,New] | 21:00 |
| *** untriaged-bot has quit IRC | 21:00 | |
| lifeless | tchaypo: ok so you're still stuck ? | 21:00 |
| *** Penick has quit IRC | 21:01 | |
| tchaypo | That's not the word I'd use, but I'm still not able to build a seed. | 21:02 |
| *** Penick has joined #tripleo | 21:02 | |
| tchaypo | Where I got to last night is that setup-endpoints calls init-keystone which seems to set up the roles | 21:03 |
| tchaypo | but keystone role-list gives a 500, so later steps can't find the admin role to use | 21:03 |
| tchaypo | This morning's first task to is to investigate what's cuasing that 500 | 21:03 |
| *** jdob has quit IRC | 21:04 | |
| *** stevebaker has quit IRC | 21:07 | |
| *** dguerri has quit IRC | 21:07 | |
| *** Hazelesque has quit IRC | 21:07 | |
| *** Hazelesque has joined #tripleo | 21:07 | |
| *** stevebaker has joined #tripleo | 21:07 | |
| *** dguerri has joined #tripleo | 21:07 | |
| *** amitpp has quit IRC | 21:13 | |
| lifeless | tchaypo: oh hahaha you have your patch depending on mine | 21:16 |
| lifeless | tchaypo: I think the public VIP is a pre-requisite for VLAN, not the other way around, so I'm going to rebase away | 21:17 |
| tchaypo | let me know when you're done and I'll pull the changes down | 21:18 |
| lifeless | tchaypo: so the seed | 21:18 |
| lifeless | tchaypo: what arch are you building? | 21:18 |
| tchaypo | *checks* | 21:23 |
| tchaypo | I don't set NODE_ARCH, so i think it defaults to same as hardware? | 21:24 |
| tchaypo | btw, this is relevant to earlier discussion about requirements | 21:24 |
| lifeless | so | 21:24 |
| lifeless | I suspect you're building amd64 | 21:24 |
| lifeless | with 2G VMs | 21:24 |
| lifeless | which won't work | 21:24 |
| lifeless | set NODE_ARCH to i386 | 21:24 |
| tchaypo | On my laptop, I can probably scrape in just barely enough RAM for a no-HA overcloud+undercloud setup - *if* I use i386 | 21:24 |
| lifeless | or use chromium | 21:25 |
| greghaynes | haha | 21:25 |
| tchaypo | but that requires that I have a local i386 apt repo - which is feasible, but requires a ton of downloading and disk space | 21:25 |
| tchaypo | I started getting it set up but it was easier to just migrate work to my hetzner machine which has sufficient ram and faster network access | 21:25 |
| lifeless | tchaypo: if you're building 4G VMs make sure my patch to maek the seed honour NODE_MEM is included in your build | 21:26 |
| greghaynes | aye, I need to hp vpn to hit the CI bastion host, dont i? | 21:26 |
| tchaypo | my seed reports | 21:27 |
| tchaypo | Linux ubuntu 3.13.0-30-generic #55-Ubuntu SMP Fri Jul 4 21:43:42 UTC 2014 i686 i686 i686 GNU/Linux | 21:27 |
| tchaypo | with 2gb ram, 576690 free (1216148 after b/c) | 21:27 |
| lifeless | ok so i386 arch seed, thats good | 21:28 |
| lifeless | greghaynes: nope | 21:28 |
| lifeless | greghaynes: stack@bastion.hp1.tripleo.org | 21:28 |
| greghaynes | success! | 21:28 |
| lifeless | now screen -xe | 21:28 |
| lifeless | erm | 21:28 |
| lifeless | -xr | 21:29 |
| lifeless | let me kick off a deploy so you can see the ssl thing in situ | 21:29 |
| greghaynes | wow this is a fancy statusline | 21:29 |
| greghaynes | looks like an overcloud build is going off ATM | 21:29 |
| lifeless | 09:29 < lifeless> let me kick off a deploy so you can see the ssl thing in situ | 21:31 |
| greghaynes | I sense an echo | 21:33 |
| tchaypo | fancy? that was just my standard, before i switched to tmux | 21:33 |
| lifeless | there's a statusline... thats fancy | 21:33 |
| *** markmc has quit IRC | 21:34 | |
| *** spzala has quit IRC | 21:39 | |
| *** ci-overcloud has joined #tripleo | 21:42 | |
| ci-overcloud | ************** ci-overcloud complete status=1 ************ | 21:42 |
| *** ci-overcloud has quit IRC | 21:42 | |
| lifeless | nuts | 21:44 |
| lifeless | hmm | 21:47 |
| lifeless | /var/log/upstart/nova-compute.log:2014-07-15 21:38:38.677 20886 TRACE nova.compute.manager [instance: ea83e0c6-a2ba-4044-8975-3974367d7716] InternalServerError: Timed out waiting for a reply to message ID 3eb3a25bc3ae48eba20002220df4a0fc (HTTP 500) | 21:47 |
| lifeless | wonder if rabbit is unhappy | 21:47 |
| lifeless | conductor not responding in a timely fashion | 21:48 |
| *** jml has quit IRC | 21:59 | |
| *** cinerama` has quit IRC | 21:59 | |
| *** cinerama` has joined #tripleo | 22:00 | |
| *** jtomasek has quit IRC | 22:00 | |
| greghaynes | :/ | 22:02 |
| greghaynes | Thats the kind if thing I was seeing with mem issues | 22:02 |
| greghaynes | but, 96gb undercloud probably doesnt have that | 22:02 |
| *** cinerama` has quit IRC | 22:02 | |
| *** cinerama` has joined #tripleo | 22:04 | |
| *** Penick has quit IRC | 22:05 | |
| tchaypo | here we go | 22:05 |
| tchaypo | http://paste.openstack.org/show/86628/ | 22:05 |
| *** jml has joined #tripleo | 22:05 | |
| *** jml has joined #tripleo | 22:05 | |
| tchaypo | looks like keystone is failing because it's not happy with the certificates it's reading | 22:05 |
| *** cody-somerville has quit IRC | 22:05 | |
| tchaypo | here we go | 22:10 |
| tchaypo | /mnt/state/etc/keystone/ssl/certs | 22:10 |
| *** cinerama` has quit IRC | 22:10 | |
| tchaypo | ca.pem ans signing_cert.pem are both 1 byte | 22:10 |
| *** cinerama` has joined #tripleo | 22:10 | |
| greghaynes | hrm | 22:11 |
| greghaynes | there was a recent change to os-cloud-config to use the heat env for those | 22:12 |
| lifeless | for the seed | 22:12 |
| greghaynes | I wonder if maybe youre running an out of date os-cloud-config? | 22:12 |
| lifeless | it has a different codepath | 22:12 |
| greghaynes | oh, this is on the seed? | 22:12 |
| lifeless | reportedly | 22:12 |
| lifeless | still uses os-cloud-config | 22:13 |
| tchaypo | yep, this is seed. | 22:13 |
| tchaypo | https://review.openstack.org/#/c/104528/ seems to be what you're talking about | 22:13 |
| greghaynes | yerp | 22:13 |
| tchaypo | my overcloud-env.json has the certs | 22:14 |
| *** Penick has joined #tripleo | 22:15 | |
| tchaypo | i was digging through os-cloud-config yesterday following the trail from devtest_seed.sh, but I wasn't looking for differences between seed and overcloud code paths. | 22:15 |
| lifeless | stevebaker: is it possible to reference an existing Neutron port in a template? | 22:16 |
| lifeless | stevebaker: e.g. I don't want it created or deleted, just used ? | 22:16 |
| *** Penick has quit IRC | 22:16 | |
| *** jml has quit IRC | 22:22 | |
| *** jang1 has quit IRC | 22:24 | |
| *** jml has joined #tripleo | 22:25 | |
| tchaypo | looking at devtest_overcloud.sh and devtest_seed.sh, they both seem to trigger the same code paths for setting up keystone | 22:25 |
| tchaypo | they both call init-keystone the same way (with different tokens); only differenceI can see is that overcloud includes -admin flag with what I think is the base API url | 22:27 |
| *** cinerama` has quit IRC | 22:27 | |
| *** cinerama` has joined #tripleo | 22:27 | |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Define and bind a public virtual IP https://review.openstack.org/101438 | 22:28 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Expose public_interface_tag support. https://review.openstack.org/103454 | 22:28 |
| lifeless | tchaypo: ^ | 22:28 |
| tchaypo | i noticed :) | 22:28 |
| lifeless | tchaypo: we need to fix the 'listens for all services thing' before I can deploy this :) | 22:29 |
| lifeless | since mysql on the wide wide web ain't great | 22:29 |
| tchaypo | yep, that should be fairly easy. | 22:29 |
| tchaypo | the heat template has a net_binds block; that gets implicitly read into each service below. For the services that should only be internal we can put a net_binds block inside the service definition that just has the internal interface | 22:30 |
| tchaypo | or switch the default to internal-only and have the custom block for the services that need both | 22:30 |
| lifeless | I'm inclined to suggest that internal-only as a default is safer | 22:30 |
| lifeless | even if its not as convenient | 22:31 |
| tchaypo | assuming the heat parser supports yaml anchors/aliases we should only have to define the non-default in one place and then reference it in the others | 22:31 |
| *** cinerama` has quit IRC | 22:32 | |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Define and bind a public virtual IP https://review.openstack.org/101438 | 22:33 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Expose public_interface_tag support. https://review.openstack.org/103454 | 22:33 |
| *** cinerama` has joined #tripleo | 22:33 | |
| lifeless | tchaypo: I don't know what you just said but I like it | 22:33 |
| tchaypo | heh | 22:33 |
| tchaypo | let me drop keystone for a minute and punch this out. | 22:33 |
| tchaypo | keystone_admin - internal only? | 22:35 |
| tchaypo | keystone_public is clearly both | 22:35 |
| lifeless | sadly keystone_admin we need to route to from the bringup | 22:35 |
| *** yamahata has joined #tripleo | 22:35 | |
| lifeless | so both | 22:35 |
| lifeless | because we use that to bring up the admin user and services IIRC | 22:36 |
| tchaypo | looking down the list | 22:37 |
| tchaypo | I'm guessing glance_registry should be internal, proably most of the heat_ services, ceilometer, swift_proxy_server? | 22:38 |
| tchaypo | okay, heat_api and heat_cfn probably need to be public | 22:38 |
| lifeless | yes, instances won't know about the internal IP (once we fix everything ;)) | 22:39 |
| lifeless | registry is external | 22:39 |
| lifeless | anything in keystone has to be external | 22:40 |
| *** morazi has quit IRC | 22:41 | |
| tchaypo | so the things I have right now that are internal-only are glance_api, heat_cloudwatch, ceilometer, and swift_proxy_server | 22:41 |
| lifeless | no, no, no, no. | 22:42 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: HP1 region deploy config fixups. https://review.openstack.org/99799 | 22:42 |
| tchaypo | public we have keystone_*, horizon, neutron, cinder, glance_registry, heat_api, heat_cfn, nvoa_ec2, nova_osapi, nova_metadata | 22:42 |
| lifeless | I guess mysql and RMQ aren't added yet. ok :) | 22:42 |
| tchaypo | hah. so at this point, everything is external? | 22:43 |
| tchaypo | that's fun | 22:43 |
| lifeless | the only thing that shouldn't be is perhaps nova_ec2 | 22:43 |
| lifeless | but we can review that later I think, since we run it in signed mode for neutron | 22:43 |
| openstackgerrit | James Polley proposed a change to openstack/tripleo-heat-templates: Define and bind a public virtual IP https://review.openstack.org/101438 | 22:44 |
| lifeless | ruh roh | 22:44 |
| tchaypo | Fairly confident the aliases/anchors will work because mergy.py is going to parse the file first. it uses pyyaml so they'll be expanded as it reads the file | 22:45 |
| greghaynes | eeek | 22:45 |
| tchaypo | once merge.py goes away we should be fine as long as we're using pyyaml or any of the other standard parsers. | 22:45 |
| greghaynes | Im not sure thats a great idea | 22:45 |
| tchaypo | greghaynes: using anchors/aliases, or relying on merge.py? | 22:46 |
| tchaypo | I'm certain the latter isn't, but I don't think we are. | 22:46 |
| greghaynes | Seems like thats adding a dependency for us to use $templater in addition to heat | 22:46 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Expose public_interface_tag support. https://review.openstack.org/103454 | 22:46 |
| greghaynes | or are you saying itll work if we dont use merge.py at all? | 22:46 |
| lifeless | its a yaml feature | 22:46 |
| tchaypo | achors/aliases are a standard part of the yaml spec, so anything that implements yaml should support them | 22:47 |
| greghaynes | I always used to think yaml was so simple | 22:47 |
| tchaypo | I've never seen a problem I'm just a little wary because they also seem to be one of the YAML features people don't make a lot of use of | 22:47 |
| openstackgerrit | Adam Gandelman proposed a change to openstack/tripleo-incubator: User-specified undercloud and overcloud img names https://review.openstack.org/107199 | 22:48 |
| lifeless | greghaynes: I first heard of it today | 22:49 |
| lifeless | greghaynes: and I'm like whoa | 22:50 |
| greghaynes | So, AIUI heat really just wants something json-able | 22:50 |
| lifeless | greghaynes: yaml | 22:50 |
| lifeless | greghaynes: it defines its inputs as yaml, not json | 22:51 |
| lifeless | greghaynes: :) evil grin here <- | 22:51 |
| greghaynes | I though that gets json'd in heat client | 22:51 |
| greghaynes | s/though/thought | 22:51 |
| *** derekh_ has quit IRC | 22:51 | |
| lifeless | tchaypo: when pyyaml parses it, the aliases get resolved right? | 22:51 |
| lifeless | tchaypo: is in it doesn't require explicit evaluation ? | 22:52 |
| *** morazi has joined #tripleo | 22:54 | |
| tchaypo | correct. | 22:55 |
| lifeless | greghaynes: ^ | 22:57 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Make use of ip route replace in ensure-bridge https://review.openstack.org/104461 | 22:57 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Set the MAC address for ensure-bridge bridges https://review.openstack.org/99604 | 22:57 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Fix issues with provider networks and public ips https://review.openstack.org/103449 | 22:57 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Support new virtual_interfaces definition for VIPs https://review.openstack.org/104368 | 22:57 |
| greghaynes | Yea, im up for trying it out | 22:58 |
| greghaynes | I also have no experience with them so *shrug* | 22:58 |
| tchaypo | ewwwww | 22:58 |
| tchaypo | there are two \ts in overcloud-source.yaml | 22:58 |
| greghaynes | heh, I had a draft comment on that open | 22:58 |
| lifeless | did I just do that ? | 22:58 |
| lifeless | sorry | 22:59 |
| tchaypo | which seem to need to be expanded as 8-space tabs | 22:59 |
| tchaypo | lifeless: what's your $EDITOR? | 22:59 |
| *** morazi has quit IRC | 22:59 | |
| lifeless | this is my not-laptop-vim config | 22:59 |
| lifeless | is less magical | 23:00 |
| tchaypo | ah | 23:00 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Define and bind a public virtual IP https://review.openstack.org/101438 | 23:00 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Expose public_interface_tag support. https://review.openstack.org/103454 | 23:00 |
| tchaypo | I don't know if it's feasible for you, but I have my ~/.vim in https://bitbucket.org/jamezpolley/dot-vim for easier syncing across hosts | 23:01 |
| lifeless | so, I'm going to unrebase these and let them roll independently - see tripleo-end-to-end for a good way to manage this | 23:02 |
| lifeless | unrelated thing should be unrelated | 23:02 |
| tchaypo | kk | 23:02 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Expose public_interface_tag support. https://review.openstack.org/103454 | 23:03 |
| *** Penick has joined #tripleo | 23:20 | |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: Support new virtual_interfaces definition for VIPs https://review.openstack.org/104368 | 23:26 |
| lifeless | there | 23:26 |
| tchaypo | okay, I'm going to let that change stew and go back to looking at my nutron isn't getting configured for me. | 23:26 |
| tchaypo | becuase that's blocking me getting a setup where I can test the vlan/vip changes | 23:26 |
| openstackgerrit | lifeless proposed a change to openstack/tripleo-image-elements: HP1 region deploy config fixups. https://review.openstack.org/99799 | 23:42 |
| lifeless | tchaypo: my refs: http://paste.ubuntu.com/7800886/ | 23:43 |
| lifeless | ok new image time to get keepalived support. | 23:45 |
| lifeless | -> food while that bakes | 23:45 |
| *** Penick has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!