| *** yuanying_ has joined #tripleo | 00:01 | |
| *** ramishra has quit IRC | 00:02 | |
| lifeless | tchaypo: win! | 00:02 |
|---|---|---|
| *** yuanyin__ has joined #tripleo | 00:04 | |
| *** yuanying has quit IRC | 00:04 | |
| *** yuanying_ has quit IRC | 00:06 | |
| tchaypo | and so finally i can ask register-nodes to update my list of nodes | 00:06 |
| tchaypo | and I get | 00:06 |
| tchaypo | BadRequest: Invalid input for field/attribute value. Value: '49152'. Wrong type. Expected '<type 'unicode'>', got '<type 'int'>' (HTTP 400) | 00:06 |
| lifeless | tchaypo: yay, you can give StevenK a bug report :) | 00:11 |
| *** rainya has quit IRC | 00:11 | |
| lifeless | SpamapS: whats this for? | 00:11 |
| SpamapS | lifeless: ansible | 00:12 |
| tchaypo | lifeless: nope, his docs make it clear that the memory should be a string | 00:12 |
| lifeless | tchaypo: right, but was it a string before? | 00:12 |
| tchaypo | okay that's a lie, his docs are silent. His *sample* uses a string | 00:12 |
| lifeless | tchaypo: and was it working before ? | 00:12 |
| lifeless | tchaypo: if you have a working input file for the old register-nodes, that makes the new one incompatible | 00:13 |
| SpamapS | lifeless: what we have right now is basically a monolithic workflow+tiny orchestration bits. What we want is the orchestration bits hidden safely behind Ansible's built in abstraction which has a terrible name, "roles" | 00:15 |
| tchaypo | My file has changed since I last ran the old register-nodes | 00:15 |
| tchaypo | however | 00:15 |
| tchaypo | http://docs.openstack.org/developer/tripleo-incubator/devtest_setup.html?highlight=nodes#devtest-test-environment-configuration is the docs in -incubator for the old register-nodes and it says that the memory is in KB | 00:15 |
| tchaypo | (no mention of string vs int) | 00:15 |
| tchaypo | (see step 6) | 00:16 |
| tchaypo | http://docs.openstack.org/developer/os-cloud-config/usage.html#registering-nodes-with-a-baremetal-service is the new register-nodes; it just has "2048" with no mention of what the unit is. | 00:16 |
| tchaypo | I'm fairly certain StevenK isn't suggesting deploying nodes with 2048k of ram though. | 00:16 |
| tchaypo | it looks like the old register-nodes had: | 00:18 |
| tchaypo | ironic node-update $NODE_ID add $(jq -r '"properties/cpus=" + (.cpu|tostring) + " properties/memory_mb=" + (.memory|tostring) + " properties/local_gb=" + (.disk|tostring) + " properties/cpu_arch=" + .arch' <<< $NODE_JSON) | 00:18 |
| tchaypo | so I'm guessing it would take either a string or an int.. | 00:18 |
| tchaypo | and testing confirms it. | 00:23 |
| tchaypo | :q | 00:25 |
| *** otoolee has quit IRC | 00:29 | |
| tchaypo | https://bugs.launchpad.net/os-cloud-config/+bug/1382275 | 00:30 |
| uvirtbot | Launchpad bug 1382275 in os-cloud-config "new register-nodes does not accept ints for numeric input" [Critical,Triaged] | 00:30 |
| *** noslzzp has joined #tripleo | 00:33 | |
| openstackgerrit | A change was merged to stackforge/kolla: configure nova database connection https://review.openstack.org/129059 | 00:43 |
| openstackgerrit | A change was merged to stackforge/kolla: Run nova-api as privileged so it can muck with iptables https://review.openstack.org/129054 | 00:43 |
| *** ChuckC has quit IRC | 00:48 | |
| tchaypo | ... and now I discover that register_nodes will abort if it hits one node that's locked by nova, instead of skipping it and moving on | 00:49 |
| tchaypo | and the error message just tells me there was a "Conflict" | 00:49 |
| tchaypo | (more info is available in debug, but I shouldn't need to debug) | 00:49 |
| lifeless | tchaypo: bug #2 ;) | 00:50 |
| *** marun has quit IRC | 00:52 | |
| *** ChuckC has joined #tripleo | 00:54 | |
| *** noslzzp has quit IRC | 00:56 | |
| cinerama | bug party! | 00:56 |
| *** ramishra has joined #tripleo | 00:58 | |
| *** jerryz has joined #tripleo | 00:59 | |
| tchaypo | #2? | 01:00 |
| *** yuanyin__ has quit IRC | 01:00 | |
| tchaypo | no, I think that's #2 *and* #3 | 01:00 |
| tchaypo | #2 is the fact that the default output doesn't tell me what's happening | 01:00 |
| tchaypo | bug #3 is the fact that the error message doesn't tell me what the error was | 01:00 |
| uvirtbot | Launchpad bug 3 in launchpad "Custom information for each translation team" [Low,Fix released] https://launchpad.net/bugs/3 | 01:00 |
| SpamapS | hm.. setting up a new seed-only.. seed just sits at "booting from hard disk" and then something about text being deprecated | 01:00 |
| tchaypo | and I guess bug #4 is the fact that it shouldn't abort when it hits a single locked node | 01:01 |
| uvirtbot | Launchpad bug 4 in launchpad "Importing finished po doesn't change progressbar" [Medium,Fix released] https://launchpad.net/bugs/4 | 01:01 |
| tchaypo | thanks uvirtbot | 01:01 |
| *** RioS2 has joined #tripleo | 01:01 | |
| *** ramishra has quit IRC | 01:02 | |
| *** yuanying has joined #tripleo | 01:03 | |
| jerryz | SpamapS: if i want to make it HA mode, what should i do? just assign 3 controllers? | 01:03 |
| SpamapS | jerryz: CONTROLSCALE=3 | 01:04 |
| SpamapS | jerryz: sorry, OVERCLOUD_CONTROLSCALE=3 | 01:04 |
| *** rainya has joined #tripleo | 01:04 | |
| cinerama | man, bashate really doesn't like "## " does it | 01:04 |
| jerryz | SpamapS: endpoints url will be haproxy IP automatically? | 01:05 |
| *** yuanying has quit IRC | 01:05 | |
| *** yuanying_ has joined #tripleo | 01:05 | |
| SpamapS | jerryz: correct | 01:08 |
| SpamapS | jerryz: a VIP will be allocated from the range you allocate to the overcloud, and that will be your API endpoint for everything. | 01:10 |
| *** otoolee has joined #tripleo | 01:11 | |
| jerryz | SpamapS: that VIP need to be in the same range as all API servers? | 01:12 |
| jerryz | SpamapS: can i use public IP for front ends and an internal for backends? | 01:14 |
| SpamapS | jerryz: that is theoretically possible, but I don't think devtest supports that. | 01:14 |
| SpamapS | actually hmm | 01:15 |
| SpamapS | it might | 01:15 |
| SpamapS | jerryz: I think you can actually do that | 01:16 |
| lifeless | we did the work for it for CI | 01:17 |
| lifeless | just the patches haven't all landed | 01:17 |
| lifeless | its only been 4 months | 01:17 |
| SpamapS | The templates allow setting a different one on the PublicVirtualIP. | 01:17 |
| lifeless | gnar, sorry, didn't mean to be bitchy | 01:17 |
| SpamapS | But I know that just having the port doesn't mean we know how to use it :-P | 01:17 |
| lifeless | publicvip is in the public network for the overcloud | 01:18 |
| lifeless | it has to be in the same public network | 01:18 |
| lifeless | the backends don't live on the public network | 01:18 |
| lifeless | they live in the controlplane network | 01:18 |
| lifeless | (and neither is the tenant network- it can be totally different) | 01:19 |
| SpamapS | lifeless: PublicVirtualNetwork defaults to ctlplane | 01:19 |
| lifeless | yes defaults | 01:19 |
| lifeless | the vlan patches haven't all landed | 01:19 |
| lifeless | examine the cd-cloud config for hp1 or hp2 | 01:19 |
| lifeless | and te tripleo-end-to-end config for their patchesets | 01:20 |
| *** sdake_ has quit IRC | 01:20 | |
| SpamapS | lifeless: ok, jerryz, btw, if you haven't figured it out, is our friend from Huawei :) | 01:20 |
| lifeless | SpamapS: I know :) - we've sat down at actual tables before | 01:20 |
| SpamapS | lifeless: and so is trying to stand up a TripleO cloud on 16 machines. :) | 01:20 |
| SpamapS | just making sure | 01:20 |
| lifeless | fairynuff | 01:22 |
| SpamapS | and with that I retire to family time for a bit | 01:23 |
| * StevenK ponders a trip outside to reposition a chain saw | 01:23 | |
| cinerama | StevenK: that sounds....ominous | 01:24 |
| StevenK | Oh, now they've started a chipper | 01:24 |
| StevenK | Which is louder, more annoying and harder to reposition | 01:24 |
| jerryz | SpamapS, lifeless: thank you. will figure it out. | 01:24 |
| lifeless | jerryz: you may want to talk to tchaypo to get a current tripleo-end-to-end yaml for this | 01:25 |
| cinerama | is there a consensus opinion on one-liner bash if statements style-wise? | 01:25 |
| jerryz | lifeless: ok. | 01:25 |
| StevenK | Personally, I like: if [ -n "$FOO" ]; then | 01:25 |
| lifeless | cinerama: such as? | 01:26 |
| cinerama | lifeless: e.g. if [ $? != 0 ] ; then echo "Terminating..." >&2 ; exit 1 ; fi | 01:27 |
| lifeless | cinerama: I suspect enough folk will find it hard enough to read to want it multi-lined | 01:27 |
| cinerama | bashate reports not-so-useful error messages in that case and in the case of | 01:27 |
| cinerama | if [ condition ]; then #nodocs | 01:28 |
| openstackgerrit | Richard Su proposed a change to openstack/tripleo-image-elements: SELinux: Update keepalived custom policy https://review.openstack.org/128764 | 01:28 |
| *** nosnos has joined #tripleo | 01:32 | |
| openstackgerrit | Steve Kowalik proposed a change to openstack/os-cloud-config: Deprecate PKI setup in init-keystone https://review.openstack.org/126456 | 01:36 |
| openstackgerrit | Steve Kowalik proposed a change to openstack/os-cloud-config: user is no longer required for init-keystone https://review.openstack.org/129105 | 01:36 |
| tchaypo | jerryz: actually my yaml is a bit out of date. I was just starting to look at it last night and I realised that the triple-incubator in particular requires a big rebase before I can use it. | 01:40 |
| StevenK | SpamapS: When you're back, perhaps you should resurrect the Kilo mid-cycle sprint e-mail so we can get some people interested in it | 01:41 |
| cinerama | yay midcycle! | 01:43 |
| jerryz | tchaypo: i can take apart devstack_overcloud.sh, customize the steps, do it step by step if necessary | 01:44 |
| StevenK | Oh good, they've driven off with the chipper | 01:46 |
| StevenK | Now I can stop contemplating murder | 01:46 |
| cinerama | I live near a sports bar with an outdoor area so I periodically hear cheering | 01:47 |
| cinerama | i have no idea what they're watching, so I'm like "YAY SPORTS" | 01:47 |
| StevenK | gus: Every time your mail mentions "nsenter" I have to re-read it to work it out | 01:48 |
| StevenK | "N Senter? No, that doesn't work. Oh, maybe it's NS for namespace ..." | 01:49 |
| gus | ya, namespaces. | 01:49 |
| gus | nobody talks about cgroups, which is the other half of "containers" | 01:50 |
| greghaynes | StevenK: Did you see your favorite of patches is back | 01:51 |
| StevenK | greghaynes: ... no? | 01:52 |
| greghaynes | https://review.openstack.org/#/c/129062/ | 01:52 |
| StevenK | Let me get the brain bleach ready so I can forget quickly | 01:53 |
| StevenK | greghaynes: Is that a simple resurrection? | 01:53 |
| greghaynes | The commit message has changed | 01:54 |
| greghaynes | :) | 01:54 |
| StevenK | greghaynes: You will answer for your sins (re: the t-i-e changes) in Paris | 01:55 |
| greghaynes | yea, its bad | 01:55 |
| StevenK | I really really hate mustache sometimes | 01:55 |
| greghaynes | srsly | 01:56 |
| StevenK | greghaynes: However, I think your t-h-t changes need a rework | 01:56 |
| StevenK | The t-i-e changes look okay, but I think I need to find caffeine or something stronger to parse the template. | 01:57 |
| greghaynes | ah, thats fair | 01:57 |
| StevenK | greghaynes: The undercloud is what kept going "BANG!" during my testing before the Revert of Doom | 01:57 |
| *** rainya has quit IRC | 01:58 | |
| StevenK | greghaynes: Where's the toci patch up to? | 01:59 |
| *** rainya has joined #tripleo | 01:59 | |
| *** ramishra has joined #tripleo | 01:59 | |
| greghaynes | which one? | 02:00 |
| *** weshay has quit IRC | 02:00 | |
| greghaynes | https://review.openstack.org/#/c/71837/ ? | 02:01 |
| StevenK | greghaynes: Yup | 02:01 |
| greghaynes | I think it works | 02:01 |
| StevenK | greghaynes: Yes, but you said the same thing about the ssl_pki branch :-P | 02:03 |
| lifeless | StevenK: revert of doom? | 02:03 |
| greghaynes | StevenK: haha, in all fairness the ssl pki patch landed while I was on PTO | 02:03 |
| *** ramishra has quit IRC | 02:03 | |
| StevenK | lifeless: ssl_pki was reverted out of os-cloud-config because it broke the world | 02:03 |
| greghaynes | also I didnt realise that CI was a total lie for that repo :p | 02:03 |
| greghaynes | I wish there was some reasonably way to test that toci patch but pretty sure we just have to go for it | 02:04 |
| StevenK | % git show d1a22691865f999212097dff2d2ac49627479a1e | diffstat -s | 02:04 |
| StevenK | 8 files changed, 341 insertions(+), 495 deletions(-) | 02:04 |
| StevenK | Therefore, Revert of Doom | 02:04 |
| openstackgerrit | greghaynes proposed a change to openstack-infra/tripleo-ci: Build a local pip mirror of python packages being tested https://review.openstack.org/71837 | 02:05 |
| StevenK | greghaynes: So you fixed the commit message to remove WIP: on the short line, but didn't remove the WIP bit at the end? | 02:06 |
| openstackgerrit | greghaynes proposed a change to openstack-infra/tripleo-ci: Build a local pip mirror of python packages being tested https://review.openstack.org/71837 | 02:06 |
| greghaynes | StevenK: huh? where? | 02:06 |
| StevenK | In patch set 4, you cheater :-P | 02:06 |
| StevenK | greghaynes: I think my only complaint about it is some of the comments need re-flowing | 02:08 |
| greghaynes | The todos | 02:09 |
| greghaynes | ? | 02:09 |
| *** rainya has quit IRC | 02:09 | |
| StevenK | greghaynes: Here, have a proper review | 02:12 |
| *** rainya has joined #tripleo | 02:20 | |
| *** rainya has quit IRC | 02:23 | |
| stevebaker | SpamapS: ugh, having renamed the request collector to url, I now remember that heat has been released assuming it is called 'request' http://git.openstack.org/cgit/openstack/heat/tree/heat/engine/resources/server.py#n402 | 02:25 |
| *** rainya has joined #tripleo | 02:32 | |
| *** rhallisey has quit IRC | 02:34 | |
| *** pradeep has joined #tripleo | 02:35 | |
| *** pradeep1 has quit IRC | 02:35 | |
| jpeeler | sdake: ryan beat me. fyi, i usually am away from my computer 3 pm your time onwards (sometimes i return late like now). | 02:39 |
| *** cwolferh_ has joined #tripleo | 02:41 | |
| *** spzala has quit IRC | 02:44 | |
| *** rainya has quit IRC | 02:46 | |
| jpeeler | larsks: i guess you missed this blog post - http://blog.docker.com/2014/10/docker-1-3-signed-images-process-injection-security-options-mac-shared-directories/ | 02:46 |
| larsks | jpeeler: ?? | 02:48 |
| larsks | Oh, is it released? | 02:48 |
| jpeeler | yeah | 02:48 |
| larsks | Wow. | 02:48 |
| larsks | Cool. | 02:48 |
| larsks | Also, --fixed-cidr is cool. | 02:48 |
| jpeeler | what does that do? (not a docker expert) | 02:49 |
| *** rainya_ has joined #tripleo | 02:49 | |
| larsks | So, pre 1.3, docker would feel free to use the entire address space associated with the docker bridge -- so attaching containers directly to a local network was basically impossible, because docker would tromp on existing addresses. | 02:49 |
| larsks | With 1.3, you can limit the address ranged used by docker with --fixed-cidr. | 02:49 |
| jpeeler | oh nifty | 02:50 |
| *** rainya has joined #tripleo | 02:51 | |
| *** ramishra has joined #tripleo | 02:52 | |
| *** rainya_ has quit IRC | 02:52 | |
| *** ramishra_ has joined #tripleo | 02:58 | |
| *** untriaged-bot has joined #tripleo | 03:00 | |
| untriaged-bot | Untriaged bugs so far: | 03:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1381408 | 03:00 |
| *** untriaged-bot has quit IRC | 03:00 | |
| uvirtbot | Launchpad bug 1381408 in diskimage-builder ""visudo" always got error when building overcloud image" [Undecided,New] | 03:00 |
| *** ramishra has quit IRC | 03:01 | |
| *** ramishra_ has quit IRC | 03:02 | |
| *** ramishra has joined #tripleo | 03:02 | |
| *** ramishra has quit IRC | 03:07 | |
| *** pradeep has quit IRC | 03:13 | |
| *** pradeep has joined #tripleo | 03:13 | |
| *** cwolferh_ has quit IRC | 03:15 | |
| *** yamahata has joined #tripleo | 03:18 | |
| *** ramishra has joined #tripleo | 03:22 | |
| *** julim has joined #tripleo | 03:24 | |
| openstackgerrit | James Polley proposed a change to openstack/os-cloud-config: If one node is locked, keep trying the rest. https://review.openstack.org/129119 | 03:26 |
| *** jcoufal has joined #tripleo | 03:27 | |
| *** pradeep1 has joined #tripleo | 03:30 | |
| *** pradeep has quit IRC | 03:32 | |
| *** pradeep has joined #tripleo | 03:39 | |
| *** pradeep1 has quit IRC | 03:41 | |
| *** pradeep1 has joined #tripleo | 03:45 | |
| *** pradeep has quit IRC | 03:45 | |
| SpamapS | stevebaker: ahh the fun of unpublished API's. ;) | 03:47 |
| *** marun has joined #tripleo | 03:49 | |
| openstackgerrit | James Polley proposed a change to openstack/os-cloud-config: If one node is locked, keep trying the rest. https://review.openstack.org/129119 | 03:50 |
| *** pradeep has joined #tripleo | 03:53 | |
| SpamapS | https://www.dropbox.com/s/u255ncbie3ry202/seed-stuck.png?dl=0 | 03:54 |
| SpamapS | anybody ever seen this? | 03:54 |
| SpamapS | My seed just stops there | 03:55 |
| *** sdake_ has joined #tripleo | 03:55 | |
| *** pradeep1 has quit IRC | 03:56 | |
| *** nealph_ has joined #tripleo | 03:58 | |
| nealph_ | lsmola: Ping? | 03:58 |
| *** tzumainn has quit IRC | 04:07 | |
| *** nealph_ has quit IRC | 04:15 | |
| tchaypo | SpamapS: heh | 04:16 |
| tchaypo | SpamapS: haven't seen it, but it's funny because it's happening to someone else. | 04:16 |
| *** jang1 has joined #tripleo | 04:17 | |
| *** ramishra has quit IRC | 04:17 | |
| SpamapS | tchaypo: hm, I may have an arch problem | 04:19 |
| SpamapS | some things i386, some amd64 | 04:20 |
| *** ramishra has joined #tripleo | 04:20 | |
| StevenK | Neat. os-cloud-config's highest McCabe complexity is 13 | 04:20 |
| *** ramishra has quit IRC | 04:20 | |
| SpamapS | hm no | 04:21 |
| SpamapS | StevenK: flirting with "maybe we _COULD_ do this in bash.." ;-) | 04:22 |
| * SpamapS builds a new seed just to see | 04:22 | |
| StevenK | SpamapS: Hah | 04:23 |
| StevenK | SpamapS: Did you see my gentle prod re: mid-cycle? | 04:23 |
| SpamapS | StevenK: no, where did you gently prod? | 04:29 |
| StevenK | [12:41] < StevenK> SpamapS: When you're back, perhaps you should resurrect the Kilo mid-cycle sprint e-mail so we can get some people interested in it | 04:30 |
| SpamapS | ahhh | 04:30 |
| SpamapS | StevenK: didn't we delegate that to greghaynes? ;) | 04:31 |
| SpamapS | this is driving me nuts. Why won't this seed boot? | 04:31 |
| *** pcrews has quit IRC | 04:42 | |
| *** pradeep1 has joined #tripleo | 04:45 | |
| openstackgerrit | James Polley proposed a change to openstack/os-cloud-config: If one node is locked, keep trying the rest. https://review.openstack.org/129119 | 04:46 |
| tchaypo | StevenK: through an ept use of patch, I managed to leave in one change from the previous revision that i had intended to revert, and then also add the replacement change that I wanted to use instead | 04:47 |
| tchaypo | ^^^ should now be consistent | 04:47 |
| *** pradeep has quit IRC | 04:47 | |
| *** cwolferh_ has joined #tripleo | 04:50 | |
| *** ramishra has joined #tripleo | 04:50 | |
| * tchaypo attempts an overcloud deployment | 04:51 | |
| tchaypo | FOR TEH LOLZ | 04:51 |
| *** jcoufal has quit IRC | 04:52 | |
| SpamapS | ok now it's a different error | 04:55 |
| SpamapS | https://www.dropbox.com/s/o9u0ftut83keukm/AlignFail.png?dl=0 | 04:55 |
| StevenK | SpamapS: That smells like arch mismatch | 04:56 |
| SpamapS | NODE_ARCH=amd64 no_proxy=127.0.0.1 break=after-error PYPI_MIRROR_URL=http://127.0.0.1/pypi/simple SEED_DIB_EXTRA_ARGS="pypi" DIB_NO_PYPI_PIP=1 scripts/devtest_seed.sh | 04:56 |
| SpamapS | after 'setup-seed-vm -a amd64 -c 2 -m 8192' | 04:57 |
| StevenK | tchaypo: We no longer run nova-bm in CI, so you can't use CI logs to refute | 04:57 |
| SpamapS | and I see amd64 cloud image being pulled in | 04:57 |
| *** sseago has quit IRC | 05:01 | |
| *** sseago has joined #tripleo | 05:01 | |
| * SpamapS tries clearing .cache/image-create | 05:08 | |
| *** pradeep has joined #tripleo | 05:10 | |
| *** lazy_prince has quit IRC | 05:11 | |
| *** ci-overcloud has joined #tripleo | 05:11 | |
| ci-overcloud | ************** ci-overcloud complete status=1 ************ | 05:11 |
| *** ci-overcloud has quit IRC | 05:11 | |
| *** pradeep1 has quit IRC | 05:12 | |
| tchaypo | whee | 05:12 |
| tchaypo | ERROR: Property error : NovaCompute22: image Error validating value u'': The Image () could not be found. | 05:13 |
| tchaypo | so that's new | 05:13 |
| tchaypo | StevenK: I don't understand what nova-bm has to do with anything | 05:14 |
| *** otoolee has quit IRC | 05:15 | |
| StevenK | tchaypo: register_func is called for both | 05:15 |
| tchaypo | oh, I see | 05:17 |
| tchaypo | _update_or_register_bm_node | 05:17 |
| tchaypo | is going to return something else | 05:17 |
| tchaypo | *shrug* do I care? I have a problem with how it handles ironic | 05:17 |
| *** pradeep1 has joined #tripleo | 05:17 | |
| tchaypo | this fixes my problem.. nova-bm is deprecated, I'm not sure why I should care enough to fix the problem there | 05:18 |
| *** pradeep has quit IRC | 05:19 | |
| StevenK | tchaypo: I care, which is why I bring it up | 05:19 |
| *** ramishra has quit IRC | 05:19 | |
| tchaypo | curse you. | 05:25 |
| tchaypo | so what *does* _update_or_register_bm_node return? | 05:26 |
| tchaypo | i mean, raise? | 05:26 |
| tchaypo | as far as i can tell the answer is "nothing", so this failure is unique to ironic | 05:27 |
| *** otoolee has joined #tripleo | 05:27 | |
| tchaypo | it does: | 05:27 |
| tchaypo | raise novaexc.ServiceUnavailable() | 05:27 |
| tchaypo | but that's because the *service* is unreachable, not just because *one node* is busy right now. The two are completely different | 05:27 |
| *** pradeep has joined #tripleo | 05:28 | |
| StevenK | tchaypo: It may also raise an uncaught exception from client.baremetal.create() | 05:28 |
| StevenK | But I'm sort of in conflict. I'd like to remove the nova-bm stuff, but backwards compat :-( | 05:28 |
| tchaypo | sure, it might do that, I assume it could also raise an uncaught exception from the ironic equivalent, i assume | 05:29 |
| tchaypo | but I | 05:29 |
| *** pradeep1 has quit IRC | 05:29 | |
| tchaypo | I'm not trying to fix the problem of "create failed for unknown reason", I'm trying to fix the problem of "couldn't update right this second because nova has locked the node" | 05:29 |
| *** pradeep1 has joined #tripleo | 05:30 | |
| tchaypo | but that's only because that's the only problem I've seen. If I'd seen other problems maybe I'd care about them too. | 05:30 |
| tchaypo | I'm so sleepy I'm actually contemplating going for a run or something to wake up. | 05:31 |
| *** ramishra has joined #tripleo | 05:31 | |
| *** pradeep has quit IRC | 05:32 | |
| *** pradeep has joined #tripleo | 05:36 | |
| *** pradeep1 has quit IRC | 05:37 | |
| *** pradeep1 has joined #tripleo | 05:40 | |
| *** pradeep has quit IRC | 05:42 | |
| *** pradeep has joined #tripleo | 05:43 | |
| *** pradeep1 has quit IRC | 05:45 | |
| *** marun has quit IRC | 05:48 | |
| *** pradeep1 has joined #tripleo | 05:56 | |
| *** pradeep has quit IRC | 05:58 | |
| *** pradeep has joined #tripleo | 05:59 | |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: Update Horizon to use NEUTRON instead of QUANTUM https://review.openstack.org/127421 | 06:02 |
| SpamapS | so | 06:02 |
| openstackgerrit | Steven Dake proposed a change to stackforge/kolla: Remove nova-base since there is only 1 image for nova-compute https://review.openstack.org/129136 | 06:03 |
| SpamapS | nobody has ideas why this VM is doing this? | 06:03 |
| openstackgerrit | Steven Dake proposed a change to stackforge/kolla: Make nova-compute work properly with libvirt https://review.openstack.org/129137 | 06:03 |
| *** pradeep1 has quit IRC | 06:03 | |
| SpamapS | I'm basically going to assume aliens have replaced my CPU with a frustration generator and leave it at that. :-P | 06:03 |
| StevenK | SpamapS: I had a quick look, but even Google failed me | 06:05 |
| SpamapS | StevenK: yeah me too :-P | 06:05 |
| StevenK | Some randoms have filed bugs with that text on LP, but no replies | 06:05 |
| lifeless | SpamapS: whats going on? | 06:05 |
| SpamapS | lifeless: seed won't boot | 06:05 |
| lifeless | symptoms? | 06:05 |
| StevenK | SpamapS: Maybe grep grub2 source? | 06:05 |
| SpamapS | https://www.dropbox.com/s/o9u0ftut83keukm/AlignFail.png?dl=0 | 06:06 |
| SpamapS | or | 06:06 |
| *** pradeep1 has joined #tripleo | 06:06 | |
| SpamapS | https://www.dropbox.com/s/u255ncbie3ry202/seed-stuck.png?dl=0 | 06:06 |
| *** dshulyak_ has joined #tripleo | 06:07 | |
| lifeless | what disk label is in use? | 06:07 |
| StevenK | https://lists.debian.org/debian-vote/2014/10/msg00001.html makes me very very sad | 06:07 |
| SpamapS | disk label? | 06:07 |
| lifeless | mbr/gpt/? | 06:08 |
| *** mrunge has joined #tripleo | 06:08 | |
| SpamapS | lifeless: how would I know? | 06:08 |
| StevenK | disk geometry? No, that isn't right either | 06:08 |
| *** pradeep has quit IRC | 06:08 | |
| lifeless | SpamapS: well, if its out main code, its mbr :) | 06:09 |
| *** k4n0 has joined #tripleo | 06:09 | |
| SpamapS | lifeless: ok. that it is. | 06:09 |
| lifeless | how much memory is the seed configured with? https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=605567 looks like it might match | 06:10 |
| uvirtbot | Debian bug 605567 in grub-pc "grub-pc: does not boot with "unaligned pointer 0x...." when insmod-ing part_{msdos, gpt}" [Normal,Fixed] | 06:10 |
| SpamapS | I did skip running devtest_testenv.sh, because my desire is to setup a seed only.. so I just manually ran setup-seed-vm with the args I wanted | 06:10 |
| SpamapS | lifeless: tried w/ the defaults (3G I think) and 8G | 06:10 |
| lifeless | hmmm, I think we should have mbr, buts its possible folk have been adding gpt | 06:10 |
| lifeless | I haven't tracked closely in a bit | 06:10 |
| *** pradeep has joined #tripleo | 06:11 | |
| *** pensu has joined #tripleo | 06:12 | |
| SpamapS | It just seems a bit random.. | 06:13 |
| *** pradeep1 has quit IRC | 06:13 | |
| *** pradeep has quit IRC | 06:15 | |
| *** pradeep has joined #tripleo | 06:16 | |
| SpamapS | ok something weird is going on | 06:17 |
| lifeless | SpamapS: the second one looks like it worked but hung? | 06:17 |
| SpamapS | if I just run' devtest.sh --trash-my-machine on the box, seed comes up | 06:18 |
| SpamapS | so I missed a step | 06:18 |
| SpamapS | ok I'll have to chase it down tomorrow | 06:22 |
| * SpamapS goes to bed | 06:22 | |
| *** pradeep1 has joined #tripleo | 06:24 | |
| *** pradeep has quit IRC | 06:25 | |
| *** marun has joined #tripleo | 06:26 | |
| *** jprovazn has joined #tripleo | 06:27 | |
| sdake_ | can anyone paste the contents of keystone endpoint-list please? | 06:29 |
| *** pradeep has joined #tripleo | 06:30 | |
| *** pradeep1 has quit IRC | 06:31 | |
| *** marun has quit IRC | 06:31 | |
| *** pradeep1 has joined #tripleo | 06:32 | |
| *** killer_prince has joined #tripleo | 06:33 | |
| *** marun has joined #tripleo | 06:33 | |
| *** killer_prince is now known as lazy_prince | 06:33 | |
| *** ramishra has quit IRC | 06:33 | |
| *** pradeep has quit IRC | 06:34 | |
| *** pradeep has joined #tripleo | 06:35 | |
| *** avozza is now known as zz_avozza | 06:35 | |
| *** pradeep1 has quit IRC | 06:36 | |
| *** pradeep1 has joined #tripleo | 06:37 | |
| *** ramishra has joined #tripleo | 06:39 | |
| *** pradeep has quit IRC | 06:40 | |
| *** pradeep has joined #tripleo | 06:40 | |
| *** pradeep1 has quit IRC | 06:41 | |
| *** pradeep1 has joined #tripleo | 06:42 | |
| *** pradeep has quit IRC | 06:44 | |
| *** dshulyak_ has quit IRC | 06:49 | |
| *** zz_avozza is now known as avozza | 06:52 | |
| *** dshulyak_ has joined #tripleo | 06:55 | |
| *** pblaho has joined #tripleo | 07:09 | |
| *** pradeep has joined #tripleo | 07:11 | |
| *** pradeep1 has quit IRC | 07:13 | |
| *** proffalken has joined #tripleo | 07:16 | |
| *** proffalken has quit IRC | 07:16 | |
| *** proffalk1n has quit IRC | 07:17 | |
| *** pradeep has quit IRC | 07:20 | |
| *** ifarkas has joined #tripleo | 07:20 | |
| *** pradeep has joined #tripleo | 07:21 | |
| *** gfidente has joined #tripleo | 07:23 | |
| *** gfidente^2nd has joined #tripleo | 07:23 | |
| *** otoolee has quit IRC | 07:28 | |
| *** dshulyak_ has quit IRC | 07:29 | |
| GheRivero | morning all | 07:29 |
| *** pradeep has quit IRC | 07:31 | |
| *** pradeep has joined #tripleo | 07:32 | |
| *** fabbione has quit IRC | 07:38 | |
| *** ramishra has quit IRC | 07:41 | |
| *** otoolee has joined #tripleo | 07:42 | |
| openstackgerrit | Steven Dake proposed a change to stackforge/kolla: Properly create endpoints for Nova services https://review.openstack.org/129156 | 07:43 |
| *** gfidente^2nd has quit IRC | 07:46 | |
| *** pradeep1 has joined #tripleo | 07:49 | |
| *** fabbione has joined #tripleo | 07:50 | |
| openstackgerrit | Motohiro/Yuanying Otsuka proposed a change to openstack/os-cloud-config: Split up extracting Ironic driver_info method https://review.openstack.org/129157 | 07:50 |
| *** jang2 has joined #tripleo | 07:50 | |
| *** pradeep has quit IRC | 07:52 | |
| *** pradeep has joined #tripleo | 07:58 | |
| *** pradeep1 has quit IRC | 07:58 | |
| *** pradeep has quit IRC | 08:02 | |
| *** wuhg has joined #tripleo | 08:04 | |
| shadower | lsmola: ping | 08:04 |
| *** akrivoka has joined #tripleo | 08:12 | |
| lsmola | shadower: pong | 08:14 |
| shadower | lsmola: so in your testing of the templates with tuskar, did you find any issues with the deployed openstack? | 08:14 |
| lsmola | shadower: so there is instack-test-overcloud script, that I use for testing | 08:15 |
| lsmola | shadower: slagle added there tests of the storage also | 08:16 |
| lsmola | shadower: and seems it is in quite good shape | 08:16 |
| shadower | \o/ | 08:16 |
| shadower | lsmola: so the problems you were seeing were mostly because of bad parameters being passed to heat? | 08:16 |
| lsmola | shadower: I will finish the CLI with tuskar today hopefully, so we can easily test also that | 08:16 |
| shadower | that'd be cool | 08:17 |
| openstackgerrit | Ghe Rivero proposed a change to openstack/diskimage-builder: Avoid overwritting of hooks https://review.openstack.org/126869 | 08:17 |
| lsmola | shadower: bad parameters, obsolete path for swift | 08:17 |
| *** sdake_ has quit IRC | 08:18 | |
| lsmola | shadower: and the last thing was that you need to increase tiny flavor to 2GB hdd, or the test fails | 08:18 |
| *** ramishra has joined #tripleo | 08:18 | |
| shadower | right | 08:18 |
| *** otoolee has quit IRC | 08:19 | |
| gfidente | lsmola, shadower btw, looking at the blockstorage/swiftstorage tests | 08:19 |
| gfidente | shouldn't we run those regardless of SCALE being 0 ? | 08:19 |
| lsmola | shadower: and for the baremetals, we just needed to set correct NTP server and it worked | 08:19 |
| gfidente | *SCALE being > 0 | 08:19 |
| *** ramishra_ has joined #tripleo | 08:19 | |
| *** ramishra has quit IRC | 08:20 | |
| lsmola | gfidente: hm, I am not sure if it should not fail | 08:20 |
| lsmola | gfidente: does it run storage on the controller node if the scale is 0? | 08:21 |
| gfidente | well we deploy cinder and swift on controllers when = 0 | 08:21 |
| *** fabbione has quit IRC | 08:22 | |
| *** pradeep has joined #tripleo | 08:22 | |
| gfidente | going to submit a PR for that | 08:22 |
| lsmola | gfidente: ok, I haven't tested it | 08:22 |
| lsmola | gfidente: ok, thank you | 08:22 |
| gfidente | indeed, we should! :) | 08:22 |
| *** fabbione has joined #tripleo | 08:23 | |
| *** jp_at_hp has joined #tripleo | 08:23 | |
| *** andrearosa has quit IRC | 08:23 | |
| *** ci-overcloud has joined #tripleo | 08:23 | |
| ci-overcloud | ************** ci-overcloud complete status=1 ************ | 08:23 |
| *** ci-overcloud has quit IRC | 08:23 | |
| *** jcoufal has joined #tripleo | 08:24 | |
| *** jistr has joined #tripleo | 08:24 | |
| *** derekh has joined #tripleo | 08:26 | |
| *** dmellado_ has joined #tripleo | 08:26 | |
| openstackgerrit | Gonéri Le Bouder proposed a change to openstack/tripleo-image-elements: systemd: always use /lib/systemd https://review.openstack.org/129162 | 08:27 |
| openstackgerrit | Gonéri Le Bouder proposed a change to openstack/diskimage-builder: Revert "introduce $SYSTEMD_SYSTEM_UNIT_DIR" https://review.openstack.org/129163 | 08:30 |
| *** lucasagomes has joined #tripleo | 08:31 | |
| openstackgerrit | Dougal Matthews proposed a change to openstack/tuskar: Put a cap on our cyclomatic complexity https://review.openstack.org/129164 | 08:32 |
| *** fabbione has quit IRC | 08:32 | |
| *** otoolee has joined #tripleo | 08:33 | |
| *** wendar_ has joined #tripleo | 08:38 | |
| *** pradeep has quit IRC | 08:38 | |
| openstackgerrit | Ghe Rivero proposed a change to openstack/tripleo-incubator: Encapsulate getting image for a deployment. https://review.openstack.org/85130 | 08:39 |
| *** wendar has quit IRC | 08:40 | |
| *** fabbione has joined #tripleo | 08:41 | |
| *** ramishra_ has quit IRC | 08:42 | |
| *** ramishra_ has joined #tripleo | 08:43 | |
| *** dtantsur|afk is now known as dtantsur | 08:47 | |
| *** jcoufal has quit IRC | 08:53 | |
| *** jcoufal has joined #tripleo | 08:54 | |
| *** untriaged-bot has joined #tripleo | 09:00 | |
| untriaged-bot | Untriaged bugs so far: | 09:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1381408 | 09:00 |
| uvirtbot | Launchpad bug 1381408 in diskimage-builder ""visudo" always got error when building overcloud image" [Undecided,New] | 09:00 |
| *** untriaged-bot has quit IRC | 09:00 | |
| gfidente | anyone would spare a comment on https://review.openstack.org/#/c/125968/ | 09:00 |
| gfidente | between p#5 and p#6 ? later add capability to parse exports file with spaces and in quotes but parsing is not trivial | 09:01 |
| gfidente | I am not sure if majority prefers to have that or stick with posix portable paths, but I'd like the change to merge one way or another | 09:01 |
| openstackgerrit | Yuriy Zveryanskyy proposed a change to openstack/diskimage-builder: Add element for build ramdisk with ironic-python-agent https://review.openstack.org/103105 | 09:05 |
| openstackgerrit | A change was merged to openstack/tripleo-image-elements: sets novnc endpoint uri to https if tls is enabled https://review.openstack.org/128871 | 09:06 |
| *** dmellado_ has quit IRC | 09:08 | |
| *** athomas has joined #tripleo | 09:13 | |
| *** ramishra_ has quit IRC | 09:14 | |
| *** andrearosa has joined #tripleo | 09:15 | |
| *** yamahata has quit IRC | 09:18 | |
| *** ramishra_ has joined #tripleo | 09:18 | |
| *** lazy_prince has quit IRC | 09:19 | |
| *** rlandy has joined #tripleo | 09:25 | |
| *** pradeep has joined #tripleo | 09:33 | |
| *** ramishra_ has quit IRC | 09:39 | |
| *** pelix has joined #tripleo | 09:44 | |
| lxsli | +A for https://review.openstack.org/#/c/113546/ please? | 09:50 |
| *** cody-somerville has joined #tripleo | 09:50 | |
| *** athomas has quit IRC | 09:58 | |
| *** cody-somerville has quit IRC | 10:02 | |
| openstackgerrit | Alexis Lee proposed a change to openstack/os-apply-config: Extract OacFile class to separate file https://review.openstack.org/129196 | 10:04 |
| *** killer_prince has joined #tripleo | 10:06 | |
| *** killer_prince is now known as lazy_prince | 10:07 | |
| *** athomas has joined #tripleo | 10:09 | |
| *** yuanying_ has quit IRC | 10:18 | |
| *** jcoufal has quit IRC | 10:18 | |
| *** yuanying has joined #tripleo | 10:19 | |
| *** yuanying has quit IRC | 10:19 | |
| *** yuanying has joined #tripleo | 10:20 | |
| *** pradeep has quit IRC | 10:22 | |
| *** yuanying has quit IRC | 10:24 | |
| *** pradeep has joined #tripleo | 10:32 | |
| *** pensu has quit IRC | 10:45 | |
| *** avozza is now known as zz_avozza | 10:49 | |
| *** dmellado_ has joined #tripleo | 10:50 | |
| derekh | greghaynes: you there ? say nothing if your not | 10:51 |
| derekh | greghaynes: going to push an update to the ci/pip stuff | 10:51 |
| *** jcoufal has joined #tripleo | 10:57 | |
| *** jcoufal has quit IRC | 10:57 | |
| *** jcoufal has joined #tripleo | 10:57 | |
| derekh | ls | 11:00 |
| *** yuanying has joined #tripleo | 11:08 | |
| *** jerryz has quit IRC | 11:12 | |
| *** pradeep1 has joined #tripleo | 11:14 | |
| *** pradeep has quit IRC | 11:15 | |
| *** derekh has quit IRC | 11:52 | |
| *** ifarkas has quit IRC | 11:52 | |
| *** derekh has joined #tripleo | 11:56 | |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Build a local pip mirror of python packages being tested https://review.openstack.org/71837 | 12:06 |
| *** dprince has joined #tripleo | 12:11 | |
| *** mrunge has quit IRC | 12:11 | |
| *** weshay has joined #tripleo | 12:13 | |
| *** rhallisey has joined #tripleo | 12:17 | |
| gfidente | lxsli, does https://review.openstack.org/#/c/112075/ look okay btw or can you spot any problem there? | 12:20 |
| *** pensu has joined #tripleo | 12:20 | |
| *** pensu has quit IRC | 12:25 | |
| *** jdob has joined #tripleo | 12:31 | |
| lxsli | gfidente: looking | 12:38 |
| *** andreaf has quit IRC | 12:38 | |
| *** andreaf has joined #tripleo | 12:38 | |
| lxsli | p sure you'll need an ExtraConfig at least :) | 12:41 |
| *** nosnos has quit IRC | 12:41 | |
| *** nosnos has joined #tripleo | 12:42 | |
| *** pensu has joined #tripleo | 12:43 | |
| *** nosnos has quit IRC | 12:46 | |
| *** zz_avozza is now known as avozza | 12:54 | |
| *** k4n0 has quit IRC | 12:55 | |
| *** tzumainn has joined #tripleo | 12:55 | |
| greghaynes | derekh: Ah, that variable isnt documented | 12:58 |
| greghaynes | in http://ci.openstack.org/zuul/launchers.html#zuul-parameters | 12:58 |
| greghaynes | but if it works then fine with me :) | 12:58 |
| openstackgerrit | Alexis Lee proposed a change to openstack/tripleo-heat-templates: Add block completion signal https://review.openstack.org/127953 | 12:58 |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-heat-templates: Add ExtraConfig param to storage templates https://review.openstack.org/129234 | 12:59 |
| openstackgerrit | Alexis Lee proposed a change to openstack/tripleo-heat-templates: Add block completion signal https://review.openstack.org/127953 | 12:59 |
| *** ramishra has joined #tripleo | 12:59 | |
| lxsli | gfidente: https://review.openstack.org/#/c/127953 please :) | 13:00 |
| gfidente | lxsli, yeah I can't +3 | 13:00 |
| gfidente | I would though | 13:00 |
| lxsli | <3 | 13:01 |
| gfidente | greghaynes, when I asked the other guys why this change was needed in nova/controller | 13:08 |
| gfidente | they told me it was obvious | 13:08 |
| gfidente | it'd be nice if I could pick that up again | 13:08 |
| greghaynes | hah | 13:09 |
| gfidente | but I am with you | 13:09 |
| greghaynes | well, we do still need a blurb, maybe that one was in error | 13:09 |
| gfidente | it is not obiouus | 13:09 |
| gfidente | greghaynes, https://review.openstack.org/#/c/108415/ see my comment on p#24 | 13:10 |
| derekh | greghaynes: that latest patch is testing a ZUUL_CHANGES=openstack/python-keystoneclient:master:refs/changes/99/99999/9 | 13:11 |
| *** morazi has joined #tripleo | 13:11 | |
| derekh | greghaynes: I'll double check the results to make sure everything happened as needed | 13:11 |
| gfidente | so purpose of change is passing specific values for a config key to some roles | 13:11 |
| greghaynes | gfidente: Yea, I would have agreed with you but I always like more explanation ;) | 13:12 |
| greghaynes | derekh: Oh? I was trying to figure out a sane way to test that code | 13:12 |
| *** akrivoka has quit IRC | 13:13 | |
| openstackgerrit | Ryan Hallisey proposed a change to stackforge/kolla: Docker image and process cleaup tool https://review.openstack.org/129238 | 13:13 |
| gfidente | greghaynes, I'll a sentence in commit message indeed, so I can take care of lxsli comment too | 13:13 |
| gfidente | thanks :( | 13:13 |
| gfidente | oh sorry that was a :) | 13:13 |
| derekh | greghaynes: I've just put ZUUL_CHANGES=openstack/python-keystoneclient:master:refs/changes/99/99999/9 in the patch, which of course mean another revision is needed to take it out again, but its the only way I could think of testing it | 13:14 |
| greghaynes | yep, good idea | 13:14 |
| *** pensu has quit IRC | 13:17 | |
| openstackgerrit | greghaynes proposed a change to openstack/tripleo-heat-templates: Add SSL PKI properties for keystone https://review.openstack.org/129052 | 13:17 |
| *** openstackgerrit has quit IRC | 13:19 | |
| *** openstackgerrit has joined #tripleo | 13:19 | |
| sdake | morning | 13:23 |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tripleo-heat-templates: Passthrough{Specific} and allNodesConfig for BlockStorage nodes https://review.openstack.org/112075 | 13:23 |
| rhallisey | sdake, morning | 13:23 |
| sdake | reviews in the queue ;) | 13:25 |
| sdake | almost get all of nova working | 13:25 |
| sdake | one last little bug to sort out | 13:25 |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tripleo-heat-templates: Passthrough{Specific} and allNodesConfig for BlockStorage nodes https://review.openstack.org/112075 | 13:25 |
| rhallisey | excellent :) | 13:25 |
| sdake | maybe you can help | 13:26 |
| sdake | I was fairly stumped last night | 13:26 |
| sdake | but it was bedtime so that had somethign to do with it | 13:26 |
| rhallisey | what are you running into? | 13:26 |
| sdake | something about an endpoint not found | 13:26 |
| sdake | yet the endpoints are set properly in the db | 13:26 |
| sdake | I had a dream maybe it was not a nova endpoint but something else | 13:27 |
| sdake | so I'll investigaet that today | 13:27 |
| rhallisey | ha | 13:27 |
| rhallisey | sdake, so I have keystone mariadb and nova-api running | 13:28 |
| sdake | you need glance as well | 13:28 |
| sdake | nova contacts othe rendpoints tho maybe it requires a cinder endpoint registration | 13:28 |
| derekh | greghaynes: https://review.openstack.org/#/c/129243/ | 13:30 |
| sdake | and you need all the changes in the review queue as well | 13:31 |
| *** ramishra has quit IRC | 13:32 | |
| sdake | market on fire today | 13:33 |
| sdake | \o/ | 13:33 |
| sdake | ge up 3.5 % | 13:33 |
| sdake | crazy bump for ge | 13:33 |
| *** marun has quit IRC | 13:34 | |
| openstackgerrit | Tzu-Mainn Chen proposed a change to openstack/tuskar-ui: Add nodes.sh script to generate node csv https://review.openstack.org/129249 | 13:38 |
| derekh | slagle: jp_at_hp do ye know if anybody has ever looked at getting CI on the icehouse branch working ? https://review.openstack.org/#/q/status:open+project:^openstack/tripleo.*+branch:stable/icehouse,n,z | 13:40 |
| derekh | if not should we? | 13:40 |
| *** noslzzp has joined #tripleo | 13:41 | |
| * derekh can take a look if we care | 13:41 | |
| *** ramishra has joined #tripleo | 13:42 | |
| sdake | rhallisey larsks here is what I get from nova-api: | 13:43 |
| sdake | http://paste.fedoraproject.org/142832/13553395 | 13:43 |
| sdake | this tells me nova-api is configured improperly | 13:43 |
| larsks | sdake: Let me take a look. | 13:44 |
| sdake | this on a nova list op | 13:44 |
| jp_at_hp | derekh: I made a very few attempts to get a build to run on icehouse and failed miserably. I haven't had any time to dig in either... | 13:44 |
| larsks | sdake: Hold on, that's from nova list? | 13:45 |
| sdake | (in nova-api) | 13:46 |
| sdake | nova list prints out auth failed | 13:46 |
| slagle | derekh: the last time i looked, it wasn't using the stable/icehouse branches of the tripleo projects | 13:46 |
| larsks | Okay. | 13:46 |
| slagle | derekh: that's what was causing all the problems | 13:46 |
| sdake | but to reproduce you need the review queue changes, because ot herwise the endpoints are busted | 13:46 |
| derekh | slagle: yup, I have an idea to make it work if we still care I can give it a go | 13:46 |
| slagle | derekh: the devstack-gate job was checking them out though, not sure why the right thing wasn't used | 13:47 |
| *** cody-somerville has joined #tripleo | 13:47 | |
| slagle | derekh: if it's easy to try, sure. but i wouldn't spend a bunch of time on it | 13:47 |
| slagle | derekh: i didn't even end up create stable branches for juno | 13:47 |
| larsks | sdake: pulling images, please hold :) | 13:48 |
| slagle | derekh: given the new backwards compat approved spec, i'd like to see us setup jobs that use tripleo master to deploy stable/juno of evertying else | 13:48 |
| derekh | slagle: ok, I'll do that instead, unless anybody else is gonna | 13:48 |
| sdake | larsks oh, and glance doens't seem to actualy store cloud images for me | 13:48 |
| larsks | Huh, works for me. At least, it writes files into /var/lib/glance/images, and they show up in glance list. | 13:49 |
| derekh | so any thoughts on those icehouse patches stuck. should we just approve them or abandon//// | 13:49 |
| slagle | derekh: i wasn't planning on it in the short term. i added a note about this discuss at the summit. but, it seemd no one had a problem with it when we were talking about what jobs to add at the midcycle | 13:49 |
| slagle | so if you wanted to take a go at it, i wouldn't complain :) | 13:50 |
| sdake | http://paste.fedoraproject.org/142836/55380314 | 13:50 |
| sdake | using glanceclient, no love | 13:50 |
| sdake | you just wrot ethem directl yto /var/lib/glance/images? | 13:50 |
| larsks | sdake: No, glance does that. | 13:50 |
| sdake | right | 13:51 |
| sdake | I was like "huh" :) | 13:51 |
| larsks | sdake: Run "glance image-show 17456857-fa48-4bfe-b859-0df89fa71758" | 13:51 |
| larsks | and tell me what you see. | 13:51 |
| sdake | see log above, that is command I'm using | 13:51 |
| larsks | Also, is it actually creating a file in /var/lib/glance/images? Or not? | 13:51 |
| sdake | larsks http://paste.fedoraproject.org/142837/35539051 | 13:52 |
| larsks | If yes, try adding --is-public=True to your image-create command and see if it shows up in "image-list" | 13:52 |
| jp_at_hp | derekh: does it make sense to abandon existing patches and see what the plan of running master against icehouse service branches yields? | 13:52 |
| sdake | right just a sedf | 13:52 |
| sdake | forgot about t hat option | 13:52 |
| larsks | So it *looks* like it is actually working. | 13:52 |
| larsks | My experience with recent versions of glance is that without --is-public=True images do not show up in the list. | 13:52 |
| larsks | At least, not my default. | 13:52 |
| larsks | I haven't investigated that much yet, because on my own system I don't care if everything is public or not. | 13:52 |
| sdake | larsks yup that fixed it (is-public=true) | 13:53 |
| sdake | thanks | 13:53 |
| slagle | jp_at_hp: i'm not opposed to abandoning those patches. it would certainly be interersting to see if tripleo master could still deploy icehouse | 13:53 |
| sdake | ok there is one problem solved | 13:53 |
| sdake | see that only took you 3 minutes :) | 13:53 |
| sdake | I struggled for hours last night on that annoyance | 13:53 |
| derekh | jp_at_hp: slagle ok, how about we abandon them and I'll aim to get a job running to run tripleo-* master with juno of openstack releases (and I'll try icehouse as an experiment) | 13:54 |
| slagle | derekh: wfm. will abandon today | 13:55 |
| openstackgerrit | Nicholas Randon proposed a change to openstack/tripleo-heat-templates: Simplify the layout of haproxy net binds config https://review.openstack.org/129258 | 13:56 |
| SpamapS | wtf | 14:05 |
| SpamapS | my seed built w/o rabbitmq? | 14:05 |
| greghaynes | SpamapS: It needs to be defined in SEED_DIB_EXTRA_ARGS IIRC | 14:06 |
| SpamapS | greghaynes: ... why? | 14:06 |
| greghaynes | also, do you really *need* rmq? :p | 14:06 |
| greghaynes | uhhh | 14:06 |
| greghaynes | there was a reason, I forget | 14:07 |
| SpamapS | nova-api has to talk to nova-conductor _SOMEHOW :) | 14:07 |
| SpamapS | Ok so yeah I used that variable to add pypi to use my mirror | 14:07 |
| SpamapS | how silly of me | 14:07 |
| SpamapS | greghaynes: probably to allow building w/ qpid ;) | 14:07 |
| SpamapS | tripleo-incubator/scripts/boot-seed-vm:SEED_DIB_EXTRA_ARGS=${SEED_DIB_EXTRA_ARGS:-'rabbitmq-server'} | 14:08 |
| SpamapS | Failed ot spot that. Doh | 14:08 |
| greghaynes | things like this make me wish we used something like envdir | 14:09 |
| SpamapS | greghaynes: doooo it | 14:09 |
| greghaynes | heh | 14:09 |
| greghaynes | Its not a real project until you pull in some djb tools | 14:09 |
| greghaynes | then everyone runs away screaming | 14:09 |
| *** rlandy has quit IRC | 14:11 | |
| *** bnemec is now known as beekneemech | 14:12 | |
| *** ramishra has quit IRC | 14:12 | |
| openstackgerrit | A change was merged to stackforge/kolla: Remove nova-base since there is only 1 image for nova-compute https://review.openstack.org/129136 | 14:12 |
| lxsli | needs a mailreader | 14:12 |
| openstackgerrit | A change was merged to stackforge/kolla: Make nova-compute work properly with libvirt https://review.openstack.org/129137 | 14:13 |
| *** radez_g0n3 is now known as radez | 14:13 | |
| *** wuhg has quit IRC | 14:13 | |
| openstackgerrit | A change was merged to stackforge/kolla: Properly create endpoints for Nova services https://review.openstack.org/129156 | 14:13 |
| sdake | onlyh two more components to debug plus jpeeler's work :) | 14:15 |
| sdake | \o/ we are close folks :) | 14:15 |
| sdake | jpeeler I recommend looking a tthe design pattern in glance or nova-controller for heat-api & heat-engine | 14:15 |
| jpeeler | yeah i've redone it quite a bit | 14:16 |
| sdake | specifically the use of the base image | 14:16 |
| openstackgerrit | Lars Kellogg-Stedman proposed a change to stackforge/kolla: fix nova auth configuration https://review.openstack.org/129273 | 14:17 |
| sdake | larsks does that fix api auth? | 14:18 |
| larsks | sdake: Probably. Building images right now. | 14:19 |
| sdake | are you building to kollaglue? | 14:20 |
| jpeeler | i was wondering about that | 14:20 |
| sdake | if not, might as well | 14:20 |
| jpeeler | i copied devstack's config, which uses 35357 instead of 5000 | 14:21 |
| larsks | jpeeler: I am pretty sure that auth does not require access to the admin api. | 14:21 |
| sdake | it does not | 14:21 |
| larsks | jpeeler: But I will let you know in a few minutes if it worked or not. | 14:21 |
| jpeeler | ok i'll just wait then | 14:21 |
| sdake | larsks are you building nad pushing to kollaglue? | 14:22 |
| larsks | sdake: I am not. For the most part, I think it's best if pushes to kollaglue are only done by one person, and I am fine if that person is you. | 14:22 |
| sdake | wfm | 14:22 |
| sdake | I'll go ahead and pull down that change and build it | 14:22 |
| larsks | It would be nice if the images in the kollaglue namespace are only ever build from stackforge master (e.g., wait for the change to merge before pushing into kollaglue/ namespace) | 14:23 |
| sdake | agree - I think after our rush on m1, we can set some more sane parameters (to be discussed at monday meeting) - i'll add to agenda | 14:23 |
| sdake | set 10-15 minutes to discuss policy on pushing/etc | 14:24 |
| sdake | dentist gave me norco 10/3256 | 14:24 |
| sdake | \o/ | 14:24 |
| sdake | normally he is really tight with medications I'm not sure what came over him | 14:25 |
| larsks | If we can have someone install webhooks on the stackforge repositories, we can set up our own automatic build environment while we wait for openstack-infra. | 14:25 |
| larsks | And then stop doing manual pushes to kollaglue/. | 14:25 |
| sdake | larsks infra doesn't rely on github, it relies on its own repos and then pushes to github later | 14:26 |
| sdake | they would like to remove github entirely, but I think the likelyhood of that being accepted by the community is low :) | 14:26 |
| larsks | sdake: That doesn't really impact what I just said at all :). As long as the pushes get to github in a reasonable amount of time, *we* could rely on it pending the necessary support in infra. | 14:26 |
| larsks | Or we can have something set up that just polls perodically if we can't get automated notification. | 14:27 |
| sdake | oh, I thought you meant some automatic github plugin or something | 14:27 |
| sdake | ya poll is easier I think | 14:27 |
| clarkb | we wont set up webhooks in github. you can however use a gerrit account to run tests based on gerrit events | 14:27 |
| *** jdob1 has joined #tripleo | 14:27 | |
| clarkb | this is a well known and tested process with tooling to go along with it | 14:27 |
| larsks | clarkb: docs pointer, please? | 14:28 |
| clarkb | also what are you waiting on us for? | 14:28 |
| clarkb | http://ci.openstack.org/running-your-own.html | 14:28 |
| larsks | clarkb: mordred had said something about setting up infrastructure for supporting automated docker builds. If we can do this ourselves that is awesome. | 14:28 |
| clarkb | We give you root on test slaves. not sure what else is missing | 14:29 |
| clarkb | we have trusty and f20 nodes. both should be able to docker | 14:29 |
| larsks | clarkb: that sounds sufficient. How do we go about getting that set up? | 14:29 |
| clarkb | submit changes to openstack-infra/project-config to add jobs under jenkins/ and tell zuul to run them in zuul/layout.yaml | 14:30 |
| *** otoolee has quit IRC | 14:30 | |
| clarkb | jayf and jroll may have ideas too since they are dockering in a job of theirs | 14:31 |
| *** jehb has joined #tripleo | 14:31 | |
| *** rwsu has joined #tripleo | 14:31 | |
| larsks | clarkb: if I am looking to run something explicitly *after* a review has been approved/merged...can I still do that using that mechanism? | 14:31 |
| sdake | clarkb we aren't waiting on you, we are waiting on us :) | 14:31 |
| *** spzala has joined #tripleo | 14:31 | |
| clarkb | larsks yes that is what jayf and jroll do | 14:31 |
| sdake | larsks I intend to tackle it in milestone #2 | 14:32 |
| *** morganfainberg has quit IRC | 14:32 | |
| larsks | clarkb: Okay, thanks, I will ping them. | 14:32 |
| sdake | or if you want, you can as well | 14:32 |
| clarkb | sdake if you arent waiting on anything dont bother with third party ci | 14:32 |
| larsks | Yeah, I don't think that's what we want. | 14:32 |
| sdake | I dont think we were intending to use third party ci ? | 14:32 |
| sdake | we want to use infra ci | 14:32 |
| sdake | we just haven't got the gates I want implemented yet because of time constraints | 14:32 |
| clarkb | sdake github hooks is basically third party ci | 14:33 |
| sdake | yes, I think larsks wants github hooks, I dont want that | 14:33 |
| larsks | sdake: that is not what I said. | 14:33 |
| sdake | ok | 14:33 |
| sdake | so no reason to argue :) | 14:33 |
| larsks | sdake: if we can do this in -infra, then we are all set. | 14:33 |
| sdake | it doesn't matter, we are all in agreement about what needs to be done | 14:33 |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-heat-templates: Adding SNMP related parameters to storage templates https://review.openstack.org/126562 | 14:33 |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-heat-templates: Add converted version of block and object storage https://review.openstack.org/123713 | 14:33 |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-heat-templates: Compute and controller templates without merge.py https://review.openstack.org/123100 | 14:33 |
| *** morganfainberg has joined #tripleo | 14:33 | |
| sdake | anyone been watching agents of shield | 14:34 |
| sdake | that show rocks | 14:34 |
| sdake | larsks I think before we automatically push the images we want a gate to make sure what we push is not busted | 14:35 |
| sdake | jpeeler and I have been talking about this for milestone 2 or perhaps milestone 3 | 14:35 |
| sdake | we need it soon | 14:35 |
| larsks | I think we need to stop manual build/push as soon as possible. I think we also need the CI on those images, but I would not make that a blocker. | 14:36 |
| sdake | its a littile more complicated though, because there is a race between upstream's rdo packaging changes | 14:36 |
| sdake | I agree we need ci asap | 14:36 |
| sdake | this manual testing is terrible | 14:36 |
| sdake | it took us 4 months to get ci going in heat btw | 14:36 |
| sdake | and I was actively trying to get it implemented across the project from month 2 | 14:37 |
| sdake | ci is just hard to bootstrap, not sure why | 14:37 |
| larsks | sdake: speaking of manual testing, with my rebuilt images I can successfully "nova list". | 14:37 |
| sdake | hot | 14:37 |
| larsks | So that seems to work now. | 14:37 |
| sdake | time to boot a vm :) | 14:37 |
| larsks | The /check.sh script I've been dropping into these images is really useful for testing. | 14:37 |
| sdake | how do you use it to test btw? | 14:38 |
| sdake | some nsenter magic? | 14:38 |
| sdake | might consider a tools/* tool to help run it | 14:38 |
| larsks | I run "docker-enter <container-id> /check.sh", where docker-enter is a wrapper around nsenter (https://github.com/larsks/docker-tools/blob/master/docker-enter) | 14:38 |
| sdake | cool | 14:38 |
| sdake | I'll try that out once I rebuild | 14:39 |
| larsks | No output == it worked. | 14:39 |
| larsks | You get errors otherwise. | 14:39 |
| sdake | larsks in heat, jpeeler actually implemented our first test cases :) | 14:40 |
| sdake | prior to that, we did all manual testing for ~4mo | 14:40 |
| sdake | I prefer not to repeat that | 14:40 |
| sdake | although manual testing for this is much easier | 14:40 |
| sdake | either it works or it does not work | 14:40 |
| sdake | with heat, we had test plans etc before we finally got the 2.5k test cases implmeented | 14:41 |
| larsks | Well, we have three test cases now (for keystone, nova, and glance), so guess we're ahead of the game. | 14:41 |
| larsks | We just need some sort of harness to run things :) | 14:42 |
| sdake | yup that is going to be a real challenge I think | 14:42 |
| sdake | I have tried to think a way to do it, but its just going tohav e to be a hack | 14:42 |
| sdake | it will be as difficult as writing all of the code we have written thus far | 14:42 |
| sdake | (which admittidely is not that complex) | 14:43 |
| sdake | jpeeler can you ack larsks change - it seems to work for him | 14:43 |
| openstackgerrit | A change was merged to stackforge/kolla: fix nova auth configuration https://review.openstack.org/129273 | 14:43 |
| *** pensu has joined #tripleo | 14:43 | |
| sdake | thanks! | 14:44 |
| * jpeeler copies that change | 14:44 | |
| greghaynes | well, thats annoying http://logs.openstack.org/49/129049/1/check-tripleo/check-tripleo-ironic-overcloud-precise-ha/28efb04/console.html#_2014-10-16_22_35_39_469 | 14:44 |
| greghaynes | we dont really have a lot of info for debugging when the demo vm fails | 14:44 |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-heat-templates: Add ExtraConfig param to storage templates https://review.openstack.org/129234 | 14:45 |
| larsks | jpeeler: you're working on heat, right? | 14:45 |
| jpeeler | larsks: yes | 14:45 |
| larsks | Do you know if heat actually requires both auth_uri *and* auth_{host,port,protocol}? | 14:45 |
| larsks | Or will it work with just auth_uri? | 14:45 |
| larsks | I am curious if it behaves the same as Nova. | 14:45 |
| jpeeler | no i don't, devstack has all of them though | 14:46 |
| larsks | I guess I can just test it locally. | 14:46 |
| * larsks goes to edit heat.conf | 14:46 | |
| jpeeler | let me know what happens | 14:46 |
| greghaynes | larsks: you mean identity_uri? | 14:46 |
| larsks | greghaynes: I dunno. The documentation is littered with auth_uri, but I have seen the other as well. | 14:47 |
| greghaynes | because AIUI identity_uri superceded auth_{host,port,protocol} | 14:47 |
| larsks | greghaynes: Spiffy. | 14:47 |
| larsks | Any idea about the purpose of auth_uri vs identity_uri? | 14:47 |
| openstackgerrit | Ben Nemec proposed a change to openstack/tripleo-image-elements: Remove vif_plugging workaround https://review.openstack.org/128778 | 14:49 |
| *** jdob1 has quit IRC | 14:49 | |
| greghaynes | larsks: no idea about auth_uri, I think thats going to be app specific | 14:49 |
| greghaynes | identity_uri is a keystone config thing | 14:49 |
| larsks | jpeeler: well, heat appears to need the various auth_* components. But, using the public api (port 5000) works fine. | 14:49 |
| *** otoolee has joined #tripleo | 14:50 | |
| greghaynes | so the auth_{host,port,protocol} is deprected, not a huge deal but if youre making new config I would just use identity_uri in place of them | 14:51 |
| *** akrivoka has joined #tripleo | 14:52 | |
| *** jp_at_hp has quit IRC | 14:56 | |
| *** pcrews has joined #tripleo | 14:57 | |
| openstackgerrit | Jeff Peeler proposed a change to stackforge/kolla: (Still WIP at the moment, but much closer) https://review.openstack.org/128994 | 14:57 |
| larsks | greghaynes: thanks. | 14:58 |
| openstackgerrit | greghaynes proposed a change to openstack/tripleo-image-elements: Use keystone identity_uri instead of auth_* https://review.openstack.org/127588 | 14:58 |
| *** untriaged-bot has joined #tripleo | 15:00 | |
| untriaged-bot | Untriaged bugs so far: | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1382468 | 15:00 |
| uvirtbot | Launchpad bug 1382468 in tuskar "Bad parameter exception" [Undecided,New] | 15:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1381408 | 15:00 |
| *** untriaged-bot has quit IRC | 15:00 | |
| uvirtbot | Launchpad bug 1381408 in diskimage-builder ""visudo" always got error when building overcloud image" [Undecided,New] | 15:00 |
| *** pbelanyi has quit IRC | 15:08 | |
| *** dtantsur has quit IRC | 15:08 | |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tripleo-heat-templates: Passthrough{Specific} and allNodesConfig for BlockStorage nodes https://review.openstack.org/112075 | 15:16 |
| gfidente | lxsli, I just fixed the dependencied there, thanks for noticing :( | 15:17 |
| *** yamahata has joined #tripleo | 15:18 | |
| *** akrivoka has quit IRC | 15:26 | |
| *** pradk has joined #tripleo | 15:28 | |
| *** otoolee has quit IRC | 15:29 | |
| jpeeler | sdake: do you know what i should look for if docker logs doesn't return anything? i should at least be getting an error | 15:29 |
| larsks | jpeeler: try running it by hand with "docker run" and provide all the necessary environment variables manually? | 15:30 |
| larsks | jpeeler: Can I pull the images and try them locally? | 15:30 |
| sdake | chmod +x start.sh | 15:30 |
| larsks | Or what sdake said :) | 15:31 |
| sdake | or any other scripts you have | 15:31 |
| jpeeler | argh, but yes larsks they are pushed | 15:31 |
| sdake | another option when you run into that, is you can run it locally eg docker run kollaglue/fedora-rdo-heat-api | 15:31 |
| sdake | itwill show you precisely what is failing | 15:31 |
| sdake | I recommend trying that right now just for a learning experience | 15:31 |
| sdake | you will llikely see "start.sh permission denied" | 15:32 |
| mordred | sdake, larsks: I have the plan in my head of what we need to do to get the docker building/publishing done, I just haven't done it | 15:32 |
| mordred | sdake, larsks: so what I will try to do instead is write it down so that if you want to do it instead of waiting for me, you can | 15:32 |
| sdake | wiki page would rock mordred | 15:33 |
| larsks | mordred: cool. Let me know if you need a hand with anything. I am wanting to tackle that Real Soon Now :) | 15:33 |
| sdake | would be happy to coalesce around one solution | 15:33 |
| mordred | the main issue that needs to be solved is that we need to split being able to run docker build on one machine and docker push on a different one | 15:33 |
| larsks | mordred: why that? | 15:33 |
| mordred | security | 15:33 |
| larsks | build machine does not have outbound access? | 15:33 |
| clarkb | mordred: but we have already solved that for all of the other artifacts we publish | 15:33 |
| clarkb | larsks: it won't have credentials | 15:34 |
| mordred | clarkb: right. we have to solve it for docker | 15:34 |
| larsks | clarkb: got it. | 15:34 |
| mordred | clarkb: the pattern is likely the same | 15:34 |
| jpeeler | sdake: yep, thanks | 15:34 |
| larsks | So...push to private repo on another machine, and from there to docker hub? | 15:34 |
| mordred | larsks: the pattern we do elsewhere | 15:34 |
| mordred | is that we publish the artifact to tarballs.o.o - and then have a job on a trusted machien that knows how to pull it from tarballs.o.o and push it to the appropriate publication place | 15:35 |
| mordred | this is slightly more complex with docker | 15:35 |
| mordred | because the artifact is most efficient in docker | 15:35 |
| mordred | (we could export/import, but that seems very lame) | 15:35 |
| *** sirushti has left #tripleo | 15:36 | |
| larsks | ...because export/import would collapse all the image layers, right? | 15:36 |
| mordred | right | 15:36 |
| mordred | so it might be that we want to run a dockerhub that we trust about as much as tarballs.o.o so that pushing to it from a host is not a thing we're worried about | 15:36 |
| mordred | and then have a job that pulls from that and pushes to the public dockerhub | 15:36 |
| larsks | That sounds reasonable to me. | 15:36 |
| mordred | in any case - I'll write up a thing with more words | 15:37 |
| derekh | greghaynes: looks like I choose the wrong project to test with because keystoneclient is installed from the git repo already, going to redo it with os-apply-config | 15:37 |
| mordred | I don't think it's likely to be _hard_ ... just a little bit of work that needs to be done | 15:37 |
| *** otoolee has joined #tripleo | 15:37 | |
| openstackgerrit | Derek Higgins proposed a change to openstack-infra/tripleo-ci: Build a local pip mirror of python packages being tested https://review.openstack.org/71837 | 15:37 |
| clarkb | mordred: oh I hadn't considered the layering aspect (I was thinking just push image up, grab then publish. the ironic agent image job does it this way) | 15:38 |
| greghaynes | derekh: haha, so that means it worked, right? ;) | 15:42 |
| openstackgerrit | Alexis Lee proposed a change to openstack/os-apply-config: Extract OacFile class to separate file https://review.openstack.org/129196 | 15:43 |
| derekh | greghaynes: well it didn't not work ;-) | 15:43 |
| openstackgerrit | Alexis Lee proposed a change to openstack/os-apply-config: Set owner+group from control file https://review.openstack.org/129303 | 15:43 |
| *** funzo has quit IRC | 15:43 | |
| *** funzo has joined #tripleo | 15:44 | |
| openstackgerrit | Ramakrishnan G proposed a change to openstack/diskimage-builder: iso element to build bootable ISO images https://review.openstack.org/123642 | 15:46 |
| openstackgerrit | James Slagle proposed a change to openstack/diskimage-builder: svc-map requires PyYAML https://review.openstack.org/129305 | 15:46 |
| sdake | larsks nova list working for me | 15:47 |
| sdake | \o/ :) | 15:47 |
| sdake | now for the million dollar operation | 15:47 |
| openstackgerrit | Alexis Lee proposed a change to openstack/os-apply-config: Set owner+group from control file https://review.openstack.org/129303 | 15:47 |
| SpamapS | mordred: why don't you write up the dib-docker change as a spec? | 15:52 |
| openstackgerrit | Nicholas Randon proposed a change to openstack/tripleo-heat-templates: Simplify the layout of haproxy net binds config https://review.openstack.org/129258 | 15:54 |
| *** bth- has joined #tripleo | 15:56 | |
| jlabocki1 | bth - daneyon has been working on neutron docker/kubernetes configurations as well. You two should talk. | 15:56 |
| mordred | SpamapS: that would bea great idea | 15:57 |
| bth- | jlabocki1, sounds good | 15:57 |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Add package install support for tuskar https://review.openstack.org/129310 | 16:01 |
| openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Add package install support for tuskar-ui https://review.openstack.org/129311 | 16:01 |
| openstackgerrit | Nicholas Randon proposed a change to openstack/tripleo-heat-templates: Simplify the layout of haproxy net binds config https://review.openstack.org/129258 | 16:02 |
| *** derekh has quit IRC | 16:09 | |
| *** marun has joined #tripleo | 16:16 | |
| *** eghobo has joined #tripleo | 16:16 | |
| *** dmellado_ has quit IRC | 16:18 | |
| *** sdake_ has joined #tripleo | 16:19 | |
| jpeeler | my image is based on fedora-rdo-base, so how am i getting /opt/kolla/kolla-common.sh: No such file or directory? | 16:24 |
| *** pblaho has quit IRC | 16:29 | |
| *** eghobo has quit IRC | 16:29 | |
| rhallisey | jpeeler, you need add kolla-common to the image | 16:33 |
| jpeeler | it should be in kollaglue/fedora-rdo-base, right? | 16:34 |
| rhallisey | jpeeler, take a look at nova-ctr-base/Dockerfile | 16:34 |
| rhallisey | ADD config-nova-controller.sh | 16:34 |
| jpeeler | sdake: kolla-common.sh is not +x either | 16:35 |
| jpeeler | rhallisey: notice how config-nova-controller.sh sources kolla-common.sh | 16:36 |
| larsks | jpeeler: kolla-common is not supposed to be +x. | 16:36 |
| larsks | It is sourced, not executed. | 16:37 |
| jpeeler | ok, so how's what i'm experiencing possible? | 16:37 |
| larsks | I don't know what you're experiencing...just sat down after grabbing lunch :) | 16:37 |
| larsks | jpeeler: I wonder if you are pulling an outdaded fedora-rdo-base? | 16:38 |
| larsks | I don't know how recently the kollaglue/ one was rebuilt. | 16:38 |
| jpeeler | i'm assuming everything in the kollaglue namespace is current, should i just rebuild it? | 16:38 |
| larsks | Probably. Because we don't have an automated build process, there's no guarantee that what's in kollaglue is current. | 16:39 |
| jpeeler | here it goes | 16:39 |
| jpeeler | (the building) | 16:40 |
| *** lucasagomes is now known as lucas-dinner | 16:42 | |
| *** pelix has quit IRC | 16:43 | |
| sdake_ | larsks any idea on http://paste.fedoraproject.org/142921/64212141 | 16:44 |
| sdake_ | jpeeler rebuild your fedora-rdo-base | 16:44 |
| sdake_ | i had the same problem | 16:44 |
| sdake_ | or do docker pull kollaglue/fedora-rdo-base | 16:44 |
| larsks | sdake_ What exactly do you want me to look at there? It's failing to connect to neutron. Do you have neutron running? | 16:45 |
| sdake_ | shoudl actuallly get it done | 16:45 |
| sdake_ | larsks well i'm curious if you have a suggestion as to what we should be doing to get the network rolling | 16:45 |
| larsks | sdake_: k8s does a pull before launching...suggesting that maybe we need to push a new fedora-rdo-base to docker hub. | 16:45 |
| sdake_ | this is caused by a nova boot | 16:45 |
| larsks | sdake_: you need somehting providing a network api, either neutron or nova network. | 16:45 |
| sdake_ | larsks if jpeeler is building his images - it will use his fedora-rdo-base cache | 16:45 |
| larsks | Right now the configuration file requires neutron. | 16:45 |
| larsks | sdake_: True dat. | 16:45 |
| sdake_ | any idea how to configure nova network | 16:46 |
| sdake_ | since neutron isn't ready | 16:46 |
| larsks | Haven't touched nova-network for a couple years now; I just use neutron. | 16:46 |
| larsks | So I would have to read the docs. | 16:46 |
| sdake_ | well my network fu isn't great | 16:46 |
| sdake_ | if you could tackle that, I'd appreciate it :) | 16:46 |
| larsks | I will take a look. | 16:46 |
| sdake_ | thanks | 16:46 |
| sdake_ | I htink we a re close | 16:46 |
| sdake_ | larsks do you think nova networking would work for this scneario? | 16:48 |
| sdake_ | radez any help you can provide here would be appreciated as well | 16:49 |
| larsks | I'm not entirely sure. I think the networking aspect is going to be one of the trickiest. | 16:49 |
| sdake_ | i'd be happy if w e could jus tboot a vm, and not necessarily be able to use it | 16:49 |
| sdake_ | (eg if the network didn't work, that would be ok in the short term) | 16:50 |
| larsks | That is, I think we can probably make things "work" enough to boot a server, but not necessarily to give it proper connectivity. | 16:50 |
| larsks | So good, we are on the same page there :) | 16:50 |
| sdake_ | ya that wfm | 16:50 |
| sdake_ | we can fix that in m2 | 16:50 |
| sdake_ | assuming daneyon can get neutron rolling we will jus tuse that in m2 | 16:50 |
| sdake_ | and I have high confidence given his current work so far | 16:50 |
| sdake_ | extra gold star for networked vm :) | 16:51 |
| *** athomas has quit IRC | 16:51 | |
| *** pensu has quit IRC | 16:52 | |
| *** akrivoka has joined #tripleo | 16:56 | |
| *** akrivoka has quit IRC | 16:57 | |
| *** akrivoka has joined #tripleo | 16:57 | |
| *** akrivoka has quit IRC | 16:57 | |
| *** jprovazn has quit IRC | 16:59 | |
| *** dkehn_ is now known as dkehn | 17:01 | |
| *** sdake_ has quit IRC | 17:01 | |
| *** pensu has joined #tripleo | 17:02 | |
| *** rameshg87 has joined #tripleo | 17:02 | |
| rameshg87 | SpamapS: hi | 17:04 |
| daneyon | it may be easier to get nova-net to work than neutron l3/dhcp/ovs. | 17:04 |
| SpamapS | rameshg87: hello. :) | 17:04 |
| SpamapS | daneyon: don't do it | 17:04 |
| rameshg87 | SpamapS: https://review.openstack.org/#/c/123642/8 would require your review again as i had rebase because of merge conflict | 17:04 |
| SpamapS | daneyon: that zombie will never die if you keep feeding it | 17:04 |
| rameshg87 | SpamapS: please have a look at it :) | 17:04 |
| SpamapS | rameshg87: will do. | 17:05 |
| daneyon | from what i see, we need to extend a separate network to the minions for either nova-net or neutron to work. | 17:05 |
| rameshg87 | SpamapS: thanks .... | 17:05 |
| daneyon | that's what i'm working on right now. | 17:05 |
| rameshg87 | dprince: hi | 17:05 |
| sdake | larsks daneyon here is my devstack flatdhcp network config - which parts are the important settings? http://paste.fedoraproject.org/142929/35654571 | 17:05 |
| sdake | daneyon we agreed a bit above to just get a booting vm would be a good first step | 17:06 |
| sdake | makign it have connectivity a good wsecond step | 17:06 |
| daneyon | Spamaps: I hear ya. I go back and forth with it. I agree with you on one hand. On the other hand, many current prod deployments use nova-net and we should support their req's. I think people will let nova-net dies when neutron provides enough stability, scalability, etc.. | 17:07 |
| daneyon | sdake: 3-6, 33-35 | 17:10 |
| sdake | thanks I'll try those | 17:10 |
| daneyon | sdake: it's been a while since i've touched nova-net. give me a few min to review some of my older configs. | 17:10 |
| *** dshulyak_ has joined #tripleo | 17:11 | |
| SpamapS | daneyon: we've taken a strong stance here in the deployment program that we deploy the defaults and we fix the defaults if they're broken. Neutron is the default now.. so.. | 17:11 |
| daneyon | SpamapS: Understandable. | 17:11 |
| SpamapS | daneyon: no problem with providing nova-net as an option, of course. | 17:11 |
| SpamapS | But if we keep adding peripheral projects that only support nova-net and not neutron .. nova-net will never die. | 17:12 |
| rameshg87 | tripleo-cores, can someone else also please have a look at https://review.openstack.org/#/c/123642/8 . this is required for an ironic driver released in juno. | 17:12 |
| daneyon | Spamaps: I'm working on neutron, so I definitely want to see it be successful. If things go well with kolla, I wouldn't be surprised if we get pressure to support nova-net until the community in general begins embracing neutron. | 17:13 |
| daneyon | SpamapS: OK, I think we're on the same page. | 17:14 |
| SpamapS | Yeah that's the right thing, I think. Let people deploy it with Neutron, and when they go "oh noes I need nova-net" do that. :) | 17:14 |
| SpamapS | But really, the last big thing, multi-host, is dead now. | 17:14 |
| SpamapS | Neutron has DVR now which does all that multi-host did | 17:14 |
| daneyon | Spamaps: What about us though? Neutron will not be ready until milestone-2 (hopefully), so are we going to try using nova-net in the meantime? | 17:15 |
| larsks | daneyon: That's what sdake and I were discussing...he just wants to get a nova server booting, so he needs *something* to provide the network api. | 17:15 |
| daneyon | larsks: that's what i was thinking. just want to make sure we're all on the same page. | 17:16 |
| rameshg87 | SpamapS: thanks a lot for quick review. :-) ; please let me know if i can ping someone else too for a review.. we need this badly for the ironic driver released for juno. | 17:17 |
| SpamapS | daneyon: Neutron won't be ready, wha? | 17:17 |
| *** jogo is now known as flashgordon | 17:17 | |
| SpamapS | whats broken in Neutron, or is it just that the requirements for getting ovs working in docker is hard? | 17:18 |
| daneyon | req's to get neutron working in a container. i cut neutron-server earlier this week. i'm working on the necessary changes to heat-kube template to support multiple interfaces on minions and containers, then build the neutron l3/dhcp/ovs containers. | 17:19 |
| daneyon | we moved the neutron bp to milestone 2 the other week because of the LOE. | 17:20 |
| *** pradeep1 has quit IRC | 17:22 | |
| sdake | larsks I just booted a vm | 17:23 |
| larsks | Woo woo | 17:23 |
| sdake | but nova list doesn't appear to work (based upon daneyon's lines I copied) | 17:23 |
| sdake | houston we have liftoff -> ebbf084f-7f7a-4db0-b2ce-6653b60c0bd0 | 17:24 |
| sdake | rather http://paste.fedoraproject.org/142937/56662314 | 17:24 |
| *** dshulyak_ has quit IRC | 17:24 | |
| sdake | daneyon ideally we want this to work on bare metal not just heat-kubernetes template | 17:25 |
| larsks | sdake: that does'nt look like "liftoff". | 17:25 |
| larsks | That looksl like "failed to lift off"... (status == ERROR) | 17:26 |
| daneyon | sdake: for sure. i just figured we need it to work in heat-kube since that's the current dev solution of choice. | 17:26 |
| larsks | daneyon: the what now? I did not follow where heat-kube came up... | 17:27 |
| *** pcrews has quit IRC | 17:27 | |
| *** morganfainberg is now known as captainmorgan | 17:29 | |
| rhallisey | sdake, that's awesome | 17:30 |
| daneyon | larsks: i was thinking that neutron l3 agent containers have a 2nd interface to support floating-ips and public traffic. The 2nd interface would get mapped to a kub-ext bridge on the minion. The kube-ext bridge gets mapped to a 2nd interface on the minion. The 2nd interface on the minion maps to a public-facing network. Thoughts? | 17:30 |
| larsks | daneyon: question: where does that second interface come from? does kubernetes have a mechanism for setting that up? I haven't looked into that in any detail yet. | 17:31 |
| larsks | daneyon: yooooooo hoooooo... | 17:34 |
| *** pradeep has joined #tripleo | 17:34 | |
| openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-heat-templates: Add ExtraConfig param to storage templates https://review.openstack.org/129234 | 17:34 |
| *** pradeep has quit IRC | 17:35 | |
| SpamapS | daneyon: they don't have to have a second interface. They just have to have addresses to support the provider network where the floating ips live. | 17:36 |
| *** pradeep has joined #tripleo | 17:36 | |
| daneyon | larsks: nova boots the kube fedora image with 2 nic's. nic 1 is for managing the kube host and for providing transport between the vxlan endpoints (just like what we do today). The 2nd nic will get mapped to the new kube-ext bridge on the minion. kube-ext will be a flat bridge that provide connectivity to the neutron l3 agent containers and bridge traffic from the l3 container through the kube host eth1 to the external container | 17:37 |
| daneyon | network. Do you see any issue with this approach? | 17:37 |
| sdake | larsks any idea on this problem: http://paste.fedoraproject.org/142945/56743714 | 17:38 |
| sdake | this is sudo docker ps keystone | 17:38 |
| sdake | keystone spins for like 3-4 minutes wiating for itself | 17:38 |
| sdake | it would be nice if we could speed that up | 17:38 |
| larsks | daneyon: I am still unclear how the neutron l3 containers are connected to the kube-ext bridge. | 17:38 |
| larsks | sdake: I don't think so. We start keystone and then just wait for it to become active so that we can register endpoints. | 17:39 |
| larsks | The solution, of course...is to move one time configuration out of the container :) | 17:39 |
| larsks | Because then our start.sh would be a lot simpler. | 17:40 |
| larsks | But it might not actually make things any faster. | 17:40 |
| larsks | (That is, if it takes keystone a while to become active here, it would probably still take keystone a while to become active...) | 17:40 |
| SpamapS | Is keystone spinning while it creates its tables? | 17:41 |
| SpamapS | That always takes longer than I think it should. | 17:41 |
| larsks | SpamapS: I figured the tables would be created by the "db_sync" operation. | 17:41 |
| SpamapS | right | 17:41 |
| SpamapS | thats kind of what I was asking.. but poorly ;) | 17:41 |
| larsks | Which happens before we start up keystone and start waiting for it. | 17:41 |
| daneyon | larsks: have a 2nd interface on the container that gets connected to kube-ext? | 17:41 |
| larsks | So by the time you see the "waiting for keystone" message, db sync was already run. | 17:41 |
| larsks | daneyon: Which brings me back to my original question: where does that second interface come from? | 17:42 |
| *** rameshg87 has left #tripleo | 17:43 | |
| *** pradeep1 has joined #tripleo | 17:44 | |
| openstackgerrit | Lars Kellogg-Stedman proposed a change to stackforge/kolla: remove glance-pod.json https://review.openstack.org/129340 | 17:44 |
| *** dshulyak_ has joined #tripleo | 17:45 | |
| *** pradeep has quit IRC | 17:46 | |
| sdake | larsks my q is why does it spin for 3-4 minutes? | 17:46 |
| sdake | it doesn't take that long for keystone to become active does it ? I think there is a bug in the checking code possibly | 17:46 |
| larsks | sdake: I'm not sure. I don't think I've seen that behavior. | 17:47 |
| larsks | I don't think there's a bug in the checking code...I mean, it's very simple. | 17:47 |
| sdake | check out fpaste above | 17:47 |
| larsks | Yes, I looked at it. | 17:47 |
| daneyon | larsks: create an image with 2 NICs. eth1 would have the standard ovs bridge config (no ip addr). Take an approach similar to pipework or netcfg to connect eth1 to kube-ex? | 17:47 |
| sdake | didn't it look suspect? | 17:47 |
| larsks | sdake: well, there are no timestamps, but it only sleeps for 1 second each, so that looks like about 10 seconds. No? | 17:48 |
| larsks | daneyon: I apologize, but I am terribly confused. Kubernetes is responsible for setting up the networking inside a container. How do you propose to create a container with multiple interfaces? Can kubernetes do this? | 17:48 |
| larsks | Or is that not what you meant by "have a 2nd interface on the container"...? | 17:49 |
| sdake | oh 1 sec | 17:49 |
| sdake | ok then | 17:49 |
| sdake | nm | 17:49 |
| sdake | I thought it was 10 seconds | 17:50 |
| sdake | its just if I do keystone endpoint-list it takes forever to get rolling | 17:50 |
| sdake | even though keystone is running | 17:50 |
| sdake | I'm one of those performance maniac guys :) | 17:50 |
| larsks | I would not worry about performance right now. | 17:50 |
| sdake | agree | 17:51 |
| sdake | I jsut dont want it to be so slow that its unusable | 17:51 |
| sdake | which isn't the case | 17:51 |
| *** yamahata has quit IRC | 17:51 | |
| *** eghobo has joined #tripleo | 17:52 | |
| daneyon | larsks: i'm still grasping kube, so hang in there with me. If kube is unable to create multiple interfaces, then could we have the l3-agent use a single nic. Have this nic connect to kube-ext. config the nic as the bridge interface and create a bridge within the container with a IP for mgt. something like this: http://docwiki.cisco.com/wiki/OpenStack_Havana_Release:_High-Availability_Manual_Deployment_Guide#Single_NIC_Configurat | 17:53 |
| daneyon | ions | 17:53 |
| daneyon | larsks: http://docwiki.cisco.com/wiki/OpenStack_Havana_Release:_High-Availability_Manual_Deployment_Guide#Single_NIC_Configurations | 17:53 |
| larsks | daneyon: I think that right now we have very little flexibility in terms of pod networking. | 17:53 |
| larsks | I think you get one interface, and it gets connected to the same bridge as all the other interfaces. | 17:54 |
| larsks | I think the way we solve this for now is by creating bridge devices inside the neutron container that are *not* bridged to actual NICs. | 17:54 |
| *** pradeep has joined #tripleo | 17:54 | |
| larsks | And then we use NAT rules for outbound connectivity. | 17:54 |
| larsks | And we worry about making inbound work after we have things booting and with functional outbound. | 17:54 |
| *** pradeep1 has quit IRC | 17:55 | |
| SpamapS | How does it do the ovs networking method? | 17:57 |
| SpamapS | I see that it replaces docker0 with obr0 | 17:57 |
| larsks | SpamapS: That is bascially just a name change. | 17:57 |
| larsks | And the overlay network is something set up by the heat templates (e.g., not set up by k8s itself). | 17:58 |
| daneyon | larsks: with that said, could we create a bridge within the l3 container that does vxlan overlay over the standard kube bridged network to a separate device/node that acts as a vxlan gateway? | 17:58 |
| larsks | daneyon: Yeah, sure, maaaaaaybe :). I had that thought to. But I would first focus on what I said a moment ago...just get things running with outbound working via 'iptables -t nat -A POSTROUTING -j MASQUERADE' | 17:59 |
| SpamapS | larsks: yeah I see that now.. https://github.com/GoogleCloudPlatform/kubernetes/blob/master/cluster/vagrant/provision-network.sh#L95 | 17:59 |
| daneyon | larsks: are you aware of any kube dev to extend the current networking model? | 18:00 |
| larsks | daneyon: there is an open issue regarding external connectivity, but that is a different problem, I think. | 18:00 |
| larsks | I am not aware of any work that would cover the neutron use case, necessarily. | 18:01 |
| larsks | ...but I haven't looked or asked, either. | 18:01 |
| sdake | larsks ignore noise about keystone performance | 18:02 |
| larsks | sdake: No worries. | 18:02 |
| sdake | I tested, it takes about 1 min to boot from start, which is n't terrible | 18:02 |
| sdake | I thought it was like 5minutes | 18:02 |
| sdake | which is less desireable | 18:02 |
| openstackgerrit | Ryan Hallisey proposed a change to stackforge/kolla: Docker image and process cleaup tool https://review.openstack.org/129238 | 18:02 |
| daneyon | larsks: OK, i figured i would ask before digging. | 18:02 |
| *** radez is now known as radez_g0n3 | 18:04 | |
| SpamapS | Seems like the problem is kubernetes is assuming you will only ever care about L3 in pods. | 18:06 |
| SpamapS | looking at the code, you probably just have to add an option to add arbitrary bridges. | 18:07 |
| *** radez_g0n3 is now known as radez | 18:07 | |
| greghaynes | SpamapS: So, trying to brainstorm a process for how to move helion specific code out into a helion role | 18:08 |
| SpamapS | greghaynes: that might not be the right approach | 18:08 |
| greghaynes | o? | 18:08 |
| SpamapS | greghaynes: I think the way to go is to move mechanics into pods | 18:08 |
| larsks | SpamapS: kubernetes is heavily application-centric, and in that model, a single interface is probably fine. It might require some convincing to get upstream to accept greater functionality. Worth a shot, though. | 18:08 |
| SpamapS | greghaynes: and then Helion specific mechanics have their own pods. But Helion specific changes to the mechanics.. are forks. | 18:09 |
| SpamapS | larsks: Yeah, or as daneyon says, just tunnel out to something on each host. | 18:09 |
| sdake | larsks are you certain pods share the network namespace? | 18:09 |
| greghaynes | not sure what you mean by mechanics, got an example? | 18:09 |
| larsks | sdake: Yes, I am totally sure. | 18:10 |
| sdake | cool | 18:10 |
| sdake | ok so I'm a bit jammed up | 18:10 |
| larsks | sdake: to be clear: containers *in a pod* share a network namespace. | 18:10 |
| sdake | with this iptables thing | 18:10 |
| larsks | different pods have different network namespaces. | 18:10 |
| SpamapS | oh now that's interesting. | 18:10 |
| larsks | SpamapS: The shared network namespace for containers in a pod? | 18:11 |
| greghaynes | SpamapS: also, I think theres some term interference happening as pod is a docker thing, right? | 18:11 |
| SpamapS | but ultimately, you need to get a whole range of floating IPs routed into each network node. That seems like you would need collaboration from the host. | 18:11 |
| SpamapS | larsks: yeah I didn't know that. | 18:11 |
| larsks | SpamapS: It is a surprisingly nice abstraction -- because it makes it easier to follow a "one process per container" sort of model, even for things that are reasonably tightly linked (because "localhost" is the pod, not the container). | 18:12 |
| SpamapS | greghaynes: sorry yeah we're going to have to multiplex w/ the docker stuff. :) | 18:12 |
| greghaynes | haha | 18:12 |
| SpamapS | larsks: totally | 18:12 |
| larsks | sdake: What is the current iptables issue? | 18:12 |
| openstackgerrit | Steven Dake proposed a change to stackforge/kolla: Change from using Neutron to Nova flat networking https://review.openstack.org/129346 | 18:12 |
| SpamapS | greghaynes: I said pod, but I meant roles. | 18:12 |
| sdake | larsks paste coming hold a sec | 18:13 |
| SpamapS | I wonder if you shouldn't just plan to run the L3 agent on the host. | 18:13 |
| openstackgerrit | patrick-crews proposed a change to openstack/tripleo-image-elements: Add missing packages to tempest element https://review.openstack.org/127055 | 18:14 |
| larsks | SpamapS: Or possibly inside a non-kubernetes-managed container, to avoid polluting the host filesystem. | 18:14 |
| larsks | sdake: We are also going to need to add a "nova-network" image to run the nova-network service. | 18:15 |
| SpamapS | larsks: yeah .. though really, it seems like there is an argument to be made for kubernetes to support "l2-capable-pods" .. so have a pod just for l3 agent and it can have its normal netowrk in the same overlay as the non-l2-capable pods. | 18:15 |
| larsks | SpamapS: ...and slowly but surely kubernetes begins to transform into OpenStack :) | 18:16 |
| SpamapS | YES | 18:16 |
| sdake | larsks nova-compute cycles with this error: http://paste.fedoraproject.org/142966/14135697 | 18:16 |
| SpamapS | but without all that python baggage. ;) | 18:16 |
| sdake | instead we ge t go baggage - yay ! | 18:17 |
| sdake | our atomic image is about 400mb | 18:17 |
| greghaynes | SpamapS: oh, huh, seems I totally misunderstood roles | 18:17 |
| sdake | this is the full os for running k8s + docker | 18:17 |
| larsks | sdake: You maybe need to install openstack-nova-network also in order to get the necessary python modules? | 18:17 |
| sdake | hmm | 18:17 |
| sdake | I would expect an import error? | 18:17 |
| larsks | That *is* an Importerror. | 18:18 |
| sdake | I'll give ita try tho | 18:18 |
| larsks | Line 13. | 18:18 |
| sdake | oh | 18:18 |
| sdake | fast and loose today - always like this on release day :) | 18:18 |
| greghaynes | SpamapS: So we would make a role for galera, for example | 18:18 |
| sdake | larsks duh thanks | 18:18 |
| SpamapS | greghaynes: more like, we would make a role for 'galera-single-node-down' and 'galera-single-node-up' and 'galera-cluster-shutdown' and 'galera-cluster-recovery' | 18:20 |
| SpamapS | greghaynes: we make roles for desired states. | 18:20 |
| greghaynes | Really? Seems like theres a pattern of passing in a desired state to a role | 18:20 |
| SpamapS | greghaynes: and then we take the servers through said states .. and that's an update. :) | 18:21 |
| SpamapS | greghaynes: we _could_ do that | 18:21 |
| SpamapS | I just don't love it. | 18:21 |
| SpamapS | but I may not have fully embraced the encapsulation. | 18:21 |
| greghaynes | I am just reading random roles on ansible-galaxy ATM | 18:21 |
| SpamapS | greghaynes: we can't really use those for much inspiration | 18:21 |
| SpamapS | greghaynes: they're focused on turning an empty box into a "foo" | 18:22 |
| SpamapS | greghaynes: we're focused on turning a "foo" into a "foo.1" :) | 18:22 |
| SpamapS | though eventually I'd love for us to also be able to do initialization | 18:22 |
| greghaynes | Hrm, ok. So then for the Helion vs upstream split | 18:23 |
| greghaynes | Helion specific bits would be in a helion-gelera-cluster-recovery role maybe? | 18:24 |
| SpamapS | well | 18:24 |
| SpamapS | Helion should never have specific galera bits. | 18:24 |
| SpamapS | we abused controllerMgmt for that. | 18:24 |
| greghaynes | Yep ;) | 18:24 |
| SpamapS | Helion will likely run extra services though. | 18:24 |
| greghaynes | ok, that can be variable-ified though | 18:24 |
| SpamapS | My intention is to move all of that away from ansible | 18:24 |
| SpamapS | and into the images | 18:24 |
| SpamapS | But short term yeah, just have forked variables | 18:25 |
| *** pcrews has joined #tripleo | 18:25 | |
| greghaynes | Sweet, ill play around with roles, see what sticks | 18:25 |
| SpamapS | greghaynes: cool | 18:26 |
| *** pradeep1 has joined #tripleo | 18:30 | |
| *** pradeep has quit IRC | 18:33 | |
| openstackgerrit | James Slagle proposed a change to openstack/diskimage-builder: svc-map requires PyYAML https://review.openstack.org/129305 | 18:35 |
| *** pradeep1 has quit IRC | 18:36 | |
| *** cody-somerville_ has joined #tripleo | 18:40 | |
| *** cody-somerville_ has joined #tripleo | 18:40 | |
| *** cody-somerville has quit IRC | 18:41 | |
| *** dshulyak_ has quit IRC | 18:44 | |
| sdake | larsks nova-network communicates with nova how, amqp? | 18:47 |
| larsks | Yes. nova-{scheduler,conductor,api,network} all use the rpc message bus. | 18:48 |
| sdake | shouldn't network be part of compute, or you think controller? | 18:48 |
| larsks | I think nova-network should be a separate container, just like nova-{scheduler, conductor}, etc. | 18:48 |
| sdake | yes I got that part | 18:48 |
| larsks | Oh, which pod. I see. | 18:48 |
| larsks | Uhhhhh. I would make it part of the controller right now. | 18:48 |
| sdake | I think we will end with compute-neutron and compute-nova | 18:49 |
| sdake | compute-novanet or something | 18:49 |
| larsks | And think you are probably right. | 18:49 |
| larsks | And actually, we can make it part of the compute pod, turn on multi-host, and see how that works. | 18:49 |
| sdake | I think I'll probably put in compute pod for now | 18:49 |
| sdake | what is multi-host, you mean minon count greater then 1? | 18:49 |
| larsks | No. | 18:49 |
| larsks | Nova network has two modes of operation. | 18:49 |
| larsks | You can have a single instance, or you can have one nova-network service per compute host. | 18:50 |
| larsks | If you make nova-network part of the compute pod, I think you're going to need to use multi-host mode. | 18:50 |
| sdake | got it | 18:50 |
| sdake | ok I'll crank that out after a smoke break :) | 18:50 |
| sdake | bbiaf | 18:50 |
| sdake | (building images now anyway, can't do much) | 18:50 |
| *** sdake_ has joined #tripleo | 18:55 | |
| *** pensu has quit IRC | 18:56 | |
| daneyon | sdake: the other day you said you were having issues with a newer release of kube? what version and what was the issue? the reason i ask is because i am having issues after rebuilding my kube cluster. all the services are running and look good but no minions in my list. | 19:01 |
| larsks | daneyon: note that new, incompatible kube packages are dropping and/or have dropped today. If you have 0.4, all bets are off. | 19:02 |
| daneyon | larsks: looks like i'm still using 0.3 -> 0.3-0.6 | 19:03 |
| larsks | Okay, that should be okay. | 19:03 |
| openstackgerrit | Jeff Peeler proposed a change to stackforge/kolla: (Still WIP at the moment, but much closer) https://review.openstack.org/128994 | 19:08 |
| *** pensu has joined #tripleo | 19:12 | |
| *** radez is now known as radez_g0n3 | 19:17 | |
| sdake_ | daneyon that particular problem requires yo uto restart kube-apiserver and kube-scheduler | 19:17 |
| sdake_ | sudo systemctl restart kube-apiserver | 19:17 |
| radez_g0n3 | sdake: I almost suggested trying nova network in our meeting monday | 19:17 |
| *** radez_g0n3 is now known as radez | 19:18 | |
| radez | I don't have much experience with it though | 19:18 |
| sdake_ | radez do you know if nova net is in controller or compute in rhos? | 19:18 |
| radez | I don't know for sure. | 19:18 |
| radez | it's been so long | 19:19 |
| sdake_ | anyone you can ask? | 19:19 |
| sdake_ | I don't know the right person to query on the subject | 19:19 |
| radez | dyokum would be a good resource or some of the nova guys | 19:19 |
| sdake_ | and I don't recall from my foreman root canal the details | 19:19 |
| sdake_ | i jus tmean as structured in foreman | 19:19 |
| radez | sdake_: there's an access.redhat.com doc on it | 19:21 |
| sdake_ | daneyon the version that has the problem is whatever is installed after doing a heat create | 19:21 |
| larsks | sdake_: nova-network goes with nova-compute + you enable multi-host. | 19:22 |
| radez | http://goo.gl/1pvJvx | 19:22 |
| larsks | That is a True Fact. | 19:22 |
| sdake_ | ok | 19:22 |
| sdake_ | what about neutron? | 19:22 |
| sdake_ | will we end up with neutron server with each compute? | 19:22 |
| larsks | No. | 19:22 |
| radez | just the plugin agent on each compute host for neutron | 19:22 |
| sdake_ | ok sounds like we have a plan then | 19:23 |
| radez | is that different for ml2? | 19:23 |
| larsks | So, with Juno neutron now has a distributed virtual router (DVR) feature, with which I am not familiar. Pre-Juno, neutron is like nova-network when *not* in multi-host mode -- you have one network host, and all traffic flows through there. | 19:23 |
| sdake_ | i'll add a new container | 19:23 |
| openstackgerrit | Lars Kellogg-Stedman proposed a change to stackforge/kolla: introduce a common base for compute and controller https://review.openstack.org/129362 | 19:23 |
| sdake_ | nice | 19:23 |
| larsks | sdake_: take a look at that before you add a new container -- I was trying to facter out common stuff between nova-controller and nova-compute. | 19:24 |
| daneyon | sdake: looks like i can see my minions. now i need to figure out what i changed to solve the problem. i have restart all the master/node services multiple times with no luck. | 19:26 |
| larsks | daneyon: so...it is working now, but unclear why? | 19:26 |
| daneyon | larsks: correct. i noticed etcd was running on the minions. i think etcd should only be running on the master, so I stopped the service and restarted kube services. don't know why that would be an issue since minions = /etc/kubernetes/config:KUBE_ETCD_SERVERS=http://$MASTER_IP:4001 | 19:29 |
| *** jcoufal has quit IRC | 19:29 | |
| larsks | daneyon: That's correct, etcd should only run on the master. | 19:29 |
| larsks | I wonder if there is a racy startup between etcd and the k8s services or something. | 19:29 |
| larsks | If we're lucky, that particular issue will simply disappear with 0.4 (and I'm sure we'll have several new issues, too). | 19:30 |
| *** cody-somerville_ has quit IRC | 19:31 | |
| *** pcrews has quit IRC | 19:31 | |
| daneyon | larsks: well that's not the issue anyways. i have 1 minion running etcd and 1 not. both are configured /etc/kubernetes/config:KUBE_ETCD_SERVERS=http://$MASTER_IP:4001 and both minions appears in the master minion list. maybe theirs some service dependencies on the master. I was restarting all services and it seemed like things worked when i only restarted api and scheduler. | 19:32 |
| sdake_ | larsks looks good - radez or jpeeler can one of you review larsks last review request | 19:32 |
| openstackgerrit | A change was merged to stackforge/kolla: remove glance-pod.json https://review.openstack.org/129340 | 19:33 |
| openstackgerrit | A change was merged to stackforge/kolla: introduce a common base for compute and controller https://review.openstack.org/129362 | 19:34 |
| sdake_ | tyhanks | 19:34 |
| openstackgerrit | A change was merged to stackforge/kolla: Docker image and process cleaup tool https://review.openstack.org/129238 | 19:34 |
| openstackgerrit | A change was merged to stackforge/kolla: Adds Neutron Server Support https://review.openstack.org/128558 | 19:35 |
| openstackgerrit | Lars Kellogg-Stedman proposed a change to stackforge/kolla: fix script name in nova-controller images https://review.openstack.org/129366 | 19:47 |
| sdake_ | jpeeler your heat change looking really good | 19:49 |
| sdake_ | I submitted a few comments | 19:49 |
| openstackgerrit | Ryan Hallisey proposed a change to stackforge/kolla: Add nova-novncproxy to the nova-controller https://review.openstack.org/129374 | 19:54 |
| *** yuanying has quit IRC | 19:56 | |
| openstackgerrit | A change was merged to stackforge/kolla: fix script name in nova-controller images https://review.openstack.org/129366 | 19:57 |
| sdake_ | what does novncproxy do anyway | 19:57 |
| larsks | it proxies vnc connections from a browser to the appropriate compute host | 19:58 |
| sdake_ | i see | 19:58 |
| larsks | That is how the instance console works. | 19:58 |
| sdake_ | that explains why there is x graphics in the dep chains i guess | 19:58 |
| sdake_ | never used instance cnsole | 19:58 |
| sdake_ | use virt-manager for that | 19:58 |
| larsks | You can't always use virt-manager if you're interacting with a remote openstack deployment of which you are not the admin :) | 19:59 |
| sdake_ | agree | 19:59 |
| sdake_ | wfm, not for a real deployment | 19:59 |
| rhallisey | larsks, should I add it to the controller? | 19:59 |
| rhallisey | larsks, I figured I would | 19:59 |
| larsks | rhallisey: well, we will need an image for it somewhere at some point, so it can't hurt. | 20:00 |
| larsks | I think maybe we will ultimately want to run it wherever we run horizon. | 20:00 |
| larsks | But I'm not sure. | 20:00 |
| openstackgerrit | Ryan Hallisey proposed a change to stackforge/kolla: Add nova-novncproxy as a kube service https://review.openstack.org/129375 | 20:00 |
| *** dprince has quit IRC | 20:06 | |
| *** sdake_ has quit IRC | 20:08 | |
| *** sdake_ has joined #tripleo | 20:08 | |
| sdake_ | i feel like the tab police | 20:09 |
| *** pcrews has joined #tripleo | 20:11 | |
| sdake_ | do we need both port and containerPort in service files? | 20:11 |
| *** rhallisey has quit IRC | 20:12 | |
| larsks | sdake_: Yes. When is the "inside port" on the container to which the proxy connects, the other is the port on which the proxy listens. | 20:13 |
| larsks | sdake_: Fix the bashate gate and you will not have to be the tab police :) | 20:13 |
| larsks | s/When/One/ that was weird | 20:13 |
| openstackgerrit | A change was merged to stackforge/kolla: Add nova-novncproxy as a kube service https://review.openstack.org/129375 | 20:14 |
| sdake_ | jpeeler ignore my comment then about the port not being necessary :) | 20:16 |
| sdake_ | pretty sure that change was busted above | 20:18 |
| *** jdob has quit IRC | 20:20 | |
| openstackgerrit | Steven Dake proposed a change to stackforge/kolla: Change to using flat nova networking from neutron https://review.openstack.org/129380 | 20:20 |
| sdake_ | hey guys the repo has 255 commits | 20:21 |
| sdake_ | 2^8 ftw ! | 20:21 |
| sdake_ | new build workflow rocks | 20:24 |
| *** pensu has quit IRC | 20:26 | |
| *** rhallisey has joined #tripleo | 20:28 | |
| *** jehb has quit IRC | 20:30 | |
| -openstackstatus- NOTICE: Gerrit will be offline from 2100-2130 for project renames | 20:35 | |
| *** ChanServ changes topic to "Gerrit will be offline from 2100-2130 for project renames" | 20:35 | |
| *** cwolfe__ has joined #tripleo | 20:36 | |
| *** cwolferh_ has quit IRC | 20:40 | |
| sdake | larsks what might haautooproxy do | 20:43 |
| *** rhallisey has quit IRC | 20:47 | |
| *** pweiss has joined #tripleo | 20:47 | |
| openstackgerrit | Pradeep Kilambi proposed a change to stackforge/kolla: WIP: Add Ceilometer service support https://review.openstack.org/129383 | 20:48 |
| SpamapS | mordred: flamel trick: select horribly formatted json in vim, type "!flamel -|flamel -" ... reformats nicely :) | 20:55 |
| SpamapS | I should probably just add a --reformat or something | 20:55 |
| *** rwsu has quit IRC | 20:56 | |
| SpamapS | actually "jq ." kinda does that better, but doesn't preserve order. :) | 20:56 |
| *** jistr has quit IRC | 20:58 | |
| *** untriaged-bot has joined #tripleo | 21:00 | |
| untriaged-bot | Untriaged bugs so far: | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1382468 | 21:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1381408 | 21:00 |
| uvirtbot | Launchpad bug 1382468 in tuskar "Bad parameter exception" [Undecided,Triaged] | 21:00 |
| uvirtbot | Launchpad bug 1381408 in diskimage-builder ""visudo" always got error when building overcloud image" [Undecided,New] | 21:00 |
| *** untriaged-bot has quit IRC | 21:00 | |
| *** radez is now known as radez_g0n3 | 21:01 | |
| sdake | 503 on reviews ftl | 21:04 |
| -openstackstatus- NOTICE: Gerrit is offline from 2100-2130 for project renames | 21:04 | |
| *** ChanServ changes topic to "Gerrit is offline from 2100-2130 for project renames" | 21:04 | |
| * sdake groans | 21:04 | |
| sdake | 30 minute break time | 21:04 |
| *** weshay has quit IRC | 21:07 | |
| clarkb | sdake: use the gertty :P | 21:13 |
| *** sdake_ has quit IRC | 21:14 | |
| *** sdake_ has joined #tripleo | 21:16 | |
| sdake | prefer breaktime clarkb :) | 21:19 |
| *** sdake_ has quit IRC | 21:20 | |
| *** ChanServ changes topic to "CI: Presumed O-K | Using OpenStack to deploy OpenStack; meetings Tuesday 1900/0800 UTC in #openstack-meeting-alt" | 21:27 | |
| -openstackstatus- NOTICE: Gerrit is back online | 21:27 | |
| *** captainmorgan is now known as needscoffee | 21:29 | |
| *** needscoffee is now known as captainmorgan | 21:29 | |
| openstackgerrit | Jonathan Brownell proposed a change to openstack/os-apply-config: Treat null values in JSON as being absent rather than 'None' https://review.openstack.org/127051 | 21:32 |
| openstackgerrit | Ben Nemec proposed a change to openstack/diskimage-builder: Enable dracut deploy ramdisks https://review.openstack.org/105275 | 21:38 |
| *** bth- has quit IRC | 21:38 | |
| *** andreaf has quit IRC | 21:59 | |
| *** gfidente has quit IRC | 22:01 | |
| *** openstackgerrit has quit IRC | 22:03 | |
| *** openstackgerrit has joined #tripleo | 22:04 | |
| *** jang2 has quit IRC | 22:26 | |
| *** gfidente has joined #tripleo | 22:30 | |
| *** andreaf has joined #tripleo | 22:41 | |
| *** rwsu has joined #tripleo | 22:52 | |
| openstackgerrit | Giulio Fidente proposed a change to openstack/tripleo-image-elements: Improve nfs-server to support multiple shares and options https://review.openstack.org/125968 | 22:53 |
| *** marun has quit IRC | 23:09 | |
| openstackgerrit | Daneyon Hansen proposed a change to stackforge/kolla: Fixes k8s neutron pod image source and formatting https://review.openstack.org/129400 | 23:38 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
