lifeless | we should | 00:00 |
---|---|---|
*** openstack has joined #tripleo | 00:02 | |
-wolfe.freenode.net- [freenode-info] channel flooding and no channel staff around to help? Please check with freenode support: http://freenode.net/faq.shtml#gettinghelp | 00:02 | |
greghaynes | any reason we dont do the raw image boot in devtest for demo vm? | 00:03 |
lifeless | EPARSE | 00:06 |
*** jcooley_ has quit IRC | 00:08 | |
greghaynes | sry, in the devtest_overcloud.sh we dont use load-image where we boot the kernel/initrd for the demo vm, why not? | 00:08 |
*** jcooley_ has joined #tripleo | 00:09 | |
*** CaptTofu has joined #tripleo | 00:12 | |
*** jcooley_ has quit IRC | 00:16 | |
SpamapS | greghaynes: normal VM images just boot from grub and the kernel inside them. | 00:21 |
SpamapS | greghaynes: so we can just upload the qcow2 to glance and boot it | 00:22 |
greghaynes | ok, so the alternative is the special case? | 00:22 |
SpamapS | greghaynes: right, baremetal images need partitions and stuff | 00:22 |
SpamapS | and split out kernel/ramdisk | 00:23 |
greghaynes | oh, right, these are emulating baremetal | 00:23 |
* greghaynes head->desk | 00:23 | |
*** matsuhashi has joined #tripleo | 00:27 | |
greghaynes | SpamapS: Any idea what would be responsible for chmod'ing /etc/nova on nova compute node during stack-update? | 00:44 |
SpamapS | greghaynes: something in /opt/stack/os-config-refresh | 00:45 |
*** jcooley_ has joined #tripleo | 00:48 | |
lifeless | greghaynes: it was chmodded so that user nova couldn't read it? | 00:50 |
lifeless | trolololol | 00:50 |
greghaynes | A guess | 00:50 |
greghaynes | although IMBW | 00:50 |
greghaynes | the perms dont match my undercloud node but looks like it still should be readable | 00:51 |
*** jcooley_ has quit IRC | 00:54 | |
lifeless | StevenK: around? Can I throw a couple of nova patches your way? | 00:59 |
StevenK | lifeless: I am currently watching flash videos | 01:00 |
lifeless | StevenK: onboarding stuff? | 01:00 |
StevenK | Yeah | 01:00 |
lifeless | StevenK: well when you get depressed enough, I have code for you | 01:00 |
StevenK | Hahahaha | 01:00 |
greghaynes | ugh, I should do some of that | 01:00 |
lifeless | you'll go blind | 01:00 |
greghaynes | :( | 01:00 |
StevenK | greghaynes: When did you start? | 01:06 |
greghaynes | last tues | 01:06 |
greghaynes | 21st | 01:06 |
StevenK | greghaynes: My first day was the 6th | 01:07 |
StevenK | greghaynes: So, welcome :-) | 01:07 |
greghaynes | Sweet! Thanks | 01:07 |
greghaynes | Where are you based? | 01:08 |
StevenK | greghaynes: Sydney, .au | 01:08 |
greghaynes | baw. So getting started hacksession not likely :P | 01:09 |
StevenK | greghaynes: How far away is Sydney, then? :-) | 01:10 |
greghaynes | A ways, im in Portland OR | 01:10 |
StevenK | It's only what, 16 hours by plane ... :-P | 01:11 |
greghaynes | haha, exactly | 01:12 |
*** CaptTofu has quit IRC | 01:13 | |
*** CaptTofu has joined #tripleo | 01:13 | |
*** CaptTofu has quit IRC | 01:18 | |
*** ccrouch has quit IRC | 01:34 | |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Update README as we do support updates now https://review.openstack.org/69436 | 01:34 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Update tripleo-heat-templates: mention merge tool https://review.openstack.org/69438 | 01:34 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Add in missing definite article in README https://review.openstack.org/69439 | 01:34 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Update os-*-config section of README https://review.openstack.org/69434 | 01:34 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Update README - file injection is not required https://review.openstack.org/69430 | 01:34 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Heat is quite usable in more than Grizzly https://review.openstack.org/69431 | 01:34 |
*** CaptTofu has joined #tripleo | 01:34 | |
SpamapS | ahh the infinite hampster-wheel of rebases | 01:35 |
*** nosnos has joined #tripleo | 01:36 | |
mordred | yay rebase! | 01:40 |
SpamapS | mordred: the next hip hop song should be 'stone cold rebasin' | 01:40 |
mordred | yeah. that'll be a sure grammy winner | 01:40 |
SpamapS | comizzle your chizzle to the gizzle repizzle the submit it to gerizzle for community revizzle | 01:42 |
*** jcooley_ has joined #tripleo | 01:42 | |
lifeless | ok, now where was I | 01:47 |
lifeless | thats right, MVP4 stuff | 01:47 |
StevenK | One more module ... | 01:47 |
*** jcooley_ has quit IRC | 01:48 | |
greghaynes | SpamapS: Was that bill cosby's guide on how to submit to openstack? | 01:52 |
SpamapS | greghaynes: you mean snoop right? | 01:54 |
greghaynes | hah, they must share material | 01:55 |
*** julim has quit IRC | 01:56 | |
SpamapS | greghaynes: https://bugs.launchpad.net/tripleo/+bug/1273489 <-- triaged.. please read comments and add anything if you have more. :) | 02:01 |
*** ccrouch has joined #tripleo | 02:01 | |
lifeless | SpamapS: are you going to flesh out heat specs/blah about rolling ? | 02:02 |
greghaynes | SpamapS: What was bugging me with that was it attempting to connect to 'local mysqld' rather than over IP | 02:03 |
SpamapS | lifeless: it is so elegant.. just 4 points.. | 02:03 |
greghaynes | nova-compute was also unable to start, assumed it was due to taht | 02:03 |
SpamapS | greghaynes: it is likely a bug in nova-compute that it won't start without a working conductor. | 02:04 |
SpamapS | s/likely // | 02:04 |
SpamapS | it should just start and spin until conductor does things properly | 02:04 |
SpamapS | greghaynes: the error was not from nova-compute though, it was from the conductor which is configured for localhost db | 02:05 |
greghaynes | Gotcha :) | 02:05 |
lifeless | SpamapS: I know, its what you get when I get time to think about a problem :P | 02:05 |
lifeless | SpamapS: OTOH, 4 bullet points can hide a tonne of mess :) | 02:06 |
SpamapS | lifeless: Yeah so #2 at https://etherpad.openstack.org/p/tripleo-rolling-upgrades is basically all that my original assessment covers. | 02:06 |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Document stable branches in devtest https://review.openstack.org/68274 | 02:09 |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Setup libvirt/kvm permissions on openSUSE https://review.openstack.org/68794 | 02:11 |
*** vkozhukalov has joined #tripleo | 02:15 | |
jamezpolley | StevenK: greghaynes might be too far away, but that doesn't mean you've escaped all threat of being dragged into a getting started hacksession | 02:18 |
jamezpolley | StevenK: you'll be an entire month ahead of me, so practically an old hand! | 02:20 |
greghaynes | only if he survives those onboarding videos | 02:23 |
StevenK | Bwahaha | 02:23 |
StevenK | Hm, no, this isn't #slug ... | 02:25 |
*** jcooley_ has joined #tripleo | 02:36 | |
*** jcooley_ has quit IRC | 02:42 | |
jamezpolley | s/an entire month/two entire months/ | 02:43 |
lifeless | jamezpolley: you're keen to start aren't you :) | 02:51 |
jamezpolley | I don't know why you'd think that :) | 02:53 |
greghaynes | jamezpolley: When do you start? | 02:54 |
lifeless | StevenK: if you fix https://review.openstack.org/#/c/68308/ we can land it | 02:56 |
jamezpolley | March 3 | 02:56 |
greghaynes | jamezpolley: Awesome :) | 02:57 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Do not drop databases without a good reason https://review.openstack.org/69003 | 02:57 |
lifeless | slagle: hey | 02:57 |
lifeless | https://review.openstack.org/#/c/67343/ wondering if you coud add the systemd unit ? | 02:57 |
*** CaptTofu has quit IRC | 03:00 | |
*** matsuhashi has quit IRC | 03:13 | |
*** matsuhashi has joined #tripleo | 03:14 | |
openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Stop sourcing devtest_seed.sh. https://review.openstack.org/69286 | 03:15 |
*** rwsu has quit IRC | 03:18 | |
StevenK | lifeless: Sure, so indent the whole debian-mirror: block by 4 spaces? | 03:30 |
lifeless | yes,, and s/ - comment/ # comment/ | 03:32 |
*** ccrouch has quit IRC | 03:32 | |
*** ccrouch has joined #tripleo | 03:33 | |
lifeless | SpamapS: around ? | 03:39 |
*** ccrouch has quit IRC | 03:42 | |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Update README - file injection is not required https://review.openstack.org/69430 | 03:45 |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Heat is quite usable in more than Grizzly https://review.openstack.org/69431 | 03:45 |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Update os-*-config section of README https://review.openstack.org/69434 | 03:45 |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Update README as we do support updates now https://review.openstack.org/69436 | 03:45 |
lifeless | SpamapS: your stack needs rebasing | 03:48 |
*** matsuhashi has quit IRC | 03:49 | |
*** CaptTofu has joined #tripleo | 03:55 | |
*** AaronGr is now known as AaronGr_Zzz | 03:57 | |
*** jcooley_ has joined #tripleo | 03:57 | |
lifeless | SpamapS: so whats nova-compute-group.yaml for | 03:59 |
*** CaptTofu has quit IRC | 04:00 | |
*** jcooley_ has quit IRC | 04:02 | |
StevenK | lifeless: Right, but the -'s in the text are fine as-is? | 04:10 |
lifeless | StevenK: - indicates a list item in yaml | 04:11 |
lifeless | StevenK: or do you mean '# foo - bar\n' <- thats ok | 04:12 |
StevenK | lifeless: I'm refering to suites: ["saucy", "saucy-updates", "saucy-security"] | 04:12 |
lifeless | yes, thats fine | 04:12 |
lifeless | its in a string | 04:12 |
StevenK | lifeless: http://paste.openstack.org/show/61980 | 04:13 |
lifeless | I think that will work | 04:17 |
StevenK | lifeless: So perhaps we should enable the cron job. | 04:23 |
*** AaronGr_Zzz is now known as AaronGr | 04:24 | |
lifeless | StevenK: heh yes | 04:24 |
lifeless | StevenK: and as you say, we'll need apache2 config fluff for the heat template | 04:25 |
StevenK | lifeless: Do you think that's enough, or should we fiddle something for first boot? | 04:26 |
lifeless | StevenK: what sort of thing are you thinking of ? | 04:26 |
StevenK | I'm not certain, that's part of the problem. | 04:26 |
lifeless | ok | 04:27 |
lifeless | so what should happen once and only once for this thing? | 04:27 |
StevenK | Well, the mirror should keep itself up to date -- perhaps we want that configurable too? | 04:28 |
lifeless | thats ongoing | 04:28 |
lifeless | not once and only once | 04:28 |
lifeless | first-boot stuff is once and only once, right ? | 04:28 |
*** jcooley_ has joined #tripleo | 04:28 | |
StevenK | We have the configuration written, we just need to run apt-mirror as the right user as the cronjob will do | 04:29 |
StevenK | So there's no one-time setup to populate the mirror for the first time | 04:29 |
*** jcooley_ has quit IRC | 04:30 | |
lifeless | righto then | 04:31 |
lifeless | so just diddle the cronjob at build time | 04:31 |
StevenK | lifeless: And provide debian-mirror.update-schedule as a string or so? | 04:31 |
lifeless | StevenK: why? | 04:33 |
lifeless | StevenK: simplest thing tome seems to be sed /#// | 04:33 |
lifeless | StevenK: if we find there isn't a right setting for it, then sure, we can allow configuring it | 04:34 |
StevenK | lifeless: The timestamp is what I'm talking about | 04:34 |
lifeless | StevenK: what timestamp? Do you mean the cronspec ? | 04:34 |
StevenK | lifeless: Yeah | 04:34 |
lifeless | StevenK: so, is the default wrong ? | 04:35 |
StevenK | The path needs fiddling | 04:35 |
StevenK | 4am is probably not a bad default for updating the mirror | 04:36 |
lifeless | so, unless you have a better time, sounds good to me | 04:36 |
lifeless | I'm not a huge believer in pick-your-own-adventure | 04:36 |
lifeless | flexability we expect folk to need - sure | 04:37 |
StevenK | And people are free to puppet it up or hand edit it | 04:37 |
lifeless | right; if we ship in the image a sane default | 04:39 |
lifeless | we can always make it a template later | 04:39 |
lifeless | just saying, don't overpredict things | 04:39 |
StevenK | lifeless: Right, let me distractedly build an image that includes this element, and then I'll push it up | 04:40 |
StevenK | In other news, section 4.7 ... | 04:40 |
*** UtahDave has quit IRC | 04:43 | |
*** matsuhashi has joined #tripleo | 04:45 | |
*** weshay has quit IRC | 04:49 | |
lifeless | SpamapS: bwahahahaahahah our wait condition stuff is -so- broken | 04:56 |
lifeless | SpamapS: e.g. we hard code '2' for the count in overcloud-source, and then '1' in -instance | 04:58 |
lifeless | but the thing in -instance isn't merged at all | 04:58 |
*** akuznetsov has joined #tripleo | 05:00 | |
*** jcooley_ has joined #tripleo | 05:06 | |
*** jcooley_ has quit IRC | 05:07 | |
StevenK | lifeless: The cron.d file looks good, but does the heat template stuff need to be in place for the mirror.list generation to fire? | 05:16 |
lifeless | StevenK: when someone uses it yes | 05:25 |
lifeless | but they are separate repos, decoupled landing | 05:25 |
StevenK | Right | 05:25 |
openstackgerrit | Steve Kowalik proposed a change to openstack/tripleo-image-elements: Add a debian-mirror element https://review.openstack.org/68308 | 05:26 |
lifeless | SpamapS: whats __include__ vs FileInclude ? | 05:28 |
*** CaptTofu has joined #tripleo | 05:56 | |
*** CaptTofu has quit IRC | 06:00 | |
*** jcoufal has joined #tripleo | 06:12 | |
lifeless | SpamapS: ^ enjoy, off to movie. | 06:41 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Permit writing output to other than stdout. https://review.openstack.org/69545 | 06:41 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Make debugging merge.py in the test suite possible. https://review.openstack.org/69546 | 06:41 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Make scaling out a feature for merge.py. https://review.openstack.org/69547 | 06:41 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Update overcloud to support N compute hosts. https://review.openstack.org/69548 | 06:41 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Deploy 2 hypervisors, not 1. https://review.openstack.org/69549 | 06:44 |
openstackgerrit | lifeless proposed a change to openstack-infra/tripleo-ci: Build test environments for 2 hypervisors. https://review.openstack.org/69550 | 06:47 |
*** vkozhukalov has quit IRC | 06:51 | |
*** rpodolyaka has joined #tripleo | 07:10 | |
*** coolsvap has joined #tripleo | 07:17 | |
*** mrunge has joined #tripleo | 07:31 | |
*** vkozhukalov has joined #tripleo | 07:33 | |
*** jprovazn has joined #tripleo | 07:35 | |
*** rlandy has joined #tripleo | 07:46 | |
*** rdopieralski has joined #tripleo | 07:48 | |
*** markmc has joined #tripleo | 07:56 | |
markmc | lifeless, howdy | 07:57 |
*** CaptTofu has joined #tripleo | 07:57 | |
markmc | lifeless, so, the short notice makes things a little difficult, but maybe 4-6 should be able to go | 07:57 |
markmc | lifeless, mar 3rd is likely to work fine for that many | 07:57 |
*** CaptTofu has quit IRC | 08:01 | |
openstackgerrit | Ralf Haferkamp proposed a change to openstack/tripleo-image-elements: Fix mysql installation on openSUSE https://review.openstack.org/68278 | 08:02 |
*** sdake has quit IRC | 08:14 | |
*** sdake has joined #tripleo | 08:15 | |
*** jistr has joined #tripleo | 08:19 | |
*** rha has quit IRC | 08:19 | |
*** rha has joined #tripleo | 08:20 | |
*** rha has joined #tripleo | 08:20 | |
*** e0ne has joined #tripleo | 08:27 | |
ProfFalken | hey all, I've got devstack working and tuskar/horizon installed, however I can't log in to Horizon using the creds in stackrc from the undercloud machine. "nova list" works fine, can anyone tell me where to find the logs to troubleshoot this? | 08:40 |
*** e0ne has quit IRC | 08:44 | |
ProfFalken | nm, found it, I get a 503. Tracking it down now | 08:45 |
*** e0ne has joined #tripleo | 08:45 | |
openstackgerrit | Matthew Macdonald-Wallace proposed a change to openstack/tuskar-ui: Switch from using the git protocol to https for pip requirements https://review.openstack.org/69559 | 08:45 |
*** pblaho has joined #tripleo | 08:47 | |
*** e0ne has quit IRC | 08:49 | |
openstackgerrit | Ronelle Landy proposed a change to openstack/tripleo-image-elements: Moving iptables rules to the relevant elements https://review.openstack.org/68075 | 08:51 |
*** vkozhukalov has quit IRC | 08:51 | |
jprovazn | lifeless: ping | 08:52 |
*** derekh has joined #tripleo | 09:05 | |
*** lsmola_ has joined #tripleo | 09:08 | |
*** matsuhashi has quit IRC | 09:09 | |
*** athomas has joined #tripleo | 09:12 | |
*** matsuhas_ has joined #tripleo | 09:14 | |
*** marun has quit IRC | 09:19 | |
*** rpodolyaka has quit IRC | 09:21 | |
*** jtomasek has joined #tripleo | 09:26 | |
*** e0ne has joined #tripleo | 09:28 | |
*** athomas has quit IRC | 09:38 | |
*** athomas has joined #tripleo | 09:49 | |
rlandy | derekh: hi ... I'm testing out the iptables changes (permissions updated). Your comments says "with iptables enabled during image build". How do I enable iptables for image building? | 09:51 |
rlandy | right now I am checking the seed vm and keystone can't be reached so I'm missing something | 09:52 |
*** CaptTofu has joined #tripleo | 09:57 | |
*** lsmola_ has quit IRC | 09:58 | |
*** martyntaylor has joined #tripleo | 10:02 | |
*** CaptTofu has quit IRC | 10:02 | |
derekh | rlandy: I meant you would enable the service during image build so that the when the vm comes up your rules would be tested, | 10:02 |
derekh | rlandy: firewalld seems to not be installed, looking | 10:03 |
*** e0ne_ has joined #tripleo | 10:06 | |
derekh | rlandy: you'll probably have to put something like this into an element to turn on the firewall | 10:07 |
derekh | yum install firewalld ; rm /etc/systemd/system/firewalld.service ; systemctl daemon-reload ; systemctl enable firewalld | 10:07 |
*** e0ne has quit IRC | 10:10 | |
rlandy | derekh: ok - I'll try that in keystone since that seemed to be the first element to hit the problem. How did the rules work previously though? boot-stack included it? | 10:10 |
derekh | rlandy: ya boot stack included them, are the rules present on your seed vm to allow access to keystone? | 10:12 |
*** lsmola_ has joined #tripleo | 10:13 | |
rlandy | derekh: ssh'ing in to the seed - looks like the rules for some of the files I changed exist but iptables --list doesn't show keystone | 10:14 |
*** martyntaylor has quit IRC | 10:15 | |
rlandy | init-keystone returns "Unable to establish connection to http://192.0.2.1:35357/v2.0/tenants" so there's no rule | 10:15 |
derekh | rlandy: weird, off the top of my head I can't think of anything, any errors in the os-coolect-config log ? if you want to send me details I can log in a have a look | 10:17 |
derekh | rlandy: is keystone running ? :-) | 10:17 |
rlandy | yes | 10:17 |
ProfFalken | when running tripleo/devtest is there any way to see the logs for the Nova scheduler? It says it's set to debug but I can't see anything in the various config files that indicate where that is output to... | 10:18 |
derekh | ProfFalken: if you on ubuntu it should be in /var/log/upstart/nova-scheduler.log | 10:18 |
derekh | ProfFalken: or something like that | 10:19 |
ProfFalken | derekh: I am and it is. thanks :) | 10:19 |
derekh | ProfFalken: np | 10:19 |
*** matsuhas_ has quit IRC | 10:22 | |
rlandy | derekh: lsof -Pnl | grep "35357" | 10:23 |
rlandy | keystone- 2735 997 3u IPv4 19707 0t0 TCP *:35357 (LISTEN) | 10:23 |
derekh | rlandy: is it possible its the IP address 192.0.2.1 perhapes it failed to get assigned to the device, you should be able to test the 192.168.122.XXX address | 10:24 |
rlandy | derekh: ok - checking a few more things here | 10:26 |
*** max_lobur_afk is now known as max_lobur | 10:29 | |
*** martyntaylor has joined #tripleo | 10:31 | |
*** matsuhashi has joined #tripleo | 10:31 | |
*** vkozhukalov has joined #tripleo | 10:37 | |
*** lsmola_ has quit IRC | 10:43 | |
*** coolsvap has quit IRC | 10:47 | |
*** lsmola_ has joined #tripleo | 10:56 | |
*** coolsvap has joined #tripleo | 11:00 | |
*** matsuhashi has quit IRC | 11:00 | |
openstackgerrit | A change was merged to openstack/tuskar-ui: Run PEP8 check by default when tests are run https://review.openstack.org/69444 | 11:06 |
openstackgerrit | A change was merged to openstack/tuskar-ui: Switch from using the git protocol to https for pip requirements https://review.openstack.org/69559 | 11:08 |
* ProfFalken is gonna work with tripleo/tuskar more often - that's the fastest openstack merge I've ever seen! :D | 11:10 | |
ProfFalken | thanks all | 11:10 |
*** boris-42 has quit IRC | 11:11 | |
ProfFalken | If I wanted to add more nodes to the underlcoud to spawn more vms in the overcloud, would I just re-run the steps from http://docs.openstack.org/developer/tripleo-incubator/devtest_undercloud.html ? | 11:14 |
*** matsuhashi has joined #tripleo | 11:14 | |
*** matsuhashi has quit IRC | 11:17 | |
*** lucasagomes has joined #tripleo | 11:22 | |
*** coolsvap has quit IRC | 11:30 | |
*** jprovazn has quit IRC | 11:30 | |
openstackgerrit | Ronelle Landy proposed a change to openstack/tripleo-image-elements: Moving iptables rules to the relevant elements https://review.openstack.org/68075 | 11:35 |
*** akrivoka has joined #tripleo | 11:36 | |
*** mrunge has quit IRC | 11:36 | |
*** jprovazn has joined #tripleo | 11:44 | |
*** panda__ has joined #tripleo | 11:54 | |
*** panda has quit IRC | 11:55 | |
*** CaptTofu has joined #tripleo | 11:58 | |
*** panda has joined #tripleo | 12:00 | |
*** mrunge has joined #tripleo | 12:03 | |
*** panda__ has quit IRC | 12:03 | |
*** CaptTofu has quit IRC | 12:04 | |
*** vipul has quit IRC | 12:10 | |
*** vipul has joined #tripleo | 12:12 | |
rlandy | derekh: iptables changes are working now in the seed. It was the file permissions again :(. But patch 3 should fix that | 12:14 |
derekh | rlandy: cool, will check it in a bit | 12:16 |
lifeless | derekh: looks like nodepool isn't reusing tripleo nodes now | 12:27 |
lifeless | derekh: which is a bit sad but meh | 12:27 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Don't delete test VMs by default. https://review.openstack.org/68841 | 12:28 |
derekh | lifeless: ok, will be interesting to see if the time to run a job increases much | 12:30 |
lifeless | derekh: well, we need to add the additional jobs | 12:30 |
lifeless | derekh: (undercloud and overcloud, and also preconfigured environments for them) and so on | 12:30 |
*** boris-42 has joined #tripleo | 12:31 | |
lifeless | farking neutron :( | 12:31 |
* lifeless restarts neutron-dhcp-agent on the ci-overcloud | 12:32 | |
derekh | lifeless: yup, | 12:32 |
derekh | that neutron problem sounds like a PITA | 12:32 |
lifeless | yuo can tell it's happening if in zuul status all our jobs have (queued) | 12:32 |
lifeless | (starting at the top) | 12:32 |
lifeless | and then nova console-log $instance | 12:33 |
lifeless | shows | 12:33 |
lifeless | cloud-init-nonet waiting 120 seconds for a network device. | 12:33 |
derekh | lifeless: should we add a restart cron job on the overcloud to workaround it? | 12:34 |
lifeless | derekh: shudder. | 12:36 |
lifeless | derekh: we should debug whats causing it | 12:36 |
lifeless | derekh: someone needs to look at the neutron code, see what is meant to happen, then gather data to show what /is/ happening | 12:37 |
derekh | lifeless: ok, I doubt I'm the right person but will poke at it a little bit and see if I can find anything | 12:38 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Update overcloud to support N compute hosts. https://review.openstack.org/69548 | 12:40 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Permit writing output to other than stdout. https://review.openstack.org/69545 | 12:40 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Make debugging merge.py in the test suite possible. https://review.openstack.org/69546 | 12:40 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-heat-templates: Make scaling out a feature for merge.py. https://review.openstack.org/69547 | 12:40 |
lifeless | derekh: I have put some reasonable diagnostics in the bug already | 12:40 |
derekh | lifeless: ok | 12:40 |
lifeless | derekh: the rabbit disconnects AFAICT are a distraction and not correlated nor causative | 12:40 |
*** max_lobur is now known as max_lobur_afk | 12:41 | |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Don't delete test VMs by default. https://review.openstack.org/68841 | 12:42 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Stop sourcing devtest_seed.sh. https://review.openstack.org/69286 | 12:42 |
openstackgerrit | lifeless proposed a change to openstack/tripleo-incubator: Deploy 2 hypervisors, not 1. https://review.openstack.org/69549 | 12:42 |
*** CaptTofu has joined #tripleo | 12:46 | |
lifeless | Ng: hey, have you had a walkthrough with Colin yet? | 12:47 |
*** tserong has quit IRC | 12:49 | |
*** tserong has joined #tripleo | 12:50 | |
*** tserong has quit IRC | 12:50 | |
*** tserong has joined #tripleo | 12:50 | |
Ng | lifeless: no, I've not had a reply. I'll chase again | 12:50 |
*** bauzas has joined #tripleo | 12:57 | |
*** dprince has joined #tripleo | 12:59 | |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Add package install support to openstack-clients https://review.openstack.org/69022 | 13:01 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Add package install support to novnc https://review.openstack.org/67945 | 13:01 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Add package install support to nova https://review.openstack.org/67946 | 13:01 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Install nova-manage into /usr/local/bin https://review.openstack.org/67947 | 13:01 |
openstackgerrit | A change was merged to openstack/tripleo-image-elements: Install nova-baremetal-manage into /usr/local/bin https://review.openstack.org/67948 | 13:01 |
*** max_lobur_afk is now known as max_lobur | 13:04 | |
*** jdob has joined #tripleo | 13:04 | |
*** hewbrocca has joined #tripleo | 13:06 | |
*** nosnos has quit IRC | 13:08 | |
*** pblaho has quit IRC | 13:11 | |
*** morazi has joined #tripleo | 13:15 | |
*** funzo has quit IRC | 13:22 | |
*** pblaho has joined #tripleo | 13:24 | |
*** funzo has joined #tripleo | 13:27 | |
*** panda__ has joined #tripleo | 13:29 | |
*** michchap has quit IRC | 13:31 | |
*** panda has quit IRC | 13:31 | |
*** michchap has joined #tripleo | 13:31 | |
*** funzo has quit IRC | 13:35 | |
*** funzo has joined #tripleo | 13:36 | |
*** michchap has quit IRC | 13:36 | |
*** noslzzp has joined #tripleo | 13:38 | |
*** julim has joined #tripleo | 13:56 | |
*** ccrouch has joined #tripleo | 14:01 | |
SpamapS | lifeless: UGH.. you're improving merge.py in ways that Heat desperately needs to be improved. | 14:03 |
*** mestery has quit IRC | 14:03 | |
slagle | heh, 100'ish lines added to merge.py | 14:04 |
* slagle just saw that | 14:04 | |
SpamapS | makes me sad | 14:05 |
SpamapS | Poor Heat just can't keep up with a lean and mean piece of crap like merge.py ;) | 14:06 |
slagle | it might, arguably, be better if merge.py was in Heat as-is | 14:07 |
slagle | at least then, where we're at, and where we want to get to is in the same place | 14:07 |
slagle | but, maybe not | 14:08 |
*** lblanchard has joined #tripleo | 14:08 | |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Update tripleo-heat-templates: mention merge tool https://review.openstack.org/69438 | 14:10 |
openstackgerrit | Clint "SpamapS" Byrum proposed a change to openstack/tripleo-incubator: Add in missing definite article in README https://review.openstack.org/69439 | 14:10 |
SpamapS | slagle: so Heat is landing most of these things now, but with a whole design rather than "just get it done like now" design. | 14:11 |
*** matty_dubs|gone is now known as matty_dubs | 14:11 | |
SpamapS | slagle: and stevebaker has asked for volunteers to help with said features. :-P | 14:11 |
*** dkehn_ has joined #tripleo | 14:13 | |
*** pblaho has quit IRC | 14:14 | |
*** mestery has joined #tripleo | 14:15 | |
marios | SpamapS: weird, i keep getting ERROR: Unknown resource Type : OS::Heat::UpdateWaitConditionHandle from heat template-validate... but i see that this landed in heat and the templates https://review.openstack.org/#/c/63245/ | 14:16 |
SpamapS | marios: perhaps you didn't restart heat-engine after updating it? | 14:20 |
marios | SpamapS: yeah likely some issue. i'm just with devstack right now and i screen -rd and stop/pull/restart heat engine and api | 14:21 |
marios | SpamapS: not a biggie i'll just comment it out for now (main goal is getting multiple computes/block merging correctly, at least to pass validation) | 14:22 |
SpamapS | marios: there is something tricky in that | 14:22 |
SpamapS | marios: also why devstack and not devtest? | 14:22 |
marios | SpamapS: time mainly and prioritization of tasks (no point trying to deploy the thing if heat isn't even validating it) | 14:23 |
marios | SpamapS: next step is getting devtest up again on some lab machine so i can try the deploys | 14:23 |
*** jayg|g0n3 is now known as jayg | 14:27 | |
*** spzala has joined #tripleo | 14:30 | |
*** michchap has joined #tripleo | 14:32 | |
marios | SpamapS: are you giving me the silence of disapproval :D. good news is 2 computes, a controller and 2 block-storage are producing a validatable template https://gist.github.com/anonymous/8668694 | 14:33 |
* marios goes to find a beaker machine | 14:33 | |
marios | rbrady1: how did it go with the 'multi-cinder' approach. did you get it deployed ok? | 14:34 |
*** michchap has quit IRC | 14:36 | |
openstackgerrit | Dougal Matthews proposed a change to openstack/python-tuskarclient: Add bindings for overcloud API entrypoints https://review.openstack.org/69312 | 14:37 |
*** michchap has joined #tripleo | 14:39 | |
SpamapS | marios: yay :) | 14:39 |
SpamapS | marios: I'm giving you the "it is 06:39AM here and children are waking up" silent treatment :) | 14:39 |
rbrady1 | marios: The create-stack is completing. It's slower | 14:39 |
marios | rbrady1: thats awesome | 14:39 |
*** rbrady1 is now known as rbrady | 14:39 | |
marios | rbrady: i finally got a template validating (needs nit in cinder yaml from tht, sending review now) | 14:40 |
marios | rbrady: 2 computes and 2 cinder | 14:40 |
rbrady | marios: thanks | 14:40 |
SpamapS | btw, I'm working out a way to solve our scaling-by-generating-templates problem.. | 14:40 |
*** mestery_ has joined #tripleo | 14:40 | |
rbrady | marios: I pulled down lifeless' patch for scaling out and wanting to try it re: cinder | 14:40 |
SpamapS | I think what we need is for Heat to be able to reference a list, passed in via parameter, for a resource name. | 14:41 |
openstackgerrit | Dougal Matthews proposed a change to openstack/python-tuskarclient: Add bindings for Resource Category API entrypoints https://review.openstack.org/69313 | 14:41 |
SpamapS | so instead of NovaCompute0: you'd have {Ref: NovaComputeList} .. and then you just pass in a list of uuids or names of planets or whatever you want.. and then when you want one gone, you just delete it from said list. | 14:42 |
SpamapS | that way you are just auto-generating _a list_ .. not an entire template. | 14:42 |
*** mestery__ has joined #tripleo | 14:42 | |
marios | SpamapS: is this part of the greater 'lets gets things we need into Heat' ? | 14:42 |
marios | SpamapS: how far off do you see these in play, at least enough for debug? | 14:42 |
SpamapS | marios: yes.. but it is also part of "lets scale things down intelligently" :) | 14:43 |
*** michchap has quit IRC | 14:43 | |
*** meste____ has joined #tripleo | 14:43 | |
SpamapS | marios: I have to focus on rolling-updates .. which may be 2 weeks of dev. Then I can get to this. Or I can guide someone else. It should be a relatively easy feature to complete in Heat as it is entirely in the parsing phase. | 14:43 |
*** mestery has quit IRC | 14:43 | |
SpamapS | anyway.. -> chaos monkies are awake | 14:44 |
marios | SpamapS: haha.good morning | 14:44 |
*** mestery_ has quit IRC | 14:46 | |
*** mestery__ has quit IRC | 14:46 | |
openstackgerrit | Marios Andreou proposed a change to openstack/tripleo-heat-templates: Remove InstanceType and ImageId from cinder template https://review.openstack.org/69618 | 14:49 |
openstackgerrit | Marios Andreou proposed a change to openstack/tripleo-heat-templates: Remove InstanceType and ImageId from cinder template https://review.openstack.org/69618 | 14:50 |
*** jcoufal has quit IRC | 14:53 | |
*** jcoufal has joined #tripleo | 14:54 | |
openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-image-elements: Fixes authentication for cinder https://review.openstack.org/69619 | 14:55 |
*** mrunge has quit IRC | 14:55 | |
*** martyntaylor1 has joined #tripleo | 14:56 | |
*** mestery has joined #tripleo | 14:57 | |
*** martyntaylor has quit IRC | 14:58 | |
*** mestery_ has joined #tripleo | 14:58 | |
*** meste____ has quit IRC | 15:00 | |
*** mestery__ has joined #tripleo | 15:01 | |
*** mestery has quit IRC | 15:02 | |
openstackgerrit | Dougal Matthews proposed a change to openstack/python-tuskarclient: Add bindings for overcloud API entrypoints https://review.openstack.org/69312 | 15:02 |
*** mestery_ has quit IRC | 15:03 | |
openstackgerrit | Dougal Matthews proposed a change to openstack/python-tuskarclient: Add bindings for overcloud API entrypoints https://review.openstack.org/69312 | 15:04 |
*** weshay has joined #tripleo | 15:05 | |
*** mestery has joined #tripleo | 15:05 | |
*** ftcjeff has joined #tripleo | 15:07 | |
openstackgerrit | Dougal Matthews proposed a change to openstack/python-tuskarclient: Add bindings for Resource Category API entrypoints https://review.openstack.org/69313 | 15:08 |
*** mestery__ has quit IRC | 15:09 | |
*** jtomasek has quit IRC | 15:09 | |
*** rwsu has joined #tripleo | 15:12 | |
*** coolsvap has joined #tripleo | 15:16 | |
openstackgerrit | Jiri Stransky proposed a change to openstack/tripleo-incubator: Ensure libvirtd is always configured on Red Hat https://review.openstack.org/69627 | 15:22 |
*** jtomasek has joined #tripleo | 15:25 | |
matty_dubs | Is there a default password for things built with dib? I'm trying to debug a failure. | 15:28 |
Ng | matty_dubs: if the stackuser element was included, it's stack/stack | 15:29 |
Ng | otherwise you're likely going to be sshing in as heat-admin with whatever ssh key was found on the build host | 15:29 |
matty_dubs | Ah-ha! I must have confused this with something else. stack/stack is exactly what I needed. | 15:30 |
matty_dubs | Thanks, Ng! | 15:30 |
*** rbrady is now known as rbrady-brb | 15:34 | |
*** HInfoForIRC has joined #tripleo | 15:37 | |
*** HInfoForIRC has left #tripleo | 15:37 | |
openstackgerrit | Jiri Stransky proposed a change to openstack/tripleo-incubator: Ensure libvirtd is always configured on Red Hat https://review.openstack.org/69627 | 15:38 |
*** mrunge has joined #tripleo | 15:38 | |
*** michchap has joined #tripleo | 15:39 | |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Update tripleo-heat-templates: mention merge tool https://review.openstack.org/69438 | 15:40 |
*** rbrady-brb is now known as rbrady | 15:42 | |
openstackgerrit | A change was merged to openstack/tripleo-incubator: Add in missing definite article in README https://review.openstack.org/69439 | 15:43 |
*** michchap has quit IRC | 15:44 | |
*** lucasagomes is now known as lucas-hungry | 15:44 | |
*** jcoufal has quit IRC | 15:50 | |
*** jcoufal-mobile has joined #tripleo | 15:51 | |
*** jistr has quit IRC | 15:51 | |
*** jtomasek has quit IRC | 15:54 | |
openstackgerrit | James Slagle proposed a change to openstack/diskimage-builder: Add ability to use local cloud image https://review.openstack.org/68133 | 16:02 |
*** jtomasek has joined #tripleo | 16:06 | |
*** boris-42 has quit IRC | 16:07 | |
*** jcooley_ has joined #tripleo | 16:09 | |
openstackgerrit | Ronelle Landy proposed a change to openstack/tripleo-image-elements: Updates permissions on 97-mysql-iptables https://review.openstack.org/69639 | 16:12 |
rlandy | rbrady: ^^ let me know if you object | 16:13 |
*** jcoufal-mobile has quit IRC | 16:15 | |
*** jcoufal-mobile has joined #tripleo | 16:15 | |
matty_dubs | Oh, hi, rlandy! Long time no see! | 16:15 |
rlandy | matty_dubs: hi there. yes - it's been a while | 16:16 |
*** hughsaunders has left #tripleo | 16:17 | |
*** vkozhukalov has quit IRC | 16:19 | |
matty_dubs | So have you folks noticed tests failing, with "ERROR: HTTPConnectionPool(host='192.0.2.1', port=8774): Max retries exceeded with url ..." timing out? | 16:19 |
matty_dubs | I just spent a bit prodding; it looks like it's genuinely just timing out. It takes about 10 minutes (?!) for nova-api to come up. | 16:19 |
rbrady | rlandy: +1 | 16:19 |
*** rdopieralski has quit IRC | 16:21 | |
*** jcoufal has joined #tripleo | 16:23 | |
*** jprovazn has quit IRC | 16:25 | |
*** jcoufal-mobile has quit IRC | 16:26 | |
*** rlandy is now known as rlandy|bbl | 16:28 | |
*** martyntaylor1 has quit IRC | 16:29 | |
*** michchap has joined #tripleo | 16:32 | |
*** michchap has quit IRC | 16:37 | |
*** lucas-hungry is now known as lucasagomes | 16:37 | |
*** martyntaylor has joined #tripleo | 16:38 | |
*** michchap has joined #tripleo | 16:40 | |
*** michchap has quit IRC | 16:45 | |
openstackgerrit | Chris Krelle proposed a change to openstack/tripleo-image-elements: Add nova-ironic element to replace nova-baremetal https://review.openstack.org/66461 | 16:57 |
*** cwolferh has joined #tripleo | 16:59 | |
*** e0ne_ has quit IRC | 17:03 | |
*** matty_dubs is now known as matty_dubs|lunch | 17:03 | |
*** marun has joined #tripleo | 17:03 | |
*** e0ne has joined #tripleo | 17:04 | |
*** marun has quit IRC | 17:05 | |
*** jtomasek has quit IRC | 17:07 | |
*** noslzzp has quit IRC | 17:07 | |
*** boris-42 has joined #tripleo | 17:07 | |
*** marun has joined #tripleo | 17:08 | |
*** e0ne has quit IRC | 17:09 | |
*** noslzzp has joined #tripleo | 17:10 | |
*** mrunge has quit IRC | 17:14 | |
openstackgerrit | Chris Krelle proposed a change to openstack/tripleo-image-elements: Ensure correct tftp directory ownership for Ironic https://review.openstack.org/69013 | 17:18 |
*** ifarkas has quit IRC | 17:19 | |
*** jtomasek has joined #tripleo | 17:22 | |
*** martyntaylor has quit IRC | 17:27 | |
derekh | slagle: not sure what ports I had missing (I've destroyed the vm that wasn't working but) https://review.openstack.org/#/c/67949/4/elements/neutron-ovs-cleanup/os-refresh-config/post-configure.d/81-neutron-ovs-cleanup | 17:40 |
*** michchap has joined #tripleo | 17:41 | |
wendar | greghaynes/StevenK/jamezpolley: would you all be interested in starting a shared etherpad doc of all our notes on "getting started with tripleo"? | 17:41 |
*** michchap has quit IRC | 17:41 | |
*** michchap has joined #tripleo | 17:42 | |
wendar | greghaynes/StevenK/jamezpolley: heading toward something like http://docs.openstack.org/developer/nova/devref/index.html, but just random notes is a great place to start | 17:42 |
*** jtomasek has quit IRC | 17:44 | |
slagle | derekh: hmm, i wonder why i added that | 17:44 |
*** athomas has quit IRC | 17:45 | |
*** michchap has quit IRC | 17:46 | |
derekh | slagle: suppose whats the point in enabling a service without starting it... | 17:46 |
slagle | derekh: well, yea. i suspect i added the line when i was refactoring for adding the os-svc-restart and map-services | 17:47 |
slagle | so i assumed there should have been a restart there | 17:47 |
derekh | yup | 17:47 |
slagle | i'll remove it | 17:48 |
slagle | if it needs to be there, it obviously needs some work, and shouldnt be part of the package patchset anyway | 17:48 |
derekh | sounds good | 17:49 |
dkehn_ | lifeless, so from yesterdays markmcclain conversion I did see anymore after your request for a recommendation, was wondering if that was the end of it | 17:49 |
openstackgerrit | Derek Higgins proposed a change to openstack/tripleo-incubator: Fix seed domain name https://review.openstack.org/69679 | 17:52 |
*** e0ne has joined #tripleo | 17:59 | |
*** matty_dubs|lunch is now known as matty_dubs | 18:05 | |
*** meera has joined #tripleo | 18:05 | |
greghaynes | wendar: Awesome idea | 18:08 |
greghaynes | Definitely interested in doing that | 18:08 |
*** ifarkas has joined #tripleo | 18:11 | |
pleia2 | derekh, dprince - not sure if you saw, but I have started a WIP to start fixing some of the fedora issues we're seeing with it being a nodepool slave https://review.openstack.org/#/c/69510/ | 18:13 |
pleia2 | and left some notes as to TODOs in there | 18:13 |
dprince | pleia2: cool, sounds good | 18:14 |
*** martyntaylor has joined #tripleo | 18:15 | |
*** vkozhukalov has joined #tripleo | 18:22 | |
wendar | greghaynes/StevenK/jamezpolley: https://etherpad.openstack.org/p/tripleo-newdev-notes | 18:25 |
*** rlandy|bbl is now known as rlandy | 18:35 | |
*** martyntaylor has quit IRC | 18:38 | |
*** edmund1 has joined #tripleo | 18:40 | |
*** michchap has joined #tripleo | 18:42 | |
openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Install glance-manage into /usr/local/bin https://review.openstack.org/67956 | 18:45 |
openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to horizon https://review.openstack.org/67952 | 18:45 |
openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to heat https://review.openstack.org/67953 | 18:45 |
openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Install heat-manage into /usr/local/bin https://review.openstack.org/67954 | 18:45 |
openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to glance https://review.openstack.org/67955 | 18:45 |
openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to neutron https://review.openstack.org/67949 | 18:45 |
openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Install keystone-manage into /usr/local/bin https://review.openstack.org/67951 | 18:45 |
openstackgerrit | James Slagle proposed a change to openstack/tripleo-image-elements: Add package install support to keystone https://review.openstack.org/67950 | 18:45 |
matty_dubs | slagle: You've been busy. ;) | 18:45 |
*** jcoufal-mobile has joined #tripleo | 18:47 | |
*** michchap has quit IRC | 18:47 | |
*** e0ne has quit IRC | 18:47 | |
*** sdague has quit IRC | 18:51 | |
*** e0ne has joined #tripleo | 18:55 | |
*** sdague has joined #tripleo | 18:56 | |
*** jistr has joined #tripleo | 19:00 | |
dkehn | we meeting? | 19:00 |
*** shadower_ is now known as shadower | 19:01 | |
*** pblaho has joined #tripleo | 19:02 | |
*** jcoufal-mobile has quit IRC | 19:03 | |
*** panda has joined #tripleo | 19:08 | |
*** panda__ has quit IRC | 19:11 | |
*** max_lobur is now known as max_lobur_afk | 19:17 | |
*** jprovazn has joined #tripleo | 19:18 | |
*** lsmola has joined #tripleo | 19:34 | |
*** pblaho has quit IRC | 19:34 | |
*** rwsu has quit IRC | 19:36 | |
matty_dubs | So can someone elaborate, in more of a for-dummies manner, how the CD cloud is being used right now? Is it actually testing each commit, or is that still WIP? | 19:36 |
*** rwsu has joined #tripleo | 19:40 | |
slagle | the CD cloud is running in a loop updating itself from master | 19:41 |
slagle | that is different from the CI-testenv stuff that is testing each commit before it's merged | 19:41 |
slagle | and that is non-voting right now. e.g., it won't block commits | 19:42 |
slagle | (someone correct me if i'm wrong) | 19:42 |
jamezpolley | wendar: thanks | 19:42 |
matty_dubs | Ah, so it's testing commits after they're merged? | 19:42 |
*** michchap has joined #tripleo | 19:43 | |
matty_dubs | I had been out of the loop on it so today's update left me still in the dark. | 19:43 |
*** michchap has quit IRC | 19:43 | |
*** michchap has joined #tripleo | 19:43 | |
*** lsmola has quit IRC | 19:44 | |
slagle | matty_dubs: right, the CD cloud is deploying directly from master | 19:45 |
slagle | it finds bugs that have already been merged :) | 19:45 |
*** michchap has quit IRC | 19:49 | |
openstackgerrit | James Slagle proposed a change to openstack/tripleo-incubator: Use relative path for keystone-manage https://review.openstack.org/69709 | 19:51 |
SpamapS | actually said loop still seems stuck.. hmm | 19:52 |
SpamapS | ahh, it was that pull-tools bug.. hah | 19:54 |
SpamapS | pull-tools was preventing itself from updating | 19:54 |
SpamapS | wow I think git might be broken actually | 19:54 |
SpamapS | it is testing if _stdout_ is a terminal | 19:54 |
SpamapS | it should only be testing stdin | 19:54 |
SpamapS | no use using a pager if stdin is /dev/null | 19:55 |
lifeless | sorry y'all being away @ 2am -> beeing asleep @ 8am | 19:57 |
SpamapS | lifeless: np, we managed to assign all work items and git blame history to you in the meeting so its all good | 19:59 |
lifeless | great | 20:00 |
lifeless | matty_dubs: I wouldn't say cd-overcloud 'tests after merges' but more we get to use what was merged | 20:00 |
lifeless | matty_dubs: and if we don't check hard enough, what we want to use is broken | 20:01 |
Ng | lifeless: FYI the broken-fans machine is back in rotation | 20:01 |
Ng | they ended up replacing the motherboard | 20:01 |
*** jcoufal has quit IRC | 20:01 | |
lifeless | Ng: nice | 20:01 |
lifeless | Ng: have you updated all ze metadata in nova-bm + machine-info-tab etc etc | 20:02 |
lifeless | Ng: (I really shouldn't have asked that..!) | 20:02 |
matty_dubs | lifeless: Ah, that makes sense. So it should be a good way to catch integration issues, etc. | 20:02 |
lifeless | matty_dubs: so any tripleo ATC can get a user account on cd-overcloud | 20:02 |
lifeless | matty_dubs: help tell us whats good and whats bust | 20:02 |
Ng | lifeless: I have. They kept the same iLO config afaics, so all that changed was the eth MACs in bm_interfaces/m-i-t and I reset the service_host to undercloud | 20:03 |
lifeless | Ng: cool | 20:03 |
lifeless | Ng: I shall learn not to ask :) | 20:03 |
*** jistr has quit IRC | 20:03 | |
Ng | lifeless: defence in depth, keep asking :) | 20:03 |
lifeless | dkehn: I didn't see anything more either | 20:03 |
lifeless | Ng: hah! ok | 20:03 |
*** vkozhukalov has quit IRC | 20:03 | |
Ng | lifeless: also, I went through and audited all the iLO serials and we have a complete set now, which was the pre-requisite for writing a "how to file a DC/Sys/Net ticket to get stuff fixed" guide, so I'll likely do that tomorrow | 20:04 |
*** lucasagomes has quit IRC | 20:04 | |
Ng | some of the DC folk know what "freecloud" means, but none of the Sys/Net folk do, which is fair enough I guess ;0 | 20:04 |
Ng | but everyone seems to understand the serials | 20:04 |
lifeless | Ng: FANTASTIC | 20:05 |
*** bashok has joined #tripleo | 20:05 | |
*** bashok has left #tripleo | 20:06 | |
lifeless | dprince: hey so you disappeared yesterday, I was hoping to spend some quality high bw time discussing the dhcp-all-interfaces thing | 20:09 |
lifeless | dprince: we have the immediate bug | 20:09 |
lifeless | dprince: but we also have had issues contacting metadata servers during reboot, and I think thats tied in | 20:09 |
lifeless | dprince: (because of br-ctlplane | 20:09 |
dprince | yes. lets talk | 20:10 |
dprince | wrapping up on a phone call now.... | 20:10 |
lifeless | ok, take your time, I'll grab breakfast and make myself presentable | 20:10 |
lifeless | SpamapS: what did you think of my hypervisor scaling set ? | 20:11 |
lifeless | mmmm my dashboard is getting a little long | 20:11 |
lifeless | https://review.openstack.org/#/dashboard/4190 | 20:11 |
lifeless | slagle: ah, so it was 80 but @ 30G / node that should have been 90.... we really shouldn't specify the numbers separately | 20:13 |
SpamapS | lifeless: I am apalled that you would continue the farce of merge.py :( | 20:13 |
SpamapS | lifeless: but I understand. ;) | 20:13 |
slagle | lifeless: yea, i think it was wrong before your change to begin with | 20:13 |
*** rlandy has quit IRC | 20:13 | |
lifeless | slagle: so, I don't think disk will ever be a dominating factor - I'm inclined to ignore and fix the root cause when we have some itch scratching time | 20:13 |
lifeless | slagle: what do you think? | 20:13 |
lifeless | 100G / 1500G = 15, 5 / 24 = 4.mumble | 20:14 |
lifeless | slagle: OTOH it is easy enough to edit | 20:14 |
dprince | lifeless: I'm back | 20:15 |
slagle | the disks are sparsely allocated right, so yea, it's not likely to matter | 20:16 |
dprince | lifeless: I think https://bugs.launchpad.net/tripleo/+bug/1272969 and https://bugs.launchpad.net/tripleo/+bug/1272803 are related to the same root issue | 20:16 |
slagle | i think the fact that something is specified there is what is confusing | 20:16 |
slagle | but yea, it's likely good enough as-is | 20:16 |
openstackgerrit | Ana Krivokapic proposed a change to openstack/tuskar-ui: WIP: Add node detail view https://review.openstack.org/69462 | 20:24 |
dprince | lifeless: ping me when you are back... | 20:24 |
slagle | does anyone know what the plan for /mnt/state is in regard to the openstack config files like /etc/nova/nova.conf? | 20:28 |
slagle | will they eventually be moved to /mnt/state? | 20:28 |
slagle | trying to understand how this might impact systemd service files from the package installs, which are using /etc/... | 20:28 |
dprince | lifeless: re the DHCP issue. I added a comment block to the ticket here: https://bugs.launchpad.net/tripleo/+bug/1272969. ping me when you are back | 20:29 |
lifeless | dprince: just nomming, back v soon | 20:30 |
lifeless | slagle: /var/run perhaps | 20:30 |
lifeless | dprince: IRC/hngouts/? | 20:30 |
slagle | hmm, ok. wonder if we could symlink from /etc/foo to /var/run/foo during install.d. probably | 20:32 |
lifeless | slagle: whatever path we choose I am of the opinion that leaving symlinks behind obfuscates the design | 20:33 |
lifeless | slagle: so I propose we make the system/upstart job definitions point directly at the place we write configs too | 20:34 |
*** e0ne has quit IRC | 20:34 | |
lifeless | s/oo/o/ | 20:34 |
dprince | lifeless: either is fine w/ me | 20:34 |
dprince | lifeless: if you want to hangout lets do it now | 20:34 |
slagle | yea, just trying to figure out how that will play nicely with the systemd files that are packaged | 20:34 |
slagle | for the installs from source, it's fine, since we write the systemd files | 20:35 |
* dprince warns lifeless that if he does a hangout other agenda items are likely to come up as well | 20:35 | |
lifeless | delete the packaged one then write the systemd files? | 20:35 |
lifeless | dprince: fine with me | 20:35 |
dprince | slagle: re the systemd files I mentioned this on the list and go no reply | 20:36 |
dprince | slagle: it would be very nice to use the packaged versions... but there are some cases where things don't line up | 20:36 |
dprince | slagle: are you hitting issues there? | 20:36 |
*** panda_ has joined #tripleo | 20:36 | |
slagle | not yet; b/c os-apply-config is still writing them under /etc | 20:36 |
lifeless | anyone else want in on this hangout action? | 20:37 |
dprince | slagle: well, let me know how it goes when you do try them :) | 20:37 |
lifeless | ng? kids asleep, want some dhcp-all-interfaces design time? | 20:37 |
dprince | slagle: many of my concerns were just suspicious... I didn't actually try them | 20:37 |
slagle | dprince: i see your reply now. | 20:38 |
slagle | using the packaged systemd files actually appears to be working fine | 20:38 |
*** akrivoka has quit IRC | 20:38 | |
dprince | lifeless: lets go, we can add whoever in if people jump in | 20:38 |
* dprince only has 20-30 minutes anyway | 20:39 | |
slagle | it shouldn't be an issue until the config is moved out from under /etc, which are service files expect | 20:39 |
slagle | s/are/our | 20:39 |
lifeless | dprince: roger | 20:39 |
Ng | lifeless: I'm already moonlighting on Rike time by having IRC open, so I'd best regretfully decline ;( | 20:39 |
ccrouch | slagle: and that move hasn't been done yet, because that config isn't "precious state" ? | 20:39 |
lifeless | Ng: https://etherpad.openstack.org/p/tripleo-dhcp-all-interfaces-iteration-2 | 20:40 |
*** panda has quit IRC | 20:40 | |
openstackgerrit | Jan Provaznik proposed a change to openstack/tripleo-image-elements: Fix exit status of haproxy install script https://review.openstack.org/69716 | 20:40 |
ccrouch | reading back | 20:40 |
slagle | ccrouch: right, it doesn't need to be saved to /mnt/state b/c os-apply-config will just reapply it on reboot | 20:41 |
*** cd-undercloud has joined #tripleo | 20:41 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 20:41 |
*** cd-undercloud has quit IRC | 20:41 | |
lifeless | \o/ | 20:41 |
*** michchap has joined #tripleo | 20:43 | |
*** michchap has quit IRC | 20:44 | |
ccrouch | slagle: so as long root filesystem is NOT read-only (i.e. o-a-c can do its thing) everything should work fine | 20:44 |
*** michchap has joined #tripleo | 20:44 | |
slagle | yes, oac still writes to /etc as of now | 20:44 |
ccrouch | lifeless: is "oac still writes to /etc as of now" something that was missed for MVP3, something targetted for MVP4, some future area for optimization or something else? | 20:46 |
*** michchap has quit IRC | 20:48 | |
*** markmc has quit IRC | 20:54 | |
*** e0ne has joined #tripleo | 20:55 | |
*** UtahDave has joined #tripleo | 20:56 | |
lifeless | ccrouch: future IMO | 21:02 |
openstackgerrit | Ryan Brady proposed a change to openstack/tripleo-image-elements: Fixes authentication for cinder https://review.openstack.org/69619 | 21:06 |
ccrouch | as long as " getting oac to use /mnt/state" is not going to block anything else, i think we're fine | 21:07 |
ccrouch | i.e. "future" would have to be after we've figured out how config files in /mnt/state play nicely with the packaged service files | 21:07 |
ccrouch | lifeless: ^ | 21:07 |
*** UtahDave has quit IRC | 21:10 | |
SpamapS | ccrouch: IMO that is my argument against bothering with packages. | 21:13 |
SpamapS | ccrouch: they are so different from what we're trying to achieve that you end up with none of the benefits. | 21:13 |
*** NewInformator has joined #tripleo | 21:14 | |
*** NewInformator has left #tripleo | 21:14 | |
*** noslzzp has quit IRC | 21:16 | |
ccrouch | SpamapS: choice of the format of the code we distribute is above my paygrade I'm afraid :-) | 21:18 |
ccrouch | we are trying to see what the best way is to combine the approaches in play in triple along with some "fixed choices", one of which is the use of packages. | 21:19 |
*** e0ne has quit IRC | 21:20 | |
SpamapS | yeah, totally get it.. totally think it is lol | 21:20 |
SpamapS | as in ludicrously, overtly, laughable :) | 21:20 |
SpamapS | ccrouch: anyway, you'll just have to patch the unit files to call with --config-dir /mnt/state/etc/nova ... _or_ we have to maintain a whole mess of symlinks | 21:21 |
SpamapS | ccrouch: I prefer the former, because it is more discoverable and obvious | 21:22 |
openstackgerrit | Jay Dobies proposed a change to openstack/tuskar: API controllers for icehouse domain model https://review.openstack.org/68716 | 21:23 |
lifeless | SpamapS: or /var/run/nova/etc/ ? | 21:23 |
ccrouch | maintaining patch sets is probably the worst of two bad options from our side. Hopefully there will be some more palatable alternatives if the "future" ever comes | 21:24 |
*** dprince has quit IRC | 21:25 | |
SpamapS | lifeless: yeah /var/run would be fine too. | 21:27 |
SpamapS | we also have to figure out how to make systemd write to "not /etc" too | 21:28 |
*** cd-undercloud has joined #tripleo | 21:28 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 21:28 |
*** cd-undercloud has quit IRC | 21:28 | |
*** markmcclain has joined #tripleo | 21:32 | |
*** cody-somerville has quit IRC | 21:33 | |
dkehn | lifeless: u around | 21:33 |
dkehn | markmcclain: hi | 21:33 |
lifeless | dkehn: I'm just stepping out for a bit, back soon | 21:34 |
markmcclain | dkehn: hi | 21:34 |
dkehn | markmcclain: yesterday we were talking about HA route and control plane you had mentioned the https://review.openstack.org/#/c/64553/ | 21:34 |
dkehn | but that it might not be there yet | 21:35 |
dkehn | markmcclain: wondering about any recommendations you might have | 21:35 |
*** coolsvap has quit IRC | 21:35 | |
markmcclain | 64553 is probably the most promising | 21:36 |
markmcclain | I'm also certain that sylvain would be happy to get more testing | 21:36 |
dkehn | markmcclain: so basically that would be the best approach in your opinion, start there and go throough it with ouor env, and when we bump into something fix it | 21:38 |
openstackgerrit | Tzu-Mainn Chen proposed a change to openstack/tuskar-ui: Combined Instance and Node objects into Node https://review.openstack.org/69724 | 21:39 |
pleia2 | lifeless: woo, new error: OverLimit: Quota exceeded for cores: Requested 4, but already used 28 of 28 cores (HTTP 413) | 21:40 |
SpamapS | ccrouch: with RPM is there a way for one package to "take over" a file from another package? In dpkg we have dpkg-divert .. that allows you to have a package which basically represents an alternate universe for a package.. so you guys could have openstack-nova-tripleo packages which just have different systemd unit files... | 21:40 |
ccrouch | SpamapS: thats an interesting idea | 21:42 |
openstackgerrit | Tzu-Mainn Chen proposed a change to openstack/tuskar-ui: Combined Instance and Node objects into Node https://review.openstack.org/69724 | 21:42 |
*** michchap has joined #tripleo | 21:44 | |
bnemec | SpamapS: ccrouch: I think slagle was looking into the possibility of having separate systemd files for tripleo because of naming differences. Might solve this problem too. | 21:44 |
*** michchap has quit IRC | 21:44 | |
*** michchap has joined #tripleo | 21:45 | |
slagle | yea, we could package some systemd service files. but given the existing packages already provide those files, we'd have to install with --replacefiles | 21:46 |
slagle | which is generally frowned upon | 21:46 |
slagle | still, hardly the end of the world | 21:46 |
SpamapS | slagle: yeah thats not what you want | 21:46 |
SpamapS | I'm a bit surprised RPM doesn't let you express it in packaging. | 21:47 |
lifeless | pleia2: you haven't updated your creds properly, thats still on the infra-nodepool account | 21:47 |
ccrouch | yeah that sounds roughly like maintaing our own patches to the unit files | 21:47 |
SpamapS | slagle: what about splitting the unit files into their own package, like openstack-nova-systemd, and then making the openstack-nova-systemd-tripleo package provide openstack-nova-systemd ? | 21:48 |
lifeless | markmcclain: so the question is ; do we start using that patch ahead of trunk / does neutron land that patch now so that we can use trunk and provide feedback / should we use pacemaker per the openstack HA manual ? | 21:48 |
lifeless | markmcclain: we're looking for a recommendation from you | 21:48 |
slagle | SpamapS: yea that would work | 21:49 |
*** michchap has quit IRC | 21:49 | |
slagle | we'd still be maintaining our own though | 21:49 |
dkehn | markmcclain: ^^^ | 21:49 |
*** shakayumi has joined #tripleo | 21:49 | |
slagle | we need like an install time macro or something | 21:50 |
markmcclain | lifeless: might have to carry it outside of our tree for a bit | 21:50 |
lifeless | markmcclain: so which is your recommendation - run the out of tree patchset, or pacemaker ? | 21:51 |
markmcclain | I'd look at running the out of tree | 21:52 |
*** ifarkas has quit IRC | 21:52 | |
*** jprovazn has quit IRC | 21:52 | |
lifeless | ok | 21:52 |
lifeless | markmcclain: sylvain is the person to chat with yeah? | 21:53 |
markmcclain | yes.. he is heading it up | 21:54 |
lifeless | markmcclain: whats his irc nick? | 21:54 |
markmcclain | he's UTC+1 | 21:54 |
markmcclain | safchain | 21:54 |
lifeless | cool | 21:54 |
dkehn | yepper | 21:55 |
lifeless | dkehn: can you have a chat to hi and see how he feels - if we run it we'll be looking for some degree of don't-break-us (e.g. database migrations shouldn't change ) | 21:55 |
dkehn | lifeless: yepper, on it | 21:56 |
lifeless | dkehn: plus we (tripleo) will need to figure out a nice way to express 'and run with this patchset', we've got most of the plumbing for that I think, but we will need to override zuul in check | 21:56 |
*** rollerj has joined #tripleo | 21:56 | |
dkehn | lifeless: k | 21:56 |
lifeless | dkehn: but that can wait for an ack from him that he's ready for users | 21:56 |
lifeless | early adopters | 21:56 |
lifeless | SpamapS: slagle: So, I'd like to get the 2 hypervisor thing fully landed today; can we do that ? | 21:57 |
slagle | lifeless: sure, if you're not worried about the disk space, i'm fine to +2 | 21:58 |
SpamapS | lifeless: I'll start reviewing shortly. | 21:58 |
lifeless | slagle: I'm not - thanks! | 21:58 |
openstackgerrit | A change was merged to openstack-infra/tripleo-ci: Build test environments for 2 hypervisors. https://review.openstack.org/69550 | 21:59 |
*** lblanchard has quit IRC | 22:13 | |
*** cd-undercloud has joined #tripleo | 22:14 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 22:14 |
*** cd-undercloud has quit IRC | 22:14 | |
openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Permit writing output to other than stdout. https://review.openstack.org/69545 | 22:17 |
*** jcoufal has joined #tripleo | 22:19 | |
*** jcoufal has quit IRC | 22:28 | |
ccrouch | lifeless: i think we briefly discussed last week the fact that neutron is setup in the heat templates to use openvswitch with GRE in the overcloud. | 22:30 |
ccrouch | if we could get it to work, would there be any objection to switching that to openvswitch + vxlan? | 22:30 |
ccrouch | or does using vxlan require parameterizing the template and allowing people to pick either GRE or vxlan? | 22:30 |
*** e0ne has joined #tripleo | 22:31 | |
*** jdob has quit IRC | 22:33 | |
*** e0ne has quit IRC | 22:36 | |
*** CaptTofu has quit IRC | 22:41 | |
*** CaptTofu has joined #tripleo | 22:41 | |
*** epim has joined #tripleo | 22:44 | |
*** epim has quit IRC | 22:44 | |
*** michchap has joined #tripleo | 22:45 | |
*** michchap has quit IRC | 22:45 | |
lifeless | ccrouch: hi so | 22:45 |
lifeless | ccrouch: vxlan would be a nice feature; I haven't read enough up about it to have an opinion about whether to change to it or support both | 22:45 |
*** michchap has joined #tripleo | 22:46 | |
*** CaptTofu has quit IRC | 22:46 | |
lifeless | SpamapS: slagle: open reviews for this list: https://review.openstack.org/#/c/69549/ | 22:50 |
*** michchap has quit IRC | 22:50 | |
lifeless | https://review.openstack.org/#/c/69548/ | 22:50 |
ccrouch | someone elsewhere mentioned a preference for vxlan, so we would have to could come up with enough reasons why it was better than GRE | 22:51 |
ccrouch | i'm just wary of the extra work to support both GRE and vxlan. | 22:51 |
lifeless | https://review.openstack.org/#/c/69547/ | 22:51 |
lifeless | https://review.openstack.org/#/c/69546/ | 22:51 |
ccrouch | i mean support either, via configuration | 22:51 |
lifeless | https://review.openstack.org/#/c/69286/ | 22:51 |
ccrouch | though i can see having that as a goal | 22:52 |
lifeless | ccrouch: I think it's certainly a goal | 22:56 |
lifeless | because if we could only deploy one network layer, it would be a uge chilling effect foro other network vendors | 22:56 |
lifeless | man, latency breaks my typing. gnarh | 22:56 |
*** jayg is now known as jayg|g0n3 | 22:59 | |
*** cd-undercloud has joined #tripleo | 23:00 | |
cd-undercloud | ************** overcloud complete status=0 ************ | 23:00 |
*** cd-undercloud has quit IRC | 23:00 | |
ccrouch | agreed. I guess we would have to see if we could make a good enough argument to have vxlan be the default. That would be a first step. | 23:00 |
ccrouch | then the next step would be letting you configure either. | 23:00 |
lifeless | well | 23:01 |
lifeless | we have gre working | 23:01 |
lifeless | so I think the first step is to add vxlan as an option | 23:01 |
openstackgerrit | A change was merged to openstack/tripleo-heat-templates: Make debugging merge.py in the test suite possible. https://review.openstack.org/69546 | 23:01 |
lifeless | then we can armwrestle over defaults | 23:01 |
*** rollerj has quit IRC | 23:01 | |
*** openstack has joined #tripleo | 23:04 | |
greghaynes | To get os-collect-config --force --one to complete on my overcloud I had to add a killfilter to neutrons rootwrap.d/l3.filters so it could kill the l3 agent.. seems odd others havent run into that? | 23:11 |
*** matty_dubs is now known as matty_dubs|gone | 23:13 | |
greghaynes | lifeless: tips on somewhere I might be able to help with new mvp? I was looking at the HA metadata API bit but not sure if its too early to poke away at | 23:13 |
SpamapS | greghaynes: regarding your o-c-c neutron fail.. can you file a bug report with the errors you saw? I don't want us to forget about it. | 23:14 |
greghaynes | on it | 23:15 |
lifeless | greghaynes: hey cool | 23:15 |
lifeless | greghaynes: I have run into that killfilter thing | 23:15 |
lifeless | greghaynes: just looking for where I jnonoted it | 23:17 |
SpamapS | lifeless: while looking for a bugtracker to report git being stupid about pagers I found this: http://www.bugseverywhere.org/ ... ever seen that? "Distributed bug tracker" | 23:18 |
lifeless | yup | 23:18 |
lifeless | seen it | 23:18 |
*** bauzas has quit IRC | 23:19 | |
lifeless | disagree with the complecting with the code base being tracked | 23:19 |
*** hewbrocca has quit IRC | 23:21 | |
SpamapS | lifeless: yeah code bases aren't necessarily 1:1 with applications | 23:21 |
lifeless | nor bugs with point in time of code | 23:22 |
*** cwolferh has quit IRC | 23:22 | |
lifeless | greghaynes: ok, I thought i twas a thing I'd see a ways back, but its new | 23:22 |
lifeless | greghaynes: so first thing I'd do is fix that upstream ;) | 23:23 |
greghaynes | https://bugs.launchpad.net/tripleo/+bug/1273882 | 23:23 |
lifeless | greghaynes: then, look at https://trello.com/b/0jIoMrdo/tripleo and pick a card, put your name on it (not to 'claim it but to say you are pushing on that) and push. | 23:23 |
lifeless | if folk are already pushing on it, talk with them to coordinate | 23:23 |
greghaynes | sweet :) | 23:23 |
lifeless | greghaynes: for https://bugs.launchpad.net/tripleo/+bug/1273882I'd add a neutron task, cause it's a neutron bug | 23:24 |
greghaynes | I assume that means 'also affects project' | 23:26 |
lifeless | yes | 23:26 |
*** julim has quit IRC | 23:27 | |
*** noslzzp has joined #tripleo | 23:27 | |
lifeless | SpamapS: what parameter changes ? | 23:29 |
*** shakayumi has quit IRC | 23:31 | |
*** michchap has joined #tripleo | 23:33 | |
lifeless | slagle: hey, can I ask a favour ? | 23:41 |
lifeless | slagle: https://review.openstack.org/#/c/67343/9 needs a systemd unit added apparently - could you add one and push it up? | 23:41 |
StevenK | SpamapS: http://paste.openstack.org/show/62052 | 23:42 |
*** cwolferh has joined #tripleo | 23:42 | |
*** cd-undercloud has joined #tripleo | 23:51 | |
cd-undercloud | ************** overcloud complete status=1 ************ | 23:51 |
*** cd-undercloud has quit IRC | 23:51 | |
lifeless | oooh | 23:53 |
lifeless | Waiting for the overcloud stack to be ready | 23:54 |
lifeless | /root/.ssh/known_hosts updated. | 23:54 |
lifeless | Original contents retained as /root/.ssh/known_hosts.old | 23:54 |
lifeless | Timing out - last probe output: | 23:54 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!