*** jtran has quit IRC | 00:01 | |
*** edygarcia has joined #openstack-dev | 00:11 | |
*** dani4571 has quit IRC | 00:14 | |
*** mrodden has quit IRC | 00:15 | |
*** Dr_Who has quit IRC | 00:17 | |
*** kobier has quit IRC | 00:19 | |
*** annashen has quit IRC | 00:20 | |
*** jcmartin has joined #openstack-dev | 00:26 | |
*** datsun180b has quit IRC | 00:29 | |
*** imsplitbit has quit IRC | 00:29 | |
*** kgriffs has quit IRC | 00:30 | |
*** dims has quit IRC | 00:30 | |
*** edygarcia has quit IRC | 00:32 | |
*** andrewbogott_afk is now known as andrewbogott | 00:34 | |
*** roge has joined #openstack-dev | 00:36 | |
*** markwash has quit IRC | 00:37 | |
*** metral_ has joined #openstack-dev | 00:39 | |
*** gyee has quit IRC | 00:41 | |
*** littleidea has quit IRC | 00:42 | |
*** metral has quit IRC | 00:43 | |
*** metral_ is now known as metral | 00:43 | |
*** littleidea has joined #openstack-dev | 00:43 | |
*** dims has joined #openstack-dev | 00:43 | |
*** metral_ has joined #openstack-dev | 00:45 | |
*** annashen has joined #openstack-dev | 00:49 | |
*** metral has quit IRC | 00:49 | |
*** metral_ is now known as metral | 00:49 | |
*** arata has quit IRC | 00:51 | |
*** kbringard has quit IRC | 00:52 | |
*** annashen has quit IRC | 00:54 | |
*** jcooley has quit IRC | 00:56 | |
devananda | russellb: if you're around, could I get you to +2 again? :) | 00:57 |
---|---|---|
*** jcmartin has quit IRC | 00:59 | |
*** thingee has quit IRC | 01:00 | |
*** jcooley has joined #openstack-dev | 01:01 | |
*** epim has quit IRC | 01:03 | |
*** pixelbeat has quit IRC | 01:04 | |
*** anniec72 has joined #openstack-dev | 01:04 | |
*** networkstatic_ has joined #openstack-dev | 01:04 | |
*** jakedahn is now known as jakedahn_zz | 01:07 | |
russellb | devananda: thought i did? | 01:07 |
russellb | or did you have to updated again? | 01:07 |
*** networkstatic has quit IRC | 01:07 | |
*** networkstatic_ is now known as networkstatic | 01:07 | |
*** anniec72 has left #openstack-dev | 01:07 | |
russellb | devananda: nm, i see what happened, and looks like vish and markmc got it already | 01:11 |
*** Mandell_ has quit IRC | 01:12 | |
*** steveleon has quit IRC | 01:13 | |
*** hemna has quit IRC | 01:14 | |
*** danwent has quit IRC | 01:15 | |
*** danwent has joined #openstack-dev | 01:15 | |
*** arata has joined #openstack-dev | 01:16 | |
*** jcooley has quit IRC | 01:19 | |
*** binarysemaphore has joined #openstack-dev | 01:20 | |
*** roge has quit IRC | 01:20 | |
*** kbringard has joined #openstack-dev | 01:22 | |
*** thingee has joined #openstack-dev | 01:23 | |
*** winston-d has quit IRC | 01:24 | |
devananda | ah, so they did :) | 01:25 |
russellb | yay | 01:26 |
*** thingee_zz has joined #openstack-dev | 01:29 | |
*** thingee has quit IRC | 01:29 | |
*** kbringard has quit IRC | 01:29 | |
*** esp2 has left #openstack-dev | 01:36 | |
*** littleidea has quit IRC | 01:40 | |
*** jcooley has joined #openstack-dev | 01:40 | |
*** jcooley has quit IRC | 01:41 | |
*** jcooley has joined #openstack-dev | 01:41 | |
arata | devananda: I've upload the patch again for unittest | 01:41 |
*** jcooley has quit IRC | 01:44 | |
*** s0mik has quit IRC | 01:44 | |
*** juice has quit IRC | 01:49 | |
*** ewindisch_ has joined #openstack-dev | 02:01 | |
*** littleidea has joined #openstack-dev | 02:02 | |
*** ewindisch has quit IRC | 02:04 | |
*** ewindisch_ is now known as ewindisch | 02:04 | |
*** markmc has quit IRC | 02:06 | |
*** andrewbogott is now known as andrewbogott_afk | 02:07 | |
*** m4xmr has joined #openstack-dev | 02:07 | |
*** andrewbogott_afk is now known as andrewbogott | 02:08 | |
*** reed has joined #openstack-dev | 02:08 | |
*** e1mer has joined #openstack-dev | 02:08 | |
*** adjohn has quit IRC | 02:08 | |
*** m4xmr has quit IRC | 02:11 | |
*** nati_ueno has left #openstack-dev | 02:12 | |
*** spiffxp has quit IRC | 02:12 | |
*** yidclare has quit IRC | 02:13 | |
*** ewindisch has quit IRC | 02:14 | |
*** riskable has joined #openstack-dev | 02:15 | |
riskable | Can anyone tell me how to connect to the serial console on my KVM instances using the OpenStack API/tools? I'm at a loss... Googling and googling but coming up empty | 02:16 |
riskable | I wrote a plugin of sorts for OpenStack that adds an 'SSH' tab to the instance detail dashboard. That works fine (autoconnects for you but you still have to tell it the port and give a username/password). Now I'd like to make it to work with the serial console--if the hypervisor in question suppots it | 02:17 |
russellb | you can get the console output | 02:17 |
russellb | to interact with it you can use the VNC console | 02:18 |
russellb | that's it IIRC | 02:18 |
riskable | There's got to be a way to attach to the serial console | 02:20 |
riskable | I don't want VNC. With VNC I can't copy & paste and it is all blurry | 02:20 |
riskable | Limited to 640x480 too. IT sucks | 02:21 |
*** nunosantos has quit IRC | 02:21 | |
*** jcooley has joined #openstack-dev | 02:22 | |
*** roadTripper has quit IRC | 02:23 | |
*** ewindisch has joined #openstack-dev | 02:24 | |
*** kbringard has joined #openstack-dev | 02:27 | |
*** littleidea has quit IRC | 02:28 | |
*** kbringard has quit IRC | 02:30 | |
devananda | jog0: re your last comment, i linked to a bp in the Topic | 02:31 |
devananda | jog0: am happy to not do that if links in commit is better, though | 02:31 |
jog0 | devananda: ahh, that is good but its also nice to have it in the commit msg as well | 02:31 |
devananda | k | 02:32 |
jog0 | because once its merged you can't look at the topic | 02:32 |
devananda | ahhh, right | 02:32 |
*** littleidea has joined #openstack-dev | 02:34 | |
*** jcooley has quit IRC | 02:38 | |
riskable | How do I send a keystroke to a running instance? I could've sworn I saw somewhere there was a command or API to do that | 02:38 |
openstackgerrit | A change was merged to openstack/keystone: Use the right subprocess based on os monkeypatch https://review.openstack.org/15791 | 02:38 |
*** nati_ueno_2 has quit IRC | 02:39 | |
jog0 | devananda: just sent the logs I have been taking about to your gmail account | 02:43 |
*** zbitter has joined #openstack-dev | 02:48 | |
riskable | This is annoying... I can send keystrokes to the instance but they go to the VNC console and not the serial console | 02:51 |
riskable | If I could send keystrokes to the serial console I could just multiplex the output of the console.log while simultaneously sending it keystrokes | 02:52 |
*** zaneb has quit IRC | 02:52 | |
*** adjohn has joined #openstack-dev | 02:53 | |
devananda | jog0: thanks. taking a look.... | 02:53 |
*** melwitt has quit IRC | 02:53 | |
*** dims has quit IRC | 02:54 | |
jog0 | devananda: let me know if you have any questions, although I am going AFK in a few minutes | 02:54 |
devananda | jog0: so longest query was 113ms. total query execution time 11s. | 03:00 |
devananda | jog0: i'd want to reproduce this over a network and tcpdump the traffic to get a clearer picture, honestly. | 03:01 |
jog0 | 11 seconds? over the time to do the scheduling I counted <2 seconds | 03:01 |
*** danwent has quit IRC | 03:02 | |
jog0 | devananda: lets talk next week, that may be possible | 03:02 |
devananda | jog0: cool. i should be around most of the week | 03:02 |
devananda | as an aside, SELECT 1 and ROLLBACK account for 12% of total query time. | 03:03 |
devananda | which is why i keep pushing to remove those ;) | 03:04 |
openstackgerrit | A change was merged to openstack/keystone: Rewrite initial migration https://review.openstack.org/15724 | 03:04 |
openstackgerrit | A change was merged to openstack/python-keystoneclient: Make initial structural changes to keystoneclient in preparation to moving auth_token here from keystone. No functional change should occur from this commit (even though it did refresh a newer copy of openstack.common.setup.py, none of the newer updates https://review.openstack.org/15698 | 03:04 |
jog0 | wow, when I looked at the logs in 20 second period (cast to compute) 3563 DB Calls were made in 1.77971 seconds according to mysql-slow.log | 03:05 |
jog0 | and thats the part I don't know how to interpret | 03:06 |
devananda | i'm not sure where you're quoting that from | 03:06 |
*** dims has joined #openstack-dev | 03:06 | |
jog0 | I will have to review how I derived my notes. But thats what I wrote down | 03:08 |
*** salv-orlando has quit IRC | 03:08 | |
jog0 | I correlated the timestamps in the nova-api and nova-scheduler logs to the mysql-slow log and broke down how many c DB calls happened when | 03:09 |
devananda | ah. maybe i need to trim the log file before digesting it? | 03:09 |
jog0 | devananda: yeah thats what I did. I gave you the raw data | 03:09 |
devananda | or not: Time range: 2012-10-11 21:48:09 to 21:53:24 | 03:09 |
devananda | hm, k | 03:10 |
devananda | will look at the other logs | 03:10 |
jog0 | the scheduling was from 21:48:08 to 21:48:32 | 03:10 |
devananda | k | 03:10 |
jog0 | anyway I think its time to call it a night. have a good weekend | 03:10 |
*** jog0 has quit IRC | 03:11 | |
devananda | g'night | 03:12 |
*** littleidea has quit IRC | 03:17 | |
*** arata has quit IRC | 03:18 | |
*** adjohn has quit IRC | 03:19 | |
*** littleidea has joined #openstack-dev | 03:21 | |
*** brucer has joined #openstack-dev | 03:23 | |
*** novas0x2a|laptop has quit IRC | 03:24 | |
*** riskable has quit IRC | 03:30 | |
*** sunilthaha has quit IRC | 03:33 | |
*** e1mer has quit IRC | 03:33 | |
*** PaulM has quit IRC | 03:33 | |
*** darjeeling has quit IRC | 03:36 | |
*** maurosr has quit IRC | 03:40 | |
*** ewindisch has quit IRC | 03:44 | |
*** sunilthaha has joined #openstack-dev | 03:46 | |
*** sunilthaha has quit IRC | 03:52 | |
openstackgerrit | A change was merged to openstack/nova: Get rid of pylint E0203 in filter_scheduler.py https://review.openstack.org/15805 | 03:59 |
*** e1mer has joined #openstack-dev | 04:00 | |
*** sunilthaha has joined #openstack-dev | 04:05 | |
*** sunilthaha has quit IRC | 04:12 | |
*** roge has joined #openstack-dev | 04:18 | |
*** jcooley has joined #openstack-dev | 04:23 | |
*** jakedahn_zz is now known as jakedahn | 04:25 | |
*** sunilthaha has joined #openstack-dev | 04:25 | |
*** jcooley has quit IRC | 04:29 | |
*** arosen1 has quit IRC | 04:30 | |
*** roge has quit IRC | 04:34 | |
*** Mandell has joined #openstack-dev | 04:38 | |
*** andrewbogott is now known as andrewbogott_afk | 04:39 | |
*** andrewbogott_afk is now known as andrewbogott | 04:40 | |
*** jakedahn is now known as jakedahn_zz | 04:42 | |
*** sunilthaha has quit IRC | 04:47 | |
*** andrewbogott is now known as andrewbogott_afk | 04:47 | |
*** aeperezt has quit IRC | 04:47 | |
*** darjeeling has joined #openstack-dev | 04:50 | |
*** eglynn_ has joined #openstack-dev | 04:51 | |
*** sunilthaha has joined #openstack-dev | 04:51 | |
*** wenjianhn has joined #openstack-dev | 04:53 | |
*** troytoman-away has quit IRC | 04:53 | |
*** troytoman-away has joined #openstack-dev | 04:54 | |
*** eglynn has quit IRC | 04:54 | |
*** troytoman-away is now known as troytoman | 04:55 | |
*** ewindisch has joined #openstack-dev | 04:56 | |
*** harlowja has quit IRC | 04:57 | |
*** Mandell has quit IRC | 04:57 | |
*** sunilthaha has quit IRC | 04:58 | |
*** digantya has quit IRC | 04:58 | |
*** anniec72 has joined #openstack-dev | 05:06 | |
*** anniec72 has quit IRC | 05:12 | |
*** adjohn has joined #openstack-dev | 05:15 | |
*** sunilthaha has joined #openstack-dev | 05:15 | |
*** kbringard has joined #openstack-dev | 05:28 | |
*** kbringard has quit IRC | 05:32 | |
*** wenjianhn has quit IRC | 05:32 | |
*** anniec72 has joined #openstack-dev | 05:35 | |
*** renier_ has quit IRC | 05:35 | |
*** renier has joined #openstack-dev | 05:36 | |
*** troytoman is now known as troytoman-away | 05:37 | |
*** koolhead17 has joined #openstack-dev | 05:37 | |
*** renier has quit IRC | 05:41 | |
*** anniec72 has quit IRC | 05:45 | |
*** anniec72 has joined #openstack-dev | 05:47 | |
*** ewindisch has quit IRC | 05:47 | |
*** winston-d has joined #openstack-dev | 05:52 | |
*** stevebake has joined #openstack-dev | 05:56 | |
*** anniec72 has quit IRC | 05:57 | |
*** aravindp has quit IRC | 06:19 | |
koolhead17 | hi all | 06:22 |
*** zaitcev has quit IRC | 06:27 | |
*** esp1 has joined #openstack-dev | 06:34 | |
*** esp1 has left #openstack-dev | 06:34 | |
*** s0mik has joined #openstack-dev | 06:35 | |
*** s0mik has quit IRC | 06:38 | |
*** darjeeling has quit IRC | 06:44 | |
*** littleidea has quit IRC | 06:45 | |
*** jcru has joined #openstack-dev | 06:46 | |
*** sstent has quit IRC | 06:46 | |
*** sstent has joined #openstack-dev | 06:49 | |
*** thingee_zz has quit IRC | 06:57 | |
*** winston-d has quit IRC | 07:15 | |
*** darjeeling has joined #openstack-dev | 07:18 | |
*** markmc has joined #openstack-dev | 07:22 | |
*** kbringard has joined #openstack-dev | 07:28 | |
*** kbringard has quit IRC | 07:33 | |
*** binarysemaphore has quit IRC | 07:33 | |
*** darjeeling has quit IRC | 07:38 | |
*** armaan has joined #openstack-dev | 07:41 | |
*** armaan has left #openstack-dev | 07:41 | |
*** adjohn has joined #openstack-dev | 07:44 | |
*** darjeeling has joined #openstack-dev | 07:45 | |
*** darjeeli_ has joined #openstack-dev | 07:46 | |
openstackgerrit | A change was merged to openstack/nova: Updated scheduler and compute for multiple capabilities. https://review.openstack.org/13920 | 07:49 |
*** darjeeling has quit IRC | 07:49 | |
*** saurabh has quit IRC | 07:50 | |
*** SlickNik has joined #openstack-dev | 07:54 | |
*** markmc has quit IRC | 07:55 | |
*** adjohn has quit IRC | 07:59 | |
*** mnewby has quit IRC | 07:59 | |
*** adjohn has joined #openstack-dev | 08:00 | |
*** darjeeli_ has quit IRC | 08:01 | |
*** sstent has quit IRC | 08:09 | |
*** Shrews has quit IRC | 08:09 | |
*** Vek has quit IRC | 08:09 | |
*** cmagina has quit IRC | 08:09 | |
*** iccha has quit IRC | 08:09 | |
*** dhubbard has quit IRC | 08:09 | |
*** sc68cal has quit IRC | 08:09 | |
*** pvo has quit IRC | 08:09 | |
*** jesusaurus has quit IRC | 08:09 | |
*** Shrews has joined #openstack-dev | 08:11 | |
*** Vek has joined #openstack-dev | 08:11 | |
*** cmagina has joined #openstack-dev | 08:11 | |
*** iccha has joined #openstack-dev | 08:11 | |
*** dhubbard has joined #openstack-dev | 08:11 | |
*** sc68cal has joined #openstack-dev | 08:11 | |
*** pvo has joined #openstack-dev | 08:11 | |
*** jesusaurus has joined #openstack-dev | 08:11 | |
*** morgan.freenode.net sets mode: +v pvo | 08:11 | |
*** e1mer has quit IRC | 08:13 | |
*** adjohn has quit IRC | 08:13 | |
*** renier has joined #openstack-dev | 08:15 | |
*** FARiN has joined #openstack-dev | 08:16 | |
*** e1mer has joined #openstack-dev | 08:19 | |
*** renier has quit IRC | 08:19 | |
*** sstent has joined #openstack-dev | 08:21 | |
*** e1mer has quit IRC | 08:21 | |
*** alobbs has joined #openstack-dev | 08:28 | |
*** thingee has joined #openstack-dev | 08:34 | |
*** thingee has quit IRC | 08:45 | |
*** darjeeling has joined #openstack-dev | 08:46 | |
*** rbasak has quit IRC | 08:54 | |
*** SlickNik has quit IRC | 08:54 | |
*** apevec has joined #openstack-dev | 09:13 | |
*** apevec has joined #openstack-dev | 09:13 | |
*** davidhadas has quit IRC | 09:14 | |
*** davidha has joined #openstack-dev | 09:14 | |
*** darjeeling has quit IRC | 09:22 | |
*** markwash has joined #openstack-dev | 09:23 | |
*** halfss has joined #openstack-dev | 09:24 | |
*** s0mik has joined #openstack-dev | 09:39 | |
*** e1mer has joined #openstack-dev | 09:47 | |
*** Hien has quit IRC | 09:49 | |
*** brucer has quit IRC | 09:51 | |
*** brucer has joined #openstack-dev | 09:52 | |
*** s0mik has quit IRC | 09:52 | |
*** s0mik has joined #openstack-dev | 10:03 | |
*** s0mik has quit IRC | 10:04 | |
*** Hien has joined #openstack-dev | 10:09 | |
*** markwash has quit IRC | 10:19 | |
*** armaan has joined #openstack-dev | 10:22 | |
*** armaan has left #openstack-dev | 10:25 | |
*** kbringard has joined #openstack-dev | 10:29 | |
*** alexpilotti has quit IRC | 10:31 | |
*** kbringard has quit IRC | 10:34 | |
*** Dorogs has joined #openstack-dev | 10:51 | |
*** ogelbukh has quit IRC | 10:53 | |
*** yjiang5 has quit IRC | 10:53 | |
*** salv-orlando has joined #openstack-dev | 10:55 | |
*** ogelbukh has joined #openstack-dev | 10:59 | |
*** almaisan-away is now known as al-maisan | 11:00 | |
*** yjiang5 has joined #openstack-dev | 11:01 | |
*** al-maisan is now known as almaisan-away | 11:01 | |
*** apevec has quit IRC | 11:06 | |
*** darjeeli_ has joined #openstack-dev | 11:09 | |
*** sunilthaha has quit IRC | 11:14 | |
*** yolanda has joined #openstack-dev | 11:17 | |
yolanda | hi, i'm a volunteer from Canonical, and i need my CLA to be approved in order to send a review for nova, can i get some help? | 11:17 |
*** rbasak has joined #openstack-dev | 11:18 | |
*** Dorogs has quit IRC | 11:23 | |
*** markwash has joined #openstack-dev | 11:25 | |
*** yjiang5_ has joined #openstack-dev | 11:26 | |
*** markwash has quit IRC | 11:29 | |
*** kbringard has joined #openstack-dev | 11:30 | |
*** kbringard has quit IRC | 11:34 | |
*** armaan has joined #openstack-dev | 11:35 | |
*** armaan has left #openstack-dev | 11:37 | |
*** yjiang5 is now known as yjiang5_away | 11:51 | |
*** renier has joined #openstack-dev | 11:51 | |
*** Dorogs has joined #openstack-dev | 11:53 | |
*** renier has quit IRC | 11:55 | |
*** yjiang5_away has quit IRC | 12:01 | |
*** Dorogs has quit IRC | 12:04 | |
*** danwent has joined #openstack-dev | 12:05 | |
*** roge has joined #openstack-dev | 12:07 | |
*** salv-orlando has quit IRC | 12:08 | |
*** roge has quit IRC | 12:11 | |
*** roge has joined #openstack-dev | 12:12 | |
*** pixelbeat has joined #openstack-dev | 12:15 | |
*** dhellmann_ has joined #openstack-dev | 12:18 | |
*** spn has quit IRC | 12:18 | |
*** spn has joined #openstack-dev | 12:19 | |
*** dhellmann has quit IRC | 12:20 | |
*** dhellmann_ is now known as dhellmann | 12:20 | |
*** kbringard has joined #openstack-dev | 12:30 | |
*** kbringard has quit IRC | 12:34 | |
openstackgerrit | A change was merged to openstack/quantum: Add QUANTUM_ prefix for env used by quantum-debug https://review.openstack.org/15780 | 12:37 |
openstackgerrit | A change was merged to openstack/quantum: Removing unsed code for Cisco Quantum Plugin V1 https://review.openstack.org/15712 | 12:37 |
*** darjeeli_ has quit IRC | 12:43 | |
*** renier has joined #openstack-dev | 12:45 | |
*** yolanda has quit IRC | 12:49 | |
*** renier has quit IRC | 12:50 | |
*** egallen has joined #openstack-dev | 13:09 | |
*** egallen has quit IRC | 13:10 | |
*** yjiang5 has joined #openstack-dev | 13:14 | |
*** yjiang5 has quit IRC | 13:16 | |
*** egallen has joined #openstack-dev | 13:17 | |
*** roge has quit IRC | 13:21 | |
*** yjiang5_ has quit IRC | 13:29 | |
*** yjiang5 has joined #openstack-dev | 13:29 | |
*** yjiang5 is now known as yjiang5_away | 13:35 | |
*** test_123 has joined #openstack-dev | 13:39 | |
*** renier has joined #openstack-dev | 13:40 | |
*** test_123 has quit IRC | 13:41 | |
*** adjohn has joined #openstack-dev | 13:42 | |
*** renier has quit IRC | 13:44 | |
*** alexpilotti has joined #openstack-dev | 13:45 | |
*** alexpilotti has quit IRC | 13:57 | |
*** dhellmann has quit IRC | 13:58 | |
*** Dr_Who has joined #openstack-dev | 14:05 | |
*** Dr_Who has joined #openstack-dev | 14:05 | |
*** renier has joined #openstack-dev | 14:12 | |
*** Dr_Who has quit IRC | 14:20 | |
*** roge has joined #openstack-dev | 14:26 | |
*** roge is now known as [4n4rk]roge | 14:46 | |
*** [4n4rk]roge has left #openstack-dev | 14:47 | |
*** pixelbeat has quit IRC | 14:48 | |
*** salv-orlando has joined #openstack-dev | 14:56 | |
*** benner has quit IRC | 14:57 | |
*** benner has joined #openstack-dev | 14:57 | |
*** salv-orlando has quit IRC | 15:01 | |
*** littleidea has joined #openstack-dev | 15:16 | |
*** armaan has joined #openstack-dev | 15:18 | |
*** darjeeling has joined #openstack-dev | 15:21 | |
*** anniec72 has joined #openstack-dev | 15:22 | |
*** egallen has quit IRC | 15:22 | |
*** egallen has joined #openstack-dev | 15:22 | |
*** littleidea has left #openstack-dev | 15:23 | |
*** gongysh has quit IRC | 15:34 | |
*** armaan has left #openstack-dev | 15:37 | |
*** halfss has quit IRC | 15:51 | |
*** davidkranz has quit IRC | 16:02 | |
*** e1mer has quit IRC | 16:07 | |
*** alexpilotti has joined #openstack-dev | 16:13 | |
alexpilotti | smoser mikal: hi! | 16:17 |
*** oneiroi has quit IRC | 16:18 | |
*** oneiroi has joined #openstack-dev | 16:21 | |
*** timello has quit IRC | 16:26 | |
*** littleidea has joined #openstack-dev | 16:31 | |
*** littleidea has quit IRC | 16:32 | |
*** littleidea has joined #openstack-dev | 16:33 | |
*** littleidea has quit IRC | 16:36 | |
*** salv-orlando has joined #openstack-dev | 16:37 | |
*** salv-orlando has quit IRC | 16:38 | |
*** salv-orlando has joined #openstack-dev | 16:39 | |
*** littleidea has joined #openstack-dev | 16:47 | |
*** sacharya has joined #openstack-dev | 16:51 | |
*** dansmith has quit IRC | 16:51 | |
*** littleidea has quit IRC | 16:52 | |
*** littleidea has joined #openstack-dev | 16:54 | |
*** blamar has joined #openstack-dev | 16:58 | |
*** danwent has quit IRC | 17:01 | |
*** ewindisch has joined #openstack-dev | 17:01 | |
*** dansmith has joined #openstack-dev | 17:05 | |
*** ewindisch has quit IRC | 17:06 | |
*** aeperezt has joined #openstack-dev | 17:06 | |
*** ewindisch has joined #openstack-dev | 17:08 | |
*** aeperezt has quit IRC | 17:10 | |
*** markwash has joined #openstack-dev | 17:22 | |
*** samkottler|bbl is now known as samkottler | 17:22 | |
*** sacharya1 has joined #openstack-dev | 17:23 | |
*** sacharya has quit IRC | 17:26 | |
*** ewindisch has quit IRC | 17:27 | |
*** colinmcnamara has joined #openstack-dev | 17:28 | |
*** kbringard has joined #openstack-dev | 17:32 | |
*** danwent has joined #openstack-dev | 17:33 | |
*** blamar has quit IRC | 17:34 | |
*** kbringard has quit IRC | 17:36 | |
*** vds has quit IRC | 17:40 | |
*** rods has quit IRC | 17:40 | |
*** colinmcnamara has quit IRC | 17:40 | |
*** thingee has joined #openstack-dev | 17:46 | |
*** danwent has quit IRC | 17:49 | |
*** jcooley has joined #openstack-dev | 17:52 | |
*** adalbas has quit IRC | 17:55 | |
*** danwent has joined #openstack-dev | 17:56 | |
*** davidkranz has joined #openstack-dev | 18:00 | |
*** danishman has joined #openstack-dev | 18:01 | |
*** renier has quit IRC | 18:03 | |
*** renier has joined #openstack-dev | 18:04 | |
*** davidkranz has quit IRC | 18:04 | |
*** davidkranz has joined #openstack-dev | 18:04 | |
*** renier has quit IRC | 18:08 | |
*** renier has joined #openstack-dev | 18:10 | |
*** adalbas has joined #openstack-dev | 18:12 | |
*** danwent has quit IRC | 18:15 | |
*** littleidea has quit IRC | 18:17 | |
*** anniec72 has quit IRC | 18:18 | |
*** jcooley has quit IRC | 18:18 | |
*** anniec has joined #openstack-dev | 18:19 | |
*** riskable has joined #openstack-dev | 18:22 | |
*** anniec has quit IRC | 18:24 | |
*** littleidea has joined #openstack-dev | 18:24 | |
*** anniec has joined #openstack-dev | 18:25 | |
*** timello has joined #openstack-dev | 18:27 | |
*** heckj has joined #openstack-dev | 18:29 | |
*** kbringard has joined #openstack-dev | 18:32 | |
*** markwash has quit IRC | 18:33 | |
*** kbringard has quit IRC | 18:37 | |
*** markwash has joined #openstack-dev | 18:41 | |
*** egallen has quit IRC | 18:45 | |
*** egallen has joined #openstack-dev | 18:46 | |
*** Dr_Who has joined #openstack-dev | 18:48 | |
*** Dr_Who has joined #openstack-dev | 18:48 | |
*** ijw1 has joined #openstack-dev | 18:48 | |
*** heckj has quit IRC | 18:51 | |
*** markwash has quit IRC | 18:51 | |
*** ijw has quit IRC | 18:51 | |
*** j_king has quit IRC | 18:52 | |
*** Dorogs has joined #openstack-dev | 18:52 | |
*** Dorogs has quit IRC | 18:54 | |
*** littleidea has left #openstack-dev | 18:55 | |
*** salv-orlando has quit IRC | 18:59 | |
*** j_king has joined #openstack-dev | 19:04 | |
*** Dr_Who has quit IRC | 19:04 | |
*** clarkb has quit IRC | 19:06 | |
*** clarkb has joined #openstack-dev | 19:06 | |
*** renier has quit IRC | 19:16 | |
*** renier has joined #openstack-dev | 19:17 | |
*** egallen has quit IRC | 19:20 | |
*** renier has quit IRC | 19:21 | |
*** pixelbeat has joined #openstack-dev | 19:29 | |
*** koolhead17 has quit IRC | 19:31 | |
*** openstack_newbe has quit IRC | 19:32 | |
*** openstack_newbe has joined #openstack-dev | 19:35 | |
*** pixelbeat has quit IRC | 19:36 | |
*** egallen has joined #openstack-dev | 19:37 | |
*** markwash has joined #openstack-dev | 19:39 | |
*** koolhead17 has joined #openstack-dev | 19:44 | |
*** timjr has joined #openstack-dev | 19:47 | |
*** egallen has quit IRC | 19:49 | |
*** egallen has joined #openstack-dev | 19:50 | |
*** aeperezt has joined #openstack-dev | 19:50 | |
*** egallen has quit IRC | 19:51 | |
*** Dr_Who has joined #openstack-dev | 19:52 | |
*** Dr_Who has joined #openstack-dev | 19:52 | |
*** egallen has joined #openstack-dev | 19:54 | |
*** egallen has quit IRC | 19:55 | |
*** markwash has quit IRC | 19:58 | |
*** utlemming has joined #openstack-dev | 19:58 | |
timjr | so, one of the unit tests failed for a glance patch that I submitted for review... but it passes when I run it | 20:05 |
timjr | would it be really rude if I submitted updated versions of the patch with prints in that unit test to figure out what went wrong? | 20:06 |
*** egallen has joined #openstack-dev | 20:08 | |
clarkb | timjr: running `tox -epy27` locally does not reproduce? | 20:12 |
timjr | well, I used run_tests.sh... haven't tried that command | 20:13 |
clarkb | tox -epy27 is the command Jenkins is running when that test fails | 20:13 |
*** Dr_Who has quit IRC | 20:14 | |
timjr | I basically changed comments. And the same test passed in python 2.6... I think it's an intermittent failure | 20:15 |
clarkb | definitely could be, was just curious if doing what Jenkins did resulted in failure | 20:16 |
clarkb | if it is reproducable that way adding print statement to pushed code wouldn't be necessary. If it is intermittent, adding prints may not help either | 20:17 |
timjr | indeed | 20:17 |
*** novas0x2a|laptop has joined #openstack-dev | 20:18 | |
timjr | unfortunately, I don't think RHEL has been so kind as to bestow python 2.7 on me just yet | 20:20 |
*** anniec has quit IRC | 20:31 | |
*** ijw11 has joined #openstack-dev | 20:37 | |
*** ijw1 has quit IRC | 20:40 | |
timjr | looks like you can just add a comment that says "recheck" to get it to rebuild | 20:40 |
*** littleidea has joined #openstack-dev | 20:41 | |
*** Tross has quit IRC | 20:43 | |
*** alexpilotti has quit IRC | 20:44 | |
*** aeperezt has quit IRC | 20:45 | |
*** PaulM has joined #openstack-dev | 20:52 | |
*** Tross has joined #openstack-dev | 20:55 | |
*** renier has joined #openstack-dev | 20:59 | |
*** blamar has joined #openstack-dev | 21:00 | |
*** danishman has quit IRC | 21:01 | |
*** renier has quit IRC | 21:04 | |
*** cmagina has quit IRC | 21:13 | |
fungi | timjr: to retry the tests, yes | 21:38 |
fungi | timjr: if it is intermittent/nondeterministic or if it was failing due to some other already merged bug which has since been fixed, then that's what you want | 21:39 |
timjr | well, I really only changed comments and removed an unused class... so there aren't a lot of really interesting failure modes you'd expect from that | 21:40 |
*** sandywalsh has joined #openstack-dev | 21:40 | |
fungi | timjr: agreed. on occasion we *do* see dependent tests (a bug in their own right honestly) which start failing due to seemingly trivial changes/removals of other bits | 21:41 |
timjr | failed in a different place this time... so flaky :( | 21:41 |
fungi | ugh. that really, really shouldn't happen | 21:42 |
fungi | what's the url to the change (or the change number)? | 21:42 |
timjr | https://review.openstack.org/#/c/15801/ | 21:42 |
fungi | yeah, something's definitelty not right. we've got failures there exposed in three different suites at different times (py26, py27 and tempest) | 21:43 |
fungi | clarkb: ^ thoughts? | 21:44 |
timjr | the tempest failures (two different times) both look like some kind of timeout | 21:44 |
clarkb | the tempest failures are cinder failing which it seems to do semi frequently | 21:44 |
timjr | maybe the load is really high someplace... | 21:44 |
timjr | oh | 21:44 |
clarkb | despite our hitting it with a hammer | 21:44 |
clarkb | I think the sleep length increase is probably a sane thing to do for the first py27 failure | 21:45 |
clarkb | however, waiting in that manner is always a potential non deterministic failure point | 21:45 |
timjr | indeed | 21:46 |
timjr | the thing it's waiting for is: | 21:46 |
timjr | write_pid_file(pid_file, pid) | 21:46 |
timjr | await_child(pid, await_time) | 21:46 |
timjr | I don't think write_pid_file should take two seconds unless the system is like really buried | 21:46 |
clarkb | well these are cloud VMs | 21:47 |
fungi | and one of the failures seemed to be a connection refusal | 21:47 |
timjr | I'll do another recheck while we're thinkin' about it... maybe the nth time's the charm | 21:48 |
fungi | we normally don't see clusters of random failures with this kind of frequency, do we? it does make me wonder if $provider is having some kind of issue | 21:48 |
clarkb | another race condition? is that test sleeping to wait for the thing listening on the socket to come up? | 21:48 |
*** gongysh has joined #openstack-dev | 21:48 | |
timjr | lemmie look | 21:49 |
*** sandywalsh has quit IRC | 21:49 | |
clarkb | fungi: jenkins doesn't load balance tests well and consecutive runs of the same test tend to end up on the same slave | 21:50 |
timjr | yeah, that test might want to wait for the port to become available, I'll add that | 21:50 |
clarkb | the test should be the only thing running on the slave at the time, but the VM is sharing resources with the other hosts on the hypervisor | 21:50 |
timjr | looks like it's using a non-empty logfile as a proxy for that | 21:50 |
fungi | clarkb: got it. that does then increase the visibility for a flaky slave at least, if to the unfortunate detriment of a particular change | 21:52 |
*** utlemming has quit IRC | 21:53 | |
*** utlemming has joined #openstack-dev | 21:53 | |
timjr | a good minimum performance SLA is probably an interesting problem | 21:53 |
timjr | nah, the whole glance API test uses that same idiom of start_servers() followed immediately by a GET | 21:55 |
timjr | start_servers does wait for the port to become available | 21:56 |
*** sacharya1 has quit IRC | 21:58 | |
*** Tross has quit IRC | 21:58 | |
clarkb | jgriffith: if you are around http://logs.openstack.org/15801/2/check/gate-tempest-devstack-vm/18059/ and http://logs.openstack.org/15801/1/check/gate-tempest-devstack-vm/18017/ are worth a look at | 22:02 |
mordred | fungi, clarkb: we've discussed cycling unittest slaves more frequently | 22:04 |
mordred | clarkb: it probably wouldn't be terribly much of a change to make the devstack-gate pool management also manage some unittest slaves in a second pool | 22:05 |
*** e1mer has joined #openstack-dev | 22:05 | |
mordred | and then perhaps expire/re-cycle them all after a few hours? | 22:05 |
mordred | hrm. wrong channel... | 22:05 |
clarkb | jgriffith: for the first one there are a couple tracebacks in n-api.txt | 22:06 |
clarkb | jgriffith: looks like the same sort of traceback in the second | 22:07 |
*** annashen has joined #openstack-dev | 22:08 | |
timjr | yay, great success | 22:19 |
*** sunil has joined #openstack-dev | 22:19 | |
timjr | it did seem to go much faster than the failures. the tempest gate thing took 20 minutes instead of 50 | 22:19 |
*** sunil has quit IRC | 22:20 | |
*** sunil has joined #openstack-dev | 22:21 | |
fungi | can't say that's making me feel any better. i just have to wonder if it lets through as many bugs via false negatives and it blocks on false positives | 22:22 |
fungi | s/and/as/ | 22:23 |
*** sunil has quit IRC | 22:23 | |
*** sthaha has joined #openstack-dev | 22:23 | |
timjr | if it's just caused by extreme slowness of the underlying system, I would be really surprised if that led to spurious test passes | 22:24 |
timjr | if it continues to be flaky though, things could degenerate fast as people keep re-running the jobs | 22:24 |
timjr | it also makes it a little tough to detect performance regressions, if the tests get a random amount of system resources | 22:25 |
fungi | yeah, agreed. makes me uneasy regardless--it's not necessarily rational of me | 22:25 |
timjr | ordinarily, a test run taking twice as long would be a cause for concern... | 22:25 |
clarkb | timjr: I don't think the change in tempest run time is an issue | 22:26 |
clarkb | ifyou look at the timestamps all of that extra time is waiting for cinder to time out | 22:26 |
timjr | oh, ok | 22:27 |
*** sandywalsh has joined #openstack-dev | 22:32 | |
*** blamar has quit IRC | 22:42 | |
*** sandywalsh has quit IRC | 22:44 | |
*** koolhead17 has quit IRC | 22:56 | |
*** adjohn has joined #openstack-dev | 22:58 | |
*** Tross has joined #openstack-dev | 22:59 | |
*** reed has quit IRC | 23:00 | |
*** Tross has quit IRC | 23:02 | |
*** davidhadas has joined #openstack-dev | 23:02 | |
*** Dr_Who has joined #openstack-dev | 23:06 | |
*** Dr_Who has joined #openstack-dev | 23:06 | |
*** novas0x2a|laptop has quit IRC | 23:11 | |
*** novas0x2a|laptop has joined #openstack-dev | 23:11 | |
*** davidha has quit IRC | 23:13 | |
*** egallen has quit IRC | 23:32 | |
*** renier has joined #openstack-dev | 23:41 | |
*** littleidea has quit IRC | 23:45 | |
*** renier has quit IRC | 23:45 | |
*** Tross has joined #openstack-dev | 23:54 | |
*** littleidea has joined #openstack-dev | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!