*** alex_xu has joined #openstack-qa | 00:04 | |
openstackrecheck | Console logs not available after 21:28s for vitrage-dsvm-api-py27 577388,5,94c76b3 | 00:07 |
---|---|---|
*** felipemonteiro_ has joined #openstack-qa | 00:12 | |
*** felipemonteiro_ has quit IRC | 00:26 | |
openstackrecheck | Console logs not available after 26:14s for tripleo-ci-centos-7-scenario003-multinode-oooq-container 572312,10,52e1534 | 00:33 |
*** oomichi has joined #openstack-qa | 00:46 | |
*** spotz has quit IRC | 01:04 | |
*** oomichi has quit IRC | 01:05 | |
*** yangyapeng has joined #openstack-qa | 01:11 | |
*** edmondsw has joined #openstack-qa | 01:16 | |
openstackrecheck | Console logs not available after 20:28s for ironic-dsvm-standalone 568551,29,09d0caf | 01:17 |
*** edmondsw has quit IRC | 01:20 | |
*** spotz has joined #openstack-qa | 01:20 | |
*** raildo has quit IRC | 01:22 | |
openstackrecheck | Console logs not available after 20:01s for requirements-check 553738,12,aa631e1 | 01:37 |
openstackrecheck | Console logs not available after 20:01s for tripleo-ci-centos-7-scenario003-multinode-oooq-container 575146,3,5d5c6d1 | 01:57 |
*** gfidente has joined #openstack-qa | 02:05 | |
*** hongbin has joined #openstack-qa | 02:06 | |
*** LindaWang has joined #openstack-qa | 02:09 | |
openstackrecheck | Console logs not available after 20:03s for openstack-tox-linters 578023,2,0d2b54d | 02:17 |
openstackrecheck | Console logs not available after 20:12s for ironic-dsvm-standalone 575433,11,8d259f4 | 02:37 |
*** vivsoni has quit IRC | 02:49 | |
openstackrecheck | Console logs not available after 20:08s for openstack-tox-linters 509728,28,e79f133 | 02:57 |
*** edmondsw has joined #openstack-qa | 03:03 | |
*** edmondsw has quit IRC | 03:08 | |
openstackrecheck | Console logs not available after 20:07s for ipa-tempest-dsvm-wholedisk-bios-ipmi-iscsi-coreos-src 575206,7,208599f | 03:17 |
*** spartacloud has joined #openstack-qa | 03:28 | |
openstackrecheck | Console logs not available after 20:06s for openstack-tox-pep8 577833,5,4f37984 | 03:38 |
gmann | masayukig: hi | 03:42 |
masayukig | gmann: hi | 03:42 |
gmann | masayukig: will you join today office hour? | 03:42 |
masayukig | ah, I think I can't today.. | 03:43 |
masayukig | or just join with my phone | 03:44 |
gmann | ohk | 03:45 |
masayukig | gmann: can you? | 03:45 |
*** oomichi has joined #openstack-qa | 03:45 | |
gmann | masayukig: same for me | 03:46 |
*** vivsoni has joined #openstack-qa | 03:51 | |
*** slaweq has quit IRC | 03:53 | |
openstackrecheck | Console logs not available after 20:08s for neutron-grenade-multinode 505973,4,852a79c | 03:58 |
*** mbindlish_ has joined #openstack-qa | 04:08 | |
*** slaweq has joined #openstack-qa | 04:11 | |
masayukig | gmann: sure. so, it might be good to cancel this week? Or someone can host? | 04:16 |
*** slaweq has quit IRC | 04:16 | |
gmann | masayukig: yea, i will check that time | 04:18 |
openstackrecheck | Console logs not available after 20:15s for legacy-tempest-dsvm-neutron-src 578144,2,1ccf059 | 04:18 |
*** mbindlish has joined #openstack-qa | 04:23 | |
*** mbindlish has quit IRC | 04:25 | |
*** hongbin has quit IRC | 04:27 | |
*** nguyenhai has left #openstack-qa | 04:32 | |
*** ramishra has joined #openstack-qa | 04:34 | |
openstackrecheck | Console logs not available after 20:34s for openstack-tox-linters 572713,2,0a0e8e4 | 04:39 |
*** sridharg has joined #openstack-qa | 04:44 | |
*** edmondsw has joined #openstack-qa | 04:52 | |
*** edmondsw has quit IRC | 04:57 | |
openstackrecheck | Console logs not available after 20:05s for nova-multiattach 557448,28,8441ab0 | 04:59 |
*** slaweq has joined #openstack-qa | 05:11 | |
*** slaweq has quit IRC | 05:15 | |
openstackrecheck | Console logs not available after 20:05s for ironic-dsvm-standalone 568551,29,7eaf1dd | 05:19 |
*** sridharg has quit IRC | 05:20 | |
*** spartacloud has quit IRC | 05:21 | |
*** yangyapeng has quit IRC | 05:25 | |
*** yangyapeng has joined #openstack-qa | 05:25 | |
*** oomichi has quit IRC | 05:28 | |
*** whoami-rajat__ has joined #openstack-qa | 05:29 | |
*** yangyapeng has quit IRC | 05:29 | |
*** whoami-rajat has joined #openstack-qa | 05:32 | |
*** whoami-rajat_ has quit IRC | 05:32 | |
*** openstackgerrit has quit IRC | 05:34 | |
*** whoami-rajat__ has quit IRC | 05:35 | |
*** pgadiya has joined #openstack-qa | 05:36 | |
*** pgadiya has quit IRC | 05:36 | |
openstackrecheck | Console logs not available after 20:08s for networking-ovn-tempest-dsvm-ovs-release 576094,4,4b692a8 | 05:39 |
*** jogo has quit IRC | 05:42 | |
*** openstackstatus has quit IRC | 05:51 | |
*** openstackstatus has joined #openstack-qa | 05:53 | |
*** ChanServ sets mode: +v openstackstatus | 05:53 | |
*** vishakha has quit IRC | 05:56 | |
*** yangyapeng has joined #openstack-qa | 05:59 | |
openstackrecheck | Console logs not available after 20:10s for neutron-tempest-dvr 577039,4,9a3ac6a | 05:59 |
gmann | chandankumar: afazekas andreaf myself and masayukig might not be available for today office hour. any chance you guys want to discuss particular otherwise we can cancel it until any of you want to chair it ? | 06:07 |
*** vishakha has joined #openstack-qa | 06:08 | |
*** ramishra has quit IRC | 06:10 | |
*** slaweq has joined #openstack-qa | 06:11 | |
*** ramishra has joined #openstack-qa | 06:12 | |
*** slaweq has quit IRC | 06:15 | |
*** jogo has joined #openstack-qa | 06:17 | |
openstackrecheck | Console logs not available after 20:11s for networking-ovn-tempest-dsvm-ovs-release 573693,4,43cf9fd | 06:19 |
*** openstackgerrit has joined #openstack-qa | 06:22 | |
openstackgerrit | Ghanshyam Mann proposed openstack/tempest master: Add compute microversion 2.61 schema in flavors_client https://review.openstack.org/563539 | 06:22 |
*** agurenko has joined #openstack-qa | 06:31 | |
*** ramishra has quit IRC | 06:35 | |
*** ramishra has joined #openstack-qa | 06:37 | |
*** gcheresh has joined #openstack-qa | 06:37 | |
openstackrecheck | Console logs not available after 20:15s for openstack-tox-py27 578010,3,50d28db | 06:40 |
*** viccuad has quit IRC | 06:40 | |
*** edmondsw has joined #openstack-qa | 06:40 | |
*** viccuad has joined #openstack-qa | 06:42 | |
*** slaweq has joined #openstack-qa | 06:44 | |
*** edmondsw has quit IRC | 06:46 | |
*** slaweq has quit IRC | 06:48 | |
*** slaweq has joined #openstack-qa | 06:54 | |
*** ramishra has quit IRC | 06:55 | |
*** mbindlish_ has quit IRC | 06:59 | |
openstackrecheck | Console logs not available after 20:08s for openstack-tox-linters 578052,2,989ba24 | 07:00 |
*** ramishra has joined #openstack-qa | 07:00 | |
*** mbindlish has joined #openstack-qa | 07:01 | |
*** lkuchlan has joined #openstack-qa | 07:01 | |
*** shardy has joined #openstack-qa | 07:05 | |
*** peereb has joined #openstack-qa | 07:09 | |
*** pcaruana has joined #openstack-qa | 07:10 | |
*** tesseract has joined #openstack-qa | 07:11 | |
*** grafuls has joined #openstack-qa | 07:12 | |
*** sapcc-bot has quit IRC | 07:15 | |
*** sapcc-bot has joined #openstack-qa | 07:16 | |
openstackrecheck | Console logs not available after 20:09s for tripleo-ci-centos-7-containers-multinode 574233,22,41fe62c | 07:20 |
*** ramishra has quit IRC | 07:23 | |
*** ramishra has joined #openstack-qa | 07:24 | |
*** spartacloud has joined #openstack-qa | 07:25 | |
*** ramishra has quit IRC | 07:29 | |
*** spartacloud has quit IRC | 07:29 | |
*** ramishra has joined #openstack-qa | 07:30 | |
*** ragiman has joined #openstack-qa | 07:36 | |
*** ramishra has quit IRC | 07:39 | |
openstackrecheck | Console logs not available after 20:13s for tripleo-ci-centos-7-scenario001-multinode-oooq-container 578292,4,738a936 | 07:40 |
*** jpena|off is now known as jpena | 07:44 | |
*** gkadam has joined #openstack-qa | 07:56 | |
*** tosky has joined #openstack-qa | 07:58 | |
openstackrecheck | Console logs not available after 20:35s for neutron-vpnaas-tempest 573232,3,686389d | 08:01 |
*** d0ugal has joined #openstack-qa | 08:08 | |
*** sshnaidm is now known as sshnaidm|afk | 08:09 | |
*** kopecmartin has joined #openstack-qa | 08:13 | |
*** dansmith has quit IRC | 08:20 | |
*** dansmith has joined #openstack-qa | 08:21 | |
openstackrecheck | Console logs not available after 20:09s for build-openstack-sphinx-docs 394619,16,16b5aff | 08:21 |
*** dansmith is now known as Guest88823 | 08:21 | |
*** ramishra has joined #openstack-qa | 08:25 | |
*** edmondsw has joined #openstack-qa | 08:29 | |
*** oomichi has joined #openstack-qa | 08:29 | |
*** edmondsw has quit IRC | 08:34 | |
gmann | masayukig: chandankumar: we will cancel today office hour and continue next week. | 08:36 |
masayukig | gmann: ok, sure. thanks | 08:37 |
openstackrecheck | Console logs not available after 20:11s for openstack-tox-linters 576053,2,ba7bcdb | 08:41 |
*** oomichi has quit IRC | 08:50 | |
openstackrecheck | Console logs not available after 20:25s for openstack-tox-linters 576904,6,ed66e8f | 09:01 |
openstackgerrit | Lucas Alvares Gomes proposed openstack-dev/devstack master: Revert "Configure [neutron] in nova_cell*.conf" https://review.openstack.org/578739 | 09:07 |
*** d0ugal has quit IRC | 09:16 | |
*** armaan has joined #openstack-qa | 09:17 | |
*** d0ugal has joined #openstack-qa | 09:17 | |
openstackrecheck | Console logs not available after 20:16s for neutron-tempest-dvr 573638,2,af2d41a | 09:22 |
*** whoami-rajat has quit IRC | 09:31 | |
*** gfidente has quit IRC | 09:37 | |
openstackrecheck | Console logs not available after 20:12s for ironic-tempest-dsvm-ipa-partition-pxe_ipmitool-tinyipa-python3 578400,2,a433c1f | 09:42 |
*** gkadam has quit IRC | 09:46 | |
*** gkadam has joined #openstack-qa | 09:47 | |
*** dtantsur|afk is now known as dtantsur | 09:49 | |
*** rcernin has quit IRC | 09:56 | |
*** sridharg has joined #openstack-qa | 09:59 | |
*** armaan has quit IRC | 10:02 | |
openstackrecheck | Console logs not available after 20:13s for tripleo-ci-centos-7-scenario002-multinode-oooq-container 568858,4,b18a9ae | 10:02 |
*** armaan has joined #openstack-qa | 10:02 | |
openstackgerrit | Lucas Alvares Gomes proposed openstack-dev/devstack master: Make configure_neutron_nova_new and create_nova_conf_neutron param optional https://review.openstack.org/578752 | 10:03 |
*** armaan has quit IRC | 10:03 | |
*** armaan has joined #openstack-qa | 10:04 | |
*** LindaWang has quit IRC | 10:09 | |
*** edmondsw has joined #openstack-qa | 10:17 | |
*** gkadam has quit IRC | 10:20 | |
*** gkadam has joined #openstack-qa | 10:21 | |
*** edmondsw has quit IRC | 10:22 | |
openstackrecheck | Console logs not available after 20:21s for nova-next 578345,3,a87d799 | 10:23 |
openstackgerrit | Lucas Alvares Gomes proposed openstack-dev/devstack master: Make configure_neutron_nova_new and create_nova_conf_neutron param optional https://review.openstack.org/578752 | 10:25 |
*** agurenko has quit IRC | 10:26 | |
*** armaan has quit IRC | 10:26 | |
*** armaan has joined #openstack-qa | 10:27 | |
*** agurenko has joined #openstack-qa | 10:28 | |
*** armaan has quit IRC | 10:31 | |
openstackrecheck | Console logs not available after 20:21s for tripleo-ci-centos-7-containers-multinode 568856,2,4950846 | 10:43 |
*** peereb has quit IRC | 10:43 | |
*** ramishra has quit IRC | 10:44 | |
*** salv-orlando has joined #openstack-qa | 10:44 | |
*** salv-orlando has quit IRC | 10:45 | |
*** yangyapeng has quit IRC | 10:51 | |
*** yangyapeng has joined #openstack-qa | 10:52 | |
*** sshnaidm|afk is now known as sshnaidm | 10:58 | |
*** jpena is now known as jpena|lunch | 10:59 | |
openstackrecheck | Console logs not available after 20:21s for cross-cinder-py35 578324,1,cdcd836 | 11:03 |
openstackgerrit | Slawek Kaplonski proposed openstack/tempest master: Add additional log of meta_data devices content https://review.openstack.org/578765 | 11:05 |
*** ragiman has quit IRC | 11:07 | |
openstackgerrit | Lee Yarwood proposed openstack-dev/devstack master: Bump noVNC to 1.0.0 https://review.openstack.org/550172 | 11:08 |
slaweq | gmann: masayukig: hi, I'm trying to debug issue described in https://bugs.launchpad.net/tempest/+bug/1775947 | 11:11 |
openstack | Launchpad bug 1775947 in tempest "tempest.api.compute.servers.test_device_tagging.TaggedAttachmentsTest failing" [Medium,Confirmed] - Assigned to Deepak Mourya (mourya007) | 11:11 |
slaweq | I sent small patch for tempest: https://review.openstack.org/#/c/578765/ | 11:11 |
slaweq | do You think that it is possible to merge it to tempest? It might help with debugging issue with this failing test | 11:11 |
openstackgerrit | Slawek Kaplonski proposed openstack/tempest master: Add additional log of meta_data devices content https://review.openstack.org/578765 | 11:12 |
*** yangyapeng has quit IRC | 11:13 | |
*** yangyapeng has joined #openstack-qa | 11:14 | |
*** yangyapeng has quit IRC | 11:14 | |
*** yangyapeng has joined #openstack-qa | 11:15 | |
openstackrecheck | Console logs not available after 20:13s for ironic-dsvm-standalone 578419,1,59ea7e6 | 11:24 |
*** gfidente has joined #openstack-qa | 11:29 | |
*** gfidente has quit IRC | 11:29 | |
*** gfidente has joined #openstack-qa | 11:29 | |
*** dtantsur is now known as dtantsur|brb | 11:32 | |
*** zul has joined #openstack-qa | 11:39 | |
frickler | tosky: andreaf: updated the devstack-plugin-ceph patch, now going to check why these patches don't seem to be covered by gerritbot here :-S | 11:41 |
openstackrecheck | Console logs not available after 20:17s for tempest-full 578034,2,ee64cfb | 11:44 |
*** salv-orlando has joined #openstack-qa | 11:45 | |
*** mbindlish has quit IRC | 11:46 | |
*** zul has quit IRC | 11:49 | |
*** ramishra has joined #openstack-qa | 11:50 | |
*** ramishra has quit IRC | 11:51 | |
*** salv-orlando has quit IRC | 11:51 | |
*** ramishra has joined #openstack-qa | 11:51 | |
*** pcaruana has quit IRC | 11:56 | |
*** jpena|lunch is now known as jpena | 11:56 | |
*** mvk has quit IRC | 11:56 | |
*** raildo has joined #openstack-qa | 12:00 | |
openstackrecheck | Console logs not available after 20:18s for osc-functional-devstack-tips 574747,1,5706c75 | 12:04 |
*** edmondsw has joined #openstack-qa | 12:06 | |
tosky | frickler: oh | 12:09 |
tosky | thanks | 12:09 |
* tosky checks | 12:09 | |
*** yangyapeng has quit IRC | 12:09 | |
*** edmondsw has quit IRC | 12:11 | |
*** rosmaita has joined #openstack-qa | 12:13 | |
*** rosmaita has quit IRC | 12:21 | |
*** fnaval has quit IRC | 12:22 | |
openstackrecheck | Console logs not available after 20:19s for tempest-full 578192,2,a7e518c | 12:25 |
*** mvk has joined #openstack-qa | 12:28 | |
*** yangyapeng has joined #openstack-qa | 12:28 | |
*** kopecmartin has quit IRC | 12:28 | |
*** rosmaita has joined #openstack-qa | 12:29 | |
*** fnaval has joined #openstack-qa | 12:34 | |
*** zul has joined #openstack-qa | 12:37 | |
*** dustins has joined #openstack-qa | 12:37 | |
*** kopecmartin has joined #openstack-qa | 12:38 | |
*** pcaruana has joined #openstack-qa | 12:44 | |
openstackrecheck | Console logs not available after 20:10s for openstack-tox-pep8 545450,14,8a747a0 | 12:45 |
*** artom has joined #openstack-qa | 12:45 | |
*** alexchadin has joined #openstack-qa | 12:51 | |
*** rcernin has joined #openstack-qa | 12:53 | |
*** dtantsur|brb is now known as dtantsur | 12:55 | |
openstackgerrit | Anna Pankiewicz proposed openstack/tempest master: Improve Tempest workspace manager unit test coverage https://review.openstack.org/576636 | 12:55 |
*** yangyapeng has quit IRC | 12:56 | |
*** edmondsw has joined #openstack-qa | 13:01 | |
openstackrecheck | Console logs not available after 20:29s for openstack-tox-linters 578403,1,cf5cbf2 | 13:05 |
*** rcernin has quit IRC | 13:08 | |
*** lkuchlan has quit IRC | 13:13 | |
*** kopecmartin has quit IRC | 13:14 | |
gmann | frickler: sounds good, it should work now. | 13:14 |
*** LindaWang_ has joined #openstack-qa | 13:15 | |
*** kopecmartin has joined #openstack-qa | 13:15 | |
gmann | slaweq: is it not fixed by the patch we converted the sleep to waiting for resource. - https://review.openstack.org/#/c/573107/ ? | 13:17 |
slaweq | gmann: I don't think so | 13:18 |
slaweq | there is many such failures still | 13:18 |
gmann | slaweq: ohk, ll check more details tomorrow | 13:18 |
slaweq | and what I found is that this test takes about 270 seconds when it fails | 13:18 |
slaweq | and about 80 seconds when it is fine | 13:18 |
slaweq | so IMO something is still in this metadata json but I don't know what (nic or volume) | 13:19 |
gmann | artom: ^^ | 13:19 |
openstackrecheck | Console logs not available after 20:22s for openstack-tox-linters 578081,5,059e798 | 13:26 |
*** mriedem has joined #openstack-qa | 13:37 | |
*** alexchadin has quit IRC | 13:44 | |
openstackrecheck | Console logs not available after 20:09s for openstack-tox-pep8 578435,1,a76e1a7 | 13:46 |
*** gkadam has quit IRC | 13:46 | |
*** gkadam has joined #openstack-qa | 13:49 | |
*** hongbin has joined #openstack-qa | 13:50 | |
*** alexchadin has joined #openstack-qa | 13:54 | |
*** awaugama has joined #openstack-qa | 13:57 | |
*** grafuls has quit IRC | 13:58 | |
*** Guest88823 is now known as dansmith | 14:01 | |
*** e0ne has joined #openstack-qa | 14:02 | |
*** yangyapeng has joined #openstack-qa | 14:02 | |
openstackrecheck | Console logs not available after 20:16s for tripleo-ci-centos-7-scenario002-multinode-oooq-container 577960,4,91ecc3a | 14:06 |
*** yangyapeng has quit IRC | 14:06 | |
*** agurenko has quit IRC | 14:06 | |
*** dustins has quit IRC | 14:06 | |
*** lbragstad has quit IRC | 14:10 | |
*** grafuls has joined #openstack-qa | 14:11 | |
*** bkopilov has quit IRC | 14:12 | |
openstackgerrit | Merged openstack/tempest master: Move Stable branch Policy Doc outside of coding guide https://review.openstack.org/576454 | 14:14 |
frickler | ^^ recheck seems to be at 20h backlog again, after it was mostly fine for a couple of days. not sure where these large jumps come from | 14:15 |
*** agurenko has joined #openstack-qa | 14:16 | |
*** dustins has joined #openstack-qa | 14:19 | |
*** yangyapeng has joined #openstack-qa | 14:21 | |
openstackrecheck | Console logs not available after 20:16s for build-openstack-sphinx-docs 578001,5,7ebf8b6 | 14:26 |
*** rnoriega has quit IRC | 14:27 | |
*** rnoriega has joined #openstack-qa | 14:28 | |
*** e0ne has quit IRC | 14:31 | |
*** agurenko has quit IRC | 14:32 | |
*** yangyapeng has quit IRC | 14:32 | |
*** CrayZee has joined #openstack-qa | 14:33 | |
*** lbragstad has joined #openstack-qa | 14:38 | |
*** fnaval has quit IRC | 14:38 | |
*** e0ne has joined #openstack-qa | 14:40 | |
*** fnaval has joined #openstack-qa | 14:42 | |
*** shardy has quit IRC | 14:42 | |
openstackgerrit | Merged openstack/tempest master: Cleanup networks resources at test level https://review.openstack.org/572015 | 14:43 |
*** shardy has joined #openstack-qa | 14:45 | |
openstackrecheck | Console logs not available after 20:16s for build-openstack-sphinx-docs 577507,2,d288918 | 14:47 |
*** kiennt26 has joined #openstack-qa | 14:47 | |
*** spartacloud has joined #openstack-qa | 14:48 | |
*** gcheresh has quit IRC | 14:53 | |
*** spartacloud has quit IRC | 14:53 | |
*** grafuls has quit IRC | 14:55 | |
*** spartacloud has joined #openstack-qa | 14:58 | |
*** alex_xu has quit IRC | 14:58 | |
*** CrayZee is now known as snapiri- | 15:00 | |
*** alex_xu has joined #openstack-qa | 15:00 | |
*** spartacloud has quit IRC | 15:03 | |
artom | gmann, hrmmm | 15:04 |
artom | slaweq, this is in the gate? Do you have an example of a fail? | 15:05 |
*** alexchadin has quit IRC | 15:06 | |
openstackrecheck | Console logs not available after 20:13s for openstack-tox-lower-constraints 578430,1,eb0a146 | 15:07 |
slaweq | artom: sure, let me find some examples | 15:08 |
slaweq | artom: for example: http://logs.openstack.org/38/573638/2/check/neutron-tempest-linuxbridge/825698e/job-output.txt#_2018-06-27_21_05_38_378999 | 15:10 |
slaweq | it's from yesterday | 15:10 |
*** kiennt26 has quit IRC | 15:10 | |
slaweq | artom: but with simple query like http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22line%20384%2C%20in%20test_tagged_attachment%5C%22 | 15:11 |
slaweq | You will find more examples e.g. in last 24 hours | 15:11 |
artom | slaweq, thanks, will take a look | 15:12 |
*** yamamoto has quit IRC | 15:12 | |
slaweq | artom: thx | 15:12 |
*** yamamoto has joined #openstack-qa | 15:12 | |
slaweq | artom: please look at time of this failed test | 15:12 |
slaweq | it takes always moe than 250 seconds for sure | 15:13 |
slaweq | in "good" run it's much faster | 15:13 |
*** grafuls has joined #openstack-qa | 15:14 | |
artom | slaweq, I wonder when it started - I'm pretty sure it was fine for a while | 15:14 |
artom | From the time the patch merged to the time we started noticing failures | 15:15 |
*** e0ne has quit IRC | 15:15 | |
slaweq | artom: in Neutron I noticed it first time when I reported this bug: https://bugs.launchpad.net/tempest/+bug/1775947 | 15:16 |
openstack | Launchpad bug 1775947 in tempest "tempest.api.compute.servers.test_device_tagging.TaggedAttachmentsTest failing" [Medium,Confirmed] - Assigned to Deepak Mourya (mourya007) | 15:16 |
slaweq | but I don't know if it was like that before or not | 15:16 |
slaweq | artom: from logstash I see that first such hit is 2018-06-19T06:38:03.293+02:00 | 15:19 |
slaweq | (I now checked all projects) | 15:19 |
artom | slaweq, hrmm, the patch (https://review.openstack.org/#/c/391947/) was merged at the end of May, so there was ~1.5 months where it was apparently fine | 15:21 |
* artom wonders if something was merged in Nova around June 19th that would affect this | 15:21 | |
*** kiennt26 has joined #openstack-qa | 15:23 | |
slaweq | artom: but wait, I reported this bug at 09.06 so I think that results from logstash are not complete maybe | 15:23 |
openstackrecheck | Console logs not available after 20:22s for openstack-tox-pep8 577567,4,311d6f1 | 15:27 |
frickler | slaweq: artom: I wouldn't count on logstash to hold more than a week of backlog, I don't know the exact number, but anything longer than that I'd be suspicous about. that patch was merged may 31st, so sound like it may have been unstable all the time | 15:38 |
artom | frickler, fair enough - so the next question is, it is only unstable in some jobs? | 15:38 |
artom | My thinking is, does linuxbridge trigger it more than, say, ovs? | 15:39 |
slaweq | artom: I have no idea about that | 15:40 |
slaweq | that's why I wanted to add this additional log to test | 15:41 |
artom | slaweq, wait, which additional log? | 15:41 |
slaweq | then we could know if it's volume or NIC which is still in metadata | 15:41 |
slaweq | artom: https://review.openstack.org/#/c/578765/ | 15:41 |
slaweq | this | 15:41 |
slaweq | artom: because IMHO this test if failing because there is still something in this metadata | 15:42 |
frickler | I checked a days worth of matches of slaweq's query above and they seem like a normal distribution over all the jobs we run | 15:42 |
slaweq | but test is attaching both: port and volume and I we don't know which is not removed from meta_data.json | 15:43 |
slaweq | frickler: thx for checking :) | 15:43 |
artom | slaweq, hrmm, so I actually just now clicked your first failing test link | 15:43 |
artom | It looks like curl got *killed* | 15:43 |
artom | So it has nothing to do with the metadata itself | 15:44 |
slaweq | artom: but IMO it was killed because instance was removed during some cleanup after test | 15:44 |
artom | slaweq, that would make sense... | 15:44 |
slaweq | please note that it takes always very long time in such failed test | 15:44 |
artom | But I thought we were doing it in a sync way | 15:45 |
*** kopecmartin has quit IRC | 15:45 | |
artom | So, we don't run cleanup until we either verify the metadata or timeout | 15:45 |
slaweq | maybe some timeout is reached then? | 15:45 |
openstackrecheck | Console logs not available after 20:11s for tripleo-ci-centos-7-scenario001-multinode-oooq-container 572312,11,965801c | 15:47 |
artom | slaweq, ahhhh! | 15:48 |
artom | I think we just need to check the result of wait_for_interface_detach | 15:48 |
artom | Hrmm | 15:48 |
artom | Or maybe not | 15:48 |
artom | It if times out, it will raise, so we won't get to the verify_metadata_but | 15:49 |
artom | * bit | 15:49 |
slaweq | artom: yes, I think that wait_for_interface_detach was fine | 15:54 |
slaweq | as it failed in next lines | 15:54 |
slaweq | artom: take a look at this example: http://logs.openstack.org/70/551370/26/check/nova-multiattach/e0fbf66/job-output.txt#_2018-06-20_13_11_35_411721 | 15:57 |
artom | slaweq, right, my thinking was, it wait_for_interface times out but we continue checking the metadata, it would fail with something like that error message | 15:57 |
slaweq | it clearly says that there was something still in this "device" meta_data.json returned from nova | 15:57 |
slaweq | but we don't know if it was volume or network port | 15:58 |
artom | slaweq, yeah, that's a different error though | 15:58 |
artom | Curl worked, and we still have something left | 15:58 |
artom | Let's assume curl getting killed is an exception, and that ^^ is the "real" problem | 15:58 |
slaweq | artom: I agree, IMO killed curl is kind of side effect here | 15:59 |
artom | slaweq, I'm not sure I understand how, but I'm willing to roll with that :) | 16:00 |
slaweq | artom: :) | 16:00 |
artom | slaweq, in that case, yeah, your patch is definitely helpful | 16:00 |
slaweq | artom: might be - if we will see that it's not the case here, we can always revert it | 16:00 |
artom | gmann, I'm on board with https://review.openstack.org/#/c/578765/, FWIW | 16:01 |
*** slaweq has quit IRC | 16:06 | |
openstackrecheck | Console logs not available after 20:08s for openstack-tox-py27 578457,1,c389e8e | 16:08 |
*** shardy has quit IRC | 16:08 | |
*** d0ugal has quit IRC | 16:17 | |
*** kiennt26 has quit IRC | 16:18 | |
*** slaweq has joined #openstack-qa | 16:25 | |
*** raopajay has quit IRC | 16:26 | |
openstackrecheck | Console logs not available after 20:19s for openstack-tox-py27 578461,1,b718042 | 16:28 |
*** dustins has quit IRC | 16:33 | |
*** ramishra has quit IRC | 16:34 | |
*** tesseract has quit IRC | 16:38 | |
openstackrecheck | Console logs not available after 20:14s for tempest-full 578463,1,d2a8ff9 | 16:48 |
*** salv-orlando has joined #openstack-qa | 16:51 | |
*** salv-orlando has quit IRC | 16:56 | |
*** ramishra has joined #openstack-qa | 16:59 | |
*** grafuls has quit IRC | 17:00 | |
*** jpena is now known as jpena|off | 17:01 | |
*** gfidente is now known as gfidente|afk | 17:06 | |
*** grafuls has joined #openstack-qa | 17:07 | |
openstackrecheck | Console logs not available after 20:21s for legacy-tempest-dsvm-neutron-src 578481,1,30df2c2 | 17:08 |
*** alexchadin has joined #openstack-qa | 17:12 | |
*** raildo has quit IRC | 17:12 | |
*** gkadam has quit IRC | 17:15 | |
*** alexchadin has quit IRC | 17:19 | |
*** dtantsur is now known as dtantsur|afk | 17:22 | |
*** spartacloud has joined #openstack-qa | 17:23 | |
*** gcheresh has joined #openstack-qa | 17:25 | |
*** ramishra has quit IRC | 17:26 | |
openstackgerrit | Brian Haley proposed openstack-infra/devstack-gate master: Support an IPv6 underlay network https://review.openstack.org/343041 | 17:27 |
*** spartacloud has quit IRC | 17:27 | |
*** alexchadin has joined #openstack-qa | 17:28 | |
*** e0ne has joined #openstack-qa | 17:28 | |
*** e0ne has quit IRC | 17:28 | |
openstackrecheck | Console logs not available after 20:22s for tripleo-ci-centos-7-undercloud-containers 578447,2,9acbd61 | 17:29 |
openstackgerrit | Brian Haley proposed openstack-infra/devstack-gate master: Support an IPv6 underlay network https://review.openstack.org/343041 | 17:31 |
*** alexchadin has quit IRC | 17:33 | |
*** mvk has quit IRC | 17:35 | |
*** trevormc has joined #openstack-qa | 17:42 | |
*** sridharg has quit IRC | 17:46 | |
*** snapiri- has quit IRC | 17:47 | |
openstackrecheck | Console logs not available after 20:15s for tripleo-ci-centos-7-scenario002-multinode-oooq-container 575330,12,373f202 | 17:49 |
*** salv-orlando has joined #openstack-qa | 17:52 | |
*** gcheresh has quit IRC | 17:53 | |
openstackgerrit | Trevor McCasland proposed openstack/openstack-health master: Add run time graph for jobs https://review.openstack.org/547866 | 17:54 |
*** trevormc has quit IRC | 17:56 | |
*** salv-orlando has quit IRC | 17:56 | |
*** raildo has joined #openstack-qa | 18:05 | |
*** alexchadin has joined #openstack-qa | 18:08 | |
openstackrecheck | Console logs not available after 20:15s for openstack-tox-py35 564441,15,f516396 | 18:09 |
*** alexchadin has quit IRC | 18:13 | |
*** pcaruana has quit IRC | 18:14 | |
*** huzefa has joined #openstack-qa | 18:22 | |
huzefa | I am trying to use osprofiler on devstack and only getting traces from glance, anyone have any ideas? | 18:23 |
openstackrecheck | Console logs not available after 20:11s for openstack-tox-py27 564440,13,6df2c7b | 18:30 |
*** gfidente|afk has quit IRC | 18:37 | |
*** armaan has joined #openstack-qa | 18:40 | |
*** vivsoni_ has joined #openstack-qa | 18:44 | |
*** vivsoni has quit IRC | 18:44 | |
*** armaan has quit IRC | 18:45 | |
*** armaan has joined #openstack-qa | 18:45 | |
*** rfolco is now known as rfolco_afk | 18:46 | |
*** e0ne has joined #openstack-qa | 18:47 | |
openstackrecheck | Console logs not available after 20:09s for neutron-functional 567901,3,18831bd | 18:50 |
*** e0ne has quit IRC | 18:50 | |
*** armaan has quit IRC | 18:50 | |
*** salv-orlando has joined #openstack-qa | 18:53 | |
*** salv-orlando has quit IRC | 18:57 | |
openstackrecheck | Console logs not available after 20:16s for tripleo-ci-centos-7-containers-multinode 578456,3,19bfd4c | 19:10 |
*** gcheresh has joined #openstack-qa | 19:12 | |
*** rfolco_afk is now known as rfolco | 19:20 | |
*** huzefa has quit IRC | 19:28 | |
openstackrecheck | Console logs not available after 20:12s for build-openstack-sphinx-docs 394619,16,db1c6c9 | 19:30 |
*** awaugama has quit IRC | 19:38 | |
openstackrecheck | Console logs not available after 20:21s for neutron-tempest-dvr 562762,4,d565f46 | 19:51 |
*** vivsoni_ has quit IRC | 20:03 | |
*** vivsoni has joined #openstack-qa | 20:03 | |
*** zul has quit IRC | 20:10 | |
openstackrecheck | Console logs not available after 20:17s for openstack-tox-lower-constraints 564448,10,2e290a8 | 20:11 |
*** gcheresh has quit IRC | 20:22 | |
openstackrecheck | Console logs not available after 20:26s for cinder-tempest-dsvm-lvm-lio-barbican 578472,1,a7b9b8c | 20:31 |
*** d0ugal has joined #openstack-qa | 20:39 | |
openstackgerrit | Felipe Monteiro proposed openstack/tempest master: Move volume v2 service client tests to v3 dir https://review.openstack.org/578993 | 20:39 |
*** raildo has quit IRC | 20:44 | |
*** mvk has joined #openstack-qa | 20:47 | |
*** dustins has joined #openstack-qa | 20:47 | |
*** raildo has joined #openstack-qa | 20:50 | |
openstackrecheck | Console logs not available after 20:09s for tripleo-ci-centos-7-scenario002-multinode-oooq-container 567224,37,58591f3 | 20:52 |
*** d0ugal has quit IRC | 20:57 | |
openstackrecheck | Console logs not available after 20:06s for openstack-tox-py27 578458,1,5d87071 | 21:12 |
*** rosmaita has quit IRC | 21:17 | |
*** edmondsw has quit IRC | 21:31 | |
openstackrecheck | Console logs not available after 20:09s for openstack-tox-linters 578023,3,3397e93 | 21:32 |
*** raildo has quit IRC | 21:40 | |
*** rcernin has joined #openstack-qa | 21:42 | |
*** fnaval has quit IRC | 21:44 | |
openstackrecheck | Console logs not available after 20:11s for openstack-tox-py27 565077,10,a05bfad | 21:52 |
*** dustins has quit IRC | 21:52 | |
*** salv-orlando has joined #openstack-qa | 21:55 | |
*** raildo has joined #openstack-qa | 21:55 | |
*** raildo has quit IRC | 21:55 | |
*** salv-orlando has quit IRC | 22:00 | |
openstackrecheck | Console logs not available after 20:13s for legacy-tempest-dsvm-py35-full-devstack-plugin-ceph 543048,6,146565b | 22:12 |
*** hongbin has quit IRC | 22:16 | |
*** ssbarnea has joined #openstack-qa | 22:28 | |
openstackrecheck | Console logs not available after 20:17s for osc-functional-devstack 575256,7,ce71a19 | 22:33 |
*** fnaval has joined #openstack-qa | 22:45 | |
openstackrecheck | Console logs not available after 20:13s for octavia-v1-dsvm-py3x-scenario 559460,8,80510fb | 22:53 |
*** tosky has quit IRC | 22:53 | |
*** salv-orlando has joined #openstack-qa | 22:56 | |
*** salv-orlando has quit IRC | 23:01 | |
openstackrecheck | Console logs not available after 20:11s for swift-tox-func 577577,2,1345d60 | 23:13 |
openstackgerrit | Merged openstack/patrole master: trivial: Drop empty services folder under patrole_tempest_plugin https://review.openstack.org/577952 | 23:24 |
openstackrecheck | Console logs not available after 20:26s for tripleo-ci-centos-7-scenario001-multinode-oooq-container 575571,7,a3f90ed | 23:33 |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Update overpermission/underpermission rbac exceptions https://review.openstack.org/579034 | 23:49 |
openstackrecheck | Console logs not available after 20:15s for requirements-check 578527,1,14ac56d | 23:54 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!