*** yangyapeng has quit IRC | 00:02 | |
*** catintheroof has joined #openstack-qa | 00:03 | |
openstackgerrit | Merged openstack-infra/devstack-gate master: Keep working to clean up PROJECTS list https://review.openstack.org/446623 | 00:04 |
---|---|---|
*** ihrachys has quit IRC | 00:13 | |
*** catintheroof has quit IRC | 00:16 | |
openstackrecheck | Console logs not available after 20:52s for gate-kolla-dsvm-build-centos-source-centos-7 442923,1,e79e4cb | 00:16 |
*** tosky has quit IRC | 00:18 | |
*** zz_dimtruck is now known as dimtruck | 00:19 | |
*** csomerville has joined #openstack-qa | 00:35 | |
*** cody-somerville has quit IRC | 00:35 | |
*** amotoki has joined #openstack-qa | 00:37 | |
openstackrecheck | Console logs not available after 21:22s for gate-rally-docs-ubuntu-xenial 370040,2,87db3ad | 00:38 |
*** gouthamr has joined #openstack-qa | 00:38 | |
*** amotoki has quit IRC | 00:41 | |
openstackrecheck | Console logs not available after 21:46s for gate-octavia-pep8-ubuntu-xenial 441912,2,eafc955 | 00:59 |
gmann | oomichi: masayukig andreaf can you look into those - https://review.openstack.org/#/c/409634/ https://review.openstack.org/#/c/413426/ | 01:00 |
*** catintheroof has joined #openstack-qa | 01:02 | |
*** catintheroof has quit IRC | 01:02 | |
*** catintheroof has joined #openstack-qa | 01:02 | |
*** xiongjh1 has joined #openstack-qa | 01:04 | |
*** gvrangan has quit IRC | 01:05 | |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fixes failing flavor access tests for Member role. https://review.openstack.org/446799 | 01:06 |
*** Apoorva has quit IRC | 01:06 | |
*** armax has quit IRC | 01:13 | |
*** yangyapeng has joined #openstack-qa | 01:16 | |
*** sshnaidm is now known as sshnaidm|off | 01:19 | |
openstackrecheck | Console logs not available after 20:29s for gate-tempest-dsvm-murano-api-ubuntu-xenial 442936,1,d725126 | 01:20 |
*** vhosakot has joined #openstack-qa | 01:28 | |
openstackrecheck | Console logs not available after 20:26s for gate-osc-dsvm-functional-ubuntu-xenial 440150,4,8eab60b | 01:40 |
*** amotoki has joined #openstack-qa | 01:45 | |
*** xiongjh1_ has joined #openstack-qa | 01:47 | |
*** xiongjh1 has quit IRC | 01:47 | |
*** amotoki has quit IRC | 01:50 | |
*** xiongjh1_ has quit IRC | 01:53 | |
*** xiongjh1_ has joined #openstack-qa | 01:53 | |
*** jamielennox is now known as jamielennox|away | 01:56 | |
*** rfolco_ has joined #openstack-qa | 01:57 | |
*** rfolco_ has quit IRC | 01:57 | |
openstackrecheck | Console logs not available after 20:37s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 442691,3,79e2942 | 02:01 |
*** jamielennox|away is now known as jamielennox | 02:01 | |
*** xiongjh1_ has quit IRC | 02:04 | |
*** xiongjh1_ has joined #openstack-qa | 02:05 | |
*** dimtruck is now known as zz_dimtruck | 02:06 | |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fixes instance actions compute rbac test failing for Member role. https://review.openstack.org/446808 | 02:09 |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Partially revert removal of time.sleep if v3 auth enabled in conf. https://review.openstack.org/446813 | 02:20 |
openstackrecheck | Console logs not available after 20:02s for gate-networking-sfc-functional-dsvm-ubuntu-xenial 442140,4,13f8331 | 02:21 |
*** vhosakot has quit IRC | 02:32 | |
*** vhosakot has joined #openstack-qa | 02:32 | |
*** yamahata has quit IRC | 02:35 | |
*** catintheroof has quit IRC | 02:36 | |
openstackrecheck | Console logs not available after 20:06s for gate-networking-sfc-functional-dsvm-ubuntu-xenial 442882,6,786ed01 | 02:41 |
*** hongbin_ has joined #openstack-qa | 02:50 | |
*** gouthamr has quit IRC | 03:01 | |
openstackrecheck | Console logs not available after 20:05s for gate-barbican-pep8-ubuntu-xenial 442344,3,59a019c | 03:01 |
*** ihrachys has joined #openstack-qa | 03:14 | |
*** ihrachys has quit IRC | 03:15 | |
openstackrecheck | Console logs not available after 20:06s for gate-congress-dsvm-api-mysql-ubuntu-xenial 442249,1,803754c | 03:21 |
*** ihrachys has joined #openstack-qa | 03:22 | |
*** ihrachys has quit IRC | 03:23 | |
*** zz_dimtruck is now known as dimtruck | 03:27 | |
openstackrecheck | Console logs not available after 20:04s for gate-tacker-pep8-ubuntu-xenial 424425,6,d9c4adc | 03:42 |
*** vhosakot_ has joined #openstack-qa | 03:44 | |
*** vhosakot has quit IRC | 03:46 | |
*** amotoki has joined #openstack-qa | 03:46 | |
*** amotoki has quit IRC | 03:51 | |
*** markvoelker_ has quit IRC | 03:53 | |
*** udesale has joined #openstack-qa | 04:00 | |
openstackrecheck | Console logs not available after 20:04s for gate-tempest-dsvm-networking-sfc-ubuntu-xenial 442882,7,ffe3c33 | 04:02 |
*** yamahata has joined #openstack-qa | 04:13 | |
*** alex_xu has quit IRC | 04:17 | |
openstackrecheck | Console logs not available after 20:13s for gate-networking-sfc-python27-ubuntu-xenial 442883,5,f9f7c48 | 04:22 |
*** alex_xu has joined #openstack-qa | 04:23 | |
*** dimtruck is now known as zz_dimtruck | 04:35 | |
*** hongbin_ has quit IRC | 04:39 | |
openstackrecheck | Console logs not available after 20:06s for gate-cross-cinder-python27-ubuntu-xenial 442061,5,878bbd2 | 04:42 |
*** ihrachys has joined #openstack-qa | 04:49 | |
*** ihrachys has quit IRC | 04:50 | |
*** xiongjh1_ has quit IRC | 04:51 | |
*** cody-somerville has joined #openstack-qa | 04:54 | |
*** csomerville has quit IRC | 04:54 | |
*** csomerville has joined #openstack-qa | 04:58 | |
*** cody-somerville has quit IRC | 04:58 | |
*** yangyape_ has joined #openstack-qa | 05:00 | |
openstackrecheck | Console logs not available after 20:07s for gate-tempest-dsvm-networking-sfc-ubuntu-xenial 442140,5,9b62404 | 05:02 |
*** yangyapeng has quit IRC | 05:02 | |
*** csomerville has quit IRC | 05:12 | |
openstackgerrit | Julian Edwards proposed openstack-dev/devstack master: Make running_in_container work with LXD https://review.openstack.org/446217 | 05:21 |
openstackrecheck | Console logs not available after 20:03s for gate-nova-pep8-ubuntu-xenial 442295,10,cd29094 | 05:22 |
*** shausy has joined #openstack-qa | 05:34 | |
*** erlon has quit IRC | 05:35 | |
*** nadya has joined #openstack-qa | 05:41 | |
openstackrecheck | Console logs not available after 20:04s for gate-networking-odl-python27-ubuntu-xenial 334250,3,e1ff32e | 05:42 |
*** nadya has quit IRC | 05:46 | |
*** yangyape_ has quit IRC | 05:48 | |
*** yangyapeng has joined #openstack-qa | 05:51 | |
openstackrecheck | Console logs not available after 20:04s for gate-rally-docs-ubuntu-xenial 370040,3,e5efcd0 | 06:02 |
*** yangyapeng has quit IRC | 06:06 | |
*** gvrangan has joined #openstack-qa | 06:06 | |
*** tuanluong has joined #openstack-qa | 06:11 | |
*** gcheresh_ has joined #openstack-qa | 06:13 | |
*** k4n0 has joined #openstack-qa | 06:15 | |
*** yangyapeng has joined #openstack-qa | 06:18 | |
openstackrecheck | Console logs not available after 20:04s for gate-tempest-dsvm-monasca-python-mysql-full-ubuntu-xenial 440847,8,6da868b | 06:22 |
*** yangyapeng has quit IRC | 06:24 | |
*** yangyapeng has joined #openstack-qa | 06:26 | |
*** abehl has joined #openstack-qa | 06:32 | |
*** sridharg has joined #openstack-qa | 06:37 | |
*** gcheresh_ has quit IRC | 06:38 | |
*** zhouyf6_ has left #openstack-qa | 06:40 | |
*** pgadiya has joined #openstack-qa | 06:42 | |
openstackrecheck | Console logs not available after 20:11s for gate-cliff-python27-ubuntu-xenial 442419,1,8f96b47 | 06:43 |
*** pgadiya has left #openstack-qa | 06:45 | |
*** r-mibu has quit IRC | 06:47 | |
*** r-mibu has joined #openstack-qa | 06:52 | |
openstackgerrit | Jeremy Zhang proposed openstack/tempest master: Add test case for update volume encryption type https://review.openstack.org/446864 | 07:02 |
openstackrecheck | Console logs not available after 20:20s for gate-taskflow-python35 442949,1,7ee6fcd | 07:03 |
*** k4n0 has quit IRC | 07:06 | |
*** markus_z has joined #openstack-qa | 07:12 | |
*** e0ne has joined #openstack-qa | 07:16 | |
*** JayF has quit IRC | 07:20 | |
*** nadya has joined #openstack-qa | 07:21 | |
openstackrecheck | Console logs not available after 20:07s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 442905,1,9151b56 | 07:23 |
*** jbernard has quit IRC | 07:23 | |
*** jbernard has joined #openstack-qa | 07:23 | |
*** vhosakot_ has quit IRC | 07:25 | |
*** zz_dimtruck is now known as dimtruck | 07:26 | |
*** nadya_ has joined #openstack-qa | 07:27 | |
*** nadya has quit IRC | 07:29 | |
*** JayF has joined #openstack-qa | 07:33 | |
*** tesseract has joined #openstack-qa | 07:34 | |
*** dimtruck is now known as zz_dimtruck | 07:36 | |
*** zhufl has quit IRC | 07:36 | |
*** zhufl has joined #openstack-qa | 07:37 | |
*** e0ne has quit IRC | 07:40 | |
*** abehl has quit IRC | 07:42 | |
*** pcaruana has joined #openstack-qa | 07:43 | |
openstackrecheck | Console logs not available after 20:06s for gate-networking-odl-python27-ubuntu-xenial 442872,3,f151a9a | 07:43 |
*** amotoki has joined #openstack-qa | 07:48 | |
*** amotoki has quit IRC | 07:52 | |
openstackgerrit | Ghanshyam Mann proposed openstack/tempest master: Separate volume v2 transfers service clients https://review.openstack.org/438006 | 07:53 |
*** tmatsu has quit IRC | 07:59 | |
*** tmatsu has joined #openstack-qa | 08:00 | |
*** hferenc has quit IRC | 08:01 | |
openstackrecheck | Console logs not available after 20:10s for gate-trove-functional-dsvm-mysql-ubuntu-xenial 442871,1,6e7f8d3 | 08:03 |
*** tmatsu has quit IRC | 08:04 | |
*** rossella_s has joined #openstack-qa | 08:05 | |
*** gfidente has joined #openstack-qa | 08:11 | |
*** gcheresh_ has joined #openstack-qa | 08:13 | |
*** gcheresh_ has quit IRC | 08:18 | |
*** gcheresh_ has joined #openstack-qa | 08:23 | |
openstackrecheck | Console logs not available after 20:05s for gate-telemetry-dsvm-integration-panko-ubuntu-xenial 442293,2,cfdc5ac | 08:23 |
*** tmatsu has joined #openstack-qa | 08:24 | |
*** tmatsu has quit IRC | 08:28 | |
*** abehl has joined #openstack-qa | 08:30 | |
*** shausy has quit IRC | 08:33 | |
*** shausy has joined #openstack-qa | 08:34 | |
*** amoralej|off is now known as amoralej | 08:38 | |
*** udesale has quit IRC | 08:41 | |
*** udesale has joined #openstack-qa | 08:41 | |
*** aarefiev_afk is now known as aarefiev | 08:43 | |
openstackrecheck | Console logs not available after 20:05s for gate-cross-cinder-python27-ubuntu-xenial 442061,5,d347302 | 08:44 |
*** hferenc has joined #openstack-qa | 08:47 | |
*** k4n0 has joined #openstack-qa | 08:54 | |
*** yamamoto has quit IRC | 08:57 | |
*** shardy has joined #openstack-qa | 09:01 | |
openstackrecheck | Console logs not available after 20:10s for gate-heat-dsvm-functional-convg-mysql-lbaasv2-non-apache-ubuntu-xenial 442943,1,b8ee5e3 | 09:04 |
openstackgerrit | Mh Raies proposed openstack/patrole master: Adding compute server tests https://review.openstack.org/445435 | 09:06 |
*** Serlex has joined #openstack-qa | 09:06 | |
openstackgerrit | Mh Raies proposed openstack/patrole master: Adding compute server tests https://review.openstack.org/445435 | 09:09 |
*** dtantsur|sick is now known as dtantsur | 09:10 | |
*** david-lyle_ has joined #openstack-qa | 09:18 | |
*** david-lyle has quit IRC | 09:18 | |
openstackrecheck | Console logs not available after 20:16s for gate-ironic-docs-ubuntu-xenial 441625,3,0b0ccc0 | 09:24 |
openstackgerrit | Mh Raies proposed openstack/patrole master: Adding compute server tests https://review.openstack.org/445435 | 09:31 |
prateek | ping andreaf, please let me know when you have some bandwidth to discuss about https://review.openstack.org/#/c/445419/ | 09:32 |
prateek | ping dpaterson, please let me know when you have some bandwidth to discuss about https://review.openstack.org/#/c/445419/ | 09:32 |
*** yamamoto has joined #openstack-qa | 09:35 | |
*** yamamoto has quit IRC | 09:38 | |
*** yamamoto has joined #openstack-qa | 09:38 | |
*** gcheresh_ has quit IRC | 09:41 | |
*** yamamoto has quit IRC | 09:42 | |
openstackrecheck | Console logs not available after 20:08s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 433497,6,024e0bf | 09:44 |
*** amotoki has joined #openstack-qa | 09:48 | |
*** amotoki has quit IRC | 09:53 | |
*** e0ne has joined #openstack-qa | 09:54 | |
*** nadya_ has quit IRC | 09:56 | |
*** mriedem has quit IRC | 09:58 | |
*** mriedem has joined #openstack-qa | 09:58 | |
*** nadya has joined #openstack-qa | 10:03 | |
*** mriedem has quit IRC | 10:03 | |
*** rcernin has joined #openstack-qa | 10:04 | |
openstackrecheck | Console logs not available after 20:11s for gate-trove-functional-dsvm-mysql-ubuntu-xenial 412299,5,8df6841 | 10:04 |
*** tosky has joined #openstack-qa | 10:05 | |
*** aojea has joined #openstack-qa | 10:10 | |
*** yangyapeng has quit IRC | 10:16 | |
*** shausy has quit IRC | 10:16 | |
*** shausy has joined #openstack-qa | 10:16 | |
openstackrecheck | Console logs not available after 20:07s for gate-os-client-config-requirements 436388,3,9c09538 | 10:25 |
openstackgerrit | Merged openstack-dev/devstack master: Updated from generate-devstack-plugins-list https://review.openstack.org/446333 | 10:27 |
andreaf | prateek: hi - what's up? | 10:31 |
prateek | Hi andreaf, thanks for replying | 10:32 |
prateek | i am working on adding a --save-state option in tempest run | 10:32 |
andreaf | yes I remember we talked about it | 10:33 |
prateek | and making save state as default option like tempest run --no-save-state and only then the save state would be skipped | 10:33 |
prateek | while i am able to run tempest run and the save state works fine in cmd | 10:34 |
prateek | andreaf, that is good then, i would have less explaining | 10:34 |
prateek | :) | 10:34 |
prateek | but the UT fails in test_run.py | 10:34 |
andreaf | prateek: so while I understand the reason why you want that to be the default, I don't think we should make it default - not yet at least - because that would have an impact on the workflow of people using tempest run today | 10:35 |
tosky | uhm, why? | 10:36 |
prateek | andreaf, okk, i would change that, another thing i wanted to ask was the failing UT | 10:36 |
prateek | http://paste.openstack.org/show/603102/ | 10:36 |
prateek | the cmd is successful but the UT fails | 10:36 |
tosky | if the difference is just a file more with the saved state, people who don't use it will not even notice | 10:36 |
andreaf | tosky: well I'm not sure - it will add time to the run for one thing | 10:37 |
prateek | tosky, that sounds good, the difference is just a new file being created | 10:37 |
tosky | andreaf: is it so slow? :) | 10:37 |
andreaf | tosky: I'm don | 10:37 |
*** cdent has joined #openstack-qa | 10:38 | |
andreaf | tosky: I don't know I guess it may depend on what it's in your cloud | 10:38 |
tosky | I don't remember it being noticeably slow - the discovery phase of the tests can be slow as well | 10:38 |
prateek | andreaf, tosky , it is pretty quick when i run | 10:38 |
tosky | prateek: can you try it with a big cluster with more resources? | 10:38 |
prateek | andreaf, yup , should depend on the cloud as well | 10:38 |
prateek | tosky, sure would do | 10:38 |
prateek | andreaf, another thing i wanted to ask was how do i debug a tempest test, since it does not mock and uses python module to run the command | 10:39 |
prateek | http://paste.openstack.org/show/603102/ | 10:39 |
prateek | andreaf, tosky ^ | 10:39 |
prateek | it says that the test fails when it runs tempest run --regex passing | 10:40 |
prateek | in the UT | 10:40 |
prateek | but when i run it on the command line it runs fine | 10:40 |
prateek | andreaf, tosky , this is when i run tempest run --regex passing | 10:41 |
prateek | http://paste.openstack.org/show/603103/ | 10:41 |
*** yamamoto has joined #openstack-qa | 10:41 | |
prateek | and this is the failed UT saying that tempest run --regex passing fails http://paste.openstack.org/show/603102/ | 10:42 |
andreaf | prateek: yeah I don't like those unit tests much, they are very platform specific I think - I had problems before with them running on macos for instance | 10:42 |
prateek | andreaf, :/ | 10:42 |
andreaf | prateek: but at least they keep the run command from breaking :) | 10:42 |
andreaf | prateek: you're welcome to refactor them and not use subprocess if you want | 10:43 |
prateek | andreaf, that sounds good, would give it a shot | 10:43 |
prateek | thanks ! | 10:43 |
*** tuanluong has quit IRC | 10:44 | |
andreaf | prateek: it terms of debugging, try to debug up to where the subprocess is invoked and check the exact command invoked | 10:44 |
andreaf | prateek: that should allow you to reproduce the issue | 10:44 |
openstackrecheck | Console logs not available after 20:08s for gate-ec2-api-python35 442779,1,80efa1d | 10:45 |
andreaf | prateek: note that if you have a tempest.conf in place that may hide issues in the unit tests | 10:45 |
*** edannon has joined #openstack-qa | 10:45 | |
prateek | andreaf, i tried entering it using s in pdb and was lost then | 10:45 |
andreaf | prateek: when unit tests are executed there is no tempest.conf in place, so make sure you don't have one when trying to reproduce the issue | 10:45 |
prateek | andreaf, yup, i have a tempest.conf, i would try without that | 10:45 |
prateek | and that might be the reason it would be pulling values i dont have otherwise | 10:46 |
prateek | andreaf, ahhh | 10:46 |
andreaf | prateek: heh I'm lazy I usually debug with pycharm :P | 10:46 |
*** rcernin has quit IRC | 10:46 | |
prateek | andreaf, i got a pycharm professional today only so would try doing that with pycharm today :) | 10:46 |
andreaf | heh it's handy for debugging I think | 10:47 |
prateek | thanks andreaf :) | 10:47 |
andreaf | prateek: thank you for working on that | 10:47 |
prateek | :) | 10:47 |
*** udesale has quit IRC | 10:48 | |
*** yamahata has quit IRC | 10:54 | |
openstackrecheck | Console logs not available after 20:12s for gate-grenade-dsvm-ceilometer-ubuntu-xenial 442781,1,9701c98 | 11:05 |
openstackrecheck | Console logs not available after 20:14s for gate-neutron-pep8-ubuntu-xenial 442375,3,e77ee27 | 11:25 |
*** yangyapeng has joined #openstack-qa | 11:26 | |
*** aojea_ has joined #openstack-qa | 11:28 | |
*** aojea has quit IRC | 11:31 | |
*** gcheresh_ has joined #openstack-qa | 11:32 | |
openstackrecheck | Console logs not available after 20:17s for gate-heat-dsvm-functional-convg-mysql-lbaasv2-ubuntu-xenial 442215,3,91e8a77 | 11:45 |
*** gszasz has joined #openstack-qa | 11:48 | |
*** amotoki has joined #openstack-qa | 11:49 | |
*** shausy has quit IRC | 11:51 | |
*** shausy has joined #openstack-qa | 11:51 | |
*** amotoki has quit IRC | 11:53 | |
*** shardy is now known as shardy_lunch | 12:04 | |
*** nadya has quit IRC | 12:04 | |
openstackrecheck | Console logs not available after 20:16s for gate-neutron-python27-ubuntu-xenial 411741,21,a81f0bf | 12:06 |
*** aysyd has joined #openstack-qa | 12:06 | |
*** rossella_s has quit IRC | 12:11 | |
*** rossella_s has joined #openstack-qa | 12:12 | |
*** edannon has quit IRC | 12:13 | |
*** bkopilov has quit IRC | 12:16 | |
*** Serlex has quit IRC | 12:17 | |
openstackrecheck | Console logs not available after 20:14s for gate-ec2-api-pep8-ubuntu-xenial 361172,14,8f80561 | 12:26 |
*** nadya has joined #openstack-qa | 12:31 | |
*** erlon has joined #openstack-qa | 12:33 | |
*** markvoelker has joined #openstack-qa | 12:35 | |
openstackgerrit | Jordan Pittier proposed openstack-infra/devstack-gate master: Don't run nova-cert by default https://review.openstack.org/446986 | 12:39 |
*** fandi has joined #openstack-qa | 12:39 | |
openstackrecheck | Console logs not available after 20:09s for gate-rally-python27-ubuntu-xenial 370040,4,41aa284 | 12:46 |
*** nadya has quit IRC | 12:47 | |
*** shausy has quit IRC | 12:48 | |
*** felipemonteiro_ has joined #openstack-qa | 12:48 | |
openstackgerrit | Merged openstack-dev/devstack stable/ocata: Fix install_libvirt for other RHEL-based distros https://review.openstack.org/445395 | 12:49 |
*** dustins has joined #openstack-qa | 12:51 | |
*** mriedem has joined #openstack-qa | 12:55 | |
*** yamamoto has quit IRC | 12:55 | |
*** yamamoto has joined #openstack-qa | 12:56 | |
*** awaugama has joined #openstack-qa | 12:58 | |
openstackrecheck | Console logs not available after 20:09s for gate-kuryr-kubernetes-python27-ubuntu-xenial 436877,7,62f42d1 | 13:06 |
*** catintheroof has joined #openstack-qa | 13:10 | |
*** catintheroof has quit IRC | 13:10 | |
*** catintheroof has joined #openstack-qa | 13:10 | |
*** nadya has joined #openstack-qa | 13:11 | |
*** tmatsu has joined #openstack-qa | 13:11 | |
*** esberglu has joined #openstack-qa | 13:14 | |
*** tmatsu has quit IRC | 13:16 | |
*** bkopilov has joined #openstack-qa | 13:18 | |
*** nadya has quit IRC | 13:20 | |
*** gouthamr has joined #openstack-qa | 13:23 | |
*** nadya has joined #openstack-qa | 13:25 | |
openstackrecheck | Console logs not available after 20:11s for gate-cinder-pep8-ubuntu-xenial 442288,5,5ce162c | 13:27 |
*** ihrachys has joined #openstack-qa | 13:27 | |
*** nadya_ has joined #openstack-qa | 13:27 | |
*** nadya has quit IRC | 13:28 | |
*** amotoki has joined #openstack-qa | 13:29 | |
*** rfolco has joined #openstack-qa | 13:29 | |
*** dave-mccowan has joined #openstack-qa | 13:30 | |
*** nadya_ has quit IRC | 13:33 | |
*** amotoki has quit IRC | 13:33 | |
*** nadya has joined #openstack-qa | 13:34 | |
*** bkopilov has quit IRC | 13:34 | |
*** ihrachys has quit IRC | 13:38 | |
*** ihrachys_ has joined #openstack-qa | 13:38 | |
*** weshay_pto is now known as weshay_sick | 13:40 | |
*** aysyd has quit IRC | 13:46 | |
openstackrecheck | Console logs not available after 20:06s for gate-tempest-dsvm-neutron-full-ubuntu-xenial-ocata 442905,1,c1ef510 | 13:47 |
openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate master: Revert "Keep working to clean up PROJECTS list" https://review.openstack.org/447004 | 13:47 |
*** bkopilov has joined #openstack-qa | 13:48 | |
openstackgerrit | Joe Hakim Rahme proposed openstack/tempest master: Add tests for compute v2.40 microversion https://review.openstack.org/447005 | 13:48 |
openstackgerrit | David Rabel proposed openstack-dev/devstack master: Create /opt/stack and make it home directory https://review.openstack.org/447006 | 13:49 |
*** gvrangan has quit IRC | 13:55 | |
*** shardy_lunch is now known as shardy | 13:56 | |
*** dustins has quit IRC | 13:59 | |
*** jdandrea has joined #openstack-qa | 14:01 | |
*** diltram has quit IRC | 14:05 | |
openstackrecheck | Console logs not available after 20:10s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 433497,7,3281136 | 14:07 |
*** hongbin has joined #openstack-qa | 14:08 | |
*** jdandrea has quit IRC | 14:16 | |
*** nadya has quit IRC | 14:19 | |
*** prateek has quit IRC | 14:22 | |
*** diltram_ has joined #openstack-qa | 14:23 | |
*** Serlex has joined #openstack-qa | 14:25 | |
*** gcheresh_ has quit IRC | 14:26 | |
openstackrecheck | Console logs not available after 20:15s for gate-cliff-python27-ubuntu-xenial 442419,2,d519353 | 14:27 |
openstackgerrit | Merged openstack-dev/devstack master: Added list of mlock-using processes to peakmem_tracker output https://review.openstack.org/434470 | 14:31 |
*** zz_dimtruck is now known as dimtruck | 14:31 | |
*** amoralej is now known as amoralej|lunch | 14:34 | |
openstackgerrit | David Rabel proposed openstack-dev/devstack master: Create /opt/stack and make it home directory https://review.openstack.org/447006 | 14:35 |
sdague | jlvillal: is this a change you want to backport - https://review.openstack.org/#/c/445176 | 14:35 |
jlvillal | sdague, I can if desired. | 14:36 |
jlvillal | sdague, I had noticed it when looking at log files | 14:36 |
openstackgerrit | Sean Dague proposed openstack-dev/devstack master: Make running_in_container work with LXD https://review.openstack.org/446217 | 14:38 |
sdague | jlvillal: your call, I wasn't sure if you wanted it back on stable branches for ironic | 14:39 |
sdague | it's the kind of targetted changes that I will often take all the way back so we don't have to ponder that master and stable work differently | 14:39 |
openstackgerrit | John L. Villalovos proposed openstack-dev/devstack stable/ocata: Use string comparison to compare UUID values https://review.openstack.org/447015 | 14:40 |
jlvillal | sdague, ^^^ | 14:40 |
openstackgerrit | John L. Villalovos proposed openstack-dev/devstack stable/newton: Use string comparison to compare UUID values https://review.openstack.org/447016 | 14:41 |
jlvillal | sdague, and ^^^ | 14:41 |
sdague | jlvillal: thanks | 14:42 |
jlvillal | sdague, You're welcome | 14:42 |
*** yamamoto has quit IRC | 14:43 | |
*** tosky has quit IRC | 14:43 | |
*** tosky has joined #openstack-qa | 14:44 | |
*** yamamoto has joined #openstack-qa | 14:45 | |
*** sc68cal has quit IRC | 14:47 | |
openstackrecheck | Console logs not available after 20:08s for gate-grenade-dsvm-ceilometer-ubuntu-xenial 442781,1,e1de4de | 14:47 |
*** raj_sing- is now known as raj_singh | 14:49 | |
*** yamamoto has quit IRC | 14:50 | |
openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate master: Revert "Keep working to clean up PROJECTS list" https://review.openstack.org/447004 | 14:51 |
*** fandi has quit IRC | 14:53 | |
*** jdandrea has joined #openstack-qa | 14:57 | |
*** k4n0 has quit IRC | 15:00 | |
*** markus_z has quit IRC | 15:02 | |
openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate master: Revert "Keep working to clean up PROJECTS list" https://review.openstack.org/447004 | 15:04 |
*** Serlex has quit IRC | 15:06 | |
openstackgerrit | Mh Raies proposed openstack/patrole master: Adding compute server tests https://review.openstack.org/445435 | 15:06 |
openstackrecheck | Console logs not available after 20:13s for gate-python-neutronclient-python27-ubuntu-xenial 442980,1,33edd21 | 15:07 |
*** mriedem is now known as mriedem_afk | 15:10 | |
*** dansmith is now known as superdan | 15:10 | |
sdague | dtroyer: any idea what TRACK_DEPENDS is really for? | 15:12 |
*** armax has joined #openstack-qa | 15:12 | |
*** amoralej|lunch is now known as amoralej | 15:13 | |
openstackgerrit | David Rabel proposed openstack-dev/devstack master: Add Debian testing to known Distros https://review.openstack.org/447027 | 15:15 |
*** dave-mccowan has quit IRC | 15:15 | |
sdague | dhellmann: I realize you are about to cut out on vacation, but in looking through https://review.openstack.org/#/c/444775 it appears that the infrastructure to run split has some short comings. Because libraries getting installed that were done at a global level (which will also hit LIBS_FROM_GIT) actually need to be double installed | 15:21 |
sdague | and... as I stare at the real solution for that ... my brain mildly melts | 15:21 |
dhellmann | sdague : does https://review.openstack.org/#/c/418135/ not solve that? | 15:25 |
dhellmann | maybe a similar check needs to happen somewhere else? | 15:26 |
sdague | dhellmann: it does for the LIBS_FROM_GIT thing, but it doesn't for things like install_keystone_middleware | 15:26 |
dhellmann | aha, I see what you mean now | 15:27 |
dhellmann | I guess I didn't realize we had anything in place installing packages that were not in requirements lists | 15:27 |
sdague | yeh, we do that based on feature selection | 15:27 |
dhellmann | oy | 15:28 |
openstackrecheck | Console logs not available after 20:10s for gate-grenade-dsvm-ceilometer-ubuntu-xenial 441734,2,55503c4 | 15:28 |
sdague | well, all this predates the feature flagging in setup.py | 15:28 |
dhellmann | yeah | 15:28 |
*** dsariel has joined #openstack-qa | 15:28 | |
sdague | and not a lot of projects moved over to it | 15:28 |
dhellmann | no, I just didn't know devstack well enough to know that was a thing | 15:28 |
*** dave-mccowan has joined #openstack-qa | 15:28 | |
dhellmann | so that's an option, then. can we move those dependencies into "extras" in the projects and have devstack use them? | 15:29 |
sdague | anyway, I kind of want to figure out if this is going to completely block heat moving forward, or it just means they'll be missing like 10% coverage | 15:29 |
sdague | dhellmann: sure, in this case it would be a swift patch to get keystonemiddleware into an optional depends | 15:29 |
dhellmann | is the only "special" case this middleware thing with swift? | 15:29 |
sdague | dhellmann: it's the only one thus found | 15:29 |
dhellmann | since swift is not yet installed under python 3? | 15:30 |
dhellmann | ok, so an expedient solution would be to put in a pip_install_2_and_3 function that does what I did in the setup_dev_lib function, then call that to install keystonemiddleware | 15:30 |
dhellmann | I'm not sure which is better long term, that or adding extras to projects | 15:31 |
sdague | it would be, but again, this stuff is getting weird. And we said we'd delete it by end of cycle. And my experience in deleting weird stuff is people start using it bug for bug in jobs to get behavior you were not expecting | 15:31 |
dhellmann | I can see not wanting to encode dependencies directly in devstack | 15:31 |
*** armax has quit IRC | 15:32 | |
dhellmann | so you think maybe living with the test coverage issues for now is better? | 15:32 |
sdague | depending on how big those gaps are, yes | 15:32 |
dhellmann | I think that's one of 3 reasonable options | 15:32 |
dhellmann | yeah, I could live with that | 15:32 |
dhellmann | I have no idea how much coverage is at issue | 15:33 |
sdague | right, I'd like that data before making a call at how much work around we'd do | 15:33 |
dhellmann | now, what do we do in queens when swift is still not running on python3? | 15:33 |
* dtroyer catching up... | 15:33 | |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Identity V3 rbac_base method refactor https://review.openstack.org/446055 | 15:33 |
dtroyer | TRACK_DEPENDS was an early way to get the list of python deps for … something? I think CI used it at one point, I doubt they still do | 15:33 |
dhellmann | maybe using the extras solution is better, long term | 15:33 |
openstackgerrit | Merged openstack/patrole master: Fixes instance actions compute rbac test failing for Member role. https://review.openstack.org/446808 | 15:33 |
dtroyer | sdague: ^^^ | 15:34 |
sdague | dhellmann: yeh, extras helps | 15:34 |
*** Apoorva has joined #openstack-qa | 15:34 | |
dhellmann | is heat's setup for devstack within the devstack repo? | 15:34 |
dhellmann | a 4th option is to do some custom stuff in their devstack plugin | 15:35 |
dhellmann | though that feels like something we'll end up repeating for other projects | 15:35 |
dhellmann | at which point we might as well just put it right into devstack directly | 15:35 |
sdague | though, honestly, I think if the answer is "we want the whole python ecosystem to support python3" and swift is really far behind there, and we're getting deployers that are going python3 only, we're just going to need to decide what that all means | 15:35 |
sdague | dhellmann: it's not in devstack, it's a plugin | 15:35 |
dhellmann | even if we do put extras into swift, we have to change devstack to use that target | 15:35 |
*** felipemonteiro_ has quit IRC | 15:35 | |
sdague | yeh | 15:36 |
dhellmann | I think I've talked myself into supporting a special case in install_swift for now. | 15:36 |
sdague | from a cleanliness and a "what the heck is going on" perspective, I'd kind of like devstack to be either pure python2 or python3 | 15:36 |
dhellmann | maybe not with a generic function, just some local logic | 15:36 |
dhellmann | I would too | 15:36 |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fixes failing flavor access tests for Member role. https://review.openstack.org/446799 | 15:37 |
dhellmann | we are extremely unlikely to have all projects on 3 by the end of pike | 15:37 |
dhellmann | we will have many, but not all | 15:37 |
sdague | sure | 15:37 |
dhellmann | so does that mean moving the "set up swift" stuff out of devstack and putting it somewhere else? if so, where? | 15:37 |
sdague | but the real issue is just what things do those projects depend on | 15:37 |
dhellmann | or do we say that we install swift from system packages? | 15:38 |
dhellmann | like our other dependencies | 15:38 |
dhellmann | that doesn't seem ideal for integration testing | 15:38 |
sdague | yeh, I don't know | 15:38 |
sdague | anyway, lets get heat data and see | 15:38 |
dhellmann | what other projects need swift in their tests? glance? | 15:39 |
sdague | there is a swift backend that's not being tested in glance, but again, it's optional | 15:39 |
dhellmann | ok | 15:40 |
openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Handle trailing commas in source libs list https://review.openstack.org/447037 | 15:40 |
*** Serlex has joined #openstack-qa | 15:40 | |
openstackgerrit | Rick Bartra proposed openstack/patrole master: Update Cinder test that incorrectly handles 404 https://review.openstack.org/446155 | 15:41 |
*** mriedem_afk is now known as mriedem | 15:42 | |
openstackgerrit | Jordan Pittier proposed openstack-dev/devstack master: Apache Keystone Template: reduce the number of processes to 3 https://review.openstack.org/445910 | 15:43 |
openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Handle trailing commas in source libs list https://review.openstack.org/447037 | 15:45 |
openstackgerrit | Ihar Hrachyshka proposed openstack-dev/devstack master: Install psutil before starting memory_tracker https://review.openstack.org/447040 | 15:45 |
openstackrecheck | Console logs not available after 20:16s for gate-tacker-python27-ubuntu-xenial 439719,3,4a0b1a9 | 15:48 |
*** yamamoto has joined #openstack-qa | 15:48 | |
openstackgerrit | Merged openstack-dev/devstack master: Xen: restrict devstack VM use upto 8 vCPUs. https://review.openstack.org/445348 | 15:49 |
openstackgerrit | Merged openstack-dev/devstack master: FAQ: remove references to stable/kilo: use stable/ocata instead https://review.openstack.org/445921 | 15:49 |
openstackgerrit | Merged openstack-dev/devstack master: Install same packages for neutron-* services as for q-* https://review.openstack.org/441571 | 15:49 |
*** aarefiev is now known as aarefiev_afk | 15:51 | |
*** aysyd has joined #openstack-qa | 15:56 | |
*** yamamoto has quit IRC | 15:56 | |
*** dsariel has quit IRC | 15:57 | |
jroll | sdague: dhellmann: jfyi, there are ironic jobs that depend on swift as a glance backend | 16:01 |
sdague | jroll: hard dependency? | 16:02 |
sdague | and, is it all of them? | 16:02 |
jroll | sdague: yes, for some, not all | 16:02 |
sdague | because the concern mostly is about python3 porting | 16:02 |
jroll | right, we'll be able to mostly test ironic on py3 without swift being happy with py3 | 16:02 |
jroll | but I wanted to give that data point, since doug asked | 16:03 |
jroll | (it's a hard dependency of one of our deploy modes, to answer that question in more detail) | 16:03 |
*** abehl has quit IRC | 16:06 | |
openstackgerrit | Merged openstack-dev/devstack master: Use string comparison to compare UUID values https://review.openstack.org/445176 | 16:07 |
openstackgerrit | Merged openstack-dev/devstack master: Remove glare from glance https://review.openstack.org/442452 | 16:07 |
openstackgerrit | Merged openstack-dev/devstack master: Fix IPv6 provider networks https://review.openstack.org/424444 | 16:07 |
openstackrecheck | Console logs not available after 20:17s for networking-odl-coverage-ubuntu-xenial 421127,15,cac43ad | 16:08 |
openstackgerrit | Ihar Hrachyshka proposed openstack-dev/devstack master: Set up sudoers to never require password for mlock_report.py https://review.openstack.org/447048 | 16:09 |
*** nadya has joined #openstack-qa | 16:10 | |
*** Apoorva has quit IRC | 16:12 | |
openstackgerrit | Ihar Hrachyshka proposed openstack-dev/devstack master: Install psutil before starting memory_tracker https://review.openstack.org/447040 | 16:15 |
openstackgerrit | Ihar Hrachyshka proposed openstack-dev/devstack master: Set up sudoers to never require password for mlock_report.py https://review.openstack.org/447048 | 16:16 |
*** dustins has joined #openstack-qa | 16:18 | |
andreaf | sdague: https://review.openstack.org/#/c/446986/ ? | 16:20 |
*** rossella_s has quit IRC | 16:22 | |
*** aojea_ has quit IRC | 16:28 | |
openstackrecheck | Console logs not available after 20:10s for gate-neutron-pep8-ubuntu-xenial 433637,10,5c33f33 | 16:28 |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Deprecate Cinder v1 API option https://review.openstack.org/446238 | 16:34 |
sdague | andreaf: +A | 16:35 |
*** sridharg has quit IRC | 16:36 | |
andreaf | sdague: thanks! | 16:39 |
andreaf | sdague: and if you have a sec for another d-g patch, this is for the scenario job: https://review.openstack.org/#/c/442565/ | 16:39 |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fixes router external_fixed_ip tests sometimes failing with Conflict. https://review.openstack.org/447061 | 16:43 |
openstackgerrit | Ken'ichi Ohmichi proposed openstack-dev/devstack stable/mitaka: Set Cinder's api_v3 False on Temepst setting https://review.openstack.org/447062 | 16:43 |
dhellmann | jroll : thanks. I think we're going to have to figure out how to support projects that want to run tests against swift while swift needs python 2. There are several options for that, none of them particularly appealing. | 16:45 |
*** abehl has joined #openstack-qa | 16:47 | |
openstackrecheck | Console logs not available after 20:10s for gate-kolla-dsvm-build-ubuntu-source-ubuntu-xenial 434431,8,664257e | 16:49 |
*** dustins has quit IRC | 16:53 | |
*** dustins has joined #openstack-qa | 16:57 | |
*** e0ne has quit IRC | 16:59 | |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Change Cinder api_v3 config True on default https://review.openstack.org/447067 | 17:00 |
*** armax has joined #openstack-qa | 17:01 | |
oomichi | andreaf: I separate cinder api config patch into https://review.openstack.org/#/c/446238/ and https://review.openstack.org/#/c/447067 | 17:02 |
andreaf | oomichi: cool, thanks | 17:02 |
oomichi | andreaf: the later needs a devstack patch: https://review.openstack.org/#/c/447062/ | 17:03 |
andreaf | oomichi: heh sure - I would have just waited for Mitaka EOL, it's less than a month a way - but ok | 17:04 |
*** Apoorva has joined #openstack-qa | 17:05 | |
oomichi | andreaf: haha, a month is long for me to forget it easily :) | 17:06 |
openstackrecheck | Console logs not available after 20:10s for gate-tempest-dsvm-networking-ovn-ovs-master 422269,10,0cf2c15 | 17:09 |
oomichi | andreaf: btw about https://review.openstack.org/#/c/444472 Now copying of manager.py seems to stop and I guess we could remove old data_utils now | 17:10 |
oomichi | andreaf: if old manager.py try to be merged after the above patch, the gate will fail and we just need to update the patch | 17:10 |
oomichi | andreaf: it doesn't seem to hurt the gates of plugin projects | 17:11 |
oomichi | the latest master branches of all projects don't use the old data_utils now | 17:12 |
*** dtantsur is now known as dtantsur|afk | 17:13 | |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fixes failing flavor access tests for Member role. https://review.openstack.org/446799 | 17:15 |
andreaf | oomichi: heh ok... but this data_utils cleanup is a bit getting in the way of making us able to change manager.py | 17:16 |
*** pcaruana has quit IRC | 17:18 | |
andreaf | oomichi: but you're right the remaining patches would not even merge after https://review.openstack.org/#/c/444472 merges | 17:18 |
andreaf | oomichi: I'll update all that tomorrow morning which should be quiet | 17:19 |
oomichi | andreaf: yeah, that takes long time than we expected. maybe because the patch is huge due to copying raw manager.py without cleanup | 17:20 |
*** nadya has quit IRC | 17:20 | |
oomichi | andreaf: reviewers(including me) tend to avoid *red* patches | 17:20 |
oomichi | andreaf: ok, I am waiting for, thanks :) | 17:21 |
jroll | dhellmann: we should have most of that code path covered soon, without swift, there would just be small bits around temporary (signed) swift URLs not covered. I'm comfortable with that while we wait for swift | 17:26 |
openstackgerrit | Joe Hakim Rahme proposed openstack/tempest master: Add tests for compute v2.40 microversion https://review.openstack.org/447005 | 17:27 |
openstackrecheck | Console logs not available after 20:21s for gate-functional-dsvm-magnum-swarm-ubuntu-xenial 443002,1,97778d9 | 17:29 |
openstackgerrit | Ihar Hrachyshka proposed openstack-dev/devstack master: Install psutil before starting memory_tracker https://review.openstack.org/447040 | 17:34 |
openstackgerrit | Ihar Hrachyshka proposed openstack-dev/devstack master: Set up sudoers to never require password for mlock_report.py https://review.openstack.org/447048 | 17:35 |
*** csomerville has joined #openstack-qa | 17:36 | |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fixes server fault thrown by delete password compute rbac test. https://review.openstack.org/447080 | 17:43 |
*** yamahata has joined #openstack-qa | 17:44 | |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fixes server fault thrown by delete password compute rbac test. https://review.openstack.org/447080 | 17:44 |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Remove set_nic_state from old remove_client https://review.openstack.org/447081 | 17:45 |
openstackgerrit | Nicolas Helgeson proposed openstack/patrole master: Identity V3 rbac_base method refactor https://review.openstack.org/446055 | 17:46 |
*** csomerville has quit IRC | 17:47 | |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fixes server fault thrown by delete password compute rbac test. https://review.openstack.org/447080 | 17:48 |
openstackgerrit | Felipe Monteiro proposed openstack/patrole master: Fixes server fault thrown by delete password compute rbac test. https://review.openstack.org/447080 | 17:48 |
openstackrecheck | Console logs not available after 20:11s for gate-dragonflow-python35 431422,15,7e35771 | 17:49 |
*** gszasz has quit IRC | 17:56 | |
openstackgerrit | Nicolas Helgeson proposed openstack/patrole master: Identity V3 (ext) Tests - Oauth Consumers https://review.openstack.org/446229 | 17:57 |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Remove set_nic_state from old remote_client https://review.openstack.org/447081 | 17:58 |
*** gvrangan has joined #openstack-qa | 17:58 | |
openstackgerrit | Nicolas Helgeson proposed openstack/tempest master: Identity V3-ext Oauth1 Consumers Client https://review.openstack.org/433818 | 18:06 |
*** abehl has quit IRC | 18:06 | |
oomichi | andreaf: do we need to keep -2 on https://review.openstack.org/#/c/446238 ? | 18:09 |
openstackrecheck | Console logs not available after 20:10s for gate-heat-dsvm-functional-convg-mysql-lbaasv2-ubuntu-xenial 442215,3,9459e15 | 18:10 |
clarkb | hello tempest reviewers, can I get review on https://review.openstack.org/#/c/446205/4 ? it dumps the ssh key as configured by cirros cloud init replacement thing to help debug ssh failures | 18:10 |
clarkb | you can see it working at http://logs.openstack.org/21/446221/4/check/gate-tempest-dsvm-neutron-full-ssh/1d3199f/console.html#_2017-03-16_22_39_13_176695 where I injected an artificial failure | 18:10 |
*** armax has quit IRC | 18:10 | |
*** nadya has joined #openstack-qa | 18:12 | |
openstackgerrit | Nicolas Helgeson proposed openstack/patrole master: Identity V3 Tests - Roles https://review.openstack.org/442870 | 18:13 |
*** armax has joined #openstack-qa | 18:14 | |
openstackgerrit | Nicolas Helgeson proposed openstack/patrole master: Identity V3 tests - Regions https://review.openstack.org/442873 | 18:15 |
*** e0ne has joined #openstack-qa | 18:16 | |
*** nadya has quit IRC | 18:17 | |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Remove assign_static_ip from old remote_client https://review.openstack.org/447093 | 18:17 |
openstackgerrit | David Rabel proposed openstack-dev/devstack master: Do not use libvirt-bin package anymore https://review.openstack.org/447094 | 18:22 |
*** aojea has joined #openstack-qa | 18:22 | |
openstackrecheck | Console logs not available after 20:09s for gate-experimental-functional-dsvm-magnum-k8s-multinode-ubuntu-xenial 443002,1,0a8102b | 18:30 |
*** gfidente has quit IRC | 18:37 | |
*** ihrachys has joined #openstack-qa | 18:38 | |
clarkb | sdague: working on getting you numbers for the apache tuning change. For the RSS column in http://logs.openstack.org/41/446741/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/fa4d2e6/logs/screen-peakmem_tracker.txt.gz is that in kilobytes? | 18:39 |
clarkb | ihrachys_: ^ I think you may know too? | 18:39 |
*** ihrachys_ has quit IRC | 18:41 | |
clarkb | ya I think it must be because 1.7% of 8GB is roughly 140000MB or 136ish MB | 18:42 |
*** david-lyle_ is now known as david-lyle | 18:43 | |
sdague | yeh, RSS is K I'm pretty sure | 18:44 |
ihrachys | clarkb: not sure. note that the service is borked right now, see patches in https://review.openstack.org/#/q/topic:collect-mlock-stats-in-gate | 18:44 |
*** e0ne has quit IRC | 18:45 | |
clarkb | ihrachys: I'm just interested in RSS is that correct? | 18:46 |
clarkb | ihrachys: for specific processes | 18:46 |
openstackgerrit | Nicolas Helgeson proposed openstack/patrole master: Identity V3 Tests - Domains https://review.openstack.org/446230 | 18:47 |
openstackgerrit | Clark Boylan proposed openstack-dev/devstack master: Tune apache connection limits down https://review.openstack.org/446741 | 18:47 |
clarkb | sdague: ^ there | 18:47 |
ihrachys | clarkb: well RSS gives you some measure, but I think it may not be ideal. see https://pythonhosted.org/psutil/#psutil.Process.memory_full_info | 18:48 |
openstackrecheck | Console logs not available after 20:22s for gate-grenade-dsvm-ceilometer-ubuntu-xenial 442703,1,aba6e92 | 18:50 |
*** tesseract has quit IRC | 18:50 | |
sdague | clarkb: +@ | 18:52 |
clarkb | thanks | 18:52 |
openstackgerrit | Merged openstack-dev/devstack stable/ocata: Use string comparison to compare UUID values https://review.openstack.org/447015 | 18:55 |
openstackgerrit | Merged openstack-infra/devstack-gate master: Don't run nova-cert by default https://review.openstack.org/446986 | 18:55 |
clarkb | and looks like nova-cert removal is worth ~95MB | 18:57 |
*** cody-somerville has joined #openstack-qa | 18:57 | |
*** tosky has quit IRC | 18:58 | |
*** catintheroof has quit IRC | 18:59 | |
*** gvrangan has quit IRC | 18:59 | |
*** aojea has quit IRC | 19:02 | |
clarkb | ihrachys: sdague also other idea is/was make sure ksm is enabled (but then reading up on that I got to thinking that maybe xen locks those pages for us whcih could explain the locked memory issues?) | 19:02 |
*** csomerville has joined #openstack-qa | 19:02 | |
clarkb | or possibly unmerging of pages may be what triggers our OOMs? | 19:03 |
sdague | so in our use case, I can't imagine ksm is going to be super helpful | 19:04 |
sdague | these guests are really small | 19:04 |
sdague | it's going to be a lot of work on the dedup there | 19:04 |
clarkb | looks like it is already running | 19:04 |
clarkb | so maybe it explains why we only OOM on xen | 19:04 |
clarkb | or at least seems more common there | 19:05 |
sdague | yeh | 19:05 |
sdague | well, on xen they need the dom0 | 19:05 |
*** cody-somerville has quit IRC | 19:05 | |
sdague | there is more mem overhead overall there | 19:06 |
*** catintheroof has joined #openstack-qa | 19:06 | |
* clarkb watches a running gate job's /sys/kernel/mm/ksm files out of curiousity | 19:07 | |
clarkb | currently nothing is shared | 19:07 |
*** dustins has quit IRC | 19:08 | |
*** amoralej is now known as amoralej|off | 19:09 | |
sdague | I still don't get this OOM when we have so much swap left, something else is going on to get us there | 19:09 |
*** dustins has joined #openstack-qa | 19:09 | |
openstackgerrit | Mh Raies proposed openstack/patrole master: Adding compute server tests https://review.openstack.org/445435 | 19:09 |
clarkb | ya so you can't swap locked memory | 19:09 |
sdague | right, but is everything locked? | 19:09 |
clarkb | I think that is what ihrachys is trying to figure out. However on reading up on ksm the initial implementation locked the shared pages so they couldn't be swapped. Current implementation allows swapping them but the undedeup when pages back to ram | 19:10 |
openstackrecheck | Console logs not available after 20:08s for gate-nova-python27-ubuntu-xenial 443003,2,0c4e98b | 19:10 |
clarkb | so wondering if ksm under us is potentually to blame | 19:10 |
clarkb | though I guess weshouldn't care about what is under us if the VM is really VMing | 19:10 |
sdague | maybe, but again, the most memory that could be tied up there is like 8*64M | 19:11 |
sdague | I want to understand why the python processes aren't getting swapped | 19:11 |
clarkb | sdague: at the nested layer yes, but what if our hypervisor from the cloud has locked our pages and that is leaking? | 19:11 |
clarkb | so we boot 10 ubuntu xenial things and run devstack on them on one hypervisor | 19:12 |
sdague | but that would prevent host swapping | 19:12 |
clarkb | thats a lot of potentially shared pages being deduped and maybe locked? (this is hand wavy at this point) | 19:12 |
clarkb | sdague: yes, unless the abstraction is leaky | 19:12 |
ihrachys | clarkb: yeah that's what I poke, why we don't swap | 19:12 |
sdague | the guest doesn't coop with the host | 19:12 |
ihrachys | there is plenty of swap memory | 19:12 |
sdague | not on linux | 19:12 |
clarkb | sdague: even with Xen? | 19:13 |
clarkb | since as far as I can tell we do swap properly on KVMbacked jobs | 19:13 |
clarkb | we see that with trove on osic for example. They use gigabytes of swap at times | 19:13 |
sdague | oh... sorry, I didn't fully understand that point | 19:13 |
sdague | so this is only a rax issue | 19:13 |
clarkb | I think so | 19:13 |
clarkb | ihrachys: ^ is that true? | 19:13 |
*** dustins has quit IRC | 19:14 | |
ihrachys | clarkb: that's what I heard, but I just trusted the info, haven't checked myself | 19:14 |
sdague | ok, so that would be an important fact to nail down | 19:14 |
clarkb | I do know we swap successfully in the trove jobs on kvm (osic) | 19:14 |
clarkb | to the tune of 2 gigabytes of swap usage | 19:14 |
*** aojea has joined #openstack-qa | 19:14 | |
clarkb | which can lead trove jobs to time out but they don't seem to OOM on KVM | 19:15 |
clarkb | amrith: ^ that right? | 19:15 |
*** gcheresh_ has joined #openstack-qa | 19:16 | |
clarkb | Default: 100 (chosen for demonstration purposes) (guess which value appears to be used by ubuntu?) | 19:29 |
openstackrecheck | Console logs not available after 20:11s for gate-cliff-python27-ubuntu-xenial 442419,3,8598302 | 19:30 |
*** tosky has joined #openstack-qa | 19:31 | |
*** aojea has quit IRC | 19:34 | |
clarkb | I guess it scans a new set of pages every 20 milliseconds | 19:37 |
*** aojea has joined #openstack-qa | 19:40 | |
*** shardy has quit IRC | 19:44 | |
*** vhosakot has joined #openstack-qa | 19:46 | |
clarkb | I keep learning things. ksmd is present as a kernel worker process, but the run file in sysfs is set to 0 not 1 | 19:47 |
clarkb | so we mgiht actually try toggling that bit in devstack to save memory too (it should affect more than just virtual machines, but at the expense of cpu overhead) | 19:47 |
openstackrecheck | Console logs not available after 20:18s for gate-zaqar-docs-ubuntu-xenial 439944,7,9424e26 | 19:51 |
openstackgerrit | Clark Boylan proposed openstack-dev/devstack master: Use ksm if running libvirt guests https://review.openstack.org/447119 | 19:55 |
sdague | clarkb: well, follow on question, how much of our pool is rax right now? | 19:57 |
clarkb | off the top of my head ~1/5? | 19:57 |
clarkb | mostly ^ is an experiment for now. Want to see how it does with "real" workload | 19:58 |
*** dimtruck is now known as zz_dimtruck | 19:58 | |
*** gcheresh_ has quit IRC | 19:58 | |
sdague | do we have a query somewhere for the oom? | 19:58 |
clarkb | sdague: ya its top of e-r | 19:59 |
sdague | the top is "tempest fails with ssh" | 19:59 |
clarkb | http://status.openstack.org/elastic-recheck/#1656386 it moved since yesterday | 19:59 |
clarkb | not sure if good or bad thing | 19:59 |
clarkb | re tempest fails with ssh I have https://review.openstack.org/446205 to try and debug more | 19:59 |
sdague | so on the oom it does not appear to be rax oriented | 20:01 |
sdague | https://dl.dropboxusercontent.com/1/view/s5hiybfg8uwbj9w/Apps/Shutter/screenshot_353.png | 20:02 |
clarkb | kk | 20:02 |
sdague | so, that discounts xen being relevant | 20:02 |
clarkb | ya | 20:02 |
*** awaugama has quit IRC | 20:04 | |
*** dave-mccowan has quit IRC | 20:07 | |
*** cdent has quit IRC | 20:09 | |
openstackgerrit | Ihar Hrachyshka proposed openstack-infra/devstack-gate master: Enable memory_tracker in gate for Pike https://review.openstack.org/434474 | 20:11 |
*** dustins has joined #openstack-qa | 20:11 | |
openstackrecheck | Console logs not available after 21:30s for gate-tempest-dsvm-networking-odl-beryllium-snapshot-v2driver 443018,1,57afdac | 20:12 |
*** gvrangan has joined #openstack-qa | 20:20 | |
clarkb | sdague: ihrachys enabling ksm has some impact http://paste.openstack.org/show/603183/ but will need to compare the higher level memory consumption numbers for a better idea of how important it is | 20:22 |
openstackgerrit | Merged openstack/patrole master: Fixes failing flavor access tests for Member role. https://review.openstack.org/446799 | 20:23 |
clarkb | looks like ~50MB at times shared? also thats a 10 second sample rate so could miss when its larger | 20:24 |
andreaf | oomichi: sorry I didn't have time to re-review yet - I removed the -2 I will check it tomorrow morning | 20:29 |
*** zz_dimtruck is now known as dimtruck | 20:30 | |
*** k4n0 has joined #openstack-qa | 20:30 | |
openstackgerrit | Mh Raies proposed openstack/patrole master: Adding compute server tests https://review.openstack.org/445435 | 20:31 |
clarkb | got up to pages_sharing:48899 * 4KB == thats almost 200MB | 20:32 |
*** ihrachys has quit IRC | 20:32 | |
oomichi | andreaf: ok, tomorrow is weekend for you. So it is fine next week :) | 20:34 |
openstackrecheck | Console logs not available after 22:23s for gate-networking-bgpvpn-python27-ubuntu-xenial 425933,3,f297de1 | 20:35 |
openstackgerrit | Merged openstack-infra/devstack-gate master: Handle trailing commas in source libs list https://review.openstack.org/447037 | 20:41 |
openstackgerrit | Nicolas Helgeson proposed openstack/patrole master: Identity V3 Tests - Domains https://review.openstack.org/446230 | 20:43 |
*** Serlex has quit IRC | 20:50 | |
*** csomerville has quit IRC | 20:50 | |
*** csomerville has joined #openstack-qa | 20:50 | |
openstackgerrit | Vasyl Saienko proposed openstack-infra/devstack-gate master: DNR/TMP Increase tempest concurrency to 4 https://review.openstack.org/447136 | 20:54 |
openstackrecheck | Console logs not available after 21:44s for gate-tempest-dsvm-neutron-full-ubuntu-xenial 442547,2,2ef1d55 | 20:56 |
*** gcheresh_ has joined #openstack-qa | 21:00 | |
openstackgerrit | Chi Lo proposed openstack/patrole master: Enhance test_server_actions_rbac with create image actions. https://review.openstack.org/447141 | 21:04 |
*** aysyd has quit IRC | 21:05 | |
*** k4n0 has quit IRC | 21:06 | |
clarkb | comparing dstat output between the py35 job before adding ksm and after ksm is enabled the old ends up with 45MB free at its lowest point and ksm new ends up with 119MB free at lowest point | 21:07 |
clarkb | now its possible that n-crt accounts for most of that | 21:07 |
clarkb | ya n-crt is not enabled when ksm was enabled but was before. will need a new baseline to compare against | 21:08 |
openstackgerrit | Clark Boylan proposed openstack-dev/devstack master: DNM use as baseline memory comparator https://review.openstack.org/447144 | 21:10 |
*** dustins_ has joined #openstack-qa | 21:11 | |
*** dustins has quit IRC | 21:12 | |
*** catintheroof has quit IRC | 21:16 | |
*** k4n0 has joined #openstack-qa | 21:18 | |
openstackrecheck | Console logs not available after 22:06s for gate-networking-ovn-python27-ubuntu-xenial 443057,1,f103e1a | 21:19 |
andreaf | layer4 job is broken - sahara is not pre-cloned and devstack dies http://logs.openstack.org/86/437286/2/gate/gate-tempest-dsvm-layer4-ubuntu-xenial/b9a081e/logs/devstacklog.txt.gz#_2017-03-17_10_54_52_872 | 21:21 |
andreaf | tosky: ^^^ any idea? | 21:21 |
clarkb | andreaf: thats like due to a recent change in devstack-gate | 21:21 |
tosky | andreaf: uhm, no idea | 21:22 |
andreaf | clarkb | 21:22 |
tosky | it was working until yesterday | 21:22 |
andreaf | clarkb: oh ok so you / someone is already on top of it? | 21:22 |
clarkb | see https://git.openstack.org/cgit/openstack-infra/devstack-gate/commit/?id=bd082d261a23ab2ddc6f3b1b0f470552beb2013e | 21:22 |
clarkb | no whoever is repsonsible for the job will need to fix the job and enable sahara properly | 21:22 |
tosky | let me recheck which change went it | 21:22 |
clarkb | and if that isn't the proper way to enable sahara someone should fix devstack-gate | 21:22 |
clarkb | basically we don't want to clone and setup sahara every time, so we use the if sahara is enabled check then clone and set up sahara else dont | 21:23 |
tosky | clarkb: ehm, so was sahara cloned every time?? | 21:23 |
andreaf | clarkb: ok yeah that makes sense | 21:23 |
clarkb | tosky: yes it has been for years | 21:24 |
tosky | I was always a bit confused by the value of PROJECTS: so whatever was there, was always cloned? | 21:24 |
andreaf | clarkb, tosky: but we don't run sahara in layer4 anymore afaik, so I'm confused why it fails | 21:24 |
clarkb | I am slowly trying to clean that up in devstack-gate as it results in job setup that is minutes longer than necessary | 21:24 |
clarkb | tosky: yes | 21:24 |
clarkb | tosky: next on the cleanup list is all of oslo | 21:24 |
clarkb | since those are only needed in the oslo src jobs | 21:24 |
clarkb | but we still clone and set them up on every single devstack job run | 21:24 |
tosky | clarkb: ok, out of curiosity: if I decide to ignore DEVSTACK_GATE_SAHARA and add sahara to PROJECTS in all the sahara jobs (and sahara-dashboard when relevant), is it the same? | 21:25 |
clarkb | tosky: yes, thats probably the ideal way to fix it | 21:25 |
clarkb | tosky: then you can push a change to d-g to remove the special casing as it won't be necessary | 21:25 |
*** alex_xu has quit IRC | 21:25 | |
tosky | clarkb: I hope there won't be other changes like this, but did you send an email with the [sahara] tag before merging? | 21:26 |
clarkb | tosky: no and yes there will be many more changes like this | 21:26 |
clarkb | we really need to stop doing this | 21:26 |
clarkb | and unfortuantely with something like 8k jobs the only real sane way to do it is try your best and fix it when things break | 21:26 |
clarkb | (because I can't read 8k jobs to make sure sahara is enabled properly) | 21:26 |
tosky | fine with that, but if you would have put Telles (the PTL), or Vitaly, Evgeny or me in cc in the review, we would have acted in advance | 21:26 |
tosky | and the job would have been fixed not now, but even before your patch would have been merged | 21:27 |
clarkb | but we wouldn't have known | 21:27 |
tosky | just a bit of communication more, is it too much to ask? | 21:27 |
clarkb | we would have looked at it and said "its checking if sahara is enableed and cloning it. great" | 21:27 |
tosky | well, it is a change which changes when Sahara is cloned, so just please put someone from the team in cc | 21:27 |
clarkb | ok | 21:28 |
tosky | fine, now I'm going to bake a patch | 21:28 |
*** alex_xu has joined #openstack-qa | 21:28 | |
andreaf | tosky: so for the layer4 job - that's owned by QA since it's sahara heat and trove | 21:28 |
andreaf | together | 21:28 |
andreaf | I would just add in there the DEVSTACK_GATE_SAHARA flag I guess? | 21:29 |
tosky | andreaf: yes, or just add sahara to the PROJECTS | 21:29 |
tosky | maybe even better | 21:29 |
clarkb | andreaf: yes either enable sahara using the flag or add it to PROJECTS then we can remove the flag altogether once its no longer needed | 21:29 |
openstackgerrit | Rick Bartra proposed openstack/patrole master: Enhance validation decorator with error code https://review.openstack.org/444042 | 21:29 |
tosky | andreaf: what did we say about that layer4 job? Is moving away the heat test the only blocker to its removal? | 21:30 |
clarkb | the change to sahara was considered very safe because we were using the existing api to modify the behavior | 21:30 |
clarkb | but apparently that api isn't actually used? | 21:30 |
tosky | andreaf: but let me check if I have to fix sahara tests too, so we can send just one review | 21:31 |
andreaf | tosky: well I'm not sure about the recent history of layer4 - it installs the sahara plugin which I'm not sure why | 21:32 |
tosky | andreaf: and yes, I have to fix them | 21:32 |
andreaf | tosky: I thought it would only tests things in tempest | 21:32 |
tosky | andreaf: yes, and I think mtreinish told me that it's going to be killed at some point, when everything there is out of tempest | 21:32 |
tosky | but even now I'm not sure why sahara and trove bits are still there | 21:33 |
*** gouthamr has quit IRC | 21:33 | |
tosky | andreaf: so, I need to fix also sahara jobs, so I can send a review also for layer4 | 21:33 |
tosky | . | 21:33 |
andreaf | tosky: ok thanks | 21:33 |
tosky | clarkb: is heat also going to be moved behind a variable, or can I rely on its availability in PROJECTS? | 21:34 |
andreaf | tosky, clarkb: probably the cleaner thing would be to have no variable at all, just have the jobs maintain their list of needed project | 21:35 |
clarkb | tosky: https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate-wrap.sh?id=bd082d261a23ab2ddc6f3b1b0f470552beb2013e#n61 the current plan is to have heat in the default list | 21:35 |
clarkb | tosky: you can see its organized alreay based on what should go away and what should stay | 21:35 |
clarkb | (the reason for that is I think heat is still a base devstack service?) | 21:35 |
*** dustins_ has quit IRC | 21:36 | |
tosky | I can never be sure :) | 21:36 |
tosky | it's not one of the Core Six | 21:36 |
openstackgerrit | Rick Bartra proposed openstack/patrole master: Enhance validation decorator with error code https://review.openstack.org/444042 | 21:36 |
tosky | I asked thinking about tempest | 21:36 |
clarkb | tosky: I'd be open to moving it too but currently the comments in the list break down the plan | 21:36 |
andreaf | clarkb: I'm not even sure why we have tempest-lib in there... I guess there may things that depend on it still? | 21:38 |
clarkb | andreaf: well everything that was in there was because we didn't do this correctly for years and anytime we had a new project we just added it to the list | 21:38 |
clarkb | then we spent 10 minutes cloning it all and checking out the correct ref | 21:38 |
clarkb | so over the last few months I have slowly been lceaning it up to reduce that overhead | 21:39 |
tosky | if we consider only core projects and almost-core, there is a test-requirements.txt in nova, but I sent a patch to remove it :) | 21:39 |
tosky | and we just removed tempest-lib from RDO | 21:39 |
tosky | so I guess it's a candidate for the removal | 21:39 |
clarkb | the idea when I first set up taht organization was to have anything default supported by devstack in there | 21:39 |
clarkb | so that default d-g worked with default devstack | 21:39 |
clarkb | its likely that things ahve moved on teh devstack side since I did the split | 21:39 |
andreaf | clarkb: well we used to pre-fetch all repos in that list on test VM images once a day | 21:41 |
*** esberglu has quit IRC | 21:41 | |
openstackrecheck | Console logs not available after 22:19s for gate-heat-pep8-ubuntu-xenial 439433,3,a9bb286 | 21:41 |
*** trevormc_ has joined #openstack-qa | 21:41 | |
andreaf | clarkb: so cloning was just a fetch of one day worth of changes | 21:41 |
andreaf | clarkb: did that change? | 21:41 |
clarkb | andreaf: no we prefetched all the git repos onto the images once a day (we still do that) | 21:41 |
tosky | oh, correction: sahara jos have been fixed by Vitaly already (Icb3c18ab955b53c028008d6c374301c1e6ca0ccd) | 21:41 |
tosky | he added DEVSTACK_GATE_SAHARA | 21:41 |
tosky | we can sort out this later | 21:41 |
clarkb | andreaf: but still doing the delta checking, grabbing new commits, and checking out the correct ref is slow | 21:42 |
andreaf | clarkb: ok yeah that's what I meant - so does it really take 10min to update all repo? | 21:42 |
clarkb | andreaf: not today, but it did when I started this work | 21:42 |
clarkb | andreaf: I think we can get it down to like 2 minutes or so if we get to the currently specified desired list | 21:42 |
clarkb | I've already removed grenade and all of the python clients and a few other randome things | 21:43 |
andreaf | clarkb: ok I see - but won't these changes affect the prefecthing? or is it the list maintained separately? | 21:43 |
clarkb | the prefetching is for every repo on gerrit | 21:43 |
andreaf | clarkb: ah cool | 21:43 |
clarkb | (we actually filter out attic repos but effectively every repo) | 21:44 |
clarkb | its part of why our images are so large | 21:44 |
andreaf | tosky: ok so I'll do the same for now on layer4 | 21:44 |
trevormc_ | hey guys trove is experiencing a similar issue | 21:44 |
*** gcheresh_ has quit IRC | 21:44 | |
tosky | andreaf: too late :) | 21:44 |
trevormc_ | http://logs.openstack.org/92/443692/3/check/gate-trove-functional-dsvm-mysql-ubuntu-xenial/6e64ca5/logs/devstacklog.txt.gz#_2017-03-17_16_04_09_227 | 21:44 |
clarkb | trevormc_: you'll need to enable trove if you want to use trove DEVSTACK_GATE_TROVE=1 | 21:44 |
tosky | andreaf: https://review.openstack.org/447147 | 21:45 |
trevormc_ | yeah I saw the patch, should i submit it? | 21:45 |
* clarkb grumps that the public interfaces in devstack-gate aren't used | 21:45 | |
andreaf | tosky: thanks! | 21:45 |
andreaf | sdague: this is needed to unblock tempest gate (leayer4 is busted atm): https://review.openstack.org/#/c/447147/1 | 21:46 |
tosky | I was already halfway through the changes; I will check with Vitaly and the others about moving away from DEVSTACK_GATE_SAHARA | 21:46 |
clarkb | trevormc_: but also you can remove DEVSTACK_GATE_TROVE completely if its no longer required as a public interface then just add trove things to PROJECTS directly | 21:46 |
andreaf | it's a d-g patch | 21:46 |
clarkb | andreaf: I can get it | 21:46 |
andreaf | clarkb: ok thanks | 21:46 |
andreaf | I was looking for a 2nd reviewer :) | 21:47 |
*** k4n0 has quit IRC | 21:47 | |
clarkb | I will single approve since its simple and fixes issue | 21:47 |
andreaf | we can do a follow up patch to remove the DEVSTACK_GATE_SAHARA flag completely | 21:47 |
andreaf | clarkb: heh fine with me, thank you! | 21:48 |
andreaf | tosky, clarkb: thank you for a quick solution | 21:48 |
tosky | andreaf: or remove the layer4 job :) | 21:48 |
tosky | that was the hope | 21:48 |
andreaf | yeah I will work on that | 21:48 |
*** cody-somerville has joined #openstack-qa | 21:49 | |
andreaf | I might make it non voting or so, to keep an eye on plugins when doing changes | 21:49 |
andreaf | but I'm not sure yet what's the best way to do that | 21:49 |
tosky | what is the blocker? The removal of heat? | 21:49 |
*** csomerville has quit IRC | 21:51 | |
andreaf | tosky: I haven't looked into it really | 21:53 |
andreaf | tosky: it used to be heat but I'll have to check | 21:54 |
*** trevormc_ has quit IRC | 21:54 | |
andreaf | clarkb: something's wrong with the user-data script ? http://logs.openstack.org/21/446221/4/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/018859d/console.html#_2017-03-16_22_28_57_838743 | 21:54 |
clarkb | andreaf: it did that on an ood patchset | 21:55 |
clarkb | basically first char was newline so didnt match the exec prefix | 21:56 |
clarkb | currebt patchset should work and I linked example in review | 21:56 |
tosky | andreaf: I think I remember now: sahara is still there for the older branches, where sahara-tests was not used; but for sure when Mitaka is EOL it can be removed | 21:56 |
amrith | clarkb, I don't think that's the reason | 21:56 |
*** gouthamr has joined #openstack-qa | 21:57 | |
*** k4n0 has joined #openstack-qa | 21:59 | |
andreaf | clarkb: didn't you want to dump ip route and ip a as well? | 21:59 |
andreaf | clarkb: if you are happy with the public key we can merge this change and add more data later if needed | 21:59 |
clarkb | andreaf: turns out thats already dumped :) but then reading more I saw it was public key auth failing so trying to get that data | 22:00 |
clarkb | the cirros image logs net info further along in the console log I just had to read more | 22:00 |
andreaf | heh I just saw Jordan's comment | 22:00 |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Remove set_nic_state from old remote_client https://review.openstack.org/447081 | 22:02 |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Remove assign_static_ip from old remote_client https://review.openstack.org/447093 | 22:02 |
clarkb | ya I was chasing the wrong thing but now think its on track for being useful | 22:02 |
andreaf | +2 on it | 22:03 |
openstackrecheck | Console logs not available after 22:09s for gate-telemetry-dsvm-integration-panko-ubuntu-xenial 442293,2,ec3798f | 22:03 |
clarkb | afazekas: re your question its the cirros user that fails ssh so not sure the others are interesting? | 22:04 |
andreaf | oomichi: remote client is another thing which is used by scenario testss so if we move that to tempest.lib we will break all plugins - so you'll have to go through debcollector or something to keep it in tempest as well until it's changed on plugin side | 22:05 |
*** yamahata has quit IRC | 22:10 | |
openstackrecheck | Console logs not available after 22:08s for gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial 442864,1,532f2b7 | 22:25 |
openstackgerrit | Vitaly Gridnev proposed openstack-infra/devstack-gate master: Add sahara to features.yaml in subnode https://review.openstack.org/447158 | 22:30 |
*** gvrangan has quit IRC | 22:34 | |
*** timello has quit IRC | 22:44 | |
*** timello has joined #openstack-qa | 22:47 | |
openstackrecheck | Console logs not available after 21:53s for gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial 434769,4,40600a6 | 22:47 |
*** dimtruck is now known as zz_dimtruck | 22:51 | |
*** superdan is now known as dansmith | 22:57 | |
openstackrecheck | Console logs not available after 22:16s for gate-neutron-python27-ubuntu-xenial 395504,19,8764442 | 23:09 |
*** aojea has quit IRC | 23:10 | |
*** erlon has quit IRC | 23:15 | |
*** k4n0 has quit IRC | 23:22 | |
*** markvoelker has quit IRC | 23:26 | |
*** zz_dimtruck is now known as dimtruck | 23:29 | |
openstackrecheck | Console logs not available after 22:20s for gate-cloudkitty-python35 411860,3,72b5915 | 23:32 |
*** dimtruck is now known as zz_dimtruck | 23:33 | |
*** zz_dimtruck is now known as dimtruck | 23:37 | |
openstackgerrit | Ken'ichi Ohmichi proposed openstack/tempest master: Remove assign_static_ip from old remote_client https://review.openstack.org/447093 | 23:39 |
openstackgerrit | Liang Hao proposed openstack/tempest master: Add test_create_update_network_port_security_enabled in test_networks.py https://review.openstack.org/445839 | 23:39 |
openstackgerrit | Liang Hao proposed openstack/tempest master: Add test_create_port_with_port_security_enabled in test_ports.py https://review.openstack.org/445806 | 23:41 |
*** yangyapeng has quit IRC | 23:46 | |
openstackrecheck | Console logs not available after 23:09s for gate-heat-dsvm-functional-convg-mysql-lbaasv2-ubuntu-xenial 433546,10,e8d64a1 | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!