Thursday, 2014-06-12

*** ellenh has quit IRC00:01
*** hemna is now known as hemna_00:12
*** ellenh has joined #openstack-ironic00:13
*** romcheg has joined #openstack-ironic00:14
*** rloo has quit IRC00:16
*** rloo has joined #openstack-ironic00:16
*** romcheg has quit IRC00:18
*** ellenh has quit IRC00:19
*** matsuhashi has joined #openstack-ironic00:27
*** nosnos has joined #openstack-ironic00:32
openstackgerritAdam Gandelman proposed a change to openstack/ironic: Cleanup virt driver tests and verify final spawn  https://review.openstack.org/9951800:33
openstackgerritAdam Gandelman proposed a change to openstack/ironic: Destroy instance to clear node state on failure  https://review.openstack.org/9951900:33
*** romcheg has joined #openstack-ironic00:57
*** romcheg has quit IRC01:02
*** igordcard has quit IRC01:28
*** rwsu has quit IRC01:42
russell_hagordeev: hey ping me at some point in the next 4 hours or so if you want me to re-review https://review.openstack.org/#/c/92847/01:44
russell_hcycle times on this are high because our timezones are totally opposite I think01:45
openstackgerritlvdongbing proposed a change to openstack/ironic: remove default=None for config options  https://review.openstack.org/9953201:51
*** romcheg has joined #openstack-ironic01:52
*** romcheg has quit IRC01:56
*** hemna has joined #openstack-ironic02:05
*** eghobo has quit IRC02:36
*** romcheg has joined #openstack-ironic02:45
*** rloo has quit IRC02:48
*** romcheg has quit IRC02:49
*** coolsvap|afk is now known as coolsvap03:04
*** romcheg has joined #openstack-ironic03:13
*** romcheg has quit IRC03:18
*** hemna has quit IRC03:24
openstackgerritJosh Gachnang proposed a change to openstack/ironic: Adding swift temp url support  https://review.openstack.org/8139103:32
lifelessdevananda: http://www.blackhat.com/presentations/bh-dc-07/Heasman/Paper/bh-dc-07-Heasman-WP.pdf <- homework :)03:37
*** romcheg has joined #openstack-ironic03:40
*** pcrews has quit IRC03:40
openstackgerritJosh Gachnang proposed a change to openstack/ironic: Adding swift temp url support  https://review.openstack.org/8139103:44
*** romcheg has quit IRC03:44
*** nosnos has quit IRC03:44
*** eghobo has joined #openstack-ironic03:47
*** vinbs has joined #openstack-ironic03:49
*** coolsvap is now known as coolsvap|afk04:01
*** romcheg has joined #openstack-ironic04:07
openstackgerritA change was merged to openstack/ironic: Add node id to DEBUG messages in impitool  https://review.openstack.org/9892804:08
*** Poornima has joined #openstack-ironic04:09
vinbsHi Haomeng :)04:10
vinbsHello Ironic04:11
*** matsuhashi has quit IRC04:11
*** romcheg has quit IRC04:11
*** lazy_prince has joined #openstack-ironic04:13
*** harlowja is now known as harlowja_away04:16
Haomengvinbs: hi04:18
Haomengvinbs: :)04:18
vinbsHaomeng: I'm a bit confused about the pxe boot process that the baremetal node goes through04:35
Haomengvinbs: welcome :)04:35
Haomengvinbs: any concern04:35
vinbsHaomeng, I'm using ubuntu server image as the pxe image source but I see the server booting up with cirros!04:36
vinbsHaomeng, is that how it's supposed to happen?04:36
Haomengvinbs: we will use two image, one is for deployment, another one is user image that will install into the baremetal node04:36
HaomengHaomeng: so for boot option, we will input a user image which has properties to find the deploy image04:37
Haomengvinbs: so what your image id is used for nova boot?04:38
HaomengHaomeng: we can doublecheck by glance command 'glance image-list' or ' nova image-list' to see if the correct image we are using04:38
vinbsso the one would be 'pxe_image_name' and the other would be 'pxe_image_source' that I give in Ironic node-create command?04:38
Haomengvinbs: from ironic side, these are deploy images I think04:40
Haomenghow dou you launch the ironic booting?04:40
Haomengwith nova boot command?04:40
vinbsHaomeng, I do it through horizon and I use ubuntu server image04:41
vinbshttp://paste.openstack.org/show/83744/04:41
Haomenglooks fine04:42
Haomengstrange04:42
vinbsHaomeng, here's the image list and the command i used for enrolling the node04:42
Haomengwhere the cirros from?04:42
Haomengdid you login correct ip?04:42
vinbsHaomeng, yes I have logged in correct IP. I did have cirros image before, but I deleted the cirros image from glance04:43
vinbsHaomeng, and added the ubuntu server image04:43
Haomengvinbs: maybe that is a bug, ironic cache the image04:43
Haomengvinbs: can you check it from tftp folder?04:43
*** dwalleck has joined #openstack-ironic04:44
Haomengvinbs: you can check the ironic log to trace the imag id04:45
Haomengsuch as "8614c1a9-7983-4d2a-adae-df04af070460"04:45
*** dwalleck has joined #openstack-ironic04:45
vinbsHaomeng, yes.. let me do it04:45
Haomengvinbs: :)04:45
Haomengvinbs: let me check ironic code to see where is the cache folder04:46
*** matsuhashi has joined #openstack-ironic04:48
vinbsHaomeng, and one more thing, when my baremetal boots up with cirros, I get this error "wget: can't connect to remote host (169.254.169.254): Network is unreachable "04:48
*** nosnos has joined #openstack-ironic04:48
vinbsHaomeng, followed by this: cloud-userdata: failed to read instance id04:49
vinbsHaomeng, and then the cirros login screen comes up04:49
Haomengvinbs: that is not ironic issue, that is cirros image issue i think, you can try to deploy it with kvm directly, we will get same issue I think04:49
vinbsHaomeng, that is what I thought. So booting with a ubuntu or fedora image might resolve this issue right?04:50
Haomengvinbs: I think we can ignore the 'wget 169.254...' issue04:51
vinbsHaomeng, okay04:52
Haomengvinbs: :)04:52
Haomengvinbs: let me help you find the image cache logic04:52
Haomengvinbs: maybe it is a cache bug04:53
vinbsHaomeng, cool :)04:53
vinbsHaomeng, I searched the ironic logs for the ubuntu image id and I see that there are requests sent with this image id04:54
Haomengvinbs: that is strage, is it the id which is ubuntu image loaded by glance?04:55
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Updated from global requirements  https://review.openstack.org/9622804:55
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic-python-agent: Updated from global requirements  https://review.openstack.org/8872204:55
Haomengcan you try to upload another ubuntu image into glance again?04:55
Haomengvinbs: or just run nova boot to creaet a vm which is from your ubuntu image?04:55
Haomengvinbs: to see if it works with nova vm?04:56
vinbsHaomeng, okay.. let me try that :)04:56
Haomengvinbs: if you make sure the image you are using is correct on, no need to verify with nova vms04:56
vinbsHaomeng, first I'll clear up the existing image from glance and try again by uploading ubuntu image again04:57
Haomengok04:58
Haomengthis is our ironic image cache path - CONF.pxe.tftp_master_path04:58
Haomengvinbs: you can check it, and clean them04:59
vinbsyou mean master_images folder in the /tftpboot folder?05:01
Haomengvinbs: yes, we can find some sub-folders with id as names05:02
*** coolsvap|afk is now known as coolsvap05:02
*** k4n0 has joined #openstack-ironic05:04
vinbsI do see two files with some ids which are different from that of the ubuntu image05:05
*** pradipta_away is now known as pradipta05:06
*** eghobo has quit IRC05:08
vinbsHaomeng, at one point I had deleted the ironic database and set it up again.. that might have been the reason for this mess up with the images?05:08
*** eghobo has joined #openstack-ironic05:09
*** rakesh_hs has joined #openstack-ironic05:22
*** pradipta is now known as pradipta_away05:24
*** sysexit has joined #openstack-ironic05:32
Haomengvinbs: vinbs: yes, delete them and run again to see if that is using ubuntu image this time05:34
*** romcheg has joined #openstack-ironic05:37
*** dwalleck has quit IRC05:41
*** romcheg has quit IRC05:42
vinbsHaomeng, I deleted the images from cache05:56
vinbsHaomeng, I restarted the services too, now when I launch an instance it's still looking for that image which was present in the cache05:57
vinbsHaomeng, I see an error in nova-compute saying <image-id> image was not found05:57
Haomengvinbs: strange05:59
Haomengvinbs: what imageid you are passing to launch nova boot?05:59
Haomengvinbs: and did you pass the image which used to boot ?06:00
Haomengvinbs: and check if this image-id is defined in our ironic conf file06:00
*** romcheg has joined #openstack-ironic06:01
vinbsHaomeng, I passed the ubuntu server image-id06:01
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Imported Translations from Transifex  https://review.openstack.org/9606306:02
vinbsHaomeng but i haven't tested it with vm nova boot yet06:02
Haomengvinbs: I under that is new one which we upload by glance this time06:02
Haomengok, how do you launch the deployment?06:02
vinbsHaomeng, through Horizon itself06:03
Haomengvinbs: yes, horizon will call nova api I think06:03
Haomengvinbs: what case you are testing? for booting vm or ironic baremetel deployment?06:04
vinbsHaomeng, yes, I see the folder with ironic node-id created in the tftpboot directory06:04
vinbsHaomeng, ironic baremetal deployment06:05
Haomengvinbs: and for this time, what is image-id?06:05
Haomengvinbs: is it new one you have uploaded image?06:05
Haomengvinbs: you can run glance image-list to double check06:05
*** romcheg has quit IRC06:05
Haomengvinbs: and check what image id you defined in your ironic.conf06:06
vinbsHaomeng, ok.. let me check that06:06
Haomengvinbs: strange06:07
vinbsHaomeng, I haven't defined any image id in ironic.conf06:08
Haomengvinbs: ok, ignore this06:08
*** radsy has quit IRC06:09
vinbsHaomeng, this is the command i use to add the ubuntu image to glance: glance image-create --name "ubuntu-14.04-server-amd64" --disk-format qcow2 --container-format bare --is-public True --progress < ubuntu-14.04-server-amd64.iso06:14
vinbsHaomeng, do you see anything wrong with that?06:14
Haomengvinbs: that is fine06:14
Haomengvinbs: should we update image properties to set the deploy image id used by ironic?06:15
vinbsHaomeng, after this i use disk image builder to create the ramdisk and kernel images06:15
Haomengvinbs: ok06:16
vinbsHaomeng, you mean like we update deploy kernel id in the image properties of the actual image we are going to boot?06:16
Haomengvinbs: let me check the documents, I remember we have to associate the deploy ramdisk/kernel id with the user real image by glance image-update command06:17
vinbsHaomeng, yes I do associate the kernel id and ramdisk id with my ubuntu image after adding them to glance06:18
Haomengvinbs: what documents are you following now? can you try with devstack+ironic - http://docs.openstack.org/developer/ironic/dev/dev-quickstart.html#deploying-ironic-with-devstack06:21
Haomengvinbs: devstack scripts suppport our ironic, we can use it directy, that is easy to deploy ironic node06:21
Haomengvinbs: however devstack is using a vm to simulate the baremetal I think06:23
vinbsHaomeng, but devstack is mostly used with virtual baremetal nodes right?06:23
vinbsHaomeng, yes06:23
vinbsHaomeng, but I need to test with real hardware06:23
Haomengvinbs: yes, but we can take reference for the scripts what actions should be done06:23
Haomengvinbs: yes06:23
vinbsHaomeng, yes.. let me take a look at those scripts then06:24
Haomengvinbs: I think only the flavor is different between the virtual or physical baremetal deployments06:24
Haomengvinbs: and the way to get mac address for baremetal06:25
Haomengvinbs: I think your env has something issue, but not clear idea how to fix06:26
vinbsHaomeng, I'll try to clear up and reinstall services. Maybe that will resolve the issue06:27
Haomengvinbs: If I can login your system, I'd like to debug with you together06:27
*** romcheg has joined #openstack-ironic06:28
vinbsHaomeng: it's in a lab setup which doesn't have access to outside internet06:28
vinbsHaomeng, let me check if I can get that access06:28
Haomengvinbs: ok, so it is diffcult to make progress with irc commnuitation:)06:29
Haomengvinbs: dont worry06:29
vinbsHaomeng, thanks a lot :)06:30
Haomengvinbs: :)06:30
vinbsHaomeng, I'll see if I can get the access to the machine for you.. that will be very helpful for me06:30
Haomengvinbs: this is devstack ironic scripts, that is good reference for us for ironic operations06:30
Haomengvinbs: ok06:31
Haomengvinbs: this line - https://github.com/openstack-dev/devstack/blob/master/lib/ironic#L38006:32
Haomengvinbs: will set the flavor properties to associate the deploy ramdisk/kernel id06:32
*** romcheg has quit IRC06:32
vinbsHaomeng, yes.. but even after doing this I used to get an error saying kernel_id is not defined06:33
vinbsHaomeng, then I came to know that I need to associate kernel_id and ramdisk_id with the real image06:33
Haomengvinbs: what log file indicate 'kernel_id' not defined?06:33
Haomengvinbs: can you share the log with paste.openstack.org06:34
vinbsHaomeng, https://ask.openstack.org/en/question/30707/failed-to-deploy-error-kernel_id/06:34
Haomengvinbs: ok, let me check06:34
vinbsHaomeng, so after doing the association that issue resolved06:34
Haomengvinbs: ?06:35
Haomengvinbs: you mean your issue is resolved?06:35
vinbsHaomeng, I mean I was getting a kernel_id issue before, I resolved that by associating the kernel_id and ramdisk_id to the boot image06:36
vinbsHaomeng, but the issue I have now is different06:36
Haomengvinbs: yes your are correct06:36
vinbsHaomeng, i still  have this issue where it is looking for a different image06:37
Haomengvinbs: that is very strange:)06:38
Haomengvinbs: confusing where the different image from06:38
Haomengvinbs: that is magic:)06:38
vinbsHaomeng, lol yeah :D06:39
vinbsHaomeng, I grep-ed for that image id in the entire etc folder just to  make sure i haven't defined it in any of the config files06:40
vinbsHaomeng, didn't find it anywhere06:40
*** dwalleck has joined #openstack-ironic06:42
*** sysexit has quit IRC06:44
*** vinbs is now known as vinbs_|_lunch06:45
*** vinbs_|_lunch is now known as vinbs_lunch06:45
*** dwalleck has quit IRC06:46
*** sysexit has joined #openstack-ironic06:47
openstackgerritlvdongbing proposed a change to openstack/ironic: remove default=None for config options  https://review.openstack.org/9953207:07
*** eguz has joined #openstack-ironic07:11
*** eguz has quit IRC07:11
*** jcoufal has joined #openstack-ironic07:13
*** eghobo has quit IRC07:15
mrdadevananda: I've been trying but I got at least one reviewer to look at https://review.openstack.org/#/c/95024 :)07:19
*** Mikhail_D_ltp has joined #openstack-ironic07:23
*** jcoufal has quit IRC07:33
Mikhail_D_ltpGood morning folks! :)07:34
mrdaHey Mikhail_D_ltp07:40
mrdaand with that... goodnight ironic!07:40
*** mrda is now known as mrda-away07:40
*** jcoufal has joined #openstack-ironic07:43
*** dwalleck has joined #openstack-ironic07:44
*** dwalleck has quit IRC07:49
Mikhail_D_ltpmrda-away: goodnight! :)07:51
*** jcoufal has quit IRC07:51
*** ndipanov has joined #openstack-ironic07:54
*** jcoufal has joined #openstack-ironic08:00
*** jistr has joined #openstack-ironic08:02
*** derekh_ has joined #openstack-ironic08:11
*** lucasagomes has joined #openstack-ironic08:12
*** jcoufal has quit IRC08:14
*** romcheg has joined #openstack-ironic08:15
*** Poornima has quit IRC08:17
*** agordeev has quit IRC08:17
*** pelix has joined #openstack-ironic08:26
*** foexle has joined #openstack-ironic08:35
*** datajerk has quit IRC08:36
*** igordcard has joined #openstack-ironic08:43
*** jcoufal has joined #openstack-ironic08:43
*** martyntaylor has joined #openstack-ironic08:45
*** dwalleck has joined #openstack-ironic08:46
*** dwalleck has quit IRC08:50
*** datajerk has joined #openstack-ironic08:51
*** max_lobur has joined #openstack-ironic08:55
*** coolsvap is now known as coolsvap|afk08:55
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Use GB instead of MB for swap  https://review.openstack.org/8378809:01
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Fractional sizes for root_gb and ephemeral_gb  https://review.openstack.org/9942609:01
*** coolsvap|afk is now known as coolsvap09:06
openstackgerritMikhail Durnosvistov proposed a change to openstack/ironic: Check whether specified FS is supported  https://review.openstack.org/9810209:09
openstackgerritImre Farkas proposed a change to openstack/ironic-specs: More robust device status checking with fuser  https://review.openstack.org/9960509:19
*** max_lobur1 has joined #openstack-ironic09:32
*** max_lobur has quit IRC09:35
*** dwalleck has joined #openstack-ironic09:46
*** dwalleck has quit IRC09:51
*** Alexei_987 has joined #openstack-ironic09:52
*** agordeev has joined #openstack-ironic10:14
*** matsuhashi has quit IRC10:20
*** matsuhashi has joined #openstack-ironic10:20
*** romcheg has quit IRC10:23
*** matsuhashi has quit IRC10:25
*** shausy has joined #openstack-ironic10:27
*** vinbs_lunch is now known as vinbs10:27
vinbsHaomeng, I had to change the image_id in the flavor key too after I changed the image in glance10:28
vinbsHaomeng, it worked fine after that10:29
vinbsHaomeng, so there are basically three places where I need to change the image_id whenever I change the real boot image in glance10:29
vinbsHaomeng, once in ironic node-create command, where I associate the ironic node with the image id10:30
vinbsHaomeng, secondly in the baremetal flavor-key where I mention the kernel and ramdisk id10:30
Haomengvinbs: cool10:31
vinbsHaomeng, thirdly in need to associate the kernel id and ramdisk id with the boot image using glance image-update10:31
Haomengvinbs: yes10:31
Haomengvinbs: I guess you take the devstack ironic scripts as reference and get idea, righ?10:32
vinbsHaomeng, yes :) that and a bit of going over the logs10:32
*** rakesh_hs has quit IRC10:32
vinbsHaomeng, it was a relief to finally see the launch instance move from spawning stage to running stage :D10:33
Haomengvinbs: :)10:33
Haomengvinbs: contgs:)10:33
Haomengvinbs: you get good luck:)10:34
vinbsHaomeng, thanks a lot for the help :)10:34
Haomengvinbs: you are welcome, and it is that you help yourseff10:34
Haomengvinbs: :)10:34
*** sysexit has quit IRC10:40
lucasagomesvinbs, the flavor is the deploy kernel & ramdisk10:42
lucasagomesvinbs, not really related to the image u want to deploy10:42
*** martyntaylor has quit IRC10:43
*** martyntaylor has joined #openstack-ironic10:47
*** Poornima has joined #openstack-ironic10:53
*** vinbs has quit IRC10:56
*** sysexit has joined #openstack-ironic10:56
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic-specs: iPXE boot  https://review.openstack.org/9882210:58
openstackgerritjan grant proposed a change to openstack/ironic: WIP: Serialise paramiko requests.  https://review.openstack.org/9962611:05
openstackgerritMikhail Durnosvistov proposed a change to openstack/ironic: Old value 'updated_at' field returned after update  https://review.openstack.org/7543011:08
openstackgerritMikhail Durnosvistov proposed a change to openstack/ironic: Get rid object model `dict` methods part 1  https://review.openstack.org/6002511:08
openstackgerritDavid Shrewsbury proposed a change to openstack/ironic: Replace mknod() with chmod()  https://review.openstack.org/9948411:08
*** nosnos has quit IRC11:13
openstackgerritMikhail Durnosvistov proposed a change to openstack/ironic: Old value 'updated_at' field returned after update  https://review.openstack.org/7543011:14
openstackgerritMikhail Durnosvistov proposed a change to openstack/ironic: Get rid object model `dict` methods part 1  https://review.openstack.org/6002511:14
*** romcheg has joined #openstack-ironic11:26
*** k4n0 has quit IRC11:31
*** Haomeng has quit IRC11:33
*** coolsvap is now known as coolsvap|afk11:36
openstackgerritMikhail Durnosvistov proposed a change to openstack/ironic: Check whether specified FS is supported  https://review.openstack.org/9810211:37
openstackgerritMikhail Durnosvistov proposed a change to openstack/ironic: Sync processutils from oslo code  https://review.openstack.org/9834211:37
openstackgerritYuriy Zveryanskyy proposed a change to openstack/ironic: Fix utils.execute() for consistency with Oslo code  https://review.openstack.org/9963611:47
*** max_lobur1 has quit IRC11:51
*** yuriyz has quit IRC12:14
*** max_lobur has joined #openstack-ironic12:15
*** jdob has joined #openstack-ironic12:17
ShrewsHmm, we're going to have to drastically rework our gate tests, me thinks12:20
Shrewshttp://bit.ly/1oRZHUI12:23
*** linggao has joined #openstack-ironic12:29
lucasagomesyeah :(12:34
lucasagomesShrews, check Sean email12:34
lucasagomesShrews, and morning :012:34
lucasagomes:)*12:34
Shrewslucasagomes: yeah, that's where i got that from12:34
Shrewslucasagomes: morning  :)12:34
Shrewslucasagomes: Are you familiar with the "oslotest overlap" Sean mentions in his review to disable that job?12:37
Shrewshttps://review.openstack.org/9963012:38
lucasagomesShrews, not really trying to find out12:41
*** coolsvap|afk has quit IRC12:46
*** openstackgerrit has quit IRC12:46
*** rakesh_hs has joined #openstack-ironic12:46
*** coolsvap|afk has joined #openstack-ironic12:46
*** openstackgerrit has joined #openstack-ironic12:48
rushiagrhello folks12:48
rushiagrI am trying out ironic with servers in my lab12:48
rushiagrthey are all HP proliant gen8 servers12:49
rushiagrany idea how to access them from outside via IPMI?12:49
rushiagrusername/password/hostname combination via lanplus interface is not working12:49
*** yuriyz has joined #openstack-ironic12:50
rushiagron the other hand, from inside the system, I am able to access ipmi things12:50
rushiagrthe above two methods are tried using ipmitool12:51
romchegrushiagr: Hi!12:51
romchegWhat error do you get?12:51
lucasagomesShrews, dont know really :(12:52
Shrewsrushiagr: IIRC, i read something recently where ipmi over lan can be disabled on hp systems. Not sure where you would check that, though.12:53
rushiagrromcheg: hi!12:54
*** rloo has joined #openstack-ironic12:54
* Shrews been toying with the idea of buying a proliant microserver for playing12:54
rushiagrromcheg: I can access the ILO web interface12:54
rushiagrromcheg: the error is12:55
romchegyuriyz: Did you enable anything in the web interface?12:55
rushiagrt: http://csrc.nist.gov/groups/12:55
rushiagrSTM/cmvp/documents/140-1/140-1val.zip12:55
yuriyzhttps://srv10-kha-ipmi.kha.mirantis.net/12:55
rushiagroops, sory12:55
yuriyzengineer12:55
rushiagrError: Unable to establish IPMI v2 / RMCP+ session12:55
romchegyuriyz: Stop right now, this is not a private window!12:55
romcheg:)12:56
boris-42romcheg yuriyz  lol12:56
*** Poornima has quit IRC12:56
rushiagrI was trying "ipmitool -I lanplus -U <username> -P <password> -H xx.xx.xx.xx sdr list12:57
rushiagrI found one document which says that only KCS interface is enabled12:57
rushiagrdoes that mean only after logging into the system I can access the interface? I need to access it via outside of that machine12:58
rushiagrromcheg: ^12:58
romchegrushiagr: http://cl.ly/image/3k1k3b2q2L30 could you check please if that is enabled?12:58
romchegIt's in the iLO web interface Administration->Access Settings12:59
*** agordeev has quit IRC13:00
*** agordeev has joined #openstack-ironic13:01
rushiagrromcheg: yes, this is enabled13:01
romchegrushiagr: hmm, let me think13:03
rushiagrromcheg: unfortunately, there isnt much info provided in the Web UI with regards to IPMI :(13:04
rushiagrI can log into the machine and do stuff using ipmitool, to extract more information from the machine, if it is needed13:05
yuriyzrushiagr, do you have admin IPMI access? Try add -L OPERATOR otherwise13:05
rushiagryuriyz: I have admin access13:08
NobodyCamgood morning IRonic13:11
* rushiagr will be afk for an hour13:12
yuriyzrushiagr, your command syntax OK, maybe a problem with network access13:12
*** matty_dubs|gone is now known as matty_dubs13:12
openstackgerritChris Krelle proposed a change to openstack/ironic: Let ipmitool natively retry commands  https://review.openstack.org/9690213:30
openstackgerritImre Farkas proposed a change to openstack/ironic: Fix workaround for the "device is busy" problem  https://review.openstack.org/9012613:37
openstackgerritChris Krelle proposed a change to openstack/ironic: Enforce a minimum time between all IPMI commands  https://review.openstack.org/9655813:39
openstackgerritImre Farkas proposed a change to openstack/ironic-specs: More robust device status checking with fuser  https://review.openstack.org/9960513:42
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Use processutils properly  https://review.openstack.org/9966513:50
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Better errors for execute() failures  https://review.openstack.org/9966613:50
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Better errors for execute() failures  https://review.openstack.org/9966613:52
openstackgerritJim Rollenhagen proposed a change to openstack/ironic-python-agent: Use processutils properly  https://review.openstack.org/9120213:52
jrollmorning y'all13:52
NobodyCamgood morning jroll13:54
*** reaper has joined #openstack-ironic13:56
*** jistr has quit IRC14:00
*** jistr has joined #openstack-ironic14:02
*** pcrews has joined #openstack-ironic14:10
*** romcheg has quit IRC14:14
lucasagomesmorning NobodyCam jroll yuriyz romcheg14:16
NobodyCammorning lucasagomes14:16
*** rloo has quit IRC14:27
*** jcoufal has quit IRC14:27
*** rloo has joined #openstack-ironic14:28
*** dwalleck has joined #openstack-ironic14:29
*** dwalleck has joined #openstack-ironic14:29
*** rloo has quit IRC14:29
*** rloo has joined #openstack-ironic14:30
*** Shiv has joined #openstack-ironic14:31
*** Shiv has quit IRC14:33
*** coolsvap|afk is now known as coolsvap14:33
BadCubmorning everyone14:34
*** Shiv has joined #openstack-ironic14:34
rushiagrmy servers are within a VPN. Can it be due to some blocked network protocol? I can see that though I can not ping the iLO IP, I can SSH into it14:34
rushiagrwhat protocol does IPMI uses? UDP?14:34
*** rloo has quit IRC14:34
*** romcheg has joined #openstack-ironic14:35
*** rloo has joined #openstack-ironic14:35
*** lazy_prince has quit IRC14:37
NobodyCammorning BadCub14:41
romchegMorning NobodyCam!14:42
NobodyCammorning romcheg14:43
NobodyCamrushiagr: yes ..port 623 / udp14:43
lucasagomesjroll, ping, mind if I rebase Josh's PXE patch?14:44
*** mkerrin has quit IRC14:44
NobodyCamromcheg: I see that Russia admitted it is supporting separatists14:45
*** martyntaylor has quit IRC14:47
romchegNobodyCam: I can see 3 Russian tanks in Ukraine http://www.youtube.com/watch?feature=player_detailpage&v=fsZPyM9nNFw#t=37 :(14:47
rushiagrNobodyCam: okay, thanks14:48
*** martyntaylor has joined #openstack-ironic14:49
rushiagrI am seeing that when I execute 'ipmitool lan print' from inside that machine, the 'Auth Type Support' is blank14:49
*** coolsvap is now known as coolsvap|afk14:49
ShrewsSo it would seem that my rebuild tempest test has random failures. After the initial boot, it verifies ephemeral partition is mounted, touches a file on that partition, then a REBUILD is issued. After the rebuild, sometimes the touched file is not there. Could this be a filesystem sync issue?14:49
NobodyCamromcheg: oh wow... I glad I'm not the person in the little car :-p14:50
* Shrews thought "sync; sync; sync" was no longer necessary14:51
rushiagrpaste.openstack.org/show/8381814:52
rushiagrhere is the output14:52
rlooShrews: the test has the flag to preserve ephemeral?14:54
*** dwalleck has quit IRC14:54
Shrewsrloo: yes. that's what it is testing. and i verify it is mounted before and after rebuild14:55
NobodyCammornign rloo14:55
rloohello everyone, NobodyCam!14:55
Shrewsrloo: if you're curious: https://review.openstack.org/9443914:55
Shrewsrloo: and morning14:56
*** jistr has quit IRC14:56
rlooShrews: I'm curious but that would mean I'd need to learn about tempest. Which I will one day, just not ready to do it today ;)14:56
*** jistr has joined #openstack-ironic14:56
Shrewsrloo: lol... i don't blame you14:57
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Factoring out PXE and TFTP functions  https://review.openstack.org/9023314:57
lucasagomesjroll, rebased ^14:57
*** mdorman has joined #openstack-ironic14:58
rushiagrany idea if the above is related to closed port?15:00
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Add iPXE support for Ironic  https://review.openstack.org/9931815:00
*** max_lobur has quit IRC15:02
NobodyCamquestion I was just looking at the ipmi specs, any know if there is a standard for key name  attributes like boot_device.. and if so where can I find sucha list15:03
*** rakesh_hs has quit IRC15:03
NobodyCams/any/anyone/15:04
Shrewsmust be hard question day15:07
*** coolsvap|afk is now known as coolsvap15:08
*** hemna has joined #openstack-ironic15:13
*** shausy has quit IRC15:13
*** foexle has quit IRC15:17
jrolllucasagomes: morning! I'm never opposed to people rebasing things for me :)15:19
jrolllucasagomes: were there conflicts?15:19
lucasagomesjroll, heh cool, just rebased that minutes ago15:20
lucasagomespxe.py15:20
lucasagomesand at the neutron tests15:20
*** Mikhail_D_ltp has quit IRC15:20
devanandag'morning, all15:20
* devananda caches up on scrollback15:20
lucasagomesdevananda, morning15:20
lucasagomesjroll, got to change something at the test_tftp.py as well due "TypeError: acquire() got an unexpected keyword argument 'node_ids'"15:21
openstackgerritjan grant proposed a change to openstack/ironic: WIP: Serialise paramiko requests.  https://review.openstack.org/9962615:23
jrolllucasagomes: ok, I'll double check when I get to the office15:23
jrollthanks again :)15:23
lucasagomesnp thank u15:23
devanandaactually, gotta step away again... bbi20m15:23
*** Mikhail_D_ltp has joined #openstack-ironic15:24
NobodyCamgood morning devananda15:25
jrollmorning devananda15:25
lucasagomesif someone wants to review something: https://review.openstack.org/90233 :) would be nice to get it merged soon15:28
*** Kai14 has joined #openstack-ironic15:29
*** Shiv has quit IRC15:30
*** Shiv has joined #openstack-ironic15:31
*** Mikhail_D_ltp has quit IRC15:31
*** sysexit has quit IRC15:32
*** Shiv has quit IRC15:33
*** Mikhail_D_ltp has joined #openstack-ironic15:33
* devananda adds ^ to the 'pad15:37
*** Mikhail_D_ltp has quit IRC15:37
*** Mikhail_D_ltp has joined #openstack-ironic15:37
JayFI bet Josh would love to come back from vacation to see #90233 merged :)15:38
Shrewsdevananda: If you haven't seen it yet, there's an email from Sean where he explains why he made our gate tests non-voting again.15:39
devananda....15:39
devanandaShrews: thanks15:39
*** Mikhail_D_ltp has quit IRC15:39
lucasagomesJayF, +115:40
lucasagomesJayF, I tested it locally here, now it works fine15:40
JayFwell it failed tempest after the rebase :x15:41
devanandaah, i see15:41
*** dwalleck has joined #openstack-ironic15:41
lucasagomeslemme recheck that15:41
JayFyeah I just read that email and it seems relevant15:42
lucasagomesdevananda, btw, check Sean's email in the openstack-dev15:42
lucasagomesyeah like Shrews said... sorry didn't see that message15:42
* lucasagomes is a spammer :P15:42
Shrewshttp://img2.wikia.nocookie.net/__cb20110629041027/icarly/images/4/49/Monty_python_spam.jpg15:44
matty_dubslucasagomes: Hey, did you see the email Sean sent to openstack-dev?15:44
matty_dubs;)15:44
lucasagomes:P15:44
*** eghobo has joined #openstack-ironic15:45
* NobodyCam thinks: lets get some real spam goning.... now where did i put that power MTA linc..... 15:47
JayFHey, I've worked with email marketing before. I may or may not have benchmarked mail systems that sent mail at a 6k messages/second :) (not that it's useful to send mail that fast... just fun)15:48
* NobodyCam may or may not have also worked in email marketing too15:49
NobodyCampower MTA/pytohn injectors/ 10k m/s15:50
NobodyCamper server15:50
JayFheh15:50
JayFmine was just a chrooted postfix, with the chroot living entirely on a ramdisk :)15:50
NobodyCamlol so long as you have enough domanins to send to15:50
* BadCub cringes at the memories of email marketing days15:50
*** shiv has joined #openstack-ironic15:51
NobodyCamJayF: oh not that was something I never thought of back in the day15:51
NobodyCams/not/now/15:52
NobodyCamchrroting a ramdisk15:52
BadCubNobodyCam: yu were too busy keeping the nation's largest spammer operational. No time to think LOL15:52
NobodyCamshhhhh15:52
JayFHeh. I quit my email marketing job because someone paid their way out of being shutdown for abuse :(15:53
*** matty_dubs is now known as matty_dubs|gone15:53
* BadCub quit after too many depositions15:53
BadCubI worked in teh legal department for the nation's largest spammer. er, affiliate network LOL15:54
NobodyCamJayF: ahh you remember http://www.danhatesspam.com15:55
BadCubGods I hated Dan...15:55
JayFI don't know anything about that guy15:55
NobodyCamlol15:55
JayFI remember the woman who was Postmaster at AOL15:55
JayFand basically she'd ask us to jump and we'd ask how high15:56
JayFbecause she could just flip off all delivery from your domain to aol on a whim15:56
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Use GB instead of MB for swap  https://review.openstack.org/8378815:56
openstackgerritLucas Alvares Gomes proposed a change to openstack/ironic: Fractional sizes for root_gb and ephemeral_gb  https://review.openstack.org/9942615:56
BadCubHe was the largest spam litigater in the USA for years. Sued everyone for everything15:56
JayFand that was the way she got your attention. Do something wrong? Get tons of bounce messages.15:56
lucasagomesdevananda, btw about https://review.openstack.org/#/c/98120/ , are we holding it ?15:56
* NobodyCam recalls all the back off and delivery rules he wrote... 15:57
lucasagomesor it just because of the gate problems?15:57
* BadCub recalls all the C&Ds he received on a daily basis15:57
*** rakesh_hs has joined #openstack-ironic15:58
NobodyCam:-p15:59
NobodyCambbt.... brb15:59
devanandalucasagomes: did you see nova has the same db migration issue we do16:00
lucasagomesdevananda, oh thought they were fine since they use the old code16:01
*** shiv has quit IRC16:01
lucasagomesand didn't migrate to alembic yet16:01
devanandalucasagomes: it's not alembic that's the cause, it's the oslo-incubator db migration code16:01
devanandasee https://bugs.launchpad.net/nova/+bug/132899716:02
* lucasagomes clicks16:02
devanandaadam_g: around?16:02
lucasagomesah good and now that it's marked as critical I suspect it's going to be fixed soon :)16:03
devanandasee the lengthy discussion? yea16:07
*** sysexit has joined #openstack-ironic16:07
devanandagate bug in nova gets fixes fast these days16:07
devanandawe need to track that and, if they dont, port the fix to ironic16:07
devanandaour db migration test code is very similar16:07
lucasagomes+1 will keep an eye on that16:07
*** linggao has quit IRC16:11
devanandaJ1 milestone tag done!16:14
devanandahttps://launchpad.net/ironic/juno/juno-116:14
devananda62 bugs fixed -- great work, everyone!16:14
*** ndipanov has quit IRC16:14
rlooYay!16:16
Shrewsthis one... i no like. i has a sad  :(     https://bugs.launchpad.net/ironic/+bug/119952216:16
romchegMorning devananda!16:16
*** ellenh has joined #openstack-ironic16:16
romchegThierry got to Launchpad…16:17
rlooShrews: why sad?16:17
Shrewsrloo: breaks unit tests on macs16:17
rlooShrews: oh, so sorry :-(16:18
Shrewswhich is not important to anyone other than myself and NobodyCam  :)16:18
rlooShrews: don't you have a bug open to fix unit tests on macs?16:18
Shrewsrloo: yes16:18
rlooShrews: what's important to you and NobodyCam is important to the rest of us. Just not as important ;)16:18
NobodyCamditto----Great job everyone!!!!16:19
lucasagomesnice16:19
NobodyCamlol16:19
*** jistr has quit IRC16:19
* NobodyCam thinks everyone should have a mac16:19
openstackgerritJay Faulkner proposed a change to openstack/ironic-python-agent: Fix incorrect log statement  https://review.openstack.org/9970616:21
lucasagomesNobodyCam, oh please hah no16:21
NobodyCam:-p16:22
JayF^ that is an easy/cheap review (https://review.openstack.org/#/c/99706/)16:22
NobodyCamJayF: yep easy -1, I want to say switching format to : 5S16:25
NobodyCamlol16:25
NobodyCamj/k16:25
JayFNobodyCam: yep, you're an openstack dev /s16:26
NobodyCam:-p16:29
*** sysexit has quit IRC16:29
jrolldevananda: nice :)16:31
*** Mikhail_D_ltp has joined #openstack-ironic16:34
*** romcheg has quit IRC16:35
*** rloo has quit IRC16:36
*** rloo has joined #openstack-ironic16:37
*** openstackgerrit has quit IRC16:38
*** sysexit has joined #openstack-ironic16:39
*** Kai14 has quit IRC16:44
*** mkerrin has joined #openstack-ironic16:53
*** harlowja_away is now known as harlowja16:54
devanandaadam_g: do you happen to have the ovs/libvirt bug reference handy? (the reason we're installing UCA in devstack-gate)16:55
*** jcoufal has joined #openstack-ironic16:58
*** rwsu has joined #openstack-ironic17:00
NobodyCamdevananda: this does not seem right to me... I seem to recall a bug about it.. do you happen to recall which # it is?17:01
NobodyCamhttp://logs.openstack.org/02/96902/13/check/check-tempest-dsvm-ironic-postgres/af373f4/logs/screen-ir-api.txt.gz17:02
devanandaNobodyCam: what's the issue?17:03
devanandaI dont see any errors in there17:03
NobodyCamahh just warns17:03
*** eghobo has quit IRC17:04
devanandahuh17:04
devanandabut a whole lot of tempest failures17:04
*** eghobo has joined #openstack-ironic17:04
devanandawtf17:04
devanandaso we disabled the fake driver by default17:04
devanandabut devstack is supposed to be adding it17:05
NobodyCam:( i'm looking for the root cause of: http://logs.openstack.org/02/96902/13/check/check-tempest-dsvm-ironic-postgres/af373f4/console.html17:05
*** Mikhail_D_ltp has quit IRC17:05
*** Nisha has joined #openstack-ironic17:06
*** Mikhail_D_ltp has joined #openstack-ironic17:08
lucasagomesalright, it's time to me to go home, came to the office today17:08
lucasagomeshave a good night everybody!17:08
NobodyCamoh conductor blew up17:08
NobodyCamnight lucasagomes17:08
NobodyCamjust hadent gotten to that log yet17:08
*** lucasagomes has quit IRC17:09
devanandaNobodyCam: yea. that's reasonable.17:13
devanandaoh, hah17:14
NobodyCamya it did what it should have17:14
devanandaso, right. conductor is refusing to start because the pxe_ipmitool driver is enabled, but there's no ipmitool on the system17:14
devanandaexactly17:14
devanandaso we need to disable pxe_ipmitool in devstack-gate runs17:14
*** derekh_ has quit IRC17:14
* NobodyCam is thinking default should be disable ALL driver and force operators to enable only what they have17:15
* devananda hacks up a patch17:16
*** Mikhail_D_ltp has quit IRC17:21
devanandahttps://review.openstack.org/9971817:22
devanandaso there's two ways17:24
*** Mikhail_D_ltp has joined #openstack-ironic17:24
NobodyCamfyi +1'd that patch17:26
devanandai'm chatting with infra about it actually17:27
devanandamay abandon it ...17:27
NobodyCamya I would lean toward only default being fake and all other driver must be enabled17:27
devanandasee conversation in infra17:28
* NobodyCam runs out of the room in to -infra17:28
*** rwsu has quit IRC17:30
devanandaany redhat users -- what's the name of the ipmi package on RH/Fedora? "ipmitool" ?17:30
*** shausy has joined #openstack-ironic17:31
*** rwsu has joined #openstack-ironic17:32
NobodyCamlooks like ipmitool17:32
*** martyntaylor has left #openstack-ironic17:32
devanandarpm.pbone.net says "yes"17:32
jrollwho feels like reviewing some specs? :) https://review.openstack.org/#/c/98506/ https://review.openstack.org/#/c/98930/ https://review.openstack.org/#/c/99235/17:34
jrollone of those is a nova spec for the ironic virt driver17:34
jrollbut would also like ironic eyes on it17:34
adam_gdevananda, here now17:35
*** Mikhail_D_ltp has quit IRC17:35
devanandaadam_g: hi! have a link to the LP bug for why we're pulling in UCA packages?17:36
adam_gdevananda, i do not. it was never a bug, but a feature shortcoming of the older libvirt shipped with precise.17:38
devanandaadam_g: ah, i thought there was something on LP tracking that17:38
adam_gdevananda, there were/are a bunch of bugs about issues with the precise libvirt package.17:39
*** dwalleck_ has joined #openstack-ironic17:39
adam_gspecifically its libvirt support for OVS virtual ports that we need for the devstack stuff17:39
*** Nisha has quit IRC17:39
devanandaadam_g: it might be useful to reference one or more of those in the devstack-gate.yaml file17:39
*** Mikhail_D_ltp has joined #openstack-ironic17:40
devanandaadam_g: so that folks undersatnd why we're pulling UCA in17:40
*** dwalleck_ has quit IRC17:40
devanandaadam_g: until infra has support for 14.04, we're probably going to continue to need to pull in UCA - -but not in the way we are today17:40
*** dwalleck_ has joined #openstack-ironic17:40
*** dwalleck has quit IRC17:41
adam_gdevananda, there is a comment there now about the OVS support. the bugs i mention actually dont affect us, we pull in a newer package where they've all been fixed. :)17:41
devanandaadam_g: there's been a fairly lengthy discussion in infra, between fungi mordred and myself, about precaching these packages17:41
devanandaadam_g: AIUI, we pull i nthe newer package from UCA precisely to get that fix17:41
adam_gdevananda, speaking of UCA, the GPG errors still seem to be issues with the key package--it seems the fix that merged the other day hasn't synced out to all slaves yet17:41
devanandaadam_g: that's what i mean -- linking to those bugs would inform folks /why/ we're using UCA17:41
devanandaadam_g: right. fungi just poked jenkins02, which was the only one that was still reporting that failure17:42
devanandaand fwiw, that's essentially why sdague made our tempest job non-voting this morning :(17:42
devanandai'm trying to wrap that up and get it voting again17:42
adam_gdevananda, the *only* reason we are using the UCA package is for the libvirt OVS support.. the bugs i speak of all are all things that were uncovered long ago in other areas of testing and aren't really relevant. bug im happy to clarify in the comments17:43
adam_gand file a bug just to track "we need 14.04"17:43
devanandaadam_g: thanks17:44
devanandait's really about the tracking / communication of why we're doing this17:44
adam_gsure17:44
*** Mikhail_D_ltp has quit IRC17:45
devanandaNobodyCam: https://review.openstack.org/9972317:46
rloodevananda: are we OK to approve things? (I don't see anything in the topic but thought I'd check)17:49
*** Mikhail_D_ltp has joined #openstack-ironic17:49
devanandarloo: there's still a note on the etherpad :)17:50
devanandarloo: we should be somewhat conservative still17:50
devanandagate queue is > 24 hours long17:50
rloodevananda: the IronicReviewDay etherpad? I'd prefer if you updated the topic. too many places to think to look and not sure which has been updated.17:51
rloodevananda: ok, i'll just review a few things then.17:52
devanandarloo: the whiteboard,a ctually17:52
rloodevananda: ok, I see it there. Is that where we should be looking then, not the topic?17:52
devanandarloo: i did change the topi. it now says "Status: ## link ##"17:53
devanandasince several folks have complained that putting a long status message in the room topic goes unnoticed17:53
rlooNobodyCam: your https://review.openstack.org/#/c/93133 hasn't merged yet :-(17:53
*** Mikhail_D_ltp has quit IRC17:53
devanandai'm open to ideas, but it seems that i can't please everyone on this17:53
rloodevananda: ha ha. ok, i was used to seeing the status there. No worries, it doesn't matter to me. Just that it changed. So whiteboard is fine. Also means that others can update it, which we couldn't with the topic.17:54
*** Mikhail_D_ltp has joined #openstack-ironic17:55
NobodyCamdevananda: queue > 24 hours not < ...17:57
NobodyCamwould that mean we shoud approve everything17:57
*** Mikhail_D_ltp has quit IRC17:58
NobodyCamoh nm I miss read17:58
NobodyCam:-p17:58
*** zul has quit IRC18:03
*** pelix has quit IRC18:03
adam_gdevananda, reading -infra backscroll. monty's suggestion should work. will give it a shot now18:08
*** Mikhail_D_ltp has joined #openstack-ironic18:09
*** jdob has quit IRC18:12
*** jdob has joined #openstack-ironic18:13
*** openstackgerrit has joined #openstack-ironic18:13
*** jcoufal has quit IRC18:17
*** shausy has quit IRC18:19
openstackgerritEllen Hui proposed a change to openstack/ironic: Add more INFO logging to ironic/common  https://review.openstack.org/9949518:22
NobodyCambrb18:24
*** jdob has quit IRC18:25
*** jdob has joined #openstack-ironic18:25
*** bandicot has joined #openstack-ironic18:27
*** notarealperson has joined #openstack-ironic18:36
NobodyCamoh its kinda chilly out there today18:37
*** mdorman has quit IRC18:45
*** mdorman has joined #openstack-ironic18:47
*** Mikhail_D_ltp has quit IRC18:47
* NobodyCam expects flood, starts filling snadbags18:47
NobodyCamlol18:47
*** ellenh has quit IRC18:47
adam_gdevananda, https://bugs.launchpad.net/openstack-ci/+bug/1329430 feel free to tag as an ironic bug if you see fit18:52
*** dwalleck_ has quit IRC18:55
Shrewsadam_g: when you were working on the tempest basic ops test, did you ever see this: http://logs.openstack.org/39/94439/6/check/check-tempest-dsvm-virtual-ironic-nv/e999951/console.html#_2014-06-12_16_34_49_00318:55
Shrewsadam_g: not sure why that's failing18:55
*** dwalleck has joined #openstack-ironic18:55
NobodyCamoh thats a new one for me18:56
*** rakesh_hs has quit IRC18:57
Shrewsit's weird b/c the advance ops test passes (now that I sync the filesystem)18:58
*** max_lobur has joined #openstack-ironic18:58
*** dwalleck_ has joined #openstack-ironic18:59
*** dwalleck has quit IRC18:59
adam_gShrews, hmm. that would mean nova scheduling failed to cast to the compute node, or ironic failed to associate the instance with node?19:00
*** Alexei_987 has quit IRC19:00
Shrewsi have yet to see it pass19:00
adam_gShrews, is this running witht he other advanced test?19:00
Shrewsadam_g: yep. advance runs before it and passes19:00
adam_gShrews, nova probably hasns't reclaimed the free resources from ironic after the previous instance terminated19:01
adam_gand can't schedule because the periodic task hasns't run yet19:01
Shrewsadam_g: I lost you at "Shrews"19:02
*** sysexit has quit IRC19:02
adam_gShrews, so you're running with only a single ironic node. the first test spawns the instance, tests, then terminates it. while the instance is running, n-cpu reports ironic has 0 free resources, they're all in use19:03
adam_gthe test finishes and deletes the instance19:03
Shrewsoh. i assumed there were more ironic nodes19:03
adam_gbut until the next n-cpu  periodic task runs to update available resources, nova still thinks there are 0 resources availbale19:03
Shrewsadam_g: is there something i need to do in the tests to fix that?19:04
adam_gShrews, IRONIC_VM_COUNT in devstack can be adjusted to spawn more, but i dont know how well the slave nodes would handle multiples19:04
Shrewsoh geez19:04
adam_gShrews, you can adjust the either the boot or terminate instance methods in tempest to wait until resources are available before boot / resources get freed after terminate?19:04
*** eguz has joined #openstack-ironic19:05
adam_gvia the nova hypervisor-stats call19:05
*** sysexit has joined #openstack-ironic19:05
adam_gor during the test setup have it poll hypervisor-stats until the resources reported in the flavor ref are available in nova19:05
Shrewsadam_g: ok. that sounds like the better path. thanks19:06
adam_gShrews, tripleo does something similar. may want to add a new configurable timeout for that19:06
*** eguz has quit IRC19:06
*** eghobo has quit IRC19:08
*** romcheg has joined #openstack-ironic19:14
*** sseago has quit IRC19:14
*** ellenh has joined #openstack-ironic19:20
*** sysexit has quit IRC19:24
*** dwalleck_ has quit IRC19:26
*** dwalleck has joined #openstack-ironic19:26
*** dwalleck has quit IRC19:26
*** romcheg has quit IRC19:28
*** sseago has joined #openstack-ironic19:30
openstackgerritEllen Hui proposed a change to openstack/ironic: Add more INFO logging to ironic/conductor  https://review.openstack.org/9974419:39
*** romcheg has joined #openstack-ironic19:53
*** bandicot has quit IRC19:54
*** romcheg has quit IRC20:00
*** Mikhail_D_ltp has joined #openstack-ironic20:04
NobodyCambrb20:06
*** bandicot has joined #openstack-ironic20:14
*** bandicot has quit IRC20:14
*** boris-42 has quit IRC20:18
*** romcheg has joined #openstack-ironic20:18
*** boris-42 has joined #openstack-ironic20:18
*** matty_dubs|gone is now known as matty_dubs20:27
NobodyCamoh did we get our own change queue! sweet20:32
*** dwalleck has joined #openstack-ironic20:32
openstackgerritA change was merged to openstack/ironic: Set instance default_ephemeral_device  https://review.openstack.org/9649820:34
*** dwalleck has quit IRC20:34
jrollorly20:34
*** romcheg1 has joined #openstack-ironic20:34
NobodyCam:)20:34
jrollamazing20:34
jrollwe can do work again20:34
jrollland all the things! \o20:34
NobodyCamwoo hoo our jobs have a chance of landing now20:34
*** openstackgerrit has quit IRC20:35
*** romcheg has quit IRC20:36
NobodyCamlol /me was starting to think the gate was test until it fails... :p20:36
*** openstackgerrit has joined #openstack-ironic20:36
NobodyCamoh fish feeding time... brb20:36
*** dwalleck has joined #openstack-ironic20:36
*** romcheg1 has quit IRC20:38
*** dwalleck has quit IRC20:41
NobodyCamok back20:42
openstackgerritRuby Loo proposed a change to openstack/ironic: Use .png instead of .gif images  https://review.openstack.org/9975920:45
* devananda wanders away for a bit20:46
*** dwalleck has joined #openstack-ironic20:53
*** dwalleck has quit IRC20:54
NobodyCamanyone have time to review a devstack patch.... https://review.openstack.org/#/c/99723/20:54
*** dwalleck has joined #openstack-ironic20:55
rlooNobodyCam: I have a bit of time now, but it is devstack :-) Will take a look...20:56
NobodyCamrloo: We'll need it!!20:59
*** jdob has quit IRC20:59
rlooNobodyCam: done!21:02
openstackgerritOpenStack Proposal Bot proposed a change to openstack/ironic: Updated from global requirements  https://review.openstack.org/9622821:02
NobodyCamwoo hoo :)21:02
NobodyCamTy rloo21:02
* NobodyCam thinks in about 5 minutes three patches will land al in a row!21:04
rlooNobodyCam: we still shouldn't approve anything right?21:05
jrollrloo: it looks like it might be ok now21:05
jrollwe have our own queue now21:05
rloowe do? How did we score that?21:06
jrollnot a clue21:06
rlooand how did you know that we have our own queue?21:06
NobodyCamlooks like we now have a queue with DIB :)21:06
jrollrloo: http://status.openstack.org/zuul/21:07
jrollbottom center21:07
NobodyCamthere are only three job in it21:07
jroll(also NobodyCam said so)21:07
NobodyCamlol21:07
rlooso the queue runs ironic/dib changes, but won't be affected by 'issues' in any of the other changes in the other gate/queue?21:08
jrollI think that's the idea21:08
NobodyCamwe should ask in infra.. I am only going off the zuul page21:08
rloohmm. Well, I think I won't approve until I see how long it takes for the three in the gate, to get through.21:09
openstackgerritA change was merged to openstack/ironic: Stop ipmitool.validate from touching the BMC  https://review.openstack.org/9912121:10
openstackgerritA change was merged to openstack/ironic: remove default=None for config options  https://review.openstack.org/9953221:10
jrollwelp, that was quick :)21:10
openstackgerritA change was merged to openstack/ironic: Wipe any metadata from a nodes disk  https://review.openstack.org/9313321:10
jrollrloo: +A away :D21:10
rlooha ha21:11
NobodyCamtry one21:11
NobodyCamfirst21:11
NobodyCam:-p21:11
NobodyCam:)21:11
Shrewsomg. 93133 was merged21:11
NobodyCamyep21:12
Shrewsawww, i was hoping to see it reach 100 patch sets21:12
NobodyCamlol ... /me wounder if we should declare a holiday21:12
NobodyCamlol... you just wanted the dbl party21:12
rlooI think we have to wait for 100 for a holiday.21:13
*** eghobo has joined #openstack-ironic21:14
NobodyCamfungi's offical answer: 21:13 | fungi > NobodyCam: is anything here ever permanent? it's a result of taking oslo cross-tests off those projects for the gate pipeline, which caused them to no longer have jobs in common with anything in the main integrated gate queue21:14
jrolloh :(21:17
NobodyCamyea :/21:18
jrollso let's land all the things that are ready now21:19
jrollwhile we have it21:19
openstackgerritRuby Loo proposed a change to openstack/ironic: Driver interface's validate should return nothing  https://review.openstack.org/9785521:29
*** petertoft has joined #openstack-ironic21:30
rlooI had to rebase that ^^, and now all the +2's are gone :-(21:30
* jroll would +2 if he could21:31
rloothx jroll. I've seen others sometimes approve but not sure I should do it to my own. Oh well.21:32
jroll/shrug21:32
JayFI personally would not +2 or +A my own code21:32
jrollthere's some cases where I would, but I'm evil21:33
jroll(I actually wouldn't in an openstack project, but yeah)21:33
petertoftJust to note that — Ironic is live in HP's Helion OpenStack Distribution: https://ask.openstack.org/en/question/32113/announcing-hp-helion-openstack-community-edition-ga/. Give it a try if you have a few servers, we're looking for experiences and feedback.21:34
jrolllike, this is a review where the 2x +2 thing is silly: https://review.openstack.org/#/c/99706/21:34
jrollpetertoft: interesting!21:34
openstackgerritAdam Gandelman proposed a change to openstack/ironic-specs: External event callback API  https://review.openstack.org/9977021:34
jrollpetertoft: is ironic just being used in a triple-o fashion there, I guess?21:35
petertoftYep.21:35
jrollcool :)21:35
petertoftCutting edge stuff. Thanks for the efforts of this team.21:35
*** Mikhail_D_ltp has quit IRC21:36
NobodyCamhey hey petertoft welcome to the iRonic channel21:37
NobodyCamthats awesome news21:38
Shrewspetertoft: send a few moonshots to my house and i'd be thrilled to test it  :)21:38
NobodyCamhehehe21:38
matty_dubsSame here! ;)21:39
petertoftYeh, just send me your postal address. They go via regular mail :)21:39
NobodyCamthou I could make a good case for the moonshot dev tower thing-y I've tale of21:39
*** max_lobur1 has joined #openstack-ironic21:40
rloois JoshNang around?21:42
*** max_lobur has quit IRC21:42
ShrewsNobodyCam: oh? small chassis?21:43
jrollrloo: he's on PTO21:43
jrollrloo: I can cover for him in the meantime :)21:43
rloojroll: ok thx. Would you please look at my comment in https://review.openstack.org/#/c/98922/21:43
rloojroll: he's got a lot of +1, so not sure...21:44
jrollrloo: hmm, good point21:44
* jroll wonders what other projects do21:44
jrollrloo: my thinking is: if auth_strategy was 'foobar', this patch behaves the same as before this patch, yes?21:46
jroll(since that was never checked before)21:47
rloojroll: well, there was no setting. it uses keystone.21:47
rloojroll: am looking through other confs to see if there are similar cases.21:47
jrollah, right.21:47
jrollsame, I checked nova and they just have 'if auth_strategy == keystone'21:48
jrollneutronclient at some point raised an exception if it was anything but keystone21:48
jrollnoauth is not well supported in openstack21:48
NobodyCamShrews: ya.. I hear it tower case size with four slots21:49
NobodyCams/it/it is/21:50
ShrewsNobodyCam: Must. Have. Now.21:50
rloojroll: so we have an 'auth_strategy=keystone' in ironic.api.app. It just checks if == keystone.21:51
jrollhmm21:51
jrollrloo: would you prefer to refactor it that way?21:52
rlooI don't know.21:52
jrollidk either.21:53
jroll:P21:53
rloojroll: so if you specify 'neutron', you want to do that stuff. but if you specified 'foobar', doing that will end up err'ing. but if we treat foobar as noauth, there is a security risk there.21:53
jrollright21:53
rloojroll: so maybe i open another bug about it, and +2 this?21:53
rloojroll: since I guess we have a similar issue with keystone.21:54
jrollyeah, that's fine21:54
rloojroll: or I do nothing about it and go away for the weekend...21:54
jrollalso, if we treat foobar as noauth here, there's no risk because this is the client21:54
jrollthe security risk is in setting a server as noauth21:54
jrollif we accidentally use noauth here, we just aren't sending credentials21:54
jrollnoooooooooo don't go :P21:54
rloojroll: the help msg says "noauth is insecure and should only be used for testing"21:55
jrollugh21:55
jrollrunning neutron in noauth mode is insecure21:55
jrollforgetting to send credentials when talking to neutron is not insecure21:55
* jroll wants to change that help message21:56
rloojroll: please change it then.21:56
jrollI will21:56
jrollwondering if that should say anything about security21:56
rloojroll: look at the commit msg too.21:56
jrolllike 'running neutron in noauth mode is insecure'21:56
jrollyeah, I saw that. not as bad because it's not presented to a deployer.21:56
rloojroll: exactly.21:57
jrollgrr21:57
jrollrloo: so, anything you'd like touched up in the actual code, since I'm uploading a new one anyway?21:57
rloojroll: so I was somewhat serious about taking off for the weekend. I have to go in a few minutes (when the dinner bell rings), and I'm off after that. I might look in later this evening though.21:57
jrollno worries, don't worry about checking in on me :)21:58
rloojroll: if you change, i guess it'll need 2 +2s anyway.21:58
jrollbut if you want me to add something like 'elif auth == 'keystone'' do it now21:58
jrollyeah21:58
rloojroll: I think, to be consistent with the other keystone one, I'd say do something like if CONF.neutron.auth_strategy != 'keystone'.21:59
jrollhmm, I was thinking `elif CONF.neutron.auth_strategy == 'keystone' and context.auth_token is None:`22:00
jrollon line 6422:00
rloojroll: you could do that, but then what if it is foobar?22:00
jrollthen it uses auth_strategy of None22:00
rloooh, then the last else kicks in.22:01
jroll(who knows what that does, but hey)22:01
jrollI do know that is not the same as noauth22:01
*** mrda-away is now known as mrda22:01
mrdaMorning ironic!22:01
jroll\o mrda22:02
NobodyCammorning mrda22:02
mrdao/22:02
rloojroll: to be honest, I don't know what the diff is between 'noauth' and None. I think it might not work if auth_token is None (the last else part).22:03
openstackgerritJim Rollenhagen proposed a change to openstack/ironic: Allow noauth for Neutron  https://review.openstack.org/9892222:03
jrollrloo: see how that looks ^22:03
jrollrloo: it's unclear to me, too, but it seems to me that they are different22:04
jrollbah, forgot to generate sample config22:04
rloojroll: I suspect/guess that if it is foobar and context.auth_token is None, that won't work. So it'll fail later on. Which may be fine, not sure.22:05
rloojroll: dinner bell has rung. Gotta go. thx :-)22:06
jrollprobably. but like, same behavior as before :)22:06
jrollcheers, have a good weekend!22:06
jroll(I wish mine started right now)22:06
NobodyCamnight rloo22:13
*** matty_dubs is now known as matty_dubs|gone22:21
NobodyCamlol watching jenkins is very much like watching grass grow22:22
mrdaNobodyCam: https://plus.google.com/111308284400884743702/posts/UBHf9VBfTvS22:23
NobodyCamlol22:24
*** petertoft has quit IRC22:26
*** radsy has joined #openstack-ironic22:34
*** radsy has joined #openstack-ironic22:34
*** dwalleck has quit IRC22:39
*** dwalleck has joined #openstack-ironic22:42
*** dwalleck has quit IRC22:51
NobodyCamdevananda: around?23:07
devanandaNobodyCam: ya23:08
NobodyCamjust a off the wall question (from watching jenkins)... :-p .... why do we have https://github.com/openstack/ironic/blob/master/requirements.txt#L30 when its not enabled by default?23:09
NobodyCamtakes forever to build ... lol23:10
jrollpyghmi takes forever to build?23:10
jrollor ironic?23:10
NobodyCampyghmi ... I'm watching a check-tripleo-ironic-undercloud-precise run atm23:11
NobodyCamand it builds it for seed, undercloud23:11
NobodyCamjust seem like a waste of testing cycles23:12
jroll"pure python implementation of IPMI protocol" what is it building23:12
jrolloh, requires pycrypto23:13
jrollbut it's not used23:13
* jroll sends a patch23:13
devanandaNobodyCam: I have a patch up that removes it ... got -1'd ... :p23:14
NobodyCamfrom us or the pycrypto23:15
devanandaNobodyCam: https://review.openstack.org/#/c/92819/223:15
devanandaNobodyCam: feel free to rebase (there's a conflict now) and update as needed23:15
jrolldevananda: nobody -1'd it except for lucas and yourself?23:16
jrolland you fixed lucas' issue with it23:16
NobodyCamya but I agree with "I think we should remove pyghmi from requirements..."23:17
NobodyCamif you wish it us it install it23:17
jrollbah, pycrypto is used, I forgot it's imported from Crypto23:18
NobodyCamwe've started to fail drivers on load now, like seamicro, ipmitool23:18
NobodyCamuntil we replace ipmitool with pyghmi I dont see a need to have it in the requirments file23:20
jroll+123:21
devanandaright23:22
devanandaso I think failing drivers on load that are not usable is, well, NOT doing that was terrible23:23
devanandaso yes23:23
openstackgerritAdam Gandelman proposed a change to openstack/ironic: Destroy instance to clear node state on failure  https://review.openstack.org/9951923:24
openstackgerritAdam Gandelman proposed a change to openstack/ironic: Cleanup virt driver tests and verify final spawn  https://review.openstack.org/9951823:24
devanandaadam_g: why "node.provision_state = ironic_states.ACTIVE" in nova/tests/virt/irnoic/test_driver?23:30
adam_gdevananda, hmm. copy/paste from an existing spawn test.23:31
devanandaadam_g: heh23:32
adam_gdevananda, not sure why that is there to begin with.23:32
*** mdorman has quit IRC23:34
openstackgerritChris Krelle proposed a change to openstack/ironic: Mock pyghmi lib in unit tests if not present  https://review.openstack.org/9281923:37
jrollis patching sys.modules really the best way to accomplish this?23:39
jrolldevananda: ^23:40
NobodyCamoh wait I think I boo boo'ed23:48
lifelessmock.mock!23:49
openstackgerritAdam Gandelman proposed a change to openstack/ironic: Destroy instance to clear node state on failure  https://review.openstack.org/9951923:49
openstackgerritAdam Gandelman proposed a change to openstack/ironic: Cleanup virt driver tests and verify final spawn  https://review.openstack.org/9951823:49
openstackgerritChris Krelle proposed a change to openstack/ironic: Mock pyghmi lib in unit tests if not present  https://review.openstack.org/9281923:51
devanandajroll: yes23:54
jrollhrm23:54
jrollI don't have a better way in mind, but seems like there must be something23:54
devanandajroll: this is better than what i originally thought of23:54
devanandajroll: take a look at the old review if you want. i think there was some discussion23:55
russell_hadam_g: this callback API is interesting23:55
jrolldevananda: ok23:55
russell_hadam_g: I'm thinking about if we could replace a lot of our use of vendor_passthru with that23:55
devanandalifeless: debug/verbose=True is the default now in tripleo?23:55
lifelessno23:55
russell_hadam_g: (both in the PXE driver where there is basically a "ok, now deploy" call, and in the agent driver where we have even more callbacks)23:56
lifelessdevananda: why?23:56
devanandalifeless: noticing your patch. i had though tripleo explicitly didn't want debug=true to be default23:56
lifelessdevananda: its not23:56
lifelessdevananda: that patch doesn't make it default23:57
devanandaoh23:57
adam_grussell_h, yeah. im in favor of adding more potential use cases to the spec. a quick look at the reference agent driver showed a lot more neutron usage that would be prone to similar races we've already seen23:57
lifelessthat patch adds debug=True if the heat metadata ironic.debug is truthy23:57
lifelesslikewise for verbose23:57
lifelessand otherwise leaves the setting absent from the file entirely23:58
russell_hadam_g: yes23:58
*** igordcard has quit IRC23:58
jrolladam_g: would love for neutron to call back23:58
adam_grussell_h, im also wondering if it should model the nova os-external-events so closely or diverge a bit and also track events in the context of not just instance, but nodes as well23:58
jrollthat's a pain point for us today23:58
devanandalifeless: ack. i fail at reading :)23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!