Thursday, 2014-01-30

*** epim has joined #openstack-ironic00:04
NobodyCamdevananda: you around to click wip?00:15
*** matsuhashi has joined #openstack-ironic00:26
devanandaNobodyCam: back00:38
NobodyCam:)00:42
* NobodyCam is going to call it a day00:42
NobodyCamlol00:43
*** epim has quit IRC00:51
*** Haomeng|2 has quit IRC01:04
*** Haomeng has joined #openstack-ironic01:04
devanandaNobodyCam: clicked WIP. also - you see hemna's review yet?01:07
NobodyCamdevananda: the libvirt stuff01:08
devanandaNobodyCam: actually, it's mostly LOG comments -- let me second that. the LOG.info is a bit excessive. I think those are really LOG.debug that you should remove soon, as reviewers are starting to take an interest ....01:08
NobodyCamthose are removed01:09
devananda:)01:09
NobodyCamya01:09
devanandaNobodyCam: the libvirt comment is a bit trickier. any thoughts?01:09
NobodyCamother then the fixme :-p01:10
devanandalol01:11
devanandak k. have a good night :)01:11
NobodyCamlol01:11
NobodyCam:-p01:11
*** rloo has quit IRC01:16
*** rloo has joined #openstack-ironic01:16
openstackgerritRuby Loo proposed a change to openstack/ironic: Update docstrings in ssh.py  https://review.openstack.org/7003301:17
*** epim has joined #openstack-ironic01:18
*** nosnos has joined #openstack-ironic01:38
*** epim has quit IRC01:48
*** rloo has quit IRC01:59
openstackgerritA change was merged to openstack/ironic: Add missing parameter in call to _load_one_plugin  https://review.openstack.org/6949502:12
*** vkozhukalov has joined #openstack-ironic02:20
*** jcooley_ has quit IRC02:47
NobodyCamdevananda: ^^^^^^^^ woo hoo03:04
openstackgerritA change was merged to openstack/ironic: Docstrings for ipmitool  https://review.openstack.org/6866503:19
*** coolsvap_away has quit IRC03:27
*** jcooley_ has joined #openstack-ironic03:27
*** matsuhashi has quit IRC03:29
*** jcooley_ has quit IRC03:34
*** jcooley_ has joined #openstack-ironic03:35
*** jcooley_ has quit IRC03:40
*** leizhang has joined #openstack-ironic03:44
*** leizhang has quit IRC04:01
*** matsuhashi has joined #openstack-ironic04:02
*** aignatov_ is now known as aignatov04:04
*** jcooley_ has joined #openstack-ironic04:10
*** jcooley_ has quit IRC04:16
*** jcooley_ has joined #openstack-ironic04:17
*** jcooley_ has quit IRC04:21
*** jcooley_ has joined #openstack-ironic04:22
*** aignatov is now known as aignatov_04:50
*** matsuhashi has quit IRC05:14
*** matsuhas_ has joined #openstack-ironic05:17
*** coolsvap has joined #openstack-ironic05:19
*** rwsu has quit IRC05:27
openstackgerritJenkins proposed a change to openstack/ironic: Imported Translations from Transifex  https://review.openstack.org/6802406:07
*** vkozhukalov has quit IRC06:18
*** jcooley_ has quit IRC06:59
*** jcooley_ has joined #openstack-ironic07:00
*** hstimer has quit IRC07:06
*** jcooley_ has quit IRC07:16
*** GheRivero has quit IRC07:25
*** mrda is now known as mrda_away07:32
ifarkasNobodyCam, sorry, I was out yesterday evening07:45
ifarkasNobodyCam, ping me when you will be online07:45
*** jcooley_ has joined #openstack-ironic07:51
*** romcheg has joined #openstack-ironic07:53
*** vkozhukalov has joined #openstack-ironic07:57
*** jistr has joined #openstack-ironic08:02
*** jcooley_ has quit IRC08:05
*** ifarkas_ has joined #openstack-ironic08:09
*** vkozhukalov has quit IRC08:10
*** ifarkas has quit IRC08:13
*** GheRivero has joined #openstack-ironic08:16
*** harlowja is now known as harlowja_away08:18
*** vkozhukalov has joined #openstack-ironic08:19
*** nosnos has quit IRC08:39
*** nosnos has joined #openstack-ironic08:39
*** vkozhukalov has quit IRC08:43
*** mdurnosvistov has joined #openstack-ironic08:46
*** jcooley_ has joined #openstack-ironic08:46
openstackgerritMikhail Durnosvistov proposed a change to openstack/ironic: Get rid of the newline "\"  https://review.openstack.org/6679308:52
*** aignatov_ is now known as aignatov08:56
*** vkozhukalov has joined #openstack-ironic08:57
GheRiveroanyone else is seing unique constrains error when running tox?08:58
GheRiverotested in a new clean environment and the same. WTF!09:08
openstackgerritYuriy Zveryanskyy proposed a change to openstack/ironic: Add ability to break TaskManager locks via REST API  https://review.openstack.org/5554909:10
*** GheRiver1 has joined #openstack-ironic09:14
*** GheRivero has left #openstack-ironic09:16
*** GheRiver1 is now known as GheRivero09:16
*** jcooley_ has quit IRC09:16
yuriyzmorning Ironic09:17
yuriyzGheRivero, I dont see09:17
GheRiveromorning09:17
yuriyzPlease copy error message09:18
GheRivero:/09:18
GheRiverohttp://paste.openstack.org/show/62153/09:19
GheRiveroin Debian Sid + SQLite 3.8.209:19
yuriyzGhe, maybe you need this https://review.openstack.org/#/c/69004/09:21
GheRiveroagh! i now i had seen it someplace but couldn't find it! testing it09:22
*** ndipanov has joined #openstack-ironic09:23
mdurnosvistovMorning all! :)09:23
*** derekh has joined #openstack-ironic09:26
*** matsuhas_ has quit IRC09:33
*** matsuhashi has joined #openstack-ironic09:39
*** Alexei_987 has joined #openstack-ironic09:44
*** athomas has joined #openstack-ironic09:44
*** nosnos has quit IRC09:46
*** nosnos has joined #openstack-ironic09:46
*** nosnos has quit IRC09:47
*** martyntaylor has joined #openstack-ironic09:48
*** matsuhashi has quit IRC09:50
*** ifarkas_ has quit IRC10:08
*** jistr has quit IRC10:08
*** jcooley_ has joined #openstack-ironic10:09
*** ifarkas has joined #openstack-ironic10:11
Haomengmorning all:)10:11
GheRiveromorning10:12
*** jcooley_ has quit IRC10:14
*** aignatov is now known as aignatov_10:15
*** aignatov_ is now known as aignatov10:15
*** GheRivero has quit IRC10:20
*** coolsvap has quit IRC10:28
*** aignatov is now known as aignatov_10:31
*** jistr has joined #openstack-ironic10:38
*** tatyana has joined #openstack-ironic10:46
*** vkozhukalov has quit IRC10:48
*** lucasagomes has joined #openstack-ironic10:56
*** derekh has quit IRC10:58
*** vkozhukalov has joined #openstack-ironic11:00
*** jcooley_ has joined #openstack-ironic11:02
*** aignatov_ is now known as aignatov11:04
*** max_lobur_afk is now known as max_lobur11:05
*** jcooley_ has quit IRC11:16
*** ko__ has joined #openstack-ironic11:25
*** coolsvap has joined #openstack-ironic11:31
openstackgerritMax Lobur proposed a change to openstack/ironic: Fix JSONEncodedDict default values  https://review.openstack.org/6841312:18
*** coolsvap has quit IRC12:20
*** anyone_else has joined #openstack-ironic12:29
*** anyone_else is now known as romcheg112:41
*** jcooley_ has joined #openstack-ironic12:51
lucasagomesNobodyCam, devananda: w00ts,http://s21.postimg.org/yuxilhft1/Screenshot_from_2014_01_30_12_53_02.png12:58
lucasagomesnova w/ ironic driver + ironic12:58
lucasagomesdeloyed :)12:58
lucasagomesifarkas, ^12:58
ifarkaslucasagomes, hey, congrats!12:59
romcheg1lucasagomes: cooooool!13:00
lucasagomescheers, needs some polish tho13:00
ifarkaslucasagomes, really cool! What image did you use the node?13:00
lucasagomesit's the cirros image13:00
romcheg1I'm trying to deploy something with Ironic as well13:00
lucasagomesifarkas, http://s8.postimg.org/gfcjnnf7n/Screenshot_from_2014_01_30_13_01_11.png13:01
lucasagomesnow it finished booting13:01
romcheg1What a beauty :)13:02
lucasagomesromcheg1, great, yea we need to test it as much as possible13:02
lucasagomesI will try to write a guideline13:02
romcheg1I already found a bug :)13:02
lucasagomesheh yea13:02
lucasagomesin the image you can see that the power state is not being synced13:02
ifarkas+1 for the guide. the previous one was also really helpful!13:02
lucasagomesfrom ironic to nova heh13:02
romcheg1We created Ironic and now are trying to guess how to use it :-P13:03
lucasagomeshah yea13:03
ifarkaslol13:03
*** vkozhukalov has quit IRC13:03
*** GheRivero has joined #openstack-ironic13:09
*** vkozhukalov has joined #openstack-ironic13:18
*** jcooley_ has quit IRC13:25
ko__hi13:34
ko__I am ne to openstack and I am trying to setup ironic using devstack13:34
ko__can someone please help me..13:35
lucasagomesko__, hi there13:35
lucasagomesplease take a look at13:35
lucasagomeshttps://wiki.openstack.org/wiki/Ironic#Try_it_on_Devstack13:35
ko__Thanks for responding. I have followed that guide..13:36
ko__However, I am not sure if it is necessary to setup a undercloud to see ironic in action..13:36
lucasagomesko__, hmm ironic is not 100% ready yet13:37
lucasagomesthere's another guide that you can follow using devstack13:37
lucasagomesthat you can get ironic to boot a vm13:37
ko__is there a way to skip setting up undercloud and see ironic in action..?13:37
lucasagomesso u can start doing some experiements with it13:37
lucasagomesko__, yes13:37
lucasagomesko__, lemme find the link for ya13:37
lucasagomesko__, https://etherpad.openstack.org/p/IronicDeployDevstack13:37
ko__that would be great..13:37
lucasagomesko__, it's experimental yet, we are working on the tripleO integration in this cycle as well13:38
ko__okay..13:39
ko__Let me validate my environment with you. I have a ESX host. On one of the VM I have setup devstack and I have another VM that I want to manage using ironic.13:40
ko__I was not sure what driver I have to use when regisetring the node in ironic so I used fake_ssh driver..13:41
ko__And I have a common network shared between devstack vm and the baremetal node. and one uplink on the devstack vm using which I can connect to it..13:42
ko__Is there anything spection that I have to take care of before I fire stack.sh..?13:43
lucasagomesko__, environment seems fine13:46
lucasagomesonly the driver used (you can see on the guide)13:46
lucasagomesis pxe_ssh13:46
lucasagomesso we use ssh in the tests as a mock for ipmi13:46
ko__So you mean to say that I have to use pxe_ssh instead of fake_ssh..13:47
lucasagomesko__, yup13:47
lucasagomesfake is just used for our unittests13:47
ko__do i also have to setup virsh on the esx host..?13:48
lucasagomesssh = ur power interface (will power on/off the node issuing virsh commands)13:48
lucasagomesko__, yes13:48
ko__okay.. thanks a lot.. Let me try it out pretty quick..13:49
lucasagomesko__, np :)13:49
openstackgerritA change was merged to openstack/ironic: API: Add sample() method on Node  https://review.openstack.org/6553613:50
*** jdob has joined #openstack-ironic13:54
*** romcheg1 has quit IRC14:03
*** vkozhukalov has quit IRC14:06
ko__lucasagomes: I followed the https://etherpad.openstack.org/p/IronicDeployDevstack till line number 65. When I execute line number 68, when I try to start service openvswitch, i get unrecognized service..14:07
ko__is this something expected..?14:07
ko__also, apt-get install openvswitch didnt help either..14:08
lucasagomesko__, openvswitch is not installed14:09
lucasagomesI think on ubuntu it;s openvswitch-switch or something like that lemme see14:09
lucasagomesbut hmm14:09
lucasagomesyou can configure the bridge ip by hand if u want as well14:09
ko__can you please help me with the commands please..14:09
ko__my eth0 on devstack is uplink and eth1 is shared by the baremetal node..14:10
lucasagomesapt-get install openvswitch-switch14:10
lucasagomesright, yea all you need is a common network between both nodes14:11
lucasagomesso you can pxe boot it14:11
ko__I checked and it seems openvswitch-switch package is already installed and is latest..14:11
ko__but it still errors when I try to start the service..14:12
lucasagomesko__, service openvswitch-switch restart  ?14:12
ko__let me try..14:12
ko__lucasagomes: that worked. thanks..14:12
lucasagomesko__, :) np updated the guide as well for both os14:13
lucasagomesko__, heh as I told you it's experimental yet (including that guide)14:13
lucasagomesfeel free to update it with ur findings14:13
lucasagomesthat will be very helpful14:13
ko__I dont mind trying experimental stuff.. I would be happy to help you in updating the guide.. However i need to know what works before I update it... and I need help from community to do that as i am just a beginner in linux..14:15
*** matty_dubs|gone is now known as matty_dubs14:16
*** jcooley_ has joined #openstack-ironic14:18
lucasagomessure :)14:18
*** vkozhukalov has joined #openstack-ironic14:19
*** max_lobur is now known as max_lobur_afk14:26
*** ko__ has quit IRC14:26
*** ko__ has joined #openstack-ironic14:27
*** jcooley_ has quit IRC14:27
*** rloo has joined #openstack-ironic14:28
ko__lucasagomes: can you please help me with the network creation on ubuntu.. seems like the script is not working for me.14:30
lucasagomesko__, right, any output?14:31
ko__one sec..14:31
ko__error: command 'net-list' doesn't support option --persistent14:33
ko__error: command 'net-list' doesn't support option --persistent14:33
ko__error: Failed to define network from /dev/fd/6314:33
ko__error: XML error: unexpected virtualport type -114:33
ko__lucasagomes: these are four lines that get printed when I execute setup-network14:34
lucasagomesright14:34
lucasagomesko__, I think it's because of ur virsh version14:34
lucasagomesto not support the persistent option14:35
ko__okay..14:35
lucasagomes[lucasagomes@lucasagomes nova]$ virsh --version14:35
lucasagomes1.1.3.314:35
lucasagomesis ur virsh 1.1.*+ ?14:35
ko__so I tried after editing the setup-network script (removed --persistent) and the first two error disappeared..14:36
ko__byut the last two are still there..14:36
ko__my virsh version is 0.9.814:36
ko__I am using Ubuntu 12.04.3 if that matters in any way..14:37
lucasagomesright, lemme see if I can find something14:38
lucasagomes(actually I dunno much ubuntu, have been using fedora for a long time since now)14:38
ko__oh..14:38
lucasagomesko__, wondering if it's virsh permission14:39
lucasagomestry to14:39
lucasagomesexport LIBVIRT_DEFAULT_URI="qemu:///system"14:39
lucasagomesand run it14:39
ko__one question.. since I already have one network connected for baremetal VM on devstack, is this step still needed..?14:39
lucasagomesko__, I don't think so14:40
lucasagomesif the vms can communicate with each other that's what's needed14:40
lucasagomesthat script is just to try to make things easier when creating the bridge for both vms14:40
lucasagomes(but it seems it's complicating more than helping)14:40
ko__So basically, I can skip this step and I can move to line number 82. is that correct..14:41
lucasagomes(we assumed that people would be familar with tripleO, that's why we are using the tripleO scripts)14:41
lucasagomesko__, yes, which is also a tripleo script heh14:41
lucasagomesbut wait14:41
ko__I am sorry.. As of now, I am just new to openstack as well as tripleo..14:42
lucasagomesif you already have a vm you want to manage via ironic you might won't need that as well14:42
lucasagomescause all that script does is to create/configure a vm to be managed by ironic14:42
lucasagomesyou already have one is that correct?14:42
lucasagomesko__, nothing to be sorry :)14:42
ko__yes.. I already have a VM on the ESX host pretending as baremetal node.14:42
lucasagomesmake sure ur vm is configured to boot via network14:43
*** aignatov is now known as aignatov_14:43
ko__it is configured to boot via network. but when I start the VM, it keeps looking for PXE response in a loop..14:43
lucasagomesko__, that's correct :)14:44
lucasagomesko__, in that guideline you will have to setup dnsmasq to answer the pxe dhcp request14:44
ko__so I should skip to dnsmasq setup.. let me do that..14:45
lucasagomes(it's just one workaround while the neutron is not complete integrated with ironic yet)14:45
lucasagomesko__, no, well you'll need the dnsmasq14:45
ko__ok.. I meant I will skip and start with the lace where dnsmasq config starts..14:46
lucasagomesah gotcha14:49
*** aignatov_ is now known as aignatov14:53
*** rloo has quit IRC14:53
GheRivero~~~p0-14:54
GheRivero]]]]]]]]]]]]]]]]]]]]]14:55
*** max_lobur_afk is now known as max_lobur14:56
ko__lucasagomes: I completed the network creation but Now i get error on line 16515:01
ko__HTTPForbidden (HTTP 403)15:01
ko__I mean my baremetal is now able to get pxe IP address...15:02
ko__and when I execute any ironic command, its givving me this error.15:03
lucasagomesko__, right so when registering the node with ironic it's returning 403?15:03
lucasagomesany error message?15:03
ko__yes..15:03
ko__even if i execute 'ironic driver-list', it gives me the same error..15:03
ko__nope..15:04
lucasagomesdid registering the images with glance worked?15:04
ko__yes that worked..15:04
lucasagomesko__, I think it's a bug in devstack, we have a patch for it at the begginning of the guide15:04
lucasagomes(which is abandoned but is needed)15:04
ko__I am looking at the ironic api log and see that there is no auth token in header..15:04
lucasagomeslemme find for u15:04
lucasagomeshttps://review.openstack.org/#/c/66925/15:04
lucasagomescheck ur auth_url15:05
lucasagomesin the ironic.conf15:05
lucasagomessee if it's incliude the version15:05
lucasagomesko__, you can add the /v2.0 by hand in the /etc/ironic/ironic.conf15:05
lucasagomesand then you'll have to restart the ironic services15:05
ko__okay.. let me do that..15:05
NobodyCammorning ironic says the man as he starts the coffee15:06
lucasagomesNobodyCam, morning15:06
lucasagomesNobodyCam, gotta talk to u15:06
NobodyCam:)15:06
lucasagomesNobodyCam, it's ok if I submit new patch-sets to the driver?15:06
lucasagomesNobodyCam, btw, I managed to deploy a machine with nova+ironic15:06
NobodyCamone minute15:06
NobodyCamawesome and yes please do15:07
lucasagomesNobodyCam, http://i.imgur.com/NvfCFAS.png :)15:07
NobodyCamw00t15:08
NobodyCambrb15:08
lucasagomesNobodyCam, cheers I will work on a patch-set15:08
lucasagomesNobodyCam, and great work at the driver :D devananda as well15:08
ifarkasNobodyCam, Good morning15:14
NobodyCammorning ifarkas :)15:14
ifarkasNobodyCam, regarding your question yesterday about my review, does the /mnt/state/boot-stack is created dir exist for you?15:15
ifarkasNobodyCam, My undercloud is missing /mnt/state/boot-stack and /mnt/state/opt/boot-stack15:16
NobodyCamifarkas: ya.. ws just looking at clints comments,15:16
NobodyCamI will push up a patch that sets it as /mnt/state/opt/boot-stack15:17
ifarkasNobodyCam, so, do you have /mnt/state/opt/boot-stack dir? because I don't15:18
NobodyCamifarkas: last patch creates it: https://review.openstack.org/#/c/66461/5/elements/nova-ironic/os-refresh-config/configure.d/80-ironic-ssh-power-key15:18
ifarkasNobodyCam, oh, right. cool!15:19
ifarkasNobodyCam, I missed that line somehow :-)15:19
NobodyCamifarkas: ok new patch up15:23
NobodyCamlucasagomes: fyi : https://review.openstack.org/#/c/66461/ just push new version up15:24
lucasagomesNobodyCam, cheers15:24
*** lucasagomes is now known as lucas-hungry15:24
*** rwsu has joined #openstack-ironic15:24
ko__lucas-hungry,  followed till the end of the guide. but VM wont boot... it is still stuck with the PXE. It is able to get DHCP ip address but its not able to receive boot files.15:25
NobodyCamko__: is it trying to pxe boot at all?15:25
ko__yes.. it is...15:26
ko__there is no change in the /tftproot directory on the devstack box..15:26
ko__is there something wrong..15:26
NobodyCamwho is the owner of the /tftpdir15:26
ko__its root and permission is 77715:27
NobodyCamok15:27
NobodyCamthat works too15:27
NobodyCam:)15:27
NobodyCamhow about /var/lib/ironic15:27
ifarkasNobodyCam, Looks good to me ;-)15:28
NobodyCam:)15:28
ko__same. root and 77715:28
NobodyCamifarkas: thank you for the review :)15:29
ifarkasNobodyCam, thanks for the fix ;-)15:29
NobodyCamko__: is there anything in the ironic-conductor.log ?15:29
ifarkasNobodyCam, ...and for the whole element15:29
openstackgerritGhe Rivero proposed a change to openstack/ironic: Remove deploy kernel and ramdisk global config  https://review.openstack.org/7014015:29
openstackgerritGhe Rivero proposed a change to openstack/ironic: Remove net_config_template options  https://review.openstack.org/7014115:29
NobodyCamGheRivero: :)15:30
ko__NobodyCam, any hint on log file name for ir-cond..?15:32
NobodyCamin dib setup it is /var/log/upstart/ironic-conductor.log15:33
NobodyCamnot sure in devstack maybe /var/log/ironic-conductor.log15:33
NobodyCamcan you paste the deploy bits to us?15:34
ko__NobodyCam, I am sorry but i am having trouble finding the logs..15:36
NobodyCamoh devstack you prob have a screen for that15:36
ko__yes.. but i thought, its getting logged in some file too..15:37
NobodyCamgah been awhile for me and devstack15:37
NobodyCamcan you cut and paste the screen log to http://paste.openstack.org15:38
ko__NobodyCam, did that.. Paste #6217715:39
*** rloo has joined #openstack-ironic15:40
ko__do you want me to execute curl cmd again and then paste it over there..?15:40
NobodyCamko__: can you send the entire url15:40
ko__http://paste.openstack.org/show/62177/15:41
NobodyCam:)15:41
NobodyCamdont even see it tring the deploy15:42
NobodyCamhow about n-compute and n-sch15:42
ko__one sec..15:45
NobodyCamsure15:46
NobodyCamGheRivero: why are you removing net_config_template???15:47
ko__http://paste.openstack.org/show/62179/15:49
NobodyCamko__: second line15:50
NobodyCamparamiko.transport [-] Authentication (password) failed.15:50
ko__ohh.. is this password for api or for virsh for the host..?15:50
*** aignatov is now known as aignatov_15:50
GheRiveroNobodyCam: we are not doing file injection and there is no template anymore15:50
NobodyCamko__: that should be virsh host15:51
NobodyCamGheRivero: have you seen the dev email thread re: [openstack-dev] [Ironic] File Injection (and the lack thereof)15:52
ko__okay.. the fact is that the baremetal VM is on a ESX host which does not have virsh installed. so i used fake_ssh driver for the node.15:52
ko__is there anyway by which i can avoid installing virsh on the esx host. I dont have the host creds with me and I do not have access to modify the vsphere either..15:54
NobodyCamko__: https://bugs.launchpad.net/ironic/+bug/126041415:55
GheRiveroNobodyCam: true. But we are not doing file injection now, and dhcp config was an ubuntu only option and...15:56
NobodyCamGheRivero: ack, I just wanted some understanding15:58
NobodyCamfor the patch15:58
GheRiveroand there was some consensus about it: http://paste.openstack.org/show/62181/15:58
GheRiverobut feel free to -2 it! :)15:58
GheRiveromaybe I should had open a bug to annotate all this15:59
NobodyCamGheRivero: :) looks good to me15:59
NobodyCamhehe :)15:59
NobodyCamko__: do you a actual node for testing?16:01
NobodyCamie a bm-vm?16:02
NobodyCamif so use fake ipmi driver and manually turn on the power16:02
*** athomas has quit IRC16:02
NobodyCamsorry still not enough coffee16:03
NobodyCamfake_pxe16:03
*** ifarkas has quit IRC16:09
*** athomas has joined #openstack-ironic16:11
*** jcooley_ has joined #openstack-ironic16:12
ko__nope.. i am using bm-vm16:14
ko__and i use fake_pxe.. but I am getting a different error now..16:14
NobodyCamfoke_ssh is fake for pxe ans real ssh power control16:15
NobodyCamfake_pxe is what you want. as that is real pxe deploy and fake power16:15
ko__NobodyCam, I am now getting some error in ir-api16:18
ko__let me paste it and pass the link to you..16:18
NobodyCam:)16:18
NobodyCamTy16:18
ko__http://paste.openstack.org/show/62185/16:18
NobodyCamwhile you get that I'm going to grab another cup of coffee ... brb16:18
NobodyCamone sec16:18
ko__take your time...16:19
NobodyCamko__: can you paste me the output of ironic node-show <NODE_UUID>16:22
ko__http://paste.openstack.org/show/62186/16:23
*** lucas-hungry is now known as lucasagomes16:24
ko__NobodyCam, I have followed https://etherpad.openstack.org/p/IronicDeployDevstack and I have only skipped line number 180 as I was not sure about it..16:24
ko__any luck..16:29
*** zul has quit IRC16:29
NobodyCamyou will need a instance id16:30
NobodyCambut I need to look whats up with the kernel_id16:31
ko__Can you please help me get one..16:31
lucasagomesko__, fake_pxe?16:31
ko__yes16:31
NobodyCamlucasagomes: WB16:31
lucasagomes:)16:31
NobodyCamlucasagomes: would not instance id on a node cause a kernel_id error in pxe?16:31
*** zul has joined #openstack-ironic16:32
ko__let me try with line 180 then..16:33
*** martyntaylor has quit IRC16:33
lucasagomesNobodyCam, yup, if instance doesn't contain a kernel_id or ramdisk_id16:33
devanandamorning, all16:33
NobodyCammorning devananda :)16:33
lucasagomesmorning devananda16:33
*** martyntaylor has joined #openstack-ironic16:33
NobodyCamlucasagomes: tell him the good news16:34
*** lsmola_ has quit IRC16:34
lucasagomesNobodyCam, yeah16:34
lucasagomesdevananda, check it out16:34
lucasagomesdevananda, http://i.imgur.com/NvfCFAS.png16:34
lucasagomesnova + ironic16:35
NobodyCam:):):)16:35
* devananda tries to read scrollback before coffee finishes brewing16:35
NobodyCamdevananda: look at lucasagomes's link16:35
romchegMorning devananda, NobodyCam16:35
romchegHow are you?16:35
*** jcooley_ has quit IRC16:35
NobodyCammorning romcheg :)16:36
devananda\o/16:36
NobodyCamdevananda: :)16:36
devanandalucasagomes: full deploy & it got the right IP. Now, could that instance reach out on the network?16:36
NobodyCamdevananda: any thoughts about conversation Spamap S and I are having in OoO16:37
devanandafantastic stuff folks!!16:37
devanandaNobodyCam: lemme read that scrollback ....16:37
lucasagomesdevananda, one thing per time... this is only nova driver + ironic16:37
lucasagomesdevananda, we splitted tests to try out the things as atomic parts16:37
lucasagomesdevananda, we also got a machine booted with ipmi thank to matty_dubs :)16:37
devanandalucasagomes: awesome!16:38
lucasagomeswe will test the neutron integration as well16:38
NobodyCamw00t!!!!16:38
lucasagomesand once we get all the parts in good shape16:38
lucasagomeswe are going to test the whole integration16:38
ko__NobodyCam, lucasagomes: it didnt work with line 180 either.. actually, it gave me an error..16:39
lucasagomesko__, so did ironic generate all the config files at the /tftproot folder?16:41
ko__nope16:41
ko__it only has pxelinux.016:41
lucasagomesright16:41
NobodyCamko__: are the glance id vaild for your case?16:41
ko__yes.. i have verified them assuming that I have to use image uuids16:42
ko__| 8e2d4cb0-3598-4fef-bc97-614c2874f15e | Deploy Kernel                   | aki         | aki              | 5631184     | active |16:43
ko__| 3d3a1233-d2b9-4f96-98e4-971b28a257a5 | Deploy Ramdisk                  | aki         | aki              | 80574387    | active |16:44
lucasagomesko__, the pxe_image_source argument16:44
lucasagomesis the id of the cirros image in glance?16:44
ko__| 089ab991-8c10-41d5-96a0-2fff8012b1eb | Windwos 2012 R2                 | vhd         | bare             | 10411724800 | active |16:44
NobodyCamoh windows16:44
ko__nope that a VHD image that I have uploaded and I ma trying to use that..16:44
lucasagomesohh windows and pxe boot heh16:44
lucasagomesright, ko__ that won't work that easily, actually we lack in support for windows in the moment16:45
ko__yup.. but atleast it should boot to PXE for deployment.. right..16:45
NobodyCamko__: https://blueprints.launchpad.net/ironic/+spec/windows-pxe-localboot016:45
ko__and then should fail at a later stage..16:45
lucasagomesko__, hmm no really, cause the pxe driver will try to cache the final image (to dd it to the disk)16:45
lucasagomesand also the ramdisk+kernel associated with that image16:45
lucasagomesin that case ur windows image has no kernel and ramdisk16:46
ko__k.. let me try with the cirrus then16:46
lucasagomesin order to pxe windows, we will need some mechanism in ironic to tell that it's an windows image and generate a diff pxe config file16:47
lucasagomes^ not implemented yet (take a look at the link NobodyCam gave u(16:47
*** hemna has quit IRC16:47
ko__okay.. but that part comes into picture once bm-vm has booted into deployment mode.16:48
ko__in my case its not pxe booting into deployment mode...16:48
lucasagomesko__, yes but the pxe driver will cache the final image before16:48
ko__okay.. so is there a logic in pxe driver which would inspect the image to check if its windows or linux and takes appropriate action.. Sorry.. I am not clear and I just want to understand better..16:49
lucasagomesko__, yup, but don't apologize :)16:50
lucasagomeswe lack in documentation in the moment16:50
lucasagomesit's our fault heh16:50
NobodyCam:-p16:51
ko__can you please be specific as in what inspection logic exists.. any line numbers from the code would be great..16:52
lucasagomesko__, in the moment there's no logic for that yet16:52
lucasagomesko__, https://blueprints.launchpad.net/ironic/+spec/windows-pxe-localboot016:53
lucasagomesthat would implement that ^16:53
devanandaso, no, we shouldn't be inspecting the image _contents_ to determine what kind of OS it is16:54
devanandathere should be image meta-data which specifies16:54
lucasagomesdevananda, +116:55
lucasagomessorry I think I missed what he said, yea it won't mount the image to inspect it16:56
lucasagomeseven because by mounting the filesystem you already modify an image (fs flags for checksum etc)16:56
lucasagomesit needs to be something external16:56
devanandayep16:57
max_loburmorning / afternoon Everyone16:58
NobodyCammorning max_lobur :)16:59
ko__I get that.. with cirrus image pxe config is getting created under /tftproot. but bm-vm still does not boot.17:00
NobodyCamlucasagomes: note: keyname change in https://review.openstack.org/#/c/66461 just pushed up17:01
ko__meaning its not getting response from TFTP server..17:01
NobodyCamko__: dnsmasq running?17:02
dkehndevananda: the ironic sprint, 3/3, I saw the email to book, but to where?17:02
NobodyCamdkehn: I think seattle but not sure?17:03
devanandanope17:03
devanandalemme check before i say for sure17:03
ko__NobodyCam: bm-vm is able to get IP address. so I can safly assume that its running..17:04
NobodyCamhumm... ko__ are you running neutron?17:04
lucasagomesNobodyCam, cheers17:04
NobodyCamthat would give ip with out pxe booting17:04
devanandadkehn: which email are you referring to?17:05
ko__I guess so.. I can see the logs in screen..17:05
dkehndevananda: HP17:05
NobodyCambrb17:05
*** blamar has joined #openstack-ironic17:06
dkehndevananda: Thu 1/30/2014 3:36 AM17:06
dkehndevananda: maybe jumping the gun, read proposed dates17:06
*** martyntaylor has quit IRC17:07
dkehndevananda: don't waste anytime looking it up will bug SpamapS or lifeless17:07
NobodyCambbt...brb17:07
dkehnwas so hoping for Seattle17:07
devanandadkehn: location is almost definitely the bay area. looks like a few things aren't confirmed yet as no official announcement has gone out17:08
dkehndevananda: thx, at least its not Northern part of the world17:09
lucasagomesdevananda, that's the mid-cycle meetup?17:09
devanandadkehn: i haven't seen anything yet indicate we should start booking17:09
devanandalucasagomes: yea17:09
devanandalucasagomes: lifeless is arranging the budget/space/etc. I'd really like you & other redhat folks to be there, and some of the mirantis folks17:10
devanandarloo - will you be around the bay area march 3 - 7?17:10
devanandaromcheg, max_lobur - any chance you guys will be able to fly to california in early march for a code sprint?17:11
*** matty_dubs is now known as matty_dubs|lunch17:12
rloodevananda: I wasn't planning on it. I suppose I could. Umm, maybe not. I think I am single-parenting that week til the Tues. Are the dates confirmed?17:12
*** Haomeng has quit IRC17:12
* rloo need to read emails17:13
devanandarloo: dates are not yet confirmed17:13
lucasagomesdevananda, I will talk to my manager about the budget etc, haven't heard anything yet. But yea the last mid-cycle was very useful17:13
devanandarloo: i thought you lived near SF ?17:13
rloodevananda. If Toronto Canada is near, then I do ;)17:13
NobodyCamlol17:14
devanandarloo: hah! um....17:14
romchegdevananda: I don't know yet17:14
romchegI do not have a US visa yet17:14
devanandaromcheg: ah. then it's not likely17:14
romchegI will ask my mgr when he's back from his vacation17:14
NobodyCamromcheg: may be tuff for you to get one now.17:15
devanandaromcheg: know if anyone else @mirantis, working on ironic, has US visa?17:15
rloohas the US blocked visas for Ukraine?17:15
romchegdevananda: AFAIK no one17:15
romchegrloo: Only for certain officials17:15
max_loburdevananda, Idk too17:16
max_loburbtw my visa interview will happen next Monday :) wish me a luck :)17:16
devanandabrb17:16
rloogood luck max_lobur!17:17
romchegGetting a visa is not a big deal.17:17
max_loburand point two - even if I have vise I'm not sure if they approve me to fly17:17
max_loburrloo, they blocked only for our government guys17:17
romchegI can do it without Mirantis. However I need sponsorship to get to the summit17:17
max_loburnot for all17:17
lucasagomesmax_lobur, g luck :)17:18
rloomax_lobur. Good to hear,just the bad guys are blocked ;)17:18
max_loburlucasagomes, thx :)17:18
max_loburrloo yep! :)17:18
lucasagomesvisas r always a pain in the neck :/17:20
max_loburtrue17:20
NobodyCampost bbt walkies... bbiafm17:20
*** ko__ has quit IRC17:23
romchegThe reason I will never stop using Google is NobodyCam's bbts, brbs, bbiafms and other wthits :D17:24
max_loburlol17:24
*** Alexei_987 has quit IRC17:25
rlooromcheg: ha ha. and I thought it was just me! ;)17:25
*** jcooley_ has joined #openstack-ironic17:25
devanandaback17:26
max_loburI was always wondering what a hell is bbt :D17:26
devanandabubby breakfast time -- probably wont find that in google search17:26
devananda:)17:27
devananda(i think)17:27
max_loburahh :)17:27
max_loburso sweet :)17:28
lucasagomeshah17:28
*** jcooley_ has quit IRC17:28
lucasagomesurban dictionary says something complete different :P17:29
max_loburlucasagomes, pls say you didn't know too :)17:29
lucasagomesmax_lobur, I didn't hah17:29
lucasagomesI only know bbq = barbecue17:29
lucasagomes:P17:29
max_lobur:D17:29
*** aignatov_ is now known as aignatov17:31
openstackgerritMax Lobur proposed a change to openstack/ironic: Allow concurrent image downloads in pxe logic  https://review.openstack.org/6390417:32
lucasagomesdevananda, quick q17:32
lucasagomeswhen issuing nova boot, we have to specify the --image parameter17:32
lucasagomesshould we use that instead of having to add pxe_image_source directly in the driver_info in ironic?17:33
lucasagomesby use that I mean, should the nova driver inject the pxe_image_source information in ironic17:33
*** jcooley_ has joined #openstack-ironic17:34
NobodyCamlol17:34
NobodyCamyep bubbie breakfast time17:34
NobodyCambubbie are the great danes!17:34
lucasagomesNobodyCam, ^ same q17:35
NobodyCam:)17:35
max_lobur:)17:35
NobodyCamlucasagomes: I would yes to the use --image17:36
lucasagomesNobodyCam, cool :D17:36
lucasagomesthanks17:37
NobodyCamwe're getting that from https://review.openstack.org/#/c/51328/13/nova/virt/ironic/ironic_driver_fields.py17:37
*** coolsvap has joined #openstack-ironic17:38
NobodyCamand driver/py lines 359 - 37017:38
devanandalucasagomes: no17:38
lucasagomesNobodyCam, a-ha! right so it's already done, when I tried I added it directly in the ironic driver_info17:39
devanandaNobodyCam: um, why do you say "yes" ?17:39
lucasagomesdevananda, no?17:39
NobodyCamdevananda: no to use --image17:39
devanandaso the Nova driver doesn't know which deploy driver that Ironic node is configured with17:39
devanandaNova should be able to issue a deploy to nodes that use different drivers17:40
NobodyCamdevananda: yes it dose17:40
devanandaNova knows the user image -- it doesnt know the underlying mechanism by which Ironic will deploy that image17:40
NobodyCamline 359 of driver.py17:40
devanandaNobodyCam: ok - it can know it. but then we need to change Nova code for every ironic vendor driver?17:40
NobodyCamI think we should!17:41
devanandahmm17:41
lucasagomesright, cause I noticed one thing17:41
NobodyCam--image is part of the normal nova command17:41
devananda--image ==> the user image. NOT the deploy image17:42
devanandapxe_deploy_kernel ==> the deploy image.17:42
lucasagomesafter I deleted the instance, nova removed all (actually almost all) the pxe_ attributes from my ironic node17:42
devanandai'm goign to side track for a moment17:42
NobodyCamack17:42
lucasagomesright17:43
devanandawhen we add the various utility functionality to ironic that we've been discussing (eg, firmware update, wipe disk, etc)17:43
devanandawe'll really be adding that t othe PXE driver17:43
devanandaand we'll need some persistent "use this ramdisk & kernel for these operations" information17:43
devanandain the node.driver_info['pxe_*'] area17:43
devanandaor in some CONF.pxe.$options arae17:44
*** vkozhukalov has quit IRC17:44
devanandausing a CONF option for that is going to be harder to manage in a heterogeneous, long-running environment --- so sticking the utility ramdisk IDs in node.driver_info['pxe_*'] gives deployers more flexibility and better support for different hardware17:45
devanandaand thus, IMO, is better17:45
devanandaso17:45
devanandathoughts?17:45
* lucasagomes thinking17:45
* NobodyCam thinking17:46
lucasagomesright, because in the moment the deploy ramdisk, kernel id17:46
lucasagomesis inject by nova17:47
lucasagomesand should be part of the nova flavor17:47
NobodyCamdevananda: vers say on the flavor like current deploy info...17:47
NobodyCamflavor could also have extra specs recovery_k&r17:47
lucasagomesso should we ignore the kernel/ramdisk id from flavor? (I mean ignore, but we won't even need to set it)17:47
lucasagomesNobodyCam, one problem about having it in the flavor17:47
lucasagomesis that our17:48
lucasagomesnode-validate would fail17:48
lucasagomescause the informations is not present in the driver_info before booting17:48
NobodyCamlucasagomes: nova could set all of that like it does now with deploy K&r17:48
NobodyCambefore it calll validate for spawn17:49
lucasagomesNobodyCam, it could, but it only does after boot17:49
lucasagomesNobodyCam, you won't be able to let's say17:49
lucasagomesenroll the nodes, and issue a "ironic node-validate <uuid>"17:49
lucasagomescause that would fail17:49
lucasagomes(it will complain about missing parameters in the pxe configuration)17:49
*** ndipanov has quit IRC17:50
*** athomas has quit IRC17:50
*** matty_dubs|lunch is now known as matty_dubs17:50
lucasagomesNobodyCam, s/after boot/after(during) deploy/g17:50
NobodyCamtrue, but the that means for a user to boot they need to have access to ironic interface17:51
NobodyCamand that the whole nova --image support is lost17:52
lucasagomesNobodyCam, well... they need to enroll the node anyway17:52
lucasagomesthat would happen before17:52
NobodyCamno an admn can setup a pool of nodes for users to boot (under current scheme)17:52
NobodyCamand user can just issue nova boot17:52
lucasagomesright17:52
lucasagomeshmmm17:53
*** jistr has quit IRC17:53
NobodyCamwhat (if i under stand) you are saying is that the admin would have to set the image on the node17:53
NobodyCamand users would have no control of that17:53
lucasagomesNobodyCam, yea I forgot the tenants part17:54
lucasagomesbut yea that's basically what i was saying17:54
lucasagomesnot only image, but deploy kernel+ramdisk17:54
lucasagomesas well17:54
lucasagomesbut I can see ur point now17:54
lucasagomesin have a non-admin tenant issuing nova boot17:54
lucasagomesto provision a baremetal machine17:54
NobodyCami think that would break nova (or at least make it so users can not pick there own images17:55
NobodyCam)17:55
devanandaright, so there's another point17:55
devanandathe deploy ramdisk runs outside of the tenant network, ya?17:55
lucasagomesyea indeed it will be a bit controversial in nova's pov17:55
devanandaso the user shouldn't be able to specify what k&r gets used for that17:55
NobodyCamthats why I stuck with getting the image from nova the way i did17:55
devanandasame for rescue, etc17:56
devanandaend user (non-admin) shouldn't be able to influence that. and, granted, in most public clouds, users can't upload their own images17:56
openstackgerritMax Lobur proposed a change to openstack/ironic: Allow concurrent image downloads in pxe logic  https://review.openstack.org/6390417:56
devanandai think it's more a question of, which service is authoritative regarding the deploy,rescue,etc mechanism for node X17:57
devanandais it Nova or Ironic?17:57
NobodyCamby having it on the flavor as it is now. users can pick --flavor and --image that match thier needs17:57
devanandawhich ever service it is needs to know things like machine architecture, what driver to use, etc17:57
NobodyCamI see deploy / rescue / etc as extra specs of the nova side17:57
devanandaNobodyCam: what if user picks a --flavor with x86 deploy ramdisk and --image that is ARM ?17:58
NobodyCamthey get a node stuck in deploying17:58
devanandaheh17:58
NobodyCam:-p17:58
lucasagomeslol17:58
lucasagomestrue17:58
devanandai'll call them utility ramdisks -- whether deploy, rescue, firmware, etc17:59
* NobodyCam need to refill coffe for this 17:59
devanandaso if utility ramdisks are a property of the ironic node.driver_info['pxe*'],17:59
devanandaand users requests an image of some $ARCH17:59
devanandanova-scheduler will always pick a node of the same $ARCH (if one is available) and that node will use the appropriate utility ramdisks, regardless of --flavor18:00
openstackgerritMax Lobur proposed a change to openstack/ironic: Add futures to requirements  https://review.openstack.org/7017718:00
*** jcooley_ has quit IRC18:00
devananda(arguign the other side) we could probably add functionality to Nova to check that flavor and image are the same $ARCH18:00
*** jcooley_ has joined #openstack-ironic18:01
devanandaok - here's another perspective18:01
devanandawhat if the admin wants to get a recovery console on a node that doesn't have a nova instance on it18:02
lucasagomesyea about the dpeloy k&r I think it's fine to have it in the driver_info or flavor18:02
lucasagomesbut the image, the image should come from the nova boot18:02
devanandalucasagomes: the user image -- yes, that must come from the nova boot request18:02
max_loburhttps://review.openstack.org/#/c/70177/1 guys, could you please review/approve Add futures to requirements ?18:02
lucasagomesyea user image18:02
devanandalucasagomes: oh! I thought you were asking abotu the deploy image this whole time18:03
lucasagomesdevananda, no that --image is the user image18:03
devanandalucasagomes: right18:03
lucasagomesdevananda, but it's an interesting point about whether we should have the deploy ramdisk/kernel in the flavor or not18:03
lucasagomesalias image="user image"18:03
*** tatyana has quit IRC18:04
lucasagomesdevananda, yes, I see more benefits in have the deploy ramdisk/kernel in the driver_info directly instead of flavor18:05
lucasagomesbecause in the future we would want to add more capabilities to that ramdisk18:05
lucasagomessuch as hw burning, etc18:05
lucasagomesso it can't be only set when a nova boot is issued18:06
devanandaright - actions which exist outside of Nova's purvue18:06
lucasagomeswe would = we will18:06
lucasagomesexactly18:06
devanandamax_lobur: waiting for jenkins, then will approve18:07
max_loburdevananda, thx!18:07
max_loburI'm going home, will join irc later from there18:07
*** max_lobur is now known as max_lobur_afk18:08
NobodyCamnight max_lobur :)18:08
lucasagomesmax_lobur, safe drive back home18:08
max_lobur_afkthank :)18:08
lucasagomesNobodyCam, if you think about the deploy r&k to be used for more operations apart from deploy (and perhaps we might even want to change this name)18:08
lucasagomesI think it makes sense to live in the driver_info instead of the flavor18:09
lucasagomesand be enrolled by the admin in the moment he's enrolling the node in ironic18:09
NobodyCamture18:09
devanandaguys, if you could take a moment to re-review https://review.openstack.org/#/c/66995/3 that'd be great18:10
devanandait's got a dependent patch already approved, too18:10
lucasagomeswill do18:10
lucasagomesthis one as well: https://review.openstack.org/#/c/69004/18:11
* NobodyCam looking18:11
devanandaNobodyCam: and https://review.openstack.org/#/c/68182/18:11
lucasagomeswithout it the tests are broken in my machine18:11
devanandalucasagomes: really? unit tests?18:12
lucasagomesdevananda, yup18:12
devanandahmm18:12
lucasagomesdevananda, it's has to do with the version of the sqlite18:12
* devananda runs unit tests18:13
lucasagomesthe newer sqlite has new exceptions, so the code in oslo which whould wrap the exceptions and issue a DuplicatedEntry exception can't do that anymore18:13
lucasagomesit raises DbError and the test fails18:13
devanandaahhh18:13
devanandayuck18:14
NobodyCamdevananda: why the _ in line 75 of doc/source/dev/architecture.rst18:14
lucasagomesdevananda, https://review.openstack.org/#/c/6140518:14
lucasagomesoslo patch fixing it18:14
devanandalucasagomes: ah, i see18:15
devanandalucasagomes: fwiw, passes locally w/o that patch18:15
lucasagomesdevananda, it's because ur sqlite is old18:15
lucasagomes[lucasagomes@lucasagomes ironic]$ sudo rpm -q sqlite18:16
lucasagomessqlite-3.8.2-1.fc20.x86_6418:16
devananda3.7.1718:16
devanandaah18:16
lucasagomesafter my upgrade to fedora 20 it started failing18:16
devananda"SQLite has new error messages since 3.7.16.18:16
lucasagomesworks on f19 tho18:16
devanandais what the oslo patch says18:16
devanandaand i'm newer than that :p18:16
devanandak18:16
lucasagomesyea I think that's wrong18:16
lucasagomesbut that patch solves the problems in my localmachine18:16
devanandacool18:17
lucasagomesI tested it18:17
devanandad'oh. needs to be rebased18:17
devanandabreaks _load_one_plugin18:17
lucasagomesdevananda, ah, lemme rebase18:17
lucasagomesurgh will have to rebase the patch it's dependent on as well18:18
devanandai have - want me to push the rebase?18:18
devanandathey both pass locally now18:18
lucasagomesdevananda, if u have it handy there feel free to do18:19
lucasagomesif not I can rebase it here quickly18:19
openstackgerritDevananda van der Veen proposed a change to openstack/ironic: Add lockfile>=0.8 to requirements.txt  https://review.openstack.org/6935818:19
openstackgerritDevananda van der Veen proposed a change to openstack/ironic: Sync db.sqlalchemy code from Oslo  https://review.openstack.org/6900418:19
lucasagomescheers18:19
lucasagomesfyi the errors when I run the unittests on master: http://paste.openstack.org/show/62194/18:20
devanandarebasing one more dep18:21
devanandalucasagomes: cheers, thanks. taht's what i'd expect :)18:22
openstackgerritDevananda van der Veen proposed a change to openstack/ironic: Removes use of timeutils.set_time_override  https://review.openstack.org/6743218:22
NobodyCamlucasagomes: not to sidetrack you, bit did you end having to do major changes to get the nova driver working? or just the execption18:24
NobodyCams/bit/but/18:25
devanandaNobodyCam: https://review.openstack.org/#/c/67877/ also needs another review18:26
*** rloo has quit IRC18:27
devanandaas a reminder to reviewers, http://status.openstack.org/reviews/ gives us some hints about prioritizing our reviewing18:27
*** harlowja_away is now known as harlowja18:28
* NobodyCam *(blushes)*18:28
lucasagomesNobodyCam, I've exceptions and some changes on the destroy()18:34
NobodyCamlucasagomes: got a quick second for: https://review.openstack.org/#/c/6699518:37
lucasagomesNobodyCam, doing it now18:37
lucasagomesbuilding the doc18:37
NobodyCam:-p18:38
lucasagomescooleo +a'd18:40
NobodyCam:)18:40
NobodyCambagel make'n time18:42
lucasagomesmuch better now to have a message routing explanation in the docs18:42
* lucasagomes always got confused when tried to explain it to others18:42
devanandadkehn: reviewing your neutron patch now18:50
devanandadkehn: the code looks good. i'm leaving a bunch of suggestions on the unit tests18:50
devanandadkehn: almost there!18:50
openstackgerritA change was merged to openstack/ironic: Remove deploy kernel and ramdisk global config  https://review.openstack.org/7014018:50
dkehndevananda: thanks18:50
openstackgerritA change was merged to openstack/ironic: Bump version of sphinxcontrib-pecanwsme  https://review.openstack.org/6607818:51
openstackgerritA change was merged to openstack/ironic: Removed unused exceptions  https://review.openstack.org/6885218:53
*** jcooley_ has quit IRC18:56
devanandadkehn: oh, i take taht back -- one suggestion on the class too. but it's small :)18:57
*** jcooley_ has joined #openstack-ironic18:59
NobodyCamdevananda: want to over ride my -1 on https://review.openstack.org/#/c/6052818:59
openstackgerritA change was merged to openstack/ironic: Run mkfs as root  https://review.openstack.org/6818218:59
NobodyCamthe only one I think worth the fix the doc strion issue18:59
NobodyCamstring even18:59
devanandadkehn: posted19:00
devanandalucasagomes: have you seen that ^ client patch?19:00
devanandalucasagomes: looks like you +2'd the dependent patch19:01
NobodyCamya I will too19:01
lucasagomesdevananda, 60528? I think I reviewed that before19:01
lucasagomeslemme re-review19:01
openstackgerritA change was merged to openstack/ironic: Delete the iscsi target  https://review.openstack.org/6787719:03
lucasagomesdevananda, NobodyCam so... I'm always a bit confused with sync patches and i18n problems19:06
lucasagomesbecause it's kinda out of our control19:06
NobodyCamya again the only one i think needs fixing is hte doc string19:07
NobodyCam:-p19:07
lucasagomesyea19:07
NobodyCamdoc the wrong error being raised19:07
lucasagomesyea, that needs to be fixed in oslo first tho19:08
*** hstimer has joined #openstack-ironic19:08
NobodyCamso do we land this as is? and wait / patch oslo to fix it?19:08
devanandaNobodyCam: wrong error? or just not i18n?19:08
lucasagomesdevananda, there's a docstring error19:09
devanandalucasagomes: we don't have to merge things from oslo -- but it's nice if we do19:09
*** hstimer has quit IRC19:09
lucasagomesit says raises the wrong exception19:09
*** marty_ has joined #openstack-ironic19:09
devanandaoh19:09
*** marty_ is now known as Guest1014519:09
NobodyCamsee comment on https://review.openstack.org/#/c/60528/14/ironicclient/openstack/common/apiclient/auth.py19:09
devanandaindeed....19:10
devanandalooks like that is not fixed upsteram yet either19:11
devanandahttps://github.com/openstack/oslo-incubator/blob/master/openstack/common/apiclient/auth.py#L7919:11
lucasagomesyup19:11
lucasagomesapart from that error I'm fine with the rest19:11
NobodyCamya I can live with i18n stuff19:11
devanandai'll file bug and fix it19:13
lucasagomesdevananda, right, so can I go and +2/a it?19:13
openstackgerritA change was merged to openstack/ironic: Minor documentation update  https://review.openstack.org/6699519:14
openstackgerritA change was merged to openstack/ironic: Update method doc strings in pxe.py  https://review.openstack.org/6699619:14
devanandasure19:14
lucasagomesok19:14
NobodyCam:)19:14
*** romcheg has quit IRC19:17
NobodyCamnice to the gate working again :)19:19
*** vkozhukalov has joined #openstack-ironic19:19
devanandaindeed!19:20
devanandadkehn: pls let me know if you have any questions about my feedback on 6607119:20
lucasagomesNobodyCam, r u working on another review for the driver?19:22
lucasagomesI think I will have to make some other changes around the code to make it retry the request if a 409 is returned19:23
devanandaoh, how do you guys want to start splitting up the nova driver patch?19:23
devanandait's already too big to review... and we need unit tests, too19:23
lucasagomesdevananda, +219:23
NobodyCamlucasagomes: I have been holding off waiting to see what you changed19:23
lucasagomesNobodyCam, ouch hmm19:23
NobodyCamI can move to some tests19:24
lucasagomesNobodyCam, I think it would be easier to you to go ahead and submit it19:24
devanandaall 3 of us working on N different patch sets in a sort of "lets play twister" mode is going to be terrible19:24
lucasagomescause I don't think I will finish it today to submit a new patch-set19:24
devanandauntil they land19:24
NobodyCamlol yes19:24
lucasagomesI wanna test it first19:24
lucasagomesyea :( it's hard to have a patch-set with 3 people working on it19:24
devanandayep19:24
devanandaeven 219:25
NobodyCamlucasagomes: do you want to paste me the changes and i'll put them up?19:25
lucasagomesNobodyCam, I can do that, but I'm kinda in the middle of it19:26
NobodyCamahh19:26
lucasagomesMaybe it's better to me to fix the exception and the destroy() first19:26
lucasagomesand then do the retry in another patch-set19:26
* lucasagomes saves a copy of the file and start removing some code19:26
lucasagomesNobodyCam, or u can go ahead ur changes and I can sync/rebase mines on top it19:27
lucasagomesdevananda, do you have any idea in which parts we could start breaking that code?19:27
NobodyCamsure.. I'll start looking tests and volume_driver stuff19:28
devanandabreak on common function boundaaries19:28
devananda?19:28
openstackgerritA change was merged to openstack/python-ironicclient: Sync apiclient and strutils from Oslo  https://review.openstack.org/6052819:28
openstackgerritA change was merged to openstack/python-ironicclient: Reuse Resource from oslo  https://review.openstack.org/6292119:28
lucasagomesbreak on different patches19:28
lucasagomessplit*19:28
devanandai mean, split the code into patches where each patch adds N functions and corresponding unit tests19:29
devanandathat should reduce merge conflicts a bit19:29
devanandaand when al the patches are assembled (the branch HEAD) we have a working driver19:29
lucasagomesI see, yea that works19:30
devanandathe rebasign stuff can be tricky, see https://wiki.openstack.org/wiki/GerritWorkflow#Add_dependency19:31
lucasagomesI was looking at breaking it in some atomic parts like: e.g one patch for the host scheduler part, another for volume19:31
lucasagomesetc19:31
*** rloo has joined #openstack-ironic19:31
devanandaah19:31
devanandaso split by file in this case may not work so well19:31
devanandabut maybe there are some files taht it'll work well for19:32
devanandawe still need to split the driver, though. > 1k lines ....19:32
lucasagomesI see19:32
lucasagomesmaybe it would also be easy to work on github first?19:33
NobodyCamlucasagomes: if you are workinng on driver I will not change it untill your done!19:33
lucasagomeslike submitting pull requests to one of our repos19:33
lucasagomesso one of us will take care of merge the different changes19:34
lucasagomesNobodyCam, devananda ^19:34
NobodyCamwe could split out scheduler in to it's own patch19:34
lucasagomesNobodyCam, ok, I will have a patch-set done for tomorrow (me wants to give it a try first)19:35
devanandarussellb: question about the nova-ironic driver and how we're going to split it up for reviews. got a minute?19:35
NobodyCamlucasagomes: ack19:35
russellbsure19:35
NobodyCamjust to driver.py19:35
NobodyCamlucasagomes: ^^19:35
devanandarussellb: hi! so two aspects to this19:35
lucasagomesNobodyCam, yup, driver.py19:36
devananda1 - multiple people are making changes to the driver as we're testing it, fleshing out some functionality, etc19:36
devananda2 - it's already too big to review sanely19:36
NobodyCamlucasagomes: I'll work else where today :)19:36
lucasagomesNobodyCam, ack :)19:36
devanandarussellb: if we had a complete-and-finished patchset, sure, it could be split into multiple smaller ones, with a little work19:36
devanandarussellb: but maintaining a patch-chain while multiple people refine each patchset is, well, really messy... we've all tried that before, though19:37
russellbdevananda: certainly split out any mods needed outside of the new driver19:37
russellbfor just an isolated driver and its tests ... i dunno, just 1 patch seems fine19:37
*** rloo has quit IRC19:37
devanandarussellb: even if driver is ~2k lines and unit tests are similar?19:37
devanandait's a bit hard to review that much, IMO anyway19:38
russellbit's certainly not ideal19:38
*** rloo has joined #openstack-ironic19:38
russellbhow is it coming along19:38
devanandaif you guys are OK with that, that's fine with me19:38
devanandagood! lucasagomes and crew have it work on real hardware now, apparently19:39
russellbhonestly, i'd be relying pretty hard on you to tell me it's sane19:39
russellb:)19:39
NobodyCamrussellb: first deploy success with nova + ironic this morning :)19:39
russellbnice19:39
devanandarussellb: if you're ok with landing partial stuff and letting us iteratively improve it, we could probably do that now19:40
devanandarussellb: or wait another few weeks while we improve it out-of-trunk. up to you guys19:40
russellbwould rather have it worked out of trunk until you think it's ready for others to start using19:40
devanandaack19:41
russellbyou should be able to work faster that way anyway19:41
devanandathere's already a solid base19:41
devanandanot bug free and probably missing some bits19:41
devanandabut yea, we can work faster out of trunk19:42
devanandarussellb: thanks!19:42
NobodyCamdevananda: russellb: what about splitting nova/scheduler/ironic_host_manager.py it to its own patch?19:43
russellbnp19:43
NobodyCamcan that land with out the (working) driver19:43
russellbNobodyCam: yeah, anything outside of the driver is a good candidate to split out ... though that may make sense to submit with the driver itself19:44
russellbto make it clear how it's used19:44
russellbi don't like merging unused code19:44
russellbwithout something using it right behind it19:44
devanandarussellb: right. so there are several dependent-but-external bits, such as a scheduler filter, a volume driver, etc19:44
NobodyCamrussellb: ack! (i agree)19:44
devanandarussellb: by "submit with" - i assume you mean as a dependent patchset. we can do that easily enough19:45
russellbyes19:45
devanandaNobodyCam: do you want to handle the patch splitting?19:46
NobodyCamI can pull sch stuff now and put up as wip19:47
NobodyCamvol driver I a=really need to take a look at and see what we are really useing there19:47
NobodyCams/a=//19:47
NobodyCamusing even19:48
NobodyCamlol19:48
lucasagomes:)19:49
NobodyCamare there currently no tests for baremetal_host_manager.py??19:51
devananda:(19:52
devanandalucasagomes: another one we should land soon: https://review.openstack.org/#/c/63937/719:52
NobodyCam:-p19:52
lucasagomesdevananda, oh haven't reviewed that yet19:53
lucasagomesgoing to add here on my todo list19:53
NobodyCamquick afk then I'll stat in on ironic scheduler patch and tests19:54
devanandamax_lobur_afk: 69135 is looking much better than the first shot at this, but i'm going to need more time to dig into it19:57
lucasagomesright guys I'm done for today19:59
lucasagomesNobodyCam, devananda g'night19:59
dkehndevananda: looking over the review, are we sure about cacheing the neutron client, see https://review.openstack.org/#/c/66071/8/ironic/common/neutron.py , where it was taken out20:03
NobodyCamnight lucasagomes20:03
dkehndevananda: line 9220:03
*** aignatov is now known as aignatov_20:04
devanandadkehn: that was only for admin=True, and used local.strongstore20:05
devanandadkehn: what i'm suggesting is that the PXE driver may instantiate a NeutronAPI object and re-use that object20:06
dkehndevananda: totally understand, it makes sense to me20:06
devananda:)20:06
devanandawhat's the cost, in network round=trips, of calling get_client()?20:07
dkehndevananda: once the tokens and what not there, about the same as anything else, pretty much doing an db updates20:08
dkehndevananda: or insert20:08
devanandaerm... you maen, "not doing any .." ?20:08
*** mdurnosvistov has quit IRC20:08
dkehnerm um correct20:08
devanandadkehn: does clientv20.Client() make any network calls? or just instantiate an object locally?20:09
*** vkozhukalov has quit IRC20:10
NobodyCamwoo hoo https://review.openstack.org/#/c/66461/ merged20:10
*** aignatov_ is now known as aignatov20:10
devanandaNobodyCam: yep! :)20:10
devanandaNobodyCam: time to update our wiki instructions too, hehe20:10
dkehndevananda: well with keystone to get propoer info is the only cost, the get_client, once it has token does not talk to neutron only the update does20:10
NobodyCamya :)20:10
devanandaok, so if there's no auth_token in the context, then 2 network calls20:11
*** mdurnosvistov has joined #openstack-ironic20:11
devanandakeystone.get_service_url('neutron') and then getting the token20:11
dkehnpretty much20:12
devananda*1 or 2, depending on config20:12
devanandacool20:12
dkehndevananda: I'm fine with the change, actually I like it better, that was my point20:12
devanandaso it makes sense to cache that object it we don't already have a token -- otherwise it'll get re-generated _every_ time20:12
devanandadkehn: oh! cool :)20:12
dkehndidn't like taking it out in the first place20:12
devanandayea, though i think this way is better than using local.strongstore. but i can see why nova did the other way20:14
*** lucasagomes has quit IRC20:14
devanandadkehn: just caght myself -- s/assertCalledOnceWith/assert_called_once_with/ in all my comments please20:22
devanandadkehn: http://www.voidspace.org.uk/python/mock/mock.html#mock.Mock.assert_called_once_with20:22
dkehndevananda: will look at it, torn away on something else20:23
devanandak20:23
dkehnat the moment20:23
devanandaNobodyCam: another one for your queue :) https://review.openstack.org/#/c/66990/20:26
* NobodyCam looks20:27
*** jcooley_ has quit IRC20:31
*** jcooley_ has joined #openstack-ironic20:32
NobodyCamdevananda: it and dep +a'd (with out pulling down and testing)20:34
NobodyCamdid we mode ssh execute out of ironic in to process utils some time ago?20:35
NobodyCamjust a lol point20:35
*** max_lobur has joined #openstack-ironic20:38
NobodyCamahh I was thinking of this one:https://review.openstack.org/#/c/61709/20:46
*** aignatov is now known as aignatov_20:58
devanandaNobodyCam: processutils is in oslo now21:04
NobodyCamya21:04
NobodyCamthe _ssh_execute (https://review.openstack.org/#/c/66990/6/ironic/drivers/modules/ssh.py) made me think od the trycmd we moved out21:06
NobodyCamhttps://review.openstack.org/#/c/61709/4/ironic/common/utils.py21:07
NobodyCamjust lol on my part21:08
*** coolsvap is now known as coolsvap_away21:10
openstackgerritA change was merged to openstack/ironic: mock's return value for processutils.ssh_execute  https://review.openstack.org/6947921:11
*** mdurnosvistov has quit IRC21:18
openstackgerritA change was merged to openstack/ironic: SSHPower driver raises IronicExceptions  https://review.openstack.org/6699021:19
openstackgerritJarrod Johnson proposed a change to stackforge/pyghmi: Detect broken sessions  https://review.openstack.org/7021921:24
*** epim has joined #openstack-ironic21:26
NobodyCambrb21:31
*** jcooley_ has quit IRC21:32
*** jcooley_ has joined #openstack-ironic21:32
openstackgerritA change was merged to stackforge/pyghmi: Detect broken sessions  https://review.openstack.org/7021921:34
devanandalifeless: in your experience with APIs, should a multi-part PATCH request be accepted if the net result is valid, even if one or more individual parts are invalid?21:58
*** jcooley_ has quit IRC21:58
devanandalifeless: eg, if the PATCH contains 3 operations, and by itself, op 2 would be rejected, but when applied 1-2-3, the net is still allowed -- should they be rejected or accepted?21:59
*** mdurnosvistov has joined #openstack-ironic22:03
*** jdob has quit IRC22:04
NobodyCamgah quick walkies brb22:04
max_loburdevananda: I guess you're about breaking resource locks22:10
devanandamax_lobur: yes22:10
devanandai'm reading http://tools.ietf.org/html/draft-ietf-appsawg-json-patch-1022:10
devanandaugh...22:10
devanandareading IETF drafts before lunch ....22:10
devanandaer, bad paste. this one: http://tools.ietf.org/html/rfc690222:11
max_loburI'll take a look now22:12
devanandamax_lobur: look at top of page 322:12
max_loburin general I can't imagine if someone will replace the lock with something, and then replace back22:12
devanandaEvaluation continues until all operations are successfully applied or until an error condition is encountered.22:12
max_loburin the same patch22:12
max_loburI see22:13
*** mrda_away is now known as mrda22:16
*** epim has quit IRC22:17
mrdamorning all22:17
devanandamax_lobur: comment posted to review22:18
devanandamornin, mrda22:18
devanandaNobodyCam: another one for your queue! https://review.openstack.org/#/c/55549/22:18
devanandaNobodyCam: if you are happy with it, I'm ok reversign my -1 and landing it, then tossing up the doc string quickly -- jus tso we can land this22:19
* mrda is reading the long scrollback22:19
* NobodyCam looks22:19
max_loburdevananda: ack22:19
NobodyCammorning mrda22:20
NobodyCamdevananda: reading your's and max_loburs comments on that patch22:31
NobodyCamskimming rfc to :-p22:32
max_loburI also found this22:34
max_loburIf a normative requirement is violated by a JSON Patch document, or22:34
max_lobur   if an operation is not successful, evaluation of the JSON Patch22:34
max_lobur   document SHOULD terminate and application of the entire patch22:34
max_lobur   document SHALL NOT be deemed successful.22:34
max_loburhttp://tools.ietf.org/html/rfc6902#section-522:34
devanandamax_lobur: yes - a "normative rquiremetn"22:35
devanandagah, cant type22:35
devanandamax_lobur: AIUI, normative requirement in this context means that the JSON PATCH document adheres to the syntax in that RFC22:36
devanandamax_lobur: not that our server knows what to dow ith the ontents22:36
devanandamax_lobur: "or if an operation is not successful"22:37
devanandain this case, we have multi-operation PATCH document22:38
devanandabut today, we are not evaluating each operation individually at all22:38
devanandaand we really can't22:38
max_loburdevananda: yea I was going to say that22:38
max_loburif we will evaluate each one individually22:38
max_loburthe quote above will mean that we should reject the whole patch if at least one is invalid22:39
devanandawe are applying all the operations to the node's JSON representation, then passing the new node object to the conductor to apply the changes22:39
max_loburbut since we applying a net weight22:39
devanandaif we tried to apply each op individually, we couldn't (today, at least) roll back the changes22:39
max_loburyea, I understand22:40
devanandaand things would be really slow if we tried to22:40
max_loburyes22:40
NobodyCamdevananda: would this be a valid example.. {power_off, remove instance_uuid} where insance uuid can be removed unless the node is first powered off22:40
devanandaeg, get a PATCH with 10 {op: add, path: /driver_info/xxxx, ....} requests22:40
devanandaNobodyCam: there's a separate API for power control22:41
devanandaNobodyCam: and power is controlled with PUT, not PATCH, IIRC22:41
* NobodyCam notes poor examle22:41
devanandaeg, [{op: replace, path: driver_name}, {op: add, path: driver_info/foo}]22:42
devanandawe're not calling validate just to PATCH the data, so that should work even if evaluated individually22:43
devanandaNobodyCam: if power was controlled via PATCH, then yes, your example would make sense :)22:44
devanandaok, i really need to step away and make lunch ....22:45
devanandabbiah22:45
NobodyCamenjoy22:46
NobodyCam:)22:46
openstackgerritDevananda van der Veen proposed a change to openstack/ironic: API validates driver name for both POST and PATCH  https://review.openstack.org/6801822:48
NobodyCammax_lobur: do you have a example for #1 (&@) on your last comment on https://review.openstack.org/#/c/55549/20/ironic/api/controllers/v1/node.py22:48
NobodyCams/\@/\&/22:48
NobodyCamgah22:49
NobodyCams/\@/2/22:49
NobodyCamthis is throwing me "2nd and 4th are not supported by our service"22:49
max_loburdo you mean do I have an example of what we don't support?22:51
max_loburfor example patch with 2 ops22:53
max_lobur1st is22:53
max_lobur{'op': 'replace', 'path': '/reservation', 'value': 'test'}22:53
NobodyCaman example of what would fail thrn be fixed by th e next op22:53
max_lobur2nd is22:53
max_lobur{'op': 'remove', 'path': '/reservation'}22:54
max_lobur1st is not allowed22:54
max_loburbut if we apply 1-222:54
max_loburit won't be noticable22:54
max_loburand net result will be acceptable by Ironic22:55
max_loburFrom my point of view it doesn't have its use in the service, it just may confuse the users22:56
max_loburalso I don't think someone will try my example =) it does'n makes sense =)22:57
max_lobur1. If the patch has some restricted action we should reject it22:58
max_lobur2. If net weight of the patch is acceptable we should not - I agree22:58
max_loburbut if 1 and 2 together - this means the patch has two opposite actions22:59
max_loburor 2 mutually exclusive actions22:59
*** thedodd has joined #openstack-ironic22:59
max_loburthat may be replaced with one22:59
max_loburtherefore I don't think such patch makes sense. It's unlikely that someone will do so23:00
max_loburbut to support this behaviour we need either have a very complex patch-analyzing tool and clear code23:01
max_loburor have a comlex code :)23:01
NobodyCamI can see the point23:02
max_loburif we decide to not support it - we will have simple jsonpatch-analyzing tool + simple code :)23:02
*** max_lobur has quit IRC23:07
*** max_lobur has joined #openstack-ironic23:08
NobodyCami see this in section 5: http://paste.openstack.org/show/XYrGtumWBLfv85XkfGRL/23:10
*** max_lobur has quit IRC23:10
*** max_lobur has joined #openstack-ironic23:10
max_lobur{power_off, remove instance_uuid} the second op of this patch is not acceptable without 1st23:10
*** mdurnosvistov has quit IRC23:10
NobodyCamya23:10
NobodyCamI tend to want to reject just based off we wont know what really failed and are dumping the (possiable) clean up on the admin23:12
NobodyCambut I'm thinking23:13
*** max_lobur has quit IRC23:16
*** matty_dubs is now known as matty_dubs|gone23:18
NobodyCamdevananda: when you get back, how would this impact our ablity to "plan" for a conductor outage.. ie. as a admin i want to take a conductor down to add some ram, buy I can update any reseravations untill i take the node down?23:22
NobodyCams/buy/but/23:22
NobodyCamgah bad typing s/can/cann't/23:23
*** max_lobur_cell has joined #openstack-ironic23:23
max_lobur_cellsorry. I have some connection problems :-\23:24
NobodyCamhehe23:24
NobodyCammax you see my question?23:24
NobodyCamis something like that one of our concerns?23:24
NobodyCamour your :-p23:25
max_lobur_celljust wanted to say that having that json util wont stop us from analyzing the resulting operation. and most of the time it will be enough to check for particular operations23:25
max_lobur_cellsorry, I can't get the question:-)23:27
NobodyCamhow would this impact our ablity to "plan" for a conductor outage.. ie. as a admin i wanted to take a conductor down to add some ram, but I cann't update any reseravations untill i take the node down?23:28
max_lobur_cellhmm23:30
devanandaNobodyCam: reservation == taskManager lock23:30
max_lobur_cellwell in this case we'll need analyze the resulting node23:30
devanandaNobodyCam: so, a) we need to implement a gentle shutdown for ConductorManager23:30
devanandaNobodyCam: and b) we should implement a way for a ConductorManager to stop sending its hearbeat23:32
devanandawhen CM drops out of hte hash ring, all nodes will be redistributed away from it23:32
devanandabut any in-progrses operations will continue until they are finished23:32
devanandathat is the period when an admin could use this API to "break" a lock -- but they shouldn't. because CM is still working23:33
devanandaonly in the case wher CM has crashed and left a dangling lock open, then this API is needed23:33
devanandaNobodyCam: that make sense?23:34
NobodyCamyes...23:35
openstackgerritdekehn proposed a change to openstack/ironic: Adds Neutron support to Ironic  https://review.openstack.org/6607123:36
devanandawoot - our tempest API tests found a real bug in my code!23:37
NobodyCamnice :)23:37
devanandahttp://logs.openstack.org/18/68018/4/check/check-tempest-dsvm-ironic/094a973/console.html#_2014-01-30_23_23_02_34523:37
NobodyCamnice23:38
max_lobur_cell:)23:39
max_lobur_cellok guys, have a nice day :) seems my internet provider trying to say that it's time for rest:)23:41
NobodyCamhehehe ok max_lobur_cell have a good night23:42
*** max_lobur_cell has quit IRC23:44

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!