openstackgerrit | Merged openstack/python-saharaclient stable/pike: Avoid tox_install.sh for constraints support https://review.openstack.org/589395 | 01:08 |
---|---|---|
openstackgerrit | Merged openstack/python-saharaclient stable/pike: Remove -U from pip install https://review.openstack.org/589396 | 01:43 |
*** dave-mccowan has quit IRC | 02:57 | |
*** links has joined #openstack-sahara | 03:56 | |
*** galaxyblr has joined #openstack-sahara | 04:43 | |
*** hoonetorg has quit IRC | 05:31 | |
*** Bhujay has joined #openstack-sahara | 05:35 | |
*** hoonetorg has joined #openstack-sahara | 05:52 | |
*** hoonetorg has quit IRC | 06:06 | |
*** pcaruana has joined #openstack-sahara | 06:27 | |
*** tosky has joined #openstack-sahara | 07:29 | |
*** rcernin has quit IRC | 07:35 | |
*** chason has quit IRC | 07:49 | |
openstackgerrit | OpenStack Release Bot proposed openstack/python-saharaclient stable/rocky: Update .gitreview for stable/rocky https://review.openstack.org/589798 | 09:35 |
openstackgerrit | OpenStack Release Bot proposed openstack/python-saharaclient stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky https://review.openstack.org/589799 | 09:36 |
openstackgerrit | OpenStack Release Bot proposed openstack/python-saharaclient master: Update reno for stable/rocky https://review.openstack.org/589800 | 09:36 |
*** dave-mccowan has joined #openstack-sahara | 10:59 | |
*** chason has joined #openstack-sahara | 11:52 | |
tellesnobrega | tosky, apparently the virt-get-kernel command works | 11:58 |
openstackgerrit | Merged openstack/python-saharaclient stable/rocky: Update .gitreview for stable/rocky https://review.openstack.org/589798 | 11:59 |
openstackgerrit | Merged openstack/python-saharaclient master: Update reno for stable/rocky https://review.openstack.org/589800 | 11:59 |
tosky | not too surprised | 12:05 |
tellesnobrega | I'm creating baremetal images using SIE, to check if they "look" similar | 12:08 |
tellesnobrega | the outputs from virt-get-kernel is: | 12:44 |
tellesnobrega | vmlinuz-3.10.0-693.21.1.el7.x86_64 | 12:44 |
tellesnobrega | initramfs-3.10.0-693.21.1.el7.x86_64.img | 12:45 |
tellesnobrega | the images are raw format | 12:46 |
tellesnobrega | not sure this is the correct ouptut we need | 12:46 |
tosky | the format should not matter, as you can easily convert from one to another with qemu-img | 12:48 |
tosky | glance supports both, but it depends on the backend; iirc ceph can only use raw images | 12:49 |
tosky | the important question is about the content, not the format of the image | 12:49 |
openstackgerrit | Merged openstack/openstack-ansible-os_sahara master: Allow tags to be used for MQ tasks https://review.openstack.org/589489 | 12:49 |
tellesnobrega | tosky, cool | 12:54 |
tellesnobrega | I don't have means to test this image on baremetal | 12:54 |
tellesnobrega | but I strongly believe this should work just fine | 12:54 |
tellesnobrega | the command is very simple | 12:55 |
tellesnobrega | documentation on this will be very simple | 12:55 |
tellesnobrega | I can write a patch on it now | 12:55 |
tosky | ack | 12:55 |
tellesnobrega | just need to figure out the dhcp part | 12:56 |
tosky | so apart from the naming, the contents generated by sahara-image-create -b and the combination of sahara-image-pack + virt-get-kernel are equivalent? | 12:56 |
tosky | yeah, and dhcp | 12:56 |
tellesnobrega | I still need to check the equivalence | 12:56 |
tellesnobrega | image with sie is failing to build | 12:56 |
tosky | wut | 12:57 |
tellesnobrega | trying again | 12:58 |
Bhujay | tellesnobrega , tosky , the code worked today to force activate the cluster to overcome the ambari issue i was discussing | 13:43 |
tellesnobrega | Bhujay, awesome | 13:43 |
Bhujay | the logic is assuming from ambari console manually we are correcting the issues by restarting the services and then ... | 13:44 |
Bhujay | complete the steps for hadoop jar install , hive ready etc. Then it triggers a health check and if found green changes the cluster status to active . | 13:45 |
Bhujay | tellesnobrega , we were waiting for your feedback , should I submit it as a patch ? | 13:47 |
tellesnobrega | Bhujay, I don't fully remember what issue you were having, can you give a quick summary of the issue? | 13:50 |
Bhujay | tellesnobrega , sure . When the number of nodes are large , ambari often fails to complete the installation with a OK status .. sends this msg back to sahara and sahara cluster state becomes Error | 13:52 |
Bhujay | however , from ambari console it takes only few minutes to correct those errors mostly by restarting the services | 13:53 |
Bhujay | but sahara cluster remains at error state hence scaling , verification or edp job nothing can be done . | 13:54 |
Bhujay | Although it is a ambari problem , this issue complete defeats the purpose of sahara - hdp deployment and hence this workaround | 13:56 |
tellesnobrega | I see | 13:57 |
tellesnobrega | you can send a patch for that, for sure | 13:57 |
tellesnobrega | Bhujay, thanks for working on it | 13:59 |
Bhujay | ok thanks , the code at the server side is working ...of course it need fine tuning from you all .. I will submit this for review and start working on the client/horizon side if it is within my capabilities | 13:59 |
openstackgerrit | Luigi Toscano proposed openstack/sahara-tests master: Add basic S3 tests (job binaries and data sources) https://review.openstack.org/581781 | 13:59 |
tellesnobrega | Bhujay, sounds good | 14:02 |
Bhujay | tellesnobrega , from rocky onwards there will be delinking of openstack version and sahara plugin right ? | 14:02 |
tosky | not rocky unfortunately, it was a bit more complex | 14:02 |
tellesnobrega | Bhujay, from stein | 14:02 |
tosky | we are targeting Stein right now | 14:02 |
Bhujay | ok | 14:02 |
Bhujay | HDP supports HDP (Apache Hawq) , when can we see it from sahara as a node process any idea ? | 14:03 |
Bhujay | ** HDB(HAWQ ) | 14:04 |
tellesnobrega | that depends on how complex it is to install it, if it is simple enough we can add next cycle | 14:04 |
tellesnobrega | it would be interesting if you create a storyboard request for it | 14:05 |
tellesnobrega | so we can evaluate properly | 14:05 |
tellesnobrega | and discuss at ptg on that matter | 14:05 |
tellesnobrega | we are looking for new services all the time | 14:05 |
tellesnobrega | and when costumers have a suggestion it is always appreciated | 14:05 |
Bhujay | tellesnobrega , sure , in my view it is very important for enterprises who are seeking alternate for AWS redshift | 14:05 |
Bhujay | today there is nothing from sahara to fill up the gap of a MPP ( Massively Parallel Processing ) Database , and HDB is the solution | 14:06 |
tellesnobrega | I see | 14:07 |
tellesnobrega | this is deployed along side HDP correct? or is it a database on its own? | 14:07 |
Bhujay | We are creating a set up manually , Will have some learning and will look forward to integrate with sahara | 14:07 |
Bhujay | tellenobrega , yes it is very much part of HDP , named as HDB | 14:08 |
tosky | if it's supported by Ambari, it should be a matter of adding the definition of the service and the constraints for validation, if needed | 14:08 |
tellesnobrega | yes | 14:08 |
Bhujay | tosky , i checked it is supported even in ambari 2.4 | 14:08 |
tellesnobrega | cool, I was worried that it was a DB on its own, which may come in a complicated conflict with trove | 14:09 |
Bhujay | no it is part not , it just gives a ANSI SQL world on top of hadoop echo system , a joint effort from hortonworks and pivotal . it is a good case for sahara integration | 14:12 |
*** Bhujay has quit IRC | 14:18 | |
openstackgerrit | Luigi Toscano proposed openstack/sahara master: Adapt to Keystone changes: use member instead of Member https://review.openstack.org/576081 | 14:21 |
*** galaxyblr has quit IRC | 14:23 | |
*** chason has quit IRC | 15:06 | |
*** chason has joined #openstack-sahara | 15:07 | |
*** chason has quit IRC | 15:07 | |
*** chason has joined #openstack-sahara | 15:08 | |
*** links has quit IRC | 15:10 | |
openstackgerrit | Merged openstack/sahara master: Enable also ambari by default in devstack https://review.openstack.org/589182 | 15:11 |
*** pcaruana has quit IRC | 15:34 | |
*** pcaruana has joined #openstack-sahara | 21:07 | |
*** pcaruana has quit IRC | 22:02 | |
*** rcernin has joined #openstack-sahara | 22:19 | |
openstackgerrit | Luigi Toscano proposed openstack/sahara-tests master: DNM Experimental scenario job based on RadosGW (not Swift) https://review.openstack.org/576929 | 22:24 |
openstackgerrit | Luigi Toscano proposed openstack/sahara-tests master: DNM very rough test for the S3 integration https://review.openstack.org/590055 | 22:24 |
*** NikitaKonovalov has quit IRC | 23:02 | |
*** rickflare has quit IRC | 23:02 | |
*** tosky has quit IRC | 23:49 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!