Wednesday, 2018-08-08

openstackgerritMerged openstack/python-saharaclient stable/pike: Avoid tox_install.sh for constraints support  https://review.openstack.org/58939501:08
openstackgerritMerged openstack/python-saharaclient stable/pike: Remove -U from pip install  https://review.openstack.org/58939601:43
*** dave-mccowan has quit IRC02:57
*** links has joined #openstack-sahara03:56
*** galaxyblr has joined #openstack-sahara04:43
*** hoonetorg has quit IRC05:31
*** Bhujay has joined #openstack-sahara05:35
*** hoonetorg has joined #openstack-sahara05:52
*** hoonetorg has quit IRC06:06
*** pcaruana has joined #openstack-sahara06:27
*** tosky has joined #openstack-sahara07:29
*** rcernin has quit IRC07:35
*** chason has quit IRC07:49
openstackgerritOpenStack Release Bot proposed openstack/python-saharaclient stable/rocky: Update .gitreview for stable/rocky  https://review.openstack.org/58979809:35
openstackgerritOpenStack Release Bot proposed openstack/python-saharaclient stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky  https://review.openstack.org/58979909:36
openstackgerritOpenStack Release Bot proposed openstack/python-saharaclient master: Update reno for stable/rocky  https://review.openstack.org/58980009:36
*** dave-mccowan has joined #openstack-sahara10:59
*** chason has joined #openstack-sahara11:52
tellesnobregatosky, apparently the virt-get-kernel command works11:58
openstackgerritMerged openstack/python-saharaclient stable/rocky: Update .gitreview for stable/rocky  https://review.openstack.org/58979811:59
openstackgerritMerged openstack/python-saharaclient master: Update reno for stable/rocky  https://review.openstack.org/58980011:59
toskynot too surprised12:05
tellesnobregaI'm creating baremetal images using SIE, to check if they "look" similar12:08
tellesnobregathe outputs from virt-get-kernel is:12:44
tellesnobregavmlinuz-3.10.0-693.21.1.el7.x86_6412:44
tellesnobregainitramfs-3.10.0-693.21.1.el7.x86_64.img12:45
tellesnobregathe images are raw format12:46
tellesnobreganot sure this is the correct ouptut we need12:46
toskythe format should not matter, as you can easily convert from one to another with qemu-img12:48
toskyglance supports both, but it depends on the backend; iirc ceph can only use raw images12:49
toskythe important question is about the content, not the format of the image12:49
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Allow tags to be used for MQ tasks  https://review.openstack.org/58948912:49
tellesnobregatosky, cool12:54
tellesnobregaI don't have means to test this image on baremetal12:54
tellesnobregabut I strongly believe this should work just fine12:54
tellesnobregathe command is very simple12:55
tellesnobregadocumentation on this will be very simple12:55
tellesnobregaI can write a patch on it now12:55
toskyack12:55
tellesnobregajust need to figure out the dhcp part12:56
toskyso apart from the naming, the contents generated by sahara-image-create -b and the combination of sahara-image-pack + virt-get-kernel are equivalent?12:56
toskyyeah, and dhcp12:56
tellesnobregaI still need to check the equivalence12:56
tellesnobregaimage with sie is failing to build12:56
toskywut12:57
tellesnobregatrying again12:58
Bhujaytellesnobrega , tosky , the code worked today to force activate the cluster to overcome the ambari issue i was discussing13:43
tellesnobregaBhujay, awesome13:43
Bhujaythe logic is assuming from ambari console manually we are  correcting the issues by restarting the services and then ...13:44
Bhujaycomplete the steps for hadoop jar install , hive ready etc. Then it  triggers a health check and if found green changes the cluster status to active .13:45
Bhujaytellesnobrega , we were waiting for your feedback , should I submit it as a patch ?13:47
tellesnobregaBhujay, I don't fully remember what issue you were having, can you give a quick summary of the issue?13:50
Bhujaytellesnobrega , sure . When the number of nodes are large , ambari often fails to  complete the installation with a OK status .. sends this msg back to sahara and sahara cluster state becomes Error13:52
Bhujayhowever , from ambari console it takes only few minutes to correct those errors mostly by restarting the services13:53
Bhujaybut sahara cluster remains at error state hence scaling , verification or edp job nothing can be done .13:54
BhujayAlthough it is a ambari problem , this issue complete defeats the purpose of sahara - hdp  deployment and hence this workaround13:56
tellesnobregaI see13:57
tellesnobregayou can send a patch for that, for sure13:57
tellesnobregaBhujay, thanks for working on it13:59
Bhujayok thanks , the code at the server side is working ...of course it need  fine tuning from you all .. I will submit this  for review and start working on the client/horizon side if it is within my capabilities13:59
openstackgerritLuigi Toscano proposed openstack/sahara-tests master: Add basic S3 tests (job binaries and data sources)  https://review.openstack.org/58178113:59
tellesnobregaBhujay, sounds good14:02
Bhujaytellesnobrega , from rocky onwards  there will be delinking of openstack version and sahara plugin right ?14:02
toskynot rocky unfortunately, it was a bit more complex14:02
tellesnobregaBhujay, from stein14:02
toskywe are targeting Stein right now14:02
Bhujayok14:02
BhujayHDP supports HDP (Apache Hawq) , when can we see it from sahara as a node process any idea ?14:03
Bhujay** HDB(HAWQ )14:04
tellesnobregathat depends on how complex it is to install it, if it is simple enough we can add next cycle14:04
tellesnobregait would be interesting if you create a storyboard request for it14:05
tellesnobregaso we can evaluate properly14:05
tellesnobregaand discuss at ptg on that matter14:05
tellesnobregawe are looking for new services all the time14:05
tellesnobregaand when costumers have a suggestion it is always appreciated14:05
Bhujaytellesnobrega , sure , in my view it is very important for enterprises who are seeking alternate for AWS redshift14:05
Bhujaytoday there is nothing  from sahara to fill up the gap of a MPP ( Massively Parallel Processing ) Database , and HDB is the solution14:06
tellesnobregaI see14:07
tellesnobregathis is deployed along side HDP correct? or is it a database on its own?14:07
BhujayWe are creating a set up manually , Will have some learning and will look forward to integrate with sahara14:07
Bhujaytellenobrega , yes it is very much part of HDP , named as HDB14:08
toskyif it's supported by Ambari, it should be a matter of adding the definition of the service and the constraints for validation, if needed14:08
tellesnobregayes14:08
Bhujaytosky , i checked it is supported even in ambari 2.414:08
tellesnobregacool, I was worried that it was a DB on its own, which may come in a complicated conflict with trove14:09
Bhujayno it is part not , it just gives a ANSI SQL world on top of hadoop echo system , a joint effort from hortonworks and pivotal . it is a good case for sahara integration14:12
*** Bhujay has quit IRC14:18
openstackgerritLuigi Toscano proposed openstack/sahara master: Adapt to Keystone changes: use member instead of Member  https://review.openstack.org/57608114:21
*** galaxyblr has quit IRC14:23
*** chason has quit IRC15:06
*** chason has joined #openstack-sahara15:07
*** chason has quit IRC15:07
*** chason has joined #openstack-sahara15:08
*** links has quit IRC15:10
openstackgerritMerged openstack/sahara master: Enable also ambari by default in devstack  https://review.openstack.org/58918215:11
*** pcaruana has quit IRC15:34
*** pcaruana has joined #openstack-sahara21:07
*** pcaruana has quit IRC22:02
*** rcernin has joined #openstack-sahara22:19
openstackgerritLuigi Toscano proposed openstack/sahara-tests master: DNM Experimental scenario job based on RadosGW (not Swift)  https://review.openstack.org/57692922:24
openstackgerritLuigi Toscano proposed openstack/sahara-tests master: DNM very rough test for the S3 integration  https://review.openstack.org/59005522:24
*** NikitaKonovalov has quit IRC23:02
*** rickflare has quit IRC23:02
*** tosky has quit IRC23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!