Wednesday, 2014-07-02

*** IlyaE has quit IRC00:09
btullythe errors i get relate to 2 fields00:12
btullyclass_definition.name and package.fully_qualified_name were both set to 512 chars and index=True00:12
btullywhich results in mysql giving an error and stops the migration00:12
btullyOperationalError: (OperationalError) (1071, 'Specified key was too long; max key length is 767 bytes') 'CREATE INDEX ix_class_definition_name ON class_definition (name)00:13
btullyOperationalError: (OperationalError) (1071, 'Specified key was too long; max key length is 767 bytes') 'CREATE INDEX ix_package_fully_qualified_name ON package (fully_qualified_name)'00:13
btullyany advice would be appreciated00:13
btullyi could go into 001_initial_version.py and set those fields to index=False00:14
btullybut not sure if that will break things down the road00:14
btullyis there some required my.cnf setting that would allow this to work?00:15
*** ankurrr has quit IRC00:16
openstackgerritGeorgy Okrokvertskhov proposed a change to stackforge/murano-dashboard: Fix topology page issue with dependencies  https://review.openstack.org/10403000:22
*** gokrokve has quit IRC00:24
*** TravT|2 has quit IRC00:57
*** gokrokve has joined #murano01:49
*** killer_prince is now known as lazy_prince02:59
*** lazy_prince is now known as killer_prince03:00
*** TravT has joined #murano03:45
*** TravT has quit IRC04:03
openstackgerritGeorgy Okrokvertskhov proposed a change to stackforge/murano-dashboard: Add app images to topology page  https://review.openstack.org/10406404:16
*** drupalmonkey has quit IRC04:24
*** lazy_prince has joined #murano04:25
*** IlyaE has joined #murano04:42
*** lazy_prince has quit IRC04:46
*** killer_prince is now known as lazy_prince04:47
*** chandan_kumar has joined #murano05:38
*** IlyaE has quit IRC06:03
*** gokrokve has quit IRC06:29
stan_lagunbtully, I've seen that before. The solution is to use ASCII collation (instead of UTF)06:44
*** gokrokve has joined #murano07:00
*** gokrokve_ has joined #murano07:02
*** gokrokv__ has joined #murano07:04
*** gokrokve has quit IRC07:04
*** gokrokve_ has quit IRC07:07
*** gokrokv__ has quit IRC07:08
openstackgerritDmitry Teselkin proposed a change to stackforge/murano: Sync Global Requirements (Juno)  https://review.openstack.org/10410508:01
*** gokrokve has joined #murano08:04
*** gokrokve has quit IRC08:09
*** slagun has joined #murano08:14
*** stan_lagun has quit IRC08:17
*** gokrokve has joined #murano08:30
*** gokrokve has quit IRC08:34
*** gokrokve has joined #murano09:02
*** gokrokve has quit IRC09:03
*** gokrokve has joined #murano09:04
*** gokrokve has quit IRC09:09
openstackgerritEkaterina Chernova proposed a change to stackforge/python-muranoclient: Add package-create command  https://review.openstack.org/9917709:18
openstackgerritEkaterina Chernova proposed a change to stackforge/python-muranoclient: Update package-import command  https://review.openstack.org/10216209:18
katyafervent__Please https://review.openstack.org/#/c/101578/09:18
*** gokrokve has joined #murano10:02
*** gokrokve has quit IRC10:07
openstackgerritEkaterina Chernova proposed a change to stackforge/python-muranoclient: Add package-create command  https://review.openstack.org/9917710:32
openstackgerritEkaterina Chernova proposed a change to stackforge/python-muranoclient: Update package-import command  https://review.openstack.org/10216210:32
*** gokrokve has joined #murano11:02
*** gokrokve has quit IRC11:08
*** gokrokve has joined #murano12:02
*** gokrokve has quit IRC12:07
*** gokrokve has joined #murano13:02
*** chandan_kumar is now known as chandankumar13:03
*** gokrokve has quit IRC13:07
btully@slagun - i'll give the ASCII collation a try. However the migration file/schema explicitly sets it to utf8. Does this mean it's a bug and that the 001_initial_version.py file should be updated to change MYSQL_CHARSET = 'utf8' to MYSQL_CHARSET = 'ascii' ?13:21
slaguncollation of that column, not entire table13:22
slagunFQN is ASCII13:22
btullyFQN?13:23
slagunfully_qualified_name13:24
btullyi don't see ascii specified anywhere in 001_intial_version.py13:25
btullyand it looks like the sqlalchemy commands for MYSQL_CHARSET are applied at the table level, not the column level13:26
slagunit is a bug. There was similar problem when it was sqlalchemy-migrate. If you see older revision in git there was similar migration 004 with String(512) and there was the same problem that was fixed by collation='ascii_general_ci'13:27
slagunNot sure about alembic, but MySQL and sqlalchemy-migrate support this on column level13:28
btullyi see. ok. thanks! so is there  is this line:13:29
btully        sa.Column('fully_qualified_name', sa.String(length=512),13:29
btully                  nullable=False, index=False),13:29
btullywell i changed index to false13:29
slagunindex is required13:29
btullybut you're saying i should be able to specify the charset or collation in that line as well?13:30
slagunthere are limitations on maximum column length that MySQL can index. 512 *unicode* chars is more then that limit. But 512 ASCII chars = 512 bytes is less. If you change column collation then index will work fine. And we do need that index13:31
btullyright i understand that13:32
btullynot being familiar with alembic or sqlalchemy i was just wondering how i'd alter that line in defining the column. no worries, i'll do some googling13:33
slagunI'm sure that can be done. And because alembic was introduce after J1 it is acceptable (although not a good practice) to patch existing migration13:34
ruhebtully: hi! can you give more details on mysql you're using (OS, mysql package and version)?13:39
btullymysql  Ver 14.14 Distrib 5.6.17, for osx10.8 (x86_64)13:39
*** drupalmonkey has joined #murano13:45
*** lazy_prince is now known as killer_prince13:45
ruhei'm developing on mysql too. there must be some specific details in the mysql config13:51
ruhebtully: did you install it from brew?13:51
ruhe* i'm developing on osx too13:52
btullyi believe so, yes13:52
btullyusing python-mysql13:52
btullysorry mysql-python13:54
btullyand yes, mysql installed via homebrew13:56
btullywhat slagun said makes sense13:56
openstackgerritEkaterina Chernova proposed a change to stackforge/python-muranoclient: Update package-import command  https://review.openstack.org/10216213:57
ruheyes, patching migration 001 is ok now13:57
btullyif the collation of the DB and table is utf8 and the columns we want to index are 512 chars, it is too big for the index since the max key length is 767 bytes13:57
btullycan anyone familiar with alembic or sqlalchemy show me how I would patch the command? I've been googling and haven't found an example of setting the column collation13:59
ruhebtully: sure. just one moment :)14:00
btullymany thanks14:00
*** IlyaE has joined #murano14:02
*** gokrokve has joined #murano14:02
openstackgerritStan Lagun proposed a change to stackforge/murano: Code refactoring and improvements for MuranoPL testing mini-framework  https://review.openstack.org/10419914:05
*** gokrokve has quit IRC14:07
ativelkovslagun: could ypu please check this commit in yaql? https://github.com/ativelkov/yaql/commit/5f1e32b96443a494e50e0cc53e0d33e7aad91a3e14:17
ativelkovIf it is fine I'll publish a new version on PyPi14:18
slagunsure14:18
slagun+114:19
slagunbut you also need to change version sting in another file14:19
ativelkovIt is already changed to 0.2.314:24
ativelkovbut this version has never been published14:25
ativelkovso we can publish it now14:25
*** gokrokve has joined #murano14:26
*** gokrokve_ has joined #murano14:27
ativelkovhttps://pypi.python.org/pypi/yaql/0.2.314:27
slagunwhat other changes does it contain?14:27
ativelkovget function14:27
slagunso we can remove one from engine?14:28
ativelkovLets check if it works - and then remove, yes14:28
slaguncontext.register_function(yaql_builtin.dict_attribution, 'get')14:28
slagunthats 'get'?14:29
*** gokrokve has quit IRC14:31
ativelkovyes14:32
ativelkovyaql> dict(a=>1, b=>2, c=>3).get(a)14:33
ativelkovworks at my yaql console14:33
openstackgerritRuslan Kamaldinov proposed a change to stackforge/murano: [WIP] Fix DB migration scripts  https://review.openstack.org/10420514:40
ruhebtully: can you please apply this patch ^^ and check if it works for you?14:40
ruhebtully: i did the fix the other way. i've used prefix indexes14:41
*** gokrokve_ has quit IRC14:43
*** gokrokve has joined #murano14:47
openstackgerritStan Lagun proposed a change to stackforge/murano: Code refactoring and improvements for MuranoPL testing mini-framework  https://review.openstack.org/10419914:59
openstackgerritEkaterina Chernova proposed a change to stackforge/python-muranoclient: Add package-create command  https://review.openstack.org/9917715:03
openstackgerritEkaterina Chernova proposed a change to stackforge/python-muranoclient: Update package-import command  https://review.openstack.org/10216215:03
*** gokrokve has quit IRC15:10
*** gokrokve has joined #murano15:11
openstackgerritRyan Peters proposed a change to stackforge/murano-dashboard: Displays supplier info fields on Application Details page  https://review.openstack.org/10399015:12
drupalmonkeydid yaql just disappear? http://pypi.openstack.org/simple/yaql/15:19
drupalmonkeyall the tests are failing because it can't find yaql15:19
ruhedrupalmonkey: hi. yeah, there is some problem and we're all trying to find what's the reason for that15:20
ruhei don't know yet whether it's a problem with pypi, openstack infra, or something else15:22
openstackgerritRuslan Kamaldinov proposed a change to stackforge/murano: DO NOT MERGE  https://review.openstack.org/10423215:25
*** gokrokve has quit IRC15:25
openstackgerritTimur Sufiev proposed a change to stackforge/murano-dashboard: Enhance versionutils.deprecated to work with classes  https://review.openstack.org/10350215:39
*** chandankumar has quit IRC15:44
btullyruhe: that patch seemed to work15:52
btullythanks so much!!!15:52
btullyin a related question. i noticed that manage.py db-sync no longer works15:53
ruhebtully: np. sorry that you've been block for so long15:53
btullyand was told to use PYTHONPATH=. ./tools/with_venv.sh .venv/bin/murano-db-manage --config-file etc/murano/murano.conf downgrade15:53
btullyPYTHONPATH15:53
ruhebtully: yes, manage.py db-sync is superseded by murano-db-manage15:53
ruheusually i use tox to manage virtual environments15:54
btullyright, so i needed to run setup.py first15:54
ruhehttp://murano.readthedocs.org/en/latest/install/manual.html#installing-the-api-service-and-engine15:54
ruhetox -e venv -- murano-db-manage --config-file /etc/murano/murano.conf upgrade15:54
btullyooh nice15:54
btully:D15:54
btullydo i need to install tox separately?15:57
ruhebtully: yep. i suggest to use tov 1.6.115:58
ruhepip install tox==1.6.115:58
*** killer_prince is now known as lazy_prince16:05
*** gokrokve has joined #murano16:06
*** IlyaE has quit IRC16:16
ruhedrupalmonkey: it's seems that yaql problem is caused by recent changes in the infra configs. we're trying to find how to fix that16:29
*** lazy_prince is now known as killer_prince16:34
*** bharath has joined #murano16:36
bharathcan invisible_to_admin  deploy  the environment?16:37
*** IlyaE has joined #murano16:55
slagunbharath, sorry, didn't get you17:10
bharathslagun: we have user called "invisible to admin" in openstack right?17:11
slagundidn't knew that :)17:12
bharathslagun: when we login as demo tenant, we have two users demo and "invisible to admin"17:13
*** IlyaE has quit IRC17:17
slagunanyway Murano doesn't constraint users. If user has enough permissions to access Neutron and create Heat stack he can deploy environment17:18
bharathslagun: oh okay and one more question, can we select existing networks while deploying  instead of creating our own network?17:19
slagunnot sure. I think it is possible with current core library design (e.g. if you provide correct object model to engine) but may not be exposed in dashboard17:22
slagunkatyafervent__, probably you know it better than me17:22
openstackgerritRyan Peters proposed a change to stackforge/murano: Add optional fields to packages for supplier info  https://review.openstack.org/9946517:27
ruhe#info failing jobs with errors about inability to install yaql are caused by recent changes in openstack-infra. no ETA on resolution yet. we're discussing this issue at #openstack-infra17:28
openstackgerritStan Lagun proposed a change to stackforge/murano: Code refactoring and improvements for MuranoPL testing mini-framework  https://review.openstack.org/10419917:35
openstackgerritStan Lagun proposed a change to stackforge/murano: Code refactoring and improvements for MuranoPL testing mini-framework  https://review.openstack.org/10419917:39
ruhe#info yaql issue is resolved. in case if your patch was affected by it, please add a comment "recheck no bug" in your patch. it'll re-trigger jenkins jobs17:43
ruhe* comment should be added in the gerrit UI17:44
ruhe* see https://review.openstack.org/#/c/103502/ for example17:45
*** openstackgerrit has quit IRC17:49
*** openstackgerrit has joined #murano17:49
openstackgerritRyan Peters proposed a change to stackforge/murano: Add optional fields to packages for supplier info  https://review.openstack.org/9946517:49
slagunMay I ask you to review https://review.openstack.org/#/c/104199/ out of order? I need to make list of commits that all depend on this17:57
*** bharath has quit IRC17:58
*** IlyaE has joined #murano18:10
ruheslagun: sure. we just need to get +1 from murano-ci. i understand problems aren't caused by your patch (it's again a problem in murano-ci infrastructure), but we can't merge this patch until we make sure that it passes real deployment tests18:16
slagunruhe, how long may it take? And what will you suggest - wait for ci or make all dependent commits right away?18:19
ruheslagun: you can send all dependent commit right now. we need to fix murano-ci tomorrow, we don't have any other options18:22
slagunanyway, you can do code review on that commit18:23
ruheslagun: sure. i will18:23
slagunruhe: thanks!18:25
openstackgerritRyan Peters proposed a change to stackforge/murano-dashboard: Displays supplier info fields on Application Details page  https://review.openstack.org/10399018:27
*** IlyaE has quit IRC18:44
*** IlyaE has joined #murano19:23
*** IlyaE has quit IRC19:57
*** IlyaE has joined #murano20:05
*** IlyaE has quit IRC20:52
*** IlyaE has joined #murano20:54
*** gokrokve has quit IRC21:06
*** gokrokve has joined #murano21:08
*** IlyaE has quit IRC21:14
*** IlyaE has joined #murano21:18
*** IlyaE has quit IRC21:29
*** IlyaE has joined #murano21:33
*** btully has quit IRC22:23

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!