| *** iraw_ has joined #openstack-community | 02:23 | |
| *** iraw_ has quit IRC | 02:26 | |
| *** sarob has joined #openstack-community | 04:01 | |
| *** sarob has quit IRC | 04:28 | |
| *** sarob has joined #openstack-community | 04:29 | |
| *** sarob has quit IRC | 04:34 | |
| *** coolsvap|afk is now known as coolsvap | 04:47 | |
| *** yfauser has joined #openstack-community | 05:19 | |
| *** yfauser has left #openstack-community | 05:21 | |
| *** subscope_ has joined #openstack-community | 05:30 | |
| *** subscope_ has quit IRC | 05:31 | |
| *** marcoceppi has quit IRC | 05:55 | |
| *** marcoceppi has joined #openstack-community | 05:56 | |
| *** neeti has joined #openstack-community | 06:32 | |
| *** marcoceppi has quit IRC | 06:41 | |
| *** marcoceppi has joined #openstack-community | 06:47 | |
| *** marcoceppi has quit IRC | 06:51 | |
| *** marcoceppi has joined #openstack-community | 06:52 | |
| *** marcoceppi has joined #openstack-community | 06:52 | |
| *** marcoceppi has quit IRC | 06:52 | |
| *** marcoceppi has joined #openstack-community | 06:52 | |
| *** marcoceppi has joined #openstack-community | 06:52 | |
| *** marcoceppi has quit IRC | 06:58 | |
| *** marcoceppi has joined #openstack-community | 07:04 | |
| *** jcoufal has joined #openstack-community | 07:06 | |
| *** jcoufal is now known as 7JTAAIHSL | 07:06 | |
| *** jcoufal has joined #openstack-community | 07:06 | |
| *** jcoufal has quit IRC | 07:06 | |
| *** jcoufal has joined #openstack-community | 07:06 | |
| *** jcoufal has quit IRC | 07:06 | |
| *** yfauser has joined #openstack-community | 07:15 | |
| *** openstackstatus has joined #openstack-community | 08:06 | |
| *** ChanServ sets mode: +v openstackstatus | 08:06 | |
| -openstackstatus- NOTICE: Restarting gerrit because it stopped sending events (ETA 15 mins) | 08:09 | |
| *** sarob has joined #openstack-community | 08:19 | |
| *** sarob has quit IRC | 08:24 | |
| *** jtomasek has joined #openstack-community | 08:27 | |
| *** yfauser has left #openstack-community | 09:23 | |
| *** marcoceppi has quit IRC | 09:39 | |
| *** marcoceppi has joined #openstack-community | 09:46 | |
| *** marcoceppi has joined #openstack-community | 09:46 | |
| *** GonZoPT has quit IRC | 10:00 | |
| *** sarob has joined #openstack-community | 10:08 | |
| *** sarob has quit IRC | 10:13 | |
| *** marcoceppi has quit IRC | 11:04 | |
| *** marcoceppi has joined #openstack-community | 11:11 | |
| *** marcoceppi has quit IRC | 11:14 | |
| *** marcoceppi has joined #openstack-community | 11:14 | |
| *** marcoceppi has joined #openstack-community | 11:14 | |
| *** cdent has joined #openstack-community | 11:23 | |
| *** marcoceppi has quit IRC | 11:25 | |
| *** coolsvap is now known as coolsvap|afk | 11:27 | |
| *** marcoceppi has joined #openstack-community | 11:33 | |
| *** marcoceppi has joined #openstack-community | 11:33 | |
| *** mrmartin has joined #openstack-community | 11:45 | |
| *** mwagner_lap has quit IRC | 11:48 | |
| *** dizquierdo has joined #openstack-community | 12:01 | |
| *** marcoceppi has quit IRC | 12:05 | |
| *** marcoceppi has joined #openstack-community | 12:11 | |
| *** jehb has joined #openstack-community | 12:16 | |
| *** yfauser has joined #openstack-community | 12:18 | |
| *** yfauser has left #openstack-community | 12:24 | |
| *** yfauser has joined #openstack-community | 13:20 | |
| *** yfauser has left #openstack-community | 13:20 | |
| *** tiswanso has joined #openstack-community | 13:21 | |
| *** marcoceppi has quit IRC | 13:24 | |
| *** 7JTAAIHSL has quit IRC | 13:26 | |
| *** marcoceppi has joined #openstack-community | 13:30 | |
| *** neeti has quit IRC | 13:31 | |
| -openstackstatus- NOTICE: gerrit has been restarted to clear a problem with its event stream. change events between 13:09 and 13:36 utc should be rechecked or have approval votes reapplied as needed to trigger jobs | 13:46 | |
| *** yfauser has joined #openstack-community | 13:55 | |
| *** yfauser has left #openstack-community | 13:56 | |
| *** mwagner_lap has joined #openstack-community | 13:57 | |
| *** jtomasek has quit IRC | 13:57 | |
| *** wznoinsk has joined #openstack-community | 14:03 | |
| *** mattgriffin has joined #openstack-community | 14:09 | |
| *** yfauser has joined #openstack-community | 14:16 | |
| *** yfauser has left #openstack-community | 14:16 | |
| *** tiswanso has quit IRC | 14:24 | |
| *** tiswanso has joined #openstack-community | 14:34 | |
| *** annegentle has joined #openstack-community | 14:51 | |
| *** sarob has joined #openstack-community | 14:59 | |
| *** tiswanso has quit IRC | 15:04 | |
| *** tiswanso has joined #openstack-community | 15:12 | |
| *** annegentle has quit IRC | 15:12 | |
| *** Piet has joined #openstack-community | 15:17 | |
| *** dizquierdo has quit IRC | 15:19 | |
| *** electrocucaracha has joined #openstack-community | 15:24 | |
| *** Marga_ has joined #openstack-community | 15:29 | |
| *** Marga__ has joined #openstack-community | 15:29 | |
| *** Marga_ has quit IRC | 15:33 | |
| *** Marga__ has quit IRC | 15:37 | |
| *** jtomasek has joined #openstack-community | 15:54 | |
| *** jcoufal has joined #openstack-community | 16:15 | |
| *** dizquierdo has joined #openstack-community | 16:30 | |
| *** tiswanso has quit IRC | 16:32 | |
| *** tiswanso_ has joined #openstack-community | 16:33 | |
| reed | hello | 16:47 |
|---|---|---|
| mrmartin | hi | 16:50 |
| reed | hi mrmartin | 16:51 |
| mrmartin | https://github.com/mkissam/puppet-askbot | 16:51 |
| mrmartin | the refactored askbot puppet | 16:52 |
| mrmartin | still have some rough edges, but basically works | 16:52 |
| mrmartin | and consume directly from askbot-devel github | 16:52 |
| reed | neat | 16:52 |
| *** logan2 has quit IRC | 17:05 | |
| *** EmilienM is now known as EmilienM|afk | 17:17 | |
| mrmartin | so yes, I was talking with them, and did a review on the spec | 17:22 |
| mrmartin | it is not so bad, but need to work on the 2nd part which defines the tasks | 17:22 |
| mrmartin | where we can identify which task depends on whom, and where we need infra help | 17:22 |
| reed | ok | 17:24 |
| reed | thanks | 17:24 |
| *** salvorapi has joined #openstack-community | 17:24 | |
| mrmartin | it was the run of the failed puppet: http://paste.openstack.org/show/208632/ | 17:26 |
| mrmartin | the box with 7.53 askbot is building meanwhile | 17:26 |
| * reed checks | 17:27 | |
| mrmartin | looks like it is missing a python import, but I don't know why, that was running well before today | 17:27 |
| mrmartin | and I see no change on askbot-devel repo | 17:27 |
| reed | is this the upgrade from master? | 17:28 |
| mrmartin | oh I've an idea, I'll try to rebuild this instance quickly | 17:29 |
| mrmartin | what I've noticed today, that the header was broken, and we had two language selectors there | 17:30 |
| reed | the html header? | 17:32 |
| mrmartin | yeap | 17:32 |
| mrmartin | so we have a chance, that this theme patch will solve that issue | 17:32 |
| reed | check it out :) | 17:32 |
| salvorapi | mrmartin: Have you try to do a manage.py syncdb --database=otherdbname ? | 17:35 |
| mrmartin | salvorapi, no thanks, I guess I found the issue | 17:35 |
| salvorapi | ah ok :) | 17:35 |
| mrmartin | I think it was a dependency problem between a pip and source deployment. | 17:36 |
| reed | mrmartin, what sort of dependency? | 17:36 |
| mrmartin | I've misconfigured the askbot-puppet module, because I put a symlink to the latest gitrepo into a wrong place, and initially deployed the askbot from pip, then tried from github repo src directly. | 17:38 |
| mrmartin | I hope | 17:38 |
| *** electrocucaracha has quit IRC | 17:38 | |
| *** salvorapi has quit IRC | 17:39 | |
| *** Piet has quit IRC | 17:39 | |
| *** jtomasek has quit IRC | 17:42 | |
| mrmartin | do you know where can I find the previous askbot packages at pypi site? | 17:45 |
| *** cdent has quit IRC | 17:51 | |
| reed | no, sorry | 18:05 |
| mrmartin | the cloud instance failed with the same error. UnknownMigration: Migration 'auth:0001_initial' probably doesn't exist. | 18:05 |
| mrmartin | I'll try that against a mysql db to exclude pgsql issue here | 18:05 |
| reed | https://pypi.python.org/pypi/askbot/0.7.50 | 18:06 |
| *** EmilienM|afk is now known as EmilienM | 18:06 | |
| mrmartin | ah, so we don't have 0.7.51 | 18:07 |
| mrmartin | but 0.7.52 exists | 18:08 |
| mrmartin | Askbot patches `auth_user` table. The migration script will automatically add missing columns, however it will not overwrite any existing columns. Please do back up your database before adding askbot to an existing site. | 18:08 |
| mrmartin | in 0.7.52 | 18:08 |
| reed | evgeny is coming | 18:09 |
| *** GonZo2K has joined #openstack-community | 18:10 | |
| reed | so the issue is because you were skipping a version | 18:10 |
| reed | ? | 18:10 |
| *** evgeny has joined #openstack-community | 18:10 | |
| evgeny | mrmartin: hello, sorry I missed the time | 18:11 |
| mrmartin | hi evgeny | 18:11 |
| mrmartin | it seems to be I've two failing deployments now :) | 18:11 |
| evgeny | upgrade django to 1.5.12 | 18:11 |
| mrmartin | requirements.txt: django>=1.3.1,<1.6 | 18:12 |
| evgeny | pip uninstall django-avatar django-celery django-redis-cache django-countries | 18:12 |
| evgeny | then pip install | 18:12 |
| evgeny | yes, there are issues with that currently | 18:12 |
| mrmartin | reed: the prod testing puppet is failed, but it happend due a missing config line only: | 18:12 |
| mrmartin | add to TEMPLATE_CONTEXT_PROCESSORS in settings.py: | 18:12 |
| mrmartin | 'askbot.deps.group_messaging.context.group_messaging_context', | 18:12 |
| evgeny | i.e. reinstnall the modules | 18:12 |
| evgeny | yes | 18:13 |
| mrmartin | ok, so this is one | 18:13 |
| mrmartin | the interesting issue is that: http://paste.openstack.org/show/208632/ | 18:13 |
| evgeny | the best is to update manually and in parallel update the recipe | 18:13 |
| mrmartin | it is a clean deployment with github master branch | 18:14 |
| evgeny | After everything is installed a python manage.py migrate is necellary | 18:14 |
| evgeny | necessary | 18:14 |
| mrmartin | what is that doing anyway: askbot.deps.group_messaging.context.group_messaging_context ? | 18:15 |
| evgeny | python manage.py syncdb --migrate --noinput | 18:15 |
| evgeny | this command will also migrate the tables, not all are made by syncdb | 18:15 |
| mrmartin | can I use this --migrate option for new deployments? | 18:16 |
| evgeny | yes | 18:16 |
| evgeny | re: migrate ^ | 18:16 |
| evgeny | regarding the context processor - not doing anything yet b/c private messaging is disabled atm | 18:16 |
| evgeny | but will be enabled in the future | 18:16 |
| *** Piet has joined #openstack-community | 18:19 | |
| *** jcoufal has quit IRC | 18:20 | |
| *** tiswanso_ has quit IRC | 18:23 | |
| *** tiswanso has joined #openstack-community | 18:23 | |
| mrmartin | evgeny: python manage.py syncdb --migrate --noinput | 18:27 |
| mrmartin | Syncing... | 18:27 |
| mrmartin | Creating tables ... | 18:27 |
| mrmartin | DatabaseError: (1146, "Table 'askbotdb.django_content_type' doesn't exist") | 18:27 |
| mrmartin | django is 1.5.12 | 18:27 |
| evgeny | do you have 'django.contrib.contenttypes', in settings.INSTALLED_APPS? | 18:28 |
| mrmartin | I have | 18:31 |
| mrmartin | reed: don't we have a pic sharing service in openstack infra similar to paste.o.o ? | 18:33 |
| reed | mrmartin, no | 18:33 |
| mrmartin | I'm sending on skype | 18:33 |
| mrmartin | evgeny, where I did the upgrade with production puppet, the language selector appears twice | 18:34 |
| mrmartin | reed: it is a clean deployment, without db and static files restore | 18:34 |
| mrmartin | evgeny: am I need to do any other config change related to new package? | 18:36 |
| *** electrocucaracha has joined #openstack-community | 18:36 | |
| evgeny | mrmartin: yes, sorry this one: django-followit (the same - reinstall) | 18:37 |
| evgeny | also you might need to delete the cache | 18:38 |
| reed | http://imgur.com/l6lDsH7 | 18:38 |
| evgeny | reed: I see, testing now | 18:39 |
| mrmartin | pip freeze | grep followit | 18:39 |
| mrmartin | django-followit==0.0.7 | 18:39 |
| mrmartin | it is 0.0.7 by default, am I need to do anything with that? | 18:39 |
| evgeny | mrmartin: add AVATAR_AUTO_GENERATE_SIZES = (16, 32, 48, 128) to settings.py | 18:41 |
| evgeny | mrmartin: if it's older version on production then update, otherwise no | 18:42 |
| mrmartin | I'm trying to redeploy in vagrant, this strange db sync issue appeared a few hours ago, and I need to find out what was changed | 18:44 |
| mrmartin | maybe some dependent package or lib is doing that | 18:44 |
| evgeny | mrmartin: have you done "python manage.py collectstatic --noinput"? | 18:50 |
| mrmartin | I'm used to | 18:50 |
| mrmartin | it is part of the puppet manifests | 18:50 |
| evgeny | regarding the migration issue - I'm not sure, could be due to some dependency library. | 18:51 |
| evgeny | I haven't seen that specific error yet | 18:51 |
| mrmartin | evgeny, yeah, I have the same idea, I never met with this error before | 18:53 |
| mrmartin | I did at least 20 deployments today | 18:53 |
| mrmartin | if it turns out that a pypi dependency changed and causing that error, than we need to pin the pip dependencies in requirements.txt to exact versions | 18:54 |
| evgeny | yes | 18:58 |
| evgeny | mrmartin: could you send me frozen requirements and I'll try to reproduce here? | 18:59 |
| mrmartin | sure: http://paste.openstack.org/show/208746/ | 18:59 |
| mrmartin | it is not db related, I can reproduce this with mysql and pgsql too | 19:00 |
| mrmartin | http://stackoverflow.com/questions/29602219/django-db-utils-databaseerror-1146-table-test-xxx-django-content-type-does | 19:02 |
| *** dizquierdo has quit IRC | 19:04 | |
| mrmartin | evgeny: a traceback for django content type issue: http://paste.openstack.org/show/208758/ | 19:08 |
| evgeny | mrmartin: why is it in mysql module/ | 19:09 |
| evgeny | mrmartin: why is it in mysql module? | 19:09 |
| mrmartin | i've switched back to mysql, but can create one pgsql too | 19:09 |
| evgeny | the issue causing this might still be relevant, but mysql library should not be used | 19:09 |
| evgeny | ok | 19:10 |
| evgeny | going to mysql is not an option here | 19:10 |
| reed | mrmartin, how are things going? | 19:19 |
| mrmartin | we are still trying to find out what's wrong here | 19:19 |
| mrmartin | I'm just doing a pip freeze diff | 19:20 |
| mrmartin | because in my local vagrant everything seems to be perfect, but the instance in hpcloud based on a ubuntu precise image is totally dead | 19:20 |
| mrmartin | and as I see, it is adding a lot of extra python packages, like boto, cloud-init | 19:21 |
| *** jcoufal has joined #openstack-community | 19:21 | |
| reed | geez | 19:21 |
| reed | who adds more packages? | 19:21 |
| mrmartin | so I guess one of the packages we are not using anyway, broke the db sync | 19:21 |
| reed | are you saying that the base ubuntu image is different? | 19:21 |
| mrmartin | basically it is included in the hp's ubuntu image, because it contains the cloud-init that is fetching info's used for provisioning | 19:22 |
| reed | geez | 19:22 |
| mrmartin | I'll try to deploy a cloud-init into vagrant to see what happens | 19:22 |
| mrmartin | :D | 19:22 |
| mrmartin | don't worry, we used to find the solution. | 19:22 |
| mrmartin | are we running ask.o.o in rackspace or from hp? | 19:23 |
| clarkb | rax | 19:23 |
| mrmartin | awesome | 19:23 |
| mrmartin | pip freeze output can be handy | 19:23 |
| mrmartin | clarkb or fungi, can you make me a pip freeze on ask.o.o ? | 19:24 |
| clarkb | I am running an errand now but can in an hour or two | 19:24 |
| clarkb | fungi is likely quicker | 19:24 |
| mrmartin | two packages are suspicious here, cloud-init and euca2ools | 19:25 |
| *** annegentle has joined #openstack-community | 19:27 | |
| *** electroc_ has joined #openstack-community | 19:28 | |
| evgeny | mrmartin: I'm stuck on pip install chardet==2.0.1 | 19:28 |
| evgeny | no such version, so I'll try the latest. It may not even be used | 19:29 |
| mrmartin | we don't have such a package | 19:29 |
| mrmartin | we have | 19:30 |
| evgeny | maybe a bunch of modules from the freeze you gave me are not used with askbot | 19:30 |
| mrmartin | it doesn't exist in vagrant | 19:30 |
| mrmartin | yes, I guess it comes from a tool predeployed by the cloud package ubuntu image | 19:30 |
| mrmartin | and it breaks everything | 19:30 |
| *** electrocucaracha has quit IRC | 19:31 | |
| evgeny | I'm just runnig 'pip install -r req.txt' on your freeze | 19:31 |
| evgeny | I don't know what breaks things yet, just trying to build the environment | 19:31 |
| evgeny | but yes, if package deployment fails with pip install - then all sorts of errors may pop up | 19:32 |
| mrmartin | yeah, but pip-install seems to be ok: Notice: /Stage[main]/Askbot::Install/Exec[pip-requirements-install]: Triggered 'refresh' from 1 events | 19:33 |
| mrmartin | django-threaded-multihost==1.4-1 in local and django-threaded-multihost==1.4.post1 in remote | 19:36 |
| evgeny | mrmartin: I have to be offline for about an hour, will be back after that. | 19:37 |
| mrmartin | ok feel free | 19:37 |
| *** evgeny has quit IRC | 19:41 | |
| mrmartin | evgeny: a virtualenv deployment could solve this dependency issue? | 19:48 |
| *** jcoufal has quit IRC | 19:55 | |
| mrmartin | ok, I'm sure that the base image I'm using in HP have a lot of python- dependency predeployed, and one of them broke things | 20:25 |
| mrmartin | this is the rax output, looks much-much better: http://paste.openstack.org/show/208853/ | 20:25 |
| *** tiswanso has quit IRC | 20:32 | |
| *** mattgriffin has quit IRC | 20:35 | |
| *** rbowen has quit IRC | 20:35 | |
| *** rbowen has joined #openstack-community | 20:35 | |
| *** dizquierdo has joined #openstack-community | 20:36 | |
| *** annegentle has quit IRC | 20:36 | |
| *** mwagner_lap has quit IRC | 20:37 | |
| mrmartin | reed: are you here? | 20:38 |
| reed | yes | 20:38 |
| mrmartin | ok, so after some investigation it seems to be that the rax images we are using in production, different from hp cloud images | 20:38 |
| reed | ubuntu is not ubuntu everywhere, eh? depressing | 20:38 |
| mrmartin | yes :D | 20:38 |
| mrmartin | exactly | 20:38 |
| mrmartin | hp adds some extra python packages | 20:38 |
| reed | and those extra packages break askbot? it makes no sense | 20:39 |
| reed | but i don't need the details | 20:39 |
| reed | if it works on RAX then that's enough | 20:39 |
| mrmartin | yes, so it is good to know, that it happens, we were lucky last time we deploy the production :) | 20:39 |
| mrmartin | ok, but you need to try out, because askbot-staging instance create could take much more time | 20:40 |
| mrmartin | so I see two options here: | 20:40 |
| mrmartin | a, quickly upload a custom image that works | 20:40 |
| mrmartin | b, refactor to virtualenv, with very specific packages | 20:40 |
| mrmartin | because as I see even in local deployment, which works, that the theme is broken, and I guess this base.html removal not solves everything. | 20:41 |
| reed | we need the staging server | 20:42 |
| mrmartin | yeah | 20:42 |
| reed | shall we ask fungi and clarkb to estimate when it may be available? | 20:42 |
| reed | or do you aready have an idea? | 20:42 |
| mrmartin | a basic server can get available quickly, the review is there, it have two comments | 20:43 |
| mrmartin | one is related to ssl params, and the other is minor naming issue | 20:44 |
| mrmartin | my experience, if we get approval, it can be deployed on this friday | 20:44 |
| reed | so late? | 20:44 |
| reed | damn | 20:44 |
| mrmartin | but it depends on the load of the infra | 20:44 |
| reed | it's a bad week this one | 20:45 |
| mrmartin | that's my experience based on previous deployments | 20:45 |
| reed | let's ask on infra | 20:45 |
| reed | what's the change #? | 20:45 |
| reed | mrmartin, can you respond to the comments from clark first? | 20:47 |
| *** Marga_ has joined #openstack-community | 20:47 | |
| mrmartin | https://review.openstack.org/#/c/172880/1 | 20:47 |
| mrmartin | ok, so I try to arrange that tomorrow and bring that patch into an approvable state. | 20:53 |
| mrmartin | and try to hack this hpcloud image thing, it shouldn't take so much time. | 20:54 |
| mrmartin | I can do it quickly, and we can test the UX of ask | 20:54 |
| reed | ok | 20:58 |
| reed | thanks marton | 20:59 |
| *** Marga_ has quit IRC | 20:59 | |
| *** electrocucaracha has joined #openstack-community | 21:04 | |
| *** annegent_ has joined #openstack-community | 21:07 | |
| *** electroc_ has quit IRC | 21:08 | |
| *** mrmartin has quit IRC | 21:33 | |
| *** Marga_ has joined #openstack-community | 21:47 | |
| *** sarob has quit IRC | 21:52 | |
| *** sarob has joined #openstack-community | 21:52 | |
| *** electrocucaracha has quit IRC | 21:56 | |
| *** Marga_ has quit IRC | 22:01 | |
| *** dizquierdo has quit IRC | 22:23 | |
| *** Piet has quit IRC | 22:32 | |
| *** evgeny has joined #openstack-community | 22:49 | |
| *** annegent_ has quit IRC | 22:51 | |
| *** mwagner_lap has joined #openstack-community | 22:54 | |
| *** Marga_ has joined #openstack-community | 23:32 | |
| *** annegentle has joined #openstack-community | 23:33 | |
| *** annegentle has quit IRC | 23:35 | |
| *** evgeny has quit IRC | 23:48 | |
| *** sarob has quit IRC | 23:51 | |
| *** sarob has joined #openstack-community | 23:54 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!