replace serialized data in aiki configs

[rejon]

Serialized data is evil! its inefficient and much better to just use a proper data type IMO. Since we rely so heavily on database and needing mysql, we should be super clean about ONLY using sql IMO.

I changed on config and borked scale! So, I had to fire up a stupid commandline client and enter this:

update aiki_config SET config_data='a:8:{s:4:"site";s:7:"default";s:3:"url";s:24:"http://scalejournal.org/";s:13:"default_chmod";s:4:"0775";s:11:"pretty_urls";s:1:"1";s:16:"default_language";s:7:"english";s:19:"default_time_format";s:9:"d - m - Y";s:8:"site_dir";s:3:"ltr";s:19:"language_short_name";s:2:"en";}' WHERE config_id=1 AND config_type='global_settings';

That is insane because I had to hand edit and count the characters of the string. Databases are used to store data, not have a data structure inside a storage system.

This is a high necessary fix.

If anything, we should provide easy access to creating proper fields on the db.

[rejon (rejon)]

I could pile on more projects, but doesn't help because we have 1 person bus count on this.

[rejon (rejon)]

Other arguments against:

http://www.mysqlperformanceblog.com/2010/01/21/when-should-you-store-serialized-objects-in-the-database/

But, for me, its a history thing! just like aikimarkup, it adds one more layer of extra stuff to learn and is another shortcut taken early in aiki that is slowing us down.

[rejon (rejon)]

"Josh Berkus (of PgExperts) calls this serialization E-blob. Much like EAV, he criticizes this as one of 10 ways to wreck your database (slides). I tend to side with Josh. I’m optimistic that this design has its place in a smaller component of your application, but I’m weary every time I hear someone decide to switch to it exclusively."

Josh is my friend. He is cool and super respected.

[rejon (rejon)]

more info about data serialization, which is basically a complete hack of a way to add non-thinking to database design:

http://php.net/manual/en/function.serialize.php

[nickybourque (nickybourque)]

I suppose it depends. There are a handful of instances where it is
advantageous to store datastructures as blobs, but I don't think that
PHP has something like Perl's Storable. Regardless, it's very resource
intensive, and not a very good way to go in all but that limited set
of cases.

Why not just store config data in files?

On Mon, Dec 13, 2010 at 2:20 PM, rejon <email address hidden> wrote:
> more info about data serialization, which is basically a complete hack
> of a way to add non-thinking to database design:
>
> http://php.net/manual/en/function.serialize.php
>
> --
> You received this bug notification because you are a member of Aiki
> Framework Developers, which is subscribed to aikiframework.
> https://bugs.launchpad.net/bugs/689904
>
> Title:
>  replace serialized data in aiki configs
>
> Status in Aiki Framework:
>  Confirmed
> Status in openclipart:
>  Confirmed
> Status in PPL:
>  New
> Status in Scale Journal:
>  Confirmed
>
> Bug description:
>  Serialized data is evil! its inefficient and much better to just use a proper data type IMO. Since we rely so heavily on database and needing mysql, we should be super clean about ONLY using sql IMO.
>
> I changed on config and borked scale! So, I had to fire up a stupid commandline client and enter this:
>
> update aiki_config SET config_data='a:8:{s:4:"site";s:7:"default";s:3:"url";s:24:"http://scalejournal.org/";s:13:"default_chmod";s:4:"0775";s:11:"pretty_urls";s:1:"1";s:16:"default_language";s:7:"english";s:19:"default_time_format";s:9:"d - m - Y";s:8:"site_dir";s:3:"ltr";s:19:"language_short_name";s:2:"en";}' WHERE config_id=1 AND config_type='global_settings';
>
> That is insane because I had to hand edit and count the characters of the string.  Databases are used to store data, not have a data structure inside a storage system.
>
> This is a high necessary fix.
>
> If anything, we should provide easy access to creating proper fields on the db.
>
>
>

[rejon (rejon)]

better to store in DB, config files should be a backup option...even with
status.net, moved all configs in the db, but config file is a backup...

thanks for opinion nicky!

On Mon, Dec 13, 2010 at 2:34 PM, nickybourque <email address hidden>wrote:

> I suppose it depends. There are a handful of instances where it is
> advantageous to store datastructures as blobs, but I don't think that
> PHP has something like Perl's Storable. Regardless, it's very resource
> intensive, and not a very good way to go in all but that limited set
> of cases.
>
> Why not just store config data in files?
>
>
>
>
> On Mon, Dec 13, 2010 at 2:20 PM, rejon <email address hidden> wrote:
> > more info about data serialization, which is basically a complete hack
> > of a way to add non-thinking to database design:
> >
> > http://php.net/manual/en/function.serialize.php
> >
> > --
> > You received this bug notification because you are a member of Aiki
> > Framework Developers, which is subscribed to aikiframework.
> > https://bugs.launchpad.net/bugs/689904
> >
> > Title:
> > replace serialized data in aiki configs
> >
> > Status in Aiki Framework:
> > Confirmed
> > Status in openclipart:
> > Confirmed
> > Status in PPL:
> > New
> > Status in Scale Journal:
> > Confirmed
> >
> > Bug description:
> > Serialized data is evil! its inefficient and much better to just use a
> proper data type IMO. Since we rely so heavily on database and needing
> mysql, we should be super clean about ONLY using sql IMO.
> >
> > I changed on config and borked scale! So, I had to fire up a stupid
> commandline client and enter this:
> >
> > update aiki_config SET
> config_data='a:8:{s:4:"site";s:7:"default";s:3:"url";s:24:"
> http://scalejournal.org/";s:13:"default_chmod";s:4:"0775";s:11:"pretty_urls";s:1:"1";s:16:"default_language";s:7:"english";s:19:"default_time_format";s:9:"d
> - m - Y";s:8:"site_dir";s:3:"ltr";s:19:"language_short_name";s:2:"en";}'
> WHERE config_id=1 AND config_type='global_settings';
> >
> > That is insane because I had to hand edit and count the characters of the
> string. Databases are used to store data, not have a data structure inside
> a storage system.
> >
> > This is a high necessary fix.
> >
> > If anything, we should provide easy access to creating proper fields on
> the db.
> >
> >
> >
>
> --
> You received this bug notification because you are a direct subscriber
> of the bug.
> https://bugs.launchpad.net/bugs/689904
>
> Title:
> replace serialized data in aiki configs
>

--
Jon Phillips
http://rejon.org/
http://fabricatorz.com/
chat/skype: kidproto | irc: rejon
+1.415.830.3884 (sf/global)
+86.187.1003.9974 (china)

+65.8330.5807 (singapore)

[rejon (rejon)]

moving back work on this...

[rejon (rejon)]

hmmm...not sure about this now...hahahha

[rejon (rejon)]

we have bigger fish to fry.