attributes import

[ag2888]

Hello,

We have setup a magento shop 1.3.2.4, openerp on windows all in one and on debian.

When we import produtct attributes we have this error on windows server :

Environment Information :
System : Windows-2003Server-5.2.3790-SP2
OS Name : nt
Operating System Release : 2003Server
Operating System Version : 5.2.3790
Operating System Architecture : 32bit
Operating System Locale : en_US.cp1252
Python Version : 2.5.2
OpenERP-Client Version : 5.0.12
Last revision No. & ID :Bazaar Package not Found !Traceback (most recent call last):
  File "netsvc.pyo", line 247, in dispatch
  File "netsvc.pyo", line 76, in __call__
  File "service\web_services.pyo", line 577, in execute
  File "osv\osv.pyo", line 58, in wrapper
  File "osv\osv.pyo", line 119, in execute
  File "osv\osv.pyo", line 111, in execute_cr
  File "C:\Program Files\OpenERP AllInOne\Server\addons\magentoerpconnect\magerp_core.py", line 84, in sync_attribs
  File "C:\Program Files\OpenERP AllInOne\Server\addons\magentoerpconnect\magerp_osv.py", line 53, in call
  File "xmlrpclib.pyo", line 1147, in __call__
  File "xmlrpclib.pyo", line 1437, in __request
  File "xmlrpclib.pyo", line 1201, in request
  File "xmlrpclib.pyo", line 1340, in _parse_response
  File "xmlrpclib.pyo", line 785, in close
ResponseError: ResponseError()

And this error on debian 5:

Environment Information :
System : Windows-32bit
OS Name : nt
Operating System Release :
Operating System Version : 32bit
Operating System Architecture : 32bit
Operating System Locale : fr_FR.cp1252
Python Version : 2.5.2
OpenERP-Client Version : 5.0.12
Last revision No. & ID :Bazaar Package not Found !Traceback (most recent call last):
  File "/usr/lib/python2.5/site-packages/openerp-server/netsvc.py", line 256, in dispatch
    result = LocalService(service_name)(method, *params)
  File "/usr/lib/python2.5/site-packages/openerp-server/netsvc.py", line 76, in __call__
    return getattr(self, method)(*params)
  File "/usr/lib/python2.5/site-packages/openerp-server/service/web_services.py", line 577, in execute
    res = service.execute(db, uid, object, method, *args)
  File "/usr/lib/python2.5/site-packages/openerp-server/osv/osv.py", line 58, in wrapper
    return f(self, dbname, *args, **kwargs)
  File "/usr/lib/python2.5/site-packages/openerp-server/osv/osv.py", line 119, in execute
    res = pool.execute_cr(cr, uid, obj, method, *args, **kw)
  File "/usr/lib/python2.5/site-packages/openerp-server/osv/osv.py", line 111, in execute_cr
    return getattr(object, method)(cr, uid, *args, **kw)
  File "/usr/lib/python2.5/site-packages/openerp-server/addons/magentoerpconnect/magerp_core.py", line 84, in sync_attribs
    mage_inp = attr_conn.call('ol_catalog_product_attribute.list', [all_attr_set_ids]) #Get the tree
  File "/usr/lib/python2.5/site-packages/openerp-server/addons/magentoerpconnect/magerp_osv.py", line 53, in call
    res = self.ser.call(self.session, method, arguments)
  File "/usr/lib/python2.5/xmlrpclib.py", line 1147, in __call__
    return self.__send(self.__name, args)
  File "/usr/lib/python2.5/xmlrpclib.py", line 1437, in __request
    verbose=self.__verbose
  File "/usr/lib/python2.5/xmlrpclib.py", line 1201, in request
    return self._parse_response(h.getfile(), sock)
  File "/usr/lib/python2.5/xmlrpclib.py", line 1335, in _parse_response
    p.feed(response)
  File "/usr/lib/python2.5/xmlrpclib.py", line 547, in feed
    self._parser.Parse(data, 0)
ExpatError: junk after document element: line 2, column 0

We have import 13 500 attribute in 8 attribute groups with "Store Manager for Magento" software . We can see all attribute on magento back office

PS : We have test with 50 attribute, all work.

Sincerely

[ntrubert-cobweb (ntrubert)]

There is a limitation due to Postrgres fields limitation about 1600 fields per table maximum.

It's lock like this bug report:

https://bugs.launchpad.net/magentoerpconnect/+bug/648667

[Raphaël Valyi - http://www.akretion.com (rvalyi)]

I confirm, in any case you will run into https://bugs.launchpad.net/magentoerpconnect/+bug/648667
I advise you first try to build a workaround to deal with your very high number of attributes before trying anything further.

[ag2888 (q-contact-gdaudit-com)]

Merci pour vos réponses :)

Raphaël, a tu justement une solution pour contourner ce problème ????

Merci :)

[Raphaël Valyi - http://www.akretion.com (rvalyi)]

ag2888,

as explained in https://bugs.launchpad.net/bugs/648667, there are 3 options:
1) develop EAV support for OpenObject and refactor magentoerpconnect over it
(by Sharoon Thomas)
2) develop an overridden read method that load only some columns depending
on a context parameter. This has been suggested by CampToCamp, I think this
is valid and easy to speed up the product manipulation in OppenERP, but that
only hekps if you are below the 1600 attributes limitation.
3) develop a system creating product tables related to Magento attribute
sets on the fly and using OpenObject '_inherits' feature. As I said, in
OpenERP 5.x the ORM was too buggy to do this. It would be interesting to see
if OpenERP 6.x could finally support this. I think this is the best
solution personally.

In any case this is not going to be simple. If you are an integrator, my
advice would be to step out of the project as you would hardly meet the
requirement (unless you can spend quite a lot to do that refactoring, using
relatively skilled developers; I would need some 12 days myself to achieve
that provided OpenERP 6 support it). If you are a end user, you should have
looked for this sooner or asked some skilled integrator. May be you could
also re-shape your Magento settings to go below the 1600 limit (possibly
using several installs, I don't know) and then eventually follow the
CampToCamp "read" option that is relatively easy to implement.

Good luck, please let us know if you find a solution.

On Thu, Oct 21, 2010 at 11:15 AM, ag2888 <email address hidden> wrote:

> *** This bug is a duplicate of bug 648667 ***
> https://bugs.launchpad.net/bugs/648667
>
> Merci pour vos réponses :)
>
> Raphaël, a tu justement une solution pour contourner ce problème ????
>
> Merci :)
>
> --
> attributes import
> https://bugs.launchpad.net/bugs/664321
> You received this bug notification because you are subscribed to Magento
> Open ERP Connector.
>
> Status in Magento Open ERP Connector: New
>
> Bug description:
> Hello,
>
> We have setup a magento shop 1.3.2.4, openerp on windows all in one and on
> debian.
>
> When we import produtct attributes we have this error on windows server :
>
>
> Environment Information :
> System : Windows-2003Server-5.2.3790-SP2
> OS Name : nt
> Operating System Release : 2003Server
> Operating System Version : 5.2.3790
> Operating System Architecture : 32bit
> Operating System Locale : en_US.cp1252
> Python Version : 2.5.2
> OpenERP-Client Version : 5.0.12
> Last revision No. & ID :Bazaar Package not Found !Traceback (most recent
> call last):
> File "netsvc.pyo", line 247, in dispatch
> File "netsvc.pyo", line 76, in __call__
> File "service\web_services.pyo", line 577, in execute
> File "osv\osv.pyo", line 58, in wrapper
> File "osv\osv.pyo", line 119, in execute
> File "osv\osv.pyo", line 111, in execute_cr
> File "C:\Program Files\OpenERP
> AllInOne\Server\addons\magentoerpconnect\magerp_core.py", line 84, in
> sync_attribs
> File "C:\Program Files\OpenERP
> AllInOne\Server\addons\magentoerpconnect\magerp_osv.py", line 53, in call
> File "xmlrpclib.pyo", line 1147, in __call__
> File "xmlrpclib.pyo", line 1437, in __request
> Fil...

[Sharoon Thomas http://openlabs.co.in (sharoonthomas)]

Hi,

I agree with Raphael and implementing EAV will take more time than the other
two methods.

The fastest solution if it gives a performance improvement will be override
of read to selectively read based on attribute set.

Thanks

Sharoon Thomas,
Business Analyst & ERP Consultant,
--Sent from Google android

On 21 Oct 2010 19:26, "Raphaël Valyi - http://www.akretion.com" <
<email address hidden>> wrote:

*** This bug is a duplicate of bug 648667 ***
https://bugs.launchpad.net/bugs/648667
ag2888,

as explained in https://bugs.launchpad.net/bugs/648667, there are 3 options:
1) develop EAV support for OpenObject and refactor magentoerpconnect over it
(by Sharoon Thomas)
2) develop an overridden read method that load only some columns depending
on a context parameter. This has been suggested by CampToCamp, I think this
is valid and easy to speed up the product manipulation in OppenERP, but that
only hekps if you are below the 1600 attributes limitation.
3) develop a system creating product tables related to Magento attribute
sets on the fly and using OpenObject '_inherits' feature. As I said, in
OpenERP 5.x the ORM was too buggy to do this. It would be interesting to see
if OpenERP 6.x could finally support this. I think this is the best
solution personally.

In any case this is not going to be simple. If you are an integrator, my
advice would be to step out of the project as you would hardly meet the
requirement (unless you can spend quite a lot to do that refactoring, using
relatively skilled developers; I would need some 12 days myself to achieve
that provided OpenERP 6 support it). If you are a end user, you should have
looked for this sooner or asked some skilled integrator. May be you could
also re-shape your Magento settings to go below the 1600 limit (possibly
using several installs, I don't know) and then eventually follow the
CampToCamp "read" option that is relatively easy to implement.

Good luck, please let us know if you find a solution.

On Thu, Oct 21, 2010 at 11:15 AM, ag2888 <email address hidden>
wrote:

> *** This bug is a duplicate of bug 648667 ***
> https://bugs.launchpad.net/bugs/648667
>
> Me...