regression: Error when importing a csv file with UTF-8 characters

Bug #528039 reported by Renato Lima - http://www.akretion.com
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Odoo Server (MOVED TO GITHUB)
Invalid
High
gpa(OpenERP)

Bug Description

Hi,

I tried to install a module with some csv files, but some files have UTF-8. Never quite had this problem I think this is a regression.

regards,

Renato Lima

[2010-02-25 18:22:11,604] INFO:init:module l10n_br_data: loading l10n_br.cfop.csv
[2010-02-25 18:22:22,885] ERROR:init:[01]:
[2010-02-25 18:22:22,885] ERROR:init:[02]: Environment Information :
[2010-02-25 18:22:22,886] ERROR:init:[03]: System : Linux-2.6.31-19-generic-i686-with-Ubuntu-9.10-karmic
[2010-02-25 18:22:22,886] ERROR:init:[04]: OS Name : posix
[2010-02-25 18:22:22,886] ERROR:init:[05]: LSB Version: core-2.0-ia32:core-2.0-noarch:core-3.0-ia32:core-3.0-noarch:core-3.1-ia32:core-3.1-noarch:core-3.2-ia32:core-3.2-noarch:core-4.0-ia32:core-4.0-noarch:cxx-3.0-ia32:cxx-3.0-noarch:cxx-3.1-ia32:cxx-3.1-noarch:cxx-3.2-ia32:cxx-3.2-noarch:cxx-4.0-ia32:cxx-4.0-noarch:desktop-3.1-ia32:desktop-3.1-noarch:desktop-3.2-ia32:desktop-3.2-noarch:desktop-4.0-ia32:desktop-4.0-noarch:graphics-2.0-ia32:graphics-2.0-noarch:graphics-3.0-ia32:graphics-3.0-noarch:graphics-3.1-ia32:graphics-3.1-noarch:graphics-3.2-ia32:graphics-3.2-noarch:graphics-4.0-ia32:graphics-4.0-noarch:qt4-3.1-ia32:qt4-3.1-noarch
[2010-02-25 18:22:22,886] ERROR:init:[06]: Distributor ID: Ubuntu
[2010-02-25 18:22:22,886] ERROR:init:[07]: Description: Ubuntu 9.10
[2010-02-25 18:22:22,886] ERROR:init:[08]: Release: 9.10
[2010-02-25 18:22:22,886] ERROR:init:[09]: Codename: karmic
[2010-02-25 18:22:22,886] ERROR:init:[10]: Operating System Release : 2.6.31-19-generic
[2010-02-25 18:22:22,887] ERROR:init:[11]: Operating System Version : #56-Ubuntu SMP Thu Jan 28 01:26:53 UTC 2010
[2010-02-25 18:22:22,887] ERROR:init:[12]: Operating System Architecture : 32bit
[2010-02-25 18:22:22,887] ERROR:init:[13]: Operating System Locale : pt_BR.UTF8
[2010-02-25 18:22:22,887] ERROR:init:[14]: Python Version : 2.6.4
[2010-02-25 18:22:22,887] ERROR:init:[15]: OpenERP-Server Version : 5.0.7
[2010-02-25 18:22:22,887] ERROR:init:[16]: Last revision No. & ID : 1989 <email address hidden>
[2010-02-25 18:22:22,887] ERROR:init:[17]:
[2010-02-25 18:22:22,888] ERROR:init:[18]: Cannot import the line: ['cfop_1', '1000', 'ENTRADAS OU AQUISI\xc7\xd5ES DE SERVI\xc7OS DO ESTADO', '', 'Classificam-se, neste grupo, as opera\xe7\xf5es ou presta\xe7\xf5es em que o estabelecimento remetente esteja localizado na mesma unidade da Federa\xe7\xe3o do destinat\xe1rio', 'input', '']
^C[2010-02-25 18:22:26,111] ERROR:init:[01]:
[2010-02-25 18:22:26,112] ERROR:init:[02]: Environment Information :
[2010-02-25 18:22:26,112] ERROR:init:[03]: System : Linux-2.6.31-19-generic-i686-with-Ubuntu-9.10-karmic
[2010-02-25 18:22:26,112] ERROR:init:[04]: OS Name : posix
[2010-02-25 18:22:26,112] ERROR:init:[05]: LSB Version: core-2.0-ia32:core-2.0-noarch:core-3.0-ia32:core-3.0-noarch:core-3.1-ia32:core-3.1-noarch:core-3.2-ia32:core-3.2-noarch:core-4.0-ia32:core-4.0-noarch:cxx-3.0-ia32:cxx-3.0-noarch:cxx-3.1-ia32:cxx-3.1-noarch:cxx-3.2-ia32:cxx-3.2-noarch:cxx-4.0-ia32:cxx-4.0-noarch:desktop-3.1-ia32:desktop-3.1-noarch:desktop-3.2-ia32:desktop-3.2-noarch:desktop-4.0-ia32:desktop-4.0-noarch:graphics-2.0-ia32:graphics-2.0-noarch:graphics-3.0-ia32:graphics-3.0-noarch:graphics-3.1-ia32:graphics-3.1-noarch:graphics-3.2-ia32:graphics-3.2-noarch:graphics-4.0-ia32:graphics-4.0-noarch:qt4-3.1-ia32:qt4-3.1-noarch
[2010-02-25 18:22:26,112] ERROR:init:[06]: Distributor ID: Ubuntu
[2010-02-25 18:22:26,113] ERROR:init:[07]: Description: Ubuntu 9.10
[2010-02-25 18:22:26,113] ERROR:init:[08]: Release: 9.10
[2010-02-25 18:22:26,113] ERROR:init:[09]: Codename: karmic
[2010-02-25 18:22:26,113] ERROR:init:[10]: Operating System Release : 2.6.31-19-generic
[2010-02-25 18:22:26,113] ERROR:init:[11]: Operating System Version : #56-Ubuntu SMP Thu Jan 28 01:26:53 UTC 2010
[2010-02-25 18:22:26,114] ERROR:init:[12]: Operating System Architecture : 32bit
[2010-02-25 18:22:26,114] ERROR:init:[13]: Operating System Locale : pt_BR.UTF8
[2010-02-25 18:22:26,114] ERROR:init:[14]: Python Version : 2.6.4
[2010-02-25 18:22:26,114] ERROR:init:[15]: OpenERP-Server Version : 5.0.7
[2010-02-25 18:22:26,114] ERROR:init:[16]: Last revision No. & ID :
[2010-02-25 18:22:26,114] ERROR:init:[17]: Cannot import the line: ['cfop_2', '1100', 'COMPRAS PARA INDUSTRIALIZA\xc7\xc3O, PRODU\xc7\xc3O RURAL, COMERCIALIZA\xc7\xc3O OU PRESTA\xc7\xc3O DE SERVI\xc7OS', '', '', 'input', 'cfop_1']

description: updated
description: updated
summary: - Error when importing a csv file with UTF-8 characters
+ regression: Error when importing a csv file with UTF-8 characters
Revision history for this message
Raphaël Valyi - http://www.akretion.com (rvalyi) wrote :

flagging as high + 5.0.7 as this is a regression vs 5.0.6. Interestingly, trunk doesn't have the issue.

Changed in openobject-server:
importance: Undecided → High
milestone: none → 5.0.7
Revision history for this message
Sharoon Thomas http://openlabs.co.in (sharoonthomas) wrote :

Raphael,

Do you think this fix caused this issue?

https://bugs.launchpad.net/bugs/524588

Revision history for this message
gpa(OpenERP) (gpa-openerp) wrote :

Hello Renato Lima,

I have tested at my end with some non-English characters in CSV, but unfortunately could not face the error.

Moreover, I would like to request you to attach the .csv file of the module so I can test into right direction.

Thanks.

Changed in openobject-server:
assignee: nobody → gpa(Open ERP) (gpa-openerp)
Revision history for this message
Renato Lima - http://www.akretion.com (renatonlima) wrote : Re: [Bug 528039] Re: regression: Error when importing a csv file with UTF-8 characters
Download full text (5.4 KiB)

Hello GPA,

Here are the modulos I'm trying install. I don't have any problem to load
those modules in trunk version, but after update my version 5.0.7 I can't
load :(

2010/2/26 gpa(Open ERP) <email address hidden>

> Hello Renato Lima,
>
> I have tested at my end with some non-English characters in CSV, but
> unfortunately could not face the error.
>
> Moreover, I would like to request you to attach the .csv file of the
> module so I can test into right direction.
>
> Thanks.
>
>
> ** Changed in: openobject-server
> Assignee: (unassigned) => gpa(Open ERP) (gpa-openerp)
>
> --
> regression: Error when importing a csv file with UTF-8 characters
> https://bugs.launchpad.net/bugs/528039
> You received this bug notification because you are a direct subscriber
> of the bug.
>
> Status in OpenObject Server: New
>
> Bug description:
> Hi,
>
> I tried to install a module with some csv files, but some files have UTF-8.
> Never quite had this problem I think this is a regression.
>
>
> regards,
>
>
> Renato Lima
>
> [2010-02-25 18:22:11,604] INFO:init:module l10n_br_data: loading
> l10n_br.cfop.csv
> [2010-02-25 18:22:22,885] ERROR:init:[01]:
> [2010-02-25 18:22:22,885] ERROR:init:[02]: Environment Information :
> [2010-02-25 18:22:22,886] ERROR:init:[03]: System :
> Linux-2.6.31-19-generic-i686-with-Ubuntu-9.10-karmic
> [2010-02-25 18:22:22,886] ERROR:init:[04]: OS Name : posix
> [2010-02-25 18:22:22,886] ERROR:init:[05]: LSB Version:
> core-2.0-ia32:core-2.0-noarch:core-3.0-ia32:core-3.0-noarch:core-3.1-ia32:core-3.1-noarch:core-3.2-ia32:core-3.2-noarch:core-4.0-ia32:core-4.0-noarch:cxx-3.0-ia32:cxx-3.0-noarch:cxx-3.1-ia32:cxx-3.1-noarch:cxx-3.2-ia32:cxx-3.2-noarch:cxx-4.0-ia32:cxx-4.0-noarch:desktop-3.1-ia32:desktop-3.1-noarch:desktop-3.2-ia32:desktop-3.2-noarch:desktop-4.0-ia32:desktop-4.0-noarch:graphics-2.0-ia32:graphics-2.0-noarch:graphics-3.0-ia32:graphics-3.0-noarch:graphics-3.1-ia32:graphics-3.1-noarch:graphics-3.2-ia32:graphics-3.2-noarch:graphics-4.0-ia32:graphics-4.0-noarch:qt4-3.1-ia32:qt4-3.1-noarch
> [2010-02-25 18:22:22,886] ERROR:init:[06]: Distributor ID: Ubuntu
> [2010-02-25 18:22:22,886] ERROR:init:[07]: Description: Ubuntu 9.10
> [2010-02-25 18:22:22,886] ERROR:init:[08]: Release: 9.10
> [2010-02-25 18:22:22,886] ERROR:init:[09]: Codename: karmic
> [2010-02-25 18:22:22,886] ERROR:init:[10]: Operating System Release :
> 2.6.31-19-generic
> [2010-02-25 18:22:22,887] ERROR:init:[11]: Operating System Version :
> #56-Ubuntu SMP Thu Jan 28 01:26:53 UTC 2010
> [2010-02-25 18:22:22,887] ERROR:init:[12]: Operating System Architecture :
> 32bit
> [2010-02-25 18:22:22,887] ERROR:init:[13]: Operating System Locale :
> pt_BR.UTF8
> [2010-02-25 18:22:22,887] ERROR:init:[14]: Python Version : 2.6.4
> [2010-02-25 18:22:22,887] ERROR:init:[15]: OpenERP-Server Version : 5.0.7
> [2010-02-25 18:22:22,887] ERROR:init:[16]: Last revision No. & ID : 1989
> <email address hidden>
> [2010-02-25 18:22:22,887] ERROR:init:[17]:
> [2010-02-25 18:22:22,888] ERROR:init:[18]: Cannot import the line:
> ['cfop_1', '1000', 'ENTRADAS OU AQUISI\xc7\xd5ES DE SERVI\xc7OS DO ESTADO',
> '', 'Classificam-se, neste grupo, as opera\...

Read more...

Changed in openobject-server:
milestone: 5.0.7 → 5.0.8
Changed in openobject-server:
status: New → Invalid
Revision history for this message
Raphaël Valyi - http://www.akretion.com (rvalyi) wrote :

Hello folks,

I apologize for Renato here,
it turns out that this file "l10n_br_data/loading l10n_br.cfop.csv" was the only file of the Brazilian localization that was NOT ENCODED IN UTF-8. In encoded it in UTF-8 and then is passed. So, sorry, no OpenERP bug. Closing it.

Revision history for this message
Renato Lima - http://www.akretion.com (renatonlima) wrote :
Download full text (5.4 KiB)

Hello,

As Raphael said, only this file (l10n_br_cfop.cv) was not in UTF-8, but I
can loaded into the trunk version, so I thought it would be an error in
5.0.7, sorry for the invonceniencia.

Renato Lima

2010/3/1 Raphaël Valyi - http://www.akretion.com <email address hidden>

> Hello folks,
>
> I apologize for Renato here,
> it turns out that this file "l10n_br_data/loading l10n_br.cfop.csv" was the
> only file of the Brazilian localization that was NOT ENCODED IN UTF-8. In
> encoded it in UTF-8 and then is passed. So, sorry, no OpenERP bug. Closing
> it.
>
> --
> regression: Error when importing a csv file with UTF-8 characters
> https://bugs.launchpad.net/bugs/528039
> You received this bug notification because you are a direct subscriber
> of the bug.
>
> Status in OpenObject Server: Invalid
>
> Bug description:
> Hi,
>
> I tried to install a module with some csv files, but some files have UTF-8.
> Never quite had this problem I think this is a regression.
>
>
> regards,
>
>
> Renato Lima
>
> [2010-02-25 18:22:11,604] INFO:init:module l10n_br_data: loading
> l10n_br.cfop.csv
> [2010-02-25 18:22:22,885] ERROR:init:[01]:
> [2010-02-25 18:22:22,885] ERROR:init:[02]: Environment Information :
> [2010-02-25 18:22:22,886] ERROR:init:[03]: System :
> Linux-2.6.31-19-generic-i686-with-Ubuntu-9.10-karmic
> [2010-02-25 18:22:22,886] ERROR:init:[04]: OS Name : posix
> [2010-02-25 18:22:22,886] ERROR:init:[05]: LSB Version:
> core-2.0-ia32:core-2.0-noarch:core-3.0-ia32:core-3.0-noarch:core-3.1-ia32:core-3.1-noarch:core-3.2-ia32:core-3.2-noarch:core-4.0-ia32:core-4.0-noarch:cxx-3.0-ia32:cxx-3.0-noarch:cxx-3.1-ia32:cxx-3.1-noarch:cxx-3.2-ia32:cxx-3.2-noarch:cxx-4.0-ia32:cxx-4.0-noarch:desktop-3.1-ia32:desktop-3.1-noarch:desktop-3.2-ia32:desktop-3.2-noarch:desktop-4.0-ia32:desktop-4.0-noarch:graphics-2.0-ia32:graphics-2.0-noarch:graphics-3.0-ia32:graphics-3.0-noarch:graphics-3.1-ia32:graphics-3.1-noarch:graphics-3.2-ia32:graphics-3.2-noarch:graphics-4.0-ia32:graphics-4.0-noarch:qt4-3.1-ia32:qt4-3.1-noarch
> [2010-02-25 18:22:22,886] ERROR:init:[06]: Distributor ID: Ubuntu
> [2010-02-25 18:22:22,886] ERROR:init:[07]: Description: Ubuntu 9.10
> [2010-02-25 18:22:22,886] ERROR:init:[08]: Release: 9.10
> [2010-02-25 18:22:22,886] ERROR:init:[09]: Codename: karmic
> [2010-02-25 18:22:22,886] ERROR:init:[10]: Operating System Release :
> 2.6.31-19-generic
> [2010-02-25 18:22:22,887] ERROR:init:[11]: Operating System Version :
> #56-Ubuntu SMP Thu Jan 28 01:26:53 UTC 2010
> [2010-02-25 18:22:22,887] ERROR:init:[12]: Operating System Architecture :
> 32bit
> [2010-02-25 18:22:22,887] ERROR:init:[13]: Operating System Locale :
> pt_BR.UTF8
> [2010-02-25 18:22:22,887] ERROR:init:[14]: Python Version : 2.6.4
> [2010-02-25 18:22:22,887] ERROR:init:[15]: OpenERP-Server Version : 5.0.7
> [2010-02-25 18:22:22,887] ERROR:init:[16]: Last revision No. & ID : 1989
> <email address hidden>
> [2010-02-25 18:22:22,887] ERROR:init:[17]:
> [2010-02-25 18:22:22,888] ERROR:init:[18]: Cannot import the line:
> ['cfop_1', '1000', 'ENTRADAS OU AQUISI\xc7\xd5ES DE SERVI\xc7OS DO ESTADO',
> '', 'Classificam-se, neste grupo, as opera\xe7\xf5es ou pre...

Read more...

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Bug attachments

Remote bug watches

Bug watches keep track of this bug in other bug trackers.