src info (and some other) wrong in pear -tests packages

[Elan Ruusamäe]

it reports wrong src.rpm package, it really should be:
php-pear-Contact_Vcard_Parse-1.31.0-2.src.rpm
not:
php-pear-Contact_Vcard_Parse-tests-1.31.0-2.src.rpm

even changelog seems empty (works ok for other packages)

poldek:/all-avail> desc php-pear-Contact_Vcard_Parse-tests
Package: php-pear-Contact_Vcard_Parse-tests-1.31.0-2.noarch
Summary: Tests for PEAR::Contact_Vcard_Parse
Group: Development/Languages/PHP
Vendor: PLD
License: PHP 2.02
Arch/OS: noarch/linux
URL: http://pear.php.net/package/Contact_Vcard_Parse/
Built: 2008/01/31 15:03 at athlon.th.pld-linux.org
Size: 0.0 KB (620 B)
Package size: 4.0 KB (4437 B)
Path: ftp://ftp1.pld-linux.org/dists/th/PLD/noarch/RPMS
Source package: php-pear-Contact_Vcard_Parse-tests-1.31.0-2.src.rpm
File: php-pear-Contact_Vcard_Parse-tests-1.31.0-2.noarch.rpm
Description:
Tests for PEAR::Contact_Vcard_Parse.

poldek:/all-avail> desc --log php-pear-Contact_Vcard_Parse-tests

Package: php-pear-Contact_Vcard_Parse-tests-1.31.0-2.noarch
poldek:/all-avail>

poldek:/all-avail> desc --log php-pear

Package: php-pear-1.3-3.noarch
Changelog:
* r1.55 2010/07/20 07:25:27 glen
- BR PEAR 1.9.0

[Elan Ruusamäe (glen666)]

list of packages (from th) which suffer same problem (checked only few random)

php-pear-Auth_HTTP-tests
php-pear-Auth_PrefManager-tests
php-pear-Auth-tests
php-pear-Config-tests
php-pear-Console_Getargs-tests
php-pear-Contact_Vcard_Build-tests
php-pear-Contact_Vcard_Parse-tests
php-pear-Crypt_Blowfish-tests
php-pear-Crypt_DiffieHellman-tests
php-pear-Crypt_HMAC-tests
php-pear-Crypt_MicroID-tests
php-pear-Crypt_Xtea-tests
php-pear-Crypt_XXTEA-tests
php-pear-Date-tests
php-pear-DBA_Relational-tests
php-pear-DBA-tests
php-pear-DB_ldap2-tests
php-pear-DB_NestedSet-tests
php-pear-DB_QueryTool-tests
php-pear-DB-tests
php-pear-Event_Dispatcher-tests
php-pear-File_Archive-tests
php-pear-File_Bittorrent-tests
php-pear-File_Find-tests
php-pear-File_Fortune-tests
php-pear-File_HtAccess-tests
php-pear-File_SearchReplace-tests
php-pear-File_Sitemap-tests
php-pear-File-tests
php-pear-FSM-tests
php-pear-Games_Chess-tests
php-pear-Gtk2_IndexedComboBox-tests
php-pear-Gtk_FileDrop-tests
php-pear-Gtk_ScrollingLabel-tests
php-pear-HTML_AJAX-tests
php-pear-HTML_BBCodeParser-tests
php-pear-HTML_Common2-tests
php-pear-HTML_Entities-tests
php-pear-HTML_Form-tests
php-pear-HTML_Javascript-tests
php-pear-HTML_QuickForm2-tests
php-pear-HTML_QuickForm_Livesearch-tests
php-pear-HTML_Table-tests
php-pear-HTML_Template_Flexy-tests
php-pear-HTML_Template_IT-tests
php-pear-HTTP_Download-tests
php-pear-HTTP_Header-tests
php-pear-HTTP_Session2-tests
php-pear-HTTP_Session-tests
php-pear-I18N_UnicodeNormalizer-tests
php-pear-I18Nv2-tests
php-pear-Image_Canvas-tests
php-pear-Image_Graph-tests
php-pear-Image_Text-tests
php-pear-JSON-tests
php-pear-Mail_Mbox-tests
php-pear-Mail_mimeDecode-tests
php-pear-Mail-tests
php-pear-Math_Basex-tests
php-pear-Math_Combinatorics-tests
php-pear-Math_Complex-tests
php-pear-Math_Fibonacci-tests
php-pear-Math_Integer-tests
php-pear-Math_Matrix-tests
php-pear-Math_Polynomial-tests
php-pear-Math_Quaternion-tests
php-pear-Math_Stats-tests
php-pear-Math_Vector-tests
php-pear-MDB2_Driver_ibase-tests
php-pear-MDB2_Driver_mssql-tests
php-pear-MDB2_Driver_mysqli-tests
php-pear-MDB2_Driver_mysql-tests
php-pear-MDB2_Driver_pgsql-tests
php-pear-MDB2_Driver_querysim-tests
php-pear-MDB2_Driver_sqlite-tests
php-pear-MDB2-tests
php-pear-MDB_QueryTool-tests
php-pear-MDB-tests
php-pear-MP3_Playlist-tests
php-pear-Net_CDDB-tests
php-pear-Net_CheckIP2-tests
php-pear-Net_Cyrus-tests
php-pear-Net_FTP-tests
php-pear-Net_HL7-tests
php-pear-Net_IDNA-tests
php-pear-Net_LMTP-tests
php-pear-Net_Monitor-tests
php-pear-Net_POP3-tests
php-pear-Net_Sieve-tests
php-pear-Net_URL_Mapper-tests
php-pear-Net_UserAgent_Mobile-tests
php-pear-Net_Wifi-tests
php-pear-Numbers_Roman-tests
php-pear-PEAR_PackageFileManager-tests
php-pear-PHP_Archive-tests
php-pear-PHP_ArrayOf-tests
php-pear-PHP_Compat-tests
php-pear-PHP_DocBlockGenerator-tests
php-pear-PHP_FunctionCallTracer-tests
php-pear-PHP_LexerGenerator-tests
php-pear-PHP_Parser-tests
php-pear-PHP_Shell-tests
php-pear-PHPUnit2-tests
php-pear-QA_Peardoc_Coverage-tests
php-pear-Science_Chemistry-tests
php-pear-Services_Akismet-tests
php-pear-Services_Ebay-tests
php-pear-Services_TinyURL-tests
php-pear-Services_urlTea-tests
php-pear-Ser...

[Elan Ruusamäe (glen666)]

one more package which src rpm is wrong and changelog missing.
this one does not match php-pear-*-tests pattern

poldek:/all-avail> desc -a php-pear-Auth_Container_ADOdb
Package: php-pear-Auth_Container_ADOdb-4.96-a.0.1.noarch
Summary: ADOdb container for PEAR Auth
Group: Development/Languages/PHP
License: dual licensed using BSD-Style and LGPL
Arch/OS: noarch/linux
URL: http://adodb.sourceforge.net/
Built: 2008/01/27 18:20 at th-i486.th.pld-linux.org
Size: 12.0 KB (12649 B)
Package size: 7.0 KB (7864 B)
Path: ftp://ftp1.pld-linux.org/dists/th/PLD/noarch/RPMS
Source package: php-pear-Auth_Container_ADOdb-4.96-a.0.1.src.rpm
File: php-pear-Auth_Container_ADOdb-4.96-a.0.1.noarch.rpm
Requires: adodb = 4.96-a.0.1, adodb-pear, php-pear-Auth
Requires(rpm): rpmlib(PayloadIsLzma) <= 4.4.6-1
Requires(dir): /usr/share/doc, /usr/share/pear/Auth/Container
Required(pkgs): FHS, adodb, adodb-pear, php-pear-Auth
Description:
Storage driver for fetching login data from a database using
ADOdb-PHP.

This storage driver can use all databases which are supported by the
ADOdb DB abstraction layer to fetch login data.
/usr/share/doc/php-pear-Auth_Container_ADOdb-4.96: README.gz
/usr/share/pear/Auth/Container: ADOdb.php
poldek:/all-avail>

[Cactus (uzi18)]

in facts our rpm/builder adds log to all subpackages but poldek shows logs only for "main" package
i think to disable this behavior and to show this data for all
e.g. there is no qt4-nvr.arch package but poldek hints to check log on this package

poldek:/all-avail> desc --log QtCore-4.6.3-1.i686

Package: QtCore-4.6.3-1.i686
Changelog:
* 2010-08-13 07:52:34 <email address hidden>
- see qt4-4.6.3-1's log

poldek:/all-avail> desc --log qt4-4.6.3-1.i686
error: qt4-4.6.3-1.i686: no such package

And for Your problem maybe it is because of "_" char ?

[Cactus (uzi18)]

poldek:/all-avail> desc php-pear-Contact_Vcard_Parse-tests-1.32.0-1.noarch

Package: php-pear-Contact_Vcard_Parse-tests-1.32.0-1.noarch
Summary: Testy dla PEAR::Contact_Vcard_Parse
Group: Development/Languages/PHP
License: PHP 2.02
Arch/OS: noarch/linux
URL: http://pear.php.net/package/Contact_Vcard_Parse/
Built: 2010/08/19 21:01 at ymir-builder
Size: 8.0 KB (8882 B)
Package size: 6.0 KB (6570 B)
Path: ftp://ftp.th.pld-linux.org/dists/th/PLD/noarch/RPMS
Source package: php-pear-Contact_Vcard_Parse-1.32.0-1.src.rpm
File: php-pear-Contact_Vcard_Parse-tests-1.32.0-1.noarch.rpm
Description:
Testy dla PEAR::Contact_Vcard_Parse.
poldek:/all-avail> desc --log php-pear-Contact_Vcard_Parse-tests-1.32.0-1.noarch

Package: php-pear-Contact_Vcard_Parse-tests-1.32.0-1.noarch
Changelog:
* 2010-08-27 08:28:11 <email address hidden>
- see php-pear-Contact_Vcard_Parse-1.32.0-1's log

[Elan Ruusamäe (glen666)]

ok, "php-pear-Contact_Vcard_Parse-tests" is bad test now, as seems package upgrade on th has corrected the poldek breakage.

so i'm taking next package that is still broken. seems first in the list matches already

note that "desc --log" shows NOTHING here, like in initial bugreport.

1: (NO CHANGELOG):
poldek:/all-avail> desc --log php-pear-Auth_HTTP-tests
Package: php-pear-Auth_HTTP-tests-2.1.6-3.noarch

2: (CHANGELOG OK ON UPGRADED PKG):
poldek:/all-avail> desc --log php-pear-Contact_Vcard_Parse-tests
Package: php-pear-Contact_Vcard_Parse-tests-1.32.0-1.noarch
Changelog:
* 2010-08-27 08:28:12 <email address hidden>
- see php-pear-Contact_Vcard_Parse-1.32.0-1's log

[Elan Ruusamäe (glen666)]

> And for Your problem maybe it is because of "_" char ?

no, this can't be. look at the symptoms.
why some other -test packages do not suffer it? and why one package got ok after it got rebuilt?

please note that all info seems missing or garbled for few packages i noted (easily testable by checking by missing changelog info).

and yes, seems poldek saves some indexes space by not duplicating changelog of packages built from same .spec, and qt4.spec is one example which lacks totally main package, has only subpackages. ideally implemented it should keep separate index for all spec files (src.rpm packages) changelog, and reading it inline (injecting to place), not telling in text what other package changelog to read (to make it transparent to user and perhaps packagekit), i.e if that compressing on indexes is really wanted.

[Elan Ruusamäe (glen666)]

could this be due poldek index being generated with older poldek. i.e at the time src.rpm information was not stored in packages.ndir, and since then the package has not been rebuilt (updated), meaning the package info is copied to new packages.ndir?

for example if i look "desc" on ac, i see that pkg in ac-main does not have that source rpm info at all:

Package: php-pear-1.0-15.noarch
Summary: PEAR - PHP Extension and Application Repository
Group: Development/Languages/PHP
License: Public Domain
Arch/OS: noarch/linux
Built: 2006/11/08 15:15 at minerva
Size: 0.0 KB (0 B)
Package size: 7.0 KB (7350 B)
Path: ftp://ftp4.pld-linux.org/dists/ac/PLD/amd64/PLD/RPMS
File: php-pear-1.0-15.noarch.rpm
Epoch: 4
Description:
PEAR - PHP Extension and Application Repository.

Please note that this package provides only basic directory structure.
If you want to use base PEAR classes (PEAR.php, PEAR/*.php), that come
with PHP, please install appropriate php-pear-* (php-pear-PEAR,
php-PEAR-Archive_Tar, etc) packages.

Package: php-pear-1.3.1-1.noarch
Summary: PEAR - PHP Extension and Application Repository
Group: Development/Languages/PHP
License: Public Domain
Arch/OS: noarch/linux
Built: 2010/09/01 11:36 at pldac-atlas
Size: 7.0 KB (7567 B)
Package size: 12.0 KB (12842 B)
Path: ftp://ftp4.pld-linux.org/dists/ac/updates/amd64
Source package: php-pear-1.3.1-1.src.rpm
File: php-pear-1.3.1-1.noarch.rpm
Epoch: 4
Description:
PEAR - PHP Extension and Application Repository.

Please note that this package provides only basic directory structure.
If you want to use base PEAR classes (PEAR.php, PEAR/*.php), that come
with PHP, please install appropriate php-pear-* (php-pear-PEAR,
php-PEAR-Archive_Tar, etc) packages.

[Elan Ruusamäe (glen666)]

yep, seems a fix would be to remove old packages.* and regenerate from scratch for all packages, as the source rpm package info was added later than the packages built.

pay attention to "Source package" value in "desc" output.

ORIGINAL FTP INDEXES:

# poldek -s .
poldek:/all-avail> desc php-pear-Structures_BibTex-tests
Package: php-pear-Structures_BibTex-tests-1.0.0-RC4.2.noarch
Summary: Tests for PEAR::Structures_BibTex
Group: Development/Languages/PHP
License: PHP License
Arch/OS: noarch/linux
URL: http://pear.php.net/package/Structures_BibTex/
Built: 2008/01/31 15:43 at th-i486.th.pld-linux.org
Size: 33.0 KB (34815 B)
Package size: 7.0 KB (7171 B)
Path: /www/rpm/public/pld/dists/th/PLD/noarch/RPMS
Source package: php-pear-Structures_BibTex-tests-1.0.0-RC4.2.src.rpm
File: php-pear-Structures_BibTex-tests-1.0.0-RC4.2.noarch.rpm
Description:
Tests for PEAR::Structures_BibTex.

REGENERATED INDEX FROM SCRATCH

# (rm -rf packages.*;umask 2;poldek --mkidx -s `pwd`/ --mt=pndir)
Creating pndir index of /www/rpm/public/pld/dists/th/PLD/noarch/RPMS/ (type=dir)...
Loading [dir]/www/rpm/public/pld/dists/th/PLD/noarch/RPMS/...
200..400..600..800..1000..1200..1400..1600..1800..2000..2200..2400..2600..2800..3000..3200..3400..3600..3800..4000..4200..4400..4600..4694
Writing /www/rpm/public/pld/dists/th/PLD/noarch/RPMS/packages.ndir.gz...
15:47:03 root[load: 1.42]@distrib noarch/RPMS#
15:47:03 root[load: 1.42]@distrib noarch/RPMS# poldek -s .
poldek:/all-avail> desc php-pear-Structures_BibTex-tests

Package: php-pear-Structures_BibTex-tests-1.0.0-RC4.2.noarch
Summary: Tests for PEAR::Structures_BibTex
Group: Development/Languages/PHP
License: PHP License
Arch/OS: noarch/linux
URL: http://pear.php.net/package/Structures_BibTex/
Built: 2008/01/31 15:43 at th-i486.th.pld-linux.org
Size: 33.0 KB (34815 B)
Package size: 7.0 KB (7171 B)
Path: /www/rpm/public/pld/dists/th/PLD/noarch/RPMS
Source package: php-pear-Structures_BibTex-1.0.0-RC4.2.src.rpm
File: php-pear-Structures_BibTex-tests-1.0.0-RC4.2.noarch.rpm
Description:
Tests for PEAR::Structures_BibTex.
poldek:/all-avail>

[Elan Ruusamäe (glen666)]

cleanup done for PLD th main:

pldth@ep09-pld ~/ftp/PLD$ find -name packages.ndir.md
./i486/RPMS/packages.ndir.md
./i486/debuginfo/packages.ndir.md
./i686/RPMS/packages.ndir.md
./i686/debuginfo/packages.ndir.md
./noarch/RPMS/packages.ndir.md
./x86_64/RPMS/packages.ndir.md
./x86_64/debuginfo/packages.ndir.md

pldth@ep09-pld ~/ftp/PLD$ tar --remove-files -cf old-indexes-620362.tar */RPMS/packages.* */debuginfo/packages.*

pldth@ep09-pld ~/ftp/PLD$ gen-indexes --noyum PLD

[Elan Ruusamäe (glen666)]

pld th main repo indexes cleaned, no point dealing with old poldek indexes problems.

[Elan Ruusamäe (glen666)]

indexes from older poldek can't be solved other than regenerating them