Syncing and merging X.org 7.2

[Timo Aaltonen]

Binary package hint: xorg

This bug is meant for monitoring the process of getting X.org 7.2 in Ubuntu for Feisty Fawn.

Where do we stand:
-Debian has published some packages to experimental
-I have synced those and merged some which need merging (epoch, patches etc), and built them in correct order
-it is also running on my desktop (XP3000+, Radeon 8500), and I've built gtk+2.0 against the new libs to make sure it doesn't have showstoppers (could build more). Tonight I'll install the packages on my laptop.
-it is also a lot less fragile on my Radeon than the previous version. I can crash it using compiz, but now I'm testing a new version of xorg-server which has dropped a few of the 3rd party (Fedora) patches we used to have. So far it is looking better

The current list of packages (updated when needed) and their versions is being held at

http://users.tkk.fi/~tjaalton/xorg72/xorg-list

Where to go from here? I think that most of the libraries/apps are trivial and can be uploaded/synced, and if the intent is to get X.org 7.2 in feisty, we can start by uploading those in this order:

* proto:
x11proto-core SYNC
x11proto-damage SYNC
x11proto-input SYNC
x11proto-randr SYNC
xcb-proto SYNC

* lib:
libfontenc SYNC
xtrans
libice
libxau SYNC
libxdmcp
libxfont
libxcb SYNC
libsm MERGE

after those are done, libx11 needs to get in (according to my dependancy-calculations anyway :). It needs a better review of things that might break. After that is done:

libxext
libxevie
libxfixes
libxfontcache
libxdamage
libxcomposite
libxrender

Then comes libxft, which is xft in Debian (probably a good time to change the name as well). This should be a simple sync, and I discussed with Tollef about this issue:
http://lists.debian.org/debian-x/2007/02/msg01195.html
and we came to the conclusion that it should not pose a problem. Let's move on:

libxi MERGE
libxkbfile
libxrandr
libxres
libxt
libxpm
libxmu MERGE
libxv MERGE
libxvmc MERGE
libxaw MERGE
libxcursor
libxss

After those, we need to sort out mesa & libdrm. Mesa-packaging has improved a lot, and it uses quilt now, so while I'm pretty confident that it would work right, maybe a reviewer might see some issues with it. libdrm can be synced.

Then comes xorg-server. Currently it works for me, but the 3rd party patches need to be checked and dropped if needed. Michel Dänzer replied to the list that I sent to debian-x:

http://lists.debian.org/debian-x/2007/02/msg01303.html

and I have a new version which has dropped 107, 108 and 110. So far it feels more robust with compiz than before, so maybe they should be dropped as advised.

After xorg-server is sorted, we can push the apps:

appres
beforelight
editres
fonttosfnt
luit
sessreg
twm
xauth
xdm SYNC
xf86dga
xfs
xinit
xmodmap

and by now we can hopefully just sync the drivers from experimental :)

[Timo Aaltonen (tjaalton)]

gzipped debdiffs are now available.. they took too much space so had to pack them :)

[Timo Aaltonen (tjaalton)]

..and they are here:

http://users.tkk.fi/~tjaalton/xorg72/

libpthread-stubs was already uploaded, so I'll assume that xcb-proto and libxcb will follow

[Timo Aaltonen (tjaalton)]

my hands obviously work faster than my head, so.. the debdiffs are in the source-directory. They were generated by a for-loop, so errors could occur.

[Julien Lavergne (gilir)]

Working well here :) Fantastic work :)

X Window System Version 7.2.0
Release Date: 22 January 2007
X Protocol Version 11, Revision 0, Release 7.2
Build Operating System: UNKNOWN
Current Operating System: Linux blitz 2.6.20-6-generic #2 SMP Wed Jan 31 20:53:39 UTC 2007 i686
Build Date: 10 February 2007

X work, but there are some packages problems after installing; Synaptic want to update :
libxi6 : 1:1.1.0-1ubuntu1 installing, 2:1.0.1-0ubuntu1 in the repo
libxaw : 1:1.0.3-1ubuntu1 installing, 2:1.0.2-ubuntu1 in the repo

Some minor problems with packages names ;)

[Timo Aaltonen (tjaalton)]

ah, that means I've forgot to bump the epoch, strange.. I'll fix it.

[Lukas Fittl (lfittl)]

I requested the sync for libpthread-stubs, and I also wanted to request libxcb, but I realized later that would take more work, and unfortunately I don't know X well enough. I will try to help with testing, and thanks for the important work.

[Che Guevara (che-guevara-3)]

http://xorg.freedesktop.org/wiki/ModuleVersionsInXorgReleases

This might come useful
Good luck and thanks for all your work

[Florent Mertens (givre)]

I just give it a try on my i855, and i must say that i'm really impress.
You did a great job Timo.

The only little problem i get was that i had to manually enable the composite extension in xorg.conf, it was default before.

Other than that, it work great :)

[Michael Biebl (mbiebl)]

Do you consider to push the changes back to Debian experimental?
Why not work directly with the XSF to avoid duplicate work and have benefit for all?

[Timo Aaltonen (tjaalton)]

Michael: we are doing that as we speak :) I'm coordinating this with Julien Cristau.

[Michael Biebl (mbiebl)]

Awesome, that's really good news.

Keep up the good work!

[Guillaume Martres (smarter)]

I've added your repository but some packages are not found:
Err http://users.tkk.fi feisty/xorg-test libice-dev 2:1.0.3-1ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libice6 2:1.0.3-1ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libsm-dev 2:1.0.2-1ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libsm6 2:1.0.2-1ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libpthread-stubs0 0.1-1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libpthread-stubs0-dev 0.1-1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxmu-headers 2:1.0.3-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxrender-dev 1:0.9.2-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxrender1 1:0.9.2-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxrandr-dev 2:1.1.2-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxrandr2 2:1.1.2-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxkbfile1 1:1.0.4-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxmu-dev 2:1.0.3-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxmu6 2:1.0.3-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxmuu1 2:1.0.3-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxres1 2:1.0.3-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxss1 1:1.1.2-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxv1 2:1.0.3-0ubuntu1
  404 Not Found
Err http://users.tkk.fi feisty/xorg-test libxvmc1 2:1.0.4-0ubuntu1
  404 Not Found
E: Failed to fetch http://users.tkk.fi/~tjaalton/xorg72/pool/feisty/xorg-test/libice-dev_1.0.3-1ubuntu1_i386.deb: 404 Not Found

Anyway it works, but I have a problem with Beryl: there's no highlight of the entry I'm selecting with the mouse in the menu

Thanks for your work and sorry for my english.

[Timo Aaltonen (tjaalton)]

yes, sorry about that. I removed packages when they were uploaded to feisty (or not), but forgot to update the repo. It's uptodate now.

note: you need to manually update some of the packages, since the ones that have an epoch set, are versioned like -Xbuild1 in feisty, not -Xubuntu1 like on my repo. But you knew that already ;)

[magilus (magilus)]

Means that we get Xorg 7.2 in Feisty? Great! Thanks Timo for your work on this :-)

[Mikael Nilsson (mini)]

Tried your repository, but the X server did not start, complaining about a missing "fixed" font. Downgrading xserver-xorg-core to the 1.1.1 version helped. Wonder what went wrong...

[Mikael Nilsson (mini)]

On mån, 2007-02-19 at 10:18 +0000, Mikael Nilsson wrote:
> Tried your repository, but the X server did not start, complaining about
> a missing "fixed" font. Downgrading xserver-xorg-core to the 1.1.1
> version helped. Wonder what went wrong...

Solved it... it seems the new xorg does not automatically add the right
FontPath elements. And I had the old

/usr/share/X11/fonts/...

Changing that to

/usr/share/fonts/X11/...

solved it, now running 7.2!

The old version looked in both places.

[Florian Zeitz (florian-zeitz)]

This packages seem to work good for me, but the minimize animation is very slow.
This has also been reported by some people on the forums:
http://www.ubuntuforums.org/showpost.php?p=2174720&postcount=74
This is with a GeForce FX 5600 using the proprietary drivers, with one LCD monitor.
I don't know whether to blame that on the proprietary driver or X.org 7.2...

[Christof Krüger (christofkr)]

Hi, I'm the one who posted the confirmation you are linking to in your post. I've just tested it with the xorg nv drivers. It's still there so it has nothing to do with the proprietary driver.

While the minimize animation is in progress, the mouse is sluggish and is "jumping". The animation does not last very long but this jumping is quite annoying because it let's me think that something's wrong with my pc.

Other than that, I've had no problems with the installation.

I can also confirm that there are some dependency problems in the packages. I can't install several development packages:

The following packages have unmet dependencies:
  libx11-dev: Depends: libxcb-xlib0-dev but it is not installable

[Timo Aaltonen (tjaalton)]

libxcb should be fine by now, and mesa & libx11 is on the way to feisty.

Right now I'd like you to test the new xorg meta-packages.. 7.2-0ubuntu0.2 is on my repository, and it should fix the font paths (among others) on upgrade (comparing the new version to the old, and if the old is <= 1:7.2 fix them)

So, if you have any issues with it, post them here. This should go with xorg-server, so until this is in a good shape xorg-server can't get in.

[Conn O Griofa (psyke83)]

Timo,

Your packages include mesa 6.5.2, however you're missing the updated drm kernel modules, which I assume are necessary for proper usage and performance. Will you be providing them in your repository, or will they only appear if these packages are accepted into feisty's main repository?

[Conn O Griofa (psyke83)]

Timo,

In addition to drm kernel modules (drm.ko, i810.ko, etc.), you will need to implement the linux-agp-compat version of agpgart.ko into Ubuntu's linux-image-`uname -r` packages. You also need to sync to the latest drivers. The relevant files are here (or else available elsewhere via source tarballs):

git-clone git://anongit.freedesktop.org/git/mesa/drm
(You need to build new kernel modules, available in drm/linux-core/)

git-clone git://anongit.freedesktop.org/git/mesa/linux-agp-compat
(This is necessary for mesa 6.5.2, and Ubuntu needs to have Module.symvers updated or else removed, to allow the new drm module to load properly)

With all your new packages installed, glxgears gives ~550fps, ppracer is jerky and runs at 19fps, and with the new modules and i810 driver custom built, I get ~770fps (using the i915_tex driver) and a smooth 40fps in ppracer (my system: Inspiron 510m, Intel 855GM, screen resolution 1024x768@24bit, 60Hz).

[Timo Aaltonen (tjaalton)]

Conn, I've taken this to the kernel folks. My ATI works better than ever, though, so maybe it is an issue with Intel only?

[Nicolò Chieffo (yelo3)]

My ati 9700 works better than before! but it's not optimal if using compiz... something is slower than metacity!
and I'm not able to use EXA. if I enable it my cpu is 100% used

[none (ubuntu-bugs-nullinfinity-deactivatedaccount)]

It's not just Intel, some types of repainting are very slow for me with an ATI Xpress 200M, fglrx driver, amd64. In particular, some elements in Amarok (like the Collection tab) take literally seconds to update, where before they were pretty much instantaneous.

Also, compiz doesn't work anymore...

[Conn O Griofa (psyke83)]

Hi Johan,

You're using the fglrx driver which is only supported up to Xorg 7.1; the onus is on ATI/AMD to ensure their drivers are compatible with newer versions of Xorg.

The Intel drivers are open source and thus part of Xorg/Mesa, and in the case of Feisty (and Timo's temporary repository), not all the elements are up-to-date (the new agpgart & kernel modules, and drivers). You should try the "radeon" driver to see how performance is, but at the moment Feisty is using a mish-mash of Xorg modules (the core is updated, but not the drivers or kernel modules).

Maybe you could try reporting the bug to AMD if you still have the problem (after everything is updated properly).

[Timo Aaltonen (tjaalton)]

Hi again.. xorg-server-1.2.0 is about to be uploaded to feisty, and with composite turned on by default like it was before.. I made a mistake by dropping a patch which turned COMPOSITE on by default. Sorry for the mess.

thanks for testing btw, this bug can soon be closed :)

[Conn O Griofa (psyke83)]

Hi,

xorg-server-1.2.0 that landed in main is causing problems on my system identical to Johan's report above; primarily slow repainting while minimizing windows.

On a different note, I found that I can restore 3D performance on my 855GM by setting the variable INTEL_BATCH=1, the slowness is a known issue stemming from the inclusion of RandR support (and this variable enables the old, faster & non-RandR compatible behaviour).

Timo, I suppose that the new drm, agpgart etc. modules won't be necessary unless the devs want to include support for the new i915_tex driver (which is buggy at the moment, but surely will improve). I would imagine the other card's drivers will be migrating to the new memory management framework too...

[Timo Aaltonen (tjaalton)]

I'll close this one now, since 7.2 is in feisty. Thanks for all the testing, and keep on reporting bugs (and fixing them) :)