My hypothesis that this happens only for MP4 media with audio in stream#0 is incorrect: I took a file that does not play with audio in stream#0 and video in stream#1 and reverted the order of the streams with MP4Box and totem still fails to play the file.
My hypothesis that this happens only for MP4 media with audio in stream#0 is incorrect: I took a file that does not play with audio in stream#0 and video in stream#1 and reverted the order of the streams with MP4Box and totem still fails to play the file.