Comment 2 for bug 698827

IMO, the biggest obstacle is decent 3D models for various components, along with data which matches the orientation and datum to those used on PCB. (Bonus points would be available later for adding enough surface datum information to automagically texture map components with text or coloured stripes derived from the BOM ;).

If you just wanted a 3D model of the board, that could be done, but I expect you want components too.