A cursory look into KDE 4 file management: Dolphin beta » Dolphin showing previews of media files
Here’s Dolphin showing a folder with a few media files. You’ll notice that the videos don’t show any previews — I expect that functionality (seen in Nautilus first) to come later.
