Can one tell, just by looking at a picture, if it's a sunset or a sunrise?

I was wondering, is there any inherent difference between a still of a sunset and one of a sunrise, if you have no further context?

That is, without knowing the time when the picture was taken, where in the world it was, which way the photographer was facing etc. Just from elements in the picture itself. Is it possible to tell the difference?

For instance, if the earth rotated a lot faster, I assume you would be able to tell by the light trail (or, of course, if it was a long exposure photograph).

Ideas?