For a quick look in-game, use <Ctrl><F8> to get a frame rate displayed near the top-center of the screen. It tries to do "real-time", and therefore will lead to an almost unreadable numbering though. As far as I know, it does not have a "hold" for lowest or highest, much less an average... But it can give you a rough idea.
