How to Remember Your History