Undo/Redo breaks after some time

After some time doing undo and redo, it does not work correctly anymore. It deletes tiles that weren't effected, places them wrong, or just does nothing until later.