It turns out we were only notifying plugins of freezer commits and cleaning up our record when the block being processed was greater than MAX_UINT64. So, uh, never.