An Eligible Employer should keep all records of employment taxes for at least 4 years after the date the tax becomes due or is paid, whichever comes later. These should be available for IRS review.