US Census Bureau Economic Programs includes the following:
Federal Statistical Agencies
Links to all federal statistics agencies, eg. Census of Agriculture, Health statistics, Crime statistics, etc.
Data.gov - Search across all federal statistical agency datasets.
Statistical Abstracts from 1879-2010 available here.
Links to Statistical Agencies (US agencies, national agencies of other countries, and International)