The Global Entrepreneurship Monitor has data and reports on entrepreneurship in 42 countries, some dating as far back as 1999. Click on 'Data' or 'Reports' in the navigation menu near the top of the page.

Also consider using IMD's World Competitiveness Yearbook 337.021 W893 to view rankings of entrepreneurship by country from 1996 to 2011.