The Screaming Frog's SEO Spider is a website spider that can help you improve your onsite SEO by extracting data and auditing for common issues. You can download and crawl 500 URLs free of charge, or you can purchase a license to unlock advanced features and remove the limit. The SEO Spider is a flexible and powerful site crawler that can crawl small and large websites quickly and allows you to analyze the results in real time. It collects key information on the site to help SEOs make informed decisions. Instantly crawl a website and identify broken links (404s), and server errors. Bulk exports the errors and source URLs to fix or send to a developer. Locate temporary and permanent redirects, identify loops and redirect chains, and upload a list to review during a site migration. Analyze page titles, meta descriptions, and other information during a crawl to identify duplicates or pages that are too long, too short, missing, not present, or duplicated throughout your site.