What is domain_scraper?

domain_scraper is a tool that scans websites to find three things: email addresses, social media links, and broken links. You give it a website URL or a list of URLs, and it crawls through the pages to collect contact information and flag any links that lead nowhere. The results are saved to a file so you end up with a clean list of emails and social media profiles. At a high level, the tool works by visiting the URLs you provide and reading through the page content. When running a full scan, it automatically checks common pages like "contact" and "team" sections, since those are where contact details typically live. It then adds those pages to its queue and keeps going, building out a broader picture of the site's contact footprint. For broken link checking, it tests every link on the page and reports which ones fail to load. The people who would get the most out of this are sales professionals, recruiters, or marketers building contact lists. If you have a spreadsheet of company websites and need to find the right email addresses or social media accounts to reach out to, this tool automates that tedious manual work. It is also useful for website owners or SEO specialists who want to audit their own sites for broken links that could hurt search rankings or frustrate visitors. One practical detail worth noting is how the tool handles data safety. For email and social media scraping, it writes findings to a file continuously as it runs, so if the program crashes partway through, you keep whatever it already found. The broken link checker currently only saves results at the very end, which the author acknowledges as a limitation they plan to address. The tool also includes a helper for cleaning up messy URL lists copied from spreadsheets, removing duplicate entries and fixing formatting issues before you start a scan.