Python (preferably) Web Scraper and crawler

This project has a couple of phases. 1. The scraper needs to gather data from inside sales navigator. For each person returned from a search the scraper needs to capture their full name (first and last name as separate fields), company name, LinkedIn profile URL, job title. 2. The crawler needs to move around sales navigator. This will involve inputting search terms and filters, as well as clicking through paginated results. 3. The scraper needs to gather deeper data from LinkedIn profile urls. This will be [full name, company name, job title, contact details (email, telephone numbers, social media accounts {profile url and handle}, recent activity (posts published, posts liked, posts commented on), current role(s), current role description(s), date of birth. 4. Data needs to be made available in a CSV export or written directly to file if being run in local. This tool will be run from a local machine, using the logged in LinkedIn account - unless you can explain why running off a server is better. I would suggest Mechanise and Beautiful Soup are the best tools to use but I'm open to suggestions. Unit testing is required but proper code commenting is essential.