InDigger

InDigger is a web scraping tool for LinkedIn. Given a company name, it goes through a predefined list of departments and returns the employees, their job title, their work experience, and their education.

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.

Run the command:

git clone https://github.com/mattrotlevi/InDigger.git

Within the directory, run the command:

python InDigger.py -h

Your output will be

usage: InDigger.py [-h] [--company string] [--emps file]
                           [--emailformat string]

InDigger - A LinkedIn scraping tool by Matt Rotlevi

optional arguments:
  -h, --help            show this help message and exit

Company Name:
  --company string      Enter the company name you want to run the search on

Employee Harvesting:
  --emps file           Discover employees by title and/or department. Titles
                        and departments are imported from a new line delimited
                        file. [Default: title-list-small.txt]
  --emailformat string  Create email addresses for discovered employees using
                        a known format. [Accepted Formats: [email protected],
                        [email protected], [email protected], [email protected],\
                        [email protected], [email protected], [email protected],
                        [email protected]]

As a demonstration of the program's ability, enter:

python InDigger.py --company "company name" --emps "/home/mattr/scraper/wordlists/title-list-small.txt" --emailformat [email protected]

The output will look like

---------------------------------------------------------------
FINANCE
---------------------------------------------------------------

NAME:Jane Doe
---------------------
Education:
-  ABC College
Experience:
-  Director, Financial Planning & Analysis at Company Name
-  Manager - Finance at WTAS
-  Manager of Finance at The Madison Square Garden Company, Inc
-  Financial Analyst at Broadridge Financial Solutions, Inc
-  Intern at Merrill Lynch
Job Title:
-  Director, Financial Planning & Analysis at Company Name
EMAIL: [email protected] 

NAME:John Doe
---------------------
Education:
-  ABC University
-  XYZ High School
Experience:
-  Finance Intern at Company Name
Job Title:
-  Intern at Company Name
EMAIL: [email protected]

Authors

• Matt Rotlevi