windows-python-scraper

Playbook for Windows Python Scraper using Selenium.

Application

1. Install Anaconda
2. Install browsers: Firefox and Chrome
3. Download selenium driver executables/binaries
   • for convenience, store in 'bin' folder
4. Install Chrome Browser extension: SelectorGadget
5. pip install selenium
6. Create Windows batch file to execute Python application
7. Create Python application

Windows Task Scheduler:

1. Start "Windows Task Scheduler"
2. On the right-pane, click "Create Basic Task..." (this is Create Basic Task Wizard)
3. Give name to task -> Next
4. Select frequency: Daily
5. Select start time (Note time zone of local machine, esp. if virtual machine @ UTC)
6. Action to Perform: Start a program
7. Click "Browse" button -> navigate to Windows batch file
8. Click "Next" and "Finish" buttons

Documentation:

1. Convert MS-Word (docx) documentation to markdown using pandoc
   • pandoc -s original.docx -t markdown -o converted.md
   • -s standalone document, not fragment
   • -f convert format from
   • -t convert format to
   • -o output file
2. pandoc demos. https://pandoc.org/demos.html
3. pandoc flags. https://pandoc.org/MANUAL.html#options