Simon Willison | Media & Entertainment » Apps & Software

Scraping web pages from the command line with shot-scraper

Scraping web pages from the command line with shot-scraper

Recommended By

17 MAR 2022

Noah Brier

The End-to-End Testing Edition

Developed by Simon Willison, this tool uses Playwright to capture screenshots from the command line.

Shot-scraper is a command line tool for browser automation that also allows web page scraping by executing JavaScript. This tool, which is built in Python and uses Playwright, can be utilized to automate screenshot taking, PDF exports, and even test automation in CI/CD pipelines like GitHub Actions.

Related Products

17 MAR 2022
17 MAR 2022

Apps & Software

puppeteer

Contributors to the Puppeteer project on GitHub

19 APR 2019

Apps & Software

SelfControl

Charlie Stigler, Steve Lambert

© WITI Industries, LLC.