Wayback Machine Scraper

Overview

The Wayback Machine Scraper is an advanced browser automation template designed to retrieve historical snapshots of web pages directly from the Internet Archive at web.archive.org. By configuring custom target parameters, researchers, developers, and compliance analysts can travel back in time to inspect past versions of websites without manual navigation.

What it does

This automation connects to the Wayback Machine archive and performs structured retrieval operations:

• Dynamically builds a timestamp-specific archive URL using your provided date and domain variables.
• Navigates precisely to the targeted capture around midday (11:59:59) on your requested date.
• Waits for the historical snapshot and its embedded resources to load completely.
• Executes a built-in extraction script to parse the page title, canonical URL, meta description, document language, top-level headings, and an introductory text snippet.
• Captures and returns the full DOM HTML of the historical webpage snapshot.

Inputs

The automation relies on two key user-configurable variables:

• date: The target calendar date formatted as YYYYMMDD (e.g., 20171103).
• url: The target website domain or address you want to inspect (e.g., apple.com).

Output

The template extracts a structured JSON payload containing valuable historical data:

• requestedDate: The original date string you configured.
• finalUrl: The exact URL loaded by the browser.
• selectedTimestamp: The specific timestamp captured from the archive link.
• title: The historical document title.
• canonicalUrl: The canonical link element found in the snapshot.
• description: The meta description tag content.
• language: The document language attribute.
• headings: An array of up to 20 key heading texts (h1, h2, h3).
• topText: An excerpt of up to 4,000 characters from the body text.
• html: The complete outer HTML of the historical page snapshot.

How to use

1. Open the template configuration panel in your Figranium workspace.
2. Locate the variables section and update the url variable to your desired website.
3. Adjust the date variable to your target historical date using the YYYYMMDD format.
4. Run the automation agent and allow it a few seconds to resolve and render the historical snapshot.
5. Review or export the resulting structured JSON output and captured HTML.

Notes

• Availability of historical snapshots depends entirely on whether the Internet Archive successfully crawled the target URL on or around your specified date.
• The navigation action targets midday captures to maximize the likelihood of retrieving a stable, complete version of the page.