Reduce Storage with Crawl Deduplication • Webrecorder Blog A new feature to save you storage space.

Learn more on our blog → webrecorder.net/blog/2026-04...

An icon showing layers of stacked data on top of an outline of a website, labelled "Deduplication"

Get more out of Browsertrix with crawl deduplication. Our crawler can now reference existing data as it runs, saving only new information to disk. We’re rolling it out to select users at first, let us know if you’d like to try it out early!

This incredible story underscores, amongst other things, the need for trust and transparency in arching tools, and for web archiving toolchain to be fully open source and archives to be verifiable.

Execution Time Addons, Robots.txt, Profile Refreshes, Custom Schedules, and More • Webrecorder Blog An overview of exciting new features from Browsertrix 1.19, 1.20, and 1.21.

What has the Webrecorder team been up to recently? A whole lot -- we've been a little too busy working on new features and improvements to have time to share, until now!

Here's latest blog post from @bitarchivist.net covering last three Browsertrix releases: webrecorder.net/blog/2025-12... !

Our browser extension, ArchiveWeb.page has recently surpassed 20,000 users on the Chrome Web store:

chromewebstore.google.com/detail/webre...

That's 20k+ users creating their own high-fidelity, interactive web archives, right in their own browsers!

If you use ArchiveWeb.page, leave us a review!

Join Us! At the 89th Annual Meeting of the Society of American Archivists on Monday August 25th (4:00pm - 6:00pm) & Tuesday August 26th (9:00am - 4:00pm) in the Exhibitor Hall, Booth 117! #SAA2025 archives2025.expofp.com?webrecorder

Browsertrix 1.18: Large URL Lists and Beautiful Emails • Webrecorder Blog Browsertrix 1.18 brings support for large URL lists, new email templates, and UX improvements for crawling and curating.

Browsertrix 1.18 is out, with support for large seed lists and a new email system so invites, password resets, and everything else is clearer, smoother, and prettier.

Also better QA and a setting to automatically fail a crawl when you get logged out.

webrecorder.net/blog/2025-08...

Browsertrix 1.17: Crawl Pause/Resume and Lower Numbers of Browser Windows • Webrecorder Blog Crawl pause/resume and lower number of browser windows

Up on the Webrecorder blog today: a post all about our latest Browsertrix release, 1.17.

This release was focused on two much-requested features: crawl pause/resume and crawling websites with only 1 or 2 browser windows.

Read more on our blog: webrecorder.net/blog/2025-07...

You can also browse climate.govarchive.us for mirror of climate .gov

Older report data:
scenarios-globalchange.govarchive.us
health2016-globalchange.govarchive.us
nca2014-globalchange.govarchive.us
nca2009-globalchange.govarchive.us

Our mirrors of the USGCRP site and report subdomains are available at:
globalchange.govarchive.us
nca2023-globalchange.govarchive.us
carbon2018-globalchange.govarchive.us
nca2018-globalchange.govarchive.us
science2017-globalchange.govarchive.us
data-globalchange.govarchive.us
...

Some of the sites also have their own standalone mirrors for easier access:

The archived mirror for climate.gov is available at: climate.govarchive.us

We also have a mirror of the USGCRP sites is at:
globalchange.govarchive.us

Create, Use, and Automate Actions With Custom Behaviors in Browsertrix • Webrecorder Blog It is now easier than ever to automate custom page actions in Browsertrix.

I wrote a blog post for the @webrecorder.net site all about exciting new developments in automated behaviors in Browsertrix. In short, it's easier than ever to tell the crawler exactly what actions to take while archiving a web page! Check it out: webrecorder.net/blog/2025-05...

Create, Use, and Automate Actions With Custom Behaviors in Browsertrix • Webrecorder Blog It is now easier than ever to automate custom page actions in Browsertrix.

New on the blog: how to automate actions in the browser while crawling with Browsertrix! Including lots of new exciting work like the Autoclick behavior, support for custom behaviors in Browsertrix, and a new easier way to create behaviors with DevTools Recorder

webrecorder.net/blog/2025-05...

Join us for a free, hands-on web archiving workshop in NYC!
June 18th at 2PM EST at @TheNewSchool Archives
This workshop will teach you how to use Browsertrix to create, curate, and share archives of online content! RSVP today, as space is limited: tinyurl.com/2fh5f5ae #WebArchives #Browsertrix

Our Commitment to Provide Accessible Tools • Webrecorder Blog This is how Webrecorder supports archivists in times where cultural organizations navigate challenges in funding, budgets and limited staff.

We’re committed to providing accessible, high-fidelity web archiving tools for all, especially in these times where organizations are facing funding and staffing challenges. Learn more about our full suite of tools in our recent blog post webrecorder.net/blog/2025-04...

Resources • Webrecorder Information, terminology, and resources for archiving and preserving the web.

Want to dive deeper into web archiving? Check out our brand new Resources page which includes helpful guides, reference materials, presentations, and more! webrecorder.net/resources/

Read more on our blog webrecorder.net/blog/2025-04... and tell us what else you’d like to see in this evolving hub

Welcome back covid.gov The Data Rescue Project, as a clearinghouse of data access points, loves highlighting partners and initiatives! Today, we feature Webrecorder, a company that develops web archiving tools and open sour...

New post! www.datarescueproject.org/welcome-back... Today, we feature @webrecorder.net and their user-friendly snapshots of government sites. They worked with @safeguardingdata.bsky.social on the Covid.gov mirror. This is a great example of what we can achieve with collaboration!

Whether it's a DH project, a personal site, or even gov site that is going offline, all you need is a WACZ file created with any of our tools (Browsertrix.com, ArchiveWeb.page) and you can host a web archive-powered mirror of your own, for free!

To get started, check out:
github.com/webrecorder/...

Introducing GovArchive.us & Mirroring Entire Sites with Web Archives • Webrecorder Blog Introducing GovArchive.us and tooling to mirror web sites using web archives.

Love this new initiative by @webrecorder.net: GovArchive.us, mirroring dynamic sites as a static web archive, while preserving the previous URL structure. Could be a really compelling options for digital humanities projects, too.

I put together this mini-site for @webrecorder.net showcasing our US Government web archives

Replace “.gov” with “.govarchive.‍us” on any of the supported government sites to seamlessly browse archived versions, including sites like USAID that are now gone

Blog post in the quoted post!

Introducing GovArchive.us & Mirroring Entire Sites with Web Archives • Webrecorder Blog Introducing GovArchive.us and tooling to mirror web sites using web archives.

Ever wanted to restore a taken down site from a web archive, with link navigation and references intact?
Our latest tooling make this simpler than ever!

Announcing govarchive.us - a dynamic, web archive-powered mirror of US government sites!

More details on our blog
webrecorder.net/blog/2025-03...

Join us for a Browsertrix webinar! We’re partnering with Preserve This on March 19 at 2 PM CT for a deep dive into high-fidelity web archiving. Learn how to archive social media, replay archived items, and get the most out of Browsertrix.

Register here -> event.webinarjam.com/register/105...

Screenshot of Webrecorder's public collection gallery of US government sites web archive on Browsertrix

We’re excited to share the first batch of US Government websites that Webrecorder has archived as part of the
@eotarchive.org initiative. They’re now available on our public collections gallery app.browsertrix.com/explore/usgo...

#WebArchiving #Browsertrix #EOTarchive

Introducing Public Collections in Browsertrix • Webrecorder Blog Now you can curate, personalize, and share all your your crawls in one place.

Today we’re introducing Public Collections on Browsertrix, a new feature that lets you personalize, curate, and showcase your archives with the world. Read more on our blog webrecorder.net/blog/2025-03...

#WebArchiving #Browsertrix

Browsertrix is up and running again! If you have any questions, let us know at support@webrecorder.net

We are currently investigating an HTTPS authentication issue with Browsertrix.

Preserving Government Websites with Browsertrix • Webrecorder Blog A collaborative effort alongside the End of Term Web Archive to capture and save history.

We’re proud to be collaborating with the @eotarchive.org and EDGI to capture and preserve critical government websites before they’re lost, using our high-fidelity web archiving tools: Browsertrix and ArchiveWeb.page

webrecorder.net/blog/2025-02...

#webarchiving #digitalpreservation #EOTarchive

Webrecorder is part of the EOT archive initiative (eotarchive.org/) along with the other partners. Our focus is on high value interactive content (dashboards, maps, etc...) We'll have more updates to share soon, please continue submitting federal URLs via: digital2.library.unt.edu/nomination/e...

how to save stuff on the internet? short, sweet & useful zine on diy web archiving by @bitarchivist.net @ilya.webrecorder.net @quinnanya.me @akijas.bsky.social @literaturegeek.bsky.social ✨💾🐢 zinebakery.com/homemade-zin... #webarchiving