Description
We should create a new package that can display what the live site looked like at different points in time, similar to the internet archive's wayback machine.
The package should have two parts: 1) a plugin that defines what urls to render, where to store the images, etc., and 2) a docker image for a worker that's capable of rendering a public url (runnable on google cloud functions).
The plugin should be able accept either explicit urls to fetch, or a sitemap.xml that is automatically resolved for urls (and automatically group pages that are considered "alternative" urls of one another).
The worker should have playwright / puppeteer installed and can save data to firestore and images to gcs (the images should be hashed so that if a website doesn't change over a period of time then it doesn't increase the storage costs).
Description
We should create a new package that can display what the live site looked like at different points in time, similar to the internet archive's wayback machine.
The package should have two parts: 1) a plugin that defines what urls to render, where to store the images, etc., and 2) a docker image for a worker that's capable of rendering a public url (runnable on google cloud functions).
The plugin should be able accept either explicit urls to fetch, or a sitemap.xml that is automatically resolved for urls (and automatically group pages that are considered "alternative" urls of one another).
The worker should have playwright / puppeteer installed and can save data to firestore and images to gcs (the images should be hashed so that if a website doesn't change over a period of time then it doesn't increase the storage costs).