Urlbox.io VS Perma.cc

This is how I do it. I send the URLs I want scraped to Urlbox[0] it renders the pages saves HTML (and screenshot and metadata) to my S3 bucket[1]. I get a webhook[2] when it's ready for me to process. I prefer to use Ruby so Nokogiri[3] is the tool I use for scraping step. This has been particularly useful when I've want to scrape some pages live from a web app and don't want to manage running Puppeteer or... - Source: Hacker News / 2 months ago

Hi there, I run urlbox.io, which is a screenshot API that allows clicking elements, waiting for elements, injecting custom JS/CSS etc. Source: over 1 year ago

Harvard Library Innovation Lab | Multiple roles | Full time | Cambridge, MA (hybrid schedule, REMOTE possible) The Harvard Library Innovation Lab explores the future of libraries by building tools and communities for open knowledge. We build long term services like https://perma.cc, https://opencasebook.org, and https://case.law, and we host fellows like Molly White, creator of Web3 is Going Just Great. We are a... - Source: Hacker News / 10 months ago

Harvard Library Innovation Lab | Multiple roles | Full time | Onsite Cambridge, MA (hybrid schedule) The Harvard Library Innovation Lab explores the future of libraries by building tools and communities for open knowledge. We build long term services like https://perma.cc, https://opencasebook.org, and https://case.law, and we host fellows and technologists-in-residence like Molly White, creator of Web3 is Going... - Source: Hacker News / over 1 year ago

For reviews of studies examining the relationship between incarceration and crime in the 1990s, see Don Stemen, Reconsidering Incarceration: New Directions for Reducing Crime (New York: Vera Institute of Justice, 2007), 4 (describing studies That showed no relationship or a very weak relationship between incarceration rates and violent crime rates through the 1990s), https://perma.cc/T8PJ-QBCD; Oliver Roeder,... Source: over 1 year ago

SEEKING FREELANCER | Remote, must be US employment authorized The Harvard Library Innovation Lab builds open source websites to democratize access to information. We are seeking Vue + Django developers to add features to our projects: https://perma.cc, https://opencasebook.org, https://case.law Please send experience and hourly rates for public-interest open source work to the harvard.edu address in my profile. - Source: Hacker News / about 2 years ago

Absolutely. You can save a HAR file from devtools at least. If you want to generate WARC from browsers, warcprox is relatively easy and fast - but setting up the proxy settings etc. Is cumbersome if all you want is a single archive. By the way, there are some great tools that use WARC under the hood such as perma [1]. They provide reliable snapshots of single documents with a stable URL. [1] https://perma.cc/. - Source: Hacker News / about 2 years ago