Dec 11th, 2024
December Product Update
Co-founder at Reworkd
We've rolled out many major updates the past few months including: a brand-new dashboard page, code templating functionality, and much-improved exporting options.
Dashboarding
A critical part of managing web data workloads is having a holistic understanding of the pipeline: how much data is coming in and where are failures arising. Without this, managing hundreds of sites can quickly become overwhelming.
We believe that keeping track of everything shouldn’t feel like a full-time job. That’s where our new dashboard comes in. It makes things simple, giving you a clear view of your web data pipeline in one place.
Here’s what you can do with it:
- See outputs over a specific time period.
- Track the total number of unique outputs and see how many pages were visited.
- Check the review status of all your websites.
- Keep tabs on the number of files downloaded - and more!
Templates
When you're scraping websites at scale, you'll quickly notice something interesting: many sites rely on the same third-party platforms to host their data—think Shopify or WooCommerce for e-commerce.
You can now create and reuse templates from your existing code, rather than writing new Playwright scripts for each website.
Exports
With our new dedicated export page, you can:
- Select the exact site(s) you want data from.
- Export the data in your preferred format - JSON or CSV.
- Pick a date to export data scraped after that day.
- Access export history.
- Redownload previously exported data.
All from one convenient page.
Wrapping Up
Stay tuned for more exciting product updates by following us on Twitter or Linkedin. We’ve got an amazing lineup of features coming your way in the next few months—don’t miss out!
If you're interested in trying any of these features out, book a meeting here or send us an email at srijan@reworkd.ai– we’d love to hear your feedback and help you get started!