Latest updates and improvements to ScrapeKit.
Added dedicated use-case pages for all 8 platforms with API examples, JSON-LD structured data, sitemap.xml, and robots.txt for improved search engine visibility.
New testimonials section, interactive API playground, competitor comparison table, FAQ accordion, and animated social proof counters in the hero section.
Rich result viewers for YouTube channels, YouTube videos, Meta Ad Library, Instagram hashtags, and Instagram comments. Results display with formatted cards, thumbnails, and stats.
Retry button on failed jobs, job duration display, Copy JSON button, CSV export for property searches, and paginated job lists (20 per page).
Scraper success rate bar charts, usage-by-platform donut charts, enhanced stat cards, and customer detail pages in the admin dashboard.
Rate limiting on login/register, CORS configuration, webhook retry with exponential backoff, Redis caching for admin stats, and request ID tracking.
Launched LinkedIn profile, search, and jobs scrapers. Added X (Twitter) profile, search, and jobs scrapers using GraphQL APIs with search engine fallbacks.
Automatic quality checks for scrape results. Jobs returning garbage data (login pages, empty profiles) are now correctly marked as failed.
TikTok profile and video scrapers. Profile scraper extracts follower count, avatar, and recent videos with thumbnails and view counts.
Canary health checks running every 30 minutes, testing each scraper with known inputs. Health status displayed on admin dashboard and public status page.
Search by advertiser name or URL to get ad creatives, copy, targeting, and performance data from the Meta Ad Library.
Full delivery history for webhooks with status codes, response times, and retry tracking. View delivery logs from the webhooks management page.