May 2026
- Clearer error messages for OCR requests
- Live elapsed time for running history entries
- More reliable extracts
- Fix chat widget covering buttons
- Preserve pasted URLs in the Playground
- Inline validation errors on Playground forms
- Polish the format picker dialog
April 2026
- Add n8n integration
- Add Make.com integration
- Add Smithery integration
- Add JSON schema editor to the Playground
- Fix usage chart overflow
- Add automatic credit top-ups
- Download full results from history
- Add markdown preview and scrape skeleton
- Unify dashboard filters
- Redesign integrations page
- Add LlamaIndex integration
- Add CrewAI integration
- Improve mobile layout
- Add legacy user migration flow
- Bump free plan credits
- Defer paid plan downgrades to end of billing period
- Unify API error responses
- Split mode and stealth, add country dropdown
- Add per-service concurrency limits
- Add `/brand` page with downloadable assets
- Add monthly/yearly switch and credit packs to `/pricing`
- Add official integrations section with MCP and CLI
- Batch crawl multiple URLs with screenshot support
- Add monitor activity endpoint
February 2026
- Add Claude code skill
- Add CLI
- Fix browser translation crash by adding Error Boundary
- Add translate="no" to prevent auto-translation DOM conflicts
- Add Auto-Recharge feature to billing page
- Users can now configure automatic credit purchases when balance runs low
- Set custom threshold and quantity for automatic recharges
January 2026
- Add searchscraper geotargeting and timezone parameters
- Add breadth parameter in smartcrawler (default: 5)
- Update depth, max pages, and breadth controls in smartcrawler form
- Add new sdk and project
- Update the Playground schema and centering
- Add changelog link to navbar
- Add JSON-LD structured data for SEO
- Add integration page
- Remove earn-with-us page
- Update header and footer
- Update spacing
- Update sidebar
- Add sdks links to the playground
- Update the history page
- Update the integrations descriptions
- Update the project management page
- Add progressbar in billing page
- Update the order in the dashboard
- Update the Playground logic
- Update the history visualization
- Update the onboarding page
- Update the playground page
- Optimize API Usage Dashboard performance - reduced from 7 API calls to 1
- Add prefetch-on-hover for faster time range switching in Usage Chart
- Add pay-per usage billing
- Update billing page
- Update dashboard page
- Update description of the pages
- Removed scheduled jobs feature
- Migrated authentication state to Zustand for improved performance
- Reduced duplicate API calls by centralizing auth state management
- Update logs visualization on the progress bar
December 2025
- Improved Buy Extra Credits button visibility with gradient styling and enhanced visual effects
- Enhanced quantity selector with intuitive slider interface
- Updated Add-hoc Credits purchase flow with better UX
- Update the progress bar
- Update scrape endpoint in the Playground
- Filter out plans
- Refactoring of the buttons according to the design
- Update the progressbar in the dashboard
- Add change email functionality to Settings page
- Users can now request email address change with verification link
- Update history card
- Update Markdownify terminal output to display results in clean JSON format with curly braces
- Move Agentic Scraper to dedicated page with Beta badge in sidebar navigation
- Replace Scheduled Jobs position with Agentic Scraper in sidebar
- Improve terminal output formatting with proper line breaks
- Increase typewriter animation speed for better user experience
- Update Interactive Tutorial terminal to match Playground terminal style
- Replace CodeBlock with terminal-style display in GuidedTutorial
- Add terminal header with colored dots and action buttons (Copy, Download)
- Improve terminal result display consistency across onboarding and playground
- Restore rounded border on remaining credits display
- Add support for yearly subscription upfront credits display
- Refactor api key management in the Playground
- Fix rawBrandingResponse not being populated during streaming scrape flow - JSON view now displays actual API response instead of null
- Add streaming progress bar with smooth animations for scrape endpoint
- Add real-time step updates during scrape processing
- Refactor credits calculus in the Playground
- Fix duplicate terminal display in Design Mode, terminal now only shows during processing
- Add collapsible HTML Content accordion with terminal-style design for Design Mode results
- Update changelog page
- Update icons in the dashboard
- Update Interactive Tutorial to show step-specific titles and descriptions in header
- Remove redundant step header section from tutorial content
- Fix history repository slicing bug - correctly handle from/to parameters when fetching paginated records
- Add new quick search
- Fix layout shift on the Playground page
- Refactoring of buttons colors
- Add skeleton loader for remaining credits display
October 2025
- Add csv extraction toggle
- Add Community section on the dashboard
- Add render heavy js
- Update dashboard
- Update code examples and the drawer when the screen is small
- Update params on the SmartCrawler
- Decouple api clients
- Update change subscription functionality
- Fix google ads params api call
- Add feedback form on the Cancellation dialog
- Add feedback form on the Playground
- Update history for smartcrawler to use the new history API
- Fix bug on the sidebar
- Add book a call button to the dashboard
- Add integrations in the dashboard
- Add sitemap functionality to the Playground for smartcrawler
- Fix legacy routes ( forgot-password, reset-password, verify )
- Fix Terminal scrolling fix - Only scrolls internally within the terminal
- Terminal message fix - Prevents duplicate loading messages after results arrive
- Gentle scroll to terminal - Makes terminal visible when it first appears
- Add command + enter key binding to start scraping
- Add Intercom messenger on sign up and sign in page
- Add husky pre-commit checks
- Add dynamodb history calls to searchscraper
- Add upgrade route to the app
November 2025
- Update the changelog dialog
- Update the remaining credits display
- Add design extraction to the Playground
- Add DNA function inside scrape endpoint
- Fix bug on the history
- Update use cases
- Add Smithery and Docker inside the integrations
- Fix bug on code generation
- Fix usage history bug
- Fix navbar bug
- Add account deletion
- Add multiple team support
- Add Projects feature
- Update bug Ux/
September 2025
- Complete app resyling
- New modern UI/UX design
- Improved user experience
August 2025
- Add filter to the history
- Fix SmartCrawler on the history
- Add SmartCrawler markdown mode
- Fix bug on the Playground for infinite scrolling
July 2025
- Pagination support
- Cookies integration
- Authentication support
- Update the changelog dialog
- Fix smartcrawler bug on the UX/UI
- Update animation of the Spidy agent
- Add SmartCrawler to the Playground
- Added configurable website limits (3-20) to SearchScraper with dynamic credit pricing
- Added infinite scrolling support to SearchScraper
- Enhanced Advanced Settings with comprehensive credit cost calculator
- Add agno integration
- Fix bug on the Playground for markdownify
June 2025
- Add SmartScraper multiple urls mode to the Playground
- Add infinite scrolling to the Playground and updated the code example generation
- Improved the UI of the Spidy agent
- Refactoring of the Rating Modal in age of the chatbot
- Fix markdownify bug in the Playground
- Add infinite scrolling integration
- Fix progress bar bug on onboarding
- Fix bug on Onboarding on Windows
- Add Dify to the integrations
- Add links to the Playground
May 2025
- Add copy-button in the Playground
- Refactoring coloring of the Playground
- Fix bug on the Playground
- Fix bug on the Playground
- Refactoring of the Spidy agent
- Refactoring Mardownify in the Playground
- Enhanced performance of the API
- Add the integration for pipedream
- Add the integration for Make.com
- Add the affiliate program
- Fix bug on the Playground
- Add new integrations in the Dashboard
- Fix bug on the Playground with double trashbin
- Update the settings dialog
- Enhanced Dashboard layout: prioritized Usage chart (60%) and API Key (40%)
- Simplified Usage chart: set bar chart default, removed line/bar toggle
- Refined API Key section: removed instructional text, adjusted size
- Optimized vertical space: reduced height/padding for Usage & API Key sections
April 2025
- Refactoring of the onboarding process
- Add easter egg
- Refactoring Playground page
- Fix bug on the Playground
- Update settings dialog
- Add key in the Playground
- Fix bug on dashboard when copy a key
- Improved API speed by 60%
- Refactoring of API key form
- Refactoring of spidy agent chat
- Update the credits display
- Update copy-code button
- Change the settings dialog
- Update for no left credits
- Update bug for Playground
- Add scrollbar in the results page
- Add button to copy the results
- Refactor of the sidebar
- Refactor of the pricing page
- Fix bug when no credits are left
- Update Spidy agent remove chat panel
- Add download csv, xlsx and json button
- Add source field to onboarding
- Fix a bug on the onboarding process
- Fix a bug on the plan
- Fix output schema bug
- Fix a bug on the integrations
- Fix SpidyChat limit bug
- Fix bug on Playground
- Increased API's speed by 60%
February 2025
- Add onboarding
- Fix bug on first login
- Fix subscription bug
- Fix bug on pricing page
- Add tutorial references
- Fixed generate schema bug
- Add new service for finished subscriptions
- Add download csv and json button
- Enhanced user experience by making Playground the default landing page and reorganizing navigation structure
- Added new service SearchScraper
- Merged LocalScraper into SmartScraper
- Added Chinese language
January 2025
- Integration with CrewAI
- Refactoring refresh problem
- Fixed code examples COPY button with syntax highlighting using CodeBlock component
- Added polling for processing requests
- Added buffering circle
- Added schema builder functionality visualization
- Fixed curl integration on examples
- Fixed refreshing problem
- Added search functionality
- bug fixing
January 2024
- Added schema builder functionality
- Improved error handling
- UI/UX enhancements
- Bug fixes and performance improvements
- Added changelog dialog
- Added curl integration on the examples
- Tick example button when copy
- Initial public release
- Core functionality implementation
- Basic user interface
