Changelog

Improved the My Requests page with better layout and user messaging. Added helpful guidance when no saved requests exist, including a button linking directly to the Request Builder. Enhanced visual consistency with updated button styling and icon usage.

Updated blog metadata handling to use slug properties directly instead of generating them from titles, improving reliability. Enhanced blog retrieval with better debugging capabilities and cleaner code by removing unnecessary console logs.

Refined header component styling for consistency across all pages. Updated logo and link dimensions for better visual alignment, and standardized font weights across navigation links for a more cohesive design.

Switched package scripts from Bun to Next.js commands for better compatibility and consistency. Updated documentation generation to use tsx and removed unnecessary vercel.json configuration.

Completely redesigned the request builder interface with a comprehensive form system. Introduced new form components including FormCheckbox, FormInput, FormTextarea, FormSelect, and FormRadioGroup for consistent user input handling. Added specialized extraction components like AIQueryField, ExtractRulesField, and ScreenshotField to streamline data extraction workflows. Implemented FormProvider for better form state management using react-hook-form, ensuring validation and better error handling throughout the request building process.

Created dedicated RequestBuilderForm and RequestResult components to improve code organization and user experience. The form component now supports HTTP methods, device types, and advanced parameters with comprehensive validation. The result component dynamically renders HTML, Markdown, and image responses with proper content type handling, making it easier to test and visualize API responses.

Refactored the API handler to use a new unified puppeteerRequest function that consolidates all scraping functionality. This enhancement provides better flexibility and maintainability while supporting additional parameters like device type selection and resource blocking options. Improved error management and streamlined API request handling for more reliable scraping operations.

Enhanced blog post rendering with Prism-based syntax highlighting for code blocks. Added clipboard copy functionality allowing users to easily copy code snippets with a single click. Improved code block UI with hover effects and better visual presentation, making technical content more accessible and readable.

Updated Footer component to support responsive layouts with a 'small' prop option. Improved grid styling for better mobile views and removed footer from documentation page for a cleaner layout.

Added Vercel Analytics package for enhanced tracking capabilities. Updated API client handling to improve flexibility and testability. Integrated analytics across the application for better user behavior insights.

Launched a comprehensive feature request system enabling users to create, vote on, and track feature requests. Built a user-friendly interface with dialogs for creating and editing requests. Added admin capabilities for status updates and editing permissions. Implemented database schema with proper indexing for efficient queries and voting functionality.

Refined analytics components by removing unnecessary card wrappers and improving layout consistency. Enhanced CreditsCharts, AnalyticsChart, DomainTable, and LogsTable components with better styling and spacing. Streamlined the presentation of API credit usage and request logs for clearer insights.

Improved AppLayout with better loading states, refined API key display, and enhanced sidebar navigation. Added new filled icons for better visual distinction, introduced Rocket01Icon for upgrade links, and improved overall styling consistency. Enhanced mobile responsiveness and user experience across dashboard pages.

Launched Request Builder page with comprehensive form for building API requests. Added options for proxy types, custom headers, and data return formats. Integrated user API key display and code snippet copying functionality. Enhanced with advanced parameters including JavaScript rendering, blocking ads, and resource management options.

Updated _document.tsx to conditionally load analytics scripts only in production environments. Added Datafast analytics integration with global type definitions for payment, pageview, signup, and conversion events. Enhanced performance and security by preventing unnecessary script loading in development.

Added LegalHeader component for legal pages. Updated sitemap generation to include privacy-policy and terms-of-service pages with appropriate priorities. Improved blog page priorities in sitemap for better SEO ranking.

Added BlogCard and BlogHeader components for improved blog layout and presentation. Integrated blog link into header navigation. Enhanced blog card styles for better responsiveness and readability. Updated NotionBlockRenderer with improved styling and semantic HTML structure.

Created a new Footer component for consistent footer design across all pages. Integrated footer into LandingPageContent, Documentation, Pricing, BlogPostPage, and BlogPage. Improved layout with FooterSection components and added Twitter icon for social media engagement. Enhanced mobile responsiveness and consistency.

Implemented a complete blog synchronization system that caches Notion blog posts in Convex for improved performance. Created a comprehensive backoffice UI for managing blog synchronization with options to sync all blogs or individual posts. Added Convex functions for querying and mutating blog data, including upsert and delete operations. Established a Sync API endpoint to facilitate data transfer from Notion to Convex, reducing API dependency and improving load times. Implemented automatic Vercel deployment triggers for rebuilding static pages after blog synchronization.

Created blog-utils.ts module with functions for generating slugs, extracting plain text, estimating reading time, and formatting dates. Implemented caching for blog fetching to reduce API calls and improve performance. Enhanced error handling for robust API interactions.

Refactored blog pages to use static generation with getStaticProps and getStaticPaths for optimal performance. Enhanced error handling in path generation and added revalidation for dynamic content updates. Improved SEO with proper sitemap generation including blog entries.

Created LandingPageContent component with FeaturesOverview section showcasing key features. Added FAQSection component with accordion functionality for common questions. Implemented CTASection component with SignUpButton integration for better user engagement. Updated feature descriptions for clarity and relevance.

Refactored PricingTable component with new feature structure including icons and detailed descriptions. Changed pricing from string to number for better data handling. Integrated PricingTable into LandingPageContent for cohesive user experience. Updated pricing constants with new icons and improved visual representation.

Enhanced shared UI integration with new components including Accordion, Alert, Avatar, Badge, and more. Updated import paths across the application for consistency. Refactored ESLint, PostCSS, and Tailwind configurations to utilize shared UI settings. Added animation guidelines for UI performance and accessibility.

Upgraded to Next.js 16 and React 19.2.0 with new features including cacheComponents and reactCompiler. Updated TypeScript configuration to use new JSX transform. Removed dynamic rendering flags and simplified middleware. Enhanced overall application structure and performance.

Implemented haptic feedback functionality using custom useVibration hook. Added vibration patterns for common user interactions, enhancing user experience on supported devices. Integrated vibration feedback into Button components for better interaction feedback.

Completely redesigned the landing page with new brand assets, improved provider logos, and enhanced feature showcase. Added animated icon switching with BrandSwitcher component supporting unlimited items with smooth animations. Integrated new SVG assets for features including AI, browser, fast, intelligent, powerful, and scalable capabilities. Improved visual representation of companies using the service.

Implemented comprehensive image optimization across the landing page, reducing file sizes by ~30% while maintaining quality. Added proper dimensions to prevent layout shifts, achieving zero Cumulative Layout Shift (CLS). Enhanced SVG loading for provider logos with eager loading to eliminate delays. Documented significant improvements in load times and Core Web Vitals metrics.

Added comprehensive content marketing rule for generating suggestions based on recent code changes. Provided structured guidelines for blog posts, tweets, emails, changelog updates, and other marketing content. Included processes for categorizing changes by impact and content strategy tips.

Completely redesigned homepage with new background image and improved branding. Updated logo dimensions and mask IDs for better consistency. Added inverted logo for different themes. Enhanced main heading to emphasize AI capabilities. Improved text visibility and readability with better styling.

Launched comprehensive analytics dashboard with usage charts, domain breakdowns, and detailed request logs. Implemented CreditsCharts component to visualize API credit usage and limits over time. Added useLiveWindow hook for managing time windows with real-time updates. Enhanced data visualization with improved performance and consistency.

Introduced new scrapes table schema to log scraping activities including user ID, domain, URL, method, status code, and duration. Implemented logScrape mutation to record scrape events and associated metadata. Updated spendUserCredits mutation to use API key for user identification. Created API routes for handling scrape logging and user credit spending.

Integrated ThemeProvider component for improved theming support across the application. Enhanced UserProfile component with theme selection options for better user experience.

Introduced UserProfile component with account settings and theme selection options. Enhanced sidebar navigation with new dashboard sections and improved organization. Added AnimatedIconSwitch component for smooth icon transitions. Improved sidebar layout with SidebarGroup and SidebarMenu components.

Introduced AppLayout component to standardize layout across app pages. Created AppSidebar with improved navigation and organization. Added new dashboard components including SectionCards and ChartAreaInteractive. Implemented withDashboardLayout HOC for consistent dashboard layout management.

Launched new pricing page with detailed plan comparisons, feature highlights, and clear call-to-action buttons. Created PricingTable component for better organization and maintainability. Integrated with authentication system for seamless subscription flow.

Integrated Clerk authentication with middleware protection. Added Convex for user management, credit handling, and billing webhooks. Implemented automatic user creation and credit allocation system. Created billing and Clerk webhooks for subscription management.

Enhanced scraping API with support for text and markdown responses. Added extraction helpers for converting HTML to text and markdown formats. Implemented unified Puppeteer request handler supporting screenshots and various request methods. Refactored ScrapingBeeTester to use js_scenario instead of script for better compatibility.

Launched new documentation page with comprehensive API guides and improved navigation. Added documentation link to header and sitemap for better accessibility. Enhanced user experience with better layout and structure.

Added cheerio, turndown, xmldom, and xpath dependencies for advanced HTML processing. Implemented new extract rules and enhanced Puppeteer request handling. Created utilities for error handling and parameter extraction. Improved scraping capabilities with better data extraction options.

Built initial scraping API with Puppeteer integration. Added support for various request methods and screenshot capabilities. Implemented API configuration with runtime settings and body parser size limits. Created v1 API endpoint structure for improved scraping functionality.

Added comprehensive UI components and configuration files including Tailwind CSS setup, Radix UI components, and utility functions for styling and responsiveness. Established foundation for consistent design system across the application.

Integrated custom OpenRunde font family replacing Google Fonts for improved performance and consistent branding. Added proper font preloading for faster page loads and better visual consistency.

Added comprehensive meta tags for SEO including Open Graph properties and Twitter cards. Implemented dynamic sitemap generation with automatic page discovery. Created robots.txt for proper search engine crawling guidelines. Integrated PostHog for analytics tracking and user behavior insights.

Established initial Next.js project setup with TypeScript, ESLint, and Tailwind CSS. Configured build system and development environment with modern tooling and best practices. Set up proper project structure for scalable development.