Browser Engine Benchmark

June 9, 2026 ยท View on GitHub

Python 3.8+ License

A toolkit for testing browser automation engines against modern web protection systems. It checks how well each engine can bypass bot detection and measures their speed, resource usage, and resistance to fingerprinting.

(Need some help with Automation? You can hire me for custom development or consulting!)

๐ŸŽฏ Overview

Modern web applications use advanced bot detection like Cloudflare, DataDome, and Imperva to block automated access. This benchmark suite shows how different browser automation engines handle these defenses:

  • Bypass Success Rate: Effectiveness against major protection systems
  • Performance Metrics: Memory usage, CPU consumption, and page load times
  • Fingerprinting Resistance: reCAPTCHA scores and CreepJS trust ratings
  • Network Analysis: IP detection (proxy validation) and WebRTC leak testing

๐Ÿš€ Key Features

Protection System Testing

  • Cloudflare
  • DataDome
  • Amazon
  • Google Search
  • Ticketmaster (Imperva)
  • Akamai
  • PerimeterX / HUMAN Security
  • Kasada
  • Reddit
  • More systems coming soon

Browser Engine Support

  • AdsPower - (Proprietary) Anti-detect browser with per-profile fingerprinting. Requires AdsPower desktop app running locally and an API key.
  • Playwright - (Open-Source) Microsoft's automation framework (Chrome, Firefox, Safari)
  • Camoufox - (Open-Source) Playwright-based
  • Patchright - (Open-Source) Playwright-based
  • Playwright Stealth - (Open-Source) Playwright-based
  • CloakBrowser - (Open-Source) Playwright-based
  • Selenium - (Open-Source) Browser automation framework (apparently deprecated, so it is tested without proxies)
  • Seleniumbase - (Open-Source) Professional toolkit for web automation activities
  • NoDriver - (Open-Source) Browser automation framework (supports only SOCKS5 proxies)
  • ZenDriver - (Open-Source) NoDriver-based
  • More engines coming soon. What engine should I add next?

Analytics

  • Automated report generation with visualizations
  • Performance profiling and resource usage tracking
  • Exportable results in JSON and Markdown formats

๐Ÿ”’ Important: Proxy Requirements

Using a clean proxy is essential for accurate benchmark results.

Why Proxies Are Required
  • IP Reputation: Your home/datacenter IP may already be flagged by protection systems from previous automation attempts, browser extensions, or security software
  • Clean Testing Environment: A fresh proxy IP ensures you're testing the browser engine's capabilities, not your IP's reputation
  • Rate Limiting: Repeated tests from the same IP can trigger rate limiting, affecting bypass success rates

Swiftproxy

Swiftproxy โ€” Premium residential proxies with 80M+ IPs across 190+ countries, non-expiring traffic, and high-anonymity connections. Built for web scraping, protocol analysis, AI agents, browser automation, and large-scale data collection.

๐Ÿ”— https://www.swiftproxy.net


๐Ÿ“Š Sample Results

This benchmark provides detailed comparative analysis. Here's an excerpt from a recent test run (more in results/example):
Real IP in this example - 146.70.188.179
Proxy IP in this example is different for each engine

Overall Bypass Rate

EngineBypass Rate (%)
patchright100.0
cloakbrowser90.0
camoufox_headless90.0
nodriver-chrome80.0
adspower80.0
seleniumbase-cdp-chrome80.0
adspower_headless70.0
tf-playwright-stealth-firefox70.0
tf-playwright-stealth-firefox_headless70.0
zendriver-chrome70.0
cloakbrowser_headless60.0
tf-playwright-stealth-chromium60.0
playwright-chrome60.0
playwright-firefox_headless60.0
playwright-firefox60.0
zendriver-chrome_headless60.0
tf-playwright-stealth-chromium_headless50.0
selenium-chrome__no_proxy50.0
playwright-chrome_headless40.0
nodriver-chrome_headless40.0
patchright_headless40.0
camoufox30.0
selenium-chrome_headless__no_proxy30.0

Resource Usage Comparison

EngineMemory Usage (MB)CPU Usage (%)
adspower_headless123.04.9
adspower130.07.0
playwright-chrome_headless517.07.4
tf-playwright-stealth-chromium_headless522.08.2
zendriver-chrome_headless818.021.5
tf-playwright-stealth-chromium913.028.6
cloakbrowser_headless936.027.2
selenium-chrome_headless__no_proxy948.010.1
zendriver-chrome1009.038.8
selenium-chrome__no_proxy1034.029.8
tf-playwright-stealth-firefox_headless1034.044.7
playwright-firefox_headless1068.070.3
cloakbrowser1082.054.4
playwright-chrome1103.028.5
seleniumbase-cdp-chrome1157.051.9
playwright-firefox1161.075.5
camoufox1181.053.3
tf-playwright-stealth-firefox1261.067.7
nodriver-chrome_headless1275.024.4
patchright_headless1277.016.6
patchright1314.053.3
camoufox_headless1318.088.6
nodriver-chrome1389.047.4

Recaptcha Scores - https://antcpt.com/score_detector

EngineRecaptcha Score (0-1)
adspower0.90
adspower_headless0.90
camoufox_headless0.90
cloakbrowser0.90
cloakbrowser_headless0.90
nodriver-chrome0.90
nodriver-chrome_headless0.90
patchright0.90
patchright_headless0.90
playwright-chrome0.90
playwright-chrome_headless0.90
playwright-firefox0.90
playwright-firefox_headless0.90
selenium-chrome__no_proxy0.90
selenium-chrome_headless__no_proxy0.90
seleniumbase-cdp-chrome0.90
tf-playwright-stealth-chromium0.90
tf-playwright-stealth-chromium_headless0.90
tf-playwright-stealth-firefox0.90
tf-playwright-stealth-firefox_headless0.90
camoufoxnan
zendriver-chromenan
zendriver-chrome_headlessnan

Note 1: "nan" indicates no score was obtained - the website just stopped working when tests were run

Note 2: This Score is taken by solving the reCAPTCHA v3 on your browser. The Score shows if Google considers you as HUMAN or BOT. 1.0 is very likely a good interaction, 0.0 is very likely a bot With low score values (< 0.3) you'll get a slow reCAPTCHA 2, it would be hard to solve it. And vise versa, with score >= 0.7 it will be much easier.

CreepJS Scores - https://abrahamjuliot.github.io/creepjs

EngineTrust Score (%)Bot Score (%)WebRTC IP
adspower0.000.0090.214.10.188
adspower_headless0.000.00177.93.10.239
camoufox_headless0.000.00186.86.110.232
cloakbrowser0.000.00
cloakbrowser_headless0.000.00
nodriver-chrome0.000.00146.70.188.179
nodriver-chrome_headless0.000.00146.70.188.179
patchright0.000.00146.70.188.179
patchright_headless0.000.00146.70.188.179
playwright-chrome0.000.00146.70.188.179
playwright-chrome_headless0.000.00146.70.188.179
playwright-firefox0.000.00146.70.188.179
playwright-firefox_headless0.000.00146.70.188.179
selenium-chrome__no_proxy0.000.00146.70.188.179
selenium-chrome_headless__no_proxy0.000.00146.70.188.179
seleniumbase-cdp-chrome0.000.00
tf-playwright-stealth-chromium0.000.00146.70.188.179
tf-playwright-stealth-chromium_headless0.000.00146.70.188.179
tf-playwright-stealth-firefox0.000.00146.70.188.179
tf-playwright-stealth-firefox_headless0.000.00146.70.188.179
zendriver-chrome0.000.00
zendriver-chrome_headless0.000.00
camoufoxnannanNot detected

Note:

  1. CreepJS disabled trust and bot scores for now - https://github.com/abrahamjuliot/creepjs/issues/292
  2. If the WebRTC IP is different from your real IP - no leakage (applicable only with proxy).

IP (Ipify)

EngineIP
adspower90.214.10.188
adspower_headless177.93.10.239
camoufoxNot detected
camoufox_headless186.86.110.232
cloakbrowser179.0.46.130
cloakbrowser_headless193.5.237.36
nodriver-chrome190.232.219.121
nodriver-chrome_headless91.54.173.199
patchright24.78.176.233
patchright_headless181.46.71.26
playwright-chrome89.247.171.61
playwright-chrome_headless196.65.213.80
playwright-firefox79.8.183.149
playwright-firefox_headless130.0.11.123
selenium-chrome__no_proxy146.70.188.179
selenium-chrome_headless__no_proxy146.70.188.179
seleniumbase-cdp-chrome142.173.54.135
tf-playwright-stealth-chromium212.237.121.217
tf-playwright-stealth-chromium_headless83.168.89.168
tf-playwright-stealth-firefox196.98.139.187
tf-playwright-stealth-firefox_headless45.227.249.248
zendriver-chrome47.234.192.130
zendriver-chrome_headless142.173.61.185

Note: If the IP is your proxy's IP - good, your real IP - bad (applicapable only with proxy).

Visual Dashboard

Bypass Dashboard

Recaptcha Score Visualization

Recaptcha Scores

CreepJS Visualization

CreepJS Scores

๐Ÿ› ๏ธ Installation

Quick Start

  1. Clone the repository

    git clone https://github.com/techinz/browsers-benchmark.git
    cd browsers-benchmark
    
  2. Set up Python environment

    python -m venv venv
    source venv/bin/activate  # On Windows: venv\Scripts\activate
    pip install -r requirements.txt
    
  3. Install browser engines

    Playwright

    playwright install
    # On Linux also run:
    playwright install-deps
    

    Camoufox

    # Windows
    camoufox fetch
    
    # Linux  
    python -m camoufox fetch
    sudo apt install -y libgtk-3-0 libx11-xcb1 libasound2
    

    Patchright

    patchright install chromium
    

    AdsPower (optional)

    1. Download and install AdsPower desktop app
    2. Open AdsPower, go to Settings โ†’ API and enable the local API
    3. Copy your API key and set ADSPOWER_API_KEY in .env
    4. Keep AdsPower running while the benchmark is active - it manages the browser process
  4. Configure settings

    cp .env.example .env
    # Edit .env with your proxy settings if needed
    
  5. Configure proxies

    1. Create a file named proxies.txt in the documents directory.
    2. Add your proxy URLs in format http://username:password@proxy_host:port or http://proxy_host:port.
      โ—๏ธ IMPORTANT (1): Number of proxies has to be not less than number of engines you want to test.
      โ—๏ธ IMPORTANT (2): Some engines support different proxy protocols - for example, Playwright supports only HTTP and HTTPS, but NoDriver supports only SOCKS5.
      This implies that you have to add multiple proxy protocols to the proxies.txt file or exclude some engines from the test.
      At the moment you need all HTTP/HTTPS proxies and at least 1 SOCKS5 for NoDriver. Also, the benchmark will show you what proxy protocols are missing.
      โ—๏ธ IMPORTANT (3): Selenium won't use any proxies.

    Example proxies.txt content (each line is a separate proxy):

    http://proxy1.example.com:8080
    http://proxy2.example.com:8080
    http://username:password@proxy3.example.com:8080
    http://username:password@proxy4.example.com:8080
    socks5://username:password@proxy5.example.com:8080
    
  6. Run benchmark

    python main.py
    

โš™๏ธ Configuration

Environment Variables (.env)

# Proxy Configuration (highly recommended to enable)
PROXY_ENABLED=true
PROXY_FILE_PATH=documents/proxies.txt
PROXY_MAX_RETRIES=3

# Performance Settings
PAGE_LOAD_TIMEOUT_S=90
PAGE_STABILIZATION_DELAY_S=5
MAX_RETRIES=3

# AdsPower (optional โ€” only needed if running the adspower engine)
# Get your API key from AdsPower desktop app: Settings โ†’ API
ADSPOWER_API_KEY=your_api_key_here
ADSPOWER_BASE_URL=http://local.adspower.net:50325
ADSPOWER_GROUP_ID=

๐Ÿ“ˆ Output & Reports

The benchmark generates reports in the results/ directory:

  • summary.md - Human-readable markdown report
  • benchmark_results.json - Raw data for further analysis
  • media/ - Generated visualizations and screenshots
    • bypass_dashboard.png - Multi-metric dashboard
    • recaptcha_scores.png - reCAPTCHA performance chart
    • creepjs_scores.png - Fingerprinting resistance analysis
    • screenshots - Screenshots of all tested targets

๐Ÿ—๏ธ Architecture

The codebase follows a modular architecture for extensibility:

โ”œโ”€โ”€ config/           # Configuration management
โ”œโ”€โ”€ engines/          # Browser engine implementations  
โ”œโ”€โ”€ utils/
โ”‚   โ”œโ”€โ”€ targets/      # Test target definitions
โ”‚   โ”œโ”€โ”€ report/       # Report generation system
โ”‚   โ”œโ”€โ”€ logging/      # Structured logging
โ”‚   โ””โ”€โ”€ ...
โ””โ”€โ”€ results/          # Output directory

Adding New Targets

  1. Modify config/benchmark_targets.py to add custom test targets:

    Target(
        name="custom_site",
        url="https://example.com",
        check_function="check_custom_bypass",
        description="Custom site protection test"
    )
    
  2. Create a check function for the target in utils/targets/check_bypass, for example in a file named custom_bypass.py:

    from engines.base import BrowserEngine
    
    async def check_custom_bypass(engine: BrowserEngine) -> bool:
        element_found, element_html = await engine.locator('//div[@class="captcha"]')
    
        return not element_found # no captcha found - success!
    
  3. Add it to the checkers mapping in config/benchmark_targets.py's BypassTargetsSettings:

    checkers: Dict[str, Callable] = Field(
        default_factory=lambda: {
            "check_cloudflare_bypass": check_cloudflare_bypass,
            "check_datadome_bypass": check_datadome_bypass,
            ...
            "check_custom_bypass": check_custom_bypass,
        }
    )
    

Adding New Engines

  1. Extend the BrowserEngine base class:

    class CustomEngine(BrowserEngine):
        async def start(self) -> None:
            # Initialize browser
            
        async def navigate(self, url: str) -> Dict[str, Any]:
            # Navigation logic
    

    Or, if Playwright-based, extend PlaywrightBase base class:

    class CustomPlaywrightBasedEngine(PlaywrightBase):
        ...
    

    Or, if Selenium-based, extend SeleniumBase base class:

    class CustomSeleniumBasedEngine(SeleniumBase):
        ...
    
  2. Add it to the engines mapping in config/engines.py's EnginesSettings:

    base_engines = [
            {
                "class": PlaywrightEngine,
                "params": {"headless": True, "name": "playwright-chrome_headless", "browser_type": "chromium"}
            },
            ...
            {
                "class": CustomEngine,
                "params": {"headless": True, "name": "custom_engine", "browser_type": "chromium"}
            }
    ]
    

๐Ÿ”ง Platform-Specific Notes

Troubleshooting

Common Issues:

  • Detection failures: Verify proxy configuration and target accessibility

๐Ÿค Contributing

Contributions are welcome! Areas where help is needed:

  • New Protection Systems: Add support for additional bot detection services
  • Browser Engines: Implement support for new automation frameworks (e.g. Selenium-based)
  • Analysis Tools: Enhance reporting and visualization

๐Ÿ“ License

This project is licensed under the MIT License - see the LICENSE file for details.

โš ๏ธ Disclaimer

This tool is designed for educational and research purposes. Users are responsible for ensuring compliance with website terms of service and applicable laws. The authors and contributors do not encourage or endorse any malicious use of this software.