- Dependency updates.
- Adds support for Playwright 1.58.
- Docker image optimisations.
- Supports the following libraries and browsers:
- puppeteer-core:
24.36.1 - playwright-core:
1.58.1,1.57.0,1.56.1,1.55.1, and1.54.2. - Chromium:
145.0.7632.6 - Chrome:
144.0.7559.109(amd64 only) - Firefox:
146.0.1 - Webkit:
26.0 - Edge:
144.0.3719.104(amd64 only)
- puppeteer-core:
- Dependency updates.
- Updates NodeJS to
24.13.0. - Supports the following libraries and browsers:
- puppeteer-core:
24.36.0 - playwright-core:
1.57.0,1.56.1,1.55.1,1.54.2, and1.53.2. - Chromium:
143.0.7499.4 - Chrome:
143.0.7499.193(amd64 only) - Firefox:
144.0.2 - Webkit:
26.0 - Edge:
143.0.3650.139(amd64 only)
- puppeteer-core:
- Adds support for Playwright 1.57
- Supports the following libraries and browsers:
- puppeteer-core:
24.35.0 - playwright-core:
1.57.0,1.56.1,1.55.1,1.54.2, and1.53.2. - Chromium:
143.0.7499.4 - Chrome:
143.0.7499.193(amd64 only) - Firefox:
144.0.2 - Webkit:
26.0 - Edge:
143.0.3650.139(amd64 only)
- puppeteer-core:
- Standardizes on how path parsing works internally, exports the utility as well.
- Supports the following libraries and browsers:
- puppeteer-core:
24.26.1 - playwright-core:
1.56.1,1.55.1,1.54.2,1.53.2, and1.52.0. - Chromium:
141.0.7390.37 - Chrome:
141.0.7390.123(amd64 only) - Firefox:
142.0.1 - Webkit:
26.0 - Edge:
141.0.3537.99(amd64 only)
- puppeteer-core:
- Dependency updates.
- Bugfix when a trailing slash is present in /function API call.
- Supports the following libraries and browsers:
- puppeteer-core:
24.26.1 - playwright-core:
1.56.1,1.55.1,1.54.2,1.53.2, and1.52.0. - Chromium:
141.0.7390.37 - Chrome:
141.0.7390.123(amd64 only) - Firefox:
142.0.1 - Webkit:
26.0 - Edge:
141.0.3537.99(amd64 only)
- puppeteer-core:
- Dependency updates.
- Supports the following libraries and browsers:
- puppeteer-core:
24.26.1 - playwright-core:
1.56.1,1.55.1,1.54.2,1.53.2, and1.52.0. - Chromium:
141.0.7390.37 - Chrome:
141.0.7390.123(amd64 only) - Firefox:
142.0.1 - Webkit:
26.0 - Edge:
141.0.3537.99(amd64 only)
- puppeteer-core:
- Dependency updates.
- Handling of
ignoreHTTPSErrorstoacceptInsecureCerts. - Smaller fixes, testing updates, and graceful shutdown handling.
- Supports the following libraries and browsers:
- puppeteer-core:
24.23.0 - playwright-core:
1.55.1,1.54.2,1.53.2,1.52.0, and1.51.1. - Chromium:
140.0.7339.16 - Chrome:
141.0.7390.66(amd64 only) - Firefox:
141.0 - Webkit:
26.0 - Edge:
141.0.3537.57(amd64 only)
- puppeteer-core:
- Dependency updates.
- Adds a new
/function/connectroute to distinguish function API calls and not have them add to concurrency. - Fix installs in SDK projects not working.
- Supports the following libraries and browsers:
- puppeteer-core:
24.22.3 - playwright-core:
1.55.1,1.54.2,1.53.2,1.52.0, and1.51.1. - Chromium:
140.0.7339.16 - Chrome:
140.0.7339.214(amd64 only) - Firefox:
141.0 - Webkit:
26.0 - Edge:
140.0.3485.94(amd64 only)
- puppeteer-core:
- Dependency updates.
- Updates base image to Ubuntu
24.04. - Updates NodeJS to
24.8.0. - Move to
npm cifor automated tests and release processes. - Small cleanup in dockerfiles for consistency.
- Added a
npm run coveragecommand for determining areas of code needing coverage. bestAttemptfixes in the/scrapeAPI.- Fixes a few OpenAPI issues in the swagger.json manifests.
- Fixes issues where install-adblock can fail.
- Updated messaging around concurrency limits being reached.
- Few more unit-tests.
- Supports the following libraries and browsers:
- puppeteer-core:
24.22.0 - playwright-core:
1.55.0,1.54.2,1.53.2,1.52.0, and1.51.1. - Chromium:
140.0.7339.16 - Chrome:
140.0.7339.186(amd64 only) - Firefox:
141.0 - Webkit:
26.0 - Edge:
140.0.3485.81(amd64 only)
- puppeteer-core:
- Dependency updates.
- Fixes an issue with absolute path in swagger.json docs.
- Dependency updates.
- README spelling fixes.
- Bumps
puppeteer-coreto24.16.0. - Bumps
playwright-coreto1.54.2. - Updates the /pressure API to return a
503error when under load and theAcceptheader istext/plain. All other headers for "Accept" are treated similarly. - Internally, when Authorization is sent via the
tokenquery-parameter, browserless now migrates it to a more secureAuthorizationheader before processing the request. This prevents accidental logging in source as well as SDK projects. - Supports a
beforehook in routes so that pre-route logic can be applied before the request is handled by the route. - Fixes an issue in API's where a
requestInterceptorhas abodywith base64 encoded content. This is now properly handled and fulfills the request. - Minor internal changes and spec file updates.
- Dependency updates.
- Fix
page's created by playwright'scontextobject hanging. - Bumps
puppeteer-coreto24.12.1. - Bumps
playwright-coreto1.54.1. - Drops support for
playwright-coreat1.49. - Supports:
- puppeteer-core: 24.12.1
- playwright-core: 1.54.1, 1.53.1, 1.52.0, and 1.50.1
- Chromium: 139.0.7258.5
- Chrome: 138.0.7204.101 (amd64 only)
- Firefox: 140.0.2
- Webkit: 26.0
- Edge: 138.0.3351.83 (amd64 only)
- Dependency updates.
- Fixes an in request shimming when no params are sent.
- Fixes an issue in OpenAPI JSON schema parsing on routes with
.din their name.
- Dependency updates.
- Bump nodeJS to 24.2.0.
- Bumps
puppeteer-coreto24.10.2. - Bumps
playwright-coreto1.53.1. - Drops support for
playwright-coreat1.48. - Supports:
- puppeteer-core: 24.10.2
- playwright-core: 1.53.1, 1.52.0, 1.50.1, and 1.49.1
- Chromium: 138.0.7204.23
- Chrome: 137.0.7151.120 (amd64 only)
- Firefox: 139.0
- Webkit: 18.5
- Edge: 137.0.3296.93 (amd64 only)
- Dependency updates.
- Fixes an issue where ARM64 Platforms attempt to load non-compatible routes.
- Dependency updates -- including fix for tar-fs.
- Bumps
puppeteer-coreto24.10.0. - Remove stray console.log's in route building.
- Fixes for duplicative user-data-dir flags (fixes CI issues).
- Dependency updates.
- Cleans up the embedded Open API docs.
- Prettier
- Dependency updates.
- Bumps
puppeteer-coreto24.8.2. - Fixes a small issue in SDK OpenAPI docgen when overwriting an existing route.
- Dependency updates.
- The
buildcommand for SDK projects will no longer runcleanprior. - On startup, browserless will check dependencies and log if a browser isn't available for that platform. This only effects non-macOS arm64 platform Chrome and Edge routes. Prior to this an error would cause the application to quit at startup.
- Fixes for running Chrome and Chromium "non-headless" in playwright.
- Formatting, and stray console message cleanup.
- Logo fixes in README.md file.
- Dependency updates.
- Propagate library process exit codes through for SDK project commands.
- Better error messaging when queuing and concurrency are full.
- No browser binary changes.
- Dependency updates.
- New
MAX_PAYLOAD_SIZEenv variable for specifying a max-payload size in HTTP-based APIs. Value is a number specified in bytes, so10485760= 10MB. - Consolidation of HTTP and Websocket Error handling into a singular method.
- Dependency updates.
- Fix http routes being ignored in SDK projects.
- Dependency updates.
- Moves relevant ad-blocking infrastructure over to uBlock Lite.
- You can now supply a glob-pattern for the
CORS_ALLOW_ORIGINparameter in order to support multiple domains and URLs. When a domain doesn't match, browserless will return a 404. - Support for IPv6 when running on
::. - SDK projects will now ignore files found in
node_modules,dist,.next,.cache, orcoverage. - New
isMatchutility to do glob pattern matching in SDK and other projects. - Supports:
- puppeteer-core: 24.4.0
- playwright-core: 1.51.1, 1.50.1, 1.49.1, 1.48.2, and 1.47.2
- Chromium: 134.0.6998.35
- Chrome: 134.0.6998.166
- Firefox: 135.0
- Webkit: 18.4
- Dependency updates.
- Fixes to the
/sessionAPI to include proper host and port. - Bumping timeout for certain unit-tests.
- Supports:
- puppeteer-core: 24.3.0
- playwright-core: 1.50.1, 1.49.1, 1.48.2, 1.47.2, and 1.46.1.
- Chromium: 133.0.6943.16
- Chrome: 133.0.6943.127
- Firefox: 134.0
- Webkit: 18.2
- Removes edge from
arm64builds due to lack of support.
- Dependency updates.
- Supports:
- puppeteer-core: 24.2.1
- playwright-core: 1.50.1, 1.49.1, 1.48.2, 1.47.2, and 1.46.1.
- Chromium: 133.0.6943.16
- Chrome: 133.0.6943.127
- Firefox: 134.0
- Webkit: 18.2
- Pins playwright and puppeteer deps in package.json for browser-version consistency in SDK projects
- Added support for Edge browser! Check out available packages here.
- Fixes headers object in the /scrape API
- Code formatting fixes
- Link fixes in certain READMEs
- Dependency updates.
- Pins Ubuntu@22.04 in Github Actions.
- Fixes
headlesstypes to use--headless=newwhen prior libraries attempt to do--headless=old(older playwright). - Typing fixes.
- Dependency updates.
- Fix issues with Firefox when using a proxy.
- Fixes for the
/metaAPI in SDK projects. - Lint fixes.
- Link fixes in this CHANGELOG.md file.
- Dependency updates.
- Fixes for /performance API in SDK projects.
- Dependency updates.
- Supports:
- puppeteer-core: 23.10.1.
- playwright-core: 1.49.0, 1.48.2, 1.47.2, 1.46.1, 1.45.3 and 1.44.1.
- Chromium: 131.0.6778.33.
- Chrome: 131.0.6778.109.
- Firefox: 132.0.
- Webkit: 18.2.
- New
/metaAPI route for getting details about the container (versions, etc). - Bump NodeJS to
v22.11.0. - Add
libwebp-devfor Webkit. - Add support for
trackingIdand/kill/{id}and/kill/all. - Prettier, internal fixes and improvements.
- Dependency updates.
- Fixes
--proxy-bypass-listCLI arguments not being passed through with function API. - Addition of
fonts-open-sansto image.
- Dependency updates.
- New SDK project command of
npm run install:browsersto help with browser management. - SDK projects now appropriately handle routes when only certain browsers are available.
- Dependency updates.
- Ensure we don't load Chrome routes for SDK projects running linux/arm64.
- Dependency updates.
- Supports:
- puppeteer-core: 23.4.1
- playwright-core: 1.47.2, 1.46.1, 1.45.3, 1.44, and 1.43.
- Stream PDF using createPDFStream() in the PDF APIs.
- Inject file-system managers in browser-manager.
- Dependency updates.
- Adds a fix to SDK routes that might not require a browser but browserless will still make one.
- Dependency updates.
- Fix issues where connecting to a bad /devtools/page route can cause 500's.
- Dependency updates.
- Supports
puppeteer@23.3.0. - Support
playwright@1.47.0. - Use installed playwright-core for downloading browser binaries instead of
npx, ensuring the appropriate browsers are installed. - Fix JSON routes 404-ing when charset is specified in the content-type header.
- Disable the built-in debugger by setting
ENABLE_DEBUGGER=false. - Automatically run prettier on file save in VS Code.
- Windows fixes for SDK projects.
- README link fixes.
- Dependency updates.
- Drop
sort-keysfor eslint integrations. - Fix devtools URLs when
PROXYis set and contains a path. - Disable
authwhen using Chrome's internal/pageAPIs. - Small fixes for new eslint rules.
- Dependency updates.
- Supports
puppeteer-core@23.1.1. - Supports
playwright-core@1.46.1, 1.44.1, 1.43.1, 1.42.1, 1.41.2. - Trailing slashes on routes now won't 404, so
/chromeand/chrome/are treated as the same and will route properly. /functionAPI now works properly when applying a 3rd-party proxy.
- Dependency updates.
- Hide token in logs on startup.
- Fixes an issue where using
--proxy-servernow works with /function-API calls. - Adds support for the following CORS headers via env variables (headers and their corresponding config names are below). Please note that these are very permissive by default, but only set when
ENABLE_CORSistrue!- 'Access-Control-Allow-Credentials': CORS_ALLOW_CREDENTIALS (default '*')
- 'Access-Control-Allow-Headers': CORS_ALLOW_HEADERS (default: '*')
- 'Access-Control-Allow-Methods': CORS_ALLOW_METHODS (default: 'OPTIONS, POST, GET')
- 'Access-Control-Allow-Origin': CORS_ALLOW_ORIGIN (default: '*')
- 'Access-Control-Expose-Headers': CORS_EXPOSE_HEADERS (default: '*')
- 'Access-Control-Max-Age': CORS_MAX_AGE (default: '2592000')
- Dependency updates.
- Fixes numerous SDK issues when creating and building new projects.
- Dependency updates.
- Better extension handling and merging when passing in custom extensions.
- Fixes a bug where a failed job (error thrown) causes the internal queue to drain.
- Prettier and other source improvements.
- Bug fix to avoid removing healthy jobs from limiter when a job fails
- Dependency updates.
Potentially Breaking
- Merged duplicate code in browsers and fixed name
WebkitPlaywrighttoWebKitPlaywright(capitalized "K"). - Devtools now bundled into the repository at build-time for the
/debuggerroute. - Dependency updates.
Potentially Breaking
- The
browserhook now gets thereqproperty for the full request instead ofmeta. - Now embeds the debugger located at
/debugger. - Preliminary support for
trackingId. - Bug fixes when dealing with ignoreHTTPSError parameters.
- Bug fixes to the /function API when it throws errors.
- Prettier fixes.
- Dependency updates.
Potentially Breaking
- SDK projects should now use conventional class method properties versus the "fat-arrow" style instance methods.
Updates
- Support for multi-version playwright (puppeteer coming soon). Browserless now checks the version in the User-Agent header and loads the appropriate playwright server for it.
- Dependency updates.
- Wrap the pressure response in a pressure key.
- New
keepAliveproperty on browser objects for downstream SDK projects to flag. - Dependency updates.
- Adds back in the
/pressureAPI from V1. - Dependency updates.
- Dependency updates.
- Debugger is now included and mounted under the
/debuggerpath. - Browserless now uses the
Loggerutility internally. Better logs for certain classes as well. - Fix number of connected clients when using the Page websocket route.
- Allows "HEAD" requests for most "GET"-based APIs.
April 12, 2024 Potentially Breaking
- New
Loggerclass and SDK primitives in support of that. - Routes now get an instance of
Logger, before thebrowserargument or as the last argument for HTTP routes.
Updates
- Numerous SDK fixes and updates in the CLI.
- Dependency updates.
April 11, 2024
- Fixes a boot-looping issue due to bad startup script. Adds tests for this as well.
- Dependency updates.
- Support for Running GPUs
- Dependency updates.
- Fixes for function API calls when behind an external URL.
- Dependency updates.
- Adds a
GET /activeroute that responds with no message and a204http code. - Move to NodeJS 20.12.0.
- README, CHANGELOG, Migration and spelling fixes.
- New
/activeroute for determining if server is able to handle requests. - Better logging around 404'd HTTP requests.
- Dependency updates.
Confignow allows for programmatic getting and setting of the external address.- Support for a new
Hooksmodule for setting up hooks in a more SDK-friendly manner. - Adds new exports for building downstream SDK projects more easily, versus using our CLI:
getArgSwitchesgetSourceFilesinstallDependenciesbuildDockerImagebuildTypeScript
README.mdupdates.- Dependency updates.
Potentially Breaking
- Drops support for recording and screencasting in favor of library-based approaches.
playwright@1.42.1andpuppeteer@22.4.0.
Other Changes
- SDK routes now take precedence over core routes when a path-collision occurs.
- Support SDK projects with their own
staticdirectories. - Adds support for user-specified
stopmethods in SDK Module extensions. - Core modules now extend
EventEmitter, making them able to publish events. - Fixes issues with
addStyleTaghappening beforegotocalls in REST APIs. - Dependency updates.
Potentially Breaking
- Routes must define a unique
nameproperty in order to remove them in SDK projects. - A new
browserlessobject in the SDKpackage.jsonfile can specify module overrides, in camelCase, instead of using a path-based semantic. - Fixes issues with
npx playwright-core install...potentially installing other browser versions than what is a dependency of Browserless. - Fixes and other general improvements.
- Dependency updates.
Potentially Breaking
ghcr.io/browserless/chromenow runs actual Chrome and not Chromium! If you were using this tag please update to useghcr.io/browserless/chromium!- This Chrome tag uses the new routing convention below. If you get random 404's, please add
/chrometo the start of the route. EG,/pdfbecomes/chrome/pdf. - Websocket connections follow a similar breakage in that the URL will go from something like
ws://localhost:3000tows://localhost:3000/chrome.
- This Chrome tag uses the new routing convention below. If you get random 404's, please add
- Adds a new
ghcr.io/browserless/chromium, and updatesghcr.io/browserless/chrometo use actual Chrome. - New and current APIs now follow a routing convention of
/$BROWSER/$ACTION. In our Chrome image, you'll see/chrome/pdffor the PDF route as opposed to/pdf.- To keep things backwards compatible, all our prior REST APIs still have the same path as well as the new semantic, but only in the
multiandchromiumtags. - These backwards compatible routes are ONLY available in
ghcr.io/browserless/chromiumandghcr.io/browserless/multi.
- To keep things backwards compatible, all our prior REST APIs still have the same path as well as the new semantic, but only in the
- Refer to the embedded documentation site for any and all updates on API differences.
Other Changes
- HTTPRoutes and WebSocket routes can now have multiple paths to listen on.
- Add
cleancommand to@browserless.io/browserlessCLI. - Adds support for
/json/list,/json/new,/json/versionandjson/protocolAPIs (Chrome and Chromium only).- When both Chrome and Chromium are present (in the case of the multi image), browserless opts for Chromium for these requests.
- Removes legacy
browser.jsonfiles since browserless now generates those and caches when requested. - Stable docker images are coming! Please be sure to see our packages page for stable tags.
- Only verify that internally managed browsers are installed when starting.
- Preliminary support for
--headless=shell. - More unit-tests for the Chrome /json APIs.
- Dependency updates.
- Dependency updates.
- Name is now
@browserless.io/browserlessto reflect our npm package. - NEW: SDK is now live here: https://www.npmjs.com/package/@browserless.io/browserless.
- Drops gulp and other gulp utilities in favor of our own. Move to modules in
scriptsdir. - Many private class properties now use
protectedso they can be referenced in SDK extensions. - Adds a
/json/versionroute for older libraries that use it. - Merge startup/test scripts into
scriptsdir. - Moves installed browsers to
/usr/local/bin/playwright-browsers. - Merge root files into package.json where possible.
- README updates and fixes.
- Numerous link and copyright fixes.
browserless 2.0.0 represents the best body of work after running browserless for over 5 years. It contains mostly the same functionality and more, and is rebuilt to be more modular and offer a NodeJS SDK. It's also much lighter and faster than prior versions and includes a lot of semantic changes.
- ECMAScript style module loading and dependencies.
- New routing system using purely NodeJS's HTTP module.
- Better logs and concurrency/queueing parameters.
- Support for running the other major browser vendors in the same format and package.
- The service now compiles TypeScript to runtime JOI validation for our routes.
- Soon: upcoming support for extensions, long-running sessions and more.
- Remove support for Selenium.
- The
/functionAPI now runs inside the context of the browser and not in Node. - Drop support for keep-alive and pre-booting.
- Support for a single
launchquery-string parameter for launching a browser versus many individual parameters.
- Many docker parameters have been renamed, but are backwards compatible. See config.ts for details.
- FINAL of V1 for browserless/chrome. See notes on V2 here
- Dependency updates.
- Added
fonts-urw-base35. - Supports puppeteer
1.20,10.4.0,13.1.3,14.4.1,16.2.0,19.7.5and21.4.1. - Supports playwright
1.39,1.38,1.37,1.36,1.35,1.34, and1.33. - Fixes an issue where keep-alive chrome instances aren't properly tracked when
browser.closeis called. - Fix improper handling of HTTP writing on bare sockets with 500 errors.
- Dependency updates.
- Fixes an issue where calls to GET /sessions sometimes return blank results.
- Drop puppeteer
21.3.1in favor of21.3.6.
- Dependency updates.
- Drop the
partnerrepo from builds as we no longer use it for installingflash. - Bump to
Ubuntulunar. - Bump to NodeJS 18.17.0
- Package.json
engines.nodenow reflects what node version we run on the docker image. - Drops support for playwright@
1.33and default playwright to1.38. - Drops support for puppeteer@
21.1.1in favor of21.3.1. - Replaces legacy
requestmodule with Node's nativefetchfor webhooks. - Drops
node-fetchacross the board in favor offetchnative.
- Dependency updates.
- New build arguments in our Dockerfile to apply different named base repo.
- New
CHROME_STABLE_VERSIONbuild arg for specifying a particular chrome stable version. - Fixes in postinstall hooks for various platforms and chrome-stable.
- NEW:
waitForproperties in our APIs now supports an object with selector + timeouts for more fine tuning. - Bump puppeteer
20.x.xto21.1.1(116.0.5845.96). - Supports playwright versions
1.37,1.36,1.35,1.34, and1.33. - Fixes in deploy script to handle versions, platforms and architectures.
- Fixes an issue where headless defaults to
DEFAULT_STEALTH. - New
PREBOOT_QUANTITYfor overriding the amount of pre-booted instances of Chrome. - Allow using a host's display by setting
DISPLAYenv variable. - Link fixes in README.md.
- Dependency updates.
- Bump to Ubuntu Kinetic release + updates to use relevant packages.
- In support of puppeteer 20+, updates to
env.jsfor finding/symlinking Chrome. - Supports playwright
1.33,1.32,1.31, and1.29.. Drops support for earlier versions. - Ad-blocking and other request-interception in browserless is graceful using the
isInterceptResolutionHandledmethod.
- Dependency updates.
- Documentation link fixes.
- Add new required lib
libu2f-udev. - Support for puppeteer@19.7.5.
- Supports playwright versions:
1.27,1.28,1.29,1.30and1.31. - Better internal TypeScript definitions.
- Print's a few extra log-lines at startup for links to various resources.
/kill/allnow supports rebooting when PREBOOT is turned on.- Fixes an issue with chromedriver boot-looping in modern versions.
- Adds support for
--headless=new. - Fixes an issue where user-data-dirs aren't deleted due to a crashed container.
- Dependency updates.
- Add back in
puppeteer@13.1.3for PDF/Screenshot performance. - Replace
puppeteer@18.0.5in favor ofpuppeteer@19.2.2. - Better puppeteer install/binary path lookups.
- Support for the following playwright versions via the /playwright path:
- 1.23.3
- 1.24.2
- 1.25.2
- 1.26.1
- 1.27.1
- Dependency updates.
- Fixes various puppeteer issues with regards to revision information and browser-fetching.
- Fixes a Selenium issue where failed browsers can cause session to zombie.
- Small fix for route error handling.
- Better selenium W3C support.
Potentially Breaking
- Update base OS from Ubuntu 20.04 to Ubuntu 22.04.
- Drops
pathsupport for bothaddScriptTagandaddStyleTag. Useurlor inject content directly.
- Dependency updates.
- We now support multiple versions of playwright via
playwright-core. browserless checks the User-Agent string and tries to load a compatible playwright server at runtime in order to avoid breakages between versions. - New
scrollPageboolean parameter for the screenshot and other relevant APIs. - browserless now writes appropriately formatted HTTP and WebSocket messages for non-2xx responses.
- Better CI coverage with prior puppeteer versions.
- Adds back a
browser.jsonfile in our docker images for easier CDP-related queries. - A new
PORTarg is available at build time in order to specify a PORT to listen onto. - Updated links for browserless documentation in docs.
- Dependency updates.
- Add
browser.jsonfile to git tags. - Prettier fixes on source.
- deploy.js file fixes for creating production tags.
- Fix: add the
userDataDiroption so that we don't fill disks when usingstealth. - Fix: allow
disconnectlisteners to fire before closing.
- Dependency updates.
- Move to using
mochafor better esm support. - Drop puppeteer
13.6.0in favor of14.4.1. - Utilize puppeteer
14.4.1forchrome-stable. - New internal
getCDPClientfor loading a page's CPD connection.
- Dependency updates.
- Bump
browserless:baseto1.16.0. - Drop
--quietfrom deploy scripts. arm64support for latest as well as puppeteer at versions 9,10 and 13.- Update puppeteer 13 from
13.5.2to13.6.0(revision982053). - README updates.
- Dependency updates.
- Playwright example correction in README.md.
- Use revision
970485for puppeteer 13.x.x,latest, chrome-stable andarm64. - When using
KEEPALIVEandPREBOOT, don't create new blank pages, and use the existing one instead.
- Dependency updates.
- Added in new fonts:
fonts-gfs-neohellenic. - Minor code formatting changes.
- Drop puppeteer@13.1.3 in favor of 13.5.2.
- Make
heapdumpan optional dependency as it's not always used, and add it back in. - Utilize
fs/promisevs home-rolled promisified utils. - Fix an issue where PREBOOT and KEEPALIVE might return an
undefinedbrowser. - Logging when file-protocol requests happen and terminate a session.
- Move the browser process exit listener into the puppeteer-provider for better session cleanup.
- Allow "headfull" playwright sessions.
- Don't
awaitchrome-helper's closing of the browser as it's not truly async. - Remove
body-parserin favor ofexpress's JSON and other parsers. - Fixes an issue where using a user-data-dir that doesn't exist causes chrome to crash.
- Add in more unit and integration tests.
- Dependency updates.
- Added in new fonts:
fonts-gfs-neohellenic. - Minor code formatting changes.
- Drop puppeteer@13.1.3 in favor of 13.5.2.
- Make
heapdumpan optional dependency as it's not always used, and add it back in. - Utilize
fs/promisevs home-rolled promisified utils. - Fix an issue where PREBOOT and KEEPALIVE might return an
undefinedbrowser. - Logging when file-protocol requests happen and terminate a session.
- Move the browser process exit listener into the puppeteer-provider for better session cleanup.
- Allow "headfull" playwright sessions.
- Don't
awaitchrome-helper's closing of the browser as it's not truly async. - Remove
body-parserin favor ofexpress's JSON and other parsers. - Fixes an issue where using a user-data-dir that doesn't exist causes chrome to crash.
- Add in more unit and integration tests.
- Dependency updates.
- Updates the
vm2module to3.9.7.
- Dependency updates.
- New
viewportoption inside of the content API. - New
encodingoption in the screenshot API. - Drop puppeteer@12.x.x in favor of 13.x.x.
- Fixes in our deploy scripts.
- Fixes for windows binaries in our postinstall hook.
- Fixes an issue where playwright tries to use a pre-booted chrome instance.
- Small type updates.
- Dependency updates.
- Drops support for
puppeteer-4.0.1in favor ofpuppeteer-12.0.1. - Chrome-stable now utilizes puppeteer @
12.0.1. - Support for
arm64via production tags (1-arm64) as well as inlatest. - Static JSON files (
protocol.json,version.json) are built at runtime on their first request and then cached in memory. - Bumps
browserless/baseto1.14.0. - New
selectorproperty for screenshot-ing a single DOM node in the screenshot API. puppeteerVersionsin the package.json file has been rename dochromeVersions.- Internal changes for deploying production tag scripts.
- Consolidate scripts for
postinstall. - Drop support for
heapdumpdue to its age and lack of platform varieties. - New
/metrics/totalroute for summing up all statistics in a single JSON payload.
- Dependency updates.
- Fix webhook not using timeout URL.
- Dependency updates.
- Support for ARM64 builds by dropping flash for it.
- Bump puppeteer 10.2.0 for 10.4.0.
- New puppeteer-hook for injecting a puppeteer-compatible library, eg. puppeteer-extra.
Potentially Breaking
- API calls with
htmlin their payloads now use thepage.setContentAPI versus a prior hack using one-time network-request interception (example here). Old versions of puppeteer might not work properly with this (<= 5.x.x). This effects the following APIS:/content,/pdfand/screenshot.
- Dependency updates.
- Bump
browserless/baseto1.12.0(add user-id toblessuserofBLESS_USER_ID=999). - Bumps puppeteer @10.x.x to
10.2.0with revision901912. - Makes API calls use
setContentproperly now (no more one-time network interception). This fixes certain issues with images not loading in PDFs and screenshots. - Fix some typings in tests.
- Dependency updates.
- Bump
browserless/baseto1.11.0. - Add new lint task and rename GitHub actions tasks, remove
tslint. - Lint and prettier fixes.
- Delay url parsing until after
beforehook runs. - New
metaobject param for page hooks (passing through arbitrary meta data set by prior hooks). - New
FUNCTION_ENV_VARSenvironment variable pass through an allow-list of environment variables for functions to access. - Fix
someObject.hasOwnPropertytoObject.prototype.hasOwnProperty.call.
- Dependency updates.
- Move to Node 16.x.x.
- Bump browserless/base to 1.10.0.
- Limit
x-response-urlto 100 characters. - Add support for puppeteer@10.x.x.
- Add
maxConcurrentstat for metrics API + log stats every 5 minutes to stdout. - Some performance improvements to how pages/browsers are setup and torn down.
- Add
API_DOCS_ENDPOINTas a filterable API to deny access to. - Minor code reformatting from prettier.
- Better page setup and logging.
- Fixes
DEFAULT_STEALTHfor self-hosted deployments. - Improvements on how chrome is closed.
- Dependency Updates.
- Support for playwright proxies.
- Fixes an issue with larger headers potentially causing load-balancers to crash and fail.
Potentially Breaking
PROXY_HOSTandPROXY_PORTare now replaced with a singlePROXY_URLparam, eg:https://www.mybrowserless.com/optional/paths. When set, browserless uses this fully-qualified URL to build out links back to its internal debugger and sessions. Useful when you're instance is behind a proxy or load-balancer of some kind.
- Dependency Updates.
- Use recent Node 14 (browserless-base 1.7.0).
- New
rejectResourceTypesproperty on most APIs (content, screenshot, pdf, etc.). - Allow serving of
file://protocols when explicitly enabled (default is off due to security concerns). SetALLOW_FILE_PROTOCOL=truein your env params. - The
/pressureAPI now takes into account CPU/Memory consumption, and adds a "reason" property for why the machine might be not available. - Fixes an issue where playwright couldn't download files.
- You can now filter /sessions calls with a
trackingIdparameter. detachedfunctions now return atrackingIdwhen present.- More types, tests, and utility consolidation.
- Dependency Updates.
- Fixes an issue where --user-data-dirs aren't deleted properly, potentially filling disks.
- Changes CPU/Memory checks to be user-based and not the entire OS.
- Adds tests for the user-data-dir issue.
- Dependency Updates.
- Move to Node 14!
- Use
esModuleInteropfor imports. - Remove
page.waitForin favor of downstream methods. - Adds new
?stealthparameter for API calls (see puppeteer-extra-stealth-plugin). - New
DEFAULT_STEALTHparam for making stealth calls by default. - Fixes
ignoreDefaultArgsin chrome stable. - Ensure temp user-data-dirs are always cleaned up.
- Dependency Updates.
- New
SESSION_CHECK_FAIL_URLwebhook for when pre-session checks fail. - Health checks now take the last two CPU/Memory samples to determine if a failure (5 minutes).
- Dependency Updates.
- Fix potentially unhandled stream error events when closing chrome.
- Bump puppeteer to 5.4.1 for major 5.
- Dependency Updates
- New
SOCKET_CLOSE_METHODfor better load-balancing behavior when under load.
- Dependency Updates
- Support for playwright 1.4.0 and greater. See more here.
- New
PRE_REQUEST_HEALTH_CHECKenv variable to check CPU/Memory prior to running a session. SetMAX_CPU_PERCENTorMAX_MEMORY_PERCENTfor setting these thresholds. Responds with a503HTTP code if CPU/Memory are high on any inbound session (API, puppeteer or webdriver).
- Dependency Updates
- Fixes a crash due to
browser.closestreams not completing properly. - Adds a
dumpioquery-string parameter for launching with puppeteer.
- Dependency Updates
- Fixes a memory leak when browsers don't close properly.
- Adds a
/heapdumproute for capturing heap dumps. Turn on by settingENABLE_HEAP_DUMP=truein your docker env. emulateMediafixes on the pdf route.- CodeQL implemented.
- README fixes.
- Dependency Updates
- Fixes an issue where the webserver can crash after rejecting a request.
- Fixes deployment script not waiting for zip files to be finished unzipped.
- Dependency Updates
- Fixes an issue in webdriver not starting properly.
Potentially Breaking
- Due to stability issues, puppeteer version 3.x.x and 4.x.x now use chromium revision
782078. See ourpackage.jsonfor details.
- Dependency Updates
- README Updates
- Fixes an issue for secured containers using prometheus (plus tests).
- Support for puppeteer
5.2.1
- Dependency Updates
- Drops support for puppeteer
2.0.0and3.0.4, please use2.1.1and3.3.0for those revisions. - Adds support for puppeteer
5.0.0. - Bug-fix with the server randomly closing with an uncaught error event thrown from inside underlying socket connection.
- Adds back in
--disable-dev-shm-usageto default arguments for better SHM performance.
- Dependency Updates
- New
maxTime,minTime,meanTimeandtotalTimeof all sessions for a given period in /stats. - Bugfix on CPU/Memory triggering health failure webhooks.
- Fix issues in websocket errors by awaiting browser.close (or 5 seconds, whichever is quickest).
Potentially Breaking
- screencast API no longer supports
audioor thesetPreferencesfunction in order to offer a better video experience. In order to set the width/height, simply set a page width height to what you'd like. chrome-stablewill now usepuppeteer@3.1.0for better compatibility.
- Dependency updates.
- Drops puppeteer version
1.20.0and below. - Move
browserless/basetov1.5.0. - Puppeteer support for
3.3.0(3.2.x and 3.1.x have the same chromium revision). - Fixes
trackingIdon pre-booted sessions. about:blankpages now are returned in the/sessionsAPI for transparency of open sessions/browsers.
- Dependency updates.
- Fix socket errors from accidentally firing error webhooks.
- Drops support for puppeteer 1.17.x and 1.18.x
- Support for puppeteer 3.0.x
- Dependency updates
- Fix reject stat firing on debugger pages not being found
- Consolidates more types.
- Dependency Updates.
- Adds roboto fonts.
- Updates
pressureAPI to take account of running browsers in therunningcount. - Adds
maxConcurrent,maxQueued,cpuandmemoryto pressure.
- Dependency Updates.
- Fixes a small issue where XVFB doesn't start properly during an automated restart.
- Dependency Updates.
- Allows
trackingIdon uploaded files to save in the appropriate tracking-ID folder. - New
userAgentparam for setting user-agent in API requests. - Fixes an issue where chrome wasn't being closed in rare cases.
- Dependency Updates.
- Updates to Node 13 for speed and memory improvements.
- browserless/base@1.4.0
- Dependency Updates.
- Fixes how deploy script determines errors when running child commands.
- Fixes issues when many selenium sessions can potentially fill up disk space.
- Dependency updates.
- Uses
pipe's for most API calls and other internal endpoints for faster/better throughput. Works only forheadlessAPI/puppeteer calls. - Allows custom lighthouse configs via POST
configproperty. - Patches vm2.
- Before hooks no longer end requests forcefully -- external hooks must manually end the request/sockets themselves.
- Properly passes socket errors to the error handler/webhook
- Dependency updates.
- Sets a system-default font of Ubuntu for most sites that use
system-uiin their font declarations. - Fixes health-check failure webhooks.
- New
PROXY_HOST,PROXY_PORTandPROXY_SSLfor external load-balancers. See docsite for more info. - Moves over to GH actions over Travis for CI.
- Dependency updates.
- New
manipulateparams for screenshots, allowing for resizing, flipping and more. - Better tracking of chrome-process for cleanup of zombied sessions.
- Dependency updates.
- Added
gitas a dependency in dockerfile for git-based npm dependencies to work. - Fixed an issue in
start.shso that errors bubble up properly and close the process. - Bumps
browserless/baseto1.2.0.
- Dependency updates.
- Dropping pre-push hooks for speed.
- Consolidate all interfaces/types to a types.d.ts file.
- Fixes an issue where numerous chrome instances launch when prebooting.
- Fixes an issue where incoming requests don't use the pre-booted chrome instance.
- Uses
page.setViewportwhen--window-sizeis set in params to help with screenshots not appearing properly (chromedriver only).
- Dependency updates.
- Stricter build-time arguments for chromium and chromedriver assets.
- Better XVFB functionality.
- New parameters for most API's,
addScriptTagandaddStyleTag, accepting an array of scripts/styles respectively. - Drop support for
puppeteer@1.17.0. - Proper support for parsing
ignoreDefaultArgsquery-parameters.
- Dependency updates.
- Bugfix on our debugger's play button being off-center.
- Fixes driver.close() calls not cleaning the browser.
- New
/GEToption for most our APIs. Stringify your JSON and add a ?body=YOUR-JSON with a /GET call to most of our functions! RequiresENABLE_API_GET=truein you docker env variables. - WebSocket (Socket) exception handling and logging.
- More integration and unit tests added.
- Fixes an issue in chromedriver where commands would hang.
- Fixes an issue in chromedriver sessions not being removed properly.
- Fixes and pins the base image so that headful sessions work again.
- Dependency updates.
- Use
apt-getto installdumb-init. - Add a LANG arg in docker.
- New
setJavaScriptEnabledproperty for REST APIs. - Fixes an issue with
waitForfunctions in REST API calls. - Fixes issues when PREBOOT_CHROME and KEEPALIVE are true.
- Updates protocol and host information in ad-blocking.
- Dependency updates.
- Removal of unnecessary '--disable-dev-shm-usage'
- Squelching of chromedriver's verbose args unless
DEBUG=*is set. - New
/kill/${id}route for remotely killing a certain browser. - Allowing of sub-child routes in workspaces.
- Dependency updates.
- New
viewportproperty option for PDF endpoint. - The
/statsendpoint now runs in a separate process meaning it can be parallelized. - Fixed a bug where hardware monitoring can cause the container to restart/crash.
- Fixes an issue with the file-chooser API not working in puppeteer.
- Dependency updates.
- New
/scrapeAPI!
- Dependency updates.
- Fixes chrome-stable's binary chromedriver.
- Move over to Node 12.
- Bugfix on width/height in the screencast API.
- Support for puppeteer@2.0.0.
- Fixed issues with the devtools JS files missing.
- Adds support for blacklisting routes in Docker.
- Consolidates hooks into a hooks module.
- Allows Selenium to specify download-paths and pausing via preferences.
- Fixes an issue in certain JSON-based CDP libraries.
- Function API's can now run incognito mode with a new Docker param.
- Dependency updates
- Better
IS_DOCKERcheck for kubernetes. - Updates to README.md, spelling fixes and Slack link.
- Fixes to debugger and larger code bodies.
- Removal of analytics in debugger.
- Screencast improvements and adding ability to set new options.
- New
waitForproperty in our APIs (content, pdf and screenshot). - Don't allow file requests on the debugger for security reasons.
- Better metrics monitoring.
singleRunmode in docker.- New prometheus support!
- Fixing issues with keeping chrome alive (only closing once TTL is met).
- Dependency updates
- Splitting docker images into two repositories for faster builds and pulls
- Adding in external routing capabilities
- New error hook
- More/better types
- Updating
deviceScaleFactorin API's for more granular control. - Better chromedriver failure messages.
- Adding
ffmpegto the docker dependency list. - Add
timecutas a dependency for recording. - Better logs on chrome PID's and closing forcefully.
- Fixed
DEFAULT_CHROME=>DEFAULT_HEADLESS. - Fixed a bug where
xvfbdoesn't start in time. - Use
SIGKILLfor killing chromedriver. /json/versionnow returns awebSocketDebuggerUrl.
- New
pageandbrowserhooks for docker images thatFROMbrowserless. bluebirdadded as a module forfunctionand other endpoints.- More dependency updates.
- Bugfix when running multiple "headfull" sessions.
- Dependency updates.
- New
WORKSPACE_DELETE_EXPIREDandWORKSPACE_EXPIRE_DAYSto auto-cleanup workspace dirs. - README.md cleanup now that HTTPS is no longer required.
- Support for
~in docker env parameters. - More alignment with how chromedriver and puppeteer sessions get cleaned up.
/sessionAPI now returnsbrowserWSEndpointandbrowserIdproperties for having multiple debuggers connected.- Support for reconnecting(!!). When a
?keepalive=KEEP-ALIVE-IN-MSis seen in thepuppeteer.connectcall we keep the browser active for that many ms after the debugger disconnects. - New
/kill/allroute which closes all actively running sessions. - New internal scheduler module, making future things like cron-based jobs a possibility.
- Better internal types.
- A minor refactor to consolidate calls to
url.parsefor performance gains. - Introduces a per-session based timeout that overrides the global timeout.
- Consolidates authorization checks to remove duplication.
- Moves more types into their backing modules in order to better consolidate files.
- Set's a non-conflicting
WORKSPACE_DIRandDEFAULT_USER_DATA_DIRin docker by default. - Drops support for puppeteer
1.15.0and adds1.19.0. - Web-based debugger now sends cookies for docker deployments that are secure.
- Live debugger is now self-hosted, no more enforced https though it's still recommended.
- Consolidated build steps.
- Using the same chromedriver binary that matches the puppeteer's bundled chromium.
- Introducing
trackingIdworkflows. - Fixing unused export's, removing extraneous internal methods.
/workspaceAPI now returns sub-files and scopes sessions bytrackingIdwhen present.- Support for
/json/newprotocol. - Dependency updates.
- Dropped support for puppeteer
1.9.0 => 1.14.0. - Added support for puppeteer
1.16.0 => 1.18.0. - A version of chromedriver is now installed to perfectly match the version of puppeteer's chromium.
- In dev, chromedriver now uses the puppeteer version of chromium.
- Defaulted most ENV-variables in docker to sensible defaults.
- New
rotatefeature for PDF endpoint:{ rotate: 90 }=> rotate left 90 degrees. - Support for
browserless.tokenin the docker image. - puppeteer integration now returns semantic HTTP codes for certain errors (
400,403and429). - Support for chromedriver's move to the W3C spec 'goog:chromeOptions'.
- The debugger now filters out
about:blankpages, and includes sessions by Selenium. - Workspace support for selenium-based integrations.
- Better handling of browser/socket closing in puppeteer integrations.
- Numerous screencast fixes.
- Moved all GH links to new repo location.
- Dep updates.
- Better windows dev experience.
- Indian font support.
- Video capture now supports audio and browser width/height.
- Dependency updates.
- DEFAULT env variables for launching pre-booted Chrome.
- Dep updates
- New
?blockAdsquery-parameter for disabling 3rd-party ad calls.
- New
authenticateandsetExtraHTTPHeadersparams for thecontent,pdf, andscreenshotAPIs. Useful for using proxies in our REST APIs. - Fixed a bunch of bugs inside of the webdriver integration, making it more REST-ful.
- Updated dependencies inside of Chromedriver.
- New
DISABLE_AUTO_SET_DOWNLOAD_BEHAVIORfor mitigating errors in puppeteer < 1.15.0. - Bumped Puppeteer to 1.15.0.
- New
/sessionAPI (and accompanying routes) for display/viewing active sesions in a remote debugger(!). - New
?pausequery-param for pausing sessions prior to running them (useful for the live debug viewer). - The browserless debugger now exposes links to these debug pages via the sidebar.
- New Debugger page can be disabled via the
ENABLE_DEBUG_VIEWER=falseenvironment variable flag. - Move to use
node@10. - No more
no-implicit-any's inside the codebase.
- During connection, we now set the download dir of REST and puppeteer sessions. Cloud users and docker users no longer have to manually set this field, and the
/workspaceAPI references it as well!
- New deploy.js file to do deployments "on-prem"
- Updated new builds for puppeteer 1.12.2 and 1.13.0
- Fixes an issues in CORS handling
- The
screenshot,function,pdf, andcontentAPI's now accept new content-types for easier POSTing of small payloads (see docsite). - The
screencastAPI can now start/stop recording programmatically via astartScreencastandstopScreencastparams (see docsite). - New
externaldir for injecting custombeforeandafterhooks in external docker builds. - A new
timeoutquery-option for session-based timeouts vs using the global one. - New
requestInterceptorsfor injection custom request behavior.
- Numerous default fixes in the APIs.
- Stray consoles removed :)
- Consolidated download behavior in
screencastanddownloadAPIs
- New
requestInterceptorsfor the /screenshot API, allowing you to mock data in response to a request. - Code debugger now transmits code over-the-wire via cookies to avoid URL max-length issues.
- Now supports cookie-based authentication via a
browserless_token=TOKEN;cookie.
- Comments in the debugger won't break it.
- Requests that are rejected due to auth reasons aren't logged in stats.
With 1.1.0 we offer a refined way of dealing with both downloads and uploads. Both use-cases are tightly coupled to the file-system, and can leave you scratching your head as to what's going one. For more information and detailed documentation, please refer to our doc-site at https://www.browserless.io/
- New
WORKSPACE_DIRvariable for controlling where browserless stores files and uploads. - New
/workspaceAPI for doing RESTful operations on the downloads/uploads file-system. - New
/downloadAPI for running a puppeteer-script, and responding with the resulting downloaded file.
- Moved routes out of the browserless module and into their own file/module.
- Renamed the
browserless-web-servicemodule to justbrowserlessfor simplicity. - Moved the
DOWNLOAD_DIRtoWORKSPACE_DIRsince it handles both uploads and downloads.
🥁 -- Stable version 1.0 is here! While this doesn't include major functionality changes, it does change how the docker builds are generated going forward. The versioning will now contain two pieces of crucial information: the version of the browserless service + the version of Chrome under-the-hood. For instance 1.2.3-puppeteer-1.10.0 is browserless at 1.2.3, exposing puppeteer at 1.10.0.
Similar to how NodeJS itself does docker releases, we'll now provide releases in 3 distinct ways:
- An immutable, pinned version release:
1.0.0-puppeteer-1.11.0 - A mutable minor version release:
1.1-puppeteer-1.12.0 - A mutable major version release:
1-puppeteer-1.9.0
For production deployments, we recommend using pinned version releases as they won't change once released. The mutable minor/major releases will receive on-going updates whenever we do changes that are bug-fixes or feature release. Even with the best intentions it's possible that instability can be introduced with these mutable images, hence why recommend the pinned version releases.
Finally, we'll continue to ship support for the last 5 minor versions of Puppeteer + the Google Chrome (stable). Old images will remain, but newer versions of browserless won't be included.
We'll continue to keep this changelog up-to-date anytime we do docker releases.