SDK ReferencePython SDK

Fetch Bulk

API functions for the Fetch Bulk resource.

Fetch Bulk

Functions for interacting with the fetch_bulk API resource. Each operation ships in four forms — sync / sync_detailed and their async counterparts.

Create Fetch Bulk

Bulk fetch URLs

Enqueues multiple URLs for HTTP fetching. Results delivered via webhook. Does not support options that require page rendering (wait_for_selector, etc.).

Limits: request bodies are guarded in a two-tier shape. A streamed body with no Content-Length header is capped at 2 MB before your API key is checked; a body that declares Content-Length is instead bounded there by a 20 MB fail-safe (not the real limit — see below), since that branch reads nothing until your key is verified. Once your key is verified, a second check re-gates the body against your account's own max_bulk_size (at this endpoint's per-item override budget), which reaches 16.8 MB for the largest documented account. A standard-plan account's effective ceiling is 2 MB; either tier's overrun returns a 400 with error code request_too_large.

Parameters

  • body (CreateFetchBulkBody)

Call styles

sync_detailed(client=client, body=body) -> Response[Union[CreateFetchBulkResponse202, Error]]
sync(client=client, body=body) -> Optional[Union[CreateFetchBulkResponse202, Error]]
await asyncio_detailed(client=client, body=body) -> Response[Union[CreateFetchBulkResponse202, Error]]
await asyncio(client=client, body=body) -> Optional[Union[CreateFetchBulkResponse202, Error]]

Get Fetch Bulk

Get fetch bulk job status

Returns the job envelope plus its per-URL items.

Downloading item content. Each completed item's content_url is a pre-signed URL, minted fresh on every read of this endpoint and valid for 600 seconds (10 minutes) — the same signing lifetime as the image_url returned by GET /v1/bulk/\{id\}/screenshots. The underlying objects are private, so an unsigned URL returns 401: download the content inside that window, or re-poll this endpoint for a fresh signature. Items that are not completed, and completed items with no stored object, carry null or the unsigned stored URL instead.

Parameters

  • id (str)

Call styles

sync_detailed(id=id, client=client) -> Response[Union[Error, GetFetchBulkResponse200, GetFetchBulkResponse202]]
sync(id=id, client=client) -> Optional[Union[Error, GetFetchBulkResponse200, GetFetchBulkResponse202]]
await asyncio_detailed(id=id, client=client) -> Response[Union[Error, GetFetchBulkResponse200, GetFetchBulkResponse202]]
await asyncio(id=id, client=client) -> Optional[Union[Error, GetFetchBulkResponse200, GetFetchBulkResponse202]]