Fetch Bulk
API functions for the Fetch Bulk resource.
Fetch Bulk
Functions for interacting with the fetch_bulk API resource. Each operation ships in four forms — sync / sync_detailed and their async counterparts.
Create Fetch Bulk
Bulk fetch URLs
Enqueues multiple URLs for HTTP fetching. Results delivered via webhook. Does not support options that require page rendering (wait_for_selector, etc.).
Limits: request bodies are guarded in a two-tier shape. A streamed body
with no Content-Length header is capped at 2 MB before your API key
is checked; a body that declares Content-Length is instead bounded
there by a 20 MB fail-safe (not the real limit — see below), since
that branch reads nothing until your key is verified. Once your key
is verified, a second check re-gates the body against your account's
own max_bulk_size (at this endpoint's per-item override budget),
which reaches 16.8 MB for the largest documented account. A
standard-plan account's effective ceiling is 2 MB; either tier's
overrun returns a 400 with error code request_too_large.
Parameters
body (CreateFetchBulkBody)
Call styles
sync_detailed(client=client, body=body) -> Response[Union[CreateFetchBulkResponse202, Error]]
sync(client=client, body=body) -> Optional[Union[CreateFetchBulkResponse202, Error]]
await asyncio_detailed(client=client, body=body) -> Response[Union[CreateFetchBulkResponse202, Error]]
await asyncio(client=client, body=body) -> Optional[Union[CreateFetchBulkResponse202, Error]]Get Fetch Bulk
Get fetch bulk job status
Returns the job envelope plus its per-URL items.
Downloading item content. Each completed item's content_url is a
pre-signed URL, minted fresh on every read of this endpoint and valid
for 600 seconds (10 minutes) — the same signing lifetime as the
image_url returned by GET /v1/bulk/\{id\}/screenshots. The underlying
objects are private, so an unsigned URL returns 401: download the
content inside that window, or re-poll this endpoint for a fresh
signature. Items that are not completed, and completed items with no
stored object, carry null or the unsigned stored URL instead.
Parameters
id (str)
Call styles
sync_detailed(id=id, client=client) -> Response[Union[Error, GetFetchBulkResponse200, GetFetchBulkResponse202]]
sync(id=id, client=client) -> Optional[Union[Error, GetFetchBulkResponse200, GetFetchBulkResponse202]]
await asyncio_detailed(id=id, client=client) -> Response[Union[Error, GetFetchBulkResponse200, GetFetchBulkResponse202]]
await asyncio(id=id, client=client) -> Optional[Union[Error, GetFetchBulkResponse200, GetFetchBulkResponse202]]