CLI
Scrape
Scrape URL content
Scrape URL content
scrape › bulk
Bulk scrape operations
| Option | Description |
|---|---|
-h, --help | display help for command |
scrape › bulk › create
Create a bulk scrape job
| Option | Description |
|---|---|
--file <path> | Path to newline-delimited file of URLs (plain URL or |
--webhook-url <url> | HTTPS webhook URL notified when the job completes |
-h, --help | display help for command |
$ bytekit scrape bulk create --file <path> --webhook-url <url>scrape › bulk › get
Get a bulk scrape job
| Option | Description |
|---|---|
-h, --help | display help for command |
$ bytekit scrape bulk get <id>scrape › create
Create a scrape job
| Option | Description |
|---|---|
--url <url> | URL to scrape |
--format <format> | Output format (e.g. markdown, html); sent as the formats |
--raw | Print the requested format body raw, with no JSON |
-o, --output <file> | Write the output to the given file path (implies --raw |
-h, --help | display help for command |
$ bytekit scrape create --url <url> --format <format> --rawscrape › get
Get a scrape job by ID
| Option | Description |
|---|---|
-h, --help | display help for command |
$ bytekit scrape get <id>