Cloudflare Workers
使用 Firecrawl 与 Cloudflare Workers,在边缘环境中搜索、抓取并与网页数据交互。
- Wrangler CLI (
npm install -g wrangler) - Firecrawl API 密钥——免费获取
npm create cloudflare@latest my-scraper
cd my-scraper
npm install firecrawl将你的 API 密钥添加为 Secret:
wrangler secret put FIRECRAWL_API_KEY创建一个处理函数,用于进行网页搜索,并返回包含完整页面内容的结果。
编辑 src/index.ts:
import { Firecrawl } from "firecrawl";
export interface Env {
FIRECRAWL_API_KEY: string;
}
export default {
async fetch(request: Request, env: Env): Promise<Response> {
const firecrawl = new Firecrawl({ apiKey: env.FIRECRAWL_API_KEY });
const url = new URL(request.url);
if (request.method === "POST" && url.pathname === "/search") {
const { query } = (await request.json()) as { query: string };
const results = await firecrawl.search(query, { limit: 5 });
return Response.json(results);
}
return new Response("Not found", { status: 404 });
},
};添加一个 /scrape 路由,用于从任意 URL 提取干净的 Markdown。
if (request.method === "POST" && url.pathname === "/scrape") {
const { url: targetUrl } = (await request.json()) as { url: string };
const result = await firecrawl.scrape(targetUrl);
return Response.json(result);
}添加 /interact 路由以控制实时浏览器会话——点击按钮、填写表单,并提取动态内容。
if (request.method === "POST" && url.pathname === "/interact") {
const result = await firecrawl.scrape("https://www.amazon.com", {
formats: ["markdown"],
});
const scrapeId = result.metadata?.scrapeId;
await firecrawl.interact(scrapeId, {
prompt: "Search for iPhone 16 Pro Max",
});
const response = await firecrawl.interact(scrapeId, {
prompt: "Click on the first result and tell me the price",
});
await firecrawl.stopInteraction(scrapeId);
return Response.json({ output: response.output });
}wrangler deploycurl -X POST https://my-scraper.<your-subdomain>.workers.dev/search \
-H "Content-Type: application/json" \
-d '{"query": "firecrawl web scraping"}'Was this page helpful?Suggest editsRaise issue