omp packages

webforai-cli5.0.3

The webforai CLI: convert web pages and local HTML to clean, LLM-ready Markdown from the shell or an AI agent (npx webforai-cli <url>).

GitHub Actions Published 3 days ago Apache-2.0 ~441 downloads/mo

Untested on omp

This is a pi package. No one has reported whether it works on omp yet. If you try it, add your result below.

Did it work for you?

Result

One report per person. A new report replaces your old one.

Reports 0

No reports yet.

Readme

webforai-cli

Any HTML to the cleanest Markdown, from the shell. Reader mode (default) extracts the main content of a page, like Mozilla Readability; agent mode (--extractor agent) adds only the links an AI agent needs to explore the site, for about half the tokens of the whole page. The Markdown goes to stdout and every log to stderr, so it composes with pipes, scripts and AI agents. Conversion is done by the webforai library, which has the benchmarks; this package adds the command.

npx webforai-cli https://example.com/article                    # Markdown to stdout
npx webforai-cli https://example.com/article --extractor agent  # with the links an agent needs
npx webforai-cli https://example.com/article -o out.md          # write a file
npx webforai-cli ./page.html                                    # convert a local HTML file
npx webforai-cli https://example.com --json                     # machine-readable envelope

Install it once to keep a webforai command on your PATH:

npm uninstall -g webforai   # only if webforai v4 is installed globally: it owns the same command
npm i -g webforai-cli
webforai https://example.com/article

Up to v4 the CLI shipped inside the webforai package (npx webforai). Since v5 that package is the library only, and npx webforai prints the webforai-cli command to run instead. Flags and exit codes are unchanged.

Hosted platform

--engine, crawl and batch use the webforai platform, which renders JavaScript, goes through proxies and crawls whole sites. They need an API key from platform.webforai.dev:

export WEBFORAI_API_KEY=wfa_...
npx webforai-cli https://example.com --engine auto                   # renders JavaScript when needed
npx webforai-cli crawl https://docs.example.com -o docs --llms-txt   # site → .md files + llms.txt
npx webforai-cli batch --file urls.txt -o pages                      # many URLs → one .md per page

For AI agents

npx webforai-cli skill --install installs an Agent Skill that teaches Claude Code, Cursor and other coding agents when and how to call the CLI. The same skill installs natively as a Claude Code plugin (claude plugin install webforai --marketplace inaridiy/webforai), a Codex plugin (codex plugin marketplace add inaridiy/webforai) or a pi package (pi install npm:webforai-cli).

Documentation

Every flag, the JSON envelope, exit codes and the Playwright loader: webforai.dev/cli.

License

Apache 2.0