Skip to main content
Normalized for Mintlify from knowledge-base/aiconnected-apps-and-modules/modules/kb-generator/kb-generator-readme.mdx.

Knowledge Base Generator

Transform any business website into a comprehensive AI knowledge base.

What It Does

This tool takes a website URL and generates everything needed to power an intelligent AI chat assistant:
  1. Scrapes the website - Extracts all pages and content
  2. Identifies services - Finds every service/product offered
  3. Researches each service - Generates educational content, decision guides, and FAQs
  4. Maps concerns to services - Creates relationships between customer problems and solutions
  5. Generates conversation starters - Creates engaging entry points for chat
  6. Writes the system prompt - Defines how the AI should behave
  7. Creates an assessment quiz - Builds a recommendation quiz
  8. Compiles a service guide - Human-readable markdown documentation

Quick Start

Requirements

  • Node.js 18+
  • Anthropic API key (Claude)
  • Firecrawl API key (web scraping)
Get your API keys:

Usage

Output Files

The generator creates these files in the output directory:

Using the Knowledge Base

In Your Chat Application

Service Data Structure

Each service includes:

Time Estimates

Cost Estimates

Approximate API costs per generation:

Customization

Override AI Model

Manual Review

After generation, you can:
  1. Review 8-service-guide.md for accuracy
  2. Edit 3-enhanced-services.json to correct any issues
  3. Regenerate the final knowledge base with corrections

Troubleshooting

”Crawl failed”

  • Check your Firecrawl API key
  • The website may be blocking crawlers
  • Try reducing the page limit

”Failed to parse JSON”

  • The AI response was malformed
  • Try running again (rate limits can cause issues)
  • Check the raw output files for debugging

Services missing

  • The website may have services behind JavaScript
  • Try scraping specific pages directly
  • Add services manually to the extracted data

License

MIT