Normalized for Mintlify from
knowledge-base/aiconnected-apps-and-modules/modules/kb-generator/kb-generator-readme.mdx.Knowledge Base Generator
Transform any business website into a comprehensive AI knowledge base.What It Does
This tool takes a website URL and generates everything needed to power an intelligent AI chat assistant:- Scrapes the website - Extracts all pages and content
- Identifies services - Finds every service/product offered
- Researches each service - Generates educational content, decision guides, and FAQs
- Maps concerns to services - Creates relationships between customer problems and solutions
- Generates conversation starters - Creates engaging entry points for chat
- Writes the system prompt - Defines how the AI should behave
- Creates an assessment quiz - Builds a recommendation quiz
- Compiles a service guide - Human-readable markdown documentation
Quick Start
Requirements
- Node.js 18+
- Anthropic API key (Claude)
- Firecrawl API key (web scraping)
- Anthropic: https://console.anthropic.com
- Firecrawl: https://firecrawl.dev
Usage
Output Files
The generator creates these files in the output directory:Using the Knowledge Base
In Your Chat Application
Service Data Structure
Each service includes:Time Estimates
Cost Estimates
Approximate API costs per generation:Customization
Override AI Model
Manual Review
After generation, you can:- Review
8-service-guide.mdfor accuracy - Edit
3-enhanced-services.jsonto correct any issues - Regenerate the final knowledge base with corrections
Troubleshooting
”Crawl failed”
- Check your Firecrawl API key
- The website may be blocking crawlers
- Try reducing the page limit
”Failed to parse JSON”
- The AI response was malformed
- Try running again (rate limits can cause issues)
- Check the raw output files for debugging
Services missing
- The website may have services behind JavaScript
- Try scraping specific pages directly
- Add services manually to the extracted data