Competitor Research Agent

Competitive intel from competitor websites scans
32 nodes

/projects/competitorresearch

Competitor Research Agent

09

A single-task competitive intelligence agent: enter a competitor URL, scrape key pages with Firecrawl, extract structured company context, then ask a ToolLoopAgent for positioning, pricing, features, tech stack, weaknesses and battlecards.

Project context05

Problem

Competitive research is usually manual, stale, and hard to compare across companies. Teams need structured intelligence from competitor sites, not screenshots or generic summaries.

Solution

The Competitor Research Agent maps and scrapes key pages, extracts normalized company context, then runs analysis tools for positioning, pricing, features, tech stack, weaknesses, and battlecards.

Challenges

The difficult pieces are resilient scraping, schema-normalized extraction, public rate limiting, inconsistent pricing pages, and producing analysis that sales or product teams can actually use.

Innovation

The workflow combines Firecrawl mapping, OpenAI structured extraction, and specialized analysis tools so each output is tied to a tactical competitive-intelligence job.

Domain expertise

This shows Stefan's strengths in market-intelligence automation, scraping architecture, structured extraction, battlecard workflows, pricing analysis, and AI product tooling for GTM teams.

Case study evidence11

Outcomes

  • Turns competitor websites into normalized intelligence that product, sales, and founder teams can compare.
  • Moves beyond page summaries into positioning, pricing, feature gaps, technical stack, weaknesses, and battlecards.
  • Shortens repetitive competitive research while keeping the evidence tied to public source pages.

Architecture decisions

  • Firecrawl map and scrape stages gather the right public pages before model analysis begins.
  • Structured extraction creates a stable competitor profile used by downstream analyst tools.
  • Specialized tools separate pricing, positioning, features, weaknesses, and battlecard generation.

Domain expertise signals

Competitive intelligenceBattlecardsPricing extractionGTM workflowsScraping resilience
Technical deep dive09

The Competitor Research Agent turns public websites into structured market intelligence. Its value is in separating scraping, normalization, analysis, and battlecard synthesis into distinct tactical jobs.

Page discovery

Competitive intelligence starts with finding the right pages. Mapping pricing, features, about, proof, and comparison pages gives the model better source material than a single homepage scrape.

Structured extraction

A normalized competitor profile gives downstream analysis a stable base. Without that schema, pricing, positioning, feature, and weakness analysis becomes inconsistent across companies.

Analyst tools

Separate tools for positioning, pricing, features, tech stack, weaknesses, and battlecards match real GTM workflows. Each tool answers a different business question.

Strategic leverage

The final output helps founders and sales teams understand where to compete, how to handle objections, and which gaps are product opportunities rather than trivia.

What this proves

  • Firecrawl map and scrape stages
  • OpenAI structured extraction into competitor data
  • Specialized analysis tools for GTM workflows
  • Battlecard generation from normalized evidence
6intel tools
4max scraped pages
3-5starget extraction
1battlecard
2model paths
60sstream cap
Technology stack09
Next.js

Next.js

Works well for a single-task research app because scraping, extraction, and chat can share one project boundary.

React

React

Supports rich views for pricing, features, stack badges, weaknesses, and battlecards.

TypeScript

TypeScript

Keeps the scraped profile, tool calls, and UI view models aligned as the analysis expands.

AI SDK

AI SDK

Runs the follow-up analyst loop with tool calling, streaming, and model-provider flexibility.

Google Gemini

Google Gemini

Handles the conversational competitor analyst path through a fast tool-loop model.

OpenAI

OpenAI

Used for the structured extraction pass where a clean CompetitorData object matters.

Fc

Firecrawl

Chosen because competitor intelligence starts with mapping and scraping real public pages.

Up

Upstash

Adds a small, durable rate-limit guard for public scraping and agent calls.

Z

Zod

Defines the competitor schema so extraction errors do not leak into the UI.

Tools implemented09

scrapeCompetitor

Coordinates URL validation, rate limiting, Firecrawl mapping, page scraping, and extraction.

Firecrawl map

Finds the pricing, features, about, and proof pages that usually carry market intelligence.

OpenAI structured extraction

Converts scraped markdown into the normalized competitor profile used by the app.

analyzePositioning

Extracts value propositions, audience, messaging themes, and category position.

extractPricing

Builds a structured view of tiers, billing model, trials, and free-plan details.

identifyFeatures

Turns page content into feature groups, gaps, and comparison-ready matrices.

analyzeTechStack

Detects frameworks, infrastructure, analytics, auth, payments, and overall modernity.

findWeaknesses

Highlights exploitable gaps, complaints, and positioning opportunities.

generateBattlecard

Creates objections, responses, winning tactics, and traps to avoid.

Stefan Creadore · @Eldergenixproduction agent systems mapped end to end