the crawlgraph blog

backlink intelligence, in plain english.

tactical guides, methodology deep-dives, and side-by-side breakdowns of what enterprise SEO tools really cost you.

50 posts·updated Sep 10, 2026
how to get backlinks for free in 2026
featuredguides

how to get backlinks for free in 2026

free options for surveying a backlink profile - gsc, bing webmaster, crawlgraph's free tier - and what each one actually shows. for full lists, $99 once.

pete the seo wizard
May 2, 2026 · 16 min read
read the breakdown
query the common crawl web graph yourself - backlinks from a 16 gb edge list
methodology8 min read

query the common crawl web graph yourself - backlinks from a 16 gb edge list

three files, no api key, no cluster. the streaming pipeline that pulls one domain's referring domains out of the open graph on a laptop.

pete the seo wizardSep 10
what is link building - the honest, short version
guides6 min read

what is link building - the honest, short version

getting other sites to link to yours, why the count stopped mattering, and the three approaches that still work sorted by how much of your time they waste.

pete the seo wizardSep 10
toxic backlinks and the disavow file - the unpopular, accurate version
guides7 min read

toxic backlinks and the disavow file - the unpopular, accurate version

toxic is a vendor word, not a google one. what the score actually is, the narrow case where disavow is correct, and why the default answer is to do nothing.

pete the seo wizardSep 10
nofollow links - what they are, whether they help, and why some tools cannot see them
guides7 min read

nofollow links - what they are, whether they help, and why some tools cannot see them

rel=nofollow became a hint in 2019, not a directive. what that changed, when to use sponsored and ugc instead, and the layer problem behind link-attribute reporting.

pete the seo wizardSep 10
domain authority vs domain rating vs trust flow - what the scores actually measure
methodology8 min read

domain authority vs domain rating vs trust flow - what the scores actually measure

four vendors, four 0-100 numbers, none of them google's. what each one is computed from, why they never agree, and the only way to read them that survives contact with reality.

pete the seo wizardSep 10
anchor text, explained - what it is, what it signals, and where it actually pays
guides8 min read

anchor text, explained - what it is, what it signals, and where it actually pays

the clickable words of a link are an independent description of your page. here is why that matters, what a natural profile looks like, and why internal anchors are the half worth working on.

pete the seo wizardSep 10
how to find keyword cannibalization in search console (with a real diagnosis)
guides9 min read

how to find keyword cannibalization in search console (with a real diagnosis)

the aggregate report cannot show it. query+page pairs can. here is the query that finds it, and 44 cannibalized queries found on our own site.

pete the seo wizardSep 10
what is a link gap - the set difference behind competitor link research
methodology7 min read

what is a link gap - the set difference behind competitor link research

a link gap is the domains linking to your competitors but not to you. here is the arithmetic, why the count of competitors changes the answer, and why two tools never agree.

pete the seo wizardSep 10
answer engine optimization: what actually makes a page citable
guides9 min read

answer engine optimization: what actually makes a page citable

aeo, geo, and llm seo mostly describe the same job. here is the part that is genuinely different from ordinary seo, and what we ship on our own site.

pete the seo wizardSep 10
is seo dead? what the link graph actually shows
methodology8 min read

is seo dead? what the link graph actually shows

the honest answer from 3.90 billion links across 121.1 million domains: rankings still work, clicks are worth less, and the signal AI systems read has not changed.

pete the seo wizardSep 10
RANK ↑ 30D
+847%
case studies
case studies5 min read

3 domains link to every major landing page builder

we compared 8 landing page builders using the top 2,000 referring domains per subject from common crawl. 3 non-platform domains link to the full set.

crawlgraph teamSep 7
crawlgraph vs serpstat - how many modules do you actually open?
comparisons7 min read

crawlgraph vs serpstat - how many modules do you actually open?

serpstat at $69/mo is a fair buy if you use most of the suite. if you only ever open the backlink module, $99 once covers that one job forever.

pete the seo wizardSep 5
crawlgraph vs spyfu - different questions, different bills
comparisons7 min read

crawlgraph vs spyfu - different questions, different bills

spyfu is a ppc intelligence tool at $39/mo. crawlgraph is backlink data for $99 once. two different jobs, and the cost lines cross in month three.

pete the seo wizardSep 5
RANK ↑ 30D
+847%
case studies
case studies5 min read

13 domains link to every major social media scheduler

we compared 8 social media schedulers using the top 2,000 referring domains per subject from common crawl. 13 non-platform domains link to the full set.

crawlgraph teamSep 5
what is a backlink graph - nodes, edges, and where authority scores come from
methodology9 min read

what is a backlink graph - nodes, edges, and where authority scores come from

a backlink graph is the web drawn as nodes (sites or pages) and edges (links). every authority score is different math over a graph of that shape.

pete the seo wizardSep 4
how often do backlink tools crawl? why your new link is not showing up yet
methodology6 min read

how often do backlink tools crawl? why your new link is not showing up yet

no tool sees the web live. a link must be crawled, indexed, then published before it appears. how to read your tool's date and confirm a link yourself.

pete the seo wizardSep 4
moz's crawler explained: dotbot, rogerbot, and the crawled flag
guides14 min read

moz's crawler explained: dotbot, rogerbot, and the crawled flag

moz runs two crawlers: dotbot builds the link index behind DA, rogerbot runs site crawl in a moz pro campaign. what crawled means and why DA moves.

pete the seo wizardSep 4
the cheapest ahrefs alternative in 2026
comparisons7 min read

the cheapest ahrefs alternative in 2026

two answers: of the seven tools here the cheapest subscription is spyfu at $39/mo, and the cheapest to own is $99 once, which beats ahrefs in one month.

pete the seo wizardSep 4
RANK ↑ 30D
+847%
case studies
case studies5 min read

12 domains link to every major help desk

we compared 8 help desks using the top 2,000 referring domains per subject from common crawl. 12 non-platform domains link to the full set.

crawlgraph teamAug 17
RANK ↑ 30D
+847%
case studies
case studies5 min read

35 domains link to every major web host

we compared 8 web hosts using the top 2,000 referring domains per subject from common crawl. 35 non-platform domains link to the full set.

crawlgraph teamAug 10
RANK ↑ 30D
+847%
case studies
case studies5 min read

13 domains link to every major no-code tool

we compared 8 no-code tools using the top 2,000 referring domains per subject from common crawl. 13 non-platform domains link to the full set.

crawlgraph teamAug 7
Common Crawl index API 2026: the current CC-MAIN index IDs
changelog4 min read

Common Crawl index API 2026: the current CC-MAIN index IDs

The current index is cc-main-2026-apr-may-jun, built from CC-MAIN-2026-17, CC-MAIN-2026-21 and CC-MAIN-2026-25. Copy-paste API URLs for both the Common Crawl CDX index and crawlgraph.

crawlgraph teamJul 24
programmatic backlink research: 5 api recipes
guides8 min read

programmatic backlink research: 5 api recipes

get a free API key, pull one domain's referring sites, filter by authority, compare competitors, feed an automation, and connect hosted MCP, with copyable code for every step.

pete the seo wizardJul 12
RANK ↑ 30D
+847%
case studies
case studies9 min read

8 domains link to every major fintech app (and they are all press or capital)

we pulled the backlinks of 8 big fintech apps from common crawl. the 8 domains that link to all of them are finance trade press, newsletters, and the VC/startup databases. no integrations, no dev tools. the niche runs on trust and money.

pete the seo wizardJul 6
RANK ↑ 30D
+847%
changelog
changelog3 min read

crawlgraph now has a free API tier (15 backlink calls a month, no card)

request a key on the docs page and it lands in your inbox. 15 backlink lookups a month on Common Crawl's open web graph, forever free. connect over hosted MCP or run the local npm server.

pete the seo wizardJul 3
RANK ↑ 30D
+847%
case studies
case studies8 min read

only 5 domains link to every major AI agent framework (and the shelf is still being built)

we pulled the backlinks of 8 AI agent frameworks from common crawl. only 5 domains link to all of them, and they are not tech media. the niche's link graph is dev platforms plus a brand-new crop of agent directories you can still get into.

pete the seo wizardJul 2
RANK ↑ 30D
+847%
case studies
case studies8 min read

only 2 domains link to every major CRM (and that is the lesson)

we pulled the backlinks of the 8 biggest CRMs from common crawl. only 2 domains link to all of them, both integration hubs. compare that to SEO tools, where 37 did. the shape of a niche's link graph tells you the strategy.

pete the seo wizardJul 1
RANK ↑ 30D
+847%
case studies
case studies9 min read

the 37 domains that link to every major SEO tool

we pulled the backlinks of 8 major seo tools from common crawl. 37 domains link to all of them, and the list is the seo trade press plus the 'best seo tools' roundups. here is the playbook that falls out of it.

pete the seo wizardJun 30
guides
guides4 min read

watch: steal your competitor's backlinks (free 2-minute walkthrough)

a short walkthrough of crawlgraph's free gap analysis: find every site linking to your competitor but not you, pull the contact email, and send the pitch - without an ahrefs or semrush subscription.

pete the seo wizardJun 17
RANK ↑ 30D
+847%
case studies
case studies8 min read

only 6 domains link to every major email marketing tool

we ran the same backlink-overlap study on the 8 biggest email tools. the overlap almost vanished - only 6 domains link to all of them. that collapse is itself the most useful finding.

pete the seo wizardJun 5
RANK ↑ 30D
+847%
case studies
case studies9 min read

the 34 domains that link to every major ai writing tool

we pulled the backlinks of the 8 biggest ai writing tools from common crawl. 34 domains link to all of them, and the list is almost entirely ai-tool directories and ai-news media. here is the playbook that falls out of it.

pete the seo wizardJun 5
RANK ↑ 30D
+847%
case studies
case studies9 min read

the 27 domains that link to every major website builder

we pulled the highest-authority backlinks of the 8 biggest website builders from common crawl. 9,189 domains link to at least one. only 27 link to all eight, and they reveal a very different playbook than you would guess.

pete the seo wizardJun 4
RANK ↑ 30D
+847%
case studies
case studies9 min read

the 35 domains that link to every major project management tool

we pulled the highest-authority backlinks of the 8 biggest project management tools from common crawl. 9,347 domains link to at least one of them. only 35 link to all eight, and that short list is the entire link-building playbook for the niche.

pete the seo wizardJun 3
ahrefsvscrawlgraph
guides
guides9 min read

find link building prospects with ai

connect an ai assistant to a live backlink data source over mcp and let it run gap analysis, rank outreach targets, and draft angles - no spreadsheet wrangling.

pete the seo wizardJun 2
methodology
methodology11 min read

how to run a backlink gap analysis for free

a gap analysis finds the domains that link to your competitors but not to you. that overlap is the highest-roi prospect list in link building. here is a free, step-by-step way to build one.

pete the seo wizardJun 2
methodology
methodology8 min read

free backlink gap analysis without ahrefs (2026)

the domains that link to your competitors but not you are the best link prospects you have. here is how to find them for free, no ahrefs or semrush subscription.

pete the seo wizardJun 2
ubersuggestvscrawlgraph
$290 lifetime·$99 once
comparisons
comparisons7 min read

ubersuggest backlink checker vs crawlgraph - which one actually has the data

ubersuggest runs backlinks as one report inside an seo suite, on its own index, capped by plan. crawlgraph does backlinks only: the full common crawl referring-domain list, for $99 once.

pete the seo wizardJun 1
majesticvscrawlgraph
$49 / mo·$99 once
comparisons
comparisons8 min read

crawlgraph vs majestic - two link-only tools, very different prices

majestic is the deepest pure-backlink index there is, with trust flow and a historic archive. crawlgraph is a quarterly common-crawl snapshot for $99 once. when each one is the right call.

pete the seo wizardJun 1
mozvscrawlgraph
$99 / mo·$99 once
comparisons
comparisons8 min read

crawlgraph vs moz - domain authority, without the subscription

moz gave the industry the DA score everyone quotes. crawlgraph gives you the same referring-domain picture from open data, once, for $99. here's the honest split.

pete the seo wizardJun 1
RANK ↑ 30D
+847%
comparisons
comparisons4 min read

an honest take: when to use ahrefs vs when to use crawlgraph

ahrefs is worth $129/month for continuous link-signal monitoring. crawlgraph is worth $99 once for outreach prospecting. here's why both are correct.

crawlgraph teamMay 29
google search console backlinks: what it shows
guides9 min read

google search console backlinks: what it shows

gsc is the only free backlink data source straight from google - but it caps the report at ~1,000 referring domains, only shows data for sites you've verified, and surfaces a filtered subset of what google actually indexed. here's the full walkthrough plus how to get around the limits.

pete the seo wizardMay 23
where ahrefs and moz get their backlink data
methodology11 min read

where ahrefs and moz get their backlink data

ahrefs, moz, semrush, and majestic each run their own proprietary crawler and ship a curated index - which is why no two backlink tools ever agree. here's the methodology, the size claims, and why common crawl is the only open alternative.

pete the seo wizardMay 23
bing webmaster tools backlinks (free, no signup)
guides9 min read

bing webmaster tools backlinks (free, no signup)

bing webmaster tools shows backlink data for free - and unlike google search console, it surfaces backlinks for sites you don't own through the similar sites report. here's the full walkthrough, the gsc comparison, and the export workflow.

pete the seo wizardMay 23
how long does google take to count a backlink?
guides8 min read

how long does google take to count a backlink?

"how long for google to count a backlink" is actually three questions: how long to crawl, how long to index, and how long for it to influence rankings. the answers are days, weeks, and months - and each phase has different bottlenecks.

pete the seo wizardMay 2
referring domain vs backlink - the difference
guides7 min read

referring domain vs backlink - the difference

a backlink is one link. a referring domain is one site - it can give you ten thousand links and still count as one. google weighs referring domain count more heavily than raw backlinks, and the ratio between them is itself a quality signal.

pete the seo wizardMay 2
common crawl release schedule (next crawl)
methodology5 min read

common crawl release schedule (next crawl)

common crawl publishes new web crawls every 1-2 months. here's the recent release cadence, crawlgraph's current composite, and why the lag matters for backlink freshness.

pete the seo wizardMay 2
semrushvscrawlgraph
$140 / mo·$99 once
comparisons
comparisons9 min read

crawlgraph vs semrush - focused vs all-in-one

semrush ships fifty things. crawlgraph ships one. here's why - for a real subset of seos - that's the point.

pete the seo wizardApr 28
ahrefsvscrawlgraph
comparisons
comparisons10 min read

ahrefs vs crawlgraph - what you actually pay for

a $99 lifetime license vs $129/mo. broken down by feature, by api call, by what the data really shows.

pete the seo wizardApr 22
RANK ↑ 30D
+847%
methodology
methodology6 min read

common crawl, explained for SEOs

the 3.90B-edge open dataset that quietly powers half the AI training runs - and how we turn it into rank intelligence.

pete the seo wizardApr 8
the dispatch

one email a month: the newest study, plus one thing worth doing with it. unsubscribe in 1 click.

plus one when a new common crawl release lands. that is all.