blog/methodology
category

methodology.

how the crawl works and why we report what we report

11
posts
87
min total
17,770
words

categories group posts by format. to read by subject instead, browse the backlink guide by topic.

11 posts in methodology

query the common crawl web graph yourself - backlinks from a 16 gb edge list

query the common crawl web graph yourself - backlinks from a 16 gb edge list

three files, no api key, no cluster. the streaming pipeline that pulls one domain's referring domains out of the open graph on a laptop.

Sep 10, 2026·8 min·1,600 words
domain authority vs domain rating vs trust flow - what the scores actually measure

domain authority vs domain rating vs trust flow - what the scores actually measure

four vendors, four 0-100 numbers, none of them google's. what each one is computed from, why they never agree, and the only way to read them that survives contact with reality.

Sep 10, 2026·8 min·1,700 words
what is a link gap - the set difference behind competitor link research

what is a link gap - the set difference behind competitor link research

a link gap is the domains linking to your competitors but not to you. here is the arithmetic, why the count of competitors changes the answer, and why two tools never agree.

Sep 10, 2026·7 min·1,500 words
is seo dead? what the link graph actually shows

is seo dead? what the link graph actually shows

the honest answer from 3.90 billion links across 121.1 million domains: rankings still work, clicks are worth less, and the signal AI systems read has not changed.

Sep 10, 2026·8 min·1,750 words
what is a backlink graph - nodes, edges, and where authority scores come from

what is a backlink graph - nodes, edges, and where authority scores come from

a backlink graph is the web drawn as nodes (sites or pages) and edges (links). every authority score is different math over a graph of that shape.

Sep 4, 2026·9 min·1,900 words
how often do backlink tools crawl? why your new link is not showing up yet

how often do backlink tools crawl? why your new link is not showing up yet

no tool sees the web live. a link must be crawled, indexed, then published before it appears. how to read your tool's date and confirm a link yourself.

Sep 4, 2026·6 min·1,250 words
methodology

how to run a backlink gap analysis for free

a gap analysis finds the domains that link to your competitors but not to you. that overlap is the highest-roi prospect list in link building. here is a free, step-by-step way to build one.

Jun 2, 2026·11 min·2,600 words
methodology

free backlink gap analysis without ahrefs (2026)

the domains that link to your competitors but not you are the best link prospects you have. here is how to find them for free, no ahrefs or semrush subscription.

Jun 2, 2026·8 min·1,600 words
where ahrefs and moz get their backlink data

where ahrefs and moz get their backlink data

ahrefs, moz, semrush, and majestic each run their own proprietary crawler and ship a curated index - which is why no two backlink tools ever agree. here's the methodology, the size claims, and why common crawl is the only open alternative.

May 23, 2026·11 min·2,280 words
common crawl release schedule (next crawl)

common crawl release schedule (next crawl)

common crawl publishes new web crawls every 1-2 months. here's the recent release cadence, crawlgraph's current composite, and why the lag matters for backlink freshness.

May 2, 2026·5 min·950 words
RANK ↑ 30D
+847%
methodology

common crawl, explained for SEOs

the 3.90B-edge open dataset that quietly powers half the AI training runs - and how we turn it into rank intelligence.

Apr 8, 2026·6 min·640 words