Uncategorized

How to Find Low-Competition Keywords from Scraped SERP Data Introduction Most keyword research tools give you a single “difficulty” score. That number is often misleading. True competition has multiple dimensions — organic SERP quality, paid ad pressure, and buyer intent alignment . By scraping live SERP data and analyzing these layers yourself, you can find keywords that traditional tools mark as competitive but are actually winnable. What Low Competition Really Means A keyword is truly low competition when it meets three criteria. First, winnable SERP positioning means the top 10 results are not dominated by mega-brands with overwhelming authority. Second, manageable ad pressure means few sponsored listings and reasonable cost-per-click. Third, realistic conversion expectations mean clear buyer intent and product-market fit . Many sellers assume low competition equals low search volume. That is incorrect. Your goal is not to avoid big niches entirely. Your goal is to find winnable entry points inside those niches — long-tail versions of high-demand terms where buyer intent is strong but competition is fragmented or poorly served . The Three Competition Layers You Must Evaluate Traditional keyword difficulty scores compress three distinct competition dimensions into one number. Scraped SERP data lets you evaluate each layer separately. Layer 1: Organic SERP Competition Even if a keyword has low ad competition, the organic results might be dominated by brands with thousands of reviews, creating a review moat that cannot be overcome with SEO alone . Scrape the top 10 organic results for your keyword. Extract the domain names, review counts for e-commerce results, and authority indicators. A simple rule of thumb: if the median review count in the top 10 exceeds 300 and more than 5 listings are from major brands, competition is high. If median reviews are under 300 and fewer than 2 big brands appear, that is a potential win . For B2B content keywords, look at domain authority and page authority. When you see low domain authorities ranking in the SERP, that is a strong signal that the keyword is winnable even for newer sites . Layer 2: Ad Competition and Commercial Intent High ad density — three or more sponsored results above the fold — signals strong commercial intent and high CPCs . Use scraped SERP data to count sponsored slots. More than three sponsored ads suggests inflated CPCs that may exceed your break-even point. Transactional intent keywords convert better than informational ones. Compare “best wireless earbuds” which suggests comparison shopping against “Apple AirPods Pro replacement case” which indicates immediate purchase intent . Target keywords where the intent matches your conversion goals. Layer 3: Relevance Gap Sometimes buyers search a keyword but the search results do not actually satisfy their need. Check customer questions and reviews. If buyers consistently ask “Does this fit X?” and no listing confirms it, that is a relevance gap you can exploit . The presence of thin content — pages that do not fully answer the query — is another green flag. When competing pages have weak differentiation, outdated images, or messy listings, those are red flags for competitors and green lights for you . Building Your Low-Competition Keyword Workflow A systematic workflow turns scraped SERP data into prioritized keyword opportunities. Step 1: Scrape SERP Data for Your Seed Keywords Start with high-volume core terms in your niche. Use a SERP API or custom scraper to extract organic results, ad density counts, and SERP features. For multi-market research across the USA, Germany, United Kingdom, France, Italy, Russia, Spain, Netherlands, Switzerland, Poland, Ireland, Australia, Canada, Thailand, and Hong Kong, run separate scrapes with country parameters. For each keyword, capture the top 10 URLs, domain authorities or brand indicators, review counts for product searches, number of sponsored results, and any featured snippets or People Also Ask boxes. Step 2: Expand to Long-Tail Variations Do not just analyze your seed keywords. Expand them using modifier stacks. Attribute modifiers include terms like large, stainless steel, or extra strength. Use-case modifiers include for travel, for kids, or for office use. Compatibility modifiers include fits X or compatible with Y. Problem-solution modifiers include for back pain or anti-slip . Long-tail keywords convert at approximately 2.3 times the rate of broad terms, with average CPCs 40 percent lower . The lower search volume is offset by higher intent and lower competition. Step 3: Apply the SERP-Fit Test Never trust a competition score alone. Validate with real SERP analysis. Ask three questions. Do the page-one results match your exact product or service type? If you sell cases but results show screen protectors, the keyword is not relevant even if it ranks. Are the top results beatable for your stage? If you have 10 reviews and the top listing has 2,000, you need more than good SEO. Is there weak differentiation in the top results? Messy listings, outdated images, and missing information are your entry points . Step 4: Look for Under-Targeted Keywords One of the most reliable signals of low competition is seeing that competitors are not properly targeting the keyword. When you scrape SERPs, check whether the keyword appears in the page title and URL slug of ranking pages. If you find that most ranking pages do not have the keyword in their title or URL, that keyword is under-targeted . When you see a low domain authority ranking alongside higher authority sites, that is another strong signal. The SERP is allowing smaller sites to rank, which means you can too. Step 5: Run Gap Analysis Across Competitors Identify the topics your competitors cover that your site does not. The SERP Topic Gap Monitor calculates a gap score using the formula: unique competitor pages covering a topic divided by total unique competitor pages . A gap score of 1.0 means every competitor page covers this topic but your site does not. That is your highest priority content opportunity. Scores between 0.5 and 0.9 indicate strong competitive coverage gaps. Scores below 0.5 are lower priority unless strategically important. For example, analyzing a wellness site against

Google Related Searches Scraping for Niche Content Ideas Introduction Google Related Searches appear at the bottom of search results pages, displaying terms semantically connected to the original query. Unlike People Also Ask questions, which reflect specific information gaps, Related Searches reveal the broader thematic landscape around a topic. For content strategists scraping this data, Related Searches unlock niche content ideas that traditional keyword tools consistently miss. What Related Searches Reveal That Other Sources Miss The Related Searches section — sometimes labeled “People also search for” — reflects follow-up queries that users actually perform after their initial search . This is fundamentally different from suggested queries or keyword databases. Related Searches represent real user behavior sequences, not aggregated volume estimates. When a user searches for “web scraping” and Google shows related terms like “web scraping Python tutorial” or “scrape Google search results,” those are not random suggestions. They are queries that real users have performed in the same session context. This behavioral signal is invisible to traditional keyword tools. The structure of Related Searches also reveals intent progression. The first related term often represents the most common next query. Subsequent terms show alternative directions users take. This sequential data helps content teams understand not just what users search, but how their search journeys evolve. Why Related Searches Are Essential for Niche Content Discovery Traditional keyword research tools prioritize volume. Related Searches prioritize relevance and recency. For niche content ideas, this distinction is critical. A niche keyword with low search volume may never appear in aggregated databases, but it can absolutely appear as a related search for a broader query. For example, “how to tell if your cat is plotting to kill you meme” is not a high-volume keyword. But it appears as a related search for “are cats plotting” . For a pet content website, that is a perfect niche content opportunity. The “breakout” designation in Google Trends signals terms with growth exceeding 5,000 percent within a given timeframe . Related Searches often surface these breakout topics before they appear in volume databases. By scraping Related Searches regularly, you capture emerging niche topics during their growth phase, not after they have flattened. How Google’s Related Searches Are Generated Google generates Related Searches through multiple signals. The primary signal is co-occurrence — terms that frequently appear together in search sessions. The secondary signal is semantic similarity — terms that Google’s algorithm understands as conceptually related. In 2026, Google has integrated Gemini AI into its Trends platform, enabling automated discovery of related search terms . The Gemini-powered Explore page can generate up to eight related search terms based on natural language input, suggesting concepts like “hypoallergenic dog breeds” or “large dog breeds” from a query about trending dog breeds . This integration matters for content strategists because it means Google’s understanding of term relationships is becoming more sophisticated. Related Searches now reflect both behavioral patterns and semantic intelligence, making them more reliable signals for content planning. Technical Approaches to Scraping Related Searches Several methods exist for extracting Related Searches at scale. Each has trade-offs in cost, reliability, and technical complexity. Managed SERP APIs The most reliable approach for production use is a managed SERP API. Services like SerpApi return structured JSON containing the related_searches field with query text, links, and additional metadata . A typical API response includes each related search as an object with the query string, a link to the Google search results for that term, and sometimes images or extensions depending on the query type . The API handles proxy rotation, CAPTCHA solving, and parser maintenance automatically. For multi-market scraping across the USA, Germany, United Kingdom, France, Italy, Russia, Spain, Netherlands, Switzerland, Poland, Ireland, Australia, Canada, Thailand, and Hong Kong, these APIs support country parameters. Setting gl=de returns related searches as seen by German users. Python Libraries for Asynchronous Scraping For teams preferring custom code, asynchronous Python libraries like PySerp provide flexible scraping capabilities . PySerp is an asynchronous library that supports Google and Bing, applies strict typing using Pydantic, and allows session management with cookie persistence . The library’s asynchronous design enables efficient extraction across multiple keywords simultaneously. A typical workflow imports the GoogleSearcherManager, establishes a session with cookies, and calls search_top() with query parameters and a limit for organic results . Related Searches extraction requires additional parsing of the full SERP response. The ScrapingBee API For teams needing simplicity, the ScrapingBee Google Search API accepts parameters including country_code, language, and device, returning structured JSON with organic_results, related_searches, and search metadata . The service handles proxy rotation and rendering, with pricing based on API credits rather than keyword volume . Building a Related Searches Content Discovery Workflow A systematic workflow turns raw Related Searches data into actionable content ideas. Stage 1: Seed Keyword Selection Start with broad seed keywords relevant to your industry. For a web scraping service, seeds might include “web scraping,” “data extraction,” “SERP API,” and “scrape Google.” For each seed, you will scrape the related searches and analyze the results. The seed selection should reflect your service categories and audience intent. Too narrow, and you miss adjacent opportunities. Too broad, and the related searches become too generic for niche discovery. Stage 2: Related Searches Extraction Run each seed keyword through your chosen extraction method — managed API, Python library, or scraping service. Capture the full list of related searches returned. For multi-market research, run the same seeds with country-specific parameters for each target location. Related Searches typically include 8 to 10 terms per query . Some terms will be direct modifications of the seed, adding modifiers like “tutorial,” “guide,” or “vs.” Others will be semantically adjacent concepts that share user intent. Stage 3: Niche Filtering and Clustering Raw related searches lists contain both broad and niche terms. Apply filtering to isolate niche content opportunities. Filter out terms that are too broad — those that could apply to any business in your industry. Filter in terms that combine your core service with specific modifiers — use

How to Validate Scraped Keyword Data Before Content Planning in 2026 Introduction Scraped keyword data can uncover valuable search opportunities, but poor-quality datasets often lead to weak content strategies, wasted budgets, and inaccurate SEO decisions. In 2026, businesses across competitive global markets need reliable keyword validation processes to ensure their content planning aligns with real search behavior, commercial intent, and market demand. Why Keyword Validation Matters Before Content Planning Keyword scraping tools and automated extraction systems can generate massive datasets quickly. However, raw keyword lists are rarely ready for direct use in content planning. Without validation, businesses risk: For organizations operating across markets such as the USA, Germany, the United Kingdom, France, Italy, Spain, the Netherlands, Switzerland, Canada, Australia, Thailand, Hong Kong, and other competitive regions, keyword accuracy directly affects visibility, localization quality, and content ROI. Modern SEO and AI-driven search systems increasingly reward relevance, topical depth, user intent alignment, and trustworthy information architecture. That makes keyword validation a critical early-stage process rather than an optional cleanup task. What Is Scraped Keyword Data? Scraped keyword data refers to search-related information collected automatically from sources such as: Businesses often scrape keyword data to identify: While scraping expands research capabilities, the raw output often contains noise, duplication, irrelevant phrases, misleading search patterns, and incomplete context. Common Problems Found in Scraped Keyword Datasets Duplicate and Near-Duplicate Keywords Large scraped datasets frequently contain repeated variations of the same query. For example: Without clustering and normalization, content teams may unintentionally plan overlapping pages that compete against each other. Irrelevant Search Intent Some scraped keywords appear relevant superficially but do not match business objectives or buyer intent. For example, informational searches may be mixed with transactional queries, or unrelated industries may appear due to ambiguous terminology. This creates problems during content prioritization and funnel alignment. Outdated Search Trends Search demand changes rapidly, especially in technology, SaaS, eCommerce, finance, logistics, healthcare, and AI-related industries. Keyword datasets scraped months earlier may no longer reflect actual user behavior in 2026. Geographic Inaccuracy Search behavior differs significantly between regions. A keyword that performs well in the USA may show completely different search intent or terminology in Germany, France, Spain, or Australia. Direct translation rarely guarantees relevance. SERP Mismatch Some keywords appear valuable based on volume alone but trigger search results dominated by: If the SERP format does not align with planned content types, ranking becomes difficult. Key Steps to Validate Scraped Keyword Data 1. Remove Duplicates and Normalize Data The first validation step is cleaning the dataset. Normalization includes: This process improves keyword clustering and prevents fragmented content planning. Businesses working with multilingual datasets across Europe or international markets should also normalize regional spelling variations, local terminology, and translated equivalents. 2. Verify Search Intent Intent validation is one of the most important stages in modern content planning. Each keyword should be classified into categories such as: For example: Content strategies become far more effective when keywords align correctly with buyer journey stages. 3. Analyze Real SERP Results Keyword validation should never rely only on volume metrics. SEO teams should manually or programmatically review: This helps determine whether a keyword realistically matches the planned content format and business objective. In 2026, AI-driven search summaries and entity-based indexing also influence visibility, making SERP analysis more important than ever. 4. Validate Regional Search Relevance International content strategies require location-aware keyword validation. Businesses targeting countries such as: must account for: For example, B2B software searches in Germany may use different phrasing than equivalent searches in the USA or the UK. Keyword validation should confirm whether regional users actually search using the extracted terms. 5. Assess Commercial Relevance Not every high-volume keyword supports business growth. Validation should identify whether a keyword contributes to: Commercially weak keywords often consume content resources without producing measurable SEO or business outcomes. A strong validation process filters out low-value opportunities early. 6. Evaluate Data Freshness Search behavior evolves continuously. Businesses should validate: For example, industries affected by AI adoption, automation, compliance requirements, or digital transformation often experience rapid keyword evolution. Outdated keyword datasets can undermine entire content roadmaps. 7. Cluster Keywords by Topic and Intent Validated keyword data should be grouped into logical topical clusters. Effective clustering improves: Instead of creating isolated pages for every variation, businesses can develop comprehensive topic-focused content hubs. This aligns better with modern search engine evaluation systems. How Poor Keyword Validation Impacts Content Strategy Businesses that skip validation often face: Low Organic Performance Pages may rank poorly because keywords do not align with actual search intent or SERP expectations. Content Cannibalization Multiple pages compete for similar queries, weakening visibility. Weak Conversion Quality Traffic increases without generating qualified leads or commercial engagement. International SEO Problems Localized campaigns may fail due to mistranslated or culturally irrelevant search terms. Reduced AI Search Visibility AI-driven search systems prioritize content that demonstrates clear topical alignment and contextual accuracy. Poor keyword validation weakens that alignment. Keyword Validation Best Practices for 2026 Combine Automation With Human Review AI-assisted keyword processing improves efficiency, but human review remains essential for: Use Multiple Validation Signals Reliable keyword validation should combine: Prioritize Topical Relevance Over Volume High-volume keywords are not always strategically valuable. Businesses increasingly benefit from: Align Keywords With Content Objectives Every validated keyword should support a defined content purpose such as: This creates stronger editorial consistency and measurable SEO performance. How hirinfotech Supports Reliable Keyword Data Validation When businesses rely on scraped search data for SEO, content planning, market research, or competitive analysis, data quality becomes a strategic concern rather than a technical detail. hirinfotech supports organizations with data-focused solutions that help improve the reliability, structure, and usability of large-scale scraped datasets for practical business decision-making. For companies operating across international markets such as the USA, the United Kingdom, Germany, France, Canada, Australia, and other competitive digital economies, keyword validation often requires more than basic extraction tools. Large datasets must be reviewed for intent accuracy, duplication, localization relevance, SERP alignment, and commercial usability before they can support effective SEO or content operations. By

Multi-Country SERP Automation: Scalable Multilingual Keyword Scraping for International SEO Topic Clusters Introduction Expanding a B2B digital footprint across diverse global markets requires precise localized data. Relying on standard search tool APIs often introduces severe visibility gaps, missing regional variance and localized search intent. To capture true international market share, global enterprises utilize automated multilingual keyword scraping to build semantic topic clusters that precisely mirror regional buyer behaviors. The Evolution of International Search Engine Architecture in 2026 International SEO has shifted fundamentally from direct keyword translation to localized entity mapping and topical authority. Modern search engine algorithms evaluate content based on how comprehensively it addresses a specific subject within a particular geographic and linguistic context. This means that a core service phrase used in the United States cannot simply be translated literally for audiences in Germany, France, Italy, or Spain without losing critical semantic context. To rank effectively across multiple borders—including highly competitive regions like the United Kingdom, Canada, Australia, the Netherlands, Switzerland, Poland, Ireland, Russia, Thailand, and Hong Kong—businesses must build localized topic clusters. A topic cluster consists of a central pillar page addressing a broad industry concept, connected via internal links to multiple subtopic assets that resolve specific long-tail queries. Without accurate, real-time data from localized Search Engine Result Pages (SERPs), identifying these long-tail queries becomes guesswork. Traditional SEO platforms often rely on historical, cached databases that smooth over regional nuances, blinding companies to the actual search patterns of local procurement teams and enterprise decision-makers. Structural Challenges in Multi-Country Keyword Discovery When engineering search strategies for multiple target countries simultaneously, B2B enterprises face distinct operational roadblocks that direct web scraping is designed to solve: Streamlining Topic Cluster Development via Automated Scraping Automated web data extraction solves these visibility challenges by pulling live data directly from regional search engines. This high-fidelity data collection feeds directly into the content planning lifecycle, allowing marketing and data teams to construct authoritative topic structures based on exact local footprints. Mapping User Intent Through Advanced Search Features A comprehensive multilingual keyword scraping strategy extracts more than raw organic URLs. It captures the broader layout of the localized search results page to map exact buyer intent. Extracting the nested text questions from conversational search features allows content teams to see the immediate informational needs of a local audience. This data provides the exact phrasing required for localized subtopic articles and targeted FAQ sections, matching what buyers ask across different regions. Capturing the specific text elements and source URLs from top-tier informational blocks reveals how search engines prefer data to be structured in a given market, whether as paragraphs, lists, or tables. Additionally, tracking bottom-of-page related search variations uncovers hidden semantic adjacencies, helping expand a topic cluster to cover an industry topic comprehensively without manual keyword brainstorming. Normalizing Cross-Border Semantic Data Once raw multilingual search data is programmatically gathered across targeted countries, it undergoes structured validation. Because data formats, character sets, and language layouts vary wildly between markets like Western Europe, Eastern Europe, and the APAC region, automated parsing pipelines normalize the unstructured HTML into clean datasets. From there, marketing data teams group these scraped search terms by conceptual intent rather than identical text strings. This ensures that the global content architecture targets the exact local equivalent of a business problem, establishing deep topical authority that satisfies both human readers and AI-powered search crawlers. Enterprise-Grade Scaling and Anti-Bot Infrastructure Deploying automated keyword data extraction at an enterprise scale requires robust data engineering pipelines. Standard automated requests face immediate blocklisting, browser fingerprinting detection, and CAPTCHA roadblocks implemented by global search infrastructure. To maintain continuous data feeds across 15+ target locations, automated scraping architectures utilize sophisticated geographic proxy distribution. By routing requests through localized residential and mobile proxy networks, the data collection infrastructure ensures that the search data gathered matches exactly what an authentic local user experiences in real time. Furthermore, these extraction pipelines dynamically modify browser fingerprints, rotating user-agent strings, HTTP headers, and device signatures. This level of technical execution prevents automated detection, ensuring a steady, reliable stream of clean search data into corporate business intelligence platforms. Strategic Search Engine Data Scraping by Hirinfotech Building high-performing international topic clusters requires access to unadulterated, real-time search engine data. Hirinfotech specializes in delivering enterprise-grade search engine data scraping services designed to power complex, multi-country digital strategies. By leveraging advanced web extraction pipelines, the company removes the operational friction of managing localized proxy networks, rotating browser fingerprints, and bypassing anti-scraping protocols across diverse geographies. For organizations targeting competitive B2B landscapes across the USA, Canada, Europe, and the APAC region, Hirinfotech provides fully customized, high-volume data streams. The extraction architecture normalizes raw HTML from various regional search engines into structured formats like JSON or CSV. This allows your internal data and marketing teams to analyze localized features, conversational question trees, and semantic variations without technical delays. Whether your enterprise needs to uncover long-tail keyword clusters in Germany, track shifting intent signals in France and Italy, or map competitive search landscapes in Thailand and Hong Kong, Hirinfotech delivers the scalable data infrastructure required. This precision data empowers marketing leaders to build authoritative content architectures that establish genuine regional relevance, optimize international ad spend, and secure long-term organic visibility. Frequently Asked Questions Why is direct keyword translation insufficient for international SEO topic clusters? Direct translation fails to account for regional idioms, localized technical terminology, and varying search habits. B2B buyers in different countries often use completely different phrasing to describe the same business problem. Multilingual keyword scraping uncovers actual, real-world search queries rather than literal dictionary translations, ensuring content aligns with genuine local intent. How does geographic location affect scraped search engine results? Search engines tailor their results pages based on the user’s localized IP address and device profiles. Results, features, and competitor visibility can change drastically between countries, or even between major city centers within the same nation. Utilizing localized proxy networks during the scraping process ensures that the collected data accurately reflects what local buyers see. What are the main

How to Scrape Competitor Landing Pages for Semantic Keyword Patterns Introduction Competitor landing pages contain your most valuable keyword research data. But manually reviewing competitor content misses the patterns that matter. Semantic keyword extraction — analyzing the relationships between keywords, themes, and topics — reveals how competitors structure their authority. By scraping competitor pages at scale, you can identify the exact keyword families, topic clusters, and content gaps that drive their rankings. What Semantic Keyword Patterns Are and Why They Matter Semantic keyword patterns go beyond simple keyword frequency. They capture the relationships between keywords, the themes that connect them, and the context in which terms appear. A single landing page might use “real estate attorney,” “property lawyer,” and “closing counsel” interchangeably. These are not separate keywords. They are semantic variants of the same underlying topic. When you scrape competitor landing pages for semantic patterns, you are not just collecting keyword lists. You are building a map of how competitors organize their topical authority. This map reveals which themes they prioritize, which concepts they treat as related, and which specific phrasing they use to match search intent. The core difference between traditional keyword extraction and semantic pattern analysis is grouping. Traditional extraction gives you a flat list. Semantic analysis groups variants into themes, identifies which themes appear across multiple competitors, and surfaces the concepts that define your competitive landscape. Scraping Competitor Landing Pages: What to Extract Before analyzing semantic patterns, you need structured data from competitor pages. The essential fields for semantic analysis include the full page title, all heading elements from H1 through H3, the meta description, visible body text excluding navigation and footer content, and any structured data or schema markup present on the page. For multi-market analysis across the USA, Germany, United Kingdom, France, Italy, Russia, Spain, Netherlands, Switzerland, Poland, Ireland, Australia, Canada, Thailand, and Hong Kong, run separate scrapes for each target location. Semantic patterns vary by language, cultural context, and local search behavior. A keyword theme that appears consistently in US competitor pages may be entirely absent from German competitors. The technical approach can range from custom scripts using Python libraries like BeautifulSoup or Scrapy to managed scraping workflows using platforms like Decodo or the CustomJS Scraper node in n8n, which fetch raw HTML and extract key SEO elements including title, headings, and meta data. Extracting Keywords and N-Grams from Scraped Content Once you have the raw content, the next step is extracting keyword phrases at multiple lengths. Unigrams — single words — are too noisy for semantic analysis. Focus on n-grams, which are phrases of two to four words. Bigrams like “real estate” and trigrams like “real estate attorney” capture the specific language competitors use. The Apify SEO Keyword Extractor uses a transformer-based model to extract multi-word keyphrases from page content, filters out numeric strings and technical junk, and keeps the most relevant two to four word keyphrases per page. The Apify Analyze Website Content tool extracts the most frequent n-grams across two to four words and identifies keywords from HTML metadata. For local or practice-area SEO, pay close attention to geo plus service combinations. Phrases like “fort lauderdale real estate lawyer” or “west palm beach probate attorney” reveal the specific location-modifier patterns competitors target. These combinations are often invisible to traditional keyword tools but appear clearly in scraped competitor content. Clustering Keywords into Semantic Families The most valuable output from semantic analysis is keyword families — groups of related phrases that represent the same underlying concept. Clustering similar phrases across multiple competitor pages reveals which concepts dominate your market. The process involves identifying all extracted phrases, calculating similarity between phrases using token-set matching or Levenshtein distance, grouping phrases that share core tokens, and for each group, selecting a representative phrase. A group containing “florida real estate attorney,” “florida real estate lawyers,” and “florida real estate law” would cluster under “florida real estate attorney” as the representative. Tools like the SEO Keyword Extractor compute cross-site keyword families by clustering similar phrases across multiple domains. The output includes the group representative, all variant keywords in the group, the number of distinct keywords in the group, and which competitor sites use each variant. This tells you not just what competitors are targeting, but how consistently they target it. Identifying Common Cross-Site Themes Phrases that appear across multiple competitor sites are signals of market standards. If three or four competitors all target variations of “real estate attorney near me,” that concept is not optional for your content strategy. The SEO Keyword Extractor calculates n-gram statistics for phrases that appear on at least three different sites, treating these as strong cross-site themes. For each n-gram, the tool returns the phrase text, the number of sites using it, the total count across pages, and sample keywords showing the full phrase variants. For example, analyzing competitor sites in the legal industry might reveal that the trigram “fort lauderdale real” appears across four competitor sites with sample keywords including “fort lauderdale real estate,” “lauderdale real estate lawyer,” and “lauderdale real estate attorneys”. This tells you that the combination of location and practice area is a mandatory theme in your market. Building Ranked Keyword Themes The final stage of semantic analysis is merging similar keyword families into higher-level themes and ranking them by importance. A keyword theme represents a complete topic area that your content should address. The SEO Keyword Extractor builds themes by constructing a graph of keyword groups connected by high Jaccard similarity — meaning groups that share a high proportion of their word sets — then collapsing connected components into themes. Each theme includes a primary keyword representing the best phrase for the theme, a score indicating theme strength based on cross-site importance and cohesion, the number of distinct keyword variants in the theme, and the complete list of all variant phrases. A theme with primary keyword “florida real estate attorney,” a score of 0.95, three sites in the theme, and variants including “florida real estate law” and

Using Scraped SERP Titles to Improve Blog Topic Clusters Introduction Topic clusters only work when your pillar page and supporting content genuinely align with how Google groups related topics. But guessing which subtopics belong together leads to cannibalization and weak authority. Scraped SERP titles tell you exactly how Google structures topics — by revealing the pages that already rank for multiple related keywords and the title patterns that signal content completeness. Why SERP Titles Matter for Topic Clusters The pages that rank for multiple keywords in your cluster are telling you something important. When a single URL appears in the top results for two or more related keywords, Google considers that page authoritative for all those terms. That page is your model for cluster structure. SERP titles specifically reveal how Google interprets the relationship between broad topics and specific subtopics. The title of a ranking page is Google’s primary signal for understanding what the page covers. When you scrape titles across keywords in a candidate cluster, patterns emerge. For example, if your cluster includes the keywords “content strategy guide,” “content strategy framework,” and “content strategy examples,” scraping the SERP titles for each keyword might reveal that the same URL ranks for all three. That URL’s title — perhaps “The Complete Content Strategy Guide: Frameworks, Examples, and Templates” — tells you exactly how Google expects a pillar page to cover the topic. The title includes both the broad term and the subtopics. The Problem with Text-Based Topic Clustering Traditional keyword grouping tools match keywords by shared words or phrases. This approach merges keywords that should be separate and separates keywords that Google treats as related. Consider two keywords: “best running shoes” and “best running trails.” Text-based clustering merges these because both contain “best running.” But Google ranks completely different pages for each query. One maps to product pages. The other maps to location-based guides. Merging them creates a cluster that no single page can satisfy. SERP-based clustering solves this by reading the URLs Google returns. When two keywords share overlapping ranking URLs, they belong in the same cluster. When they share no URLs, they belong in separate clusters. Scraped SERP titles validate this further — the titles of overlapping URLs reveal the content format Google expects. Step 1: Scrape SERP Titles for Your Keyword List Start with a comprehensive keyword list around your primary topic. Export from Ahrefs, Semrush, Moz, or Google Search Console. For each keyword, scrape the top five to ten organic results. Extract the ranking URL, page title, meta description for optional context, and ranking position. For multi-market topic clusters covering the USA, Germany, United Kingdom, France, Italy, Russia, Spain, Netherlands, Switzerland, Poland, Ireland, Australia, Canada, Thailand, and Hong Kong, run separate SERP scrapes with country parameters. SERP titles vary by location due to localized intent and content preferences. Use a SERP API or managed scraper for consistent results. Tools like Apify’s Google Search Scraper return structured JSON with titles, URLs, descriptions, and positions. Step 2: Detect URL Overlap as the Primary Clustering Signal With SERP data collected, calculate URL overlap between every pair of keywords. Use Jaccard similarity, where the similarity score equals the number of shared ranking URLs divided by the total unique URLs across both keywords. This score ranges from zero, meaning no overlap, to one, meaning identical ranking sets. Apply agglomerative hierarchical clustering. This algorithm starts with each keyword as its own cluster, then merges based on overlap thresholds. A higher threshold creates finer, more specific clusters. A lower threshold creates broader, more general clusters. Step 3: Extract Title Patterns Within Each Cluster Once keywords are grouped into clusters, scrape SERP titles for the highest-volume keyword in each cluster. Look for patterns across the top five ranking pages. Ask these questions when analyzing titles. Do ranking titles consistently include specific words like “Guide,” “Checklist,” “Template,” or “Examples”? This indicates the content format Google expects. Do titles front-load the primary topic? Most effective titles place the main keyword within the first three to five words. What angle do ranking titles take? “Complete Guide” suggests exhaustive coverage. “Step-by-Step” suggests process documentation. “Best X” suggests comparison content. What word count range do ranking titles use? Matching the typical length prevents truncation in SERPs. For B2B topics, ranking titles often include commercial terms like “vs,” “review,” “top,” or “best.” For informational topics, titles lean toward “what is,” “how to,” or “guide.” Step 4: Map Title Patterns to Cluster Structure Title patterns inform two critical decisions for your topic cluster: pillar page format and supporting content scope. If ranking titles for your primary keyword consistently include subtopic modifiers — for example, “Content Strategy Guide: Frameworks, Tools, and Measurement” — your pillar page should cover multiple subtopics within a single, comprehensive guide. If ranking titles for subtopic keywords are held by distinct URLs that are different from the pillar URL, those subtopics need separate cluster articles. The title patterns of those separate URLs tell you the content format and angle for each supporting piece. Map title patterns to cluster roles. Pillar page titles are broad and comprehensive, following patterns like “Topic: The Complete Guide” or “Topic Explained (Everything You Need to Know).” Cluster article titles are specific and angled, following patterns like “How to Subtopic” or “Best Subtopic Tools” or “Subtopic vs Alternative.” Step 5: Build Intent-Based Sub-Clusters URL overlap tells you that keywords belong together. Title patterns tell you why. Add intent classification to your clusters by analyzing title language. Titles containing “What is,” “How to,” “Guide,” or “Explained” signal informational intent, which maps to blog posts or tutorials. Titles containing “Best,” “Top,” “Vs,” or “Review” signal commercial intent, which maps to comparison pages or roundups. Titles containing “Buy,” “Price,” “Cost,” or “Pricing” signal transactional intent, which maps to product pages or service landing pages. When keywords within the same URL-overlap cluster show different intent signals in their ranking titles, your cluster needs multiple content types. The cluster remains intact — Google still groups these keywords topically —