28 Nov
Keeping tabs on competitors’ websites can provide invaluable insights into their strategies, offerings, and focus areas. Monitoring new pages as they are added helps you stay informed about trends and opportunities. Here, we’ll cover multiple methods for tracking new pages effectively, including search engine tools, advanced SEO crawlers, and third-party services.
Why Monitoring New Pages Matters
Monitoring new pages offers several strategic advantages:
- Stay Competitive: Detect competitor activity early, such as new product launches or service expansions.
- Identify Trends: Learn about new content topics or focus areas to inspire your strategy.
- Optimize Your SEO: Analyze competitors’ new pages for content structure, keywords, and layout improvements.
- Gain Tactical Insights: Spot shifts in messaging, pricing strategies, or audience targeting.
Method 1: Using the site: Operator and Time Filters
The site: operator allows you to search for pages indexed by Google for a specific domain. Adding time filters helps narrow down recently indexed pages.
Steps to Use This Method:
1. Open Google Search: Start with Google or a similar search engine.
2. Enter the Query: Use the site: operator followed by the competitor’s domain. For example:
site:dutchnews.nl
3. Apply Time Filters:
- Click on Tools below the search bar.
- Use the Any time menu to select a time frame, such as the last 24 hours or week.
4. Analyze Results: The results will show pages recently added or updated within the chosen period.
Advantages:
- Simple and free.
- Quick results with no additional tools required.
Drawbacks:
- Relies on timely indexing by search engines.
- Manual process that can be time-intensive.
Method 2: Using Screaming Frog in Sitemap Mode
Screaming Frog is a powerful SEO crawler that allows you to detect new pages by comparing changes in a website’s sitemap over time.
Steps to Set Up Screaming Frog:
1. Install the Tool: Download and install Screaming Frog SEO Spider from its official website.
2. Crawl the Sitemap:
- Enter the sitemap URL (e.g., https://www.screamingfrog.co.uk/sitemap.xml).
- Let Screaming Frog crawl and gather the data.
3. Export Data: Save the list of URLs to a spreadsheet.
4. Schedule and Compare:
- Repeat the crawl weekly or monthly
- Use Screaming Frog’s Compare Mode to identify new pages.
5. Analyze Changes: Highlighted differences will show new or removed pages.
Advantages:
- Tracks all sitemap-listed pages.
- Ideal for websites with large and complex structures.
Drawbacks:
- Requires sitemap access (some websites may block or hide their sitemap).
- Learning curve for first-time users.
Method 3: Using Ahrefs to Monitor Website Changes
Ahrefs, a popular SEO tool, offers robust monitoring features that can track changes on a competitor’s website. With its Site Explorer and Alerts, you can detect newly added pages effortlessly.
Steps to Use Ahrefs:
1. Access Ahrefs Site Explorer:
- Enter the competitor’s domain in the Site Explorer tool.
- Review the Pages section to find newly added pages.
2. Set Up Alerts:
- Navigate to Alerts in Ahrefs.
- Configure an alert for the website to receive email notifications when new pages are added or existing ones are updated.
3. Monitor Changes: Use Ahrefs’ historical data and crawling capabilities to compare the latest changes with previous structures.
Advantages:
- Automates tracking with alerts.
- Offers detailed insights into new content, backlinks, and organic keywords for the new pages.
Drawbacks:
- Requires an Ahrefs subscription.
- Focuses on indexed pages, which may miss unindexed changes.
Key Tips for Effective Monitoring
- Combine Multiple Methods: Use
site:queries for quick checks and Screaming Frog or Ahrefs for deeper insights. - Focus on Relevant Sections: Target key areas like product pages, blogs, or landing pages where updates are frequent.
- Set Alerts: Automate monitoring through tools like Ahrefs or Hexowatch to save time.
- Check Regularly: Perform regular audits (weekly or monthly) to keep up with changes.
- Analyze Metadata: Pay attention to titles, descriptions, and keywords on new pages to uncover competitors’ SEO strategies.
Conclusion
Detecting new pages on competitor websites is an essential part of competitive analysis and SEO strategy. Whether you prefer using the free site: operator for quick checks, leveraging Screaming Frog for detailed comparisons, or utilizing Ahrefs for automated tracking, there’s a solution to fit your needs.
By incorporating these methods into your workflow, you can stay informed about competitors’ strategies, adapt your own approaches, and maintain your competitive edge in the market.
