How to crawl ONLY the subfolder with Screaming Frog | SEO tutorial

3 months ago
1

Join the SEO email list 👉 https://yerainabreu.com/signup/
In this video, I'll show you how to crawl (just) subfolders with Screaming Frog. See more on 𝙈𝙔 𝘽𝙇𝙊𝙂 https://yerainabreu.com/blog/how-to-crawl-a-subfolder-with-screaming-frog/. Please let me know if this video helped you by leaving a 𝘾𝙊𝙈𝙈𝙀𝙉𝙏 👍 𝙎𝙐𝘽𝙎𝘾𝙍𝙄𝘽𝙀 to my channel by clicking this link 👉 https://www.youtube.com/yerainabreu?sub_confirmation=1. If you liked this video, please give it a 𝙇𝙄𝙆𝙀 and 𝙎𝙃𝘼𝙍𝙀 with friends! Read more below. 👇👇👇

— 𝗦 𝗔 𝗟 𝗘 𝗦 & 𝗢 𝗙 𝗙 𝗘 𝗥 𝗦 —
🎉 My favorite Hosting: 👉 Siteground https://bit.ly/3dP2RM6
🎉 My favorite AI content SEO tool: 👉 ScaleNut https://bit.ly/3dLoptj
🎉 My favorite WordPress SEO tool: 👉 RankMath https://bit.ly/3fpHTE3
🎉 My favorite niche niche site theme: 👉 GeneratePress https://bit.ly/3GDMRHi
🎉 My second favorite WordPress theme: 👉 Elegant Theme's Divi https://bit.ly/3SoLErS
🎉 My favorite project management tool by far: 👉 ClickUp https://bit.ly/3ChaAMh
🎉 My favorite WordPress product table plugin tool: 👉 AzonPress https://bit.ly/3QIVN2y

— 𝗚 𝗘 𝗔 𝗥 —
👉 My microphone: Audio-Technica ATR-6550: https://amzn.to/3HNtJGc
👉 My computer: MacBook Pro 16 Inch: https://amzn.to/34GLcSa
👉 My Padcaster Parrot teleprompter: https://amzn.to/3gF0yt5
👉 My Elgato asuxiliary holding arm https://amzn.to/3sxTZ0V
👉 My lighting: Viltrox VL-300T https://amzn.to/3jorhJ7
👉 My camera: Sony ZV1: https://amzn.to/3uKNUkd
👉 My desk mount clamp: https://amzn.to/3Js9gar
👉 My camera tripod: https://amzn.to/2TpdUxI
▸ My editing Software: Premiere Pro CC 2022
▸ My screen Recording Software: Quicktime

— 𝗖 𝗢 𝗡 𝗡 𝗘 𝗖 𝗧 —
https://instagram.com/yerainabreu
https://facebook.com/yerainabreu
https://dribbble.com/yerainabreu
https://tiktok.com/@yerainabreu
https://twitter.com/yerainabreu
https://yerainabreu.com

If you've read this far down the description, I want to sincerely thank you for checking out my videos.

— 𝗧 𝗥 𝗔 𝗡 𝗦 𝗖 𝗥 𝗜 𝗣 𝗧 𝗜 𝗢 𝗡 —
I’m sure you’ve heard of Screaming Frog, the go-to SEO tool for website audits and data extraction. But have you ever wondered how to maximize its potential and focus your crawl on a specific subfolder?

Fear not. Today I’ll share with you my way of subfolder exclusively with the screaming frog SEO crawling tool. Let’s get started.

Screaming Frog is a powerful SEO tool that allows users to crawl websites and gather valuable data to improve their search engine optimization efforts. In addition to crawling the main domain of a website, Screaming Frog can also be used to crawl specific subfolders.

Crawling a subfolder with Screaming Frog can provide insights into the content and structure of that section of the website, helping to identify issues and opportunities for improvement. Here is a step-by-step guide on how to crawl a subfolder with Screaming Frog.

Understand the Subfolder
Before we dive in, it’s essential to understand the subfolder you want to crawl. A subfolder is simply a directory within your website that holds specific content, such as blog posts, images, or product pages. Once you’ve identified the subfolder you want to crawl, take note of its URL structure. It will look something like this: https://www.example.com/subfolder/.

Prepare Screaming Frog SEO Tool
First things first: you’ll need to have the Screaming Frog SEO Spider installed on your computer. If you haven’t already, download it from the Screaming Frog website and install it. Once you have the tool installed, open it up and take a moment to familiarize yourself with the interface.

Configure Your Crawl
Now, the fun begins. To configure the crawl to focus only on the subfolder, follow these steps:
1. Go to the ‘Configuration’ menu in the upper left corner of the Screaming Frog 2. interface.
3. Select ‘Spider’ from the dropdown menu.
4. Click the ‘Advanced’ tab.
5. Check the box that says ‘Crawl Outside of Start Folder.’
6. Click ‘OK’ to close the settings window.

Sharpen Your Focus – Set Up the Inclusion Filter
With the basic configuration done, it’s time to set up the inclusion filter to ensure that Screaming Frog crawls only the desired subfolder. Here’s how:
1. Go back to the ‘Configuration’ menu.
2. Select ‘Include’ from the dropdown menu.
3. Click ‘Add’ to create a new inclusion rule.
4. Enter the subfolder’s URL structure using regex. For example, if your subfolder’s URL is...

*Read the full transcript on my blog: https://yerainabreu.com/blog/how-to-crawl-a-subfolder-with-screaming-frog/

— 𝗧 𝗔 𝗚 𝗦 —
#screamingfrog #seo #searchengineoptimization #googletagmanager #tagmanager #htmltags #seo #digitalmarketing #marketing #socialmediamarketing #socialmedia #webdesign #branding #business #onlinemarketing #contentmarketing #website #marketingdigital #searchengineoptimization #webdevelopment #google #ecommerce #advertising #marketingstrategy #instagram #design #marketingtips #wordpress #entrepreneur #digital #graphicdesign #websitedesign #smallbusiness #sem

Loading comments...