Premium Only Content

How to crawl ONLY the subfolder with Screaming Frog | SEO tutorial
Join the SEO email list 👉 https://yerainabreu.com/signup/
In this video, I'll show you how to crawl (just) subfolders with Screaming Frog. See more on 𝙈𝙔 𝘽𝙇𝙊𝙂 https://yerainabreu.com/blog/how-to-crawl-a-subfolder-with-screaming-frog/. Please let me know if this video helped you by leaving a 𝘾𝙊𝙈𝙈𝙀𝙉𝙏 👍 𝙎𝙐𝘽𝙎𝘾𝙍𝙄𝘽𝙀 to my channel by clicking this link 👉 https://www.youtube.com/yerainabreu?sub_confirmation=1. If you liked this video, please give it a 𝙇𝙄𝙆𝙀 and 𝙎𝙃𝘼𝙍𝙀 with friends! Read more below. 👇👇👇
— 𝗦 𝗔 𝗟 𝗘 𝗦 & 𝗢 𝗙 𝗙 𝗘 𝗥 𝗦 —
🎉 My favorite Hosting: 👉 Siteground https://bit.ly/3dP2RM6
🎉 My favorite AI content SEO tool: 👉 ScaleNut https://bit.ly/3dLoptj
🎉 My favorite WordPress SEO tool: 👉 RankMath https://bit.ly/3fpHTE3
🎉 My favorite niche niche site theme: 👉 GeneratePress https://bit.ly/3GDMRHi
🎉 My second favorite WordPress theme: 👉 Elegant Theme's Divi https://bit.ly/3SoLErS
🎉 My favorite project management tool by far: 👉 ClickUp https://bit.ly/3ChaAMh
🎉 My favorite WordPress product table plugin tool: 👉 AzonPress https://bit.ly/3QIVN2y
— 𝗚 𝗘 𝗔 𝗥 —
👉 My microphone: Audio-Technica ATR-6550: https://amzn.to/3HNtJGc
👉 My computer: MacBook Pro 16 Inch: https://amzn.to/34GLcSa
👉 My Padcaster Parrot teleprompter: https://amzn.to/3gF0yt5
👉 My Elgato asuxiliary holding arm https://amzn.to/3sxTZ0V
👉 My lighting: Viltrox VL-300T https://amzn.to/3jorhJ7
👉 My camera: Sony ZV1: https://amzn.to/3uKNUkd
👉 My desk mount clamp: https://amzn.to/3Js9gar
👉 My camera tripod: https://amzn.to/2TpdUxI
▸ My editing Software: Premiere Pro CC 2022
▸ My screen Recording Software: Quicktime
— 𝗖 𝗢 𝗡 𝗡 𝗘 𝗖 𝗧 —
▸ https://instagram.com/yerainabreu
▸ https://facebook.com/yerainabreu
▸ https://dribbble.com/yerainabreu
▸ https://tiktok.com/@yerainabreu
▸ https://twitter.com/yerainabreu
▸ https://yerainabreu.com
If you've read this far down the description, I want to sincerely thank you for checking out my videos.
— 𝗧 𝗥 𝗔 𝗡 𝗦 𝗖 𝗥 𝗜 𝗣 𝗧 𝗜 𝗢 𝗡 —
I’m sure you’ve heard of Screaming Frog, the go-to SEO tool for website audits and data extraction. But have you ever wondered how to maximize its potential and focus your crawl on a specific subfolder?
Fear not. Today I’ll share with you my way of subfolder exclusively with the screaming frog SEO crawling tool. Let’s get started.
Screaming Frog is a powerful SEO tool that allows users to crawl websites and gather valuable data to improve their search engine optimization efforts. In addition to crawling the main domain of a website, Screaming Frog can also be used to crawl specific subfolders.
Crawling a subfolder with Screaming Frog can provide insights into the content and structure of that section of the website, helping to identify issues and opportunities for improvement. Here is a step-by-step guide on how to crawl a subfolder with Screaming Frog.
Understand the Subfolder
Before we dive in, it’s essential to understand the subfolder you want to crawl. A subfolder is simply a directory within your website that holds specific content, such as blog posts, images, or product pages. Once you’ve identified the subfolder you want to crawl, take note of its URL structure. It will look something like this: https://www.example.com/subfolder/.
Prepare Screaming Frog SEO Tool
First things first: you’ll need to have the Screaming Frog SEO Spider installed on your computer. If you haven’t already, download it from the Screaming Frog website and install it. Once you have the tool installed, open it up and take a moment to familiarize yourself with the interface.
Configure Your Crawl
Now, the fun begins. To configure the crawl to focus only on the subfolder, follow these steps:
1. Go to the ‘Configuration’ menu in the upper left corner of the Screaming Frog 2. interface.
3. Select ‘Spider’ from the dropdown menu.
4. Click the ‘Advanced’ tab.
5. Check the box that says ‘Crawl Outside of Start Folder.’
6. Click ‘OK’ to close the settings window.
Sharpen Your Focus – Set Up the Inclusion Filter
With the basic configuration done, it’s time to set up the inclusion filter to ensure that Screaming Frog crawls only the desired subfolder. Here’s how:
1. Go back to the ‘Configuration’ menu.
2. Select ‘Include’ from the dropdown menu.
3. Click ‘Add’ to create a new inclusion rule.
4. Enter the subfolder’s URL structure using regex. For example, if your subfolder’s URL is...
*Read the full transcript on my blog: https://yerainabreu.com/blog/how-to-crawl-a-subfolder-with-screaming-frog/
— 𝗧 𝗔 𝗚 𝗦 —
#screamingfrog #seo #searchengineoptimization #googletagmanager #tagmanager #htmltags #seo #digitalmarketing #marketing #socialmediamarketing #socialmedia #webdesign #branding #business #onlinemarketing #contentmarketing #website #marketingdigital #searchengineoptimization #webdevelopment #google #ecommerce #advertising #marketingstrategy #instagram #design #marketingtips #wordpress #entrepreneur #digital #graphicdesign #websitedesign #smallbusiness #sem
-
LIVE
The Charlie Kirk Show
1 hour agoChristians Under Siege + Shame! Shame! + AMA | O'Neill, Ahern | 10.3.2025
5,257 watching -
LIVE
Right Side Broadcasting Network
3 hours agoLIVE: White House Press Secretary Karoline Leavitt Holds a Press Briefing - 10/3/25
2,738 watching -
LIVE
MattMorseTV
47 minutes ago🔴EMERGENCY White House PRESS CONFERENCE.🔴
867 watching -
LIVE
Side Scrollers Podcast
2 hours agoNetflix Execs to TESTIFY Over LGBTQ Agenda + IGN DESTROYS Xbox Game Pass + More | Side Scrollers
419 watching -
LIVE
iCkEdMeL
3 hours ago $1.44 earnedChicago Erupts in ICE Protest as Diddy Faces Judge’s Hammer
148 watching -
LIVE
Barry Cunningham
27 minutes agoBREAKING NEWS: KAROLINE LEAVITT HOSTS SURPRISE WHITE HOUSE PRESS CONFERENCE!
1,005 watching -
1:31:26
Steven Crowder
3 hours agoHegseth Makes the Military Great Again!
140K146 -
1:13:06
The Rubin Report
2 hours agoPress Gasps When Told Trump’s Brutal Plan for Layoff of Gov’t Workers with Dinesh D'Souza
36.7K15 -
1:01:54
Dr. Eric Berg
4 days agoThe Dr. Berg Show LIVE October 3, 2025
12.6K2 -
LIVE
LFA TV
14 hours agoLIVE & BREAKING NEWS! | FRIDAY 10/3/25
3,548 watching