Recently I was looking at a number of Flash-centric sites that should have been able to be indexed. Digging deeper into the problem I noticed that many sites have not updated their Flash detection and version checking scripts to allow spiders or mobile phone users to access their content “without” meeting the requirements they are testing for thus creating a spider trap.
Many of these scripts alone work ok but they have multiple detects which will often stop s spider unless you specifically test for them. I suggest you go through he following test to determine if spiders are getting trapped: .
- Is the browser compatible?
- Yes. Proceed to Step 2.
- No. Display alternative content. This is where the search spider will stop.
- Is Adobe Flash Player installed?
- Is the correct version of Adobe Flash Player installed?
If you want to see how many sites that feature SWF content actually block search spiders, simply do a search for “flash player required” and see how many results you find. There are millions of sites out there that show a message like “MyWebSite.com requires the Flash Player plug-in.” Spiders are not web browsers, so they cannot interact with your site to download any software requirements. They can read only document formats, such as HTML and PDF files. So when they run into these software download requirements, they go elsewhere.