Cookie Consent by Free Privacy Policy Generator Baiduspider-image User Agent - Baidu Bot Details | CL SEO

Baiduspider-image

Baidu Since 2003
Search Respects robots.txt
#search #baidu #images #chinese
Quick Actions
Official Docs

What is Baiduspider-image?

Baiduspider-image is Baidu's specialized crawler for indexing images for Baidu Image Search. Given Baidu's dominance in China, this crawler is essential for image visibility in the Chinese market. The bot indexes various image formats and considers factors like image quality, relevance, and surrounding Chinese text. For businesses with visual content targeting Chinese audiences, optimizing for Baiduspider-image is crucial. The crawler can be controlled independently through robots.txt.

User Agent String

Baiduspider-image+(+http://www.baidu.com/search/spider.htm)

How to Control Baiduspider-image

Block Completely

To prevent Baiduspider-image from accessing your entire website, add this to your robots.txt file:

# Block Baiduspider-image User-agent: Baiduspider-image Disallow: /

Block Specific Directories

To restrict access to certain parts of your site while allowing others:

User-agent: Baiduspider-image Disallow: /admin/ Disallow: /private/ Disallow: /wp-admin/ Allow: /public/

Set Crawl Delay

To slow down the crawl rate (note: not all bots respect this directive):

User-agent: Baiduspider-image Crawl-delay: 10

How to Verify Baiduspider-image

Verification Method:
Check Baidu's IP ranges

Learn more in the official documentation.

Detection Patterns

Multiple ways to detect Baiduspider-image in your application:

Basic Pattern

/Baiduspider\-image/i

Strict Pattern

/^Baiduspider\-image\+\(\+http\://www\.baidu\.com/search/spider\.htm\)$/

Flexible Pattern

/Baiduspider\-image[\s\/]?[\d\.]*?/i

Vendor Match

/.*Baidu.*Baiduspider\-image/i

Implementation Examples

// PHP Detection for Baiduspider-image function detect_baiduspider_image() { $user_agent = $_SERVER['HTTP_USER_AGENT'] ?? ''; $pattern = '/Baiduspider\\-image/i'; if (preg_match($pattern, $user_agent)) { // Log the detection error_log('Baiduspider-image detected from IP: ' . $_SERVER['REMOTE_ADDR']); // Set cache headers header('Cache-Control: public, max-age=3600'); header('X-Robots-Tag: noarchive'); // Optional: Serve cached version if (file_exists('cache/' . md5($_SERVER['REQUEST_URI']) . '.html')) { readfile('cache/' . md5($_SERVER['REQUEST_URI']) . '.html'); exit; } return true; } return false; }
# Python/Flask Detection for Baiduspider-image import re from flask import request, make_response def detect_baiduspider_image(): user_agent = request.headers.get('User-Agent', '') pattern = r'Baiduspider-image' if re.search(pattern, user_agent, re.IGNORECASE): # Create response with caching response = make_response() response.headers['Cache-Control'] = 'public, max-age=3600' response.headers['X-Robots-Tag'] = 'noarchive' return True return False # Django Middleware class BaiduspiderimageMiddleware: def __init__(self, get_response): self.get_response = get_response def __call__(self, request): if self.detect_bot(request): # Handle bot traffic pass return self.get_response(request)
// JavaScript/Node.js Detection for Baiduspider-image const express = require('express'); const app = express(); // Middleware to detect Baiduspider-image function detectBaiduspiderimage(req, res, next) { const userAgent = req.headers['user-agent'] || ''; const pattern = /Baiduspider-image/i; if (pattern.test(userAgent)) { // Log bot detection console.log('Baiduspider-image detected from IP:', req.ip); // Set cache headers res.set({ 'Cache-Control': 'public, max-age=3600', 'X-Robots-Tag': 'noarchive' }); // Mark request as bot req.isBot = true; req.botName = 'Baiduspider-image'; } next(); } app.use(detectBaiduspiderimage);
# Apache .htaccess rules for Baiduspider-image # Block completely RewriteEngine On RewriteCond %{HTTP_USER_AGENT} Baiduspider\-image [NC] RewriteRule .* - [F,L] # Or redirect to a static version RewriteCond %{HTTP_USER_AGENT} Baiduspider\-image [NC] RewriteCond %{REQUEST_URI} !^/static/ RewriteRule ^(.*)$ /static/$1 [L] # Or set environment variable for PHP SetEnvIfNoCase User-Agent "Baiduspider\-image" is_bot=1 # Add cache headers for this bot <If "%{HTTP_USER_AGENT} =~ /Baiduspider\-image/i"> Header set Cache-Control "public, max-age=3600" Header set X-Robots-Tag "noarchive" </If>
# Nginx configuration for Baiduspider-image # Map user agent to variable map $http_user_agent $is_baiduspider_image { default 0; ~*Baiduspider\-image 1; } server { # Block the bot completely if ($is_baiduspider_image) { return 403; } # Or serve cached content location / { if ($is_baiduspider_image) { root /var/www/cached; try_files $uri $uri.html $uri/index.html @backend; } try_files $uri @backend; } # Add headers for bot requests location @backend { if ($is_baiduspider_image) { add_header Cache-Control "public, max-age=3600"; add_header X-Robots-Tag "noarchive"; } proxy_pass http://backend; } }

Should You Block This Bot?

Recommendations based on your website type:

Site Type Recommendation Reasoning
E-commerce Allow Essential for product visibility in search results
Blog/News Allow Increases content reach and discoverability
SaaS Application Block No benefit for application interfaces; preserve resources
Documentation Allow Improves documentation discoverability for developers
Corporate Site Allow Allow for public pages, block sensitive areas like intranets

Advanced robots.txt Configurations

E-commerce Site Configuration

User-agent: Baiduspider-image Crawl-delay: 5 Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ Disallow: /api/ Disallow: /*?sort= Disallow: /*?filter= Disallow: /*&page= Allow: /products/ Allow: /categories/ Sitemap: https://example.com/sitemap.xml

Publishing/Blog Configuration

User-agent: Baiduspider-image Crawl-delay: 10 Disallow: /wp-admin/ Disallow: /drafts/ Disallow: /preview/ Disallow: /*?replytocom= Allow: /

SaaS/Application Configuration

User-agent: Baiduspider-image Disallow: /app/ Disallow: /api/ Disallow: /dashboard/ Disallow: /settings/ Allow: / Allow: /pricing/ Allow: /features/ Allow: /docs/

Quick Reference

User Agent Match

Baiduspider-image

Robots.txt Name

Baiduspider-image

Category

search

Respects robots.txt

Yes
Copied to clipboard!