Minor International Search Engines

Iranian search engine

SeznamBot is a robot that retrieves content for the Czech based Seznam search engine.

European Search engine that respects user privacy.

A crawler from Naver which collects content from web links which are shared on Naver services, this includes Naver blogs and cafes.

South Korean Search Engine and Portal

This is one of the main crawlers for the Russian Portal, Mail.ru.

Korean Search and rich media Content Aggregator

This is a mobile focused search service in China, co-founded the team behind the mobile browser UC Youshi and China’s Internet industry leader Alibaba. If you have business interests in China you may wish to whitelist this crawler.

Gigablast is one of a handful of search engines in the United States that maintains its own searchable index of over a billion pages.

Japanese search engine crawler. Ichiro is a search service for images and videos, so will collect not only HTML pages but also images and videos as well. They also occasionally collect other data for system research and development.

EasouSpider bot is a web scraping bot for the Chinese mobile search engine Easou. The bot helps to connect consumers and businesses. If you are not interested in doing business in China, you may want to consider blocking this bot.

Vietnamese market portal Coccoc Image Robot