Detect robots in koa

Note: This post is over 9 years old. The information may be outdated.

Koa detect robots. Fast Middleware detect bot crawler for Koa.

Installation

npm install koa-isbot --save

Usage

var koa = require('koa'),
  app = koa.app(),
  isBot = require('koa-isbot')

app.use(isBot())

app.use(function* (next) {
  console.log('isBot? ', this.state.isBot)
  // null or 'googlebot', 'bingbot', ...
})

app.listen(3000)

Update for Koa2

var koa = require('koa')
  , app = koa.app()
  , isBot = require('koa-isbot');

app.use(isBot());

app.use(aysnc (ctx, next) => {
    console.log('isBot? ', ctx.isBot);
    // null or 'googlebot', 'bingbot', ...
});

app.listen(3000);

Support list

  • Google bot - googlebot
  • Baidu - baiduspider
  • Guruji - gurujibot
  • Yandex - yandexbot
  • Slurp- slurp
  • MSN - msnbot
  • Bing - bingbot
  • Facebook - facebookexternalhit
  • Linkedin - linkedinbot
  • Twitter - twitterbot
  • Slack - slackbot
  • Telegram - telegrambot
  • Apple - applebot
  • Pingdom - pingdom
  • tumblr - tumblr

Source code

Github: https://github.com/duyet/koa-isbot NPM: https://www.npmjs.com/package/koa-isbot

How to contribute

  1. Fork the project on Github (https://github.com/duyet/koa-isbot/fork)
  2. Create a topic branch for your changes
  3. Ensure that you provide documentation and test coverage for your changes (patches won’t be accepted without)
  4. Create a pull request on Github (these are also a great place to start a conversation around a patch as early as possible)
JavascriptNode.jsJavascript Framework