mirrors/searxng
1
0
Fork 0
mirror of https://github.com/searxng/searxng.git synced 2024-06-03 05:49:23 +00:00
Code Issues Projects Releases Wiki Activity
searxng/docs/src/searx.botdetection.rst
Markus Heiser 1ec325adcc [mod] limiter -> botdetection: modularization and documentation 
In order to be able to meet the outstanding requirements, the implementation is
modularized and supplemented with documentation.

This patch does not contain functional change, except it fixes issue #2455

----

Aktivate limiter in the settings.yml and simulate a bot request by::

    curl -H 'Accept-Language: de-DE,en-US;q=0.7,en;q=0.3' \
         -H 'Accept: text/html'
         -H 'User-Agent: xyz' \
         -H 'Accept-Encoding: gzip' \
         'http://127.0.0.1:8888/search?q=foo'

In the LOG:

    DEBUG   searx.botdetection.link_token : missing ping for this request: .....

Since ``BURST_MAX_SUSPICIOUS = 2`` you can repeat the query above two time
before you get a "Too Many Requests" response.

Closes: https://github.com/searxng/searxng/issues/2455
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-05-29 14:54:56 +02:00

740 B
Raw Blame History

Bot Detection

Contents

searx.botdetection

searx.botdetection.limiter

Rate limit

searx.botdetection.ip_limit

searx.botdetection.link_token

Probe HTTP headers

searx.botdetection.http_accept

searx.botdetection.http_accept_encoding

searx.botdetection.http_accept_language

searx.botdetection.http_connection

searx.botdetection.http_user_agent