searx.network.raise_for_httperror Namespace Reference

Functions
	is_cloudflare_challenge ("SXNG_Response" resp)
	is_cloudflare_firewall ("SXNG_Response" resp)
	raise_for_cloudflare_captcha ("SXNG_Response" resp)
	raise_for_recaptcha ("SXNG_Response" resp)
	raise_for_captcha ("SXNG_Response" resp)
None	raise_for_httperror ("SXNG_Response" resp)

Detailed Description

Raise exception for an HTTP response is an error.

Function Documentation

is_cloudflare_challenge()

searx.network.raise_for_httperror.is_cloudflare_challenge

(

"SXNG_Response"

resp

)

Definition at line 18 of file raise_for_httperror.py.

def is_cloudflare_challenge(resp: "SXNG_Response"):
    if resp.status_code in [429, 503]:
        if ('__cf_chl_jschl_tk__=' in resp.text) or (
            '/cdn-cgi/challenge-platform/' in resp.text
            and 'orchestrate/jsch/v1' in resp.text
            and 'window._cf_chl_enter(' in resp.text
        ):
            return True
    if resp.status_code == 403 and '__cf_chl_captcha_tk__=' in resp.text:
        return True
    return False
 
 

Referenced by raise_for_cloudflare_captcha().

Here is the caller graph for this function:

is_cloudflare_firewall()

searx.network.raise_for_httperror.is_cloudflare_firewall

(

"SXNG_Response"

resp

)

Definition at line 31 of file raise_for_httperror.py.

def is_cloudflare_firewall(resp: "SXNG_Response"):
    return resp.status_code == 403 and '<span class="cf-error-code">1020</span>' in resp.text
 
 

Referenced by raise_for_cloudflare_captcha().

Here is the caller graph for this function:

raise_for_captcha()

searx.network.raise_for_httperror.raise_for_captcha

(

"SXNG_Response"

resp

)

Definition at line 58 of file raise_for_httperror.py.

def raise_for_captcha(resp: "SXNG_Response"):
    raise_for_cloudflare_captcha(resp)
    raise_for_recaptcha(resp)
 
 

References raise_for_cloudflare_captcha(), and raise_for_recaptcha().

Referenced by raise_for_httperror().

Here is the call graph for this function:

Here is the caller graph for this function:

raise_for_cloudflare_captcha()

searx.network.raise_for_httperror.raise_for_cloudflare_captcha

(

"SXNG_Response"

resp

)

Definition at line 35 of file raise_for_httperror.py.

def raise_for_cloudflare_captcha(resp: "SXNG_Response"):
    if resp.headers.get('Server', '').startswith('cloudflare'):
        if is_cloudflare_challenge(resp):
            # https://support.cloudflare.com/hc/en-us/articles/200170136-Understanding-Cloudflare-Challenge-Passage-Captcha-
            # suspend for 2 weeks
            raise SearxEngineCaptchaException(
                message='Cloudflare CAPTCHA', suspended_time=get_setting('search.suspended_times.cf_SearxEngineCaptcha')
            )
 
        if is_cloudflare_firewall(resp):
            raise SearxEngineAccessDeniedException(
                message='Cloudflare Firewall',
                suspended_time=get_setting('search.suspended_times.cf_SearxEngineAccessDenied'),
            )
 
 

References searx.get_setting(), is_cloudflare_challenge(), and is_cloudflare_firewall().

Referenced by raise_for_captcha().

Here is the call graph for this function:

Here is the caller graph for this function:

raise_for_httperror()

None searx.network.raise_for_httperror.raise_for_httperror

(

"SXNG_Response"

resp

)

Raise exception for an HTTP response is an error.

Args:
    resp (requests.Response): Response to check

Raises:
    requests.HTTPError: raise by resp.raise_for_status()
    searx.exceptions.SearxEngineAccessDeniedException: raise when the HTTP status code is 402 or 403.
    searx.exceptions.SearxEngineTooManyRequestsException: raise when the HTTP status code is 429.
    searx.exceptions.SearxEngineCaptchaException: raise when if CATPCHA challenge is detected.

Definition at line 63 of file raise_for_httperror.py.

def raise_for_httperror(resp: "SXNG_Response") -> None:
    """Raise exception for an HTTP response is an error.
 
    Args:
        resp (requests.Response): Response to check
 
    Raises:
        requests.HTTPError: raise by resp.raise_for_status()
        searx.exceptions.SearxEngineAccessDeniedException: raise when the HTTP status code is 402 or 403.
        searx.exceptions.SearxEngineTooManyRequestsException: raise when the HTTP status code is 429.
        searx.exceptions.SearxEngineCaptchaException: raise when if CATPCHA challenge is detected.
    """
    if resp.status_code and resp.status_code >= 400:
        raise_for_captcha(resp)
        if resp.status_code in (402, 403):
            raise SearxEngineAccessDeniedException(message='HTTP error ' + str(resp.status_code))
        if resp.status_code == 429:
            raise SearxEngineTooManyRequestsException()
        resp.raise_for_status()

References raise_for_captcha().

Here is the call graph for this function:

raise_for_recaptcha()

searx.network.raise_for_httperror.raise_for_recaptcha

(

"SXNG_Response"

resp

)

Definition at line 51 of file raise_for_httperror.py.

def raise_for_recaptcha(resp: "SXNG_Response"):
    if resp.status_code == 503 and '"https://www.google.com/recaptcha/' in resp.text:
        raise SearxEngineCaptchaException(
            message='ReCAPTCHA', suspended_time=get_setting('search.suspended_times.recaptcha_SearxEngineCaptcha')
        )
 
 

References searx.get_setting().

Referenced by raise_for_captcha().

Here is the call graph for this function:

Here is the caller graph for this function: