searx.engines.duckduckgo_extra Namespace Reference

Functions
	request (query, params)
	_image_result (result)
	_video_result (result)
	_news_result (result)
	response (resp)

Variables
logging	logger .Logger
dict	about
list	categories = ['images', 'web']
str	ddg_category = 'images'
bool	paging = True
bool	safesearch = True
bool	send_accept_language_header = True
dict	safesearch_cookies = {0: '-2', 1: None, 2: '1'}
dict	safesearch_args = {0: '1', 1: None, 2: '1'}
dict	search_path_map = {'images': 'i', 'videos': 'v', 'news': 'news'}

Detailed Description

DuckDuckGo Extra (images, videos, news)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Function Documentation

_image_result()

searx.engines.duckduckgo_extra._image_result ( result )

protected

Definition at line 98 of file duckduckgo_extra.py.

def _image_result(result):
    return {
        'template': 'images.html',
        'url': result['url'],
        'title': result['title'],
        'content': '',
        'thumbnail_src': result['thumbnail'],
        'img_src': result['image'],
        'resolution': '%s x %s' % (result['width'], result['height']),
        'source': result['source'],
    }
 
 

Referenced by searx.engines.duckduckgo_extra.response().

Here is the caller graph for this function:

_news_result()

searx.engines.duckduckgo_extra._news_result ( result )

protected

Definition at line 125 of file duckduckgo_extra.py.

def _news_result(result):
    return {
        'url': result['url'],
        'title': result['title'],
        'content': result['excerpt'],
        'source': result['source'],
        'publishedDate': datetime.utcfromtimestamp(result['date']),
    }
 
 

Referenced by searx.engines.duckduckgo_extra.response().

Here is the caller graph for this function:

_video_result()

searx.engines.duckduckgo_extra._video_result ( result )

protected

Definition at line 111 of file duckduckgo_extra.py.

def _video_result(result):
    return {
        'template': 'videos.html',
        'url': result['content'],
        'title': result['title'],
        'content': result['description'],
        'thumbnail': result['images'].get('small') or result['images'].get('medium'),
        'iframe_src': get_embeded_stream_url(result['content']),
        'source': result['provider'],
        'length': result['duration'],
        'metadata': result.get('uploader'),
    }
 
 

Referenced by searx.engines.duckduckgo_extra.response().

Here is the caller graph for this function:

request()

searx.engines.duckduckgo_extra.request	(		query,
			params )

Definition at line 49 of file duckduckgo_extra.py.

def request(query, params):
    eng_region: str = traits.get_region(params['searxng_locale'], traits.all_locale)  # type: ignore
 
    # request needs a vqd argument
    vqd = get_vqd(query, eng_region, force_request=True)
 
    if not vqd:
        # some search terms do not have results and therefore no vqd value
        params['url'] = None
        return params
 
    eng_lang = get_ddg_lang(traits, params['searxng_locale'])
 
    args = {
        'q': query,
        'o': 'json',
        # 'u': 'bing',
        'l': eng_region,
        'f': ',,,,,',
        'vqd': vqd,
    }
 
    if params['pageno'] > 1:
        args['s'] = (params['pageno'] - 1) * 100
 
    params['cookies']['ad'] = eng_lang  # zh_CN
    params['cookies']['ah'] = eng_region  # "us-en,de-de"
    params['cookies']['l'] = eng_region  # "hk-tzh"
 
    safe_search = safesearch_cookies.get(params['safesearch'])
    if safe_search is not None:
        params['cookies']['p'] = safe_search  # "-2", "1"
    safe_search = safesearch_args.get(params['safesearch'])
    if safe_search is not None:
        args['p'] = safe_search  # "-1", "1"
 
    logger.debug("cookies: %s", params['cookies'])
 
    params['url'] = f'https://duckduckgo.com/{search_path_map[ddg_category]}.js?{urlencode(args)}'
 
    # sending these two headers prevents rate limiting for the query
    params['headers'] = {
        'Referer': 'https://duckduckgo.com/',
        'X-Requested-With': 'XMLHttpRequest',
    }
 
    return params
 
 

response()

searx.engines.duckduckgo_extra.response

(

resp

)

Definition at line 135 of file duckduckgo_extra.py.

def response(resp):
    results = []
    res_json = resp.json()
 
    for result in res_json['results']:
        if ddg_category == 'images':
            results.append(_image_result(result))
        elif ddg_category == 'videos':
            results.append(_video_result(result))
        elif ddg_category == 'news':
            results.append(_news_result(result))
        else:
            raise ValueError(f"Invalid duckduckgo category: {ddg_category}")
 
    return results

References searx.engines.duckduckgo_extra._image_result(), searx.engines.duckduckgo_extra._news_result(), and searx.engines.duckduckgo_extra._video_result().

Here is the call graph for this function:

Variable Documentation

about

dict searx.engines.duckduckgo_extra.about

Initial value:

=  {
    "website": 'https://duckduckgo.com/',
    "wikidata_id": 'Q12805',
    "use_official_api": False,
    "require_api_key": False,
    "results": 'JSON (site requires js to get images)',
}

Definition at line 26 of file duckduckgo_extra.py.

categories

list searx.engines.duckduckgo_extra.categories = ['images', 'web']

Definition at line 35 of file duckduckgo_extra.py.

ddg_category

str searx.engines.duckduckgo_extra.ddg_category = 'images'

Definition at line 36 of file duckduckgo_extra.py.

logger

logging searx.engines.duckduckgo_extra.logger .Logger

Definition at line 21 of file duckduckgo_extra.py.

paging

bool searx.engines.duckduckgo_extra.paging = True

Definition at line 39 of file duckduckgo_extra.py.

safesearch

bool searx.engines.duckduckgo_extra.safesearch = True

Definition at line 40 of file duckduckgo_extra.py.

safesearch_args

dict searx.engines.duckduckgo_extra.safesearch_args = {0: '1', 1: None, 2: '1'}

Definition at line 44 of file duckduckgo_extra.py.

safesearch_cookies

dict searx.engines.duckduckgo_extra.safesearch_cookies = {0: '-2', 1: None, 2: '1'}

Definition at line 43 of file duckduckgo_extra.py.

search_path_map

dict searx.engines.duckduckgo_extra.search_path_map = {'images': 'i', 'videos': 'v', 'news': 'news'}

Definition at line 46 of file duckduckgo_extra.py.

send_accept_language_header

bool searx.engines.duckduckgo_extra.send_accept_language_header = True

Definition at line 41 of file duckduckgo_extra.py.