.oO SearXNG Developer Documentation Oo.
Loading...
Searching...
No Matches
searx.engines.duckduckgo_extra Namespace Reference

Functions

 request (query, params)
 _image_result (result)
 _video_result (result)
 _news_result (result)
 response (resp)

Variables

dict about
list categories = ['images', 'web']
str ddg_category = 'images'
bool paging = True
bool safesearch = True
bool send_accept_language_header = True
dict safesearch_cookies = {0: '-2', 1: None, 2: '1'}
dict safesearch_args = {0: '1', 1: None, 2: '1'}
dict search_path_map = {'images': 'i', 'videos': 'v', 'news': 'news'}

Detailed Description

DuckDuckGo Extra (images, videos, news)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Function Documentation

◆ _image_result()

searx.engines.duckduckgo_extra._image_result ( result)
protected

Definition at line 87 of file duckduckgo_extra.py.

87def _image_result(result):
88 return {
89 'template': 'images.html',
90 'url': result['url'],
91 'title': result['title'],
92 'content': '',
93 'thumbnail_src': result['thumbnail'],
94 'img_src': result['image'],
95 'resolution': '%s x %s' % (result['width'], result['height']),
96 'source': result['source'],
97 }
98
99

Referenced by response().

Here is the caller graph for this function:

◆ _news_result()

searx.engines.duckduckgo_extra._news_result ( result)
protected

Definition at line 114 of file duckduckgo_extra.py.

114def _news_result(result):
115 return {
116 'url': result['url'],
117 'title': result['title'],
118 'content': html_to_text(result['excerpt']),
119 'source': result['source'],
120 'publishedDate': datetime.fromtimestamp(result['date']),
121 }
122
123

Referenced by response().

Here is the caller graph for this function:

◆ _video_result()

searx.engines.duckduckgo_extra._video_result ( result)
protected

Definition at line 100 of file duckduckgo_extra.py.

100def _video_result(result):
101 return {
102 'template': 'videos.html',
103 'url': result['content'],
104 'title': result['title'],
105 'content': result['description'],
106 'thumbnail': result['images'].get('small') or result['images'].get('medium'),
107 'iframe_src': get_embeded_stream_url(result['content']),
108 'source': result['provider'],
109 'length': result['duration'],
110 'metadata': result.get('uploader'),
111 }
112
113

Referenced by response().

Here is the caller graph for this function:

◆ request()

searx.engines.duckduckgo_extra.request ( query,
params )

Definition at line 38 of file duckduckgo_extra.py.

38def request(query, params):
39 eng_region: str = traits.get_region(params['searxng_locale'], traits.all_locale) # type: ignore
40
41 # request needs a vqd argument
42 vqd = get_vqd(query, eng_region, force_request=True)
43
44 if not vqd:
45 # some search terms do not have results and therefore no vqd value
46 params['url'] = None
47 return params
48
49 eng_lang = get_ddg_lang(traits, params['searxng_locale'])
50
51 args = {
52 'q': query,
53 'o': 'json',
54 # 'u': 'bing',
55 'l': eng_region,
56 'f': ',,,,,',
57 'vqd': vqd,
58 }
59
60 if params['pageno'] > 1:
61 args['s'] = (params['pageno'] - 1) * 100
62
63 params['cookies']['ad'] = eng_lang # zh_CN
64 params['cookies']['ah'] = eng_region # "us-en,de-de"
65 params['cookies']['l'] = eng_region # "hk-tzh"
66
67 safe_search = safesearch_cookies.get(params['safesearch'])
68 if safe_search is not None:
69 params['cookies']['p'] = safe_search # "-2", "1"
70 safe_search = safesearch_args.get(params['safesearch'])
71 if safe_search is not None:
72 args['p'] = safe_search # "-1", "1"
73
74 logger.debug("cookies: %s", params['cookies'])
75
76 params['url'] = f'https://duckduckgo.com/{search_path_map[ddg_category]}.js?{urlencode(args)}'
77
78 # sending these two headers prevents rate limiting for the query
79 params['headers'] = {
80 'Referer': 'https://duckduckgo.com/',
81 'X-Requested-With': 'XMLHttpRequest',
82 }
83
84 return params
85
86

◆ response()

searx.engines.duckduckgo_extra.response ( resp)

Definition at line 124 of file duckduckgo_extra.py.

124def response(resp):
125 results = []
126 res_json = resp.json()
127
128 for result in res_json['results']:
129 if ddg_category == 'images':
130 results.append(_image_result(result))
131 elif ddg_category == 'videos':
132 results.append(_video_result(result))
133 elif ddg_category == 'news':
134 results.append(_news_result(result))
135 else:
136 raise ValueError(f"Invalid duckduckgo category: {ddg_category}")
137
138 return results

References _image_result(), _news_result(), and _video_result().

Here is the call graph for this function:

Variable Documentation

◆ about

dict searx.engines.duckduckgo_extra.about
Initial value:
1= {
2 "website": 'https://duckduckgo.com/',
3 "wikidata_id": 'Q12805',
4 "use_official_api": False,
5 "require_api_key": False,
6 "results": 'JSON (site requires js to get images)',
7}

Definition at line 15 of file duckduckgo_extra.py.

◆ categories

list searx.engines.duckduckgo_extra.categories = ['images', 'web']

Definition at line 24 of file duckduckgo_extra.py.

◆ ddg_category

str searx.engines.duckduckgo_extra.ddg_category = 'images'

Definition at line 25 of file duckduckgo_extra.py.

◆ paging

bool searx.engines.duckduckgo_extra.paging = True

Definition at line 28 of file duckduckgo_extra.py.

◆ safesearch

bool searx.engines.duckduckgo_extra.safesearch = True

Definition at line 29 of file duckduckgo_extra.py.

◆ safesearch_args

dict searx.engines.duckduckgo_extra.safesearch_args = {0: '1', 1: None, 2: '1'}

Definition at line 33 of file duckduckgo_extra.py.

◆ safesearch_cookies

dict searx.engines.duckduckgo_extra.safesearch_cookies = {0: '-2', 1: None, 2: '1'}

Definition at line 32 of file duckduckgo_extra.py.

◆ search_path_map

dict searx.engines.duckduckgo_extra.search_path_map = {'images': 'i', 'videos': 'v', 'news': 'news'}

Definition at line 35 of file duckduckgo_extra.py.

◆ send_accept_language_header

bool searx.engines.duckduckgo_extra.send_accept_language_header = True

Definition at line 30 of file duckduckgo_extra.py.