.oO SearXNG Developer Documentation Oo.
Loading...
Searching...
No Matches
searx.engines.peertube Namespace Reference

Functions

 request (query, params)
 response (resp)
 video_response (resp)
 fetch_traits (EngineTraits engine_traits)

Variables

dict about
list categories = ["videos"]
bool paging = True
str base_url = "https://peer.tube"
bool time_range_support = True
dict time_range_table
bool safesearch = True
dict safesearch_table = {0: 'both', 1: 'false', 2: 'false'}

Detailed Description

Peertube and :py:obj:`SepiaSearch <searx.engines.sepiasearch>` do share
(more or less) the same REST API and the schema of the JSON result is identical.

Function Documentation

◆ fetch_traits()

searx.engines.peertube.fetch_traits ( EngineTraits engine_traits)
Fetch languages from peertube's search-index source code.

See videoLanguages_ in commit `8ed5c729 - Refactor and redesign client`_

.. _8ed5c729 - Refactor and redesign client:
   https://framagit.org/framasoft/peertube/search-index/-/commit/8ed5c729
.. _videoLanguages:
   https://framagit.org/framasoft/peertube/search-index/-/commit/8ed5c729#3d8747f9a60695c367c70bb64efba8f403721fad_0_291

Definition at line 135 of file peertube.py.

135def fetch_traits(engine_traits: EngineTraits):
136 """Fetch languages from peertube's search-index source code.
137
138 See videoLanguages_ in commit `8ed5c729 - Refactor and redesign client`_
139
140 .. _8ed5c729 - Refactor and redesign client:
141 https://framagit.org/framasoft/peertube/search-index/-/commit/8ed5c729
142 .. _videoLanguages:
143 https://framagit.org/framasoft/peertube/search-index/-/commit/8ed5c729#3d8747f9a60695c367c70bb64efba8f403721fad_0_291
144 """
145
146 resp = get(
147 'https://framagit.org/framasoft/peertube/search-index/-/raw/master/client/src/components/Filters.vue',
148 # the response from search-index repository is very slow
149 timeout=60,
150 )
151
152 if not resp.ok: # type: ignore
153 print("ERROR: response from peertube is not OK.")
154 return
155
156 js_lang = re.search(r"videoLanguages \‍(\‍)[^\n]+(.*?)\]", resp.text, re.DOTALL) # type: ignore
157 if not js_lang:
158 print("ERROR: can't determine languages from peertube")
159 return
160
161 for lang in re.finditer(r"\{ id: '([a-z]+)', label:", js_lang.group(1)):
162 eng_tag = lang.group(1)
163 if eng_tag == 'oc':
164 # Occitanis not known by babel, its closest relative is Catalan
165 # but 'ca' is already in the list of engine_traits.languages -->
166 # 'oc' will be ignored.
167 continue
168 try:
169 sxng_tag = language_tag(babel.Locale.parse(eng_tag))
170 except babel.UnknownLocaleError:
171 print("ERROR: %s is unknown by babel" % eng_tag)
172 continue
173
174 conflict = engine_traits.languages.get(sxng_tag)
175 if conflict:
176 if conflict != eng_tag:
177 print("CONFLICT: babel %s --> %s, %s" % (sxng_tag, conflict, eng_tag))
178 continue
179 engine_traits.languages[sxng_tag] = eng_tag
180
181 engine_traits.languages['zh_Hans'] = 'zh'
182 engine_traits.languages['zh_Hant'] = 'zh'

◆ request()

searx.engines.peertube.request ( query,
params )
Assemble request for the Peertube API

Definition at line 51 of file peertube.py.

51def request(query, params):
52 """Assemble request for the Peertube API"""
53
54 if not query:
55 return False
56
57 # eng_region = traits.get_region(params['searxng_locale'], 'en_US')
58 eng_lang = traits.get_language(params['searxng_locale'], None)
59
60 params['url'] = (
61 base_url.rstrip("/")
62 + "/api/v1/search/videos?"
63 + urlencode(
64 {
65 'search': query,
66 'searchTarget': 'search-index', # Vidiversum
67 'resultType': 'videos',
68 'start': (params['pageno'] - 1) * 10,
69 'count': 10,
70 # -createdAt: sort by date ascending / createdAt: date descending
71 'sort': '-match', # sort by *match descending*
72 'nsfw': safesearch_table[params['safesearch']],
73 }
74 )
75 )
76
77 if eng_lang is not None:
78 params['url'] += '&languageOneOf[]=' + eng_lang
79 params['url'] += '&boostLanguages[]=' + eng_lang
80
81 if params['time_range'] in time_range_table:
82 time = datetime.now().date() + time_range_table[params['time_range']]
83 params['url'] += '&startDate=' + time.isoformat()
84
85 return params
86
87

◆ response()

searx.engines.peertube.response ( resp)

Definition at line 88 of file peertube.py.

88def response(resp):
89 return video_response(resp)
90
91

References video_response().

Here is the call graph for this function:

◆ video_response()

searx.engines.peertube.video_response ( resp)
Parse video response from SepiaSearch and Peertube instances.

Definition at line 92 of file peertube.py.

92def video_response(resp):
93 """Parse video response from SepiaSearch and Peertube instances."""
94 results = []
95
96 json_data = resp.json()
97
98 if 'data' not in json_data:
99 return []
100
101 for result in json_data['data']:
102 metadata = [
103 x
104 for x in [
105 result.get('channel', {}).get('displayName'),
106 result.get('channel', {}).get('name') + '@' + result.get('channel', {}).get('host'),
107 ', '.join(result.get('tags', [])),
108 ]
109 if x
110 ]
111
112 duration = result.get('duration')
113 if duration:
114 duration = timedelta(seconds=duration)
115
116 results.append(
117 {
118 'url': result['url'],
119 'title': result['name'],
120 'content': html_to_text(result.get('description') or ''),
121 'author': result.get('account', {}).get('displayName'),
122 'length': duration,
123 'views': humanize_number(result['views']),
124 'template': 'videos.html',
125 'publishedDate': parse(result['publishedAt']),
126 'iframe_src': result.get('embedUrl'),
127 'thumbnail': result.get('thumbnailUrl') or result.get('previewUrl'),
128 'metadata': ' | '.join(metadata),
129 }
130 )
131
132 return results
133
134

Referenced by response().

Here is the caller graph for this function:

Variable Documentation

◆ about

dict searx.engines.peertube.about
Initial value:
1= {
2 # pylint: disable=line-too-long
3 "website": 'https://joinpeertube.org',
4 "wikidata_id": 'Q50938515',
5 "official_api_documentation": 'https://docs.joinpeertube.org/api-rest-reference.html#tag/Search/operation/searchVideos',
6 "use_official_api": True,
7 "require_api_key": False,
8 "results": 'JSON',
9}

Definition at line 20 of file peertube.py.

◆ base_url

str searx.engines.peertube.base_url = "https://peer.tube"

Definition at line 33 of file peertube.py.

◆ categories

list searx.engines.peertube.categories = ["videos"]

Definition at line 31 of file peertube.py.

◆ paging

bool searx.engines.peertube.paging = True

Definition at line 32 of file peertube.py.

◆ safesearch

bool searx.engines.peertube.safesearch = True

Definition at line 47 of file peertube.py.

◆ safesearch_table

dict searx.engines.peertube.safesearch_table = {0: 'both', 1: 'false', 2: 'false'}

Definition at line 48 of file peertube.py.

◆ time_range_support

bool searx.engines.peertube.time_range_support = True

Definition at line 39 of file peertube.py.

◆ time_range_table

dict searx.engines.peertube.time_range_table
Initial value:
1= {
2 'day': relativedelta(),
3 'week': relativedelta(weeks=-1),
4 'month': relativedelta(months=-1),
5 'year': relativedelta(years=-1),
6}

Definition at line 40 of file peertube.py.