searx.engines.gentoo Namespace Reference

Functions
	locale_to_lang_code (locale)
	get_lang_urls (language)
	request (query, params)
	response (resp)

Variables
dict	about
list	categories = ['it', 'software wikis']
bool	paging = True
str	base_url = 'https://wiki.gentoo.org'
str	xpath_results = '//ul[@class="mw-search-results"]/li'
str	xpath_link = './/div[@class="mw-search-result-heading"]/a'
str	xpath_content = './/div[@class="searchresult"]'
dict	lang_urls
dict	main_langs

Detailed Description

 Gentoo Wiki

Function Documentation

get_lang_urls()

searx.engines.gentoo.get_lang_urls

(

language

)

Definition at line 51 of file gentoo.py.

def get_lang_urls(language):
    if language != 'en':
        return lang_urls['others']
    return lang_urls['en']
 
 
# Language names to build search requests for
# those languages which are hosted on the main site.

Referenced by searx.engines.gentoo.request(), and searx.engines.gentoo.response().

Here is the caller graph for this function:

locale_to_lang_code()

searx.engines.gentoo.locale_to_lang_code

(

locale

)

Definition at line 32 of file gentoo.py.

def locale_to_lang_code(locale):
    if locale.find('-') >= 0:
        locale = locale.split('-')[0]
    return locale
 
 
# wikis for some languages were moved off from the main site, we need to make
# requests to correct URLs to be able to get results in those languages

Referenced by searx.engines.gentoo.request(), and searx.engines.gentoo.response().

Here is the caller graph for this function:

request()

searx.engines.gentoo.request	(		query,
			params )

Definition at line 84 of file gentoo.py.

def request(query, params):
    # translate the locale (e.g. 'en-US') to language code ('en')
    language = locale_to_lang_code(params['language'])
 
    # if our language is hosted on the main site, we need to add its name
    # to the query in order to narrow the results to that language
    if language in main_langs:
        query += ' (' + main_langs[language] + ')'
 
    # prepare the request parameters
    query = urlencode({'search': query})
    offset = (params['pageno'] - 1) * 20
 
    # get request URLs for our language of choice
    urls = get_lang_urls(language)
    search_url = urls['base'] + urls['search']
 
    params['url'] = search_url.format(query=query, offset=offset, language=language)
 
    return params
 
 
# get response from search-request

References searx.engines.gentoo.get_lang_urls(), and searx.engines.gentoo.locale_to_lang_code().

Here is the call graph for this function:

response()

searx.engines.gentoo.response

(

resp

)

Definition at line 107 of file gentoo.py.

def response(resp):
    # get the base URL for the language in which request was made
    language = locale_to_lang_code(resp.search_params['language'])
    url = get_lang_urls(language)['base']
 
    results = []
 
    dom = html.fromstring(resp.text)
 
    # parse results
    for result in dom.xpath(xpath_results):
        link = result.xpath(xpath_link)[0]
        href = urljoin(url, link.attrib.get('href'))
        title = extract_text(link)
        content = extract_text(result.xpath(xpath_content))
 
        results.append({'url': href, 'title': title, 'content': content})
 
    return results

References searx.engines.gentoo.get_lang_urls(), and searx.engines.gentoo.locale_to_lang_code().

Here is the call graph for this function:

Variable Documentation

about

dict searx.engines.gentoo.about

Initial value:

=  {
    "website": 'https://wiki.gentoo.org/',
    "wikidata_id": 'Q1050637',
    "official_api_documentation": 'https://wiki.gentoo.org/api.php',
    "use_official_api": False,
    "require_api_key": False,
    "results": 'HTML',
}

Definition at line 11 of file gentoo.py.

base_url

str searx.engines.gentoo.base_url = 'https://wiki.gentoo.org'

Definition at line 23 of file gentoo.py.

categories

list searx.engines.gentoo.categories = ['it', 'software wikis']

Definition at line 21 of file gentoo.py.

lang_urls

dict searx.engines.gentoo.lang_urls

Initial value:

=  {
    'en': {'base': 'https://wiki.gentoo.org', 'search': '/index.php?title=Special:Search&offset={offset}&{query}'},
    'others': {
        'base': 'https://wiki.gentoo.org',
        'search': '/index.php?title=Special:Search&offset={offset}&{query}\
                &profile=translation&languagefilter={language}',
    },
}

Definition at line 40 of file gentoo.py.

main_langs

dict searx.engines.gentoo.main_langs

Initial value:

=  {
    'ar': 'العربية',
    'bg': 'Български',
    'cs': 'Česky',
    'da': 'Dansk',
    'el': 'Ελληνικά',
    'es': 'Español',
    'he': 'עברית',
    'hr': 'Hrvatski',
    'hu': 'Magyar',
    'it': 'Italiano',
    'ko': '한국어',
    'lt': 'Lietuviškai',
    'nl': 'Nederlands',
    'pl': 'Polski',
    'pt': 'Português',
    'ru': 'Русский',
    'sl': 'Slovenský',
    'th': 'ไทย',
    'uk': 'Українська',
    'zh': '简体中文',
}

Definition at line 59 of file gentoo.py.

paging

bool searx.engines.gentoo.paging = True

Definition at line 22 of file gentoo.py.

xpath_content

str searx.engines.gentoo.xpath_content = './/div[@class="searchresult"]'

Definition at line 28 of file gentoo.py.

xpath_link

str searx.engines.gentoo.xpath_link = './/div[@class="mw-search-result-heading"]/a'

Definition at line 27 of file gentoo.py.

xpath_results

str searx.engines.gentoo.xpath_results = '//ul[@class="mw-search-results"]/li'

Definition at line 26 of file gentoo.py.