searx.engines.openalex Namespace Reference

Functions
None	request (str query, dict[str, t.Any] params)
EngineResults	response (SXNG_Response resp)
str|None	_stringify_pages (dict[str, t.Any] biblio)
datetime|None	_parse_date (str|None value)
str|None	_doi_to_plain (str|None doi_value)
str|None	_reconstruct_abstract (dict[str, list[int]]|None abstract_inverted_index)
tuple[str, str|None, str|None]	_extract_links (dict[str, t.Any] item)
list[str]	_extract_authors (dict[str, t.Any] item)
list[str]	_extract_tags (dict[str, t.Any] item)
tuple[str|None, str|None, str|None, str|None, str|None, datetime|None]	_extract_biblio (dict[str, t.Any] item)
str|None	_extract_comments (dict[str, t.Any] item)

Variables
dict	about
list	categories = ["science", "scientific publications"]
bool	paging = True
str	search_url = "https://api.openalex.org/works"
str	mailto = ""

Function Documentation

_doi_to_plain()

str | None searx.engines.openalex._doi_to_plain ( str | None doi_value )

protected

Definition at line 126 of file openalex.py.

def _doi_to_plain(doi_value: str | None) -> str | None:
    if not doi_value:
        return None
    # OpenAlex `doi` field is commonly a full URL like https://doi.org/10.1234/abcd
    return doi_value.removeprefix("https://doi.org/")
 
 

Referenced by response().

Here is the caller graph for this function:

_extract_authors()

list[str] searx.engines.openalex._extract_authors ( dict[str, t.Any] item )

protected

Definition at line 165 of file openalex.py.

def _extract_authors(item: dict[str, t.Any]) -> list[str]:
    authors: list[str] = []
    for auth in item.get("authorships", []):
        if not auth:
            continue
        author_obj = auth.get("author", {})
        display_name = author_obj.get("display_name")
        if isinstance(display_name, str) and display_name != "":
            authors.append(display_name)
    return authors
 
 

Referenced by response().

Here is the caller graph for this function:

_extract_biblio()

tuple[str | None, str | None, str | None, str | None, str | None, datetime | None] searx.engines.openalex._extract_biblio ( dict[str, t.Any] item )

protected

Definition at line 186 of file openalex.py.

) -> tuple[str | None, str | None, str | None, str | None, str | None, datetime | None]:
    host_venue = item.get("host_venue", {})
    biblio = item.get("biblio", {})
    journal: str | None = host_venue.get("display_name")
    publisher: str | None = host_venue.get("publisher")
    pages = _stringify_pages(biblio)
    volume = biblio.get("volume")
    number = biblio.get("issue")
    published_date = _parse_date(item.get("publication_date"))
    return journal, publisher, pages, volume, number, published_date
 
 

References _parse_date(), and _stringify_pages().

Referenced by response().

Here is the call graph for this function:

Here is the caller graph for this function:

_extract_comments()

str | None searx.engines.openalex._extract_comments ( dict[str, t.Any] item )

protected

Definition at line 200 of file openalex.py.

def _extract_comments(item: dict[str, t.Any]) -> str | None:
    cited_by_count = item.get("cited_by_count")
    if isinstance(cited_by_count, int):
        return f"{cited_by_count} citations"
    return None

Referenced by response().

Here is the caller graph for this function:

_extract_links()

tuple[str, str | None, str | None] searx.engines.openalex._extract_links ( dict[str, t.Any] item )

protected

Definition at line 154 of file openalex.py.

def _extract_links(item: dict[str, t.Any]) -> tuple[str, str | None, str | None]:
    primary_location = item.get("primary_location", {})
    landing_page_url: str | None = primary_location.get("landing_page_url")
    work_url: str = item.get("id", "")
    url: str = landing_page_url or work_url
    open_access = item.get("open_access", {})
    pdf_url: str | None = primary_location.get("pdf_url") or open_access.get("oa_url")
    html_url: str | None = landing_page_url
    return url, html_url, pdf_url
 
 

Referenced by response().

Here is the caller graph for this function:

_extract_tags()

list[str] searx.engines.openalex._extract_tags ( dict[str, t.Any] item )

protected

Definition at line 177 of file openalex.py.

def _extract_tags(item: dict[str, t.Any]) -> list[str]:
    tags: list[str] = []
    for c in item.get("concepts", []):
        name = (c or {}).get("display_name")
        if isinstance(name, str) and name != "":
            tags.append(name)
    return tags
 
 

Referenced by response().

Here is the caller graph for this function:

_parse_date()

datetime | None searx.engines.openalex._parse_date ( str | None value )

protected

Definition at line 114 of file openalex.py.

def _parse_date(value: str | None) -> datetime | None:
    if not value:
        return None
    # OpenAlex may return YYYY, YYYY-MM or YYYY-MM-DD
    for fmt in ("%Y-%m-%d", "%Y-%m", "%Y"):
        try:
            return datetime.strptime(value, fmt)
        except ValueError:
            continue
    return None
 
 

Referenced by _extract_biblio().

Here is the caller graph for this function:

_reconstruct_abstract()

str | None searx.engines.openalex._reconstruct_abstract ( dict[str, list[int]] | None abstract_inverted_index )

protected

Definition at line 133 of file openalex.py.

) -> str | None:
    # The abstract is returned as an inverted index {token: [positions...]}
    # Reconstruct by placing tokens at their positions and joining with spaces.
    if not abstract_inverted_index:
        return None
    position_to_token: dict[int, str] = {}
    max_index = -1
    for token, positions in abstract_inverted_index.items():
        for pos in positions:
            position_to_token[pos] = token
            max_index = max(max_index, pos)
    if max_index < 0:
        return None
    ordered_tokens = [position_to_token.get(i, "") for i in range(0, max_index + 1)]
    # collapse multiple empty tokens
    text = " ".join(t for t in ordered_tokens if t != "")
    return text if text != "" else None
 
 

Referenced by response().

Here is the caller graph for this function:

_stringify_pages()

str | None searx.engines.openalex._stringify_pages ( dict[str, t.Any] biblio )

protected

Definition at line 102 of file openalex.py.

def _stringify_pages(biblio: dict[str, t.Any]) -> str | None:
    first_page = biblio.get("first_page")
    last_page = biblio.get("last_page")
    if first_page and last_page:
        return f"{first_page}-{last_page}"
    if first_page:
        return str(first_page)
    if last_page:
        return str(last_page)
    return None
 
 

Referenced by _extract_biblio().

Here is the caller graph for this function:

request()

None searx.engines.openalex.request	(	str	query,
		dict[str, t.Any]	params )

Definition at line 34 of file openalex.py.

def request(query: str, params: dict[str, t.Any]) -> None:
    # Build OpenAlex query using search parameter and paging
    args = {
        "search": query,
        "page": params["pageno"],
        # keep result size moderate; OpenAlex default is 25
        "per-page": 10,
        # relevance sorting works only with `search`
        "sort": "relevance_score:desc",
    }
 
    # Language filter (expects ISO639-1 like 'fr', 'en')
    language = params.get("language")
    filters: list[str] = []
    if isinstance(language, str) and language != "all":
        iso2 = language.split("-")[0].split("_")[0]
        if len(iso2) == 2:
            filters.append(f"language:{iso2}")
 
    if filters:
        args["filter"] = ",".join(filters)
 
    # include mailto if configured for polite pool (engine module setting)
    if isinstance(mailto, str) and mailto != "":
        args["mailto"] = mailto
 
    params["url"] = f"{search_url}?{urlencode(args)}"
 
 

response()

EngineResults searx.engines.openalex.response

(

SXNG_Response

resp

)

Definition at line 63 of file openalex.py.

def response(resp: SXNG_Response) -> EngineResults:
    data = resp.json()
    res = EngineResults()
 
    for item in data.get("results", []):
        url, html_url, pdf_url = _extract_links(item)
        title: str = item.get("title", "")
        content: str = _reconstruct_abstract(item.get("abstract_inverted_index")) or ""
        authors = _extract_authors(item)
        journal, publisher, pages, volume, number, published_date = _extract_biblio(item)
        doi = _doi_to_plain(item.get("doi"))
        tags = _extract_tags(item) or None
        comments = _extract_comments(item)
 
        res.add(
            res.types.LegacyResult(
                template="paper.html",
                url=url,
                title=title,
                content=content,
                journal=journal,
                publisher=publisher,
                doi=doi,
                tags=tags,
                authors=authors,
                pdf_url=pdf_url,
                html_url=html_url,
                publishedDate=published_date,
                pages=pages,
                volume=volume,
                number=number,
                type=item.get("type"),
                comments=comments,
            )
        )
 
    return res
 
 

References _doi_to_plain(), _extract_authors(), _extract_biblio(), _extract_comments(), _extract_links(), _extract_tags(), and _reconstruct_abstract().

Here is the call graph for this function:

Variable Documentation

about

dict searx.engines.openalex.about

Initial value:

=  {
    "website": "https://openalex.org/",
    "wikidata_id": "Q110718454",
    "official_api_documentation": "https://docs.openalex.org/how-to-use-the-api/api-overview",
    "use_official_api": True,
    "require_api_key": False,
    "results": "JSON",
}

Definition at line 14 of file openalex.py.

categories

list searx.engines.openalex.categories = ["science", "scientific publications"]

Definition at line 25 of file openalex.py.

mailto

str searx.engines.openalex.mailto = ""

Definition at line 31 of file openalex.py.

paging

bool searx.engines.openalex.paging = True

Definition at line 26 of file openalex.py.

search_url

str searx.engines.openalex.search_url = "https://api.openalex.org/works"

Definition at line 27 of file openalex.py.