.oO SearXNG Developer Documentation Oo.
Loading...
Searching...
No Matches
searx.engines.soundcloud Namespace Reference

Functions

 request (query, params)
 
 response (resp)
 
 init (engine_settings)
 
str|None get_client_id ()
 

Variables

logging logger .Logger
 
dict about
 
list categories = ["music"]
 
bool paging = True
 
str search_url = "https://api-v2.soundcloud.com/search"
 
 cid_re = re.compile(r'client_id:"([^"]*)"', re.I | re.U)
 
int results_per_page = 10
 
str soundcloud_facet = "model"
 
dict app_locale_map
 

Detailed Description

SoundCloud is a German audio streaming service.

Function Documentation

◆ get_client_id()

str | None searx.engines.soundcloud.get_client_id ( )

Definition at line 130 of file soundcloud.py.

130def get_client_id() -> str | None:
131
132 client_id = ""
133 url = "https://soundcloud.com"
134 resp = http_get(url, timeout=10)
135
136 if not resp.ok:
137 logger.error("init: GET %s failed", url)
138 return client_id
139
140 tree = html.fromstring(resp.content)
141 script_tags = tree.xpath("//script[contains(@src, '/assets/')]")
142 app_js_urls = [tag.get("src") for tag in script_tags if tag is not None]
143
144 # extracts valid app_js urls from soundcloud.com content
145
146 for url in app_js_urls[::-1]:
147
148 # gets app_js and search for the client_id
149 resp = http_get(url)
150
151 if not resp.ok:
152 logger.error("init: app_js GET %s failed", url)
153 continue
154
155 cids = cid_re.search(resp.content.decode())
156 if cids and len(cids.groups()):
157 client_id = cids.groups()[0]
158 break
159
160 if client_id:
161 logger.info("using client_id '%s' for soundclud queries", client_id)
162 else:
163 logger.warning("missing valid client_id for soundclud queries")
164 return client_id or None

Referenced by request().

+ Here is the caller graph for this function:

◆ init()

searx.engines.soundcloud.init ( engine_settings)

Definition at line 125 of file soundcloud.py.

125def init(engine_settings): # pylint: disable=unused-argument
126 global CACHE # pylint: disable=global-statement
127 CACHE = EngineCache(engine_settings["name"]) # type:ignore
128
129

◆ request()

searx.engines.soundcloud.request ( query,
params )

Definition at line 64 of file soundcloud.py.

64def request(query, params):
65
66 # missing attributes: user_id, app_version
67 # - user_id=451561-497874-703312-310156
68 # - app_version=1740727428
69
70 guest_client_id = CACHE.get("guest_client_id")
71 if guest_client_id is None:
72 guest_client_id = get_client_id()
73 if guest_client_id:
74 CACHE.set(key="guest_client_id", value=guest_client_id)
75
76 args = {
77 "q": query,
78 "offset": (params['pageno'] - 1) * results_per_page,
79 "limit": results_per_page,
80 "facet": soundcloud_facet,
81 "client_id": guest_client_id,
82 "app_locale": app_locale_map.get(params["language"].split("-")[0], "en"),
83 }
84
85 params['url'] = f"{search_url}?{urlencode(args)}"
86 return params
87
88

References get_client_id().

+ Here is the call graph for this function:

◆ response()

searx.engines.soundcloud.response ( resp)

Definition at line 89 of file soundcloud.py.

89def response(resp):
90 results = []
91 data = resp.json()
92
93 for result in data.get("collection", []):
94
95 if result["kind"] in ("track", "playlist"):
96 url = result.get("permalink_url")
97 if not url:
98 continue
99 uri = quote_plus(result.get("uri"))
100 content = [
101 result.get("description"),
102 result.get("label_name"),
103 ]
104 res = {
105 "url": url,
106 "title": result["title"],
107 "content": " / ".join([c for c in content if c]),
108 "publishedDate": parser.parse(result["last_modified"]),
109 "iframe_src": "https://w.soundcloud.com/player/?url=" + uri,
110 "views": result.get("likes_count"),
111 }
112 thumbnail = result["artwork_url"] or result["user"]["avatar_url"]
113 res["thumbnail"] = thumbnail or None
114 length = int(result.get("duration", 0) / 1000)
115 if length:
116 length = datetime.timedelta(seconds=length)
117 res["length"] = length
118 res["views"] = result.get("playback_count", 0) or None
119 res["author"] = result.get("user", {}).get("full_name") or None
120 results.append(res)
121
122 return results
123
124

Variable Documentation

◆ about

dict searx.engines.soundcloud.about
Initial value:
1= {
2 "website": "https://soundcloud.com",
3 "wikidata_id": "Q568769",
4 "official_api_documentation": "https://developers.soundcloud.com/docs/api/guide",
5 "use_official_api": False,
6 "require_api_key": False,
7 "results": 'JSON',
8}

Definition at line 22 of file soundcloud.py.

◆ app_locale_map

dict searx.engines.soundcloud.app_locale_map
Initial value:
1= {
2 "de": "de",
3 "en": "en",
4 "es": "es",
5 "fr": "fr",
6 "oc": "fr",
7 "it": "it",
8 "nl": "nl",
9 "pl": "pl",
10 "szl": "pl",
11 "pt": "pt_BR",
12 "pap": "pt_BR",
13 "sv": "sv",
14}

Definition at line 44 of file soundcloud.py.

◆ categories

list searx.engines.soundcloud.categories = ["music"]

Definition at line 31 of file soundcloud.py.

◆ cid_re

searx.engines.soundcloud.cid_re = re.compile(r'client_id:"([^"]*)"', re.I | re.U)

Definition at line 39 of file soundcloud.py.

◆ logger

logging searx.engines.soundcloud.logger .Logger

Definition at line 20 of file soundcloud.py.

◆ paging

bool searx.engines.soundcloud.paging = True

Definition at line 32 of file soundcloud.py.

◆ results_per_page

int searx.engines.soundcloud.results_per_page = 10

Definition at line 40 of file soundcloud.py.

◆ search_url

str searx.engines.soundcloud.search_url = "https://api-v2.soundcloud.com/search"

Definition at line 34 of file soundcloud.py.

◆ soundcloud_facet

str searx.engines.soundcloud.soundcloud_facet = "model"

Definition at line 42 of file soundcloud.py.