Commit graph

725 commits

Author SHA1 Message Date
webstreamr
4c5f5a3514
chore(release): release v0.52.4 (#378) 2025-09-23 08:52:50 +00:00
WebStreamr
0a0bedacb4
chore(fetcher): complete proxy headers 2025-09-23 08:50:56 +00:00
WebStreamr
7e771c2644
revert: Revert "chore(fetcher): try to remove the proxy headers (again)"
This reverts commit 00bd11495f.
2025-09-23 08:32:59 +00:00
WebStreamr
6d5a511cb4
chore: remove XPrime
backend API responses are encrypted and use webassembly for decryption
2025-09-22 09:30:14 +00:00
webstreamr
a2af1ae21e
chore(release): release v0.52.3 (#363) 2025-09-18 08:54:27 +00:00
WebStreamr
a30b271a57
fix(source): improve 4KHDHub year and title matching 2025-09-18 08:50:44 +00:00
WebStreamr
60f44c9603
revert: Revert "fix: remove turnstyle detection to check if it causes false-positives"
This reverts commit c10ca29fda.
2025-09-16 19:41:59 +00:00
webstreamr
1433d032f3
chore(release): release v0.52.2 (#360) 2025-09-16 14:50:54 +00:00
WebStreamr
d90cd8f984
fix(fetcher): only retry 503 and 504 2025-09-16 14:49:13 +00:00
WebStreamr
c10ca29fda
fix: remove turnstyle detection to check if it causes false-positives 2025-09-16 13:05:03 +00:00
WebStreamr
c819dd6bb7
fix(extractor): filter out non-accessible HubCloud streams 2025-09-16 12:40:01 +00:00
WebStreamr
d06c2934a8
fix: do not return cache headers when noCache is set 2025-09-16 12:09:42 +00:00
WebStreamr
aeb7ce5f54
fix(extractor): normalize Streamtape URLs 2025-09-15 14:02:37 +00:00
webstreamr
48b6f9efb0
chore(release): release v0.52.1 (#357) 2025-09-14 23:12:05 +02:00
WebStreamr
f4d905833f
fix(source): re-implement PrimeWire in safer and more efficient way 2025-09-14 20:51:28 +00:00
webstreamr
65c73e8b6e
chore(release): release v0.52.0 (#355) 2025-09-14 21:31:32 +02:00
WebStreamr
737bf6aa94
feat: allow to disable extractors via env var 2025-09-14 19:30:32 +00:00
WebStreamr
f89d90619a
feat: allow to disable sources via env var 2025-09-14 19:29:22 +00:00
webstreamr
a3c25adc7a
chore(release): release v0.51.2 (#354) 2025-09-14 18:19:23 +00:00
WebStreamr
ae32376758
fix(fetcher): re-use proxy agents 2025-09-14 18:18:09 +00:00
WebStreamr
aded562304
fix(source): close jsdom window immediately after getting HTML 2025-09-14 18:12:41 +00:00
WebStreamr
8b479be6c5
fix: log more infos for uncaught errors 2025-09-14 18:12:28 +00:00
WebStreamr
8acbd37df3
revert: Revert recent reverts again
This reverts commit 78db179957.
2025-09-14 17:38:46 +00:00
webstreamr
cf6946bc4a
chore(release): release v0.51.1 (#351) 2025-09-14 15:40:25 +02:00
WebStreamr
78db179957
revert: Revert "chore(fetcher): log more infos about responses"
This reverts commit 731bd33470.
2025-09-14 13:37:17 +00:00
WebStreamr
9a279b53a4
revert: Revert "feat: allow to disable cache"
This reverts commit 4078f0c404.
2025-09-14 13:37:14 +00:00
WebStreamr
2aa9ad270e
revert: Revert "chore: log error count in final result log"
This reverts commit 2421913587.
2025-09-14 13:37:11 +00:00
WebStreamr
4ca87f0ff1
revert: Revert "chore(fetcher): log proxy usage, allow to disable proxy via config"
This reverts commit b67e1b85d6.
2025-09-14 13:37:08 +00:00
webstreamr
a79b0bdfdd
chore(release): release v0.51.0 (#349) 2025-09-13 20:28:43 +02:00
WebStreamr
b67e1b85d6
chore(fetcher): log proxy usage, allow to disable proxy via config 2025-09-13 18:27:17 +00:00
WebStreamr
2421913587
chore: log error count in final result log 2025-09-13 17:59:21 +00:00
WebStreamr
4078f0c404
feat: allow to disable cache 2025-09-13 17:51:12 +00:00
WebStreamr
731bd33470
chore(fetcher): log more infos about responses 2025-09-13 17:41:28 +00:00
WebStreamr
4351ddc00d
revert: Revert "fix(extractor): use SuperVideo embed URls which are not triggering CF challenges"
This reverts commit 3a2178eb55.
2025-09-12 18:49:00 +00:00
webstreamr
941a61fb74
chore(release): release v0.50.4 (#348) 2025-09-12 20:36:18 +02:00
WebStreamr
a729dc85e0
chore: add url info to blocked error 2025-09-12 18:35:22 +00:00
webstreamr
491595934f
chore(release): release v0.50.3 (#347) 2025-09-12 20:27:19 +02:00
WebStreamr
d087318286
chore(fetcher): cache only 2xx and 404 responses 2025-09-12 18:24:19 +00:00
WebStreamr
5429b0cb7a
chore(extractor): set VidSrc referer again 2025-09-12 18:17:10 +00:00
WebStreamr
69da82b139
chore(fetcher): bring back error retry 2025-09-12 17:53:37 +00:00
WebStreamr
fdb9bff86b
chore: slightly clean-up extractor and source logging 2025-09-12 17:49:14 +00:00
WebStreamr
cb256de9f8
chore(source): disable Soaper 2025-09-12 17:41:18 +00:00
WebStreamr
b27126fd8e
fix(extractor): cache FileLions 2025-09-12 17:39:47 +00:00
webstreamr
b9c13b8a89
chore(release): release v0.50.2 (#346) 2025-09-12 13:22:31 +00:00
WebStreamr
2a47d97d5c
chore(fetcher): switch back to undici fetch 🤡 2025-09-12 13:20:59 +00:00
webstreamr
0f00aecde5
chore(release): release v0.50.1 (#345) 2025-09-12 11:54:32 +02:00
WebStreamr
7ee87ceb9e
chore(fetcher): remove interceptors and retries 2025-09-12 09:50:07 +00:00
webstreamr
81208ab99b
chore(release): release v0.50.0 (#344) 2025-09-12 10:15:35 +02:00
WebStreamr
b513a8926b
feat: add support for proxy per host using minimatch 2025-09-12 08:13:18 +00:00
WebStreamr
2f370d1b9c
refactor: create dispatcher per request 2025-09-12 07:30:27 +00:00
WebStreamr
ffd62a5d16
chore(extractor): remove Referer from follow-up VidSrc requests completely 2025-09-12 07:10:51 +00:00
webstreamr
7249c1fd96
chore(release): release v0.49.7 (#343) 2025-09-11 16:51:45 +02:00
WebStreamr
87893819b0
chore(fetcher): switch back to native fetch 🤡 2025-09-11 14:34:26 +00:00
webstreamr
c29ec82d6a
chore(release): release v0.49.6 (#342) 2025-09-11 15:33:53 +02:00
WebStreamr
98c53a15f2
fix(extractor): do not pass Referer for cloudnestra requests
seems to avoid some blocking interestingly 🙈
2025-09-11 12:42:57 +00:00
webstreamr
d190446187
chore(release): release v0.49.5 (#341) 2025-09-10 19:43:32 +00:00
WebStreamr
7f264b2503
chore: include imdb and tmdb IDs in XPrime requests 2025-09-10 19:42:18 +00:00
webstreamr
128c144ebf
chore(release): release v0.49.4 (#340) 2025-09-10 21:29:47 +02:00
WebStreamr
531ad7562a
fix(extractor): use correct xprime referer 2025-09-10 18:42:01 +00:00
webstreamr
c9e4dfce68
chore(release): release v0.49.3 (#339) 2025-09-10 15:25:51 +02:00
WebStreamr
057b2346dc
chore(extractor): clean-up header/referer passing 2025-09-10 13:21:36 +00:00
WebStreamr
7f2cf10021
fix(extractor): improve messy meta type 2025-09-10 13:21:02 +00:00
webstreamr
904f5de3e0
chore(release): release v0.49.2 (#338) 2025-09-10 11:26:52 +00:00
WebStreamr
00bd11495f
chore(fetcher): try to remove the proxy headers (again) 2025-09-10 11:25:16 +00:00
webstreamr
03b3512380
chore(release): release v0.49.1 (#337) 2025-09-10 10:13:59 +00:00
WebStreamr
c5da7c1997
fix(extractor): grab VixSrc height from playlist 2025-09-10 10:12:41 +00:00
renovate[bot]
8b5588936e
fix(deps): update dependency cacheable to v2 (#336)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: WebStreamr <210764791+webstreamr@users.noreply.github.com>
2025-09-10 10:11:52 +00:00
WebStreamr
3a2178eb55
fix(extractor): use SuperVideo embed URls which are not triggering CF challenges
we unfortunately loose size and title info though
2025-09-10 10:01:33 +00:00
webstreamr
17e99101bc
chore(release): release v0.49.0 (#334) 2025-09-09 14:02:59 +02:00
WebStreamr
8430e5d0d1
feat(extractor): add FileLions extractor 2025-09-09 11:51:20 +00:00
webstreamr
39681dc7f6
chore(release): release v0.48.0 (#332) 2025-09-08 09:34:47 +00:00
WebStreamr
39850dccf7
feat(extractor): support PixelServer in HubCloud
looks like it will limit download speed after a while, but some sources
only have that one..
2025-09-08 09:33:31 +00:00
webstreamr
327d297d58
chore(release): release v0.47.2 (#331) 2025-09-08 09:12:24 +00:00
WebStreamr
68232363ae
fix(extractor): find more FSL links 2025-09-08 09:11:07 +00:00
webstreamr
41f78b50e7
chore(release): release v0.47.1 (#330) 2025-09-08 09:03:57 +00:00
WebStreamr
c2983f0551
fix(source): handle missing 4KHDHub episodes more gracefully 2025-09-08 09:02:19 +00:00
WebStreamr
6577eda289
chore: add Norwegian, sort language list 2025-09-08 08:50:23 +00:00
webstreamr
ad4eea68ce
chore(release): release v0.47.0 (#325) 2025-09-08 08:33:35 +00:00
WebStreamr
e1b5e7bce1
chore(tmdb): use mutex to avoid double tmdb requests 2025-09-08 08:31:44 +00:00
WebStreamr
3b8481ed3f
chore: add infos about sources and extractors to description 2025-09-08 08:17:12 +00:00
WebStreamr
9f15a03a5a
chore: add more details to /live / ipcheck endpoint, add cloudnestra 2025-09-08 08:04:08 +00:00
WebStreamr
3380185449
chore: drop uuid in favor of node:crypto randomUUID 2025-09-08 07:38:24 +00:00
WebStreamr
b60f91a96a
chore: configure a bunch of more language mappings 2025-09-08 07:35:31 +00:00
WebStreamr
1ecb088b60
feat(extractor): add HubCloud with FSL 2025-09-08 07:35:31 +00:00
WebStreamr
8a1645fb81
feat(source): add 4KHDHub 2025-09-08 07:35:31 +00:00
WebStreamr
48c7735165
fix(extractor): gracefully handle deleted files for SaveFiles 2025-09-06 19:31:21 +00:00
webstreamr
120f10139c
chore(release): release v0.46.5 (#323) 2025-09-05 08:54:32 +00:00
WebStreamr
b589c25bb5
chore(extractor): do only one VidSrc request per domain at a time 2025-09-05 08:52:57 +00:00
WebStreamr
211babec37
chore(fetcher): wait out short rate limits and retry 2025-09-05 08:52:36 +00:00
WebStreamr
e846900384
fix(fetcher): fix TTL for rate limit cache 2025-09-05 07:35:06 +00:00
webstreamr
ad7444ed97
chore(release): release v0.46.4 (#322) 2025-09-04 11:37:50 +00:00
WebStreamr
af4d0010fb
chore(source): retry also blocking errors with different VidSrc TLD 2025-09-04 11:36:37 +00:00
webstreamr
fde6128757
chore(release): release v0.46.3 (#321) 2025-09-04 10:30:23 +02:00
WebStreamr
cf79473fad
chore: allow forcing the IP check in the /live endpoint 2025-09-04 08:07:55 +00:00
webstreamr
ff62ea0597
chore(release): release v0.46.2 (#319) 2025-09-04 07:43:24 +00:00
WebStreamr
ad7e480213
fix(extractor): remove non-working VidSrc pm TLD 2025-09-04 07:42:16 +00:00
WebStreamr
cfcf81b665
refactor: simplify passing around meta 2025-09-03 19:55:58 +00:00
WebStreamr
4002301fa6
fix(source): VixSrc is not an English source 2025-09-03 17:44:07 +00:00
webstreamr
b0a251c21e
chore(release): release v0.46.1 (#318) 2025-09-03 16:49:34 +02:00
WebStreamr
756cd01ab9
chore: decrease fetcher and extractor memory cache sizes 2025-09-03 14:39:27 +00:00
webstreamr
c7e87e14b9
chore(release): release v0.46.0 (#316) 2025-09-03 15:02:24 +02:00
WebStreamr
fd0900e053
feat: add stats endpoint with cache stats 2025-09-03 13:00:07 +00:00
WebStreamr
5ea34f66dd
fix(source): make cache prop static 2025-09-03 12:48:21 +00:00
WebStreamr
5547fd5486
fix(source): move countryCode filtering into central place 2025-09-03 12:18:56 +00:00
WebStreamr
12ac42ef5f
chore: no special sorting for errors 2025-09-03 11:05:16 +00:00
WebStreamr
89790609db
feat(source): persist PrimeWire redirect URL cache 2025-09-03 11:03:03 +00:00
WebStreamr
2b7e9c403d
feat: configure sqlite as secondary source and extractor cache 2025-09-03 10:56:13 +00:00
WebStreamr
94abcd3f0a
chore: add ipStatus to /live endpoint 2025-09-03 10:29:00 +00:00
WebStreamr
83021fb773
chore(fetcher): decrease timeout to 5 seconds 2025-09-03 10:28:48 +00:00
webstreamr
63ada6099a
chore(release): release v0.45.3 (#315) 2025-09-02 15:08:17 +00:00
WebStreamr
833043143f
chore(extractor): cache YouTube for 6h 2025-09-02 15:06:55 +00:00
WebStreamr
41aacf84db
chore(extractor): cache ExternalUrl for 6h 2025-09-02 15:05:51 +00:00
WebStreamr
1b89cadab5
chore: always return integers for Cache-Control max-age 2025-09-02 14:51:31 +00:00
WebStreamr
969ab8d0d7
chore(extractor): start refreshing results randomly after at least 2/3 of the TTL passed 2025-09-02 14:41:55 +00:00
WebStreamr
316fd4621b
chore(extractor): cache KinoGer for 6h 2025-09-02 14:28:45 +00:00
WebStreamr
bb95118d2b
chore(extractor): cache SaveFiles for 6h 2025-09-02 14:28:04 +00:00
WebStreamr
fc17545860
chore(extractor): cache XPrime for 6h 2025-09-02 14:27:23 +00:00
WebStreamr
a250440670
chore(extractor): cache Doodstream for 6h 2025-09-02 14:26:25 +00:00
WebStreamr
1e100e6d2e
chore(extractor): cache Soaper for 12h 2025-09-02 13:48:01 +00:00
WebStreamr
ccf8006f13
chore(extractor): cache Dropload for 3h 2025-09-02 13:40:22 +00:00
WebStreamr
7ac71837b3
chore(extractor): cache SuperVideo for 3h 2025-09-02 13:39:39 +00:00
WebStreamr
c68570d2bc
chore(extractor): cache VidSrc for 3h 2025-09-02 13:38:51 +00:00
WebStreamr
bc06cb5750
chore(source): cache sources for 12h 2025-09-02 13:37:26 +00:00
WebStreamr
dc093f7109
refactor: consistently use cacheable for caching 2025-09-02 13:33:51 +00:00
webstreamr
bd38329fd8
chore(release): release v0.45.2 (#310) 2025-09-01 22:12:06 +02:00
WebStreamr
ceb520d49d
fix(source): consider season and episode for cache key 2025-09-01 20:10:30 +00:00
WebStreamr
b47a512587
fix: catch all timeouts 2025-09-01 18:33:42 +00:00
WebStreamr
2468fbde4e
chore(source): remove outdated comment 2025-09-01 18:33:42 +00:00
WebStreamr
e109637e48
refactor: move locks into StreamController 2025-09-01 10:58:05 +00:00
WebStreamr
4d05ac859f
chore: handle NotFoundError / 404 inside source and cache it also 2025-09-01 10:53:59 +00:00
webstreamr
8154527533
chore(release): release v0.45.1 (#307) 2025-09-01 12:35:45 +02:00
WebStreamr
c47f48c64b
chore(fetcher): log retries 2025-09-01 08:17:59 +00:00
WebStreamr
0fc7675560
chore(fetcher): retry timeouts once 2025-08-31 20:12:04 +00:00
WebStreamr
c556d9500b
chore(extractor): support caching via MediaFlow Proxy 2025-08-31 20:06:33 +00:00
WebStreamr
33ee150915
fix(extractor): set missing viaMediaFlowProxy in Streamtape 2025-08-31 19:22:48 +00:00
WebStreamr
c82a7ab756
chore(source): cache source results for 3 hours 2025-08-31 19:14:43 +00:00
WebStreamr
9da7c07dc6
refactor(source): introduce abstract parent class 2025-08-31 18:52:42 +00:00
webstreamr
75363c72cf
chore(release): release v0.45.0 (#293) 2025-08-28 21:21:55 +02:00
WebStreamr
18d8ee6b79
chore(extractor): use guessSizeFromMp4 in Streamtape, Uqload and XPrime 2025-08-28 19:17:21 +00:00
WebStreamr
4a1a3b19aa
refactor: introduce guessSizeFromMp4 2025-08-28 19:01:14 +00:00
WebStreamr
cefc80fa55
chore(extractor): move Fetcher into parent, guess missing heights for SuperVideo 2025-08-28 18:58:15 +00:00
WebStreamr
c8cd2ec794
chore(extractor): add more KinoGer domains 2025-08-25 14:29:58 +00:00
WebStreamr
c7c2ebf353
feat: support TMDB IDs 2025-08-22 14:49:15 +00:00
WebStreamr
eecd3255f0
fix(extractor): handle SaveFiles /d/ links properly 2025-08-21 11:28:15 +00:00
WebStreamr
05d11e366b
chore: configure undici dispatcher allowing HTTP2, caching DNS and retrying connection errors 2025-08-21 09:11:58 +00:00
WebStreamr
795c033a82
revert: Revert "chore(source): disable Soaper"
This reverts commit 71979d82b6.
2025-08-20 21:24:21 +00:00
WebStreamr
b6a8e6f448
feat(source): add Einschalten 2025-08-19 09:50:04 +00:00
WebStreamr
2d9f9bf1af
chore(extractor): add more KinoGer domains and determine resolution 2025-08-19 09:35:35 +00:00
webstreamr
c8afe6995d
chore(release): release v0.44.1 (#291) 2025-08-18 18:35:14 +02:00
WebStreamr
35acb49545
fix(extractor): remove unreliable title height guessing 2025-08-18 13:17:42 +00:00