Commit graph

548 commits

Author SHA1 Message Date
WebStreamr
7e771c2644
revert: Revert "chore(fetcher): try to remove the proxy headers (again)"
This reverts commit 00bd11495f.
2025-09-23 08:32:59 +00:00
WebStreamr
6d5a511cb4
chore: remove XPrime
backend API responses are encrypted and use webassembly for decryption
2025-09-22 09:30:14 +00:00
webstreamr
a2af1ae21e
chore(release): release v0.52.3 (#363) 2025-09-18 08:54:27 +00:00
WebStreamr
60f44c9603
revert: Revert "fix: remove turnstyle detection to check if it causes false-positives"
This reverts commit c10ca29fda.
2025-09-16 19:41:59 +00:00
webstreamr
1433d032f3
chore(release): release v0.52.2 (#360) 2025-09-16 14:50:54 +00:00
WebStreamr
d90cd8f984
fix(fetcher): only retry 503 and 504 2025-09-16 14:49:13 +00:00
WebStreamr
c10ca29fda
fix: remove turnstyle detection to check if it causes false-positives 2025-09-16 13:05:03 +00:00
WebStreamr
c819dd6bb7
fix(extractor): filter out non-accessible HubCloud streams 2025-09-16 12:40:01 +00:00
webstreamr
48b6f9efb0
chore(release): release v0.52.1 (#357) 2025-09-14 23:12:05 +02:00
WebStreamr
f4d905833f
fix(source): re-implement PrimeWire in safer and more efficient way 2025-09-14 20:51:28 +00:00
webstreamr
65c73e8b6e
chore(release): release v0.52.0 (#355) 2025-09-14 21:31:32 +02:00
webstreamr
a3c25adc7a
chore(release): release v0.51.2 (#354) 2025-09-14 18:19:23 +00:00
WebStreamr
ae32376758
fix(fetcher): re-use proxy agents 2025-09-14 18:18:09 +00:00
WebStreamr
8acbd37df3
revert: Revert recent reverts again
This reverts commit 78db179957.
2025-09-14 17:38:46 +00:00
webstreamr
cf6946bc4a
chore(release): release v0.51.1 (#351) 2025-09-14 15:40:25 +02:00
WebStreamr
78db179957
revert: Revert "chore(fetcher): log more infos about responses"
This reverts commit 731bd33470.
2025-09-14 13:37:17 +00:00
WebStreamr
9a279b53a4
revert: Revert "feat: allow to disable cache"
This reverts commit 4078f0c404.
2025-09-14 13:37:14 +00:00
WebStreamr
2aa9ad270e
revert: Revert "chore: log error count in final result log"
This reverts commit 2421913587.
2025-09-14 13:37:11 +00:00
WebStreamr
4ca87f0ff1
revert: Revert "chore(fetcher): log proxy usage, allow to disable proxy via config"
This reverts commit b67e1b85d6.
2025-09-14 13:37:08 +00:00
webstreamr
a79b0bdfdd
chore(release): release v0.51.0 (#349) 2025-09-13 20:28:43 +02:00
WebStreamr
b67e1b85d6
chore(fetcher): log proxy usage, allow to disable proxy via config 2025-09-13 18:27:17 +00:00
WebStreamr
2421913587
chore: log error count in final result log 2025-09-13 17:59:21 +00:00
WebStreamr
4078f0c404
feat: allow to disable cache 2025-09-13 17:51:12 +00:00
WebStreamr
731bd33470
chore(fetcher): log more infos about responses 2025-09-13 17:41:28 +00:00
WebStreamr
4351ddc00d
revert: Revert "fix(extractor): use SuperVideo embed URls which are not triggering CF challenges"
This reverts commit 3a2178eb55.
2025-09-12 18:49:00 +00:00
webstreamr
941a61fb74
chore(release): release v0.50.4 (#348) 2025-09-12 20:36:18 +02:00
WebStreamr
a729dc85e0
chore: add url info to blocked error 2025-09-12 18:35:22 +00:00
webstreamr
491595934f
chore(release): release v0.50.3 (#347) 2025-09-12 20:27:19 +02:00
WebStreamr
d087318286
chore(fetcher): cache only 2xx and 404 responses 2025-09-12 18:24:19 +00:00
WebStreamr
69da82b139
chore(fetcher): bring back error retry 2025-09-12 17:53:37 +00:00
WebStreamr
fdb9bff86b
chore: slightly clean-up extractor and source logging 2025-09-12 17:49:14 +00:00
WebStreamr
cb256de9f8
chore(source): disable Soaper 2025-09-12 17:41:18 +00:00
webstreamr
b9c13b8a89
chore(release): release v0.50.2 (#346) 2025-09-12 13:22:31 +00:00
WebStreamr
2a47d97d5c
chore(fetcher): switch back to undici fetch 🤡 2025-09-12 13:20:59 +00:00
webstreamr
0f00aecde5
chore(release): release v0.50.1 (#345) 2025-09-12 11:54:32 +02:00
WebStreamr
7ee87ceb9e
chore(fetcher): remove interceptors and retries 2025-09-12 09:50:07 +00:00
webstreamr
81208ab99b
chore(release): release v0.50.0 (#344) 2025-09-12 10:15:35 +02:00
WebStreamr
b513a8926b
feat: add support for proxy per host using minimatch 2025-09-12 08:13:18 +00:00
WebStreamr
2f370d1b9c
refactor: create dispatcher per request 2025-09-12 07:30:27 +00:00
webstreamr
7249c1fd96
chore(release): release v0.49.7 (#343) 2025-09-11 16:51:45 +02:00
WebStreamr
87893819b0
chore(fetcher): switch back to native fetch 🤡 2025-09-11 14:34:26 +00:00
webstreamr
c29ec82d6a
chore(release): release v0.49.6 (#342) 2025-09-11 15:33:53 +02:00
webstreamr
d190446187
chore(release): release v0.49.5 (#341) 2025-09-10 19:43:32 +00:00
webstreamr
128c144ebf
chore(release): release v0.49.4 (#340) 2025-09-10 21:29:47 +02:00
webstreamr
c9e4dfce68
chore(release): release v0.49.3 (#339) 2025-09-10 15:25:51 +02:00
webstreamr
904f5de3e0
chore(release): release v0.49.2 (#338) 2025-09-10 11:26:52 +00:00
WebStreamr
00bd11495f
chore(fetcher): try to remove the proxy headers (again) 2025-09-10 11:25:16 +00:00
webstreamr
03b3512380
chore(release): release v0.49.1 (#337) 2025-09-10 10:13:59 +00:00
renovate[bot]
8b5588936e
fix(deps): update dependency cacheable to v2 (#336)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: WebStreamr <210764791+webstreamr@users.noreply.github.com>
2025-09-10 10:11:52 +00:00
WebStreamr
3a2178eb55
fix(extractor): use SuperVideo embed URls which are not triggering CF challenges
we unfortunately loose size and title info though
2025-09-10 10:01:33 +00:00
webstreamr
17e99101bc
chore(release): release v0.49.0 (#334) 2025-09-09 14:02:59 +02:00
WebStreamr
8430e5d0d1
feat(extractor): add FileLions extractor 2025-09-09 11:51:20 +00:00
webstreamr
39681dc7f6
chore(release): release v0.48.0 (#332) 2025-09-08 09:34:47 +00:00
webstreamr
327d297d58
chore(release): release v0.47.2 (#331) 2025-09-08 09:12:24 +00:00
webstreamr
41f78b50e7
chore(release): release v0.47.1 (#330) 2025-09-08 09:03:57 +00:00
WebStreamr
6577eda289
chore: add Norwegian, sort language list 2025-09-08 08:50:23 +00:00
webstreamr
ad4eea68ce
chore(release): release v0.47.0 (#325) 2025-09-08 08:33:35 +00:00
WebStreamr
e1b5e7bce1
chore(tmdb): use mutex to avoid double tmdb requests 2025-09-08 08:31:44 +00:00
WebStreamr
3b8481ed3f
chore: add infos about sources and extractors to description 2025-09-08 08:17:12 +00:00
WebStreamr
b60f91a96a
chore: configure a bunch of more language mappings 2025-09-08 07:35:31 +00:00
WebStreamr
8a1645fb81
feat(source): add 4KHDHub 2025-09-08 07:35:31 +00:00
webstreamr
120f10139c
chore(release): release v0.46.5 (#323) 2025-09-05 08:54:32 +00:00
WebStreamr
211babec37
chore(fetcher): wait out short rate limits and retry 2025-09-05 08:52:36 +00:00
WebStreamr
e846900384
fix(fetcher): fix TTL for rate limit cache 2025-09-05 07:35:06 +00:00
webstreamr
ad7444ed97
chore(release): release v0.46.4 (#322) 2025-09-04 11:37:50 +00:00
webstreamr
fde6128757
chore(release): release v0.46.3 (#321) 2025-09-04 10:30:23 +02:00
webstreamr
ff62ea0597
chore(release): release v0.46.2 (#319) 2025-09-04 07:43:24 +00:00
WebStreamr
cfcf81b665
refactor: simplify passing around meta 2025-09-03 19:55:58 +00:00
WebStreamr
4002301fa6
fix(source): VixSrc is not an English source 2025-09-03 17:44:07 +00:00
webstreamr
b0a251c21e
chore(release): release v0.46.1 (#318) 2025-09-03 16:49:34 +02:00
WebStreamr
756cd01ab9
chore: decrease fetcher and extractor memory cache sizes 2025-09-03 14:39:27 +00:00
webstreamr
c7e87e14b9
chore(release): release v0.46.0 (#316) 2025-09-03 15:02:24 +02:00
WebStreamr
fd0900e053
feat: add stats endpoint with cache stats 2025-09-03 13:00:07 +00:00
WebStreamr
5547fd5486
fix(source): move countryCode filtering into central place 2025-09-03 12:18:56 +00:00
WebStreamr
12ac42ef5f
chore: no special sorting for errors 2025-09-03 11:05:16 +00:00
WebStreamr
2b7e9c403d
feat: configure sqlite as secondary source and extractor cache 2025-09-03 10:56:13 +00:00
WebStreamr
83021fb773
chore(fetcher): decrease timeout to 5 seconds 2025-09-03 10:28:48 +00:00
webstreamr
63ada6099a
chore(release): release v0.45.3 (#315) 2025-09-02 15:08:17 +00:00
WebStreamr
dc093f7109
refactor: consistently use cacheable for caching 2025-09-02 13:33:51 +00:00
webstreamr
bd38329fd8
chore(release): release v0.45.2 (#310) 2025-09-01 22:12:06 +02:00
WebStreamr
ceb520d49d
fix(source): consider season and episode for cache key 2025-09-01 20:10:30 +00:00
WebStreamr
4d05ac859f
chore: handle NotFoundError / 404 inside source and cache it also 2025-09-01 10:53:59 +00:00
webstreamr
8154527533
chore(release): release v0.45.1 (#307) 2025-09-01 12:35:45 +02:00
WebStreamr
c47f48c64b
chore(fetcher): log retries 2025-09-01 08:17:59 +00:00
WebStreamr
0fc7675560
chore(fetcher): retry timeouts once 2025-08-31 20:12:04 +00:00
WebStreamr
9da7c07dc6
refactor(source): introduce abstract parent class 2025-08-31 18:52:42 +00:00
webstreamr
75363c72cf
chore(release): release v0.45.0 (#293) 2025-08-28 21:21:55 +02:00
WebStreamr
4a1a3b19aa
refactor: introduce guessSizeFromMp4 2025-08-28 19:01:14 +00:00
WebStreamr
cefc80fa55
chore(extractor): move Fetcher into parent, guess missing heights for SuperVideo 2025-08-28 18:58:15 +00:00
WebStreamr
c7c2ebf353
feat: support TMDB IDs 2025-08-22 14:49:15 +00:00
WebStreamr
795c033a82
revert: Revert "chore(source): disable Soaper"
This reverts commit 71979d82b6.
2025-08-20 21:24:21 +00:00
WebStreamr
b6a8e6f448
feat(source): add Einschalten 2025-08-19 09:50:04 +00:00
webstreamr
c8afe6995d
chore(release): release v0.44.1 (#291) 2025-08-18 18:35:14 +02:00
WebStreamr
35acb49545
fix(extractor): remove unreliable title height guessing 2025-08-18 13:17:42 +00:00
webstreamr
6b8e9d7ac6
chore(release): release v0.44.0 (#288) 2025-08-17 19:00:58 +00:00
WebStreamr
5e6c71f4ad
feat(extractor): add YouTube extractor 2025-08-17 18:59:29 +00:00
WebStreamr
f58c30299a
chore(source): bring back Frembed 2025-08-17 18:28:24 +00:00
WebStreamr
71979d82b6
chore(source): disable Soaper 2025-08-17 18:25:09 +00:00
WebStreamr
176c4c93e7
refactor: fully replace handler with source 2025-08-17 18:22:04 +00:00
webstreamr
c34a1eafcc
chore(release): release v0.43.3 (#285) 2025-08-16 22:05:07 +00:00
webstreamr
9897fa8225
chore(release): release v0.43.2 (#281) 2025-08-16 18:55:59 +02:00
WebStreamr
ef613f2742
chore: double HTTP cache, quadruple extractor cache 2025-08-16 16:40:15 +00:00
webstreamr
ac0e54f39f
chore(release): release v0.43.1 (#280) 2025-08-15 13:45:00 +00:00
webstreamr
f15b00710b
chore(release): release v0.43.0 (#279) 2025-08-15 12:37:44 +02:00
WebStreamr
cfe38878d7
feat(source): add XPrime 2025-08-15 10:35:56 +00:00
WebStreamr
fe5b3af887
chore(fetcher): allow to customize minimum cache ttl 2025-08-15 08:54:14 +00:00
WebStreamr
2a5284d555
refactor(fetcher): sort custom request init props 2025-08-15 08:50:38 +00:00
webstreamr
b1a4b8017f
chore(release): release v0.42.1 (#277) 2025-08-14 10:24:15 +02:00
webstreamr
c3fb400116
chore(release): release v0.42.0 (#276) 2025-08-13 12:51:17 +02:00
WebStreamr
a12ae7aaa5
chore(fetcher): retry 5xx errors up to 3 times 2025-08-13 10:49:36 +00:00
WebStreamr
17da20f6d0
fix: support stream resolving without config 2025-08-13 10:28:28 +00:00
webstreamr
7d85f37c21
chore(release): release v0.41.9 (#275) 2025-08-12 17:19:34 +02:00
WebStreamr
e28de7d4d9
revert: "fix(fetcher): remove weird proxy headers in request"
This reverts commit ee09e10e6e.
2025-08-12 15:15:03 +00:00
webstreamr
c76ec91d15
chore(release): release v0.41.8 (#270) 2025-08-12 14:44:22 +02:00
WebStreamr
617ae77825
fix(source): bring back PrimeWire 🎉
- use happy-dom instead of jsdom
- grab link token from app JS to resolve links
2025-08-12 12:41:21 +00:00
webstreamr
47dc0d57a8
chore(release): release v0.41.7 (#268) 2025-08-11 15:50:19 +00:00
WebStreamr
9a019396c8
fix(fetcher): simplify header and ttl determination, fix edge case bug 2025-08-11 15:47:04 +00:00
webstreamr
083bbb8e9b
chore(release): release v0.41.6 (#266) 2025-08-11 12:10:58 +00:00
WebStreamr
ee09e10e6e
fix(fetcher): remove weird proxy headers in request
looks like this is finally causing weird issues and leading to some
Cloudflare blocks. we might be better of without it, let's try..
2025-08-11 12:09:46 +00:00
WebStreamr
0efdfa4a6f
fix(fetcher): better detect inline Cloudflare Turnstile 2025-08-11 11:40:58 +00:00
webstreamr
24d2cff3f7
chore(release): release v0.41.5 (#262) 2025-08-11 08:46:06 +00:00
WebStreamr
6489b10527
chore(source): add English to VixSrc
It returns English links in most of the cases, this will unlock more
URLs for people only having English selected and MediaFlow Proxy configured
2025-08-11 08:44:33 +00:00
WebStreamr
491df54242
chore(manifest): sort sources for each language in configuration 2025-08-11 08:44:26 +00:00
WebStreamr
3aff950598
chore(manifest): add supported languages to description 2025-08-11 08:38:56 +00:00
WebStreamr
7d700103c4
chore(fetcher): decrease default timeout back to 10s 2025-08-11 08:38:56 +00:00
webstreamr
6285760bad
chore(release): release v0.41.4 (#260) 2025-08-08 08:28:48 +00:00
WebStreamr
78ced84774
chore(fetcher): block a host temporarily after 30 times timing out instead of 10 2025-08-08 08:27:40 +00:00
webstreamr
c14e1c008a
chore(release): release v0.41.3 (#258) 2025-08-06 09:10:38 +00:00
webstreamr
ff538303c6
chore(release): release v0.41.2 (#257) 2025-08-05 15:04:30 +02:00
webstreamr
2ab20dc9b8
chore(release): release v0.41.1 (#256) 2025-08-05 13:33:32 +02:00
WebStreamr
009bb930b5
chore(fetcher): increase default timeout to 15s
in most of the cases we're still very fast anyway
but in some of the small cases let's avoid timeout blocks by waiting
longer
2025-08-05 10:01:30 +00:00
WebStreamr
086c32f980
chore: health check improvements to avoid performance issues
- only once per minute
- concurrency 1
- use default timeout
2025-08-05 09:56:11 +00:00
webstreamr
6bf3dc3e2b
chore(release): release v0.41.0 (#244) 2025-08-04 11:55:24 +02:00
WebStreamr
854b211f2c
feat: do not show errors by default 2025-08-04 09:52:48 +00:00
WebStreamr
c81f17a19a
chore: use source baseUrl for source errors 2025-08-04 09:29:35 +00:00
WebStreamr
b94c539269
refactor(source): consistently define baseUrl 2025-08-04 09:27:25 +00:00
webstreamr
5728111fd2
chore(release): release v0.40.3 (#242) 2025-07-24 10:21:03 +02:00
WebStreamr
cc3dacdd76
refactor: extract error and logging helper 2025-07-24 08:16:40 +00:00
webstreamr
b15d93eca8
chore(release): release v0.40.2 (#241) 2025-07-23 07:45:03 +00:00
WebStreamr
be8c664b47
refactor: extract helpers to figure out which instance we're running on 2025-07-23 07:40:41 +00:00
webstreamr
337ced8467
chore(release): release v0.40.1 (#239) 2025-07-22 08:29:13 +00:00
webstreamr
ebcdc5ebd3
chore(release): release v0.40.0 (#237) 2025-07-21 20:05:12 +00:00
WebStreamr
951d442a7d
chore: mention languages and MediaFlow Proxy in description 2025-07-21 20:04:08 +00:00
WebStreamr
51b9104f07
chore: handle cloudflare 451 censor block, show block reasons 2025-07-21 19:35:52 +00:00
WebStreamr
114d296fe3
feat: disable extractors via config 2025-07-21 19:18:20 +00:00
WebStreamr
6fe09fc459
refactor: improve manifest type 2025-07-21 19:08:21 +00:00
WebStreamr
453cc747a1
refactor: introduce createSources() analogue to createExtractors() 2025-07-21 14:39:13 +00:00
webstreamr
ee411709fc
chore(release): release v0.39.2 (#227) 2025-07-20 20:46:46 +02:00
WebStreamr
674eb7ca6d
fix(fetcher): support Basic Auth 2025-07-20 18:44:37 +00:00
webstreamr
75a5133004
chore(release): release v0.39.1 (#225) 2025-07-20 14:01:52 +02:00