Commit graph

220 commits

Author SHA1 Message Date
webstreamr
d0802fea50
chore(release): release v0.23.2 (#110) 2025-06-04 18:38:45 +00:00
WebStreamr
efb0f96be2
chore(fetcher): use well-working node user agent by default again 2025-06-04 18:37:51 +00:00
WebStreamr
aa4c672594
chore(fetcher): persist and use FlareSolverr cookie and user agent
doesn't seem to work, but this is best practice anyway..
2025-06-04 18:29:02 +00:00
WebStreamr
0d3a5b8919
chore(fetcher): use queue limit of 10 again :)
queuing too long results in a bad experience. and often there are other
non-blocked sources too, so people can choose those. or self-host.
2025-06-04 16:18:03 +00:00
webstreamr
a9ebe9946a
chore(release): release v0.23.1 (#107) 2025-06-04 15:24:36 +00:00
WebStreamr
7387aef764
chore(fetcher): use FlareSolverr also for other 403 Cloudflare responses 2025-06-04 15:23:15 +00:00
WebStreamr
e6aa95f875
chore(fetcher): increase queue limit to 30 2025-06-04 15:22:59 +00:00
WebStreamr
2c9faebcdc
fix(fetcher): improve Flaresolverr fetching
- use queued fetching to not mix sessions
- log issue responses
2025-06-04 14:59:12 +00:00
webstreamr
7c45c78788
chore(release): release v0.23.0 (#105) 2025-06-04 16:20:24 +02:00
WebStreamr
af65ed0094
feat(fetcher): add FlareSolverr support 2025-06-04 14:18:50 +00:00
WebStreamr
1b8f75f00e
fix(extractor): do not mutate URLs to avoid cache misses 2025-06-04 13:23:54 +00:00
WebStreamr
fef59dd03b
fix: never cache result errors 2025-06-04 12:05:59 +00:00
WebStreamr
7ec7219ed4
chore: do not log headers for known blocking reasons 2025-06-04 12:05:09 +00:00
webstreamr
a156e98831
chore(release): release v0.22.10 (#104) 2025-06-04 12:59:20 +02:00
WebStreamr
422f7d014c
chore(fetcher): hard-code user-agent again for debugging purposes 2025-06-04 10:54:16 +00:00
WebStreamr
77fc20cfff
refactor: extract env access into helpers 2025-06-04 10:29:50 +00:00
webstreamr
64823685cc
chore(release): release v0.22.9 (#103) 2025-06-04 10:07:13 +00:00
WebStreamr
b69c9cde03
chore: cache successful results as long as we safely can 2025-06-04 10:06:24 +00:00
renovate[bot]
389461415d
chore(deps): update dependency @stylistic/eslint-plugin to v4.4.1 (#101)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-06-04 08:47:17 +00:00
WebStreamr
d78dca3345
chore: log response headers for blocks 2025-06-04 08:45:08 +00:00
webstreamr
c5cc955d91
chore(release): release v0.22.8 (#99) 2025-06-04 00:47:28 +02:00
WebStreamr
f0817a3dd6
chore: implement queued fetching 2025-06-03 22:44:57 +00:00
WebStreamr
ef2c45e2cb
chore: add more error infos to results 2025-06-03 21:56:19 +00:00
webstreamr
ed501a7ee9
chore(release): release v0.22.7 (#96) 2025-06-03 17:04:57 +02:00
WebStreamr
9d17f5340a
chore: catch handler blocked errors and report the and report themm 2025-06-03 15:02:56 +00:00
WebStreamr
f6967da5cc
chore: try to log error causes 2025-06-03 14:54:05 +00:00
WebStreamr
b94f9898b0
chore: use tsconfig base for node 22 2025-06-03 14:54:05 +00:00
WebStreamr
0b9cf21fae
fix(handler): use new frembed domain (again) 2025-06-03 14:21:18 +00:00
renovate[bot]
f0ffd9b024
chore(deps): update dependency typescript-eslint to v8.33.1 (#97)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-06-02 21:23:54 +00:00
WebStreamr
ae6fdfe726
chore: add language name to config in manifest as well 2025-06-02 15:45:16 +00:00
webstreamr
9291a377d3
chore(release): release v0.22.6 (#95) 2025-06-02 15:33:11 +00:00
WebStreamr
e4dd16e9d1
chore: improve results format and refactor name/title generation 2025-06-02 15:31:15 +00:00
webstreamr
120fb2896f
chore(release): release v0.22.5 (#94) 2025-06-02 11:43:57 +02:00
WebStreamr
e86b5c3454
fix(handler): use new frembed domain 2025-06-02 09:42:26 +00:00
WebStreamr
12d91ba0b4
test: fix mocked Fetcher real calls by using same headers 2025-06-02 09:42:26 +00:00
renovate[bot]
dbf1dd1fb9
chore(deps): lock file maintenance (#93)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-06-02 02:22:34 +00:00
renovate[bot]
d04c9280df
chore(deps): update dependency @types/node to v22.15.29 (#92)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-06-02 02:21:56 +00:00
webstreamr
d271b2c337
chore(release): release v0.22.4 (#91) 2025-06-01 19:38:06 +00:00
WebStreamr
cd8ff60508
fix(handler): disable Eurostreaming as long as it doesn't work 2025-06-01 19:37:03 +00:00
WebStreamr
c3a2f9fdc6
fix(fetcher): use "node" as user agent explicitly
no idea why, but this avoids challenges so far..
2025-06-01 19:31:25 +00:00
WebStreamr
2eb09fc65a
chore: generalize forbidden/blocked handling 2025-06-01 19:31:11 +00:00
webstreamr
f3cbc92286
chore(release): release v0.22.3 (#88) 2025-06-01 13:42:44 +00:00
WebStreamr
424ed78b93
chore(fetcher): hardcode user-agent for now to avoid using "node" 2025-06-01 13:40:59 +00:00
webstreamr
ba9f33230f
chore(release): release v0.22.2 (#87) 2025-06-01 13:21:25 +00:00
WebStreamr
717019e04e
chore(fetcher): add response header info to non-expected errors 2025-06-01 13:19:38 +00:00
WebStreamr
ca981220c9
chore(fetcher): remove Origin header
more is not always better I guess :)

not breaking anything, but that header is not used for normal HTTP GET
requests
2025-06-01 13:08:52 +00:00
webstreamr
a85a483732
chore(release): release v0.22.1 (#86) 2025-05-31 21:15:58 +00:00
WebStreamr
fbc1aa994c
fix: switch back to fetch and do not generate user agents
seems to be causing less cloudflare challenges
2025-05-31 21:13:52 +00:00
renovate[bot]
2f9a349d31
chore(deps): update eslint monorepo to v9.28.0 (#85)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-05-30 22:13:58 +00:00
webstreamr
0f19b4b7a7
chore(release): release v0.22.0 (#80) 2025-05-29 21:25:43 +02:00