Supervideo blocked #498

Closed
opened 2025-11-10 23:18:46 +00:00 by GLlgGL · 30 comments
GLlgGL commented 2025-11-10 23:18:46 +00:00 (Migrated from github.com)

Hi

I get Supervideo.cc blocked reason unknown on the public instance.

Hi I get Supervideo.cc blocked reason unknown on the public instance.
webstreamr commented 2025-11-11 01:37:26 +00:00 (Migrated from github.com)

I get the same on my dev instance. Either this is temporary or they do some stricter detection via cloudflare. If the latter, I have a bad feeling.. Anyway, reached out to somebody else who scrapes it too and until I'm back on a computer we can do whisful watching and waiting :) or somebody else starts debugging with curl requests

I also checked if switching from warp to another proxy/VPN or switching from full super video to embed scraping helps. No changes with either.

I get the same on my dev instance. Either this is temporary or they do some stricter detection via cloudflare. If the latter, I have a bad feeling.. Anyway, reached out to somebody else who scrapes it too and until I'm back on a computer we can do whisful watching and waiting :) or somebody else starts debugging with curl requests I also checked if switching from warp to another proxy/VPN or switching from full super video to embed scraping helps. No changes with either.
GLlgGL commented 2025-11-11 10:21:40 +00:00 (Migrated from github.com)

Check here might help. Maybe is the solution
a4b7e7be5c

Check here might help. Maybe is the solution https://github.com/Gujal00/ResolveURL/commit/a4b7e7be5c4d04e1f9e82b8f83ac30204464455e
webstreamr commented 2025-11-12 03:22:26 +00:00 (Migrated from github.com)

https://github.com/UrloMythus/MammaMia/blob/main/Src/API/extractors/supervideo.py is apparently also working just fine. Which is an indicator that the fetcher or extractor here needs adaption and it can be fixed most likely

https://github.com/UrloMythus/MammaMia/blob/main/Src/API/extractors/supervideo.py is apparently also working just fine. Which is an indicator that the fetcher or extractor here needs adaption and it can be fixed most likely
GLlgGL commented 2025-11-12 12:48:54 +00:00 (Migrated from github.com)

When you come back?

When you come back?
webstreamr commented 2025-11-12 13:07:13 +00:00 (Migrated from github.com)

End of November my friend 😁 you can try removing proxy (forward*, IP and such) headers from Fetcher.ts if you're motivated

End of November my friend 😁 you can try removing proxy (forward*, IP and such) headers from Fetcher.ts if you're motivated
GLlgGL commented 2025-11-12 16:46:59 +00:00 (Migrated from github.com)

Hmm good

I can try but don't understand it well what I have to do

Hmm good I can try but don't understand it well what I have to do
GLlgGL commented 2025-11-13 08:45:18 +00:00 (Migrated from github.com)

`025-11-13T08:23:41.238Z info 85b0be6f-8b73-43ad-960b-77b01b67c27f: Fetch GET https://mostraguarda.stream/movie/tt29644189

2025-11-13T08:23:41.293Z info 85b0be6f-8b73-43ad-960b-77b01b67c27f: Got 403 (Forbidden) for https://mostraguarda.stream/movie/tt29644189

2025-11-13T08:23:41.317Z warn 85b0be6f-8b73-43ad-960b-77b01b67c27f: mostraguarda: Request to https://mostraguarda.stream/movie/tt29644189 was blocked, reason: cloudflare_challenge, headers: {"accept-ch":"Sec-CH-UA-Bitness, Sec-CH-UA-Arch, Sec-CH-UA-Full-Version, Sec-CH-UA-Mobile, Sec-CH-UA-Model, Sec-CH-UA-Platform-Version, Sec-CH-UA-Full-Version-List, Sec-CH-UA-Platform, Sec-CH-UA, UA-Bitness, UA-Arch, UA-Full-Version, UA-Mobile, UA-Model, UA-Platform-Version, UA-Platform, UA","alt-svc":"h3=":443"; ma=86400","cache-control":"private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0","cf-mitigated":"challenge","cf-ray":"99dcde52eeb357f4-IAD","content-encoding":"br","content-type":"text/html; charset=UTF-8","critical-ch":"Sec-CH-UA-Bitness, Sec-CH-UA-Arch, Sec-CH-UA-Full-Version, Sec-CH-UA-Mobile, Sec-CH-UA-Model, Sec-CH-UA-Platform-Version, Sec-CH-UA-Full-Version-List, Sec-CH-UA-Platform, Sec-CH-UA, UA-Bitness, UA-Arch, UA-Full-Version, UA-Mobile, UA-Model, UA-Platform-Version, UA-Platform, UA","cross-origin-embedder-policy":"require-corp","cross-origin-opener-policy":"same-origin","cross-origin-resource-policy":"same-origin","expires":"Thu, 01 Jan 1970 00:00:01 GMT","nel":"{"success_fraction":0,"report_to":"cf-nel","max_age":604800}","origin-agent-cluster":"?1","permissions-policy":"accelerometer=(),browsing-topics=(),camera=(),clipboard-read=(),clipboard-write=(),geolocation=(),gyroscope=(),hid=(),interest-cohort=(),magnetometer=(),microphone=(),payment=(),publickey-credentials-get=(),screen-wake-lock=(),serial=(),sync-xhr=(),usb=()","referrer-policy":"same-origin","report-to":"{"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v4?s=XMthLCTl4YXby385oxsh7ETEAV2hxbQlOeyncoLwbFtjSWIVwBxsit%2BMC2WskOmOsczQ4hfqeGnsjUnAvfyidTR22C3%2BUiQb22oHZpz%2BUbVicQZ0cdXp3q0cMAcF%2FFglpE1QhY67"}],"group":"cf-nel","max_age":604800}","server":"cloudflare","server-timing":"chlray;desc="99dcde52eeb357f4", cfOrigin;dur=0,cfEdge;dur=22, cfL4;desc="?proto=TCP&rtt=771&min_rtt=770&rtt_var=291&sent=3&recv=5&lost=0&retrans=0&sent_bytes=2864&recv_bytes=956&delivery_rate=3703324&cwnd=252&unsent_bytes=0&cid=a9959cfd4da8ee85&ts=29&x=0"","vary":"Accept-Encoding","x-content-type-options":"nosniff","x-frame-options":"SAMEORIGIN","age":"0","date":"Thu, 13 Nov 2025 08:23:41 GMT"}.`

This problem I had yesterday with the other source and by adding headers I fixed...but this website is not accesible.

So the problem maybe is not the extractor because it's failing to get the movie link

`025-11-13T08:23:41.238Z info 85b0be6f-8b73-43ad-960b-77b01b67c27f: Fetch GET https://mostraguarda.stream/movie/tt29644189 2025-11-13T08:23:41.293Z info 85b0be6f-8b73-43ad-960b-77b01b67c27f: Got 403 (Forbidden) for https://mostraguarda.stream/movie/tt29644189 2025-11-13T08:23:41.317Z warn 85b0be6f-8b73-43ad-960b-77b01b67c27f: mostraguarda: Request to https://mostraguarda.stream/movie/tt29644189 was blocked, reason: cloudflare_challenge, headers: {"accept-ch":"Sec-CH-UA-Bitness, Sec-CH-UA-Arch, Sec-CH-UA-Full-Version, Sec-CH-UA-Mobile, Sec-CH-UA-Model, Sec-CH-UA-Platform-Version, Sec-CH-UA-Full-Version-List, Sec-CH-UA-Platform, Sec-CH-UA, UA-Bitness, UA-Arch, UA-Full-Version, UA-Mobile, UA-Model, UA-Platform-Version, UA-Platform, UA","alt-svc":"h3=\":443\"; ma=86400","cache-control":"private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0","cf-mitigated":"challenge","cf-ray":"99dcde52eeb357f4-IAD","content-encoding":"br","content-type":"text/html; charset=UTF-8","critical-ch":"Sec-CH-UA-Bitness, Sec-CH-UA-Arch, Sec-CH-UA-Full-Version, Sec-CH-UA-Mobile, Sec-CH-UA-Model, Sec-CH-UA-Platform-Version, Sec-CH-UA-Full-Version-List, Sec-CH-UA-Platform, Sec-CH-UA, UA-Bitness, UA-Arch, UA-Full-Version, UA-Mobile, UA-Model, UA-Platform-Version, UA-Platform, UA","cross-origin-embedder-policy":"require-corp","cross-origin-opener-policy":"same-origin","cross-origin-resource-policy":"same-origin","expires":"Thu, 01 Jan 1970 00:00:01 GMT","nel":"{\"success_fraction\":0,\"report_to\":\"cf-nel\",\"max_age\":604800}","origin-agent-cluster":"?1","permissions-policy":"accelerometer=(),browsing-topics=(),camera=(),clipboard-read=(),clipboard-write=(),geolocation=(),gyroscope=(),hid=(),interest-cohort=(),magnetometer=(),microphone=(),payment=(),publickey-credentials-get=(),screen-wake-lock=(),serial=(),sync-xhr=(),usb=()","referrer-policy":"same-origin","report-to":"{\"endpoints\":[{\"url\":\"https:\\/\\/a.nel.cloudflare.com\\/report\\/v4?s=XMthLCTl4YXby385oxsh7ETEAV2hxbQlOeyncoLwbFtjSWIVwBxsit%2BMC2WskOmOsczQ4hfqeGnsjUnAvfyidTR22C3%2BUiQb22oHZpz%2BUbVicQZ0cdXp3q0cMAcF%2FFglpE1QhY67\"}],\"group\":\"cf-nel\",\"max_age\":604800}","server":"cloudflare","server-timing":"chlray;desc=\"99dcde52eeb357f4\", cfOrigin;dur=0,cfEdge;dur=22, cfL4;desc=\"?proto=TCP&rtt=771&min_rtt=770&rtt_var=291&sent=3&recv=5&lost=0&retrans=0&sent_bytes=2864&recv_bytes=956&delivery_rate=3703324&cwnd=252&unsent_bytes=0&cid=a9959cfd4da8ee85&ts=29&x=0\"","vary":"Accept-Encoding","x-content-type-options":"nosniff","x-frame-options":"SAMEORIGIN","age":"0","date":"Thu, 13 Nov 2025 08:23:41 GMT"}.` This problem I had yesterday with the other source and by adding headers I fixed...but this website is not accesible. So the problem maybe is not the extractor because it's failing to get the movie link
webstreamr commented 2025-11-27 15:01:29 +00:00 (Migrated from github.com)

I looked into this but still have no clue why the supervideo.cc is blocking, sorry. In my case it's the extractor for sure. I'll need to play around on my Linux laptop still, but I'm worried that it is some cloudflare browser finger printing or so, similar as https://github.com/Gujal00/ResolveURL/issues/1169

I will most likely set-up a fully dockerized webstreamr and see if it helps if I change versions of various things.

what I tried so far with no luck

  • warp vpn on/off
  • webshare proxy on/off
  • passing various headers and leaving them out
  • removing proxy ip related headers
  • changing embed URL as a4b7e7be5c did
  • using same user agent and headers as resolveurl does
  • downgrading node from 24 to 22
  • use fetch directly vs use undici fetch
  • use exactly the same cURL request as browser request that works does, e.g.
curl --socks5 127.0.0.1:1080 'https://supervideo.cc/e/bj6szat1pval'   --compressed   -H 'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:144.0) Gecko/20100101 Firefox/144.0'   -H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8'   -H 'Accept-Language: en-US,en;q=0.7,de-DE;q=0.3'   -H 'Accept-Encoding: gzip, deflate, br, zstd'   -H 'DNT: 1'   -H 'Sec-GPC: 1'   -H 'Connection: keep-alive'   -H 'Upgrade-Insecure-Requests: 1'   -H 'Sec-Fetch-Dest: document'   -H 'Sec-Fetch-Mode: navigate'   -H 'Sec-Fetch-Site: none'   -H 'Sec-Fetch-User: ?1'
  • use powershell request on same machine/ip where it works via browser, e.g.
Invoke-WebRequest -UseBasicParsing -Uri "https://supervideo.cc/e/bj6szat1pval" `
>> -UserAgent "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:144.0) Gecko/20100101 Firefox/144.0" `
>> -Headers @{
>> "Accept" = "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"
>>   "Accept-Language" = "en-US,en;q=0.7,de-DE;q=0.3"
>>   "Accept-Encoding" = "gzip, deflate, br, zstd"
>>   "DNT" = "1"
>>   "Sec-GPC" = "1"
>>   "Upgrade-Insecure-Requests" = "1"
>>   "Sec-Fetch-Dest" = "document"
>>   "Sec-Fetch-Mode" = "navigate"
>>   "Sec-Fetch-Site" = "none"
>>   "Sec-Fetch-User" = "?1"
>> }
I looked into this but still have no clue why the supervideo.cc is blocking, sorry. In my case it's the extractor for sure. I'll need to play around on my Linux laptop still, but I'm worried that it is some cloudflare browser finger printing or so, similar as https://github.com/Gujal00/ResolveURL/issues/1169 I will most likely set-up a fully dockerized webstreamr and see if it helps if I change versions of various things. what I tried so far with no luck - warp vpn on/off - webshare proxy on/off - passing various headers and leaving them out - removing proxy ip related headers - changing embed URL as https://github.com/Gujal00/ResolveURL/commit/a4b7e7be5c4d04e1f9e82b8f83ac30204464455e did - using same user agent and headers as resolveurl does - downgrading node from 24 to 22 - use fetch directly vs use undici fetch - use exactly the same cURL request as browser request that works does, e.g. ```sh curl --socks5 127.0.0.1:1080 'https://supervideo.cc/e/bj6szat1pval' --compressed -H 'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:144.0) Gecko/20100101 Firefox/144.0' -H 'Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8' -H 'Accept-Language: en-US,en;q=0.7,de-DE;q=0.3' -H 'Accept-Encoding: gzip, deflate, br, zstd' -H 'DNT: 1' -H 'Sec-GPC: 1' -H 'Connection: keep-alive' -H 'Upgrade-Insecure-Requests: 1' -H 'Sec-Fetch-Dest: document' -H 'Sec-Fetch-Mode: navigate' -H 'Sec-Fetch-Site: none' -H 'Sec-Fetch-User: ?1' ``` - use powershell request on same machine/ip where it works via browser, e.g. ```sh Invoke-WebRequest -UseBasicParsing -Uri "https://supervideo.cc/e/bj6szat1pval" ` >> -UserAgent "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:144.0) Gecko/20100101 Firefox/144.0" ` >> -Headers @{ >> "Accept" = "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8" >> "Accept-Language" = "en-US,en;q=0.7,de-DE;q=0.3" >> "Accept-Encoding" = "gzip, deflate, br, zstd" >> "DNT" = "1" >> "Sec-GPC" = "1" >> "Upgrade-Insecure-Requests" = "1" >> "Sec-Fetch-Dest" = "document" >> "Sec-Fetch-Mode" = "navigate" >> "Sec-Fetch-Site" = "none" >> "Sec-Fetch-User" = "?1" >> } ```
webstreamr commented 2025-11-27 15:06:14 +00:00 (Migrated from github.com)

ok, minor success, with https://github.com/lwthiker/curl-impersonate it works :) e.g.

./curl_chrome116 --socks5 127.0.0.1:1080 'https://supervideo.cc/e/bj6szat1pval'

I suppose that means it is indeed tls fingerprinting or something related

it might be possible to do something similar via node, or add a dependency to curl-impersonate and a wrapper in node.

to be continued..

ok, minor success, with https://github.com/lwthiker/curl-impersonate it works :) e.g. ```sh ./curl_chrome116 --socks5 127.0.0.1:1080 'https://supervideo.cc/e/bj6szat1pval' ``` I suppose that means it is indeed tls fingerprinting or something related it might be possible to do something similar via node, or add a dependency to curl-impersonate and a wrapper in node. to be continued..
GLlgGL commented 2025-11-27 21:05:08 +00:00 (Migrated from github.com)

Seems good to me like this. You can aso install what distro you like on windows via Linux Subsystem. It's 2-3 commands.

curl 'https://supervideo.cc/e/bj6szat1pval' \ -H 'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.0.0 Safari/537.36'

Image
Seems good to me like this. You can aso install what distro you like on windows via Linux Subsystem. It's 2-3 commands. `curl 'https://supervideo.cc/e/bj6szat1pval' \ -H 'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.0.0 Safari/537.36'` <img width="1308" height="957" alt="Image" src="https://github.com/user-attachments/assets/ea074b94-db3f-4a5f-b460-b3dfe287d9d0" />
webstreamr commented 2025-11-28 04:04:25 +00:00 (Migrated from github.com)

What distro where you using there? Can you also post the output of the following please?

curl 'https://tools.scrapfly.io/api/tls'

The less weird hacks I have to resort to the better.

What distro where you using there? Can you also post the output of the following please? ```sh curl 'https://tools.scrapfly.io/api/tls' ``` The less weird hacks I have to resort to the better.
GLlgGL commented 2025-11-28 08:22:12 +00:00 (Migrated from github.com)
Image

Debian

<img width="1886" height="578" alt="Image" src="https://github.com/user-attachments/assets/50628c8f-3219-40b8-8fa5-c9fe4c4629f3" /> Debian
webstreamr commented 2025-11-28 12:24:00 +00:00 (Migrated from github.com)

using curl-impersonate is too much overhead and not a good solution. but I realized that apparently switching to axios is a workaround. I'm preparing that.

using curl-impersonate is too much overhead and not a good solution. but I realized that apparently switching to axios is a workaround. I'm preparing that.
GLlgGL commented 2025-11-28 12:57:10 +00:00 (Migrated from github.com)

Good

Are your vacation over?

Good Are your vacation over?
webstreamr commented 2025-11-28 15:41:54 +00:00 (Migrated from github.com)

I pushed something. if you have a local dev env running - can you pull, do npm install and check if supervideo is fine now?

I pushed something. if you have a local dev env running - can you pull, do npm install and check if supervideo is fine now?
GLlgGL commented 2025-11-28 16:43:32 +00:00 (Migrated from github.com)

I can try just give me 1 hour I guess as I am over phone and not on laprop right now

I can try just give me 1 hour I guess as I am over phone and not on laprop right now
GLlgGL commented 2025-11-28 18:23:24 +00:00 (Migrated from github.com)

SuperVideo works now.

image

There are two new problems

image

SuperVideo works now. ![image](https://github.com/user-attachments/assets/d0d762c0-104f-44f5-ab48-d279706448e8) There are two new problems ![image](https://github.com/user-attachments/assets/c8a677e4-8d4e-4095-b10c-37d2ebe87c2f)
GLlgGL commented 2025-11-28 20:22:26 +00:00 (Migrated from github.com)

Also

image

Also ![image](https://github.com/user-attachments/assets/dd7c72c7-649b-4209-8b88-c7e5bc6538a7)
webstreamr commented 2025-11-28 23:13:07 +00:00 (Migrated from github.com)

I think those are not related to the changes and are solved by e.g. using a VPN. Thx for testing!

I think those are not related to the changes and are solved by e.g. using a VPN. Thx for testing!
GLlgGL commented 2025-11-29 08:41:20 +00:00 (Migrated from github.com)

Hmm. I will not bother to use e vpn if that is the case. We can close this now.

Hmm. I will not bother to use e vpn if that is the case. We can close this now.
webstreamr commented 2025-11-29 12:56:36 +00:00 (Migrated from github.com)

worked around / fixed via 09f795b862 and b7930014ab

worked around / fixed via 09f795b8622808e062bddecb02db68647d369183 and b7930014abbeb4445b15a12c060a9fc396561bd4
GLlgGL commented 2025-11-29 13:01:40 +00:00 (Migrated from github.com)

image

I also got these on every movie i go

But nothing to do with the new changes...i get them even on old one

![image](https://github.com/user-attachments/assets/6f3e4bf5-991f-493b-bd84-6a5fefbe017f) I also got these on every movie i go But nothing to do with the new changes...i get them even on old one
webstreamr commented 2025-11-29 13:12:20 +00:00 (Migrated from github.com)

2 things

  • there was no new release yet, so supervideo will not work yet
  • the public instance issues were because apparently the warp proxy container died (again). the infra is not maintained by me, not sure what's recently going on. I restarted it.
2 things - there was no new release yet, so supervideo will not work yet - the public instance issues were because apparently the warp proxy container died (again). the infra is not maintained by me, not sure what's recently going on. I restarted it.
GLlgGL commented 2025-11-29 13:19:45 +00:00 (Migrated from github.com)

Now they work. The only one that still shows blocked is the mostraguarda.stream

Maybe because I am using it through vercel and they might have blocked the ip

But I think they are now all good.

You can focus now on new things:p

Now they work. The only one that still shows blocked is the mostraguarda.stream Maybe because I am using it through vercel and they might have blocked the ip But I think they are now all good. You can focus now on new things:p
webstreamr commented 2025-11-29 14:36:36 +00:00 (Migrated from github.com)

Still not working on the public instance it seems 😭

Still not working on the public instance it seems 😭
GLlgGL commented 2025-11-29 14:58:08 +00:00 (Migrated from github.com)

For me using vercel is working

For me using vercel is working
GLlgGL commented 2025-11-29 17:18:21 +00:00 (Migrated from github.com)

on last release i get blocked again on public instance

on last release i get blocked again on public instance
GLlgGL commented 2025-11-29 17:25:23 +00:00 (Migrated from github.com)

Bulding and using vercel works fine though. Maybe your public instance ip is getting blocked

Bulding and using vercel works fine though. Maybe your public instance ip is getting blocked
webstreamr commented 2025-11-30 11:14:44 +00:00 (Migrated from github.com)

Should be good now. Elfhosted build env was outdated and still using alpine based older node images.

Should be good now. Elfhosted build env was outdated and still using alpine based older node images.
GLlgGL commented 2025-11-30 11:46:49 +00:00 (Migrated from github.com)

Yes I confirm. Now we have a good view.
100% looking good now.

Yes I confirm. Now we have a good view. 100% looking good now.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Creepso/webstreamr-github#498
No description provided.