mirror of
https://github.com/movixcorp/MovixOpenSource.git
synced 2026-07-26 16:32:07 +00:00
feat: live TV FCTV, fournisseur OAuth, sources J1F/Cinestream, modération IA & durcissement Gros lot de travail synchronisé depuis le repo de dev. Les grands axes : migration de domaine (movix.date + miroirs), deux nouvelles sources films/séries (1jour1film, Cinestream) et une n ouvelle source livetv, un fournisseur OAuth « Se connecter avec Movix », une modération de contenu par IA revue, plus un lot de durcissement mémoire/réseau, sécurité et perf côté API et front. ## 🌐 Domaines & miroirs - Domaine canonique `movix.chat`/`movix.golf`/`movix.tax` → **movix.date** partout (front, allow-lists CORS/domaine, Discord RPC). Miroir `movix.health` → **movix.online** (Footer, Header, pages d'aide CaMarchePlus/Dns/Miroirs). Lien Telegram du footer → `mysticsaba.com`. ~10 clés i18n mises à jour. ## 🎬 Sources de streaming (VOD) - **J1F (1jour1film)** — nouvelle source de bout en bout (`routes/j1f.js`, monté sur `/api/j1f`). Résout le domaine tournant via une page `/go/`, décode les blobs base64 `J1F_SRV`/`j1fEpsData` (Dooplay/WP), ne garde que les players uniques, ignore les agrégateurs (frembed/vidsrc/videasy). Cache stale-while-revalidate dédié. Players 1J1F lus via l'extension/userscript. - **Cinestream** — nouvelle source films (`routes/cinestream.js`, scrape Next.js `cinestream.info`, match par id TMDB autoritaire). Wiflix bascule ses **films** sur Cinestream (bot-shield flemmix pénible sur les films) ; la **TV** reste sur flemmix. - **Wiflix** — `flemmix.farm` → **`flemmix.golf`** ; handshake cookie (`makeWiflixSearchRequest`, `h_check=25`) ; sélecteurs de template corrigés. - **Cpasmal** — axios+proxy → `makeCpasmalRequest` (CycleTLS JA3) car Cloudflare 403 ; recherche GET → POST form (le WAF bloque le GET). - **Fstream** — cookie anti-bot `fsschal` ; source épisodes JS statique (`/static/series/<id>.js`) avant l'AJAX `episodes_p.php` ; fallback `get_seasons.php`. - **FranceTV** — `fetchSeasonEpisodesViaDeepPage` (pagination JSON « Afficher plus »). - **Coflix** — `coflix.date` → `coflix.trade` ; logs 429 silencés en double. - **proxyManager** — cinq helpers de contournement Cloudflare exportés (`makeCinestreamRequest`, `make1j1fRequest`, `makeCpasmalRequest`, handshake Wiflix `makeWiflixSearchRequest`/`wiflixHandshake`, `classifyCloudflare429` worker-vs-site) ; CycleTLS + rotation ProxyScrape, ne throw jamais sur statut HTTP. Coflix/LecteurVideo quittent les Cloudflare Workers pour ProxyScrape. ## 📺 Live TV — remplacement de Sosplay/Vavoo par FCTV33 - Source sport **Sosplay → FCTV33** (API RBTV, protobuf brut) réécrite de bout en bout dans `liveTvRoutes.js`, **Vavoo retiré** (manifest/catalogue/stream) — tout passe par `/api/livetv/*`. - Pipeline neuf : décodeur protobuf maison, signature `sfver` (bs keys + MD5), auto-découverte des domaines API/player tournants (`hubu.ru/fctvlink` + Nuxt SSR / `params` rot47, cache 30 min), scraper de matchs (`scrapeFctvMatches` : équipes/logos, ligue, pays, statut live, tri live-first), résolution de flux (HLS natif d'abord, embed en secours), token CDN (XOR keystream + base64, gate `rb-session`). - Route `GET /api/livetv/fctv/playlist` : proxy m3u8 intelligent (résout le token, réécrit les segments, retry sur token périmé, modes `raw` extension / `proxy` VIP). - **Matchs plus réservés aux VIP** (seul `iptv_` le reste) : flux natif proxifié pour les VIP, stub `_fctvLocal` résolu côté client par l'extension/userscript (`RESOLVE_FCTV`), fallback embed sinon. - Front `LiveTV.tsx` : `matches` → `fctv`, UI accordéon par match (logos, badges ligue/pays, score/timer live, favori), disclaimer, fix icône `music`. Rotations d'hôtes : `witv.team`→`witv.football`, `livetv876.me`→`livetv901.me`. ## 🧩 Extensions · Userscript · Discord RPC - **FCTV en lecture native** : handlers `SETUP_FCTV_HEADERS`/`RESOLVE_FCTV` (règle DNR Referer/Origin/UA sur `/cfall/s*` + résolveur local IP-bindé : protobuf-lite + rot47 + token XOR). - **Vavoo retiré** , `cinepulse.lol` → `purstream.mx`. - Fix extracteur **Sibnet** (`Range: bytes=0-0`) ; fix bug userscript `matchToRegex` (patterns ancrés `^…$` cassant `/cfall/s` → dé-ancrés) ; override dev `localhost:25565`. - Bumps de version (Chrome 1.3.3→1.3.8, Firefox 1.5.1→1.5.5, userscript 1.4.0→1.4.7) ; PreMid nouveau `clientId` Discord + `regExp` élargi (1.0.3→1.0.4). ## 🔑 OAuth (fournisseur « Se connecter avec Movix ») & codes d'accès - Refonte du flux d'autorisation OAuth (`OAuthAuthorizePage.tsx`) + routes (`routes/authRoutes.js`, `routes/oauth.js`) et stockage des clients OAuth étoffé (`utils/oauthClientsDb.js`, `routes/adminOauthApps.js` pour la gestion admin des apps). - `AccessCodeForm.tsx` retouché en cohérence avec le nouveau flux ; `checkVip.js` ajusté. - Session centralisée : `accountAuth.ts` expose `clearStoredAuthSession()` / `broadcastAuthChange()` (liste `AUTH_KEYS` unifiée), désormais utilisés partout à la déconnexion. ## 💬 Modération de contenu (IA) - Modèle OpenRouter `google/gemini-2.5-flash-lite` → `deepseek/deepseek-v4-flash` (`commentsRoutes.js`, `sharedListsRoutes.js`) ; fonctions/logs renommés `moderateContentWithGemini` → `moderateContentWithAI` (découplés du nom du modèle). - Prompt durci (critères INSULTES / DEMANDE_AJOUT resserrés) pour éviter les faux positifs sur questions, signalements de bug et plaintes de contenu manquant. - `AdminComments.tsx` : libellé « par Gemini » → clé i18n générique. ## 🧊 Hydracker / Darkiworld - **Sortie du debrid** : AllDebrid/RealDebrid supprimés (`utils/hydrackerLive.js` : branche provider retirée ; vars `ALLDEBRID_*`/`REALDEBRID_*` sorties du `.env`) — hydracker renvoie directement `rawUrl`/`directDL`. Liens servis depuis les snapshots SQLite locaux (`utils/darkiworldSqlite.js`, `darkino-backups/`). - **Anti-scraping** sur `/decode/:id` (`routes/darkiworld.js`) : watchlist + alerte webhook Discord (`DISCORD_SCRAPER_WEBHOOK`) et empoisonnement/blocage de réponse pour les IP listées (`SCRAPER_BLOCKED_IPS`). - **Mémoire** : cache d'agents proxy borné (`utils/lruMap.js`) qui détruit les sockets des agents évincés. ## 🛠️ Admin — propriété des liens & équipe - **Propriété des liens** : les liens streaming gagnent l'attribution `added_by` et l'ownership est appliquée des deux côtés (uploader = ses liens, admin = tous). GET public masqué (`stripLinkOwner`), `GET /admin/streaming-links/:type/:id` authentifié conserve le tag ; `DELETE /admin/links` par URL unique ; `PUT /admin/links` masse admin-only. - **Équipe** : `GET/POST/DELETE /admin/admins` + `GET /admin/team/history` (audit), identité via `adminIdentity.js` (option `preferProfile` → premier profil Movix). UI `AdminTeam.tsx`. - **Privilèges** (`middleware/auth.js`) : `isAdmin` rejette `role !== 'admin'` (403) — les uploaders ne passent plus les routes admin-only. Migration `add_role_to_admins.sql`. ## 🎁 Wrapped v2 - Cartes de partage : logique canvas extraite (`utils/wrappedCanvas.ts`, `utils/wrappedShareCards.ts`), formats de partage supplémentaires + preview. - Nouvelles slides : jour record, répartition par jour de semaine, champion de rewatch, âge ciné (année de sortie médiane pondérée par le temps de visionnage). - Perf : données depuis le payload backend (zéro re-fetch TMDB), trailer lazy, percentile non bloquant (réchauffe en arrière-plan, lock Redis `NX`), shuffle seedé. ## 🔐 Auth · Profils · VIP - **Pseudo forcé** : `validateProfileName` (1–32 chars, strip control/zero-width, + `maxLength={32}` côté UI Profile/WatchParty) ; les pseudos OAuth trop longs → `requiresUsernameChange` + modale bloquante `RequireUsernameChange.tsx`. - **Sync durci** (`ProfileContext.tsx`, `syncPolicy.js`) : anti-replay cross-user, filtrage des ops à clés non-syncables (`access_code`/`access_code_expires` exclues), « wipe guard » qui préserve le local sur profil vide inattendu, dédupe des `loadProfiles()` concurrents. Logout centralisé (voir OAuth). - **VIP** : `is_vip` préservé au chargement de profil (corrige un downgrade VIP inter-onglets qui relançait la popup pub) ; `vipDonations.js` poll de secours `payment-status.php` (via `ipn_token`, colonne `paygate_ipn_token`) → plus d'invoices bloquées. ## ▶️ Lecteur (HLS) - Basse latence opt-in : `isLowLatencyEnabled('movies')` (scope movies/livetv, `lowLatencyPref.ts`) au lieu du mode forcé ; `FloatingPlayer` aligné. - Sous-titres cinep : wrapper m3u8 synthétique pour les URI `.vtt`/`.srt` directes, `isSubtitleLoadError` (une piste cassée ne tue plus la vidéo), rendu `<i>/<b>/<u>`. - Menu sources regroupé par langue (VF/VFQ/VFF/VOSTFR). ## 📡 Cast (AirPlay / Chromecast) - Retrait du contournement proxy darkibox (`buildApiProxyUrl`) → cast direct de l'URL ; `runtime.ts` supprime `API_PROXY_BASE_URL`/`buildApiProxyUrl` devenus morts. - Paramètre `streamType` (`BUFFERED` par défaut) propagé jusqu'à `loadMediaOnCastWithFallback`. ## 📢 Pubs - Modes de popup (`adPopupMode.ts`) : `normal`, `auto`, `click-anywhere` ; toggle « +18 » séparé (`adAdultMode.ts`). `SCRIPT_AD_MODE_ENABLED` → `false`, URL du script changée. ## 🔎 Recherche & priorité des sources - `searchUtils.ts` : le terme original contourne le filtre « trop générique » (fix zéro-résultat sur titres courts : Baki, Gantz). - `animeSignals.ts` : détection donghua (CN/TW/HK ou `zh` + Animation, hors C-drama). - `sourceAutoSelect.ts` : `VFF`/`VFQ` normalisés en `vf` (sinon reléguées derrière VOSTFR). `sourcePriorityPrefs.ts` : schéma v2 → v3 (nouvel ordre par défaut + `j1f`, migration non destructive des ordres personnalisés). `extractionPrefs.ts` : +daddylive. ## 🔒 Sécurité - Sanitisation d'URL avant rendu en `href` : `CommentsSection.tsx` (liens markdown `http(s)://`) et `Greenlight/AdminLinkSubmissions.tsx` — bloque les `javascript:`. ## ⚙️ Infra & perf - **server.js** : recyclage périodique des workers (12h) + `[memstats]` + hook `SIGUSR2` → heap-snapshot. - **app.js** : monte `/api/j1f`, retire la route statique `/oauth-icons`, passe `makeCpasmalRequest` au router Cpasmal, `coflix.date` → `coflix.trade`. - **lazyWithRetry.ts / main.tsx / ErrorBoundary.tsx** : récupération chunk-load réécrite (retry + reload budgété), garde `removeChild/insertBefore`, écran soft « Mise à jour » au lieu du crash-report. - **UI** : `TopProgressBar` écrit `transform` directement sur un ref (compositor-only, plus de re-render) ; `blur-text` relâche `will-change` après l'animation. - **proxiesembed/server.py** : `curl_cffi` (JA3) pour `cinep-proxy` + retry SOCKS5 sur 403 ; lookup clé VIP réaligné sur `checkVip.js` ; log WARNING par défaut ; SOCKS5 forcé IPv4 ; wrapper VTT/SRT pour hls.js ; re-label `application/zip` → `video/mp2t` ; `cinepulse.lol` → `purstream.mx`. ## 🧹 Nettoyage & suppressions - **Front** : carte promo « Loadix » sur Download (remplace l'encart beta), « 1jour1film » ajouté à « C'est quoi Movix », fallback Darkino/Nightflix gutté en no-op (`api.movix.chat` décommissionné), classes CSS mortes retirées, fix `fetchPriority` → `fetchpriority`. - **Backend** : scrapers/utilitaires morts retirés — `routes/dragiv.js`, `routes/topstream.js`, `routes/proxy.js`, `utils/cloudflareSession.js`, `utils/hydrackerBatch.js`, `utils/hydrackerQueue.js'. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
703 lines
24 KiB
JavaScript
703 lines
24 KiB
JavaScript
/**
|
|
* Express application setup.
|
|
* Extracted from server.js -- creates the app, mounts middleware and routes.
|
|
* Does NOT start the server (that remains in server.js).
|
|
*/
|
|
|
|
const express = require("express");
|
|
const http = require("http");
|
|
const https = require("https");
|
|
const compression = require("compression");
|
|
|
|
// Middleware modules
|
|
const corsMiddleware = require("./middleware/cors");
|
|
const {
|
|
securityHeaders,
|
|
keepAliveHeaders,
|
|
domainRestriction,
|
|
jsonParseErrorHandler,
|
|
} = require("./middleware/security");
|
|
|
|
// Config
|
|
const { redis } = require("./config/redis");
|
|
|
|
// Utility modules
|
|
const {
|
|
getFromCacheWithExpiration,
|
|
getFromCacheNoExpiration,
|
|
saveToCache,
|
|
touchCacheEntry,
|
|
shouldUpdateCache,
|
|
shouldUpdateCacheFrenchStream,
|
|
shouldUpdateCacheLecteurVideo,
|
|
shouldUpdateCache24h,
|
|
shouldUpdateCache48h,
|
|
generateCacheKey,
|
|
CACHE_DIR,
|
|
} = require("./utils/cacheManager");
|
|
|
|
const {
|
|
limitConcurrency3,
|
|
limitConcurrency10,
|
|
} = require("./utils/concurrency");
|
|
|
|
const {
|
|
CPASMAL_BASE_URL,
|
|
makeRequestWithCorsFallback,
|
|
} = require("./utils/proxyManager");
|
|
|
|
const axios = require("axios");
|
|
const { wrapper } = require("axios-cookiejar-support");
|
|
const tough = require("tough-cookie");
|
|
const axiosHelpers = require("./utils/axiosHelpers");
|
|
|
|
const DEFAULT_DARKIWORLD_BASE_URL = "https://darkiworld2026.com";
|
|
|
|
function normalizeBaseUrl(value) {
|
|
return String(value || "")
|
|
.trim()
|
|
.replace(/\/+$/, "");
|
|
}
|
|
|
|
const DARKIWORLD_BASE_URL = normalizeBaseUrl(
|
|
process.env.DARKIWORLD_BASE_URL || DEFAULT_DARKIWORLD_BASE_URL,
|
|
);
|
|
|
|
const cookieJar = new tough.CookieJar();
|
|
|
|
// === Darkino session & headers setup ===
|
|
// UA + client hints stables (Chrome/Brave 148 Windows). darkiworld a une
|
|
// limite de session par client, donc TOUTES les requêtes (refresh `/`,
|
|
// /api/v1/titles/.../content/liens, /api/v1/download-premium/...,
|
|
// seasons/episodes) doivent partager exactement ce fingerprint pour rester
|
|
// sur une seule session côté upstream.
|
|
//
|
|
// Cookies + x-xsrf-token : viennent de l'env (DARKIWORLD_COOKIES /
|
|
// DARKIWORLD_XSRF_TOKEN). cf_clearance volontairement absent de l'env :
|
|
// Cloudflare le renouvelle régulièrement, le set-cookie de réponse arrive
|
|
// dans le tough-cookie jar et `mergeCookieHeaders(jarState, configured)`
|
|
// ajoute les cookies du jar absents de la string env sans écraser ceux fixés.
|
|
const darkiHeaders = {
|
|
accept: "application/json",
|
|
"accept-encoding": "gzip, deflate, br",
|
|
"accept-language": "fr-FR,fr;q=0.6",
|
|
"cache-control": "no-cache",
|
|
cookie: process.env.DARKIWORLD_COOKIES || "",
|
|
pragma: "no-cache",
|
|
priority: "u=1, i",
|
|
"sec-ch-ua":
|
|
'"Chromium";v="148", "Brave";v="148", "Not/A)Brand";v="99"',
|
|
"sec-ch-ua-arch": '"x86"',
|
|
"sec-ch-ua-bitness": '"64"',
|
|
"sec-ch-ua-full-version-list":
|
|
'"Chromium";v="148.0.0.0", "Brave";v="148.0.0.0", "Not/A)Brand";v="99.0.0.0"',
|
|
"sec-ch-ua-mobile": "?0",
|
|
"sec-ch-ua-model": '""',
|
|
"sec-ch-ua-platform": '"Windows"',
|
|
"sec-ch-ua-platform-version": '"19.0.0"',
|
|
"sec-fetch-dest": "empty",
|
|
"sec-fetch-mode": "cors",
|
|
"sec-fetch-site": "same-origin",
|
|
"sec-gpc": "1",
|
|
"user-agent":
|
|
"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/148.0.0.0 Safari/537.36",
|
|
"x-xsrf-token": process.env.DARKIWORLD_XSRF_TOKEN || "",
|
|
};
|
|
|
|
// Coflix config
|
|
const COFLIX_BASE_URL = "https://coflix.trade";
|
|
const coflixHeaders = {
|
|
"User-Agent":
|
|
"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36",
|
|
Referer: "https://coflix.trade",
|
|
};
|
|
|
|
// === Axios instances for each source ===
|
|
const axiosCoflix = axios.create({
|
|
baseURL: COFLIX_BASE_URL,
|
|
timeout: 15000,
|
|
headers: coflixHeaders,
|
|
decompress: true,
|
|
});
|
|
|
|
const axiosAnimeSama = axios.create({
|
|
timeout: 30000,
|
|
headers: {
|
|
"User-Agent":
|
|
"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36",
|
|
},
|
|
decompress: true,
|
|
});
|
|
|
|
const FSTREAM_BASE_URL_VAL = "https://french-stream.one/";
|
|
const axiosFStream = axios.create({
|
|
baseURL: FSTREAM_BASE_URL_VAL,
|
|
timeout: 6000,
|
|
headers: {
|
|
"User-Agent":
|
|
"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/144.0.0.0 Safari/537.36",
|
|
Accept:
|
|
"text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8",
|
|
"Accept-Language": "fr-FR,fr;q=0.9,en;q=0.8",
|
|
"Accept-Encoding": "gzip, deflate, br",
|
|
DNT: "1",
|
|
Connection: "keep-alive",
|
|
"Upgrade-Insecure-Requests": "1",
|
|
"Sec-Fetch-Dest": "document",
|
|
"Sec-Fetch-Mode": "navigate",
|
|
"Sec-Fetch-Site": "same-origin",
|
|
"Sec-Fetch-User": "?1",
|
|
"Sec-GPC": "1",
|
|
Pragma: "no-cache",
|
|
"Cache-Control": "no-cache",
|
|
"sec-ch-ua": '"Not(A:Brand";v="8", "Chromium";v="144", "Brave";v="144"',
|
|
"sec-ch-ua-mobile": "?0",
|
|
"sec-ch-ua-platform": '"Windows"',
|
|
Referer: "https://french-stream.one/",
|
|
},
|
|
decompress: true,
|
|
});
|
|
|
|
// Darkino session refresh — coordonné via Redis pour qu'un SEUL worker du
|
|
// cluster pinge l'upstream toutes les 10 minutes (et pas N workers en parallèle,
|
|
// ce qui ferait exploser la limite de session côté darkiworld).
|
|
const DARKINO_SESSION_REFRESH_INTERVAL = 10 * 60 * 1000; // 10 minutes
|
|
const DARKINO_REFRESH_LAST_KEY = "darkino:lastRefreshAt";
|
|
const DARKINO_REFRESH_LOCK_KEY = "darkino:refreshLock";
|
|
const DARKINO_REFRESH_LOCK_TTL_MS = 30 * 1000; // filet si le worker crash pendant le GET (axios timeout = 5s)
|
|
|
|
const refreshDarkinoSessionIfNeeded = async () => {
|
|
try {
|
|
const last = Number(await redis.get(DARKINO_REFRESH_LAST_KEY)) || 0;
|
|
if (Date.now() - last <= DARKINO_SESSION_REFRESH_INTERVAL) return;
|
|
|
|
// SET NX PX : seul le worker qui acquiert exécute le refresh, les autres no-op.
|
|
const acquired = await redis.set(
|
|
DARKINO_REFRESH_LOCK_KEY,
|
|
String(process.pid),
|
|
"PX",
|
|
DARKINO_REFRESH_LOCK_TTL_MS,
|
|
"NX",
|
|
);
|
|
if (!acquired) return;
|
|
|
|
try {
|
|
await axiosHelpers.axiosDarkinoRequest({ method: "get", url: "/" });
|
|
await redis.set(DARKINO_REFRESH_LAST_KEY, String(Date.now()));
|
|
console.log("[DARKINO] Session refreshed");
|
|
} catch (error) {
|
|
if (
|
|
!error.response ||
|
|
(error.response.status !== 500 && error.response.status !== 403)
|
|
) {
|
|
console.error("[DARKINO] Failed to refresh session:", error.message);
|
|
}
|
|
} finally {
|
|
await redis.del(DARKINO_REFRESH_LOCK_KEY).catch(() => {});
|
|
}
|
|
} catch (_) {
|
|
// Redis down → skip silently. Pas de fallback in-memory : ce serait
|
|
// réintroduire le bug N-workers-refreshent-en-parallèle.
|
|
}
|
|
};
|
|
|
|
// Configure axiosHelpers with darkino session deps + axios instances
|
|
axiosHelpers.configure({
|
|
darkiHeaders,
|
|
cookieJar,
|
|
coflixHeaders,
|
|
COFLIX_BASE_URL,
|
|
axiosCoflix,
|
|
axiosAnimeSama,
|
|
axiosFStream,
|
|
ANIME_SAMA_URL: "https://anime-sama.to/",
|
|
FSTREAM_BASE_URL: FSTREAM_BASE_URL_VAL,
|
|
});
|
|
|
|
// === Initialize global agent keep-alive with socket limits ===
|
|
http.globalAgent.keepAlive = true;
|
|
http.globalAgent.maxSockets = 128; // Prevent unbounded socket accumulation
|
|
http.globalAgent.maxFreeSockets = 32;
|
|
https.globalAgent.keepAlive = true;
|
|
https.globalAgent.maxSockets = 128;
|
|
https.globalAgent.maxFreeSockets = 32;
|
|
// Retire each pooled socket after N requests so a long-lived worker rotates
|
|
// its keep-alive sockets instead of pinning the same TLS sessions / native
|
|
// socket objects for the whole process lifetime.
|
|
http.globalAgent.maxRequestsPerSocket = 1000;
|
|
https.globalAgent.maxRequestsPerSocket = 1000;
|
|
|
|
// === Create Express app ===
|
|
const app = express();
|
|
|
|
// === Mount middleware in correct order ===
|
|
|
|
// 1. Enable gzip compression for all responses
|
|
app.use(
|
|
compression({
|
|
level: 1, // Balanced compression level (1-9, higher = more compression, slower)
|
|
threshold: 1024, // Only compress responses > 1KB
|
|
filter: (req, res) => {
|
|
// Don't compress if client doesn't accept it
|
|
if (req.headers["x-no-compression"]) return false;
|
|
return compression.filter(req, res);
|
|
},
|
|
}),
|
|
);
|
|
|
|
// 2. Cors Configuration (Restricted in production)
|
|
app.use(corsMiddleware);
|
|
|
|
// 3. Security headers (minimal set -- replaces Helmet)
|
|
app.use(securityHeaders);
|
|
|
|
// 4. Keep-Alive headers
|
|
app.use(keepAliveHeaders);
|
|
|
|
// 5. Domain restriction middleware
|
|
app.use(domainRestriction);
|
|
|
|
// 6. Body parsing
|
|
// Largest legitimate JSON body is the localStorage sync payload, capped at
|
|
// 5MB by SYNC_LIMITS.maxRequestBytes (utils/syncPolicy.js); OAuth icon uploads
|
|
// cap at 256KB. 8MB leaves headroom while preventing a single request from
|
|
// pinning tens of MB of buffer until the response completes.
|
|
app.use(express.json({ limit: "8mb" }));
|
|
|
|
// 7. JSON parse error handler (must come right after json parser)
|
|
app.use(jsonParseErrorHandler);
|
|
|
|
app.use(express.urlencoded({ extended: true, limit: "1mb" }));
|
|
|
|
// 8. Serve uploaded OAuth app icons (`public/oauth-icons/<filename>`).
|
|
// Le panel admin upload ici, OAuthAuthorizePage lit `/oauth-icons/<filename>`.
|
|
const { ICON_DIR: OAUTH_ICON_DIR } = require('./utils/oauthClientsDb');
|
|
app.use(
|
|
'/oauth-icons',
|
|
express.static(OAUTH_ICON_DIR, {
|
|
fallthrough: false,
|
|
maxAge: '7d',
|
|
setHeaders: (res) => {
|
|
res.setHeader('Cross-Origin-Resource-Policy', 'cross-origin');
|
|
},
|
|
}),
|
|
);
|
|
|
|
// ==========================================================================
|
|
// Configure route modules with dependencies from extracted utilities
|
|
// ==========================================================================
|
|
|
|
const TMDB_API_KEY = process.env.TMDB_API_KEY || "";
|
|
const TMDB_API_URL = "https://api.themoviedb.org/3";
|
|
const DARKINO_MAINTENANCE = false;
|
|
const DARKINOS_CACHE_DIR = require("path").join(__dirname, "cache", "darkinos");
|
|
const DOWNLOAD_CACHE_DIR = require("path").join(
|
|
__dirname,
|
|
"cache",
|
|
"darkinodownloadlink",
|
|
);
|
|
const ANIME_SAMA_URL = "https://anime-sama.to/";
|
|
|
|
// Shared deps object for common dependencies
|
|
const commonDeps = {
|
|
TMDB_API_KEY,
|
|
TMDB_API_URL,
|
|
DARKINO_MAINTENANCE,
|
|
DARKINOS_CACHE_DIR,
|
|
getFromCacheNoExpiration,
|
|
getFromCacheWithExpiration,
|
|
saveToCache,
|
|
shouldUpdateCache,
|
|
shouldUpdateCacheFrenchStream,
|
|
shouldUpdateCacheLecteurVideo,
|
|
shouldUpdateCache24h,
|
|
limitConcurrency3,
|
|
axiosDarkinoRequest: axiosHelpers.axiosDarkinoRequest,
|
|
};
|
|
|
|
// --- Configure cpasmal ---
|
|
const cpasmalRouter = require("./routes/cpasmal");
|
|
cpasmalRouter.configure({
|
|
CPASMAL_BASE_URL,
|
|
TMDB_API_URL,
|
|
TMDB_API_KEY,
|
|
makeCpasmalRequest: require("./utils/proxyManager").makeCpasmalRequest,
|
|
getFromCacheNoExpiration,
|
|
shouldUpdateCache,
|
|
});
|
|
|
|
// --- Configure coflix (helper, not a router) ---
|
|
const coflix = require("./routes/coflix");
|
|
coflix.configure({
|
|
axiosCoflixRequest: axiosHelpers.axiosCoflixRequest,
|
|
axiosLecteurVideoRequest: axiosHelpers.axiosLecteurVideoRequest,
|
|
makeCoflixRequest: require("./utils/proxyManager").makeCoflixRequest,
|
|
coflixHeaders,
|
|
getFromCacheNoExpiration,
|
|
saveToCache,
|
|
formatCoflixError: axiosHelpers.formatCoflixError,
|
|
});
|
|
|
|
// --- Configure frenchstream (helper, not a router) ---
|
|
const frenchstream = require("./routes/frenchstream");
|
|
frenchstream.configure({
|
|
makeRequestWithCorsFallback,
|
|
axiosFrenchStreamRequest: axiosHelpers.axiosFrenchStreamRequest,
|
|
// findTvSeriesOnTMDB will be injected after tmdb is configured
|
|
});
|
|
|
|
// --- Configure animeSama ---
|
|
const animeSamaRouter = require("./routes/animeSama");
|
|
animeSamaRouter.configure({
|
|
ANIME_SAMA_URL,
|
|
axiosAnimeSama,
|
|
axiosAnimeSamaRequest: axiosHelpers.axiosAnimeSamaRequest,
|
|
getFromCacheNoExpiration,
|
|
saveToCache,
|
|
mergeStreamingLinks: axiosHelpers.mergeStreamingLinks,
|
|
cleanupOldCacheFiles: axiosHelpers.cleanupOldCacheFiles,
|
|
migrateOldCacheFiles: axiosHelpers.migrateOldCacheFiles,
|
|
limitConcurrency10,
|
|
});
|
|
|
|
// --- Configure tmdb ---
|
|
const tmdbRouter = require("./routes/tmdb");
|
|
tmdbRouter.configure({
|
|
TMDB_API_KEY,
|
|
TMDB_API_URL,
|
|
getFromCacheNoExpiration,
|
|
saveToCache,
|
|
shouldUpdateCacheFrenchStream,
|
|
shouldUpdateCacheLecteurVideo,
|
|
limitConcurrency3,
|
|
// Coflix helpers
|
|
searchCoflixByTitle: coflix.searchCoflixByTitle,
|
|
getMovieDataFromCoflix: coflix.getMovieDataFromCoflix,
|
|
getTvDataFromCoflix: coflix.getTvDataFromCoflix,
|
|
filterEmmmmbedReaders: coflix.filterEmmmmbedReaders,
|
|
// FrenchStream helpers
|
|
getFrenchStreamMovie: frenchstream.getFrenchStreamMovie,
|
|
getFrenchStreamSeries: frenchstream.getFrenchStreamSeries,
|
|
getFrenchStreamSeriesDetails: frenchstream.getFrenchStreamSeriesDetails,
|
|
extractSeriesInfo: frenchstream.extractSeriesInfo,
|
|
mergeSeriesParts: frenchstream.mergeSeriesParts,
|
|
cleanTvCacheData: frenchstream.cleanTvCacheData,
|
|
});
|
|
|
|
// Now inject findTvSeriesOnTMDB back into frenchstream (circular dep)
|
|
frenchstream.configure({
|
|
findTvSeriesOnTMDB: tmdbRouter.findTvSeriesOnTMDB,
|
|
});
|
|
|
|
// --- Configure search ---
|
|
const searchRouter = require("./routes/search");
|
|
searchRouter.configure({
|
|
DARKINO_MAINTENANCE,
|
|
DARKINOS_CACHE_DIR,
|
|
axiosDarkinoRequest: axiosHelpers.axiosDarkinoRequest,
|
|
getFromCacheNoExpiration,
|
|
saveToCache,
|
|
touchCacheEntry,
|
|
shouldUpdateCache,
|
|
});
|
|
|
|
// --- Configure download ---
|
|
const downloadRouter = require("./routes/download");
|
|
downloadRouter.configure({
|
|
DARKINO_MAINTENANCE,
|
|
DARKINOS_CACHE_DIR,
|
|
darkiHeaders,
|
|
darkiworld_premium: false,
|
|
axiosDarkinoRequest: axiosHelpers.axiosDarkinoRequest,
|
|
getFromCacheNoExpiration,
|
|
saveToCache,
|
|
shouldUpdateCache,
|
|
refreshDarkinoSessionIfNeeded,
|
|
});
|
|
|
|
// --- Configure darkiworld ---
|
|
const darkiworldRouter = require("./routes/darkiworld");
|
|
darkiworldRouter.configure({
|
|
DARKINO_MAINTENANCE,
|
|
DOWNLOAD_CACHE_DIR,
|
|
darkiHeaders,
|
|
axiosDarkinoRequest: axiosHelpers.axiosDarkinoRequest,
|
|
getFromCacheNoExpiration,
|
|
saveToCache,
|
|
shouldUpdateCache,
|
|
shouldUpdateCache24h,
|
|
shouldUpdateCache48h,
|
|
refreshDarkinoSessionIfNeeded,
|
|
redis,
|
|
});
|
|
|
|
// --- Configure voirdrama ---
|
|
const voirdramaRouter = require("./routes/voirdrama");
|
|
voirdramaRouter.configure({
|
|
TMDB_API_KEY,
|
|
TMDB_API_URL,
|
|
getFromCacheNoExpiration,
|
|
saveToCache,
|
|
shouldUpdateCache24h,
|
|
});
|
|
|
|
// --- Configure francetv ---
|
|
const francetvRouter = require("./routes/francetv");
|
|
francetvRouter.configure({
|
|
getFromCacheWithExpiration,
|
|
saveToCache,
|
|
});
|
|
|
|
const {
|
|
router: vipDonationsRouter,
|
|
ensureVipDonationsTables
|
|
} = require('./routes/vipDonations');
|
|
const { router: vipPayblisRouter } = require('./routes/vipPayblis');
|
|
const oauthRouter = require('./routes/oauth');
|
|
|
|
// ==========================================================================
|
|
// Mount all route modules
|
|
// ==========================================================================
|
|
|
|
// Pre-existing routes (already extracted before this modularization)
|
|
const sharedListsRouter = require("./sharedListsRoutes");
|
|
app.use("/api/comments", require("./commentsRoutes"));
|
|
app.use("/api/likes", require("./likesRoutes"));
|
|
app.use("/api/shared-lists", sharedListsRouter);
|
|
app.use("/api/livetv", require("./liveTvRoutes"));
|
|
|
|
// New modular routes
|
|
app.use('/api/cpasmal', cpasmalRouter);
|
|
app.use('/anime', animeSamaRouter);
|
|
app.use('/api', tmdbRouter);
|
|
app.use('/', searchRouter);
|
|
app.use('/api', downloadRouter);
|
|
app.use('/api/fstream', require('./routes/fstream'));
|
|
app.use('/api/wiflix', require('./routes/wiflix'));
|
|
app.use('/api/j1f', require('./routes/j1f'));
|
|
app.use('/api', require('./routes/sync'));
|
|
app.use('/api/profiles', require('./routes/profiles'));
|
|
app.use('/api/help', require('./routes/helpFeedback'));
|
|
app.use('/api/auth', require('./routes/authRoutes'));
|
|
app.use('/api/oauth', oauthRouter);
|
|
app.use('/api/admin/oauth-apps', require('./routes/adminOauthApps'));
|
|
app.use('/api/sessions', require('./routes/sessions'));
|
|
app.use('/api', require('./routes/debrid'));
|
|
app.use('/api', require('./routes/admin'));
|
|
app.use('/api', vipDonationsRouter);
|
|
app.use('/api', vipPayblisRouter);
|
|
app.use('/api/darkiworld', darkiworldRouter);
|
|
app.use('/api/drama', voirdramaRouter);
|
|
app.use('/api/ftv', francetvRouter);
|
|
const purstreamRouter = require('./routes/purstream');
|
|
purstreamRouter.configure({
|
|
TMDB_API_KEY,
|
|
TMDB_API_URL,
|
|
PROXY_SERVER_URL: process.env.PROXY_SERVER_URL,
|
|
verifyAccessKey: require("./checkVip").verifyAccessKey,
|
|
getFromCacheNoExpiration,
|
|
saveToCache,
|
|
shouldUpdateCache,
|
|
});
|
|
app.use("/api/purstream", purstreamRouter);
|
|
|
|
const downloadLinksLeaderboardRouter = require('./routes/downloadLinksLeaderboard');
|
|
app.use('/api/download-links', downloadLinksLeaderboardRouter);
|
|
|
|
// ==========================================================================
|
|
// MySQL pool initialization — pool unique via mysqlPool.js
|
|
// ==========================================================================
|
|
|
|
const {
|
|
initPool,
|
|
getPool,
|
|
SCHEMA_BOOTSTRAP_LOCK_NAME,
|
|
withMysqlAdvisoryLock
|
|
} = require('./mysqlPool');
|
|
const { ensureAccountLinksStorage } = require('./utils/accountLinks');
|
|
const { ensureCloneLinksStorage } = require('./utils/cloneLinks');
|
|
const { ensureOAuthStorage } = require('./utils/oauthStorage');
|
|
|
|
const appReady = (async () => {
|
|
try {
|
|
const pool = await initPool();
|
|
console.log("MySQL unified pool initialized successfully");
|
|
await withMysqlAdvisoryLock(pool, SCHEMA_BOOTSTRAP_LOCK_NAME, async () => {
|
|
console.log(
|
|
`[Bootstrap] Worker ${process.pid} acquired MySQL schema lock`,
|
|
);
|
|
|
|
// Créer la table user_sessions si elle n'existe pas
|
|
await pool.execute(`
|
|
CREATE TABLE IF NOT EXISTS user_sessions (
|
|
id VARCHAR(255) PRIMARY KEY,
|
|
user_id VARCHAR(255) NOT NULL,
|
|
user_type ENUM('oauth', 'bip39') NOT NULL,
|
|
user_agent TEXT,
|
|
created_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
|
|
accessed_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,
|
|
INDEX idx_user_sessions_user (user_id, user_type),
|
|
INDEX idx_user_sessions_accessed (accessed_at)
|
|
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci
|
|
`);
|
|
console.log("Table user_sessions initialized successfully");
|
|
|
|
await ensureAccountLinksStorage();
|
|
console.log("Table account_links initialized successfully");
|
|
|
|
await ensureCloneLinksStorage();
|
|
console.log("Table clone_links initialized successfully");
|
|
|
|
await ensureVipDonationsTables(pool);
|
|
console.log('VIP donations tables initialized successfully');
|
|
|
|
await ensureOAuthStorage(pool);
|
|
console.log('OAuth tables initialized successfully');
|
|
|
|
// OAuth client config (table oauth_clients + stats + grants VIP).
|
|
// ensureTables et migrateLegacyJsonIfNeeded sont protégés par le lock
|
|
// mais idempotents — sûr sur restart cluster. reloadCache hydrate
|
|
// le cache in-process de CE worker (chaque worker a le sien).
|
|
const oauthClientsDb = require('./utils/oauthClientsDb');
|
|
await oauthClientsDb.ensureTables();
|
|
await oauthClientsDb.migrateLegacyJsonIfNeeded();
|
|
await oauthClientsDb.reloadCache();
|
|
// Cluster mode: subscribe so this worker reloads when any other worker
|
|
// mutates an OAuth client (see oauthClientsDb cross-worker invalidation).
|
|
oauthClientsDb.startClientsCacheSubscriber();
|
|
console.log('OAuth client tables initialized successfully');
|
|
|
|
// Initialize Wishboard routes
|
|
const { createWishboardRouter } = require("./wishboardRoutes");
|
|
const wishboardRouter = createWishboardRouter(pool, redis);
|
|
app.use("/api/wishboard", wishboardRouter);
|
|
app.use("/api/admin/wishboard", wishboardRouter);
|
|
console.log("Wishboard routes initialized successfully");
|
|
|
|
// Initialize Link Submissions routes (user-submitted streaming links)
|
|
const {
|
|
createLinkSubmissionsRouter,
|
|
} = require("./linkSubmissionsRoutes");
|
|
const linkSubmissionsRouter = createLinkSubmissionsRouter(pool, redis);
|
|
app.use("/api/link-submissions", linkSubmissionsRouter);
|
|
// Create link_submissions table if not exists
|
|
await pool.execute(`
|
|
CREATE TABLE IF NOT EXISTS link_submissions (
|
|
id INT AUTO_INCREMENT PRIMARY KEY,
|
|
user_id VARCHAR(255) NOT NULL,
|
|
profile_id VARCHAR(255) NOT NULL,
|
|
tmdb_id INT NOT NULL,
|
|
media_type ENUM('movie', 'tv') NOT NULL,
|
|
season_number INT DEFAULT NULL,
|
|
episode_number INT DEFAULT NULL,
|
|
url VARCHAR(2048) NOT NULL,
|
|
source_name VARCHAR(100) DEFAULT NULL,
|
|
status ENUM('pending', 'approved', 'rejected') DEFAULT 'pending',
|
|
rejection_reason TEXT DEFAULT NULL,
|
|
reviewed_by VARCHAR(255) DEFAULT NULL,
|
|
reviewed_at DATETIME DEFAULT NULL,
|
|
created_at DATETIME DEFAULT CURRENT_TIMESTAMP,
|
|
updated_at DATETIME DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,
|
|
INDEX idx_ls_status (status),
|
|
INDEX idx_ls_profile (profile_id),
|
|
INDEX idx_ls_tmdb (tmdb_id, media_type),
|
|
INDEX idx_ls_created (created_at)
|
|
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci
|
|
`);
|
|
console.log("Link Submissions routes initialized successfully");
|
|
|
|
// Download links schema (admin-managed downloads + history/leaderboard)
|
|
await pool.execute(`
|
|
CREATE TABLE IF NOT EXISTS download_links_history (
|
|
id BIGINT PRIMARY KEY AUTO_INCREMENT,
|
|
admin_id VARCHAR(255) NOT NULL,
|
|
admin_auth_type ENUM('oauth','bip-39') NOT NULL,
|
|
action ENUM('added','removed') NOT NULL,
|
|
media_type ENUM('movie','tv') NOT NULL,
|
|
tmdb_id BIGINT NOT NULL,
|
|
season INT NULL,
|
|
episode INT NULL,
|
|
link_url TEXT NOT NULL,
|
|
link_type ENUM('streaming','download') NOT NULL DEFAULT 'download',
|
|
changed_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
|
|
INDEX idx_dlh_admin (admin_id, admin_auth_type),
|
|
INDEX idx_dlh_changed (changed_at),
|
|
INDEX idx_dlh_action (action),
|
|
INDEX idx_dlh_link_type (link_type)
|
|
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci
|
|
`);
|
|
|
|
// Ensure download_links JSON column on films and series (idempotent)
|
|
const ensureColumn = async (tableName, columnName, definitionSql) => {
|
|
const [rows] = await pool.execute(
|
|
`SELECT COLUMN_NAME FROM INFORMATION_SCHEMA.COLUMNS
|
|
WHERE TABLE_SCHEMA = DATABASE() AND TABLE_NAME = ? AND COLUMN_NAME = ? LIMIT 1`,
|
|
[tableName, columnName]
|
|
);
|
|
if (rows.length === 0) {
|
|
await pool.execute(`ALTER TABLE \`${tableName}\` ADD COLUMN ${definitionSql}`);
|
|
}
|
|
};
|
|
await ensureColumn('films', 'download_links', 'download_links JSON NULL');
|
|
await ensureColumn('series', 'download_links', 'download_links JSON NULL');
|
|
// Retro-migration: ensure link_type column exists on download_links_history (for installations that created the table before this column was added)
|
|
await ensureColumn('download_links_history', 'link_type', "link_type ENUM('streaming','download') NOT NULL DEFAULT 'download'");
|
|
console.log("Download links schema initialized successfully");
|
|
|
|
// Initialize Top 10 routes (public ranking)
|
|
const { router: top10Router, initTop10Routes } = require("./top10Routes");
|
|
initTop10Routes(pool, redis);
|
|
app.use("/api/top10", top10Router);
|
|
console.log("Top 10 routes initialized successfully");
|
|
|
|
// Initialize Wrapped routes (Movix Wrapped 2026 data collection)
|
|
const {
|
|
router: wrappedRouter,
|
|
initWrappedRoutes,
|
|
initTables: initWrappedTables,
|
|
} = require("./wrappedRoutes");
|
|
initWrappedRoutes(pool, redis);
|
|
await initWrappedTables();
|
|
app.use("/api/wrapped", wrappedRouter);
|
|
console.log("Wrapped routes initialized successfully");
|
|
});
|
|
} catch (error) {
|
|
console.error("MySQL connection error:", error.message);
|
|
throw error;
|
|
}
|
|
})();
|
|
|
|
// === Pool getter for other modules ===
|
|
function getAppPool() {
|
|
return getPool();
|
|
}
|
|
|
|
// Hydracker freeze (2026-05-15): the queue, worker lock, and rate-limit key
|
|
// from the old architecture are dead. Clear them once on boot so they don't
|
|
// linger or confuse ops dashboards.
|
|
(async () => {
|
|
try {
|
|
if (redis && typeof redis.del === 'function') {
|
|
await redis.del('hydracker:queue:pending',
|
|
'hydracker:worker_lock',
|
|
'hydracker:rate_limited_until');
|
|
console.log('[hydracker-freeze] cleared legacy redis keys');
|
|
}
|
|
} catch (e) {
|
|
console.warn('[hydracker-freeze] redis cleanup failed:', e?.message);
|
|
}
|
|
})();
|
|
|
|
// === Unified error handler ===
|
|
app.use((err, req, res, next) => {
|
|
if (err.message !== "Not allowed by CORS") {
|
|
console.error("Erreur globale:", err);
|
|
}
|
|
res.status(500).json({
|
|
error: "Erreur serveur interne",
|
|
message: err.message,
|
|
path: req.path,
|
|
});
|
|
});
|
|
|
|
module.exports = { app, appReady, getAppPool };
|