MovixOpenSource/API/Mainapi/app.js
Movix 8657a856f8 feat: live TV FCTV, fournisseur OAuth, sources J1F/Cinestream, modération IA & durcissement
feat: live TV FCTV, fournisseur OAuth, sources J1F/Cinestream, modération IA & durcissement

Gros lot de travail synchronisé depuis le repo de dev. Les grands axes :
migration de domaine (movix.date + miroirs), deux nouvelles sources films/séries
(1jour1film, Cinestream) et une n ouvelle source livetv, un fournisseur OAuth « Se connecter avec Movix », une
modération de contenu par IA revue, plus un lot de durcissement mémoire/réseau,
sécurité et perf côté API et front.

## 🌐 Domaines & miroirs

- Domaine canonique `movix.chat`/`movix.golf`/`movix.tax` → **movix.date** partout
  (front, allow-lists CORS/domaine, Discord RPC). Miroir `movix.health` →
  **movix.online** (Footer, Header, pages d'aide CaMarchePlus/Dns/Miroirs). Lien
  Telegram du footer → `mysticsaba.com`. ~10 clés i18n mises à jour.

## 🎬 Sources de streaming (VOD)

- **J1F (1jour1film)** — nouvelle source de bout en bout (`routes/j1f.js`, monté sur
  `/api/j1f`). Résout le domaine tournant via une page `/go/`, décode les blobs base64
  `J1F_SRV`/`j1fEpsData` (Dooplay/WP), ne garde que les players uniques, ignore les
  agrégateurs (frembed/vidsrc/videasy). Cache stale-while-revalidate dédié. Players 1J1F
  lus via l'extension/userscript.
- **Cinestream** — nouvelle source films (`routes/cinestream.js`, scrape Next.js
  `cinestream.info`, match par id TMDB autoritaire). Wiflix bascule ses **films** sur
  Cinestream (bot-shield flemmix pénible sur les films) ; la **TV** reste sur flemmix.
- **Wiflix** — `flemmix.farm` → **`flemmix.golf`** ; handshake cookie
  (`makeWiflixSearchRequest`, `h_check=25`) ; sélecteurs de template corrigés.
- **Cpasmal** — axios+proxy → `makeCpasmalRequest` (CycleTLS JA3) car Cloudflare 403 ;
  recherche GET → POST form (le WAF bloque le GET).
- **Fstream** — cookie anti-bot `fsschal` ; source épisodes JS statique
  (`/static/series/<id>.js`) avant l'AJAX `episodes_p.php` ; fallback `get_seasons.php`.
- **FranceTV** — `fetchSeasonEpisodesViaDeepPage` (pagination JSON « Afficher plus »).
- **Coflix** — `coflix.date` → `coflix.trade` ; logs 429 silencés en double.
- **proxyManager** — cinq helpers de contournement Cloudflare exportés
  (`makeCinestreamRequest`, `make1j1fRequest`, `makeCpasmalRequest`, handshake Wiflix
  `makeWiflixSearchRequest`/`wiflixHandshake`, `classifyCloudflare429` worker-vs-site) ;
  CycleTLS + rotation ProxyScrape, ne throw jamais sur statut HTTP. Coflix/LecteurVideo
  quittent les Cloudflare Workers pour ProxyScrape.

## 📺 Live TV — remplacement de Sosplay/Vavoo par FCTV33

- Source sport **Sosplay → FCTV33** (API RBTV, protobuf brut) réécrite de bout en bout
  dans `liveTvRoutes.js`, **Vavoo retiré** (manifest/catalogue/stream) — tout passe par
  `/api/livetv/*`.
- Pipeline neuf : décodeur protobuf maison, signature `sfver` (bs keys + MD5),
  auto-découverte des domaines API/player tournants (`hubu.ru/fctvlink` + Nuxt SSR /
  `params` rot47, cache 30 min), scraper de matchs (`scrapeFctvMatches` :
  équipes/logos, ligue, pays, statut live, tri live-first), résolution de flux (HLS
  natif d'abord, embed en secours), token CDN (XOR keystream + base64, gate
  `rb-session`).
- Route `GET /api/livetv/fctv/playlist` : proxy m3u8 intelligent (résout le token,
  réécrit les segments, retry sur token périmé, modes `raw` extension / `proxy` VIP).
- **Matchs plus réservés aux VIP** (seul `iptv_` le reste) : flux natif proxifié pour
  les VIP, stub `_fctvLocal` résolu côté client par
  l'extension/userscript (`RESOLVE_FCTV`), fallback embed sinon.
- Front `LiveTV.tsx` : `matches` → `fctv`, UI accordéon par match (logos, badges
  ligue/pays, score/timer live, favori), disclaimer, fix icône `music`. Rotations
  d'hôtes : `witv.team`→`witv.football`, `livetv876.me`→`livetv901.me`.

## 🧩 Extensions · Userscript · Discord RPC

- **FCTV en lecture native** : handlers `SETUP_FCTV_HEADERS`/`RESOLVE_FCTV` (règle DNR
  Referer/Origin/UA sur `/cfall/s*` + résolveur local IP-bindé : protobuf-lite + rot47
  + token XOR).
- **Vavoo retiré** , `cinepulse.lol` → `purstream.mx`.
- Fix extracteur **Sibnet** (`Range: bytes=0-0`) ; fix bug userscript `matchToRegex`
  (patterns ancrés `^…$` cassant `/cfall/s` → dé-ancrés) ; override dev
  `localhost:25565`.
- Bumps de version (Chrome 1.3.3→1.3.8, Firefox 1.5.1→1.5.5, userscript 1.4.0→1.4.7) ;
  PreMid nouveau `clientId` Discord + `regExp` élargi (1.0.3→1.0.4).

## 🔑 OAuth (fournisseur « Se connecter avec Movix ») & codes d'accès

- Refonte du flux d'autorisation OAuth (`OAuthAuthorizePage.tsx`) + routes
  (`routes/authRoutes.js`, `routes/oauth.js`) et stockage des clients OAuth étoffé
  (`utils/oauthClientsDb.js`, `routes/adminOauthApps.js` pour la gestion admin des apps).
- `AccessCodeForm.tsx` retouché en cohérence avec le nouveau flux ; `checkVip.js` ajusté.
- Session centralisée : `accountAuth.ts` expose `clearStoredAuthSession()` /
  `broadcastAuthChange()` (liste `AUTH_KEYS` unifiée), désormais utilisés partout à la
  déconnexion.

## 💬 Modération de contenu (IA)

- Modèle OpenRouter `google/gemini-2.5-flash-lite` → `deepseek/deepseek-v4-flash`
  (`commentsRoutes.js`, `sharedListsRoutes.js`) ; fonctions/logs renommés
  `moderateContentWithGemini` → `moderateContentWithAI` (découplés du nom du modèle).
- Prompt durci (critères INSULTES / DEMANDE_AJOUT resserrés) pour éviter les faux
  positifs sur questions, signalements de bug et plaintes de contenu manquant.
- `AdminComments.tsx` : libellé « par Gemini » → clé i18n générique.

## 🧊 Hydracker / Darkiworld

- **Sortie du debrid** : AllDebrid/RealDebrid supprimés (`utils/hydrackerLive.js` :
  branche provider retirée ; vars `ALLDEBRID_*`/`REALDEBRID_*` sorties du `.env`) —
  hydracker renvoie directement `rawUrl`/`directDL`. Liens servis depuis les snapshots
  SQLite locaux (`utils/darkiworldSqlite.js`, `darkino-backups/`).
- **Anti-scraping** sur `/decode/:id` (`routes/darkiworld.js`) : watchlist + alerte
  webhook Discord (`DISCORD_SCRAPER_WEBHOOK`) et empoisonnement/blocage de réponse pour
  les IP listées (`SCRAPER_BLOCKED_IPS`).
- **Mémoire** : cache d'agents proxy borné (`utils/lruMap.js`) qui détruit les sockets
  des agents évincés.

## 🛠️ Admin — propriété des liens & équipe

- **Propriété des liens** : les liens streaming gagnent l'attribution `added_by` et
  l'ownership est appliquée des deux côtés (uploader = ses liens, admin = tous). GET
  public masqué (`stripLinkOwner`), `GET /admin/streaming-links/:type/:id` authentifié
  conserve le tag ; `DELETE /admin/links` par URL unique ; `PUT /admin/links` masse
  admin-only.
- **Équipe** : `GET/POST/DELETE /admin/admins` + `GET /admin/team/history` (audit),
  identité via `adminIdentity.js` (option `preferProfile` → premier profil Movix). UI
  `AdminTeam.tsx`.
- **Privilèges** (`middleware/auth.js`) : `isAdmin` rejette `role !== 'admin'` (403) —
  les uploaders ne passent plus les routes admin-only. Migration
  `add_role_to_admins.sql`.

## 🎁 Wrapped v2

- Cartes de partage : logique canvas extraite (`utils/wrappedCanvas.ts`,
  `utils/wrappedShareCards.ts`), formats de partage supplémentaires + preview.
- Nouvelles slides : jour record, répartition par jour de semaine, champion de rewatch,
  âge ciné (année de sortie médiane pondérée par le temps de visionnage).
- Perf : données depuis le payload backend (zéro re-fetch TMDB), trailer lazy,
  percentile non bloquant (réchauffe en arrière-plan, lock Redis `NX`), shuffle seedé.

## 🔐 Auth · Profils · VIP

- **Pseudo forcé** : `validateProfileName` (1–32 chars, strip control/zero-width, +
  `maxLength={32}` côté UI Profile/WatchParty) ; les pseudos OAuth trop longs →
  `requiresUsernameChange` + modale bloquante `RequireUsernameChange.tsx`.
- **Sync durci** (`ProfileContext.tsx`, `syncPolicy.js`) : anti-replay cross-user,
  filtrage des ops à clés non-syncables (`access_code`/`access_code_expires` exclues),
  « wipe guard » qui préserve le local sur profil vide inattendu, dédupe des
  `loadProfiles()` concurrents. Logout centralisé (voir OAuth).
- **VIP** : `is_vip` préservé au chargement de profil (corrige un downgrade VIP
  inter-onglets qui relançait la popup pub) ; `vipDonations.js` poll de secours
  `payment-status.php` (via `ipn_token`, colonne `paygate_ipn_token`) → plus d'invoices
  bloquées.

## ▶️ Lecteur (HLS)

- Basse latence opt-in : `isLowLatencyEnabled('movies')` (scope movies/livetv,
  `lowLatencyPref.ts`) au lieu du mode forcé ; `FloatingPlayer` aligné.
- Sous-titres cinep : wrapper m3u8 synthétique pour les URI `.vtt`/`.srt` directes,
  `isSubtitleLoadError` (une piste cassée ne tue plus la vidéo), rendu `<i>/<b>/<u>`.
- Menu sources regroupé par langue (VF/VFQ/VFF/VOSTFR).

## 📡 Cast (AirPlay / Chromecast)

- Retrait du contournement proxy darkibox (`buildApiProxyUrl`) → cast direct de l'URL ;
  `runtime.ts` supprime `API_PROXY_BASE_URL`/`buildApiProxyUrl` devenus morts.
- Paramètre `streamType` (`BUFFERED` par défaut) propagé jusqu'à
  `loadMediaOnCastWithFallback`.

## 📢 Pubs

- Modes de popup (`adPopupMode.ts`) : `normal`, `auto`, `click-anywhere` ; toggle « +18 »
  séparé (`adAdultMode.ts`). `SCRIPT_AD_MODE_ENABLED` → `false`, URL du script changée.

## 🔎 Recherche & priorité des sources

- `searchUtils.ts` : le terme original contourne le filtre « trop générique » (fix
  zéro-résultat sur titres courts : Baki, Gantz).
- `animeSignals.ts` : détection donghua (CN/TW/HK ou `zh` + Animation, hors C-drama).
- `sourceAutoSelect.ts` : `VFF`/`VFQ` normalisés en `vf` (sinon reléguées derrière
  VOSTFR). `sourcePriorityPrefs.ts` : schéma v2 → v3 (nouvel ordre par défaut + `j1f`,
  migration non destructive des ordres personnalisés). `extractionPrefs.ts` : +daddylive.

## 🔒 Sécurité

- Sanitisation d'URL avant rendu en `href` : `CommentsSection.tsx` (liens markdown
  `http(s)://`) et `Greenlight/AdminLinkSubmissions.tsx` — bloque les `javascript:`.

## ⚙️ Infra & perf

- **server.js** : recyclage périodique des workers (12h) + `[memstats]` + hook
  `SIGUSR2` → heap-snapshot.
- **app.js** : monte `/api/j1f`, retire la route statique `/oauth-icons`, passe
  `makeCpasmalRequest` au router Cpasmal, `coflix.date` → `coflix.trade`.
- **lazyWithRetry.ts / main.tsx / ErrorBoundary.tsx** : récupération chunk-load réécrite
  (retry + reload budgété), garde `removeChild/insertBefore`, écran soft « Mise à jour »
  au lieu du crash-report.
- **UI** : `TopProgressBar` écrit `transform` directement sur un ref (compositor-only,
  plus de re-render) ; `blur-text` relâche `will-change` après l'animation.
- **proxiesembed/server.py** : `curl_cffi` (JA3) pour `cinep-proxy` + retry SOCKS5 sur
  403 ; lookup clé VIP réaligné sur `checkVip.js` ; log WARNING par défaut ; SOCKS5
  forcé IPv4 ; wrapper VTT/SRT pour hls.js ; re-label `application/zip` → `video/mp2t` ;
  `cinepulse.lol` → `purstream.mx`.

## 🧹 Nettoyage & suppressions

- **Front** : carte promo « Loadix » sur Download (remplace l'encart beta),
  « 1jour1film » ajouté à « C'est quoi Movix », fallback Darkino/Nightflix gutté en
  no-op (`api.movix.chat` décommissionné), classes CSS mortes retirées, fix
  `fetchPriority` → `fetchpriority`.
- **Backend** : scrapers/utilitaires morts retirés — `routes/dragiv.js`,
  `routes/topstream.js`, `routes/proxy.js`, `utils/cloudflareSession.js`,
  `utils/hydrackerBatch.js`, `utils/hydrackerQueue.js'.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-05 18:22:13 +02:00

703 lines
24 KiB
JavaScript

/**
* Express application setup.
* Extracted from server.js -- creates the app, mounts middleware and routes.
* Does NOT start the server (that remains in server.js).
*/
const express = require("express");
const http = require("http");
const https = require("https");
const compression = require("compression");
// Middleware modules
const corsMiddleware = require("./middleware/cors");
const {
securityHeaders,
keepAliveHeaders,
domainRestriction,
jsonParseErrorHandler,
} = require("./middleware/security");
// Config
const { redis } = require("./config/redis");
// Utility modules
const {
getFromCacheWithExpiration,
getFromCacheNoExpiration,
saveToCache,
touchCacheEntry,
shouldUpdateCache,
shouldUpdateCacheFrenchStream,
shouldUpdateCacheLecteurVideo,
shouldUpdateCache24h,
shouldUpdateCache48h,
generateCacheKey,
CACHE_DIR,
} = require("./utils/cacheManager");
const {
limitConcurrency3,
limitConcurrency10,
} = require("./utils/concurrency");
const {
CPASMAL_BASE_URL,
makeRequestWithCorsFallback,
} = require("./utils/proxyManager");
const axios = require("axios");
const { wrapper } = require("axios-cookiejar-support");
const tough = require("tough-cookie");
const axiosHelpers = require("./utils/axiosHelpers");
const DEFAULT_DARKIWORLD_BASE_URL = "https://darkiworld2026.com";
function normalizeBaseUrl(value) {
return String(value || "")
.trim()
.replace(/\/+$/, "");
}
const DARKIWORLD_BASE_URL = normalizeBaseUrl(
process.env.DARKIWORLD_BASE_URL || DEFAULT_DARKIWORLD_BASE_URL,
);
const cookieJar = new tough.CookieJar();
// === Darkino session & headers setup ===
// UA + client hints stables (Chrome/Brave 148 Windows). darkiworld a une
// limite de session par client, donc TOUTES les requêtes (refresh `/`,
// /api/v1/titles/.../content/liens, /api/v1/download-premium/...,
// seasons/episodes) doivent partager exactement ce fingerprint pour rester
// sur une seule session côté upstream.
//
// Cookies + x-xsrf-token : viennent de l'env (DARKIWORLD_COOKIES /
// DARKIWORLD_XSRF_TOKEN). cf_clearance volontairement absent de l'env :
// Cloudflare le renouvelle régulièrement, le set-cookie de réponse arrive
// dans le tough-cookie jar et `mergeCookieHeaders(jarState, configured)`
// ajoute les cookies du jar absents de la string env sans écraser ceux fixés.
const darkiHeaders = {
accept: "application/json",
"accept-encoding": "gzip, deflate, br",
"accept-language": "fr-FR,fr;q=0.6",
"cache-control": "no-cache",
cookie: process.env.DARKIWORLD_COOKIES || "",
pragma: "no-cache",
priority: "u=1, i",
"sec-ch-ua":
'"Chromium";v="148", "Brave";v="148", "Not/A)Brand";v="99"',
"sec-ch-ua-arch": '"x86"',
"sec-ch-ua-bitness": '"64"',
"sec-ch-ua-full-version-list":
'"Chromium";v="148.0.0.0", "Brave";v="148.0.0.0", "Not/A)Brand";v="99.0.0.0"',
"sec-ch-ua-mobile": "?0",
"sec-ch-ua-model": '""',
"sec-ch-ua-platform": '"Windows"',
"sec-ch-ua-platform-version": '"19.0.0"',
"sec-fetch-dest": "empty",
"sec-fetch-mode": "cors",
"sec-fetch-site": "same-origin",
"sec-gpc": "1",
"user-agent":
"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/148.0.0.0 Safari/537.36",
"x-xsrf-token": process.env.DARKIWORLD_XSRF_TOKEN || "",
};
// Coflix config
const COFLIX_BASE_URL = "https://coflix.trade";
const coflixHeaders = {
"User-Agent":
"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36",
Referer: "https://coflix.trade",
};
// === Axios instances for each source ===
const axiosCoflix = axios.create({
baseURL: COFLIX_BASE_URL,
timeout: 15000,
headers: coflixHeaders,
decompress: true,
});
const axiosAnimeSama = axios.create({
timeout: 30000,
headers: {
"User-Agent":
"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36",
},
decompress: true,
});
const FSTREAM_BASE_URL_VAL = "https://french-stream.one/";
const axiosFStream = axios.create({
baseURL: FSTREAM_BASE_URL_VAL,
timeout: 6000,
headers: {
"User-Agent":
"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/144.0.0.0 Safari/537.36",
Accept:
"text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8",
"Accept-Language": "fr-FR,fr;q=0.9,en;q=0.8",
"Accept-Encoding": "gzip, deflate, br",
DNT: "1",
Connection: "keep-alive",
"Upgrade-Insecure-Requests": "1",
"Sec-Fetch-Dest": "document",
"Sec-Fetch-Mode": "navigate",
"Sec-Fetch-Site": "same-origin",
"Sec-Fetch-User": "?1",
"Sec-GPC": "1",
Pragma: "no-cache",
"Cache-Control": "no-cache",
"sec-ch-ua": '"Not(A:Brand";v="8", "Chromium";v="144", "Brave";v="144"',
"sec-ch-ua-mobile": "?0",
"sec-ch-ua-platform": '"Windows"',
Referer: "https://french-stream.one/",
},
decompress: true,
});
// Darkino session refresh — coordonné via Redis pour qu'un SEUL worker du
// cluster pinge l'upstream toutes les 10 minutes (et pas N workers en parallèle,
// ce qui ferait exploser la limite de session côté darkiworld).
const DARKINO_SESSION_REFRESH_INTERVAL = 10 * 60 * 1000; // 10 minutes
const DARKINO_REFRESH_LAST_KEY = "darkino:lastRefreshAt";
const DARKINO_REFRESH_LOCK_KEY = "darkino:refreshLock";
const DARKINO_REFRESH_LOCK_TTL_MS = 30 * 1000; // filet si le worker crash pendant le GET (axios timeout = 5s)
const refreshDarkinoSessionIfNeeded = async () => {
try {
const last = Number(await redis.get(DARKINO_REFRESH_LAST_KEY)) || 0;
if (Date.now() - last <= DARKINO_SESSION_REFRESH_INTERVAL) return;
// SET NX PX : seul le worker qui acquiert exécute le refresh, les autres no-op.
const acquired = await redis.set(
DARKINO_REFRESH_LOCK_KEY,
String(process.pid),
"PX",
DARKINO_REFRESH_LOCK_TTL_MS,
"NX",
);
if (!acquired) return;
try {
await axiosHelpers.axiosDarkinoRequest({ method: "get", url: "/" });
await redis.set(DARKINO_REFRESH_LAST_KEY, String(Date.now()));
console.log("[DARKINO] Session refreshed");
} catch (error) {
if (
!error.response ||
(error.response.status !== 500 && error.response.status !== 403)
) {
console.error("[DARKINO] Failed to refresh session:", error.message);
}
} finally {
await redis.del(DARKINO_REFRESH_LOCK_KEY).catch(() => {});
}
} catch (_) {
// Redis down → skip silently. Pas de fallback in-memory : ce serait
// réintroduire le bug N-workers-refreshent-en-parallèle.
}
};
// Configure axiosHelpers with darkino session deps + axios instances
axiosHelpers.configure({
darkiHeaders,
cookieJar,
coflixHeaders,
COFLIX_BASE_URL,
axiosCoflix,
axiosAnimeSama,
axiosFStream,
ANIME_SAMA_URL: "https://anime-sama.to/",
FSTREAM_BASE_URL: FSTREAM_BASE_URL_VAL,
});
// === Initialize global agent keep-alive with socket limits ===
http.globalAgent.keepAlive = true;
http.globalAgent.maxSockets = 128; // Prevent unbounded socket accumulation
http.globalAgent.maxFreeSockets = 32;
https.globalAgent.keepAlive = true;
https.globalAgent.maxSockets = 128;
https.globalAgent.maxFreeSockets = 32;
// Retire each pooled socket after N requests so a long-lived worker rotates
// its keep-alive sockets instead of pinning the same TLS sessions / native
// socket objects for the whole process lifetime.
http.globalAgent.maxRequestsPerSocket = 1000;
https.globalAgent.maxRequestsPerSocket = 1000;
// === Create Express app ===
const app = express();
// === Mount middleware in correct order ===
// 1. Enable gzip compression for all responses
app.use(
compression({
level: 1, // Balanced compression level (1-9, higher = more compression, slower)
threshold: 1024, // Only compress responses > 1KB
filter: (req, res) => {
// Don't compress if client doesn't accept it
if (req.headers["x-no-compression"]) return false;
return compression.filter(req, res);
},
}),
);
// 2. Cors Configuration (Restricted in production)
app.use(corsMiddleware);
// 3. Security headers (minimal set -- replaces Helmet)
app.use(securityHeaders);
// 4. Keep-Alive headers
app.use(keepAliveHeaders);
// 5. Domain restriction middleware
app.use(domainRestriction);
// 6. Body parsing
// Largest legitimate JSON body is the localStorage sync payload, capped at
// 5MB by SYNC_LIMITS.maxRequestBytes (utils/syncPolicy.js); OAuth icon uploads
// cap at 256KB. 8MB leaves headroom while preventing a single request from
// pinning tens of MB of buffer until the response completes.
app.use(express.json({ limit: "8mb" }));
// 7. JSON parse error handler (must come right after json parser)
app.use(jsonParseErrorHandler);
app.use(express.urlencoded({ extended: true, limit: "1mb" }));
// 8. Serve uploaded OAuth app icons (`public/oauth-icons/<filename>`).
// Le panel admin upload ici, OAuthAuthorizePage lit `/oauth-icons/<filename>`.
const { ICON_DIR: OAUTH_ICON_DIR } = require('./utils/oauthClientsDb');
app.use(
'/oauth-icons',
express.static(OAUTH_ICON_DIR, {
fallthrough: false,
maxAge: '7d',
setHeaders: (res) => {
res.setHeader('Cross-Origin-Resource-Policy', 'cross-origin');
},
}),
);
// ==========================================================================
// Configure route modules with dependencies from extracted utilities
// ==========================================================================
const TMDB_API_KEY = process.env.TMDB_API_KEY || "";
const TMDB_API_URL = "https://api.themoviedb.org/3";
const DARKINO_MAINTENANCE = false;
const DARKINOS_CACHE_DIR = require("path").join(__dirname, "cache", "darkinos");
const DOWNLOAD_CACHE_DIR = require("path").join(
__dirname,
"cache",
"darkinodownloadlink",
);
const ANIME_SAMA_URL = "https://anime-sama.to/";
// Shared deps object for common dependencies
const commonDeps = {
TMDB_API_KEY,
TMDB_API_URL,
DARKINO_MAINTENANCE,
DARKINOS_CACHE_DIR,
getFromCacheNoExpiration,
getFromCacheWithExpiration,
saveToCache,
shouldUpdateCache,
shouldUpdateCacheFrenchStream,
shouldUpdateCacheLecteurVideo,
shouldUpdateCache24h,
limitConcurrency3,
axiosDarkinoRequest: axiosHelpers.axiosDarkinoRequest,
};
// --- Configure cpasmal ---
const cpasmalRouter = require("./routes/cpasmal");
cpasmalRouter.configure({
CPASMAL_BASE_URL,
TMDB_API_URL,
TMDB_API_KEY,
makeCpasmalRequest: require("./utils/proxyManager").makeCpasmalRequest,
getFromCacheNoExpiration,
shouldUpdateCache,
});
// --- Configure coflix (helper, not a router) ---
const coflix = require("./routes/coflix");
coflix.configure({
axiosCoflixRequest: axiosHelpers.axiosCoflixRequest,
axiosLecteurVideoRequest: axiosHelpers.axiosLecteurVideoRequest,
makeCoflixRequest: require("./utils/proxyManager").makeCoflixRequest,
coflixHeaders,
getFromCacheNoExpiration,
saveToCache,
formatCoflixError: axiosHelpers.formatCoflixError,
});
// --- Configure frenchstream (helper, not a router) ---
const frenchstream = require("./routes/frenchstream");
frenchstream.configure({
makeRequestWithCorsFallback,
axiosFrenchStreamRequest: axiosHelpers.axiosFrenchStreamRequest,
// findTvSeriesOnTMDB will be injected after tmdb is configured
});
// --- Configure animeSama ---
const animeSamaRouter = require("./routes/animeSama");
animeSamaRouter.configure({
ANIME_SAMA_URL,
axiosAnimeSama,
axiosAnimeSamaRequest: axiosHelpers.axiosAnimeSamaRequest,
getFromCacheNoExpiration,
saveToCache,
mergeStreamingLinks: axiosHelpers.mergeStreamingLinks,
cleanupOldCacheFiles: axiosHelpers.cleanupOldCacheFiles,
migrateOldCacheFiles: axiosHelpers.migrateOldCacheFiles,
limitConcurrency10,
});
// --- Configure tmdb ---
const tmdbRouter = require("./routes/tmdb");
tmdbRouter.configure({
TMDB_API_KEY,
TMDB_API_URL,
getFromCacheNoExpiration,
saveToCache,
shouldUpdateCacheFrenchStream,
shouldUpdateCacheLecteurVideo,
limitConcurrency3,
// Coflix helpers
searchCoflixByTitle: coflix.searchCoflixByTitle,
getMovieDataFromCoflix: coflix.getMovieDataFromCoflix,
getTvDataFromCoflix: coflix.getTvDataFromCoflix,
filterEmmmmbedReaders: coflix.filterEmmmmbedReaders,
// FrenchStream helpers
getFrenchStreamMovie: frenchstream.getFrenchStreamMovie,
getFrenchStreamSeries: frenchstream.getFrenchStreamSeries,
getFrenchStreamSeriesDetails: frenchstream.getFrenchStreamSeriesDetails,
extractSeriesInfo: frenchstream.extractSeriesInfo,
mergeSeriesParts: frenchstream.mergeSeriesParts,
cleanTvCacheData: frenchstream.cleanTvCacheData,
});
// Now inject findTvSeriesOnTMDB back into frenchstream (circular dep)
frenchstream.configure({
findTvSeriesOnTMDB: tmdbRouter.findTvSeriesOnTMDB,
});
// --- Configure search ---
const searchRouter = require("./routes/search");
searchRouter.configure({
DARKINO_MAINTENANCE,
DARKINOS_CACHE_DIR,
axiosDarkinoRequest: axiosHelpers.axiosDarkinoRequest,
getFromCacheNoExpiration,
saveToCache,
touchCacheEntry,
shouldUpdateCache,
});
// --- Configure download ---
const downloadRouter = require("./routes/download");
downloadRouter.configure({
DARKINO_MAINTENANCE,
DARKINOS_CACHE_DIR,
darkiHeaders,
darkiworld_premium: false,
axiosDarkinoRequest: axiosHelpers.axiosDarkinoRequest,
getFromCacheNoExpiration,
saveToCache,
shouldUpdateCache,
refreshDarkinoSessionIfNeeded,
});
// --- Configure darkiworld ---
const darkiworldRouter = require("./routes/darkiworld");
darkiworldRouter.configure({
DARKINO_MAINTENANCE,
DOWNLOAD_CACHE_DIR,
darkiHeaders,
axiosDarkinoRequest: axiosHelpers.axiosDarkinoRequest,
getFromCacheNoExpiration,
saveToCache,
shouldUpdateCache,
shouldUpdateCache24h,
shouldUpdateCache48h,
refreshDarkinoSessionIfNeeded,
redis,
});
// --- Configure voirdrama ---
const voirdramaRouter = require("./routes/voirdrama");
voirdramaRouter.configure({
TMDB_API_KEY,
TMDB_API_URL,
getFromCacheNoExpiration,
saveToCache,
shouldUpdateCache24h,
});
// --- Configure francetv ---
const francetvRouter = require("./routes/francetv");
francetvRouter.configure({
getFromCacheWithExpiration,
saveToCache,
});
const {
router: vipDonationsRouter,
ensureVipDonationsTables
} = require('./routes/vipDonations');
const { router: vipPayblisRouter } = require('./routes/vipPayblis');
const oauthRouter = require('./routes/oauth');
// ==========================================================================
// Mount all route modules
// ==========================================================================
// Pre-existing routes (already extracted before this modularization)
const sharedListsRouter = require("./sharedListsRoutes");
app.use("/api/comments", require("./commentsRoutes"));
app.use("/api/likes", require("./likesRoutes"));
app.use("/api/shared-lists", sharedListsRouter);
app.use("/api/livetv", require("./liveTvRoutes"));
// New modular routes
app.use('/api/cpasmal', cpasmalRouter);
app.use('/anime', animeSamaRouter);
app.use('/api', tmdbRouter);
app.use('/', searchRouter);
app.use('/api', downloadRouter);
app.use('/api/fstream', require('./routes/fstream'));
app.use('/api/wiflix', require('./routes/wiflix'));
app.use('/api/j1f', require('./routes/j1f'));
app.use('/api', require('./routes/sync'));
app.use('/api/profiles', require('./routes/profiles'));
app.use('/api/help', require('./routes/helpFeedback'));
app.use('/api/auth', require('./routes/authRoutes'));
app.use('/api/oauth', oauthRouter);
app.use('/api/admin/oauth-apps', require('./routes/adminOauthApps'));
app.use('/api/sessions', require('./routes/sessions'));
app.use('/api', require('./routes/debrid'));
app.use('/api', require('./routes/admin'));
app.use('/api', vipDonationsRouter);
app.use('/api', vipPayblisRouter);
app.use('/api/darkiworld', darkiworldRouter);
app.use('/api/drama', voirdramaRouter);
app.use('/api/ftv', francetvRouter);
const purstreamRouter = require('./routes/purstream');
purstreamRouter.configure({
TMDB_API_KEY,
TMDB_API_URL,
PROXY_SERVER_URL: process.env.PROXY_SERVER_URL,
verifyAccessKey: require("./checkVip").verifyAccessKey,
getFromCacheNoExpiration,
saveToCache,
shouldUpdateCache,
});
app.use("/api/purstream", purstreamRouter);
const downloadLinksLeaderboardRouter = require('./routes/downloadLinksLeaderboard');
app.use('/api/download-links', downloadLinksLeaderboardRouter);
// ==========================================================================
// MySQL pool initialization — pool unique via mysqlPool.js
// ==========================================================================
const {
initPool,
getPool,
SCHEMA_BOOTSTRAP_LOCK_NAME,
withMysqlAdvisoryLock
} = require('./mysqlPool');
const { ensureAccountLinksStorage } = require('./utils/accountLinks');
const { ensureCloneLinksStorage } = require('./utils/cloneLinks');
const { ensureOAuthStorage } = require('./utils/oauthStorage');
const appReady = (async () => {
try {
const pool = await initPool();
console.log("MySQL unified pool initialized successfully");
await withMysqlAdvisoryLock(pool, SCHEMA_BOOTSTRAP_LOCK_NAME, async () => {
console.log(
`[Bootstrap] Worker ${process.pid} acquired MySQL schema lock`,
);
// Créer la table user_sessions si elle n'existe pas
await pool.execute(`
CREATE TABLE IF NOT EXISTS user_sessions (
id VARCHAR(255) PRIMARY KEY,
user_id VARCHAR(255) NOT NULL,
user_type ENUM('oauth', 'bip39') NOT NULL,
user_agent TEXT,
created_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
accessed_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,
INDEX idx_user_sessions_user (user_id, user_type),
INDEX idx_user_sessions_accessed (accessed_at)
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci
`);
console.log("Table user_sessions initialized successfully");
await ensureAccountLinksStorage();
console.log("Table account_links initialized successfully");
await ensureCloneLinksStorage();
console.log("Table clone_links initialized successfully");
await ensureVipDonationsTables(pool);
console.log('VIP donations tables initialized successfully');
await ensureOAuthStorage(pool);
console.log('OAuth tables initialized successfully');
// OAuth client config (table oauth_clients + stats + grants VIP).
// ensureTables et migrateLegacyJsonIfNeeded sont protégés par le lock
// mais idempotents — sûr sur restart cluster. reloadCache hydrate
// le cache in-process de CE worker (chaque worker a le sien).
const oauthClientsDb = require('./utils/oauthClientsDb');
await oauthClientsDb.ensureTables();
await oauthClientsDb.migrateLegacyJsonIfNeeded();
await oauthClientsDb.reloadCache();
// Cluster mode: subscribe so this worker reloads when any other worker
// mutates an OAuth client (see oauthClientsDb cross-worker invalidation).
oauthClientsDb.startClientsCacheSubscriber();
console.log('OAuth client tables initialized successfully');
// Initialize Wishboard routes
const { createWishboardRouter } = require("./wishboardRoutes");
const wishboardRouter = createWishboardRouter(pool, redis);
app.use("/api/wishboard", wishboardRouter);
app.use("/api/admin/wishboard", wishboardRouter);
console.log("Wishboard routes initialized successfully");
// Initialize Link Submissions routes (user-submitted streaming links)
const {
createLinkSubmissionsRouter,
} = require("./linkSubmissionsRoutes");
const linkSubmissionsRouter = createLinkSubmissionsRouter(pool, redis);
app.use("/api/link-submissions", linkSubmissionsRouter);
// Create link_submissions table if not exists
await pool.execute(`
CREATE TABLE IF NOT EXISTS link_submissions (
id INT AUTO_INCREMENT PRIMARY KEY,
user_id VARCHAR(255) NOT NULL,
profile_id VARCHAR(255) NOT NULL,
tmdb_id INT NOT NULL,
media_type ENUM('movie', 'tv') NOT NULL,
season_number INT DEFAULT NULL,
episode_number INT DEFAULT NULL,
url VARCHAR(2048) NOT NULL,
source_name VARCHAR(100) DEFAULT NULL,
status ENUM('pending', 'approved', 'rejected') DEFAULT 'pending',
rejection_reason TEXT DEFAULT NULL,
reviewed_by VARCHAR(255) DEFAULT NULL,
reviewed_at DATETIME DEFAULT NULL,
created_at DATETIME DEFAULT CURRENT_TIMESTAMP,
updated_at DATETIME DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP,
INDEX idx_ls_status (status),
INDEX idx_ls_profile (profile_id),
INDEX idx_ls_tmdb (tmdb_id, media_type),
INDEX idx_ls_created (created_at)
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci
`);
console.log("Link Submissions routes initialized successfully");
// Download links schema (admin-managed downloads + history/leaderboard)
await pool.execute(`
CREATE TABLE IF NOT EXISTS download_links_history (
id BIGINT PRIMARY KEY AUTO_INCREMENT,
admin_id VARCHAR(255) NOT NULL,
admin_auth_type ENUM('oauth','bip-39') NOT NULL,
action ENUM('added','removed') NOT NULL,
media_type ENUM('movie','tv') NOT NULL,
tmdb_id BIGINT NOT NULL,
season INT NULL,
episode INT NULL,
link_url TEXT NOT NULL,
link_type ENUM('streaming','download') NOT NULL DEFAULT 'download',
changed_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP,
INDEX idx_dlh_admin (admin_id, admin_auth_type),
INDEX idx_dlh_changed (changed_at),
INDEX idx_dlh_action (action),
INDEX idx_dlh_link_type (link_type)
) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci
`);
// Ensure download_links JSON column on films and series (idempotent)
const ensureColumn = async (tableName, columnName, definitionSql) => {
const [rows] = await pool.execute(
`SELECT COLUMN_NAME FROM INFORMATION_SCHEMA.COLUMNS
WHERE TABLE_SCHEMA = DATABASE() AND TABLE_NAME = ? AND COLUMN_NAME = ? LIMIT 1`,
[tableName, columnName]
);
if (rows.length === 0) {
await pool.execute(`ALTER TABLE \`${tableName}\` ADD COLUMN ${definitionSql}`);
}
};
await ensureColumn('films', 'download_links', 'download_links JSON NULL');
await ensureColumn('series', 'download_links', 'download_links JSON NULL');
// Retro-migration: ensure link_type column exists on download_links_history (for installations that created the table before this column was added)
await ensureColumn('download_links_history', 'link_type', "link_type ENUM('streaming','download') NOT NULL DEFAULT 'download'");
console.log("Download links schema initialized successfully");
// Initialize Top 10 routes (public ranking)
const { router: top10Router, initTop10Routes } = require("./top10Routes");
initTop10Routes(pool, redis);
app.use("/api/top10", top10Router);
console.log("Top 10 routes initialized successfully");
// Initialize Wrapped routes (Movix Wrapped 2026 data collection)
const {
router: wrappedRouter,
initWrappedRoutes,
initTables: initWrappedTables,
} = require("./wrappedRoutes");
initWrappedRoutes(pool, redis);
await initWrappedTables();
app.use("/api/wrapped", wrappedRouter);
console.log("Wrapped routes initialized successfully");
});
} catch (error) {
console.error("MySQL connection error:", error.message);
throw error;
}
})();
// === Pool getter for other modules ===
function getAppPool() {
return getPool();
}
// Hydracker freeze (2026-05-15): the queue, worker lock, and rate-limit key
// from the old architecture are dead. Clear them once on boot so they don't
// linger or confuse ops dashboards.
(async () => {
try {
if (redis && typeof redis.del === 'function') {
await redis.del('hydracker:queue:pending',
'hydracker:worker_lock',
'hydracker:rate_limited_until');
console.log('[hydracker-freeze] cleared legacy redis keys');
}
} catch (e) {
console.warn('[hydracker-freeze] redis cleanup failed:', e?.message);
}
})();
// === Unified error handler ===
app.use((err, req, res, next) => {
if (err.message !== "Not allowed by CORS") {
console.error("Erreur globale:", err);
}
res.status(500).json({
error: "Erreur serveur interne",
message: err.message,
path: req.path,
});
});
module.exports = { app, appReady, getAppPool };