MovixOpenSource/API/Mainapi/routes/cpasmal.js
Movix 8657a856f8 feat: live TV FCTV, fournisseur OAuth, sources J1F/Cinestream, modération IA & durcissement
feat: live TV FCTV, fournisseur OAuth, sources J1F/Cinestream, modération IA & durcissement

Gros lot de travail synchronisé depuis le repo de dev. Les grands axes :
migration de domaine (movix.date + miroirs), deux nouvelles sources films/séries
(1jour1film, Cinestream) et une n ouvelle source livetv, un fournisseur OAuth « Se connecter avec Movix », une
modération de contenu par IA revue, plus un lot de durcissement mémoire/réseau,
sécurité et perf côté API et front.

## 🌐 Domaines & miroirs

- Domaine canonique `movix.chat`/`movix.golf`/`movix.tax` → **movix.date** partout
  (front, allow-lists CORS/domaine, Discord RPC). Miroir `movix.health` →
  **movix.online** (Footer, Header, pages d'aide CaMarchePlus/Dns/Miroirs). Lien
  Telegram du footer → `mysticsaba.com`. ~10 clés i18n mises à jour.

## 🎬 Sources de streaming (VOD)

- **J1F (1jour1film)** — nouvelle source de bout en bout (`routes/j1f.js`, monté sur
  `/api/j1f`). Résout le domaine tournant via une page `/go/`, décode les blobs base64
  `J1F_SRV`/`j1fEpsData` (Dooplay/WP), ne garde que les players uniques, ignore les
  agrégateurs (frembed/vidsrc/videasy). Cache stale-while-revalidate dédié. Players 1J1F
  lus via l'extension/userscript.
- **Cinestream** — nouvelle source films (`routes/cinestream.js`, scrape Next.js
  `cinestream.info`, match par id TMDB autoritaire). Wiflix bascule ses **films** sur
  Cinestream (bot-shield flemmix pénible sur les films) ; la **TV** reste sur flemmix.
- **Wiflix** — `flemmix.farm` → **`flemmix.golf`** ; handshake cookie
  (`makeWiflixSearchRequest`, `h_check=25`) ; sélecteurs de template corrigés.
- **Cpasmal** — axios+proxy → `makeCpasmalRequest` (CycleTLS JA3) car Cloudflare 403 ;
  recherche GET → POST form (le WAF bloque le GET).
- **Fstream** — cookie anti-bot `fsschal` ; source épisodes JS statique
  (`/static/series/<id>.js`) avant l'AJAX `episodes_p.php` ; fallback `get_seasons.php`.
- **FranceTV** — `fetchSeasonEpisodesViaDeepPage` (pagination JSON « Afficher plus »).
- **Coflix** — `coflix.date` → `coflix.trade` ; logs 429 silencés en double.
- **proxyManager** — cinq helpers de contournement Cloudflare exportés
  (`makeCinestreamRequest`, `make1j1fRequest`, `makeCpasmalRequest`, handshake Wiflix
  `makeWiflixSearchRequest`/`wiflixHandshake`, `classifyCloudflare429` worker-vs-site) ;
  CycleTLS + rotation ProxyScrape, ne throw jamais sur statut HTTP. Coflix/LecteurVideo
  quittent les Cloudflare Workers pour ProxyScrape.

## 📺 Live TV — remplacement de Sosplay/Vavoo par FCTV33

- Source sport **Sosplay → FCTV33** (API RBTV, protobuf brut) réécrite de bout en bout
  dans `liveTvRoutes.js`, **Vavoo retiré** (manifest/catalogue/stream) — tout passe par
  `/api/livetv/*`.
- Pipeline neuf : décodeur protobuf maison, signature `sfver` (bs keys + MD5),
  auto-découverte des domaines API/player tournants (`hubu.ru/fctvlink` + Nuxt SSR /
  `params` rot47, cache 30 min), scraper de matchs (`scrapeFctvMatches` :
  équipes/logos, ligue, pays, statut live, tri live-first), résolution de flux (HLS
  natif d'abord, embed en secours), token CDN (XOR keystream + base64, gate
  `rb-session`).
- Route `GET /api/livetv/fctv/playlist` : proxy m3u8 intelligent (résout le token,
  réécrit les segments, retry sur token périmé, modes `raw` extension / `proxy` VIP).
- **Matchs plus réservés aux VIP** (seul `iptv_` le reste) : flux natif proxifié pour
  les VIP, stub `_fctvLocal` résolu côté client par
  l'extension/userscript (`RESOLVE_FCTV`), fallback embed sinon.
- Front `LiveTV.tsx` : `matches` → `fctv`, UI accordéon par match (logos, badges
  ligue/pays, score/timer live, favori), disclaimer, fix icône `music`. Rotations
  d'hôtes : `witv.team`→`witv.football`, `livetv876.me`→`livetv901.me`.

## 🧩 Extensions · Userscript · Discord RPC

- **FCTV en lecture native** : handlers `SETUP_FCTV_HEADERS`/`RESOLVE_FCTV` (règle DNR
  Referer/Origin/UA sur `/cfall/s*` + résolveur local IP-bindé : protobuf-lite + rot47
  + token XOR).
- **Vavoo retiré** , `cinepulse.lol` → `purstream.mx`.
- Fix extracteur **Sibnet** (`Range: bytes=0-0`) ; fix bug userscript `matchToRegex`
  (patterns ancrés `^…$` cassant `/cfall/s` → dé-ancrés) ; override dev
  `localhost:25565`.
- Bumps de version (Chrome 1.3.3→1.3.8, Firefox 1.5.1→1.5.5, userscript 1.4.0→1.4.7) ;
  PreMid nouveau `clientId` Discord + `regExp` élargi (1.0.3→1.0.4).

## 🔑 OAuth (fournisseur « Se connecter avec Movix ») & codes d'accès

- Refonte du flux d'autorisation OAuth (`OAuthAuthorizePage.tsx`) + routes
  (`routes/authRoutes.js`, `routes/oauth.js`) et stockage des clients OAuth étoffé
  (`utils/oauthClientsDb.js`, `routes/adminOauthApps.js` pour la gestion admin des apps).
- `AccessCodeForm.tsx` retouché en cohérence avec le nouveau flux ; `checkVip.js` ajusté.
- Session centralisée : `accountAuth.ts` expose `clearStoredAuthSession()` /
  `broadcastAuthChange()` (liste `AUTH_KEYS` unifiée), désormais utilisés partout à la
  déconnexion.

## 💬 Modération de contenu (IA)

- Modèle OpenRouter `google/gemini-2.5-flash-lite` → `deepseek/deepseek-v4-flash`
  (`commentsRoutes.js`, `sharedListsRoutes.js`) ; fonctions/logs renommés
  `moderateContentWithGemini` → `moderateContentWithAI` (découplés du nom du modèle).
- Prompt durci (critères INSULTES / DEMANDE_AJOUT resserrés) pour éviter les faux
  positifs sur questions, signalements de bug et plaintes de contenu manquant.
- `AdminComments.tsx` : libellé « par Gemini » → clé i18n générique.

## 🧊 Hydracker / Darkiworld

- **Sortie du debrid** : AllDebrid/RealDebrid supprimés (`utils/hydrackerLive.js` :
  branche provider retirée ; vars `ALLDEBRID_*`/`REALDEBRID_*` sorties du `.env`) —
  hydracker renvoie directement `rawUrl`/`directDL`. Liens servis depuis les snapshots
  SQLite locaux (`utils/darkiworldSqlite.js`, `darkino-backups/`).
- **Anti-scraping** sur `/decode/:id` (`routes/darkiworld.js`) : watchlist + alerte
  webhook Discord (`DISCORD_SCRAPER_WEBHOOK`) et empoisonnement/blocage de réponse pour
  les IP listées (`SCRAPER_BLOCKED_IPS`).
- **Mémoire** : cache d'agents proxy borné (`utils/lruMap.js`) qui détruit les sockets
  des agents évincés.

## 🛠️ Admin — propriété des liens & équipe

- **Propriété des liens** : les liens streaming gagnent l'attribution `added_by` et
  l'ownership est appliquée des deux côtés (uploader = ses liens, admin = tous). GET
  public masqué (`stripLinkOwner`), `GET /admin/streaming-links/:type/:id` authentifié
  conserve le tag ; `DELETE /admin/links` par URL unique ; `PUT /admin/links` masse
  admin-only.
- **Équipe** : `GET/POST/DELETE /admin/admins` + `GET /admin/team/history` (audit),
  identité via `adminIdentity.js` (option `preferProfile` → premier profil Movix). UI
  `AdminTeam.tsx`.
- **Privilèges** (`middleware/auth.js`) : `isAdmin` rejette `role !== 'admin'` (403) —
  les uploaders ne passent plus les routes admin-only. Migration
  `add_role_to_admins.sql`.

## 🎁 Wrapped v2

- Cartes de partage : logique canvas extraite (`utils/wrappedCanvas.ts`,
  `utils/wrappedShareCards.ts`), formats de partage supplémentaires + preview.
- Nouvelles slides : jour record, répartition par jour de semaine, champion de rewatch,
  âge ciné (année de sortie médiane pondérée par le temps de visionnage).
- Perf : données depuis le payload backend (zéro re-fetch TMDB), trailer lazy,
  percentile non bloquant (réchauffe en arrière-plan, lock Redis `NX`), shuffle seedé.

## 🔐 Auth · Profils · VIP

- **Pseudo forcé** : `validateProfileName` (1–32 chars, strip control/zero-width, +
  `maxLength={32}` côté UI Profile/WatchParty) ; les pseudos OAuth trop longs →
  `requiresUsernameChange` + modale bloquante `RequireUsernameChange.tsx`.
- **Sync durci** (`ProfileContext.tsx`, `syncPolicy.js`) : anti-replay cross-user,
  filtrage des ops à clés non-syncables (`access_code`/`access_code_expires` exclues),
  « wipe guard » qui préserve le local sur profil vide inattendu, dédupe des
  `loadProfiles()` concurrents. Logout centralisé (voir OAuth).
- **VIP** : `is_vip` préservé au chargement de profil (corrige un downgrade VIP
  inter-onglets qui relançait la popup pub) ; `vipDonations.js` poll de secours
  `payment-status.php` (via `ipn_token`, colonne `paygate_ipn_token`) → plus d'invoices
  bloquées.

## ▶️ Lecteur (HLS)

- Basse latence opt-in : `isLowLatencyEnabled('movies')` (scope movies/livetv,
  `lowLatencyPref.ts`) au lieu du mode forcé ; `FloatingPlayer` aligné.
- Sous-titres cinep : wrapper m3u8 synthétique pour les URI `.vtt`/`.srt` directes,
  `isSubtitleLoadError` (une piste cassée ne tue plus la vidéo), rendu `<i>/<b>/<u>`.
- Menu sources regroupé par langue (VF/VFQ/VFF/VOSTFR).

## 📡 Cast (AirPlay / Chromecast)

- Retrait du contournement proxy darkibox (`buildApiProxyUrl`) → cast direct de l'URL ;
  `runtime.ts` supprime `API_PROXY_BASE_URL`/`buildApiProxyUrl` devenus morts.
- Paramètre `streamType` (`BUFFERED` par défaut) propagé jusqu'à
  `loadMediaOnCastWithFallback`.

## 📢 Pubs

- Modes de popup (`adPopupMode.ts`) : `normal`, `auto`, `click-anywhere` ; toggle « +18 »
  séparé (`adAdultMode.ts`). `SCRIPT_AD_MODE_ENABLED` → `false`, URL du script changée.

## 🔎 Recherche & priorité des sources

- `searchUtils.ts` : le terme original contourne le filtre « trop générique » (fix
  zéro-résultat sur titres courts : Baki, Gantz).
- `animeSignals.ts` : détection donghua (CN/TW/HK ou `zh` + Animation, hors C-drama).
- `sourceAutoSelect.ts` : `VFF`/`VFQ` normalisés en `vf` (sinon reléguées derrière
  VOSTFR). `sourcePriorityPrefs.ts` : schéma v2 → v3 (nouvel ordre par défaut + `j1f`,
  migration non destructive des ordres personnalisés). `extractionPrefs.ts` : +daddylive.

## 🔒 Sécurité

- Sanitisation d'URL avant rendu en `href` : `CommentsSection.tsx` (liens markdown
  `http(s)://`) et `Greenlight/AdminLinkSubmissions.tsx` — bloque les `javascript:`.

## ⚙️ Infra & perf

- **server.js** : recyclage périodique des workers (12h) + `[memstats]` + hook
  `SIGUSR2` → heap-snapshot.
- **app.js** : monte `/api/j1f`, retire la route statique `/oauth-icons`, passe
  `makeCpasmalRequest` au router Cpasmal, `coflix.date` → `coflix.trade`.
- **lazyWithRetry.ts / main.tsx / ErrorBoundary.tsx** : récupération chunk-load réécrite
  (retry + reload budgété), garde `removeChild/insertBefore`, écran soft « Mise à jour »
  au lieu du crash-report.
- **UI** : `TopProgressBar` écrit `transform` directement sur un ref (compositor-only,
  plus de re-render) ; `blur-text` relâche `will-change` après l'animation.
- **proxiesembed/server.py** : `curl_cffi` (JA3) pour `cinep-proxy` + retry SOCKS5 sur
  403 ; lookup clé VIP réaligné sur `checkVip.js` ; log WARNING par défaut ; SOCKS5
  forcé IPv4 ; wrapper VTT/SRT pour hls.js ; re-label `application/zip` → `video/mp2t` ;
  `cinepulse.lol` → `purstream.mx`.

## 🧹 Nettoyage & suppressions

- **Front** : carte promo « Loadix » sur Download (remplace l'encart beta),
  « 1jour1film » ajouté à « C'est quoi Movix », fallback Darkino/Nightflix gutté en
  no-op (`api.movix.chat` décommissionné), classes CSS mortes retirées, fix
  `fetchPriority` → `fetchpriority`.
- **Backend** : scrapers/utilitaires morts retirés — `routes/dragiv.js`,
  `routes/topstream.js`, `routes/proxy.js`, `utils/cloudflareSession.js`,
  `utils/hydrackerBatch.js`, `utils/hydrackerQueue.js'.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-05 18:22:13 +02:00

843 lines
30 KiB
JavaScript

/**
* Cpasmal route module.
* Extracted from server.js — handles Cpasmal search, link extraction, and caching.
*
* Mounted as: app.use('/api/cpasmal', require('./routes/cpasmal'));
* Route paths are relative to the mount point.
*/
const express = require('express');
const router = express.Router();
const cheerio = require('cheerio');
const fsp = require('fs').promises;
const path = require('path');
const axios = require('axios');
const { CACHE_DIR, generateCacheKey } = require('../utils/cacheManager');
const { memoryCache } = require('../config/redis');
const { fetchTmdbDetails } = require('../utils/tmdbCache');
// ---- Lazy-bound dependencies injected via configure() ----
let deps = {
CPASMAL_BASE_URL: '',
TMDB_API_URL: '',
TMDB_API_KEY: '',
makeCpasmalRequest: async () => { throw new Error('cpasmal not configured'); },
getFromCacheNoExpiration: async () => null,
shouldUpdateCache: async () => true
};
/**
* Toutes les requêtes Cpasmal passent par CycleTLS (JA3 Chrome) : Cloudflare
* bot-challenge les requêtes axios + proxies datacenter avec un 403 (GET comme
* POST). makeCpasmalRequest tourne un vrai JA3 Chrome sur le pool ProxyScrape.
* Adapte la config axios-style { method, url, data, headers } du routeur vers
* la signature de makeCpasmalRequest et renvoie un objet axios-like { data }.
*/
function _createScopedRequest() {
return (config) => deps.makeCpasmalRequest(config.url, {
method: config.method || 'get',
body: config.data || '',
headers: config.headers || {},
});
}
function configure(injected) {
Object.assign(deps, injected);
}
// ---- Helper: log 403 errors ----
function _log403(context, error) {
const status = error.response?.status;
if (status === 403) {
const proxy = error.cpasmalProxy || 'unknown';
const url = error.cpasmalUrl || error.config?.url || '';
console.log(`[Cpasmal] 403 Forbidden — ${context} | proxy=${proxy} | url=${url}`);
}
}
// ---- Helper functions ----
function hasEmptyLinks(data) {
if (!data || !data.links) return true;
return data.links.vf.length === 0 && data.links.vostfr.length === 0;
}
function sortCpasmalLinks(links) {
const priority = ['voe', 'uqload'];
return links.sort((a, b) => {
const indexA = priority.indexOf(a.server);
const indexB = priority.indexOf(b.server);
if (indexA !== -1 && indexB !== -1) return indexA - indexB;
if (indexA !== -1) return -1;
if (indexB !== -1) return 1;
return 0;
});
}
// Helper to get TMDB details (cached via Redis)
async function getTmdbDetails(tmdbId, type) {
return fetchTmdbDetails(deps.TMDB_API_URL, deps.TMDB_API_KEY, tmdbId, type, 'fr-FR');
}
// Scores search results from a single search query and returns { bestMatch, bestScore }
function _scoreCpasmalResults($, items, title, year, type, normalize) {
let bestMatch = null;
let bestScore = -1;
items.each((i, el) => {
const $el = $(el);
const link = $el.find('a.th-img').attr('href');
const titleText = $el.find('.th-desc .th-capt').text().trim();
const yearText = $el.find('.th-desc .th-year').text().trim();
const isSerie = $el.find('.th-Serie').length > 0;
const isMovie = $el.find('.th-Film').length > 0;
// Check type - strict filtering
if (type === 'movie' && !isMovie) return;
if (type === 'tv' && !isSerie) return;
const normTitle = normalize(title);
// Retirer l'annee entre parentheses du titre (deja capturee dans yearText)
const cleanedTitleText = titleText.replace(/\s*\(\d{4}\)\s*/g, '').trim();
const normTitleText = normalize(cleanedTitleText);
// Calculate match score
let score = 0;
let titleMatchQuality = 'none';
// Exact title match (highest priority) - 100 points
if (normTitleText === normTitle) {
score += 100;
titleMatchQuality = 'exact';
}
// Title starts with search term (good match)
else if (normTitleText.startsWith(normTitle + ' ')) {
const lengthRatio = normTitle.length / normTitleText.length;
if (lengthRatio >= 0.75) {
score += 50;
titleMatchQuality = 'strong';
} else if (lengthRatio >= 0.60) {
score += 25;
titleMatchQuality = 'moderate';
} else {
score += 5;
titleMatchQuality = 'weak';
}
}
// Title ends with search term
else if (normTitleText.endsWith(' ' + normTitle)) {
const lengthRatio = normTitle.length / normTitleText.length;
if (lengthRatio >= 0.75) {
score += 50;
titleMatchQuality = 'strong';
} else if (lengthRatio >= 0.60) {
score += 25;
titleMatchQuality = 'moderate';
} else {
score += 5;
titleMatchQuality = 'weak';
}
}
// Search term is contained but not at start/end
else if (normTitleText.includes(normTitle)) {
score += 5;
titleMatchQuality = 'weak';
}
// Search term contains the result title
else if (normTitle.includes(normTitleText)) {
score += 3;
titleMatchQuality = 'weak';
}
// No match at all - skip
else {
return;
}
// Year matching bonus points
if (year && yearText) {
const yearDiff = Math.abs(parseInt(yearText) - parseInt(year));
const isWeakTitle = (titleMatchQuality === 'weak');
if (yearDiff === 0) {
score += isWeakTitle ? 10 : 50;
} else if (yearDiff === 1) {
score += isWeakTitle ? 5 : 20;
} else if (yearDiff > 5) {
// Forte penalite: empecher un exact title match avec mauvaise annee de battre
// un match partiel avec bonne annee (ex: "Magnum" 1980 vs "Magnum, P.I." 2018)
score -= 100;
} else {
score -= 30;
}
}
if (score > bestScore && score > 0) {
bestScore = score;
bestMatch = link;
}
});
return { bestMatch, bestScore };
}
// Run a single cpasmal search query across multiple pages, return { bestMatch, bestScore }
async function _runCpasmalSearch(searchQuery, title, year, type, normalize, maxPages, requestFn) {
const doRequest = requestFn || _createScopedRequest();
let bestMatch = null;
let bestScore = -1;
let page = 1;
while (page <= maxPages) {
try {
// POST form (DLE classic): Cloudflare WAF 403s the GET ?do=search querystring, POST body passes.
const params = new URLSearchParams();
params.append('do', 'search');
params.append('subaction', 'search');
params.append('search_start', String(page));
params.append('full_search', '0');
params.append('story', searchQuery);
const response = await doRequest({
method: 'post',
url: `${deps.CPASMAL_BASE_URL}/index.php`,
data: params.toString(),
headers: {
'Content-Type': 'application/x-www-form-urlencoded',
'Origin': deps.CPASMAL_BASE_URL,
'Referer': `${deps.CPASMAL_BASE_URL}/`
}
});
const $ = cheerio.load(response.data);
const items = $('div.thumb');
if (items.length === 0) break;
const result = _scoreCpasmalResults($, items, title, year, type, normalize);
if (result.bestScore > bestScore) {
bestScore = result.bestScore;
bestMatch = result.bestMatch;
}
// Only stop early if we have title + year confirmed match
if (bestScore >= 140) break;
page++;
} catch (error) {
_log403('search', error);
break;
}
}
return { bestMatch, bestScore };
}
async function searchCpasmal(title, year, type, requestFn) {
const doRequest = requestFn || _createScopedRequest();
// Prepare search query: normalize spaces and keep colons
let searchQuery = title.replace(/\u00A0/g, ' ').replace(/\s+/g, ' ').trim();
// Normalize function for title comparison
const normalize = (str) => str.normalize('NFD').replace(/[\u0300-\u036f]/g, '').toLowerCase().replace(/[:\s\-.,!?'"()]+/g, ' ').replace(/\s+/g, ' ').trim();
// === Strategy 1: Search by title only (2 pages) ===
let { bestMatch, bestScore } = await _runCpasmalSearch(searchQuery, title, year, type, normalize, 2, doRequest);
// === Strategy 2: If no year-confirmed match, retry with "title year" ===
if (bestScore < 140 && year) {
const searchQueryWithYear = `${searchQuery} ${year}`;
const result2 = await _runCpasmalSearch(searchQueryWithYear, title, year, type, normalize, 1, doRequest);
if (result2.bestScore > bestScore) {
bestScore = result2.bestScore;
bestMatch = result2.bestMatch;
}
}
// === Strategy 3: If still no good match, try full_search=1 ===
if (bestScore < 20) {
try {
const params = new URLSearchParams();
params.append('do', 'search');
params.append('subaction', 'search');
params.append('search_start', '1');
params.append('full_search', '1');
params.append('story', searchQuery);
const response = await doRequest({
method: 'post',
url: `${deps.CPASMAL_BASE_URL}/index.php`,
data: params.toString(),
headers: {
'Content-Type': 'application/x-www-form-urlencoded',
'Origin': deps.CPASMAL_BASE_URL,
'Referer': `${deps.CPASMAL_BASE_URL}/`
}
});
const $ = cheerio.load(response.data);
const items = $('div.thumb');
if (items.length > 0) {
const result3 = _scoreCpasmalResults($, items, title, year, type, normalize);
if (result3.bestScore > bestScore) {
bestScore = result3.bestScore;
bestMatch = result3.bestMatch;
}
}
} catch (error) {
_log403('full_search', error);
}
}
return bestScore >= 20 ? bestMatch : null;
}
// Helper to extract links from a movie page
async function extractMovieLinks(url, requestFn) {
const doRequest = requestFn || _createScopedRequest();
if (process.env.DEBUG_CPASMAL) console.time(`[Cpasmal] ExtractMovieLinks ${url}`);
try {
const response = await doRequest({ method: 'get', url: url });
const $ = cheerio.load(response.data);
const links = { vf: [], vostfr: [] };
let cpasmalYear = null;
// Extraire l'annee de sortie depuis la page cpasmal
$('article ul li').each((i, el) => {
const $el = $(el);
const infoLabel = $el.find('span.info').text().trim().toLowerCase();
if (infoLabel.includes('date de sortie') || infoLabel.includes('ann\u00e9e') || infoLabel.includes('annee')) {
const infoValue = $el.find('span.infos').text().trim();
const yearMatch = infoValue.match(/(\d{4})/);
if (yearMatch) {
cpasmalYear = yearMatch[1];
}
}
});
// Si pas trouve, chercher avec d'autres selecteurs
if (!cpasmalYear) {
const infosList = $('div.content-info ul li, div.shortpost-info ul li, .fx-info ul li');
infosList.each((i, el) => {
const text = $(el).text().toLowerCase();
if (text.includes('date de sortie') || text.includes('ann\u00e9e') || text.includes('annee')) {
const yearMatch = text.match(/(\d{4})/);
if (yearMatch) {
cpasmalYear = yearMatch[1];
}
}
});
}
const linkElements = $('.liens-c .lien');
// Collect all tasks first
const tasks = [];
for (let i = 0; i < linkElements.length; i++) {
const el = linkElements[i];
const onclick = $(el).attr('onclick');
if (onclick && onclick.includes('getxfield')) {
const match = onclick.match(/getxfield\('([^']*)',\s*'([^']*)',\s*'([^']*)'\)/);
if (match) {
const [_, id, xfield, token] = match;
const isVostfr = xfield.includes('vostfr');
const isVf = xfield.includes('vf');
const ajaxUrl = `${deps.CPASMAL_BASE_URL}/engine/ajax/getxfield.php?id=${id}&xfield=${xfield}&token=${token}`;
tasks.push({ ajaxUrl, xfield, isVostfr, isVf });
}
}
}
// Execute requests sequentially
for (const task of tasks) {
try {
const ajaxResponse = await doRequest({ method: 'get', url: task.ajaxUrl });
const iframeMatch = ajaxResponse.data.match(/src="([^"]+)"/);
if (iframeMatch) {
const linkData = { server: task.xfield.split('_')[0], url: iframeMatch[1] };
if (task.isVostfr) links.vostfr.push(linkData);
if (task.isVf) links.vf.push(linkData);
}
} catch (err) {
_log403('getxfield', err);
}
}
links.vf = sortCpasmalLinks(links.vf);
links.vostfr = sortCpasmalLinks(links.vostfr);
if (process.env.DEBUG_CPASMAL) {
console.timeEnd(`[Cpasmal] ExtractMovieLinks ${url}`);
console.log(`[Cpasmal] Found ${links.vf.length} VF and ${links.vostfr.length} VOSTFR links`);
}
return { links, cpasmalYear };
} catch (error) {
_log403('extractMovieLinks', error);
return { links: { vf: [], vostfr: [] }, cpasmalYear: null };
}
}
// Helper to extract links from a series episode
async function extractSeriesLinks(seriesUrl, seasonNumber, episodeNumber, requestFn) {
const doRequest = requestFn || _createScopedRequest();
if (process.env.DEBUG_CPASMAL) console.time(`[Cpasmal] ExtractSeriesLinks ${seriesUrl}`);
try {
const response = await doRequest({ method: 'get', url: seriesUrl });
let $ = cheerio.load(response.data);
// Find season link
let seasonUrl = null;
$('.th-seas').each((i, el) => {
const text = $(el).find('.th-count').text().trim();
if (text.toLowerCase().includes(`saison ${seasonNumber}`)) {
seasonUrl = $(el).closest('a').attr('href');
}
});
if (!seasonUrl) {
return { vf: [], vostfr: [] };
}
// Construct episode URL
const episodeUrl = `${seasonUrl.replace('.html', '')}/${episodeNumber}-episode.html`;
// Fetch episode page
const epResponse = await doRequest({ method: 'get', url: episodeUrl });
$ = cheerio.load(epResponse.data);
const links = { vf: [], vostfr: [] };
const linkElements = $('.liens-c .lien');
// Collect all tasks first
const tasks = [];
for (let i = 0; i < linkElements.length; i++) {
const el = linkElements[i];
const onclick = $(el).attr('onclick');
if (onclick && onclick.includes('playEpisode')) {
const match = onclick.match(/playEpisode\(this,\s*'([^']*)',\s*'([^']*)'\)/);
if (match) {
const [_, id, xfield] = match;
const isVostfr = xfield.includes('vostfr');
const isVf = xfield.includes('vf');
const ajaxUrl = `${deps.CPASMAL_BASE_URL}/engine/inc/serial/app/ajax/Season.php`;
const params = new URLSearchParams();
params.append('id', id);
params.append('xfield', xfield);
params.append('action', 'playEpisode');
tasks.push({ ajaxUrl, data: params.toString(), xfield, isVostfr, isVf });
}
}
}
// Execute requests sequentially
for (const task of tasks) {
try {
const ajaxResponse = await doRequest({
method: 'post',
url: task.ajaxUrl,
data: task.data,
headers: {
'Content-Type': 'application/x-www-form-urlencoded',
'X-Requested-With': 'XMLHttpRequest'
}
});
const iframeMatch = ajaxResponse.data.match(/src="([^"]+)"/);
if (iframeMatch) {
const linkData = { server: task.xfield.split('_')[0], url: iframeMatch[1] };
if (task.isVostfr) links.vostfr.push(linkData);
if (task.isVf) links.vf.push(linkData);
}
} catch (err) {
_log403('playEpisode', err);
}
}
links.vf = sortCpasmalLinks(links.vf);
links.vostfr = sortCpasmalLinks(links.vostfr);
if (process.env.DEBUG_CPASMAL) {
console.timeEnd(`[Cpasmal] ExtractSeriesLinks ${seriesUrl}`);
console.log(`[Cpasmal] Found ${links.vf.length} VF and ${links.vostfr.length} VOSTFR links`);
}
return links;
} catch (error) {
_log403('extractSeriesLinks', error);
return { vf: [], vostfr: [] };
}
}
// === DATA FETCHING FUNCTIONS ===
async function fetchCpasmalMovieData(tmdbId, throwOnError = true) {
const requestFn = _createScopedRequest();
const tmdbData = await getTmdbDetails(tmdbId, 'movie');
if (!tmdbData) {
if (throwOnError) throw new Error('Movie not found on TMDB');
return null;
}
const title = tmdbData.title;
const tmdbYear = tmdbData.release_date ? tmdbData.release_date.split('-')[0] : null;
const cpasmalUrl = await searchCpasmal(title, tmdbYear, 'movie', requestFn);
if (!cpasmalUrl) {
if (throwOnError) throw new Error('Movie not found on Cpasmal');
return null;
}
let { links, cpasmalYear } = await extractMovieLinks(cpasmalUrl, requestFn);
let finalCpasmalUrl = cpasmalUrl;
// Validation post-match: reject if year mismatch, retry with explicit year search
if (cpasmalYear && tmdbYear && cpasmalYear !== tmdbYear) {
// Retry: search specifically with "title year"
const normalize = (str) => str.normalize('NFD').replace(/[\u0300-\u036f]/g, '').toLowerCase().replace(/[:\s\-.,!?'"()]+/g, ' ').replace(/\s+/g, ' ').trim();
const searchQueryWithYear = `${title.replace(/\u00A0/g, ' ').replace(/\s+/g, ' ').trim()} ${tmdbYear}`;
const retryResult = await _runCpasmalSearch(searchQueryWithYear, title, tmdbYear, 'movie', normalize, 2, requestFn);
if (retryResult.bestMatch && retryResult.bestMatch !== cpasmalUrl) {
const retryExtract = await extractMovieLinks(retryResult.bestMatch, requestFn);
// Accept if year matches or if year is not available on the page
if (!retryExtract.cpasmalYear || retryExtract.cpasmalYear === tmdbYear) {
links = retryExtract.links;
cpasmalYear = retryExtract.cpasmalYear;
finalCpasmalUrl = retryResult.bestMatch;
} else {
if (throwOnError) throw new Error('Movie not found on Cpasmal (year mismatch)');
return null;
}
} else {
if (throwOnError) throw new Error('Movie not found on Cpasmal (year mismatch)');
return null;
}
}
const year = cpasmalYear || tmdbYear;
return { title, year, cpasmalUrl: finalCpasmalUrl, links };
}
async function fetchCpasmalTvData(tmdbId, season, episode, throwOnError = true) {
const requestFn = _createScopedRequest();
const tmdbData = await getTmdbDetails(tmdbId, 'tv');
if (!tmdbData) {
if (throwOnError) throw new Error('TV Show not found on TMDB');
return null;
}
const title = tmdbData.name;
const year = tmdbData.first_air_date ? tmdbData.first_air_date.split('-')[0] : null;
const cpasmalUrl = await searchCpasmal(title, year, 'tv', requestFn);
if (!cpasmalUrl) {
if (throwOnError) throw new Error('TV Show not found on Cpasmal');
return null;
}
// Validation post-match: verifier l'annee sur la page de la serie
if (year) {
try {
const pageResponse = await requestFn({ method: 'get', url: cpasmalUrl });
const $page = cheerio.load(pageResponse.data);
let cpasmalYear = null;
$page('article ul li').each((i, el) => {
const $el = $page(el);
const infoLabel = $el.find('span.info').text().trim().toLowerCase();
if (infoLabel.includes('date de sortie') || infoLabel.includes('ann\u00e9e') || infoLabel.includes('annee')) {
const infoValue = $el.find('span.infos').text().trim();
const yearMatch = infoValue.match(/(\d{4})/);
if (yearMatch) cpasmalYear = yearMatch[1];
}
});
if (!cpasmalYear) {
const infosList = $page('div.content-info ul li, div.shortpost-info ul li, .fx-info ul li');
infosList.each((i, el) => {
const text = $page(el).text().toLowerCase();
if (text.includes('date de sortie') || text.includes('ann\u00e9e') || text.includes('annee')) {
const ym = text.match(/(\d{4})/);
if (ym) cpasmalYear = ym[1];
}
});
}
if (cpasmalYear && cpasmalYear !== year) {
console.log(`[CPASMAL TV] Annee non correspondante: TMDB=${year}, Cpasmal=${cpasmalYear} pour "${title}" (${cpasmalUrl})`);
// Retry avec "title year"
const normalize = (str) => str.normalize('NFD').replace(/[\u0300-\u036f]/g, '').toLowerCase().replace(/[:\s\-.,!?'"()]+/g, ' ').replace(/\s+/g, ' ').trim();
const searchQueryWithYear = `${title.replace(/\u00A0/g, ' ').replace(/\s+/g, ' ').trim()} ${year}`;
const retryResult = await _runCpasmalSearch(searchQueryWithYear, title, year, 'tv', normalize, 2, requestFn);
if (retryResult.bestMatch && retryResult.bestMatch !== cpasmalUrl) {
const links = await extractSeriesLinks(retryResult.bestMatch, season, episode, requestFn);
return { title, year, cpasmalUrl: retryResult.bestMatch, links };
} else {
if (throwOnError) throw new Error('TV Show not found on Cpasmal (year mismatch)');
return null;
}
}
} catch (error) {
if (error.message && error.message.includes('year mismatch')) throw error;
// Erreur de validation non bloquante — continuer normalement
console.log(`[CPASMAL TV] Erreur lors de la validation d'annee: ${error.message}`);
}
}
const links = await extractSeriesLinks(cpasmalUrl, season, episode, requestFn);
return { title, year, cpasmalUrl, links };
}
// === CPASMAL REQUEST DEDUPLICATION ===
const ongoingCpasmalRequests = new Map();
const CPASMAL_REQUEST_TIMEOUT = 15000;
const CPASMAL_STALE_CLEANUP_MS = 10 * 60 * 1000;
const getOrCreateCpasmalRequest = async (cacheKey, requestFunction) => {
if (ongoingCpasmalRequests.has(cacheKey)) {
const existing = ongoingCpasmalRequests.get(cacheKey);
let dedupTimer;
return Promise.race([
existing.promise.finally(() => clearTimeout(dedupTimer)),
new Promise((_, reject) => { dedupTimer = setTimeout(() => reject(new Error('Cpasmal dedup timeout')), CPASMAL_REQUEST_TIMEOUT); })
]);
}
const requestPromise = (async () => {
let timeoutTimer;
try {
const result = await Promise.race([
requestFunction().finally(() => clearTimeout(timeoutTimer)),
new Promise((_, reject) => {
timeoutTimer = setTimeout(() => {
ongoingCpasmalRequests.delete(cacheKey);
reject(new Error('Cpasmal request timeout'));
}, CPASMAL_REQUEST_TIMEOUT);
})
]);
return result;
} finally {
clearTimeout(timeoutTimer);
ongoingCpasmalRequests.delete(cacheKey);
}
})();
ongoingCpasmalRequests.set(cacheKey, { promise: requestPromise, createdAt: Date.now() });
return requestPromise;
};
// Nettoyage périodique des requêtes Cpasmal bloquées
setInterval(() => {
const now = Date.now();
let cleaned = 0;
for (const [key, entry] of ongoingCpasmalRequests) {
if (entry.createdAt && (now - entry.createdAt > CPASMAL_STALE_CLEANUP_MS)) {
ongoingCpasmalRequests.delete(key);
cleaned++;
}
}
if (cleaned > 0) console.log(`[CPASMAL DEDUP] Nettoyage: ${cleaned} requêtes expirées supprimées`);
}, 5 * 60 * 1000).unref();
// === BACKGROUND UPDATE ===
const updateCpasmalCache = async (cacheKey, type, ...args) => {
try {
const shouldUpdate = await deps.shouldUpdateCache(CACHE_DIR.CPASMAL, cacheKey);
if (!shouldUpdate) {
return;
}
// background update
const existingCache = await deps.getFromCacheNoExpiration(CACHE_DIR.CPASMAL, cacheKey);
let newData;
if (type === 'movie') {
newData = await fetchCpasmalMovieData(args[0], false);
} else if (type === 'tv') {
newData = await fetchCpasmalTvData(args[0], args[1], args[2], false);
}
if (newData) {
await fsp.writeFile(path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`), JSON.stringify(newData), 'utf-8');
const memKey = `${CACHE_DIR.CPASMAL}:${cacheKey}`;
await memoryCache.set(memKey, newData);
// Si les liens sont vides, antidater le fichier pour forcer un re-fetch au prochain appel
if (hasEmptyLinks(newData)) {
const cacheFilePath = path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`);
try {
const oldTime = new Date(Date.now() - 30 * 60 * 1000);
await fsp.utimes(cacheFilePath, oldTime, oldTime);
} catch (e) { /* ignore */ }
}
} else if (existingCache && !existingCache.notFound) {
// On a déjà un cache valide — ne PAS le remplacer par notFound (erreur 403, timeout, etc.)
// On touche juste le fichier pour repousser le prochain check
const cacheFilePath = path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`);
try {
const now = new Date();
await fsp.utimes(cacheFilePath, now, now);
} catch (e) { /* ignore */ }
} else {
// Pas de cache existant ou cache déjà notFound → on met à jour le notFound
const notFoundData = { notFound: true, timestamp: Date.now() };
await fsp.writeFile(path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`), JSON.stringify(notFoundData), 'utf-8');
const memKey = `${CACHE_DIR.CPASMAL}:${cacheKey}`;
await memoryCache.set(memKey, notFoundData);
}
} catch (error) {
// silent
}
};
// ---- Routes ----
router.get('/movie/:tmdbid', async (req, res) => {
const { tmdbid } = req.params;
const cacheKey = generateCacheKey(`movie_${tmdbid}`);
if (process.env.DEBUG_CPASMAL) {
const used = process.memoryUsage().heapUsed / 1024 / 1024;
console.log(`[Cpasmal API] Start /movie/${tmdbid} - Memory: ${Math.round(used * 100) / 100} MB`);
console.time(`[Cpasmal API] Total /movie/${tmdbid}`);
}
try {
// 1. Try cache
const cachedData = await deps.getFromCacheNoExpiration(CACHE_DIR.CPASMAL, cacheKey);
if (cachedData) {
const cacheFilePath = path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`);
if (cachedData.notFound) {
res.status(404).json({ error: 'Movie not found on Cpasmal (Cached)' });
} else {
// Calculer la prochaine mise à jour
let prochaineMiseAJour = null;
try {
const stats = await fsp.stat(cacheFilePath);
const nextUpdateTime = stats.mtime.getTime() + 40 * 60 * 1000;
if (nextUpdateTime <= Date.now()) {
prochaineMiseAJour = 'immédiate';
} else {
prochaineMiseAJour = new Date(nextUpdateTime).toISOString();
}
} catch (e) { /* ignore */ }
res.json({ ...cachedData, prochaineMiseAJour });
}
// Background update if old OR if links are empty
try {
const stats = await fsp.stat(cacheFilePath);
const age = Date.now() - stats.mtime.getTime();
if (age > 20 * 60 * 1000 || hasEmptyLinks(cachedData)) {
updateCpasmalCache(cacheKey, 'movie', tmdbid);
}
} catch (e) { /* ignore */ }
return;
}
// 2. Fetch fresh with deduplication
const data = await getOrCreateCpasmalRequest(cacheKey, () => fetchCpasmalMovieData(tmdbid, false));
if (!data) {
const notFoundData = { notFound: true, tmdbId: tmdbid, timestamp: Date.now() };
await fsp.writeFile(path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`), JSON.stringify(notFoundData), 'utf-8');
return res.status(404).json({ error: 'Movie not found on Cpasmal' });
}
await fsp.writeFile(path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`), JSON.stringify(data), 'utf-8');
await memoryCache.set(`${CACHE_DIR.CPASMAL}:${cacheKey}`, data);
const prochaineMiseAJour = new Date(Date.now() + 40 * 60 * 1000).toISOString();
res.json({ ...data, prochaineMiseAJour });
if (process.env.DEBUG_CPASMAL) console.timeEnd(`[Cpasmal API] Total /movie/${tmdbid}`);
} catch (error) {
if (error.message && error.message.includes('not found')) {
return res.status(404).json({ error: error.message });
}
res.status(500).json({ error: 'Internal Server Error' });
}
});
// Route pour supprimer le cache d'un film cpasmal
router.get('/movie/:tmdbid/clear-cache', async (req, res) => {
const { tmdbid } = req.params;
const cacheKey = generateCacheKey(`movie_${tmdbid}`);
const cacheFilePath = path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`);
try {
await fsp.unlink(cacheFilePath);
res.json({ success: true, message: `Cache cleared for movie ${tmdbid}` });
} catch (error) {
if (error.code === 'ENOENT') {
res.status(404).json({ error: `No cache found for movie ${tmdbid}` });
} else {
res.status(500).json({ error: 'Failed to clear cache' });
}
}
});
router.get('/tv/:tmdbid/:season/:episode', async (req, res) => {
const { tmdbid, season, episode } = req.params;
const cacheKey = generateCacheKey(`tv_${tmdbid}_s${season}_e${episode}`);
try {
// 1. Try cache
const cachedData = await deps.getFromCacheNoExpiration(CACHE_DIR.CPASMAL, cacheKey);
if (cachedData) {
const cacheFilePath = path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`);
if (cachedData.notFound) {
res.status(404).json({ error: 'TV Show not found on Cpasmal (Cached)' });
} else {
// Calculer la prochaine mise à jour
let prochaineMiseAJour = null;
try {
const stats = await fsp.stat(cacheFilePath);
const nextUpdateTime = stats.mtime.getTime() + 40 * 60 * 1000;
if (nextUpdateTime <= Date.now()) {
prochaineMiseAJour = 'immédiate';
} else {
prochaineMiseAJour = new Date(nextUpdateTime).toISOString();
}
} catch (e) { /* ignore */ }
res.json({ ...cachedData, prochaineMiseAJour });
}
// Background update if old OR if links are empty
try {
const stats = await fsp.stat(cacheFilePath);
const age = Date.now() - stats.mtime.getTime();
if (age > 20 * 60 * 1000 || hasEmptyLinks(cachedData)) {
updateCpasmalCache(cacheKey, 'tv', tmdbid, season, episode);
}
} catch (e) { /* ignore */ }
return;
}
// 2. Fetch fresh with deduplication
const data = await getOrCreateCpasmalRequest(cacheKey, () => fetchCpasmalTvData(tmdbid, season, episode, false));
if (!data) {
const notFoundData = { notFound: true, tmdbId: tmdbid, season, episode, timestamp: Date.now() };
await fsp.writeFile(path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`), JSON.stringify(notFoundData), 'utf-8');
return res.status(404).json({ error: 'TV Show not found on Cpasmal' });
}
await fsp.writeFile(path.join(CACHE_DIR.CPASMAL, `${cacheKey}.json`), JSON.stringify(data), 'utf-8');
await memoryCache.set(`${CACHE_DIR.CPASMAL}:${cacheKey}`, data);
const prochaineMiseAJour = new Date(Date.now() + 40 * 60 * 1000).toISOString();
res.json({ ...data, prochaineMiseAJour });
} catch (error) {
if (error.message && error.message.includes('not found')) {
return res.status(404).json({ error: error.message });
}
res.status(500).json({ error: 'Internal Server Error' });
}
});
module.exports = router;
module.exports.configure = configure;