mirror of
https://github.com/movixcorp/MovixOpenSource.git
synced 2026-07-27 13:22:14 +00:00
feat: live TV FCTV, fournisseur OAuth, sources J1F/Cinestream, modération IA & durcissement Gros lot de travail synchronisé depuis le repo de dev. Les grands axes : migration de domaine (movix.date + miroirs), deux nouvelles sources films/séries (1jour1film, Cinestream) et une n ouvelle source livetv, un fournisseur OAuth « Se connecter avec Movix », une modération de contenu par IA revue, plus un lot de durcissement mémoire/réseau, sécurité et perf côté API et front. ## 🌐 Domaines & miroirs - Domaine canonique `movix.chat`/`movix.golf`/`movix.tax` → **movix.date** partout (front, allow-lists CORS/domaine, Discord RPC). Miroir `movix.health` → **movix.online** (Footer, Header, pages d'aide CaMarchePlus/Dns/Miroirs). Lien Telegram du footer → `mysticsaba.com`. ~10 clés i18n mises à jour. ## 🎬 Sources de streaming (VOD) - **J1F (1jour1film)** — nouvelle source de bout en bout (`routes/j1f.js`, monté sur `/api/j1f`). Résout le domaine tournant via une page `/go/`, décode les blobs base64 `J1F_SRV`/`j1fEpsData` (Dooplay/WP), ne garde que les players uniques, ignore les agrégateurs (frembed/vidsrc/videasy). Cache stale-while-revalidate dédié. Players 1J1F lus via l'extension/userscript. - **Cinestream** — nouvelle source films (`routes/cinestream.js`, scrape Next.js `cinestream.info`, match par id TMDB autoritaire). Wiflix bascule ses **films** sur Cinestream (bot-shield flemmix pénible sur les films) ; la **TV** reste sur flemmix. - **Wiflix** — `flemmix.farm` → **`flemmix.golf`** ; handshake cookie (`makeWiflixSearchRequest`, `h_check=25`) ; sélecteurs de template corrigés. - **Cpasmal** — axios+proxy → `makeCpasmalRequest` (CycleTLS JA3) car Cloudflare 403 ; recherche GET → POST form (le WAF bloque le GET). - **Fstream** — cookie anti-bot `fsschal` ; source épisodes JS statique (`/static/series/<id>.js`) avant l'AJAX `episodes_p.php` ; fallback `get_seasons.php`. - **FranceTV** — `fetchSeasonEpisodesViaDeepPage` (pagination JSON « Afficher plus »). - **Coflix** — `coflix.date` → `coflix.trade` ; logs 429 silencés en double. - **proxyManager** — cinq helpers de contournement Cloudflare exportés (`makeCinestreamRequest`, `make1j1fRequest`, `makeCpasmalRequest`, handshake Wiflix `makeWiflixSearchRequest`/`wiflixHandshake`, `classifyCloudflare429` worker-vs-site) ; CycleTLS + rotation ProxyScrape, ne throw jamais sur statut HTTP. Coflix/LecteurVideo quittent les Cloudflare Workers pour ProxyScrape. ## 📺 Live TV — remplacement de Sosplay/Vavoo par FCTV33 - Source sport **Sosplay → FCTV33** (API RBTV, protobuf brut) réécrite de bout en bout dans `liveTvRoutes.js`, **Vavoo retiré** (manifest/catalogue/stream) — tout passe par `/api/livetv/*`. - Pipeline neuf : décodeur protobuf maison, signature `sfver` (bs keys + MD5), auto-découverte des domaines API/player tournants (`hubu.ru/fctvlink` + Nuxt SSR / `params` rot47, cache 30 min), scraper de matchs (`scrapeFctvMatches` : équipes/logos, ligue, pays, statut live, tri live-first), résolution de flux (HLS natif d'abord, embed en secours), token CDN (XOR keystream + base64, gate `rb-session`). - Route `GET /api/livetv/fctv/playlist` : proxy m3u8 intelligent (résout le token, réécrit les segments, retry sur token périmé, modes `raw` extension / `proxy` VIP). - **Matchs plus réservés aux VIP** (seul `iptv_` le reste) : flux natif proxifié pour les VIP, stub `_fctvLocal` résolu côté client par l'extension/userscript (`RESOLVE_FCTV`), fallback embed sinon. - Front `LiveTV.tsx` : `matches` → `fctv`, UI accordéon par match (logos, badges ligue/pays, score/timer live, favori), disclaimer, fix icône `music`. Rotations d'hôtes : `witv.team`→`witv.football`, `livetv876.me`→`livetv901.me`. ## 🧩 Extensions · Userscript · Discord RPC - **FCTV en lecture native** : handlers `SETUP_FCTV_HEADERS`/`RESOLVE_FCTV` (règle DNR Referer/Origin/UA sur `/cfall/s*` + résolveur local IP-bindé : protobuf-lite + rot47 + token XOR). - **Vavoo retiré** , `cinepulse.lol` → `purstream.mx`. - Fix extracteur **Sibnet** (`Range: bytes=0-0`) ; fix bug userscript `matchToRegex` (patterns ancrés `^…$` cassant `/cfall/s` → dé-ancrés) ; override dev `localhost:25565`. - Bumps de version (Chrome 1.3.3→1.3.8, Firefox 1.5.1→1.5.5, userscript 1.4.0→1.4.7) ; PreMid nouveau `clientId` Discord + `regExp` élargi (1.0.3→1.0.4). ## 🔑 OAuth (fournisseur « Se connecter avec Movix ») & codes d'accès - Refonte du flux d'autorisation OAuth (`OAuthAuthorizePage.tsx`) + routes (`routes/authRoutes.js`, `routes/oauth.js`) et stockage des clients OAuth étoffé (`utils/oauthClientsDb.js`, `routes/adminOauthApps.js` pour la gestion admin des apps). - `AccessCodeForm.tsx` retouché en cohérence avec le nouveau flux ; `checkVip.js` ajusté. - Session centralisée : `accountAuth.ts` expose `clearStoredAuthSession()` / `broadcastAuthChange()` (liste `AUTH_KEYS` unifiée), désormais utilisés partout à la déconnexion. ## 💬 Modération de contenu (IA) - Modèle OpenRouter `google/gemini-2.5-flash-lite` → `deepseek/deepseek-v4-flash` (`commentsRoutes.js`, `sharedListsRoutes.js`) ; fonctions/logs renommés `moderateContentWithGemini` → `moderateContentWithAI` (découplés du nom du modèle). - Prompt durci (critères INSULTES / DEMANDE_AJOUT resserrés) pour éviter les faux positifs sur questions, signalements de bug et plaintes de contenu manquant. - `AdminComments.tsx` : libellé « par Gemini » → clé i18n générique. ## 🧊 Hydracker / Darkiworld - **Sortie du debrid** : AllDebrid/RealDebrid supprimés (`utils/hydrackerLive.js` : branche provider retirée ; vars `ALLDEBRID_*`/`REALDEBRID_*` sorties du `.env`) — hydracker renvoie directement `rawUrl`/`directDL`. Liens servis depuis les snapshots SQLite locaux (`utils/darkiworldSqlite.js`, `darkino-backups/`). - **Anti-scraping** sur `/decode/:id` (`routes/darkiworld.js`) : watchlist + alerte webhook Discord (`DISCORD_SCRAPER_WEBHOOK`) et empoisonnement/blocage de réponse pour les IP listées (`SCRAPER_BLOCKED_IPS`). - **Mémoire** : cache d'agents proxy borné (`utils/lruMap.js`) qui détruit les sockets des agents évincés. ## 🛠️ Admin — propriété des liens & équipe - **Propriété des liens** : les liens streaming gagnent l'attribution `added_by` et l'ownership est appliquée des deux côtés (uploader = ses liens, admin = tous). GET public masqué (`stripLinkOwner`), `GET /admin/streaming-links/:type/:id` authentifié conserve le tag ; `DELETE /admin/links` par URL unique ; `PUT /admin/links` masse admin-only. - **Équipe** : `GET/POST/DELETE /admin/admins` + `GET /admin/team/history` (audit), identité via `adminIdentity.js` (option `preferProfile` → premier profil Movix). UI `AdminTeam.tsx`. - **Privilèges** (`middleware/auth.js`) : `isAdmin` rejette `role !== 'admin'` (403) — les uploaders ne passent plus les routes admin-only. Migration `add_role_to_admins.sql`. ## 🎁 Wrapped v2 - Cartes de partage : logique canvas extraite (`utils/wrappedCanvas.ts`, `utils/wrappedShareCards.ts`), formats de partage supplémentaires + preview. - Nouvelles slides : jour record, répartition par jour de semaine, champion de rewatch, âge ciné (année de sortie médiane pondérée par le temps de visionnage). - Perf : données depuis le payload backend (zéro re-fetch TMDB), trailer lazy, percentile non bloquant (réchauffe en arrière-plan, lock Redis `NX`), shuffle seedé. ## 🔐 Auth · Profils · VIP - **Pseudo forcé** : `validateProfileName` (1–32 chars, strip control/zero-width, + `maxLength={32}` côté UI Profile/WatchParty) ; les pseudos OAuth trop longs → `requiresUsernameChange` + modale bloquante `RequireUsernameChange.tsx`. - **Sync durci** (`ProfileContext.tsx`, `syncPolicy.js`) : anti-replay cross-user, filtrage des ops à clés non-syncables (`access_code`/`access_code_expires` exclues), « wipe guard » qui préserve le local sur profil vide inattendu, dédupe des `loadProfiles()` concurrents. Logout centralisé (voir OAuth). - **VIP** : `is_vip` préservé au chargement de profil (corrige un downgrade VIP inter-onglets qui relançait la popup pub) ; `vipDonations.js` poll de secours `payment-status.php` (via `ipn_token`, colonne `paygate_ipn_token`) → plus d'invoices bloquées. ## ▶️ Lecteur (HLS) - Basse latence opt-in : `isLowLatencyEnabled('movies')` (scope movies/livetv, `lowLatencyPref.ts`) au lieu du mode forcé ; `FloatingPlayer` aligné. - Sous-titres cinep : wrapper m3u8 synthétique pour les URI `.vtt`/`.srt` directes, `isSubtitleLoadError` (une piste cassée ne tue plus la vidéo), rendu `<i>/<b>/<u>`. - Menu sources regroupé par langue (VF/VFQ/VFF/VOSTFR). ## 📡 Cast (AirPlay / Chromecast) - Retrait du contournement proxy darkibox (`buildApiProxyUrl`) → cast direct de l'URL ; `runtime.ts` supprime `API_PROXY_BASE_URL`/`buildApiProxyUrl` devenus morts. - Paramètre `streamType` (`BUFFERED` par défaut) propagé jusqu'à `loadMediaOnCastWithFallback`. ## 📢 Pubs - Modes de popup (`adPopupMode.ts`) : `normal`, `auto`, `click-anywhere` ; toggle « +18 » séparé (`adAdultMode.ts`). `SCRIPT_AD_MODE_ENABLED` → `false`, URL du script changée. ## 🔎 Recherche & priorité des sources - `searchUtils.ts` : le terme original contourne le filtre « trop générique » (fix zéro-résultat sur titres courts : Baki, Gantz). - `animeSignals.ts` : détection donghua (CN/TW/HK ou `zh` + Animation, hors C-drama). - `sourceAutoSelect.ts` : `VFF`/`VFQ` normalisés en `vf` (sinon reléguées derrière VOSTFR). `sourcePriorityPrefs.ts` : schéma v2 → v3 (nouvel ordre par défaut + `j1f`, migration non destructive des ordres personnalisés). `extractionPrefs.ts` : +daddylive. ## 🔒 Sécurité - Sanitisation d'URL avant rendu en `href` : `CommentsSection.tsx` (liens markdown `http(s)://`) et `Greenlight/AdminLinkSubmissions.tsx` — bloque les `javascript:`. ## ⚙️ Infra & perf - **server.js** : recyclage périodique des workers (12h) + `[memstats]` + hook `SIGUSR2` → heap-snapshot. - **app.js** : monte `/api/j1f`, retire la route statique `/oauth-icons`, passe `makeCpasmalRequest` au router Cpasmal, `coflix.date` → `coflix.trade`. - **lazyWithRetry.ts / main.tsx / ErrorBoundary.tsx** : récupération chunk-load réécrite (retry + reload budgété), garde `removeChild/insertBefore`, écran soft « Mise à jour » au lieu du crash-report. - **UI** : `TopProgressBar` écrit `transform` directement sur un ref (compositor-only, plus de re-render) ; `blur-text` relâche `will-change` après l'animation. - **proxiesembed/server.py** : `curl_cffi` (JA3) pour `cinep-proxy` + retry SOCKS5 sur 403 ; lookup clé VIP réaligné sur `checkVip.js` ; log WARNING par défaut ; SOCKS5 forcé IPv4 ; wrapper VTT/SRT pour hls.js ; re-label `application/zip` → `video/mp2t` ; `cinepulse.lol` → `purstream.mx`. ## 🧹 Nettoyage & suppressions - **Front** : carte promo « Loadix » sur Download (remplace l'encart beta), « 1jour1film » ajouté à « C'est quoi Movix », fallback Darkino/Nightflix gutté en no-op (`api.movix.chat` décommissionné), classes CSS mortes retirées, fix `fetchPriority` → `fetchpriority`. - **Backend** : scrapers/utilitaires morts retirés — `routes/dragiv.js`, `routes/topstream.js`, `routes/proxy.js`, `utils/cloudflareSession.js`, `utils/hydrackerBatch.js`, `utils/hydrackerQueue.js'. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
751 lines
24 KiB
JavaScript
751 lines
24 KiB
JavaScript
/**
|
|
* Wiflix routes.
|
|
* Extracted from server.js -- Wiflix search, player extraction, and routes.
|
|
* Mount point: app.use('/api/wiflix', router)
|
|
*/
|
|
|
|
const express = require("express");
|
|
const router = express.Router();
|
|
const axios = require("axios");
|
|
const cheerio = require("cheerio");
|
|
const path = require("path");
|
|
const fsp = require("fs").promises;
|
|
|
|
const { memoryCache } = require("../config/redis");
|
|
const {
|
|
generateCacheKey,
|
|
saveToCache,
|
|
} = require("../utils/cacheManager");
|
|
const {
|
|
makeWiflixRequest,
|
|
makeWiflixSearchRequest,
|
|
} = require("../utils/proxyManager");
|
|
const { acquireRedisLock } = require("../utils/redisLock");
|
|
const {
|
|
fetchTmdbDetails,
|
|
fetchTmdbSeason,
|
|
} = require("../utils/tmdbCache");
|
|
// Movies are scraped from cinestream.info (flemmix's bot-shield is painful for
|
|
// films); TV stays on flemmix below. Same return shape, so the route + cache
|
|
// here consume it unchanged.
|
|
const { fetchCinestreamMovieData } = require("./cinestream");
|
|
|
|
const TMDB_API_KEY = process.env.TMDB_API_KEY || "";
|
|
const TMDB_API_URL = "https://api.themoviedb.org/3";
|
|
const WIFLIX_BASE_URL = "https://flemmix.golf";
|
|
|
|
// === Cache helpers (local, since getFromCacheNoExpiration is not yet in cacheManager) ===
|
|
const getFromCacheNoExpiration = async (cacheDir, key) => {
|
|
try {
|
|
const memKey = `${cacheDir}:${key}`;
|
|
const memData = await memoryCache.get(memKey);
|
|
if (memData) return memData;
|
|
|
|
const cacheFilePath = path.join(cacheDir, `${key}.json`);
|
|
let fileContent;
|
|
try {
|
|
fileContent = await fsp.readFile(cacheFilePath, "utf8");
|
|
} catch (e) {
|
|
if (e.code === "ENOENT") return null;
|
|
throw e;
|
|
}
|
|
|
|
const cacheData = JSON.parse(fileContent);
|
|
if (
|
|
typeof cacheData === "string" ||
|
|
cacheData === null ||
|
|
cacheData === undefined
|
|
) {
|
|
try {
|
|
await fsp.unlink(cacheFilePath);
|
|
} catch {}
|
|
return null;
|
|
}
|
|
|
|
await memoryCache.set(memKey, cacheData);
|
|
return cacheData;
|
|
} catch (error) {
|
|
if (error.code === "ENOENT") return null;
|
|
console.error(
|
|
`Erreur lors de la recuperation du cache pour ${key}:`,
|
|
error,
|
|
);
|
|
return null;
|
|
}
|
|
};
|
|
|
|
// === Utility Functions ===
|
|
const normalizeString = (str) => {
|
|
if (!str) return "";
|
|
return str
|
|
.toLowerCase()
|
|
.normalize("NFD")
|
|
.replace(/[\u0300-\u036f]/g, "")
|
|
.replace(/[^\w\s]/g, " ")
|
|
.replace(/\s+/g, " ")
|
|
.trim();
|
|
};
|
|
|
|
// Normalise un titre en retirant les termes generiques FR/EN (articles, "film/movie", etc.)
|
|
// pour comparer le "coeur" du titre (ex: "The Super Mario Galaxy Movie" → "super mario galaxy")
|
|
const stripTitleNoise = (str) => {
|
|
return normalizeString(str)
|
|
.replace(/\b(le film|the movie|the film|le movie|film|movie|movies|films)\b/g, '')
|
|
.replace(/\b(the|a|an|le|la|les|l|un|une|des|de|du|d)\b/g, '')
|
|
.replace(/\s+/g, ' ')
|
|
.trim();
|
|
};
|
|
|
|
const getLevenshteinSimilarity = (str1, str2) => {
|
|
const s1 = normalizeString(str1);
|
|
const s2 = normalizeString(str2);
|
|
if (s1 === s2) return 1;
|
|
if (s1.length === 0 || s2.length === 0) return 0;
|
|
|
|
const matrix = [];
|
|
for (let i = 0; i <= s2.length; i++) {
|
|
matrix[i] = [i];
|
|
}
|
|
for (let j = 0; j <= s1.length; j++) {
|
|
matrix[0][j] = j;
|
|
}
|
|
|
|
for (let i = 1; i <= s2.length; i++) {
|
|
for (let j = 1; j <= s1.length; j++) {
|
|
if (s2.charAt(i - 1) === s1.charAt(j - 1)) {
|
|
matrix[i][j] = matrix[i - 1][j - 1];
|
|
} else {
|
|
matrix[i][j] = Math.min(
|
|
matrix[i - 1][j - 1] + 1,
|
|
matrix[i][j - 1] + 1,
|
|
matrix[i - 1][j] + 1,
|
|
);
|
|
}
|
|
}
|
|
}
|
|
|
|
const maxLength = Math.max(s1.length, s2.length);
|
|
return maxLength === 0
|
|
? 1
|
|
: (maxLength - matrix[s2.length][s1.length]) / maxLength;
|
|
};
|
|
|
|
function formatNextUpdate(ms) {
|
|
if (ms <= 0) return 'imminent';
|
|
const totalSeconds = Math.ceil(ms / 1000);
|
|
const minutes = Math.floor(totalSeconds / 60);
|
|
const seconds = totalSeconds % 60;
|
|
if (minutes > 0) return `${minutes}m ${seconds}s`;
|
|
return `${seconds}s`;
|
|
}
|
|
|
|
// === Search ===
|
|
async function searchWiflixMovie(title, baseUrl = WIFLIX_BASE_URL) {
|
|
const searchUrl = `${baseUrl}/`;
|
|
const payload = `do=search&subaction=search&story=${encodeURIComponent(title)}`;
|
|
try {
|
|
let responseBody = null;
|
|
|
|
try {
|
|
// Cookie handshake: GET homepage to harvest the bot-shield session cookie,
|
|
// then POST the search with it + h_check=25 on the same proxy.
|
|
const res = await makeWiflixSearchRequest(baseUrl + "/", searchUrl, {
|
|
data: payload,
|
|
headers: {
|
|
"Content-Type": "application/x-www-form-urlencoded",
|
|
"Referer": baseUrl + "/",
|
|
"Origin": baseUrl,
|
|
},
|
|
timeout: 15000,
|
|
});
|
|
responseBody = typeof res.data === 'string' ? res.data : JSON.stringify(res.data);
|
|
console.log(`[WIFLIX SEARCH] OK via proxy`);
|
|
} catch (err) {
|
|
console.log(`[WIFLIX SEARCH] Echec: ${err.message}`);
|
|
return { url: null, debugHtml: 'Erreur: service temporairement indisponible' };
|
|
}
|
|
|
|
if (!responseBody || responseBody.includes("Un instant, s'il vous plait")) {
|
|
return { url: null, debugHtml: responseBody || 'Challenge Cloudflare non resolu' };
|
|
}
|
|
|
|
const $ = cheerio.load(responseBody);
|
|
// Template has no #dle-content wrapper. Real results are div.mov; the
|
|
// "Populaires" reco block (#no-results-rec) is hidden when results exist —
|
|
// exclude it exactly like the site's own JS result counter does.
|
|
const movBlocks = $("div.mov").not("#no-results-rec .mov");
|
|
if (movBlocks.length === 0) return { url: null, debugHtml: responseBody };
|
|
|
|
let bestMatch = null;
|
|
let bestSimilarity = 0;
|
|
|
|
movBlocks.each((_, block) => {
|
|
const $block = $(block);
|
|
const $titleLink = $block.find("a.mov-t");
|
|
if (!$titleLink.length) return;
|
|
|
|
const href = $titleLink.attr("href");
|
|
if (!href) return;
|
|
|
|
const resultTitle = $titleLink.text().trim();
|
|
if (!resultTitle || resultTitle.length < 2) return;
|
|
|
|
const resultTitleLower = resultTitle.toLowerCase();
|
|
const hasBlockSai = $block.find(".block-sai").length > 0;
|
|
const isSeries =
|
|
href.includes("/serie-") ||
|
|
resultTitleLower.includes("saison") ||
|
|
/saison-\d+/i.test(href) ||
|
|
hasBlockSai;
|
|
const searchIsSeries = title.toLowerCase().includes("saison");
|
|
|
|
if (searchIsSeries && !isSeries) return;
|
|
if (!searchIsSeries && isSeries) return;
|
|
|
|
if (searchIsSeries) {
|
|
const searchSeasonMatch = title.match(/saison\s+(\d+)/i);
|
|
if (searchSeasonMatch) {
|
|
const searchSeason = parseInt(searchSeasonMatch[1]);
|
|
|
|
let resultSeasonNum = null;
|
|
const titleSeasonMatch = resultTitle.match(/saison\s+(\d+)/i);
|
|
if (titleSeasonMatch) {
|
|
resultSeasonNum = parseInt(titleSeasonMatch[1]);
|
|
}
|
|
if (resultSeasonNum === null) {
|
|
const blockSaiText = $block.find(".block-sai").text().trim();
|
|
const saiMatch =
|
|
blockSaiText.match(/saison\s+(\d+)/i) ||
|
|
blockSaiText.match(/^(\d+)/);
|
|
if (saiMatch) {
|
|
resultSeasonNum = parseInt(saiMatch[1]);
|
|
}
|
|
}
|
|
if (resultSeasonNum === null) {
|
|
const urlSeasonMatch = href.match(/saison-(\d+)/i);
|
|
if (urlSeasonMatch) {
|
|
resultSeasonNum = parseInt(urlSeasonMatch[1]);
|
|
}
|
|
}
|
|
|
|
if (resultSeasonNum === null || searchSeason !== resultSeasonNum)
|
|
return;
|
|
}
|
|
}
|
|
|
|
const cleanSearchTitle = title
|
|
.toLowerCase()
|
|
.replace(/\s+saison\s+\d+/g, "")
|
|
.trim();
|
|
const cleanResultTitle = resultTitle
|
|
.toLowerCase()
|
|
.replace(/\s+saison\s+\d+/g, "")
|
|
.trim();
|
|
|
|
let similarity = 0;
|
|
if (cleanResultTitle === cleanSearchTitle) {
|
|
similarity = 1.0;
|
|
} else {
|
|
similarity = getLevenshteinSimilarity(
|
|
cleanResultTitle,
|
|
cleanSearchTitle,
|
|
);
|
|
// Fallback: comparer les titres sans bruit FR/EN ("The ... Movie" vs "Le Film")
|
|
if (similarity < 0.85) {
|
|
const coreSearch = stripTitleNoise(cleanSearchTitle);
|
|
const coreResult = stripTitleNoise(cleanResultTitle);
|
|
if (coreSearch && coreResult) {
|
|
const coreSim = coreSearch === coreResult
|
|
? 1.0
|
|
: getLevenshteinSimilarity(coreSearch, coreResult);
|
|
similarity = Math.max(similarity, coreSim);
|
|
}
|
|
}
|
|
}
|
|
|
|
let fullUrl = href;
|
|
if (fullUrl && !fullUrl.startsWith("http")) {
|
|
fullUrl = fullUrl.startsWith("/")
|
|
? `${baseUrl}${fullUrl}`
|
|
: `${baseUrl}/${fullUrl}`;
|
|
}
|
|
|
|
if (similarity >= 0.85 && similarity > bestSimilarity) {
|
|
bestSimilarity = similarity;
|
|
bestMatch = fullUrl ? encodeURI(fullUrl) : fullUrl;
|
|
}
|
|
});
|
|
|
|
return { url: bestMatch, debugHtml: bestMatch ? null : responseBody };
|
|
} catch (error) {
|
|
if (error.response?.status === 403) {
|
|
console.error(
|
|
`[WIFLIX SEARCH] 403 Forbidden pour "${title}" sur ${searchUrl}`,
|
|
);
|
|
}
|
|
return { url: null, debugHtml: 'Erreur: service temporairement indisponible' };
|
|
}
|
|
}
|
|
|
|
// === Release Date Extraction ===
|
|
function extractWiflixReleaseDate($) {
|
|
try {
|
|
const releaseDateElement = $(
|
|
"body > div:first-child > div > div > div > div > div > article > div:first-child > div:nth-child(2) > ul > li:nth-child(2) > div:nth-child(2)",
|
|
);
|
|
if (releaseDateElement.length > 0) {
|
|
const dateText = releaseDateElement.text().trim();
|
|
const yearMatch = dateText.match(/(\d{4})/);
|
|
if (yearMatch) return parseInt(yearMatch[1]);
|
|
}
|
|
|
|
const fallbackSelectors = [
|
|
"div.mov-desc",
|
|
".mov-desc",
|
|
'li:contains("Annee") + li',
|
|
'li:contains("Date") + li',
|
|
];
|
|
for (const selector of fallbackSelectors) {
|
|
const element = $(selector);
|
|
if (element.length > 0) {
|
|
const text = element.text().trim();
|
|
const yearMatch = text.match(/(\d{4})/);
|
|
if (yearMatch) return parseInt(yearMatch[1]);
|
|
}
|
|
}
|
|
return null;
|
|
} catch (error) {
|
|
console.error("[WIFLIX] Erreur lors de l'extraction de la date:", error);
|
|
return null;
|
|
}
|
|
}
|
|
|
|
// === Player Extraction ===
|
|
async function extractWiflixPlayers(pageUrl) {
|
|
try {
|
|
let rawHtml = null;
|
|
|
|
try {
|
|
const res = await makeWiflixRequest(pageUrl, {
|
|
timeout: 15000,
|
|
headers: {
|
|
"Referer": WIFLIX_BASE_URL + "/",
|
|
},
|
|
});
|
|
rawHtml = typeof res.data === 'string' ? res.data : JSON.stringify(res.data);
|
|
console.log(`[WIFLIX PLAYERS] OK via proxy`);
|
|
} catch (err) {
|
|
console.log(`[WIFLIX PLAYERS] Echec: ${err.message}`);
|
|
}
|
|
|
|
if (!rawHtml) {
|
|
return { players: [], releaseYear: null, debugHtml: 'Impossible de charger la page' };
|
|
}
|
|
const $ = cheerio.load(rawHtml);
|
|
const players = [];
|
|
const releaseYear = extractWiflixReleaseDate($);
|
|
|
|
const episodeDivs = $(
|
|
'div[class*="ep"][class*="vf"], div[class*="ep"][class*="vs"]',
|
|
);
|
|
|
|
if (episodeDivs.length > 0) {
|
|
episodeDivs.each((index, element) => {
|
|
const $episodeDiv = $(element);
|
|
const episodeClass = $episodeDiv.attr("class");
|
|
const episodeMatch = episodeClass.match(/ep(\d+)(vf|vs)/);
|
|
if (episodeMatch) {
|
|
const episodeNumber = parseInt(episodeMatch[1]);
|
|
const type = episodeMatch[2] === "vf" ? "VF" : "VOSTFR";
|
|
$episodeDiv.find("a[onclick]").each((linkIndex, linkElement) => {
|
|
const $link = $(linkElement);
|
|
const onclick = $link.attr("onclick");
|
|
// Template dropped the .clichost class (like the movie page) — match any span.
|
|
const $span = $link.find("span");
|
|
if (onclick && $span.length) {
|
|
const match = onclick.match(/loadVideo\('([^']+)'/);
|
|
if (match && match[1]) {
|
|
let processedUrl = match[1];
|
|
const name = $span.text().trim();
|
|
if (processedUrl.includes("tipfly.xyz")) {
|
|
const tipflyMatch = processedUrl.match(
|
|
/tipfly\.xyz\/em-?\d+-(.+)/,
|
|
);
|
|
if (tipflyMatch && tipflyMatch[1])
|
|
processedUrl = `https://oneupload.net/embed-${tipflyMatch[1]}.html`;
|
|
} else if (
|
|
name.toLowerCase() === "voe" ||
|
|
processedUrl.includes("jilliandescribecompany.com")
|
|
) {
|
|
processedUrl = processedUrl.replace(
|
|
/^https?:\/\/[^/]+/,
|
|
"https://voe.sx",
|
|
);
|
|
}
|
|
const domainMatch = processedUrl.match(
|
|
/https?:\/\/(?:www\.)?([^\/]+)/,
|
|
);
|
|
const domainName = domainMatch ? domainMatch[1] : name;
|
|
players.push({
|
|
name: domainName,
|
|
url: processedUrl,
|
|
episode: episodeNumber,
|
|
type,
|
|
});
|
|
}
|
|
}
|
|
});
|
|
}
|
|
});
|
|
} else {
|
|
const filmLinks = $(".tabs-sel a[onclick]");
|
|
filmLinks.each((index, element) => {
|
|
const $link = $(element);
|
|
const onclick = $link.attr("onclick");
|
|
const $span = $link.find("span");
|
|
if (onclick && $span.length) {
|
|
const match = onclick.match(/loadVideo\('([^']+)'/);
|
|
if (match && match[1]) {
|
|
let processedUrl = match[1];
|
|
const name = $span.text().trim();
|
|
let type = "VF";
|
|
if (name.toLowerCase().includes("vostfr")) type = "VOSTFR";
|
|
if (processedUrl.includes("tipfly.xyz")) {
|
|
const tipflyMatch = processedUrl.match(
|
|
/tipfly\.xyz\/em-?\d+-(.+)/,
|
|
);
|
|
if (tipflyMatch && tipflyMatch[1])
|
|
processedUrl = `https://oneupload.net/embed-${tipflyMatch[1]}.html`;
|
|
} else if (
|
|
name.toLowerCase() === "voe" ||
|
|
processedUrl.includes("jilliandescribecompany.com")
|
|
) {
|
|
processedUrl = processedUrl.replace(
|
|
/^https?:\/\/[^/]+/,
|
|
"https://voe.sx",
|
|
);
|
|
}
|
|
const domainMatch = processedUrl.match(
|
|
/https?:\/\/(?:www\.)?([^\/]+)/,
|
|
);
|
|
const domainName = domainMatch ? domainMatch[1] : name;
|
|
players.push({
|
|
name: domainName,
|
|
url: processedUrl,
|
|
episode: 1,
|
|
type,
|
|
});
|
|
}
|
|
}
|
|
});
|
|
}
|
|
|
|
return { players, releaseYear, debugHtml: players.length === 0 ? rawHtml : null };
|
|
} catch (error) {
|
|
return {
|
|
players: [],
|
|
releaseYear: null,
|
|
debugHtml: error.response?.data || error.message || null,
|
|
};
|
|
}
|
|
}
|
|
|
|
// === Data Fetching ===
|
|
// Movie data now comes from cinestream.info (see ./cinestream + updateWiflixCache).
|
|
// flemmix is still scraped for TV below.
|
|
|
|
async function fetchWiflixTvData(tmdbId, season, cachedData = null) {
|
|
try {
|
|
const [tmdbData, seasonData] = await Promise.all([
|
|
fetchTmdbDetails(TMDB_API_URL, TMDB_API_KEY, tmdbId, "tv", "fr-FR"),
|
|
fetchTmdbSeason(TMDB_API_URL, TMDB_API_KEY, tmdbId, season, "fr-FR"),
|
|
]);
|
|
const originalData = tmdbData;
|
|
|
|
if (!tmdbData || !seasonData) {
|
|
if (cachedData) return cachedData;
|
|
return {
|
|
success: false,
|
|
error: "Serie ou saison non trouvee sur TMDB",
|
|
tmdb_id: tmdbId,
|
|
season,
|
|
};
|
|
}
|
|
|
|
const titlesToTry = [
|
|
tmdbData.name,
|
|
originalData.original_name,
|
|
originalData.name,
|
|
]
|
|
.filter(Boolean)
|
|
.filter((title, index, arr) => arr.indexOf(title) === index);
|
|
|
|
let seriesUrl = null;
|
|
let searchDebugHtml = null;
|
|
for (const title of titlesToTry) {
|
|
const searchResult = await searchWiflixMovie(`${title} saison ${season}`);
|
|
if (searchResult.url) { seriesUrl = searchResult.url; break; }
|
|
searchDebugHtml = searchResult.debugHtml;
|
|
}
|
|
|
|
if (!seriesUrl)
|
|
return {
|
|
success: false,
|
|
error: "Serie non trouvee sur Wiflix",
|
|
tmdb_id: tmdbId,
|
|
season,
|
|
titles_tried: titlesToTry,
|
|
debugHtml: searchDebugHtml,
|
|
};
|
|
|
|
const extractionResult = await extractWiflixPlayers(seriesUrl);
|
|
const players = extractionResult.players;
|
|
const wiflixReleaseYear = extractionResult.releaseYear;
|
|
|
|
if (players.length === 0)
|
|
return {
|
|
success: false,
|
|
error: "Aucun lecteur video trouve",
|
|
tmdb_id: tmdbId,
|
|
season,
|
|
wiflix_url: seriesUrl,
|
|
debugHtml: extractionResult.debugHtml,
|
|
};
|
|
|
|
if (wiflixReleaseYear) {
|
|
const tmdbReleaseYear = seasonData.air_date
|
|
? new Date(seasonData.air_date).getFullYear()
|
|
: null;
|
|
if (tmdbReleaseYear && wiflixReleaseYear !== tmdbReleaseYear) {
|
|
console.log(
|
|
`[WIFLIX TV] Date mismatch: TMDB Season ${season} (${tmdbReleaseYear}) vs Wiflix ${wiflixReleaseYear} pour ${tmdbData.name}`,
|
|
);
|
|
return {
|
|
success: false,
|
|
error: "Serie non disponible sur Wiflix (date de sortie differente)",
|
|
tmdb_id: tmdbId,
|
|
season,
|
|
wiflix_url: seriesUrl,
|
|
tmdb_release_year: tmdbReleaseYear,
|
|
wiflix_release_year: wiflixReleaseYear,
|
|
};
|
|
}
|
|
}
|
|
|
|
const episodes = {};
|
|
players.forEach((player) => {
|
|
const episodeNum = player.episode;
|
|
if (!episodes[episodeNum]) episodes[episodeNum] = { vf: [], vostfr: [] };
|
|
if (player.type === "VOSTFR") episodes[episodeNum].vostfr.push(player);
|
|
else episodes[episodeNum].vf.push(player);
|
|
});
|
|
|
|
return {
|
|
success: true,
|
|
tmdb_id: tmdbId,
|
|
title: tmdbData.name,
|
|
original_title: originalData.original_name,
|
|
season: parseInt(season),
|
|
wiflix_url: seriesUrl,
|
|
episodes,
|
|
cache_timestamp: new Date().toISOString(),
|
|
};
|
|
} catch (error) {
|
|
console.error(`[WIFLIX TV] Erreur: ${error.message}`);
|
|
if (cachedData) {
|
|
console.log(
|
|
`[WIFLIX] Cache preserve malgre l'erreur pour tv ${tmdbId} saison ${season}`,
|
|
);
|
|
return cachedData;
|
|
}
|
|
return {
|
|
success: false,
|
|
error: "Erreur lors de la recuperation des donnees Wiflix",
|
|
message: error.message,
|
|
tmdb_id: tmdbId,
|
|
season,
|
|
};
|
|
}
|
|
}
|
|
|
|
// === Background Cache Update ===
|
|
const WIFLIX_UPDATE_LOCK_TTL = 60; // 60s max per scrape — auto-expires if worker crashes
|
|
|
|
const updateWiflixCache = async (
|
|
cacheDir,
|
|
cacheKey,
|
|
type,
|
|
tmdbId,
|
|
season = null,
|
|
) => {
|
|
// Dedup cross-cluster: only one worker scrapes a given cacheKey at a time
|
|
const lock = await acquireRedisLock(`wiflix:update:${cacheKey}`, {
|
|
ttl: WIFLIX_UPDATE_LOCK_TTL,
|
|
retries: 0, // Don't wait — if another worker is already on it, skip
|
|
});
|
|
if (!lock) return; // Another worker (or this one) is already updating this key
|
|
|
|
try {
|
|
const existingCache = await getFromCacheNoExpiration(cacheDir, cacheKey);
|
|
|
|
let newData;
|
|
if (type === "movie")
|
|
newData = await fetchCinestreamMovieData(tmdbId, existingCache);
|
|
else if (type === "tv")
|
|
newData = await fetchWiflixTvData(tmdbId, season, existingCache);
|
|
else throw new Error(`Type non supporte: ${type}`);
|
|
|
|
if (
|
|
typeof newData === "string" &&
|
|
newData.includes("Maintenance en cours")
|
|
)
|
|
throw new Error("Maintenance en cours - donnees invalides");
|
|
if (
|
|
typeof newData === "string" ||
|
|
newData === null ||
|
|
newData === undefined
|
|
)
|
|
throw new Error("Donnees invalides - non-JSON");
|
|
|
|
if (newData) {
|
|
const isFailedResult = newData.success === false;
|
|
if (isFailedResult && existingCache?.success) return;
|
|
if (newData.success) {
|
|
const { debugHtml: _dh, ...cacheableData } = newData;
|
|
await saveToCache(cacheDir, cacheKey, cacheableData);
|
|
} else {
|
|
await saveToCache(cacheDir, cacheKey, newData);
|
|
}
|
|
}
|
|
} catch (error) {
|
|
console.error(`[WIFLIX UPDATE] ${type} ${tmdbId}: ${error.message}`);
|
|
} finally {
|
|
await lock.release();
|
|
}
|
|
};
|
|
|
|
// === Routes ===
|
|
|
|
// GET /movie/:tmdbId
|
|
router.get("/movie/:tmdbId", async (req, res) => {
|
|
const { tmdbId } = req.params;
|
|
const cacheKey = generateCacheKey(`wiflix_movie_${tmdbId}`);
|
|
const cacheDir = path.join(__dirname, "..", "cache", "wiflix");
|
|
|
|
try {
|
|
await fsp.mkdir(cacheDir, { recursive: true });
|
|
|
|
const cachedData = await getFromCacheNoExpiration(cacheDir, cacheKey);
|
|
let dataReturned = false;
|
|
|
|
if (cachedData) {
|
|
const RECENT_UPDATE_THRESHOLD = cachedData.success === false
|
|
? 5 * 60 * 1000
|
|
: 3 * 60 * 60 * 1000; // 3h pour les succes
|
|
const cachePath = path.join(cacheDir, `${cacheKey}.json`);
|
|
let nextUpdateIn = null;
|
|
let shouldSkipUpdate = false;
|
|
try {
|
|
const stats = await fsp.stat(cachePath);
|
|
const remaining = RECENT_UPDATE_THRESHOLD - (Date.now() - stats.mtime.getTime());
|
|
if (remaining > 0) {
|
|
shouldSkipUpdate = true;
|
|
nextUpdateIn = formatNextUpdate(remaining);
|
|
} else {
|
|
nextUpdateIn = 'imminent';
|
|
}
|
|
} catch (e) {}
|
|
|
|
res.status(200).json({ ...cachedData, next_update_in: nextUpdateIn });
|
|
dataReturned = true;
|
|
|
|
if (!shouldSkipUpdate)
|
|
updateWiflixCache(cacheDir, cacheKey, "movie", tmdbId);
|
|
}
|
|
|
|
if (!dataReturned) {
|
|
res.status(202).json({
|
|
success: false,
|
|
pending: true,
|
|
message: "Recherche en cours, reessayez dans quelques secondes",
|
|
tmdb_id: tmdbId,
|
|
});
|
|
|
|
updateWiflixCache(cacheDir, cacheKey, "movie", tmdbId);
|
|
}
|
|
} catch (error) {
|
|
console.error(`[WIFLIX MOVIE] Erreur: ${error.message}`);
|
|
if (!res.headersSent) {
|
|
res.status(500).json({
|
|
success: false,
|
|
error: "Erreur lors de la recuperation des donnees Wiflix",
|
|
message: error.message,
|
|
tmdb_id: tmdbId,
|
|
});
|
|
}
|
|
}
|
|
});
|
|
|
|
// GET /tv/:tmdbId/:season
|
|
router.get("/tv/:tmdbId/:season", async (req, res) => {
|
|
const { tmdbId, season } = req.params;
|
|
const cacheKey = generateCacheKey(`wiflix_tv_${tmdbId}_${season}`);
|
|
const cacheDir = path.join(__dirname, "..", "cache", "wiflix");
|
|
|
|
try {
|
|
await fsp.mkdir(cacheDir, { recursive: true });
|
|
|
|
const cachedData = await getFromCacheNoExpiration(cacheDir, cacheKey);
|
|
let dataReturned = false;
|
|
|
|
if (cachedData) {
|
|
const RECENT_UPDATE_THRESHOLD = cachedData.success === false
|
|
? 5 * 60 * 1000
|
|
: 3 * 60 * 60 * 1000; // 3h pour les succes
|
|
const cachePath = path.join(cacheDir, `${cacheKey}.json`);
|
|
let nextUpdateIn = null;
|
|
let shouldSkipUpdate = false;
|
|
try {
|
|
const stats = await fsp.stat(cachePath);
|
|
const remaining = RECENT_UPDATE_THRESHOLD - (Date.now() - stats.mtime.getTime());
|
|
if (remaining > 0) {
|
|
shouldSkipUpdate = true;
|
|
nextUpdateIn = formatNextUpdate(remaining);
|
|
} else {
|
|
nextUpdateIn = 'imminent';
|
|
}
|
|
} catch (e) {}
|
|
|
|
res.json({ ...cachedData, next_update_in: nextUpdateIn });
|
|
dataReturned = true;
|
|
|
|
if (!shouldSkipUpdate)
|
|
updateWiflixCache(cacheDir, cacheKey, "tv", tmdbId, season);
|
|
}
|
|
|
|
if (!dataReturned) {
|
|
res.status(202).json({
|
|
success: false,
|
|
pending: true,
|
|
message: "Recherche en cours, reessayez dans quelques secondes",
|
|
tmdb_id: tmdbId,
|
|
season: parseInt(season),
|
|
});
|
|
|
|
updateWiflixCache(cacheDir, cacheKey, "tv", tmdbId, season);
|
|
}
|
|
} catch (error) {
|
|
console.error(`[WIFLIX TV] Erreur: ${error.message}`);
|
|
if (!res.headersSent) {
|
|
res.status(500).json({
|
|
success: false,
|
|
error: "Erreur lors de la recuperation des donnees Wiflix",
|
|
message: error.message,
|
|
tmdb_id: tmdbId,
|
|
season,
|
|
});
|
|
}
|
|
}
|
|
});
|
|
|
|
module.exports = router;
|