Task : Extension ArXiv - Toutes les sciences

Date : 13/01/2026 21:04 Duree : ~30 min Statut : TERMINE

Objectif

Etendre le collector ArXiv de NeedFinder pour couvrir tous les domaines scientifiques, pas seulement l'informatique.

Avant / Apres

Metrique	Avant	Apres
Categories ArXiv	7 (cs.*)	26 (multi-sciences)
Papers ArXiv	301	826
Total discoveries	809	1334
Matches	34	48

Categories ajoutees

Computer Science (existant + ajouts)

cs.AI, cs.LG, cs.CL, cs.CV, cs.CR (existant)
cs.RO (Robotics)
cs.HC (Human-Computer Interaction)
cs.NE (Neural and Evolutionary Computing)

Physics & Engineering

physics.app-ph (Applied Physics)
cond-mat.mtrl-sci (Materials Science)
quant-ph (Quantum Physics)
eess.SP (Signal Processing)
eess.SY (Systems and Control)

Biology & Medicine

q-bio.BM (Biomolecules)
q-bio.NC (Neurons and Cognition)
q-bio.GN (Genomics)
q-bio.QM (Quantitative Methods)

Mathematics & Statistics

stat.ML (Machine Learning - Stats)
stat.AP (Applications)
math.OC (Optimization and Control)

Economics & Finance

econ.GN (General Economics)
q-fin.ST (Statistical Finance)
q-fin.CP (Computational Finance)

Energy & Environment

physics.soc-ph (Physics and Society - energy)
astro-ph.EP (Earth and Planetary - climate)

Modifications techniques

arxiv.ts

Categories etendues : 7 → 26
Categorisation amelioree : Mapping vers 17 categories internes
Tech extraction : Patterns specifiques par domaine (quantum, bio, materials, energy)
Impact scoring : Boost pour categories hot (quantum, genomics, neuroscience)

matcher.ts

Category mapping etendu :
- health → biomedicine, neuroscience, genomics, biology
- finance → economics_finance, statistics, quantum
- tech → robotics, quantum, computer_science
Semantic matching :
- sleep → neuroscience, brain, circadian
- diet → genomics, metabolism, protein
- energy → solar, battery, renewable

Resultats

Distribution par domaine scientifique

ai_ml                | 468
computer_vision      | 128
computer_science     | 105
nlp                  |  66
economics_finance    |  36
quantum              |  32
neuroscience         |  26
physics_engineering  |  23
robotics             |  22
statistics           |  22
materials_science    |  16
mathematics          |  16
biomedicine          |  15
genomics             |  15
energy               |  10
biology              |   9
environment          |   3

Exemples de matches cross-domaine

Besoin	Decouverte	Score
Diet/weight loss	CoDAC Medical Diagnosis	85
Language learning	LLM Token Pruning	85
Budget management	TALON Speculative Decoding	85
Offline-first apps	Rethinking RNNs	75

Fichiers modifies

Fichier	Modification
/app/src/collectors/arxiv.ts	26 categories, categorisation etendue
/app/src/services/matcher.ts	Semantic mapping cross-domaine

API

# Stats
curl http://192.168.1.51:5200/api/stats

# Discoveries par categorie
curl "http://192.168.1.51:5200/api/discoveries?category=quantum"
curl "http://192.168.1.51:5200/api/discoveries?category=neuroscience"

# Lancer collecte ArXiv
curl -X POST http://192.168.1.51:5200/api/collect/arxiv

# Lancer matching
curl -X POST http://192.168.1.51:5200/api/match/all