SkinDeepRESEARCHSteve Seguin

Live local demo

Search real research

Find papers with keywords or a small model that compares meaning.

Search 5,183 real scientific abstracts. Type a question or topic. Results are documents, not a generated answer.

Keyword search loads an 8 MB collection. Comparing meaning also loads a 23 MB MiniLM model and 8 MB of document vectors. Your query stays on this device.

Ready. Nothing is downloaded until you search.

Keywords

BM25: matches words in titles and abstracts.

    Meaning

    MiniLM: compares the query's numerical representation with each document.

      Combine the two rankings

      Fixed combination

      Reciprocal-rank fusion combines both lists with a fixed formula.

        Learned combination

        Five learned weights combine word scores, meaning scores and ranks. Trained on separate SciFact claims; it does not learn from your query.

          What happened on 100 test queries?

          Each method searched the same complete 5,183-document collection. “Relevant first” means the first paper was judged to contain evidence about the claim; it may support or refute it.

          MethodRelevant firstQuery time
          Keywords (BM25)55 / 1005.0 ms
          Meaning (MiniLM)47 / 1006.8 ms
          Combined ranking54 / 10012.7 ms
          Learned combination59 / 100Not timed

          Exploratory sample of 100 official SciFact test claims. Warm local CPU medians, three repeats, including query encoding and ranking; document indexing and model loading are separate. These Python timings are not browser timings. No early exit or quality-preserving speedup is claimed.

          A small learned combination reached 59/100 after training on 600 separate claims and selecting its settings on another 209. This is an exploratory repeat of the same test, not fresh confirmation. It improved first results but found slightly fewer relevant papers in the top five than the fixed combination. Method and tradeoffs.

          Data, model and limitations

          SciFact contains real paper abstracts and expert-authored research claims with human evidence judgments. These are not production search logs. The demo and benchmark use the same fixed corpus, not all scientific literature or the web.

          MiniLM-L6 uses six transformer layers and returns a 384-number vector. All six layers run. The model is pretrained; we did not fit or select it on these 100 queries. BM25 sees full abstracts; MiniLM uses at most 256 tokens, which can hide relevant text.

          A close meaning score is not a probability or a factual verdict. Scientific text may have appeared in model pretraining. The test uses benchmark relevance labels, which may not cover every useful paper. The browser uses the same pinned q8 ONNX model and stored document vectors, but its runtime and query timings differ.

          Abstract collection: SciFact / Semantic Scholar S2ORC, ODC-By 1.0. Claims and annotations: CC BY 4.0. See the original license; the BEIR mirror separately lists CC BY-SA 4.0.

          Method, all metrics and setup costs · Every test ranking · Frozen protocol and sources · Experiment code · Browser code

          New: compare the methods on 200 additional test IDs