Skip to content

Roadmap

Where Olaverse is heading. Shipped items are marked โœ“; everything else is planned and subject to change. Follow progress on GitHub.


v0.2 โ€” shipped โœ“

  • โœ“ MISTTitleGenerator โ€” chat titles from a user's first message (mist-tg-0.3b)
  • โœ“ MISTQuestionGenerator โ€” question generation across 25 languages (mist-qg-1.5b)
  • โœ“ diacnet-1.0 sentence segmentation โ€” long text no longer truncated
  • โœ“ Documented model claims re-verified against the real checkpoints

v0.1.5 โ€” shipped โœ“

  • โœ“ 25-language identification (LIDLite25, LIDNeural25, LIDNeural5_1)
  • โœ“ diacnet-1.0 โ€” multilingual diacritization across 10 languages
  • โœ“ OTK-BPE multilingual tokenizers (Swahili, Kinyarwanda, merged)
  • โœ“ Retrieval toolkit (Reranker, Embedder)
  • โœ“ Vision module (PrismUpscaler, PrismDenoiser, PrismSteganography)
  • โœ“ Datasets API (load_dataset, DiacBench)

v0.3 โ€” shipped โœ“

  • โœ“ diactag-1.0 โ€” diacritization as per-character tagging: the output is guaranteed to be the input with marks added, per-character calibrated confidence, built-in language detection, and a 38 MB int8 CPU backend. Yoruba 0.2006 โ†’ 0.0836 DER, Hausa 0.0593 โ†’ 0.0041
  • โœ“ diacnet-1.1 โ€” the ByT5 line retrained on a larger corpus; large gains on Vietnamese, Turkish, Polish and Italian, a regression on Yoruba
  • โœ“ Private/gated Hugging Face repos authenticate via the huggingface-cli login token store, not just HF_TOKEN

v0.4 โ€” planned

  • CLI โ€” command-line access to the core models:
    olaverse diacritize "se eranko naa"
    olaverse detect text.txt
    olaverse tokenize yo text.txt
    
  • Pipeline API โ€” chain detection โ†’ normalization โ†’ diacritization in one call:
    from olaverse import Pipeline
    
    pipeline = Pipeline(language_detection=True, normalization=True, diacritization=True)
    pipeline.process(text)
    
  • REST inference API โ€” olaverse serve diacnet โ†’ POST /diacritize
  • More African languages across LID, DiacNet and DiacTag

v0.4 โ€” planned

  • Custom fine-tuning API
  • Streaming inference
  • More speech tools โ€” progress toward trained acoustic models for the TTS pipeline

v1.0 โ€” planned

  • Production deployment toolkit โ€” Docker images, cloud inference recipes, edge deployment guides

Not on the roadmap (deliberately)

More model families. The current focus is depth over breadth: making the existing models โ€” DiacTag, DiacNet, LID, OTK-BPE, retrieval, MIST, Prism โ€” easier to adopt, deploy, and trust in production.