Ampstack

From Mesh Wiki
Revision as of 04:06, 4 December 2024 by Archipelago (talk | contribs) (copy from old wiki)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

ampstack zero[edit | edit source]

absolute minimum set of technical specifications to ease integration with software and infrastructure by amp

  • Python
    • amp is very good at Python and not so good at other languages
  • Poetry
    • standardized dependency management helpful for integration
  • embed_server for embeddings. Supports OpenAI and open-source embeddings.
    • abstracts away API key and RAM management
    • allows re-running programs without needing to load embedding model back into RAM
    • implements caching
    • allows moving compute-heavy portions across network boundary