Skip to main content

Memory Data Connector

The Memory Data Connector enables configuring an in-memory dataset for tables used, or produced by the Spice runtime. Only certain tables, with predefined schemas, can be defined by the connector. These are:

  • store: Defines a table that LLMs, with memory tooling, can store data in. Requires mode: read_write.

Examples​

datasets:
  - from: memory:store
    name: llm_memory
    mode: read_write
    columns:
      - name: value
        embeddings: # Easily make your LLM learnings searchable.
          - from: all-MiniLM-L6-v2

embeddings:
  - name: all-MiniLM-L6-v2
    from: huggingface:huggingface.co/sentence-transformers/all-MiniLM-L6-v2

Cookbook​

  • A cookbook recipe to provide persistent memory capabilities for language models in Spice. LLM Memory