Behind the Scenes

We Are Testing Supermemory. It Has Not Solved AI Memory Yet.

What Collab365 is testing with Supermemory, what retrieval can and cannot fix, and the privacy and review controls a small business needs before trusting shared AI memory.

Supermemory may reduce the amount of business context we repeatedly paste into AI tools. It does not give a model perfect memory, guarantee accuracy or remove the need for human review.

That is the test we are actually running.

Helen and I kept hitting the same problem inside Collab365. A new AI session knew nothing about our products, terminology, decisions or the awkward exceptions hidden in old systems.

A five-minute task could begin with twenty minutes of hunting for the right document and explaining the business again.

What the product does

Supermemory describes its system as a memory and retrieval layer for AI applications. Its documentation says it processes supplied content, creates representations of it and retrieves relevant context for a later request.

That is useful, but it is not magic memory.

Retrieval-augmented generation, usually shortened to RAG, adds selected source material to a model's prompt. The model can still misunderstand the retrieved text. The wrong document can rank highly. An old fact can remain old. A vague question can retrieve the wrong context.

So our working loop is:

  1. Add approved business material.
  2. Ask a real question from our workflow.
  3. Inspect which sources were retrieved.
  4. Check the response against those sources.
  5. Correct or remove misleading material.
  6. Let Helen or me approve anything public or customer-facing.

The useful measure is not whether the answer sounds as though the model has worked here for years. It is whether we can trace the answer to the right current evidence.

What we are not putting into it

The original article said "no customer data" as if that single rule solved privacy. It does not.

A proper review also needs to ask:

  • What information do connected services expose?
  • Which third-party model providers process content?
  • Where is data stored and for how long?
  • How can a record be corrected or deleted?
  • Who inside the business can retrieve it?
  • Could one customer's context appear in another customer's answer?

Supermemory's privacy policy says connected-service content and API usage information may be processed, and that AI features may involve third-party providers. That makes its policy and current contract part of the technical decision, not a link nobody reads.

Memory can become a liability

I originally called memory "the moat" and suggested it would be hard to migrate. That may be true for some businesses, but it is an inference.

The more immediate risk is simpler: persistent context can preserve bad decisions as efficiently as good ones.

A useful memory layer needs ownership, source dates, deletion, access control and a way to distinguish a founder's opinion from a contractual fact.

We are still testing. The product may save us time. The test is not complete, and this article is not a recommendation to upload your business brain and hope for the best.

If you are designing a business knowledge layer that AI can use without inventing the facts, join The AI Authority for practical, human-reviewed guidance.

Sources