Overview #
Cognitio writes a short, friendly reply to small talk. You give it the latest message and a few earlier turns; it gives back one or two casual sentences. Use it when a conversation is a check-in or a quick question rather than a job, and a large language model would be slower and dearer than the moment deserves.
Cognitio is a conversational responder: given the current turn and a short window of prior turns, it returns one or two short sentences in a casual, warm register. It is the Response-family model a host application calls when a conversation is small talk rather than a job — a check-in, a quick opinion, a one-line question — and a full-size responder would be slower and more expensive than the moment deserves.
Cognitio is a fine-tune, not a model trained from scratch. It applies an 18.5M-parameter LoRA adapter, trained by Ducky Software, to Qwen2.5-1.5B-Instruct, an open-weight 1.5B-parameter instruct model. The adapter shapes the base model's voice and length; the base model supplies the language ability. Input is the current user turn plus up to eight prior turns, rendered by the service as a ChatML conversation behind a fixed system prompt; output is a single reply string capped at 96 new tokens.
Within the response family, Cognitio is the only member since ERM, the fixed-line reserve responder, was withdrawn on 2026-09-20: it generates free text on a GPU. Cognitio has no classification heads and no label catalogue; it does not decide whether a reply is safe to give. A host that needs that check runs an intention model such as ELIM before calling Cognitio.
Intended use #
- Short conversational replies — greetings, check-ins, casual opinions, quick how-tos — where one or two sentences are the right length.
- Keeping a consistent, brief voice across a conversation without prompting a large model for every turn.
- Serving as the ordinary responder in a host that already runs an intention check before it.
Out of scope #
- Long, technical, or multi-step answers; the 1.5B base and the 96-token cap both work against them.
- Anything that needs current facts, retrieval, or tools; Cognitio has none and will guess.
- Safety screening or content moderation of its own input or output.
Choose Cognitio when #
- The host needs a generated reply in a consistent casual register and can afford a GPU-backed HTTP call of a few seconds.
- The conversation window is short (at most nine turns) and the expected reply is one or two sentences.
- A host that needs a deterministic fallback while the service is unavailable holds a fixed line of its own; no Falcon model plays that part.
Specification #
| Base model | Qwen/Qwen2.5-1.5B-Instruct — open-weight decoder-only transformer, 28 layers, hidden size 1,536, MLP width 8,960, grouped-query attention |
|---|---|
| Base parameters | approx 1.5B (vendor figure; not recomputed) |
| Adapter | PEFT LoRA, rank 16, alpha 32 (scale 2.0), dropout 0.05, no bias, not merged into the base |
| Adapter parameters | 18,464,768 trainable, 392 tensors, float32 |
| Adapter file | adapter_model.safetensors, 73.9 MB |
| Target modules | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj on all 28 layers |
| Tokeniser | Qwen2 byte-pair encoding with the ChatML chat template |
| Context | Current turn plus up to 8 prior turns; training sequences were at most 512 tokens |
| Generation | Sampling with top-p 0.9, temperature 0.7 by default, at most 96 new tokens |
| Serving precision | float16 on GPU, float32 on CPU; the base is not quantised at inference |
| Training method | QLoRA supervised fine-tuning (4-bit NF4 base during training only), 400 steps |
| Libraries | transformers 4.46.3, PEFT 0.13.2, TRL 0.11.4, bitsandbytes 0.44.1 |
Try it #
- You send
- A chat that opens with “hey” and then asks “you free later?”.
- You get back
- A short, casual reply, such as asking what time the person was thinking of.
The same exchange as the API sees it:
{
"prompt": "you free later?",
"history": [
{ "role": "user", "content": "hey" },
{ "role": "assistant", "content": "hey — what's up?" }
],
"max_new_tokens": 64,
"temperature": 0.7
}{
"text": "might be — what time were you thinking?",
"model": "cognitio",
"base_model": "Qwen/Qwen2.5-1.5B-Instruct",
"backend": "friend-lora"
}Limits & safety #
Cognitio does not see the host application's tools, memory, user profile or any earlier part of the conversation: it reads at most nine turns rendered as ChatML text behind a fixed system prompt, and nothing else. It does not see images, locations, dates or the real time.
- It has no retrieval, no tools and no current data; questions about weather, prices, schedules or news receive a plausible guess, not an answer.
- It is small: long, technical or multi-step requests exceed what a 1.5B base and a 96-token cap can do well.
- It performs no input or output moderation of its own; the training filter removed assistant-register and inappropriate phrasing from the data, but nothing at inference checks the request or the reply.
- It is non-deterministic at the default temperature; the same request can produce different replies, and an empty or truncated reply is possible.
- Its voice is fixed by the training persona (lower-case, em dashes, Canadian references) and cannot be steered per request; there is no persona or style parameter.
- Its context is short: history beyond the last eight turns is silently dropped, and multi-turn coherence was not evaluated.
- The service has no authentication and no rate limiting; access control belongs to the deployment.
Related models #
ELIM
Reads the last few lines of a chat and says whether a reply is fine to give, needs a nudge, or should stop.
Conversation-intention classifier: trajectory, allow / steer / abort, harm and steer hint
Latest versions #
| Version | Date | Status | Note |
|---|---|---|---|
| 1.0.0 | Released | First documented version. QLoRA adapter trained in job friend-lora-20260910-113709 (400 steps, 2,112 rows) on Qwen2.5-1.5B-Instruct; hosted endpoint serving since 2026-09-10. |
Read the full documentation
Nine chapters: architecture, inputs and outputs, training, evaluation, API, runtime, limits and versions.