AlphaJuri Build Log: Errors We Made, Fixed, and Learned From
Building AI-native legal tech means failing fast and fixing faster. At Avante, we document every meaningful error in our portfolio companies — not as a postmort
Building AI-native legal tech means failing fast and fixing faster. At Avante, we document every meaningful error in our portfolio companies — not as a postmortem ritual, but as a live operating discipline that compounds over time.
Why We Publish This at All
Most venture builders hide their mistakes. They publish milestone announcements, not failure logs. Avante does the opposite.
AlphaJuri is one of our companies in active construction. It sits at the intersection of legal intelligence and AI — a space where the margin for hallucination, misclassification, and trust erosion is essentially zero. Every error costs credibility. Every fix compounds learning.
So we write it down. Publicly. Not because it's comfortable, but because the founders and co-builders who want to work with Avante deserve to see how we actually operate — not how we say we operate.
Error #1: We Let the LLM Cite Clauses That Didn't Exist
The most embarrassing week in AlphaJuri's short life came when our document analysis module confidently cited Article 473, Paragraph 2 of a contract — a clause the contract did not contain.
The model was pattern-matching from training data on similar contract structures, not grounding output in the actual uploaded document. The retrieval layer was too loose. The prompt gave the model too much latitude to 'fill in' what should have been there.
What we fixed: We tightened the retrieval-augmented generation (RAG) pipeline to require strict source attribution. Every clause reference now must be pulled verbatim from the indexed document. If it isn't there, the model says so instead of inventing it.
What we learned: Confidence calibration in legal AI is not a UX problem — it's an architecture problem. You solve it upstream, not with a disclaimer at the bottom of the screen.
Error #2: We Shipped a Feature the User Never Asked For
We built a contract comparison view that showed clause-by-clause diffs side by side. Clean interface. Good engineering. Zero usage in the first two weeks.
We went back to the early users. They didn't want to compare clauses. They wanted to know which party held more risk exposure in a given clause — a judgment call, not a visual diff.
The feature answered the wrong question because we built from assumptions instead of sessions. We had not sat with a lawyer and watched them actually work through a contract review in real time.
What we fixed: We replaced the diff view with a risk-scoring layer per clause. The model now flags which party bears obligation, what triggers that obligation, and what the consequence of breach looks like in plain language.
What we learned: In legal tech, the job-to-be-done is almost never 'show me more information.' It's 'tell me what to worry about.' Those are fundamentally different product directions.
Error #3: Our Onboarding Assumed Too Much Legal Sophistication
AlphaJuri's early positioning skewed toward senior lawyers. The onboarding copy reflected that — dense, terminology-heavy, minimal hand-holding.
Then we watched a paralegal try to use the product. She uploaded a document, saw the output, and didn't know what to do with it. Not because the output was wrong — because the interface gave her no action prompt. Just analysis. No 'here's what to do next.'
This is a common failure mode in AI products: the model does the hard cognitive work, then drops the user in an empty room.
What we fixed: We added structured action prompts after every analysis block. The interface now surfaces three possible next steps based on what the model found — draft a response, flag for escalation, or mark as resolved.
What we learned: AI output without workflow integration is a research tool, not a work tool. AlphaJuri needs to be the latter.
Error #4: We Ignored Latency Until Users Started Ignoring Us
Legal professionals work under time pressure. A contract review that takes forty-five seconds to load is not a minor inconvenience — it breaks the work rhythm and trains users to stop expecting the product to be fast.
We had optimized for output quality at the expense of response time. Our pipeline was running sequential calls where parallel calls were entirely viable. We hadn't profiled it. We assumed it was fast enough because it felt fast in internal testing.
It wasn't. Real documents are longer. Real users don't wait.
What we fixed: We restructured the pipeline to run document chunking and clause classification in parallel. Response time dropped significantly. We also added a streaming output view so users see partial results as they arrive instead of waiting for the full response.
What we learned: In AI-native products, perceived speed is a product feature, not an infrastructure detail. It belongs in the spec, not the backlog.
Error #5: We Didn't Define 'Done' for the AI Layer
This is the most structural error on the list — and the one that took us longest to name.
When you're building with AI, there's a persistent temptation to keep iterating on the model behavior without declaring a stable baseline. Every week the outputs get slightly better. Every week you resist shipping because 'we can improve it a little more.'
We fell into this trap with AlphaJuri's clause classification module. We spent three weeks in quality iteration without a defined acceptance threshold. The team was doing real work, but without a ship condition, 'good enough' had no meaning.
What we fixed: We now define explicit quality gates before any model component enters the build sprint. The gate has three elements — a minimum accuracy floor on a test set of real documents, a maximum hallucination rate, and a user task completion benchmark from observed sessions.
What we learned: AI development without acceptance criteria is not R&D — it's drift. You need the same engineering discipline you'd apply to any other system, applied to model behavior.
- Define the quality gate before you start iterating.
- Separate 'improvement work' from 'ship-readiness work' in your sprint structure.
- Real documents, not synthetic test sets, are your ground truth.
The Pattern Across All Five Errors
Look at these five errors together and a pattern emerges: every one of them traces back to the gap between what we assumed and what was actually true.
We assumed the model would stay grounded. It didn't. We assumed users wanted comparison. They wanted judgment. We assumed lawyers would onboard easily. Paralegals couldn't. We assumed our pipeline was fast. It wasn't under real conditions. We assumed improvement was always worth doing. It was — but only when pointed at a defined target.
This is the core operating discipline at Avante: assumptions are hypotheses, not facts. You test them as fast as possible, with real users, on real work. That's how What Is Avante Ventures and How Does It Build AI-Native Companies actually translates into building — not just positioning.
AlphaJuri is not unique in making these errors. Every AI-native company in legal tech is navigating the same terrain. What matters is the velocity of detection and correction. A mistake that takes a week to find and fix is a feature, not a failure.
What This Means for Founders Building in AI-Native Verticals
If you're building an AI-native company in a high-stakes vertical — legal, health, finance, compliance — the error taxonomy above is not specific to AlphaJuri. It's close to universal.
The hallucination problem is architectural. The feature-market fit problem is a listening problem. The onboarding problem is a workflow integration problem. The latency problem is a prioritization problem. The 'done' problem is a discipline problem.
None of them are fixed by better prompts. All of them are fixed by operational rigor applied to AI as a first-class engineering system.
The venture builder model — where operators are inside the company, not observing from a cap table — is what makes this error log possible. Avante teams work inside AlphaJuri. We see the errors when they happen, not in a quarterly board deck. That's the structural advantage, and it's worth understanding how it differs from traditional fund structures. The How Do Venture Studios Make Money? The Honest Breakdown piece gets into why that alignment matters beyond the feel-good version.
If you're a founder who wants to build this way — with real operational support, documented learning, and AI as the foundation rather than a feature — Avante is building that infrastructure now.
Frequently asked questions
- What is AlphaJuri and how does it relate to Avante?
- AlphaJuri is an AI-native legal intelligence company being built inside the Avante venture studio. Avante provides operational co-building support — meaning Avante operators work directly inside AlphaJuri's development process, not as investors watching from the outside. It's one of several companies Avante is actively constructing in Brazil's AI-native ecosystem.
- Why does Avante publish internal error logs publicly?
- Because the founders and co-builders Avante works with need to see the real operating method, not the polished version. Publishing error logs builds trust with the right audience — people who know that fast error detection and correction is a competitive advantage, not an embarrassment. It also keeps internal teams honest about velocity and discipline.
- Are these errors common in other AI-native legal tech products?
- Yes. Hallucination in document-grounded tasks, feature-market fit drift, onboarding assumptions, latency underestimation, and undefined quality gates are structural challenges across AI-native products in high-stakes verticals. The errors themselves are not unusual — what varies is how fast teams find them, name them clearly, and fix them at the architectural level rather than patching symptoms.
Want more? Get one essay per week on venture building, AI-native businesses, and the Brazil opportunity.
Avante Intelligence · weekly · no spam. Or browse the Library