Guest Blog: From Jeff Miller, CEO of Australian Drilling Industry Association (ADIA)
Recently, Betty moved to a new generation of models — faster, smarter, and more cost-efficient than what we were using before. On the surface, that sounds like a routine upgrade.
In reality, it represents something more important:
When models improve, the ceiling on what’s possible rises with them.
And that creates a compounding effect over time.
Defining the Real Metric: Knowledge Per Second
When evaluating AI systems, it’s tempting to focus on model benchmarks, parameter counts, or headline claims about intelligence.
But for associations, those metrics are secondary.
The real question is:
How much trusted, usable knowledge can we deliver to a member in a given amount of time?
That is what we call knowledge per second.
It’s not about raw token speed.
It’s not about how large a model is.
It’s not about scoring highest on abstract reasoning benchmarks.
It’s about outcomes.
If a member asks a question and receives:
- A grounded answer,
- Accurately sourced,
- Contextually appropriate,
- Delivered without friction,
- Deliver the same quality answer more quickly.
- Use that additional speed budget to do more work behind the scenes while delivering the answer in the same amount of time.
- Better interpret nuanced governance language.
- Reduce edge-case failures.
- Decrease the need for follow-up clarification.
- Improve confidence in complex responses.
- Higher usage without hesitation.
- Broader deployment across workflows.
- More generous context evaluation.
- Fewer artificial constraints on where intelligence can be applied.
- Understanding becomes sharper.
- Retrieval becomes more precise.
- Reasoning becomes more consistent.
- Communication becomes clearer.
- Personalization becomes more contextual.
Then knowledge has been successfully transferred.
Knowledge per second measures how efficiently that transfer happens.
More trusted knowledge.
Less time.
Less friction.
That is the north star.
Why Model Advancement Changes the Equation
Once you define the goal that way, model advancement becomes much more meaningful.
When a model becomes faster, you gain options.
You can:
Or—
Speed isn’t just about responsiveness.
It’s about capacity.
If you can process more context, perform deeper reasoning, or validate more thoroughly within the same response window, you increase knowledge quality without increasing perceived latency.
Knowledge per second rises.
When a model becomes smarter, you gain reliability.
Stronger reasoning can:
That reduces friction in the interaction.
Members get what they need the first time.
Knowledge per second rises again.
When a model becomes more cost-efficient, you gain scale.
Cost efficiency allows:
Cost isn’t just a finance metric.
It determines how much intelligence you can responsibly apply across your ecosystem.
And when intelligence can be applied more broadly, knowledge per second increases at the system level.
Continuous Improvement, Layer by Layer
The most powerful aspect of model advancement is that it doesn’t require a total reinvention.
It allows for incremental elevation.
As models improve, any portion of the system can improve:
Each improvement may be small in isolation.
But over time, they compound.
Faster responses.
More accurate synthesis.
Greater contextual awareness.
Fewer breakdowns.
The result is not just better AI.
It is a continuously rising baseline of knowledge delivery.
Raising the Ceiling Over Time
There will not be a final, stable moment where models stop advancing.
The pace of improvement suggests the opposite.
Context windows expand.
Latency drops.
Reasoning strengthens.
Multimodal capabilities grow.
Each advancement redefines what can be done within the same interaction window.
A question that once required tradeoffs can now be handled seamlessly.
An answer that once required simplification can now incorporate richer context.
A response that once took several seconds may now be delivered instantly — or enhanced without additional delay.
Every time the underlying models improve, the potential knowledge per second increases.
The ceiling moves upward.
What This Means for Betty
Moving Betty to a newer generation of models was not about chasing novelty.
It was about raising that ceiling.
Faster models allow us to either respond more quickly or do more cognitive work within the same time window.
Smarter models allow us to reduce friction and improve trust.
More efficient models allow intelligence to be applied more broadly and consistently.
Together, those improvements increase the amount of trusted, usable knowledge that can be delivered to members — per interaction, per moment, per second.
And because model advancement is ongoing, this is not a one-time gain.
It is a continuous curve.
The Permanent Advantage of Progress
AI is not a static capability.
It is an advancing frontier.
Each generation of models opens the door to refine, enhance, and elevate how knowledge is delivered.
For associations, that means the member experience does not have to remain fixed.
It can improve — steadily, invisibly, and continuously.
More clarity.
More depth.
More responsiveness.
Less friction.
That is what model advancement truly unlocks.
Not just better models.
But a steadily increasing rate at which trusted knowledge reaches the people who need it most.
And that curve is only accelerating.