We earn commissions when you shop through links on this site — at no extra cost to you. Learn more

Back to all essays
George's TakesOwn Your Tech

Closed Orchestrators Will Commoditize. Open Ones Will Compound.

·5 min read
George Pu
George Pu$10M+ Portfolio

28 · Toronto · Building to own for 30+ years

Closed Orchestrators Will Commoditize. Open Ones Will Compound.

Two AI infrastructure announcements landed in the same week.

Ours was a model. We released flash-1-mini — a 4-billion-parameter bilingual Canadian legal AI — under Apache 2.0, alongside an open benchmark (CBLRE), an open training corpus, and the methodology behind both.

The model runs on a MacBook.

It runs on a Raspberry Pi.

The weights are downloadable. You own the file.

Perplexity's was an orchestrator.

At Intel's Computex keynote in Taipei, CEO Aravind Srinivas demonstrated what the company calls the first hybrid local-server inference orchestrator:

Software that decides, in real time and mid-task, which parts of an AI workload run locally on your device and which route to frontier models in the cloud.

A local model flags what's sensitive and keeps it on the machine; everything else goes to the cloud.

It's closed-source.

The routing logic is proprietary.

Perplexity is valued at around $20 billion, with annual recurring revenue north of $450 million.

Two announcements. Two different positions on the same emerging stack.

The two layers

For three years the AI conversation has been about the model.

Which lab built the best one, which scored highest, which would be the national champion. That conversation is ending.

A model is a file. Files commoditize.

The frontier model that first did something specific cost tens of millions to train; the open-weight model that matches it on a narrow task can be fine-tuned for a tiny fraction of that, and the fraction shrinks every quarter.

Within a few years every developed economy will have open-weight models in every capability class that matters.

The model layer is becoming infrastructure — important, but not where the durable position sits.

The position is one layer up: orchestration.

It decides which model runs which task. Whether your request stays on your device, runs in your country's cloud region, or routes to a global hyperscaler.

What data crosses what border. What gets logged, verified, retained.

That's the layer Perplexity just planted a flag in.

It's also where the next decade of value in AI accumulates.

The only question that matters is whether that layer is closed or open.

Why closed orchestrators commoditize

Perplexity's orchestrator makes the routing call for you.

A local model decides what's sensitive, the proprietary logic decides what leaves your device, and you accept those decisions — including the privacy model, the compliance posture, and an audit trail you can't see.

For a lot of buyers that's fine. For others it's a problem.

A government that needs to specify which workloads stay inside national borders can't inspect or modify a black box.

A regulated firm that has to show an auditor why a given data classification went to a given compute environment has a compliance gap.

Closed routing logic is structurally harder to audit than open routing logic — and the regulatory direction, from the EU AI Act to Canada's draft strategy to every sovereign-cloud framework, pushes toward auditability.

Then there's the open-source clock.

Every feature a closed service ships in version 1.0 gets mapped and reproduced by the open community on a predictable lag.

Closed Unix became open Linux.

Closed frontier models became a wall of open weights that now match them on most tasks.

The closed product is the R&D advance team for its open equivalent.

Once a credible open orchestrator exists, the marginal cost of routing logic falls toward zero, and the orchestrator stops being the product — it becomes a feature of whatever's around it.

None of this means Perplexity fails.

Closed services can hold a layer for decades on user experience and switching costs alone — Windows and Adobe both prove it, and Perplexity will likely build a real, successful business here.

But holding a layer and owning the durable position underneath it are different things.

Why open orchestrators compound

The open layer is the substrate.

It's what the closed orchestrators, the picked champions, the regulated buyers, the researchers, and the builders who haven't started yet all build on top of.

If you're finding this useful, I send essays like this 2-3x per week.
·No spam

It sits below the competitive layer and above the commodity layer — which is the only place a small team can hold ground against a $20-billion company.

For orchestration specifically, that substrate is four things:

  • a reference architecture for hybrid local-cloud routing,
  • an open routing engine anyone can fork,
  • an open methodology for evaluating routing decisions, and
  • an open compliance framework regulated buyers can adopt without lock-in.

None of it exists comprehensively yet. It will. That's the layer we're building.

What we shipped, and what's coming

flash-1-mini is the proof at the model layer: a specialist Canadian legal AI, built by five people in Toronto, deployable openly, running on consumer hardware.

CBLRE is the proof at the evaluation layer: vendor-neutral benchmarking for regulated Canadian AI, released openly, usable against any model today.

In July we plan to ship flash-1 (9B).

In September, we plan to ship flash-1-pro (27B) — and alongside it the Reference Orchestration Layer v1.0: open code showing how to run flash-1-pro in production legal workflows.

Citation verification, multi-model routing, audit-trail generation, human-in-the-loop checkpoints. Apache 2.0, frozen at release.

Fork it and build your own orchestrator on top.

To be clear about what that is and isn't: it's not a competitor to Perplexity.

We are not running a half-billion-dollar commercial orchestration service.

We're publishing the reference logic anyone can build one from.

So when a Canadian regulated buyer needs auditable open routing for procurement, or a European government needs to pin workloads to EU data centres, the open infrastructure already exists.

The closed orchestrator can win on user experience for years.

The open substrate compounds in the background until it's the thing everything else stands on.

Why this is a Canadian moment

The federal AI strategy reported this week directs the Major Projects Office to build sovereign cloud capacity, taps the $25-billion Canada Strong Fund to take stakes in AI companies, proposes procurement preference for Canadian vendors, and puts additional capital behind compute access.

Most of that flows to closed, picked-champion mechanisms.

That's one position. It isn't the only one.

A Canadian institution deploying AI for regulated work in 2027 faces a choice: pay for closed proprietary orchestration that may or may not clear compliance, or deploy open orchestration that's auditable end to end, runs on Canadian infrastructure where required, and routes to global cloud where it doesn't.

The open path needs open infrastructure to exist by then.

That's what we're building toward.

In three weeks we put a public demo of flash-1-mini on Telus H200 capacity in Rimouski, Quebec.

Canadian sovereign compute, open weights, open evaluation, auditable routing — the whole stack, in production.

Not a sandbox. Actual inference on Canadian infrastructure.

The thesis

Models commoditize fast.

Orchestration software commoditizes slower, but it commoditizes.

The open infrastructure underneath both compounds over a decade.

Perplexity is building one position, and a real one — they'll probably win the headlines and a good business with them.

We're at a different layer, shipping the open substrate anyone, including Perplexity, can build on.

The closed orchestrators get the coverage. The open infrastructure gets used.

Closed orchestrators will commoditize. Open ones will compound.

A small team in Toronto. Apache 2.0. Not VC-funded. Canadian government R&D backing.

AI you can own.

Share this: