Search
Mobile menu Mobile menu
AI Strategy , Data science & AI Aug 20, 2026

Algorithmic Progress Is Quietly Outpacing Your Data Strategy

VECTOR Labs Team
VECTOR Labs Team
Algorithmic Progress Is Quietly Outpacing Your Data Strategy
Last updated on: Aug 20, 2026

The dominant assumption behind most enterprise AI roadmaps built over the last three years is that proprietary data is the primary defensible asset. Accumulate enough of it, clean it well, and you have a moat. That logic made sense when model architectures were relatively stable and the marginal gain from better algorithms was modest compared to the gain from more data. Neither condition holds cleanly in 2026, and the investment implications for engineering and data leaders are worth examining directly.

The Greenblatt Thought Experiment and What It Reveals

The Greenblatt framing asks a pointed question: if you hold data constant and allow only algorithmic improvements to vary, how much of observed model performance improvement do you recover? The answer, across multiple capability domains, is a substantial share. This is not a theoretical curiosity. It is a direct challenge to the capital allocation logic that sent billions into data lake infrastructure, labelling pipelines, and proprietary dataset accumulation.

The mechanism matters here. Algorithmic progress compounds through better training objectives, improved post-training methods such as reinforcement learning from human feedback and its successors, architectural changes that extract more signal from the same token budget, and inference-time compute strategies that shift capability from training to deployment. Each of these improvements applies to whatever data you already have. The data does not need to grow for the model to get meaningfully better.

The commercial implication is that teams who built their moat argument on data volume alone may have underestimated how much of the performance gap they were attributing to data was actually attributable to the model and training regime sitting on top of it.

Why Data Moats Are Weaker Than They Appeared

Data moats rest on two conditions: the data must be genuinely proprietary, and the model must not be able to substitute for it through other means. Both conditions are eroding.

Synthetic data generation has matured to the point where high-quality training signal can be produced at scale without proprietary corpora in many domains. Distillation from frontier models, combined with careful filtering, has allowed smaller organisations to close capability gaps that were previously assumed to require years of data accumulation. This does not eliminate the value of domain-specific data, but it does compress the lead time that proprietary data was supposed to guarantee.

The second erosion is more subtle. As foundation models improve, the marginal value of additional domain-specific fine-tuning data decreases for tasks where the model already has strong priors. The cases where proprietary data remains genuinely decisive are narrowing: they are concentrated in domains with highly idiosyncratic structure, regulatory constraints on data sharing, or where ground truth labels require expensive expert annotation that cannot be replicated synthetically.

Where Algorithmic Investment Actually Compounds

If data accumulation is not the primary driver of durable advantage, the question becomes what is. The answer is not simply "better models" in the abstract. It is the organisational capability to evaluate, adopt, and adapt algorithmic improvements faster than competitors.

Evaluation Infrastructure

The bottleneck for most enterprise teams is not access to better models. Frontier models are increasingly accessible via API or open weights. The bottleneck is the ability to evaluate whether a new model or training method actually improves performance on the specific tasks that matter commercially. Teams without rigorous internal evaluation infrastructure cannot tell whether a new release is genuinely better for their use case or simply better on public benchmarks that do not reflect their workload.

Post-Training Agility

Post-training methods, including instruction tuning, preference optimisation, and reinforcement learning with process-level reward signals, are where a significant share of practical capability gains are now concentrated. We have written previously about progress advantage as an annotation-free step-level scoring signal derived from RL post-training, and the degree to which it changes what is achievable in long-horizon agentic tasks. Teams that can run these methods internally, rather than waiting for a vendor to incorporate them into a hosted product, compress the adoption cycle from months to weeks.

Architecture Selection Cadence

Mixture-of-experts architectures, speculative decoding, and inference-time compute scaling have each materially changed the cost-performance frontier in the last eighteen months. The teams benefiting most are those with the internal fluency to evaluate architectural trade-offs and the infrastructure to test them without full retraining cycles. We covered the evaluation framework for this in our piece on training infrastructure as a competitive moat.

What This Means for Capital Allocation

None of this argues for abandoning data infrastructure investment. Domain-specific data remains valuable, particularly where it captures proprietary signals that synthetic generation cannot replicate, such as internal transaction histories, customer behaviour sequences, or annotated outcomes from proprietary workflows. The argument is about concentration and sequencing.

The reallocation question for a CTO is whether the next incremental dollar spent on data pipeline capacity would generate more return than the same dollar spent on model evaluation tooling, post-training capability, or internal research headcount with the depth to track and implement algorithmic advances. For most enterprise teams, the honest answer is that the marginal return on data infrastructure has declined relative to the marginal return on model agility.

The practical test is straightforward. If your team cannot currently evaluate whether a new open-weight model release outperforms your existing deployment on your own tasks within two weeks of release, you have an evaluation infrastructure gap. That gap costs more than the data pipeline ticket you are currently deprioritising.

Rebalancing Without Abandoning What Works

The rebalancing we are describing is not a pivot away from data discipline. Teams that have invested in clean, well-governed, domain-specific datasets retain a real advantage, particularly in regulated industries where data provenance and auditability are non-negotiable. The point is that data quality and governance are necessary but not sufficient conditions for AI advantage in 2026.

The teams that will compound their position over the next two to three years are those that pair strong data foundations with genuine algorithmic agility: the ability to evaluate new methods quickly, adopt post-training improvements without full retraining cycles, and build internal research capability that does not depend entirely on vendor roadmaps. That combination is harder to replicate than a data warehouse, which is precisely what makes it a more durable source of advantage.

Where Vector Labs Fits

We build and evaluate production ML systems for enterprise teams reassessing where their AI investment should be concentrated. In our work with a large retail bank on churn prediction, described in detail at vector-labs.ai/case-studies/banking-churn-prediction, the performance gains that mattered commercially came from model architecture selection and feature engineering discipline, not from data volume alone. If you are working through a similar reallocation question, we are happy to think through it with you at vector-labs.ai/contacts.

FAQs

Does this mean we should stop investing in proprietary data collection?

Not categorically. Proprietary data retains genuine value in domains where it captures signals that cannot be replicated synthetically, such as internal behavioural sequences, annotated outcomes from proprietary workflows, or regulated datasets with strict provenance requirements. The argument is about concentration: if your current allocation heavily favours data infrastructure over model evaluation and post-training capability, that balance is worth revisiting. The question is whether the next incremental dollar in data pipeline capacity generates more return than the same dollar in model agility.

How do we assess whether we have an evaluation infrastructure gap?

A practical test is cycle time. If your team cannot evaluate whether a new open-weight model release meaningfully outperforms your current deployment on your own tasks within two weeks of that release, you have an evaluation gap. The underlying causes are usually the absence of task-specific benchmark suites built from real production workloads, insufficient tooling to run comparative evaluations at the inference cost and latency constraints that matter commercially, and a lack of internal headcount with the depth to interpret results beyond public benchmark scores.

What does post-training agility actually require in practice?

At minimum, it requires the compute and tooling to run instruction tuning and preference optimisation on models in the 7B to 70B parameter range without depending entirely on a vendor's hosted fine-tuning service. Beyond that, it requires internal familiarity with the current state of post-training methods, including reinforcement learning approaches that use process-level reward signals rather than outcome-only feedback. Teams that rely entirely on vendor roadmaps for post-training improvements will consistently adopt capability gains months after competitors who can run these methods internally.

How should we think about synthetic data as a substitute for proprietary corpora?

Synthetic data is not a universal substitute, but its scope of applicability has expanded significantly. For tasks where the model needs to learn a reasoning pattern or a response style, high-quality synthetic data generated through distillation and careful filtering can close much of the gap that proprietary data was previously assumed to cover. Where it does not substitute well is in domains where the signal is genuinely idiosyncratic to your data, such as specific customer behaviour patterns, proprietary financial signals, or annotated outcomes that reflect expert judgment your organisation has accumulated over time.

What internal research capability is realistic for an enterprise team that is not a frontier lab?

The goal is not to replicate frontier lab research. It is to maintain enough internal depth to evaluate and implement published advances without a six-month lag. Practically, this means having engineers who read the relevant literature and can assess whether a new method applies to your workload, combined with the infrastructure to run controlled experiments. A small team with genuine depth in post-training methods and evaluation design will consistently outperform a larger team that relies on vendor announcements as its primary signal of what is possible.

How do we make the case internally for rebalancing investment away from data infrastructure?

The most credible internal argument is an empirical one. Run a structured comparison: take your current best model deployment and measure how much of its performance gap relative to a frontier model is attributable to data limitations versus model and training method limitations. In most enterprise settings, this analysis reveals that the binding constraint is not data volume but evaluation rigour and post-training method quality. That finding, grounded in your own production workload, is more persuasive to a CFO or board than a general argument about algorithmic progress.

A team that understands you
With 20+ years of experience in the world's leading consultancy companies, implementing AI and ML projects in industry-specific contexts, we are ready to hear your challenges.
Subscribe to our newsletter for insights and updates on AI and industry trends.
By clicking "Sign me up", you agree to our Privacy Policy.
By clicking the Accept button, you are giving your consent to the use of cookies when accessing this website and utilizing our services. To learn more about how cookies are used and managed, please refer to our Privacy Policy and Cookies Declaration