Index

The LLM Software Frontier

It feels like every other company now is battling over convincing clients to upload knowledge sources to their platform. It's understandable, LLMs' answers are only as relevant as the context they have on the question they seek to answer.

Context in this sense is the intelligence an LLM has over your product. It can be learned, and it's in the interest of every company to extract it from its most tenured employees such that it's persisted and permeated throughout the company. e.g. you want to capture what your best salesperson does, their workflows and automations, so other salespeople in the team can copy and learn.

Providing low friction ways for companies to gain this knowledge is where it's at. The Schelling point then becomes the knowledge base and keeping it in sync. Then the key is how to deploy and use it with the right harness in each use case.

Each harness has its own third party connections that augment the LLM's capabilities. Things the agents cannot figure out by themselves because they are dependent on the environment, so they need to know how to find/figure out. I expect that most of these tools will be ripe for disruption if they don't adopt a pay-per-use strategy. For example:

  • Social media planners need to schedule posts, find new innovative ways of conveying a message based on new trends, see analytics on their post performance, etc.
  • SEO planners need tools to do keyword analysis, access to your analytics and Google console to see how well you're doing, etc.

How can we best capture the company know-how? How is it shared across company teams with proper permissions and sandboxing and agent loops? Most interesting approaches to this come from low friction and high information density.

It's clear that tools that are first used to augment human work can then gain know-how on that specific application and automate it away. The key question is then, what can't be automated away? Right now that is work that requires judgement, or work where regulation prevents it. These are the sections where copilot-like tools will accrue most value, as they cannot be automated.