Member-only story
Enterprise Agentic Model | How do I put the AI in the API?
83% of the internet traffic is behind APIs!
Imagine that. All the business logic and intelligence are behind that API wall.
Exposing these rich actions (HTTP GET/POST/PATCH/DELETE) over LLM's utilizing upgraded tools like function calls, will accelerate the vision for LAMs (Large Action Models) if we can interact with all those APIs.
We already have this capability of functional calling, so what is new? Function calls have been tools in LLMs since early 2023.
What changed is Structured Outputs!
This is the biggest feature in GPT 4–o beta, in my opinion.
What’s different with structured outputs is that function calling wasn’t reliable with exact matches on API parameters in the past. While JSON Schema provided some support, Structured Outputs will make this deterministic, compared to the JSON mode option before Aug ‘24.
With Structured Outputs it is. So, I can confidently run actions and tasks or even chain them together to build a pipeline of processes! Apple Intelligence is about Actions.
So, let’s dig into the code!
