The Amazements and Frustrations of Agents
My day with agents today was a study in contrasts.
The Incredible Find & Fix
It started off incredible. I’ve been having intermittent internet drop outs several times a day for the last few months and had no clue why. They were always very brief, but just long enough to break an active session and I had just come to accept them as a fact of life until some more Starlink satellites were up.
Then this morning, while my infra agent was doing its weekly check of my home automation stack and its logs it flagged that one of the cameras was dropping streams repeatedly. I took it up on its offer to investigate which led it to it discovering that this was happening because Starlink WAN failovers to my secondary connection flush my Unifi router’s connection table and drop camera streams.
Ok, sure, I’ve seen those dropouts happen, its been annoying. And so when it offered to ‘dig in’ to figuring out what was happening, I of course said yes, and what it figured out after about 15 minutes of investigation and testing was that there was an IP conflict between during DHCP refreshes between the internal address from my Starlink and my Tailnet that was causing the dropouts. Another 10 minutes and it had the problem fixed.
Unreal, months of background annoyance and frustration, fixed in minutes because I had an agent just checking logs and it could find correlations and draw upon a store of knowledge orders of magnitude greater than I could ever dream of. It also then proceeded to quickly clean up a bunch of other things in my home automation setup along with improvements I wanted. Truly wonderous.
The Deep Frustration
That was the peak however (and no, I’m not going to complain about Siri again).
Agents are a god send in dealing with travel stuff. For instance, I had it set an alert on ExpertFlyer earlier today that just snagged me a major seat upgrade for my flight tomorrow. But that was done with me at my computer when I could log it in and I’m heading back out on the road soon and I really want my agents to be able to access all my travel profiles without me having to be at the computer.
And using a cloud based browser isn’t good enough, too many of them are blocked by services (looking at you United). It needs to be using an actual browser on my local machine.
But damn, if I cannot find a way for the agents to use my passwords to log in to a local browser on my machine. Hell, these are even passwords I’m fine totally exposing and being logged in agent history or a new password manager, it doesn’t matter, they cannot find a workable way to:
1) start a fresh session / login to a site
2) from a browser on my computer
3) while I’m not at the computer to approve it
This isn’t even a technically hard problem, what it did earlier in the day is way more impressive! The ecosystem and interactions just aren’t developed enough yet to support it and too many users don’t understand the consequences of some decisions and so the models and harnesses work really hard to protect you from yourself.
And so I’m slightly resigned to accepting the limitations, waiting till there’s harness updates that work, or maybe just final spinning up a local model with a custom harness and building out whatever I want. I guess we’ll see what happens on my flight tomorrow.
Comments
No comments yet
Leave a comment