tensorfolk

Infrastructure & LLMOps

5 areas, 3 updates so far. Checked every morning.

Google Cloud announces Agent Compute Engine, a microVM per agent session

Google unveiled a service that gives every agent session its own hardware-isolated microVM on Titanium, with quick checkpoint and restore and credentials kept outside the guest. It also open-sourced Agent Substrate for GKE, usable now, and extended its agent gateway and identity controls beyond Google Cloud. The managed service reaches preview in the coming months.

Why it matters: Agent sandboxing is becoming a first-class cloud primitive with stronger isolation than containers.

Bedrock AgentCore Gateway adds InvokeModel routing and automatic model fallback

AgentCore Gateway's inference endpoint now accepts standard Bedrock InvokeModel and streaming calls, so existing SDK code can go through one governed endpoint. Rules can define an ordered list of fallback models used on throttling, server errors or timeouts, and a circuit breaker skips targets that keep failing.

Why it matters: Provider failover moves out of application code into a managed gateway, cutting outages from single-model throttling.