The Threshold Report
← Threshold Report

What’s Real

Video+10Sep 1

Image: The Threshold Report/GPT Image 2

Visko opens public access to Orbis, a steerable live video model

Generated video normally means submitting a prompt and waiting for a finished clip. Visko opened public access to Orbis yesterday, a model that streams video as it makes it and accepts new instructions while the picture keeps moving. The company says it runs at 4K and 24 frames per second and can keep generating for hour-scale sessions. That kind of live control fits simulation work, interactive media, and producing synthetic footage to train robots.

Agents+5Text+2Sep 1

Image: deepmind.google

Google adds agentic video understanding to three Gemini Flash models

Feeding a long video to a model has meant sampling it at a fixed number of frames per second and paying for all of them, most of which show nothing. Since yesterday, Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite can instead pick which frames, audio, and transcript sections to inspect while working through a question. Google reports up to 88% lower token use, 66% lower cost, and 7% higher accuracy from the change, at normal Gemini API token rates with no separate feature fee. A developer hunting a two-second event in hours of recordings, counting how often an action repeats, or checking an anomaly no longer has to build the sampling pipeline first.

Agents+2Text+2Sep 1

Image: openai.com

ChatGPT for Healthcare can now pull records from Epic

Yesterday, OpenAI connected ChatGPT for Healthcare to supported Epic electronic health record environments, so the assistant can retrieve authorized patient context: visit notes, lab results, medication lists, and specialist documentation. A clinician can ask for a patient's timeline or what has changed recently and follow the answer back to the notes and results it came from. OpenAI also added a Healthcare Public Data plugin reaching nine official sources, among them PubMed, DailyMed, ClinicalTrials.gov, CMS Coverage, and RxNorm. Research and pharmacy staff can line up trial, drug, and coverage records inside the same governed workspace.

Agents+2Sep 1

Image: The Threshold Report/GPT Image 2

Mercor publishes a 397B knowledge-work agent and its training recipe

Mercor published the weights, evaluation traces, and a public SkyRL training recipe for its Qwen-based office-work agents yesterday. After training on 1,928 tasks written by human experts, its 397-billion-parameter model went from 16.11% to 27.29% on Pass@1, meaning success on the first attempt, at Mercor's held-out APEX-Agents test, which sets an agent to work across files, email, chat, slides, and other simulated office tools. Because the recipe and the infrastructure choices behind it are public, other teams can copy or adapt the method, including the parts that keep long tool-using reinforcement-learning jobs from falling over.

SOURCES · mercor.com
Audio+2Sep 2

Image: research.meta.ai

Meta releases Muse Voice Transcribe for live multilingual transcription

Anyone building live captions or meeting notes has usually had to bolt one system that turns speech into text onto a second that works out who is speaking. Meta released Muse Voice Transcribe today, a streaming model that does both at once and also detects when a speaker has finished. It handles code-switching, meaning a speaker moving between languages mid-conversation, across 25 languages Meta says it validated extensively, and Meta says it can label more than 20 speakers and keep running on audio longer than an hour. Supplying names, places, or specialist terms in advance improves how the model hears them.

SOURCES · research.meta.ai
Image+2Sep 1

Image: blog.google

Google starts rolling out Pics, an AI image editor for Workspace

Google Pics, a standalone image generator and editor built on the Nano Banana model, began reaching users yesterday. It can isolate a single object in a picture and change it, rewrite or translate text inside an image, and produce several variations at once, and it runs inside Google Docs and Slides. Someone assembling a deck or a marketing one-pager can fix the visual in place instead of moving it out to a design tool and back. Pics files can be shared, so two people can work on the same edit.

Compute & Infra+2Sep 2

IBM's Granite time-series models arrive in Confluent Cloud early access

IBM's Granite time-series models went live in early access inside Confluent Cloud today, where forecasting and anomaly detection can be called straight from Flink SQL, the query language used against those live streams. Teams watching sensor readings, transactions, or application metrics move past them have generally had to stand up and host a separate model-serving setup to do that. Predictions and flagged anomalies can be written back to Kafka topics (the streams other systems subscribe to) and picked up by alerts, dashboards, and downstream jobs. Coverage is Confluent Cloud on AWS for now, with Confluent Platform support planned for on-premises and hybrid installations.

SOURCES · huggingface.co
Compute & Infra+2Sep 2

Researchers build a solid-state cooler driven by waste heat

Cooling a chip normally costs electricity, spent on fans, pumps, and compressors. Researchers at the Karlsruhe Institute of Technology and the University of Tsukuba reported a prototype today that runs on heat instead, using one nickel-titanium film to turn heat into motion and a second film to do the cooling. With the actuator at 86°C, it produced a 4°C temperature difference at the component, with no electric motor in the loop. Waste heat coming off a processor is the kind of input the design is meant to run on.

1 of 8

Curious whether AI can do something yet? Submit a question and we’ll track it for you.

See the board

Security

Money Moves

The AI stocks Wall Street fund managers are adding, trimming, or dropping.

Open the tracker for the latest holdings.

Open Market Watch

Who invests in, buys, supplies and powers whom across AI.

Open AI Entanglements
AgentsSep 1

Image: openai.com

OpenAI rates unreleased Astra model Critical for cyber capability

OpenAI says Astra, a model it has not released, is the first it rates at the Critical cybersecurity capability threshold, meaning that with suitable tools and access it can find previously unknown software flaws and build them into exploit chains against many hardened systems. The company says it delayed parts of Astra's development and release after the Hugging Face incident. It restarted a paused large reinforcement-learning training run on August 28, 2026, after adding isolation, monitoring, and alignment controls. By OpenAI's own account, finding and chaining unfamiliar flaws is moving into what a model can do with much less human direction.

Positive - OpenAI paused Astra’s development until stronger isolation, monitoring, and alignment controls were in place, then limited its critical cyber capabilities to selected testers.
AgentsSep 1

Image: blogs.nvidia.com

CrowdStrike ships SafeMind agents inside its Falcon platform

CrowdStrike shipped SafeMind into its Falcon platform yesterday, pairing post-trained NVIDIA Nemotron models with agent harnesses (that is, the scaffolding that decides which tools an agent may call and when) built for security work. NVIDIA says the system was exercised in a simulated copy of NVIDIA's own network, with one set of agents hunting for attack paths and another writing and validating the detections meant to catch them. For a security team, the offer is investigation, prioritization, and remediation help running at machine speed under vendor management. Customers can also run the models on their own or plug their own models into CrowdStrike's harnesses.

Positive - CrowdStrike tested offensive and defensive agents in a simulated network before deploying the resulting detection system through Falcon.
SOURCES · blogs.nvidia.com
TextSep 1

Image: anthropic.com

Anthropic releases Claude Fable 5.1 and cuts cached-context price 75%

Anthropic released Claude Fable 5.1 yesterday and dropped the price of reading cached context to $0.25 per million tokens, 75% below what Fable 5 charged. Agents that keep rereading the same code, documents, and tool definitions across a long session pay for that repetition, so the cut lands on exactly the kind of hours-long coding and research work companies are running. Anthropic says the model's new cyber safeguards let it identify software vulnerabilities while withholding exploit development, which leaves defensive work available to security teams on the generally available model. The company also says that after reporting cyber-evaluation incidents on July 30, it added pre-tool checks (that is, checks run before the model is allowed to use a tool) and stronger isolation before resuming external testing.

Positive - Anthropic added pre-tool checks and stronger isolation before resuming external testing, containing Fable’s vulnerability-finding capabilities behind new safeguards.
TextSep 2

Refusal-stripped open models confirmed far more weak bug reports

Abliterated models, meaning open models modified to strip out their refusals, are popular in security research because they will discuss attacks the originals decline to touch. A clearbluejar analysis reported today ran base and abliterated builds of Gemma and Qwen over FreeBSD source code and found some altered versions confirming far more weak bug candidates than the originals. In one 28-file run, an abliterated Gemma produced 144 candidates and marked 138 of them valid, while missing the known CVE (a publicly catalogued vulnerability) that the base model found. For a team pointing local models at its own code, agreeableness like that buys extra triage work and a real flaw left uncaught.

Positive - Controlled testing exposed that altered open models can confidently endorse weak bug reports while missing a known flaw, giving defenders evidence of their reliability limits.
1 of 4

Other News

TextAug 31

Image: openai.com

OpenAI opens self-service ChatGPT ad buying in more markets

Businesses in India, Europe, the Middle East, and North Africa can buy ChatGPT ads themselves through OpenAI's Ads Manager, an expansion OpenAI announced on Aug. 31. The ads already sell in more than 40 countries, until now through OpenAI's own sales staff, agency partners, and technology partners. Advertisers in the newly opened markets skip that managed-sales step and purchase directly. The ad business pays for a free, ad-supported version of ChatGPT that sits alongside subscriptions and API access.

SOURCES · openai.com

Upcoming

Announced or reported, but not yet real or available.

Compute & InfraSep 1

Google buys 396MW from Fervo's Utah geothermal project

Waiting on: Plant completion - Cape Station is under construction and slated to come online in 2028, and Google's possible Utah data center still depends on approvals and commercial conditions.

Compute & InfraSep 1

Cerebras starts building first 50MW of Finnish data-center campus

Waiting on: Construction completing - work has started on the first 50MW phase and nothing is running yet.

Compute & InfraSep 2

AWS targets December for Saudi cloud region, 2028 for AI Zone

Waiting on: Construction and service start - AWS puts the Saudi cloud region at December 2026 and the AI Zone's first 50MW at 2028.

VideoSep 1

World Labs gives select partners early access to Atlas world model

Waiting on: Early-access expansion - Atlas is open to select partners, and everyone else can only request access.