ReviewRadar

KEY UPDATES

Update 1The "Practical Exam" for AI Coding is Here: AWS Turns Real Cloud Service Tasks into Test Papers

On September 4th, Amazon open-sourced a set of test questions called AWS-bench, specifically designed to test how well AI assistants that can write code, modify configurations, and run commands perform in real AWS cloud environments. Previous coding exams mostly involved modifying small snippets of programs; this time, they directly brought tasks like cloud deployment, troubleshooting, and configuration fixes—things that happen daily in companies—into the exam hall, and also allowed vendors to package their models and tools together for testing. Programming Expert · Lao Xu says | The direction hits the nail on the head. No matter how impressive the official demos are, they can't beat a unified environment test paper. But remember the lesson from Huawei's comparative experiment on August 22nd: test scores are just scores, and the scope of questions and environment configurations are all defined by the organizers. Before taking on real projects, it's still the same advice: run it on your own codebase for a week first, don't rush into production environments. Editor Xiao He says | From an ordinary user's perspective, when choosing AI coding tools in the future, besides looking at whose marketing copy looks good, you can wait for another "AWS Practical Exam Report Card." Continuing the old principle I mentioned on August 26th: new test papers should be noted but not entered immediately; wait until the rankings stabilize for one or two rounds before deciding.

Update 2Meta's New Model Hits Global Third Place Three Days After Launch, Price is Only One-Sixth of First Place

LiveBench's real-time leaderboard today shows that Muse Spark 1.3, released by Meta on September 2nd, scored a total of 81.6, jumping straight to third place overall, trailing only Claude's two flagship models (83.4 and 83.0). What's even more striking is the cost: it averages $0.219 per successful task, while the number one ranked Claude Fable 5.1 costs $1.212, nearly six times higher. On Artificial Analysis's Intelligence Index leaderboard on the same day, it scored 62 points, entering the top tier, and its ultra-high-speed version remains the fastest output among the leaders, at 182 tokens per second (tokens are the character units used for AI pricing and output). Product Expert · A Zhe says | In yesterday's issue, I said the battle for entry points has shifted from "who is strongest" to "who is most worth using." Meta is throwing punches with both fists here: proving capability on the leaderboards and flipping the table on price. Last round, their Muse Spark 1.2 made headlines with a data-sharing discount plan offering 1.3-8% off list price; this time, the new version directly slots into third place among the top tier. The key point is whether other vendors will respond to the pressure of three leaderboards simultaneously driving down prices. As usual, newly ranked positions tend to fluctuate, so note it down first. Editor Xiao He says | With such a low price, my first reaction was to try writing weekly reports with it. But following the rule I set on August 28th, no matter how cheap it is, someone needs to empirically test that it's "not stupid" before I recommend it. How Meta's AI uses data and what account permissions are granted are still unclear to ordinary people, so let's wait for third-party reviews first.

Update 3A skill that makes "AI speak short sentences" goes viral, claiming 42% token savings

A skill that makes "AI speak short sentences" goes viral, claiming 42% token savings. A developer created an optional response style called Macha, prompting AI to speak in concise sentence structures typical of South Indian English, claiming an average saving of 42% of tokens (the smallest billing unit for AI; fewer words mean lower bills). The money-saving idea is as simple as saving fuel in cars, but whether speaking 42% less will also omit critical information has not yet been verified through controlled experiments.

Update 4Renting a "workstation" Linux host for AI

Renting a "workstation" Linux host for AI. Developers open-sourced Kovavue: any agent that speaks the MCP protocol (a universal docking language between AI tools) can rent a dedicated Linux machine managed by the provider, operating on it like a real person, with accounts handled via signature custody. Instead of letting AI borrow your computer to work, give it a rented machine that won't hurt if it breaks; permission isolation is the ticket for agents to enter production.

Update 5Open-source software sets "traps" for AI crawlers

Open-source software sets "traps" for AI crawlers. Maintainers of NetworkManager, a Linux network management component, launched a mechanism hiding "canary" markers visible only to programs within documentation; if AI agents scrape content without adhering to authorization policies, citing them will expose the violation. This turns "whether AI follows the rules" into detectable evidence, as the open-source community begins building its own audit tools.

Update 6Montgomery, a visual training toolbox written in Rust, is open-sourced, allowing object detection and image segmentation training on ordinary GPUs; it is experimental in nature

Montgomery, a visual training toolbox written in Rust, is open-sourced, allowing object detection and image segmentation training on ordinary GPUs; it is experimental in nature. It's still far from ordinary users, but the fact that "visual model training is no longer exclusive to the Python ecosystem" is a positive signal for edge-side AI hardware.

Update 7Who decides "AGI is here"? OpenAI claims "The AGI era has arrived" alongside its new model, while The Verge podcast dissects each company's definitions point by point

Who decides "AGI is here"? OpenAI claims "The AGI era has arrived" alongside its new model, while The Verge podcast dissects each company's definitions point by point. There is still no universally accepted exam for AGI, so anyone can draw lines based on standards favorable to themselves. Treat "breakthroughs" without public exams as marketing first.

Update 8AI coding modifies code, but git can't explain why

AI coding modifies code, but git can't explain why. A new tool called Casefile records the context of every AI code modification, allowing code history to explain commits involving AI participation. As AI output increases, "who changed it and why" has become a new pain point for teams.

Update 9Empirical test of Google Slides' AI beautification feature

Empirical test of Google Slides' AI beautification feature. The author used it to beautify slides, resulting in the entire page being returned as a non-editable image, impossible to modify. The author has a competitive stance against Google, so discount the conclusion, but the pitfall of "AI features turning editable objects into dead images" is real; back up important files before clicking beautify.

Update 10Giving AI philosophy exams

Giving AI philosophy exams. A developer initiated an AI philosophy competition, arguing that while large models are getting stronger in math and coding, subjects like philosophy, which have no standard answers, lack test creators. Philosophy exams inevitably carry subjectivity, so scoring rules are more important than scores, but the next battlefield for AI evaluation is indeed questions that "cannot be automatically graded."

Update 11Hours of training enable humans to recognize AI-generated faces

Hours of training enable humans to recognize AI-generated faces. An experiment at the University of Southampton showed that after brief training, participants' ability to identify AI faces improved significantly, whereas ordinary people's recognition rate for AI face-swapping was previously close to guessing. AI face forgery evolves much faster than detector updates; rather than relying on platforms, spend an hour training your naked eye.

Update 12Reverse AI: AntiAgent makes machines ask questions, humans think

Reverse AI: AntiAgent makes machines ask questions, humans think. This product reverses the relationship of "humans giving instructions to AI": AI is responsible for asking sharp follow-up questions, and humans are responsible for thinking and answering, targeting scenarios where "procrastination often stems from unclear thinking." In an era where everyone practices prompt engineering, some are starting to doubt the direction; regardless of whether this experiment succeeds, it's worth a look.

📖 Full leaderboard tables and expert commentary live in the Chinese edition of the review magazine.