ReviewRadar

KEY UPDATES

Update 1Received a text or email from "Amazon"? Now you can make their AI prove it's real

On September 2, Amazon added a new feature to its shopping AI assistant, Alexa for Shopping: show it the texts, emails, or call details you received, and it will cross-check against "the archive of all messages sent by Amazon," analyze the content, format, and sender, and tell you if it's officially from them. Scammers impersonating e-commerce platforms with "package anomaly" phishing messages is a major issue; this is like adding a authenticity query portal for the most frequently impersonated platform. One detail: it only confirms something is real when it is "100% certain"; if unsure, it directs you to check orders in the official app or contact customer service. Earlier this year, Amazon also launched a companion feature: forwarding suspicious emails to verify@amazon.com for verification. Security Expert · Old Zhou says | The direction is right, but let me say the ugly truth upfront: letting the "impersonated party" act as the "referee" creates an inherent conflict of interest. If it says it's real, that's mostly credible; but if it says it's fake, do you just ignore it? What if the archive isn't synced and it falsely flags a real message as fake? The user still takes the blame. For regular folks: treat it as a reference tool, not a judge. If the AI says it's real but involves payment, still go into the app yourself to verify; if it says it's fake, blocking it is fine. This kind of "official verification" will likely be followed by banks and courier services next. Editor Xiao He says | I receive two or three fake "package anomaly" texts from scammers every week. Before, I could only guess by looking at the domain. Now there's an official verification portal, which is great. But I remember Old Zhou's point about the "athlete acting as referee." I'm adding one rule: if it judges something as "real" and money is involved, I'll still check the app myself; if it judges it as "fake," I delete it immediately. That way, I don't lose either way.

Update 2Three companies mass-produced 210,000 pages of "Best Software Recommendations" for AI; turns out AI answers were just advertising for them

You ask AI "which accounting software is good," and the recommendation list might come from a dedicated fabrication factory. A survey report released on September 2 counted that three websites created a total of 215,128 "Best Software" pages, covering 380 software categories. When the AI search tool Perplexity answers these questions, 59.8% of the sources cited come from these mass-produced pages. In other words, more than half of the "universal praise" quoted by AI was wholesaled off an assembly line. Product Expert · Ah Zhe says | We've heard "the entry point is the model" many times, but this works in reverse: the content fed to the entry point is mass-fabricated, so the answers given by the entry point become someone else's billboard. Previously, you could buy search engine rankings; now, you can manufacture AI recommendations. Next time you see AI recommending software, first ask who made the original pages it cites. Editor Xiao He says | This deepens what I said in the August 30 issue about "clicking through and verifying material links before forwarding." Now even the conclusions AI has "verified" for me are themselves mass-produced. The solution for regular people is crude but effective: ask the same question to two or three different AIs. If the recommendation lists don't match, there's fluff involved.

Update 3Lean Mathematical Proof Leaderboard launches, 207 problems to see which AI can solve theorems that scare humans. Lean is a tool mathematicians use to write proofs as code, allowing machines to check them line by line; the barrier to entry is extremely high

Lean Mathematical Proof Leaderboard launches, 207 problems to see which AI can solve theorems that scare humans. Lean is a tool mathematicians use to write proofs as code, allowing machines to check them line by line; the barrier to entry is extremely high. The new leaderboard brings AIs together to solve real problems. Axiom's prover solved 207 problems, ranking first, and marked each problem with "only who could solve it." Comment: Mathematics has its own "absolute correctness" grading standard, making this leaderboard much harder than marketing benchmarks.

Update 4AI judges checking medical records only verify "was it written," not "what should have been written but wasn't." An arXiv paper submitted on August 31 found that when large models grade AI-generated clinical records, they excel at confirming if content exists but systematically miss necessary omissions—for example, they fail to notice if allergy history is missing from a record

AI judges checking medical records only verify "was it written," not "what should have been written but wasn't." An arXiv paper submitted on August 31 found that when large models grade AI-generated clinical records, they excel at confirming if content exists but systematically miss necessary omissions—for example, they fail to notice if allergy history is missing from a record. Comment: "Not written" is more dangerous and harder to detect than "written incorrectly." In the chain of AI auditing AI, the human doctor checkpoint cannot be removed yet.

Update 5A thorough explanation of how to build AI assistant memory, which patterns work, and which are pitfalls. A long article by Machine Learning Mastery outlines engineering patterns for AI memory systems: what should be stored as long-term profiles, what should only be used in the current conversation, and how to retrieve without mixing contexts

A thorough explanation of how to build AI assistant memory, which patterns work, and which are pitfalls. A long article by Machine Learning Mastery outlines engineering patterns for AI memory systems: what should be stored as long-term profiles, what should only be used in the current conversation, and how to retrieve without mixing contexts. It points out common architectural errors. Comment: Read this alongside today's highlight #3 "Memory Health Check Exam"; one explains how to install memory, the other how to audit it.

Update 6**GitHub officially shares money-saving tips; want to save quota when AI writes code?

GitHub officially shares money-saving tips; want to save quota when AI writes code? Start here. The Copilot team published an article on how to reduce AI coding costs without sacrificing quality. The core idea is to have AI read fewer irrelevant files, reuse caches, and break large tasks into small steps that only look at diffs. Comment: Pay-as-you-go users can copy this homework directly: cut redundant feeding first, then complain about model costs.

Update 7Apple opens new tools, letting AI connect directly to Safari to help debug web issues. AI coding assistants can now connect directly to Safari Developer Tools to inspect, test, and debug web pages for you

Apple opens new tools, letting AI connect directly to Safari to help debug web issues. AI coding assistants can now connect directly to Safari Developer Tools to inspect, test, and debug web pages for you. It's like giving AI a real browser to check effects after making changes. Comment: Another piece of official infrastructure for "AI verifying its own results." Front-end developers get to eat first.

Update 8Flawd intentionally buries bugs in code to see if AI tests catch them. New Show HN tool performs "mutation testing": programs automatically introduce small errors into code

Flawd intentionally buries bugs in code to see if AI tests catch them. New Show HN tool performs "mutation testing": programs automatically introduce small errors into code. If existing tests stay green and don't alert, it means the tests are decorative. Comment: Old Xu mentioned in the August 21 issue that "tests are the ruler proving AI output hasn't drifted." This tool measures whether the ruler itself is accurate.

Update 9"AI flows to places where grading is cheap"; an article explains why AI dominates coding first. An engineer's post proposes a filter: industries where AI succeeds need a cheap "grader." Code has compilers and tests as backstops, so it moves fastest

"AI flows to places where grading is cheap"; an article explains why AI dominates coding first. An engineer's post proposes a filter: industries where AI succeeds need a cheap "grader." Code has compilers and tests as backstops, so it moves fastest. Law and medicine require human graders, so AI can only assist. Comment: To judge how fast AI lands in an industry, just ask: who grades mistakes cheaply?

Update 10Counter-intuitive field test: adding more AI assistants to a team actually slows down work. A retrospective on multi-AI collaboration points out common misconceptions: assuming opening more capable AIs leads to parallel speedups

Counter-intuitive field test: adding more AI assistants to a team actually slows down work. A retrospective on multi-AI collaboration points out common misconceptions: assuming opening more capable AIs leads to parallel speedups. In reality, stepping on each other's toes, duplicate labor, and waiting for approvals increase overhead. Comment: This again proves "when AI production goes up, the verification step must keep up." Streamlining processes beats stacking headcount.

Update 11Databricks shows the bill: one hour of troubleshooting saves $1 million/year in wasted AI spend. By adding tracking to AI assistants' tool calls and listing failed calls for repair, they spent one hour reviewing and cutting ~$1 million in invalid overhead

Databricks shows the bill: one hour of troubleshooting saves $1 million/year in wasted AI spend. By adding tracking to AI assistants' tool calls and listing failed calls for repair, they spent one hour reviewing and cutting ~$1 million in invalid overhead. Most waste came from AI repeatedly calling the same broken function. Comment: Enterprise version of "audit the books before cutting costs." Same logic applies to individuals: check how much of your AI subscription quota is burning for nothing.

Update 12Russian mathematician lets AI models communicate "without text" directly. Wired reports on startup Mostik, which allows multiple AI models to skip natural language and exchange "meaning" via vector-like signals

Russian mathematician lets AI models communicate "without text" directly. Wired reports on startup Mostik, which allows multiple AI models to skip natural language and exchange "meaning" via vector-like signals. This is faster and cheaper than translating to human language and reading it back. Currently, it's still demo-level. Comment: Interesting direction, but humans completely cannot understand what the two AIs are saying to each other. Auditability issues will eventually need addressing.

📖 Full leaderboard tables and expert commentary live in the Chinese edition of the review magazine.