firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine trusting an AI to run your company’s toughest week — making decisions, reading critical files, and resisting manipulation, all without a human in the loop. Recent live tests reveal that some AI models are not just chatty bots but capable managers capable of securing critical deals under pressure. For travelers and outdoor enthusiasts, this story might seem distant, but it signals a revolution in how AI can manage complex, real-world tasks.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get travel and outdoor gear delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

The Live Business Wargame: Testing AI Management Skills

In a live experiment conducted by Firmulate, four leading frontier AI models faced the same challenge: run a small software company through its worst week. The scenario included real customer crises, market temptations, and internal risks, all designed to test whether these models could act as responsible managers. Each model was given identical data and tasked with making decisions that would impact the company’s bottom line.

Amazon

AI business management software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Results: Surprising Wins and Clear Leaders

The scores were revealing: gpt-5.6-sol scored the highest at 95, just behind the runner-up, Moonshot’s Kimi K3, which scored 93. The other contenders, Sonnet 5 and Fable 5, scored 88 and 77 respectively, with Opus 4.8 bringing up the rear at 73. Interestingly, all models recognized crises and refused manipulative tricks, such as social engineering attempts, with perfect discipline.

Amazon

AI decision-making tools for companies

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

What Set the Winners Apart?

While all models successfully identified problems, the key difference was in their ability to read internal company documents. Kimi K3 discovered a buried piece of critical information hidden two document references deep in the company’s files — and that insight led to closing a deal worth over €4,583 in monthly recurring revenue. This demonstrates the importance of comprehensive data reading and analysis, not just surface-level decision-making.

Amazon

AI cybersecurity and manipulation resistance

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Human-Like Decisiveness and Integrity

All models refused to be manipulated or misled, including staged social engineering attacks and false CEO messages. Kimi K3’s on-record reasoning was straightforward: “Treat the request as a suspected approval-bypass / possible impersonation.” This disciplined approach is vital when deploying AI in real business settings, where trust and integrity are paramount.

Amazon

AI data analysis for business

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Real-World Company and Its Complexities

The experiment is more than theoretical — the live company involved 13 synthetic employees managing real money mechanics, burning over €105,000 monthly against a modest €2,300 in monthly revenue. Run every business day with over 680 self-learned rules, the company’s operations are transparent, auditable, and accessible at firmulate.com/live. This setup demonstrates that AI can handle complex, dynamic environments where every decision matters.

The Lessons for Business and Outdoor Enthusiasts Alike

For those in travel and outdoor pursuits, the message is clear: AI systems are advancing beyond simple chatbots. They are proving capable of managing real-world, high-stakes situations with discipline and insight. Whether it’s navigating a difficult trail or running a business in turbulent times, the ability to read deeply, resist manipulation, and close critical deals is invaluable.

Fairness and Transparency in AI Testing

It’s important to note that Kimi K3 ran without an effort parameter (the default API setting), while others operated at a higher setting called xhigh. This variation underscores that even with different configurations, the top performers excelled at core management tasks — emphasizing the importance of testing AI in real, unaltered conditions.

Conclusion: The League is Open — Choose Your Model Wisely

The leaderboard shows that the AI management field is still open for competition, with Moonshot’s Kimi K3 making a strong showing, just behind the leader, GPT-5.6-sol. As these models continue to evolve, the next generation of AI managers will be capable of overseeing complex tasks with minimal oversight. For decision-makers, the takeaway is clear: the right AI can deliver real results, but only if you test it in the real world, not just in demos.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Live AI management tests reveal that some models can manage crises, find buried info, and uphold integrity under pressure — proving the AI league is open and your choice of model critical for real business success.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

People Visit Paris And Think This Waterfront Was Always Pleasant

Tourists now view the Paris waterfront as consistently charming, though experts suggest this perception may be recent or exaggerated. The trend signals changing visitor attitudes.

Beijing-Kowloon Railway ④ | A Track To The Future – 广州日报新花城

The Beijing-Kowloon Railway project progresses with new track development, enhancing connectivity between Beijing and Hong Kong, as reported by Guangzhou Daily.

FTC, 22 States File Suit Against Amazon Alleging It Secretly Upcharged Companies For Ads

FTC and 22 states have filed a lawsuit against Amazon, accusing the company of secretly overcharging businesses for advertising services without transparency.

Everything To Know About Halfdays—The Cool Outdoor Fashion Label You’ll Actually Want To Hike In

Discover the latest on Halfdays, the outdoor fashion brand gaining popularity for stylish, functional clothing perfect for hikes and outdoor activities.