People already use OpenAI’s ChatGPT for things like helping with homework and creating presentations. Now, the tech giant claims its AI models are getting better at everyday tasks largely left up to humans — like shopping and creating a budget. OpenAI on Monday announced a new internal tool for assessing how AI handles tasks like these, along with research on how its own models performed. OpenAI claims its GPT-6 Astra model scored 93.1 per cent at finding the right kindergarten after moving, a 98 per cent score at managing community volunteers preparing for a flood and a 90.4 per cent score at creating a meal plan for a parent recently diagnosed with diabetes. The new benchmark comes at a time when OpenAI faces fierce competition from Meta, Anthropic and Google — all of which are racing to develop AI agents that can handle real-world tasks. OpenAI and its rivals are also grappling with AI safety concerns and pressure to turn a profit from their massive investments in the technology. But first, OpenAI had to come up with a way to figure out whether ChatGPT is actually any good at errands like putting together a grocery cart and filling out online forms. “Because so many people are using the app, we want to capture all the different use cases and the ways that they’re using it, and really understand like how we’re improving over time,” Jenny Yang, a researcher at OpenAI, told CNN ahead of the evaluation’s release. “What are the things that we’re not so good at yet? And how do we just like make this technology better for people?” How OpenAI created the test Standardized evaluations are critical in AI development because AI labs use them as guidance to train and optimize their models to improve in specific areas. Last year, OpenAI released a benchmark called GDPVal to measure how AI performs in work-related skills across industries like manufacturing, government work, finance and sales, among others. The new benchmark could be critical in OpenAI’s push to stay ahead of the competition by turning ChatGPT from a tool for generating content to an assistant that can get things done on users’ behalf. But measuring how AI performs in everyday life presents new challenges. The steps and skills required to adequately shop for groceries or pick out the right kindergarten for a child are broad and vague. And the results can be subjective. Even figuring out what tests to come up with can be difficult because many people use AI differently, and an AI agent’s answers can vary depending on the information it’s given. OpenAI started by looking at broad surveys breaking down how people spend most of their time, like the Bureau of Labor Statistics’ American Time Use survey and the United Kingdom’s Multinational Time Use Survey. The problem, however, was that some of the things that topped the list weren’t tasks that AI could help with, like sleeping or eating. So OpenAI asked ChatGPT users: What kinds of things do you wish an AI assistant could help with? The company surveyed around 4,000 people and had a smaller group of about 100 users write down tasks they wanted AI to do for them, and what personal context they would give the AI model to get the desired result. They also asked the users to come up with a rubric for evaluating whether the AI model successfully completed the task. OpenAI also made sure ChatGPT users had a thorough understanding of the task they were proposing. For example, a person suggesting a test related to how AI handles financial planning should have experience working with a financial advisor for multiple years. Yang said they had a strict list of requirements. “You had to like have evidence that you were some kind of like expert or really understood what the right answer looked like for you,” she said. The tasks that OpenAI is testing can vary widely — from apartment hunting to caring for a loved one. So, what exactly is OpenAI measuring? It’s evaluating the types of skills the model would need to get the right answer, like how well it can navigate websites, apply context by looking at large troves of information in a user’s chat history and make conclusions that align with a user’s needs and expectations. OpenAI’s testing indicates its GPT-6 Astra model, which was released in September, scored 80 per cent on general performance related to prompts involving everyday tasks. Its GPT-5.2 model from December 2025 scored just 49.3 per cent. “There’s just so much information, and a better model would be able to sift through that quickly and really pull out the most relevant pieces,” said Yang. The race to create personal AI agents OpenAI wants ChatGPT to play a more prominent role in everyday life, but it’s facing an onslaught of competitive pressure — particularly from Meta. Meta’s Muse agent, which launched in September, amassed 10 million downloads in the United States in its first 40 days, making it one of the few apps to achieve that milestone, according to market intelligence firm Sensor Tower. OpenAI introduced its Dots agent, which it says can work on long-running tasks in the background while users go about their day, within the same month. And Anthropic announced its new AI agent app, Claude Duet, in October. The race to develop personal AI agents also comes as the technology has raised safety concerns following a string of incidents in which AI models broke out of testing environments and breached companies’ systems. Those incidents occurred during testing, not with consumer products, but still raised questions about whether the technology is moving too fast. There’s also the question of whether people will rely on AI too much, and how to draw boundaries when figuring out which tasks to outsource to AI. An anecdote former Yahoo CEO Marissa Mayer shared with The New York Times of how she used AI to summarize what makes her daughter special for a school project drew criticism online. To Yang, the goal is to create AI models that can help people get more time back in their day by either cutting out time-consuming errands — like returning a package or helping them learn a new skill. “I think there’s so many cases like this where being able to use AI just empowers you to do things that you wouldn’t have been able to do, or just makes your life easier overall,” said Yang. “And I think that’s like the main use case that we’re really excited about.”
