Our twins turned four earlier this year, and with the Pokémon party balloons and Hot Wheels monster trucks came a major milestone — upgrading them to "big boy" beds.
Â
Like any amateur decorator, I was using ChatGPT to generate some images for their bedroom redesign — glow-in-the-dark dinosaur sheets, green stripe wallpaper, pulldown shades, general aspirational mood board energy — when a pop-up appeared.
Â
"Your Plus plan now includes connected finances," it said. I could link my financial accounts and ChatGPT would use that data to help me with questions about my spending, subscriptions, balances, and more. Right there in the interface: Bank of America, Charles Schwab, ready to sync.
Â
I stared at it for a moment.
Â
Then I clicked the X.
Â
Not because I'm anti-AI. I was, after all, literally using it at that very moment to determine whether their bedroom needed green built-in bookcases. (Strong no, as it turns out.) But when it comes to my actual financial accounts, I wanted to think before I clicked — and when I did think about it, I had two concerns I couldn't get past.
Sounds Authoritative. Isn't Always.
The first concern is one I've been watching for a while: AI is not as reliable at personal finance advice as it sounds like it should be.
Â
A study published this year in the Journal of Financial Planning tested seven of the most widely used generative AI platforms — ChatGPT, Claude, Copilot, DeepSeek, Gemini, Meta AI, and Perplexity — on a set of identical financial scenarios covering emergency savings, retirement withdrawal rates, and investment portfolio allocation. The researchers, finance professors at the University of Georgia and the University of Rome, found "significant variation in guidance" across platforms. The same question, put to seven different tools, produced a meaningfully different spread of answers.
Â
That alone would be concerning enough. But the more unsettling finding was this: The answers sounded confident regardless of whether they were right.
Â
"No matter what you ask it, it'll always come back with an answer that sounds authoritative, even if it's not," said Andrew Lo, director of MIT's Laboratory for Financial Engineering, in a recent interview with CNBC. "When it comes to very, very specific calculations of your own personal situation, that's where you have to be very, very careful."
Â
That's what's easy to forget when you're looking at a fluent, well-organized AI response: Fluency isn't accuracy. A wrong answer delivered in a calm, professional tone is still a wrong answer — and nothing about the format will tip you off.
Â
The study's authors put it plainly: "GenAI-driven responses may sound confident but can still be incomplete, misleading, or incorrect."
Â
A separate 2024 study in the Journal of Risk and Financial Management looked specifically at ChatGPT's ability to provide financial guidance and found its recommendations tended to be "generic," often missing crucial details specific to the individual's situation. Useful as a starting point. Not reliable as a finish line.
Nobody's Looking Out for You
Here's the piece most people don't know: AI doesn't owe you a fiduciary duty.
Â
A fiduciary — the legal standard that licensed financial advisors are held to — must act in your best interest. If they give you bad advice, there are professional and legal consequences. AI has no such obligation. It can generate a confident, reasonable-sounding recommendation that is wrong, or that ignores a critical detail about your situation, and there is no legal framework holding it accountable to you personally.
Â
The Journal of Financial Planning study also found evidence of demographic bias. When researchers changed the race or gender of the hypothetical person in their prompts — while keeping the financial scenarios otherwise identical — the AI's recommendations shifted. That's the kind of inconsistency that would end a human financial advisor's career.
The Other Thing I Couldn't Stop Thinking About
My second concern with the pop-up was more straightforward: I wasn't sure I wanted to hand a commercial AI platform a complete picture of my financial life.
Â
That's a personal calculation, and reasonable people will land in different places on it. But connecting your bank and investment accounts to an AI system means that data is now part of your interaction history with a product — and before clicking "Get started," it's worth understanding exactly what that means for how your information is stored, used, and potentially shared.
Â
I'll be honest: I didn't have clear enough answers to those questions to feel comfortable proceeding. So I didn't.
What It's Actually Good For
None of this is an argument against using AI for financial questions altogether. Two out of three Americans who use generative AI say they've turned to it for financial guidance, according to an Intuit Credit Karma survey — and for certain kinds of questions, that makes complete sense.
Â
AI is genuinely useful at the conceptual level. How does a Roth conversion work? What's the difference between term and whole life insurance? Why does asset allocation matter as you get closer to retirement? For building financial literacy, generating questions to bring to an advisor, or getting a working understanding of a topic you're unfamiliar with, it's a legitimate tool.
Â
What it struggles with — what the research is consistent on — is your specific situation. The numbers that are actually yours. The tradeoffs that depend on your income, your debts, your timeline, your goals. That's where the generic answers start to fail, and where the confident tone becomes the most dangerous.
Â
Use AI to get smarter about a topic. Don't use it to make a decision about your money.
Â
As for the bedroom: Green bookcases were a no, but I never would have come up with the matching sage green sconces over each bed. I'll take it.
Â
My bank accounts, though, are staying private for now — at least until I understand a lot more about what that connection actually means.
Wealth-Building Tips for a Brighter Future
Want to expand your money skills to help you thrive, both now and in the years to come? Need clarity about ways to navigate the twists and turns of the economy, the stock market and more?
Zacks' Money Sense newsletter is a trusted source of personal finance information and resources. Every week, you’ll receive new ideas and practical strategies you can use to save more, invest more intelligently, and build a brighter financial future. Sign up free today.
Want the latest recommendations from Zacks Investment Research? Today, you can download 7 Best Stocks for the Next 30 Days. Click to get this free report
(0) comments
Welcome to the discussion.
Log In
Keep it Clean. Please avoid obscene, vulgar, lewd, racist or sexually-oriented language.
PLEASE TURN OFF YOUR CAPS LOCK.
Don't Threaten. Threats of harming another person will not be tolerated.
Be Truthful. Don't knowingly lie about anyone or anything.
Be Nice. No racism, sexism or any sort of -ism that is degrading to another person.
Be Proactive. Use the 'Report' link on each comment to let us know of abusive posts.
Share with Us. We'd love to hear eyewitness accounts, the history behind an article.