• About Us
  • Contact Us
Account
GTB
  • Home
  • News
  • Premium
  • Business
  • Personal Finance
  • Lifestyle
    • Travel
    • Health
    • Retail/Fashion
  • Podcast
    • Business Chat
    • Retiring Richly
    • Sika Nkommo
  • Videos
  • Analysis/Features
No Result
View All Result
  • Home
  • News
  • Premium
  • Business
  • Personal Finance
  • Lifestyle
    • Travel
    • Health
    • Retail/Fashion
  • Podcast
    • Business Chat
    • Retiring Richly
    • Sika Nkommo
  • Videos
  • Analysis/Features
No Result
View All Result
Account
Ghana Talks Business
No Result
View All Result

Beware the Overfit Trap in Data Analysis

23/01/2017
Reading Time: 1 min read
Flat design modern vector illustration concept of teamwork analyzing project on business meeting

Flat design modern vector illustration concept of teamwork analyzing project on business meeting

0
SHARES
Share on FacebookShare on TwitterShare on WhatsApp

It can be exciting when your data analysis suggests a surprising or counterintuitive prediction. But the result might be due to overfitting, which occurs when a statistical model describes random noise rather than the underlying relationship you need to capture. You can guard against this trap by keeping your analysis simple. Be on guard against spurious correlations, and look for relationships that measure important effects related to clear, logical hypotheses. Test for overfitting by randomly dividing the data into a training set, with which you’ll estimate the model, and a validation set, with which you’ll test the accuracy of the model’s predictions. An overfit model might be great at making predictions within the training set but raise warning flags by performing poorly in the validation set. You might also consider alternative narratives: Is there another story you could tell with the same data? If so, you cannot be confident that the relationship you have uncovered is the right — or only — one.

Source: HBR

Previous Post

15 Quotes to Inspire Great Teamwork

Next Post

Luxury Goods in Africa: A Maturing Sector

Related Posts

Rules for a Successful corporate career, ghanatalksbusiness.com

Five Rules for a Successful Corporate Career

04/02/2022
Op studios

Giving back to society: Op Studios reaches out to Rising Star Orphanage, Dodowa

21/03/2020
Networking for business

How to get the most value from Networking Events

12/06/2019
Dishonest Customers

8 Rules for Good Customer Service

05/11/2018

When Companies Should Invest in Training Their Employees — and When They Shouldn’t

30/10/2018

How To Lead a Team That Doesn’t Want To Be Led

16/07/2018
Next Post

Luxury Goods in Africa: A Maturing Sector

US President Barack Obama holds a year-end press conference in the Brady Press Briefing Room of the White House in Washington, DC, December 16, 2016.
Obama on Friday warned his successor Donald Trump against antagonizing China by reaching out to Taiwan, saying he could risk a "very significant" response if he upends decades of diplomatic tradition. / AFP / ZACH GIBSON        (Photo credit should read ZACH GIBSON/AFP/Getty Images)

Obama’s Exit, Trump’s Opportunity

  • About Us
  • Disclaimer
  • Privacy Policy
  • Advertising
  • Contact Us

© 2021 Ghana Talks Business

No Result
View All Result
  • Home
  • News
  • Premium
  • Business
  • Personal Finance
  • Lifestyle
    • Travel
    • Health
    • Retail/Fashion
  • Podcast
    • Business Chat
    • Retiring Richly
    • Sika Nkommo
  • Videos
  • Analysis/Features
  • Login

© 2021 Ghana Talks Business

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In