{"id":11,"date":"2021-11-30T12:32:00","date_gmt":"2021-11-30T17:32:00","guid":{"rendered":""},"modified":"2024-01-27T01:20:00","modified_gmt":"2024-01-27T06:20:00","slug":"99-1-is-the-new-80-20","status":"publish","type":"post","link":"https:\/\/ozer.gt\/log\/2021\/11\/30\/99-1-is-the-new-80-20\/","title":{"rendered":"99\/1 is the new 80\/20"},"content":{"rendered":"<p>An obvious but often neglected fact is the overemphasized value of accuracy as a performance metric. In a two-class problem where 99% of the cases are of 0 (Not a spam email), achieving an accuracy of 99% is as easy as classifying all emails as safe. Sensitivity, specificity, and other metrics exist for a reason.<\/p>\n<p><a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2021-08-17\/waymo-s-self-driving-cars-are-99-of-the-way-there-the-last-1-is-the-hardest\">The story of Waymo<\/a>, Google&#8217;s self-driving car, resembles the value of solving the remaining 1% of the problem where conventional machine learning gets stuck due to the limitations of training data. If 1% of the error turns into a make or break point, one needs to get creative. On a long tail that extends to infinity, walking faster or running does not probably help as much as a leap of imagination.<\/p>\n<p>I must note that it&#8217;s not fair to expect an autonomous car to be &#8220;error-free&#8221; given we do not expect human drivers to perform error-free at the driver license exams and road tests. The two will just make different errors.<\/p>\n<div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>An obvious but often neglected fact is the overemphasized value of accuracy as a performance metric. In a two-class problem where 99% of the cases are of 0 (Not a spam email), achieving an accuracy of 99% is as easy as classifying all emails as safe. Sensitivity, specificity, and other metrics exist for a reason. [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"cybocfi_hide_featured_image":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-11","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/posts\/11","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/comments?post=11"}],"version-history":[{"count":2,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/posts\/11\/revisions"}],"predecessor-version":[{"id":99,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/posts\/11\/revisions\/99"}],"wp:attachment":[{"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/media?parent=11"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/categories?post=11"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ozer.gt\/log\/wp-json\/wp\/v2\/tags?post=11"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}