Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 2037 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)

39 comments

  • Comment Link vanity wallet generator Friday, 20 March 2026 11:14 posted by vanity wallet generator

    Fantastic site. Lots of useful information here. I am sending it to several friends ans also sharing in delicious. And of course, thanks for your effort!

  • Comment Link tron wallet generator Friday, 20 March 2026 10:49 posted by tron wallet generator

    I'm not sure why but this weblog is loading very slow for me. Is anyone else having this problem or is it a issue on my end? I'll check back later on and see if the problem still exists.

  • Comment Link big baller Thursday, 19 March 2026 16:16 posted by big baller

    I really appreciate this post. I have been looking all over for this! Thank goodness I found it on Bing. You have made my day! Thx again

  • Comment Link big baller club casino philippines Thursday, 19 March 2026 12:20 posted by big baller club casino philippines

    Hello there, I found your web site via Google while looking for a related topic, your website came up, it looks great. I have bookmarked it in my google bookmarks.

  • Comment Link big baller Thursday, 19 March 2026 11:47 posted by big baller

    You actually make it seem so easy with your presentation but I find this topic to be actually something which I think I would never understand. It seems too complex and very broad for me. I'm looking forward for your next post, I?ll try to get the hang of it!

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 13:19 posted by คลิปหลุดสาวใหญ่

    Hello! This is my first visit to your blog! We are a collection of volunteers and starting a new initiative in a community in the same niche. Your blog provided us valuable information to work on. You have done a outstanding job!

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 09:38 posted by คลิปหลุดสาวใหญ่

    Thanks for your publication on the vacation industry. We would also like to add that if you are a senior taking into account traveling, it really is absolutely vital that you buy travel insurance for senior citizens. When traveling, retirees are at biggest risk of getting a health emergency. Buying the right insurance coverage package for your age group can look after your health and provide you with peace of mind.

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 09:07 posted by คลิปหลุดสาวใหญ่

    Simply wish to say your article is as astonishing. The clearness in your put up is just nice and i could suppose you are a professional in this subject. Fine with your permission let me to seize your RSS feed to keep up to date with approaching post. Thanks 1,000,000 and please continue the gratifying work.

  • Comment Link Absolute Decks  Basements Contracting Monday, 16 March 2026 22:57 posted by Absolute Decks Basements Contracting

    Whoa! This blog looks just like my old one! It's on a completely different subject but it has pretty much the same page layout and design. Superb choice of colors!

  • Comment Link Absolute Decks and Basements Contracting Monday, 16 March 2026 18:47 posted by Absolute Decks and Basements Contracting

    Wonderful items from you, man. I have bear in mind your stuff prior to and you're just extremely magnificent. I really like what you have got right here, certainly like what you're saying and the way through which you are saying it. You make it enjoyable and you continue to care for to stay it wise. I cant wait to learn much more from you. This is actually a tremendous site.

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.

to-be published