Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 2480 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)

72 comments

  • Comment Link 스포츠중계 Monday, 23 March 2026 10:01 posted by 스포츠중계

    Spot on with this write-up, I truly suppose this website needs way more consideration. I?ll probably be once more to read way more, thanks for that info.

  • Comment Link 스포츠중계 Monday, 23 March 2026 09:34 posted by 스포츠중계

    This design is wicked! You definitely know how to keep a reader amused. Between your wit and your videos, I was almost moved to start my own blog (well, almost...HaHa!) Great job. I really loved what you had to say, and more than that, how you presented it. Too cool!

  • Comment Link rare trx Friday, 20 March 2026 14:27 posted by rare trx

    F*ckin? remarkable things here. I?m very glad to see your post. Thanks a lot and i'm looking forward to contact you. Will you please drop me a mail?

  • Comment Link vanity wallet generator Friday, 20 March 2026 11:14 posted by vanity wallet generator

    Fantastic site. Lots of useful information here. I am sending it to several friends ans also sharing in delicious. And of course, thanks for your effort!

  • Comment Link tron wallet generator Friday, 20 March 2026 10:49 posted by tron wallet generator

    I'm not sure why but this weblog is loading very slow for me. Is anyone else having this problem or is it a issue on my end? I'll check back later on and see if the problem still exists.

  • Comment Link big baller Thursday, 19 March 2026 16:16 posted by big baller

    I really appreciate this post. I have been looking all over for this! Thank goodness I found it on Bing. You have made my day! Thx again

  • Comment Link big baller club casino philippines Thursday, 19 March 2026 12:20 posted by big baller club casino philippines

    Hello there, I found your web site via Google while looking for a related topic, your website came up, it looks great. I have bookmarked it in my google bookmarks.

  • Comment Link big baller Thursday, 19 March 2026 11:47 posted by big baller

    You actually make it seem so easy with your presentation but I find this topic to be actually something which I think I would never understand. It seems too complex and very broad for me. I'm looking forward for your next post, I?ll try to get the hang of it!

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 13:19 posted by คลิปหลุดสาวใหญ่

    Hello! This is my first visit to your blog! We are a collection of volunteers and starting a new initiative in a community in the same niche. Your blog provided us valuable information to work on. You have done a outstanding job!

  • Comment Link คลิปหลุดสาวใหญ่ Wednesday, 18 March 2026 09:38 posted by คลิปหลุดสาวใหญ่

    Thanks for your publication on the vacation industry. We would also like to add that if you are a senior taking into account traveling, it really is absolutely vital that you buy travel insurance for senior citizens. When traveling, retirees are at biggest risk of getting a health emergency. Buying the right insurance coverage package for your age group can look after your health and provide you with peace of mind.

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.