Oren Yosifon || VP Product, SaaS Platform, Cellebrite

Oren Yosifon

VP Product, SaaS Platform, Cellebrite

The Good, The Bad and the Eval

Product Managers struggle with defining clear success metrics for AI based features. Here's a story: 

I once met Ron Huldai, who told me he wanted to spend 100$K on an AI based feature tat would benefit Tel-Aviv. I told him I can build him an amazing AI model that would predict each day, if there's going to be a devastating earthquake in the following day in tel-aviv. He asked me: "what will the accuracy of the model be?" and I said: "99.9%" . My model was very simple, giving "no" as an answer every day. 

This story shows, for example, that "accuracy" is a metric that s not the right one to use in this situation.

In our talk I will explain how to measure how "good" are your AI Features, in order to understand how they improve over time, and create a shared language with customers and R&D.

 

Written by  Read 2572 times Last modified on Friday, 19 December 2025 11:46
Rate this item
(0 votes)
Published in Day 1
Super User

Latest from Super User

More in this category: « Shay Many || Senior Director of Product Management, Guesty Ofer Polivoda || Country Manager, Mixpanel »

80 comments

  • Comment Link hai hoan imperial Sunday, 19 April 2026 00:52 posted by hai hoan imperial

    I have noticed that of all sorts of insurance, medical care insurance is the most controversial because of the discord between the insurance policies company's need to remain profitable and the customer's need to have insurance. Insurance companies' revenue on health and fitness plans are certainly low, consequently some businesses struggle to generate income. Thanks for the suggestions you write about through this web site.

  • Comment Link hai hoan imperial Saturday, 18 April 2026 18:46 posted by hai hoan imperial

    Many thanks for your post. I'd really like to say that the expense of car insurance varies widely from one plan to another, mainly because there are so many different facets which contribute to the overall cost. Such as, the make and model of the motor vehicle will have a huge bearing on the charge. A reliable aged family motor vehicle will have a lower priced premium compared to a flashy fancy car.

  • Comment Link hai hoan imperial Saturday, 18 April 2026 16:54 posted by hai hoan imperial

    I?m not sure where you're getting your info, but great topic. I needs to spend some time learning more or understanding more. Thanks for fantastic info I was looking for this information for my mission.

  • Comment Link usdt wallet Friday, 17 April 2026 22:45 posted by usdt wallet

    Hi there, just became aware of your blog through Google, and found that it is really informative. I?m going to watch out for brussels. I will be grateful if you continue this in future. Numerous people will be benefited from your writing. Cheers!

  • Comment Link vanity address generator Friday, 17 April 2026 18:44 posted by vanity address generator

    Hello, i think that i noticed you visited my blog so i got here to ?go back the prefer?.I am trying to to find issues to enhance my web site!I suppose its good enough to make use of a few of your ideas!!

  • Comment Link vanity address generator online Friday, 17 April 2026 14:55 posted by vanity address generator online

    I was suggested this website by my cousin. I am not sure whether this post is written by him as nobody else know such detailed about my problem. You are amazing! Thanks!

  • Comment Link tron vanity address generator Friday, 17 April 2026 11:17 posted by tron vanity address generator

    F*ckin? tremendous things here. I?m very glad to see your post. Thanks a lot and i am looking forward to contact you. Will you please drop me a e-mail?

  • Comment Link vanity address tron Friday, 17 April 2026 08:03 posted by vanity address tron

    This is very attention-grabbing, You are a very professional blogger. I've joined your feed and look ahead to in the hunt for extra of your fantastic post. Also, I have shared your web site in my social networks!

  • Comment Link vanity tron address Friday, 17 April 2026 04:40 posted by vanity tron address

    With havin so much content do you ever run into any problems of plagorism or copyright violation? My website has a lot of unique content I've either authored myself or outsourced but it seems a lot of it is popping it up all over the internet without my authorization. Do you know any techniques to help prevent content from being stolen? I'd definitely appreciate it.

  • Comment Link alessandracruz Wednesday, 15 April 2026 01:08 posted by alessandracruz

    I appreciate, cause I found just what I was looking for. You've ended my 4 day long hunt! God Bless you man. Have a nice day. Bye

Leave a comment

Make sure you enter all the required information, indicated by an asterisk (*). HTML code is not allowed.