{"id":167977,"date":"2021-06-08T18:02:09","date_gmt":"2021-06-08T13:02:09","guid":{"rendered":"https:\/\/venturebeat.com\/?p=2694720"},"modified":"2021-06-08T18:02:09","modified_gmt":"2021-06-08T13:02:09","slug":"ibm-releases-ai-model-toolkit-to-help-developers-measure-uncertainty","status":"publish","type":"post","link":"https:\/\/www.technologyforyou.org\/ibm-releases-ai-model-toolkit-to-help-developers-measure-uncertainty\/","title":{"rendered":"IBM releases AI model toolkit to help developers measure uncertainty"},"content":{"rendered":"
<\/div>\n
\n

Elevate your enterprise data technology and strategy at Transform 2021<\/a><\/em>. <\/p>\n

\n<\/div>\n

At its Digital Developer Conference today, IBM open-sourced Uncertainty Quantification 360 (UQ360), a new toolkit focused on enabling AI to understand and communicate its uncertainty. Following in the footsteps of IBM\u2019s AI Fairness 360<\/a> and AI Explainability 360<\/a>, the goal of UQ360 is to foster community practices across researchers, data scientists, developers, and others that might lead to better understanding and communication around the limitations of AI.<\/p>\n

It\u2019s commonly understood that deep learning models are overconfident \u2014 even when they make mistakes. Epistemic uncertainty describes what a model doesn\u2019t know because the training data wasn\u2019t appropriate. On the other hand, aleatoric uncertainty is the uncertainty arising from the natural randomness of observations. Given enough training samples, epistemic uncertainty will decrease, but aleatoric uncertainty can\u2019t be reduced even when more data is provided.<\/p>\n

UQ360 offers a set of algorithms and a taxonomy to quantify uncertainty, as well as capabilities to measure and improve uncertainty quantification (UQ). For every UQ algorithm provided in the UQ360 Python package, a user can make a choice of an appropriate style of communication by following IBM\u2019s guidance on communicating UQ estimates, from descriptions to visualizations. UQ360 also includes an interactive experience that provides an introduction to producing UQ and ways to use UQ in a house price prediction application. Moreover, UQ360 includes a number of in-depth tutorials to demonstrate how to use UQ across the AI lifecycle.<\/p>\n

The importance of uncertainty<\/h2>\n

Uncertainty is a major barrier standing in the way of self-supervised learning\u2019s<\/a> success, Facebook chief AI scientist Yann LeCun said at the International Conference on Learning Representation (ICLR) last year. Distributions are tables of values that link every possible value of a variable to the probability the value could occur. They represent uncertainty perfectly well where the variables are discrete, which is why architectures like Google\u2019s BERT<\/a> are so successful. But researchers haven\u2019t yet discovered a way to usefully<\/em> represent distributions where the variables are continuous \u2014 i.e., where they can be obtained only by measuring.<\/p>\n

As IBM research staff members Prasanna Sattigeri and Q. Vera Liao note in a blog post, the choice of UQ method depends on a number of factors, including the underlying model, the type of machine learning task, characteristics of the data, and the user\u2019s goal. Sometimes a chosen UQ method might not produce high-quality uncertainty estimates and could mislead users, so it\u2019s crucial for developers to evaluate the quality of UQ and improve the quantification quality if necessary before deploying an AI system.<\/p>\n

In a recent study conducted by Himabindu Lakkaraju, an assistant professor at Harvard University, showing uncertainty metrics<\/a> to both people with a background in machine learning and non-experts had an equalizing effect on their resilience to AI predictions. While fostering trust in AI may never be as simple as providing metrics, awareness of the pitfalls could go some way toward protecting people from machine learning\u2019s limitations.<\/p>\n

\u201cCommon explainability techniques shed light on how AI works, but UQ exposes limits and potential failure points,\u201d Sattigeri and Liao wrote. \u201cUsers of a house price prediction model would like to know the margin of error of the model predictions to estimate their gains or losses. Similarly, a product manager may notice that an AI model predicts a new feature A will perform better than a new feature B on average, but to see its worst-case effects on KPIs, the manager would also need to know the margin of error in the predictions.\u201d<\/p>\n

\n

VentureBeat<\/h3>\n

VentureBeat’s mission is to be a digital town square for technical decision-makers to gain knowledge about transformative technology and transact. Our site delivers essential information on data technologies and strategies to guide you as you lead your organizations. We invite you to become a member of our community, to access:<\/p>\n