Manifold is a tool for visualizing machine learning model predictions, understanding their performance, and comparing them. It is independent of the specifics of the model and only cares about inputs and outputs, which makes it widely applicable.
I worked on a prototype of Manifold that was described in a paper published in the IEEE Transactions on Visualization and Computer Graphics in 2019.
Yang Wang gave a presentation at IEEE VIS 2018 in Berlin. Lezhi Li and Yang Wang then developed the prototype further into a fully fledged model debugging tool described in a blogpost, and eventually open-sourced it, making the code available on GitHub.
The tool received a significant amount of press coverage:
- https://venturebeat.com/2020/01/07/uber-open-sources-manifold-a-visual-tool-for-debugging-ai-models/
- https://towardsdatascience.com/uber-open-sources-manifold-to-visually-debug-machine-learning-programs-bd1dbd882110
- https://theusbreakingnews.com/uber-open-sources-manifold-a-visual-tool-for-debugging-ai-models/
- https://govirall.net/uber-open-sources-manifold-a-visual-tool-for-debugging-ai-models/6269/
- https://meterpreter.org/uber-open-source-manifold-a-visual-debugging-tool-for-machine-learning/
- https://www.infoq.cn/article/JNNkRGRsgvQ5chgEJSFa
- https://jaxenter.com/machine-learning-manifold-166566.html
- https://www.marktechpost.com/2020/01/08/uber-open-sourced-manifold-a-visual-debugging-tool-for-machine-learning/
- https://neurohive.io/en/news/manifold-visual-debugging-tool-for-machine-learning-at-uber/
- https://it.toolbox.com/blogs/shrutiumathe/uber-open-sources-manifold-visual-debugging-tool-for-machine-learning-researchers-011320
- https://www.reddit.com/r/datascience/comments/elr3yc/uber_opensourced_manifold_a_tool_to_visually/
- https://laptopsmagazine.com/uber-open-sources-manifold-a-visual-tool-for-debugging-ai-models/
- https://en24.news/2020/01/uber-releases-the-machine-learning-tool-manifold-as-open-source.html
- https://www.websystemer.no/uber-open-sources-manifold-to-visually-debug-machine-learning-programs/
- https://towardsdatascience.com/uber-has-been-quietly-assembling-one-of-the-most-impressive-open-source-deep-learning-stacks-in-b645656ddddb