What Embedding visualization with fifty one. How it is useful

 embeddings could be used to analyze data and models? Use FiftyOne's embeddings visualization capabilities to reveal hidden structure in the data, mine hard samples, pre-annotate data, recommend new samples for annotation, and more.

FiftyOne provides a powerful embeddings visualization capability that you can use to generate low-dimensional representations of the samples and objects in your datasets.

This notebook highlights several applications of visualizing image embeddings, with the goal of motivating some of the many possible workflows that you can perform.

Specifically, we’ll cover the following concepts:

Loading datasets from the FiftyOne Dataset Zoo

Using compute_visualization() to generate 2D representations of images

Providing custom embeddings to compute_visualization()

Visualizing embeddings via interactive plots connected to the FiftyOne App

And we’ll demonstrate how to use embeddings to:

Identify anomolous/incorrect image labels

Find examples of scenarios of interest

Pre-annotate unlabeled data for training

So, what’s the takeaway?

Combing through individual images in a dataset and staring at aggregate performance metrics trying to figure out how to improve the performance of a model is an ineffective and time-consuming process. Visualizing your dataset in a low-dimensional embedding space is a powerful workflow that can reveal patterns and clusters in your data that can answer important questions about the critical failure modes of your model and how to augment your dataset to address these failures.

Using the FiftyOne Brain’s embeddings visualization capability on your ML projects can help you uncover hidden patterns in your data and take action to improve the quality of your datasets and models.

References:

https://docs.voxel51.com/tutorials/image_embeddings.html