SiaSearch Blog SiaSearch v0.6: Introducing Frame & Object Views, Results Sorting

Here's what we've added in July 2021: frame & object views, as well as result sorting. Dive in to learn about our latest product updates.️ Frames ViewMany computer vision models consume data in the form of individual frames instead of clips. As a result, data annotations are also often done over separate frames. As a result, it's essential for any data exploration tool to have the ability to showcase frame level data.Previously, SiaSearch users had to open each clip in the viewer to obtain access to individual frames, causing a lot of manual toggling between results and detailed views.Now, after running a query, you can access a dedicated frames view on the top right of the navigation bar. Within this view, you can opt to view frames with or without object detections.To view frames with object detections, you can further select a model and a set of classes. After selection, bounding boxes are shown on the frame thumbnails and can open in the viewer.‍‍ Objects ViewFor model evaluation and debugging, most ML engineers care about objects, not frames. Objects allow users can make a number of informed decisions about training datasets, such as:Visual understanding: bbox tightness, occlusions, background, surroundingsSorting & filtering: by confidence scores, bbox area, bbox locationModel comparison: evaluation (TP, FP, TN, FN), IoUIn addition to the newly added frames view, you can now expand search results down to a single object level. Like frames, the objects view can be accessed via the navigation bar on the top right.Within this view, you can choose to view objects of specific classes and models, and further click on the thumbnail to see the object highlighted in the viewer.Result SortingAfter obtaining query results, users need an efficient way to get to the right data items before analyzing them in the viewer. Our new result sorting feature helps streamline workflows based on user preferences. Previously, users were forced to either repeatedly fine-tune query conditions, manually scroll through 100s of data samples, or result to only inspect top line data.Now, in all search result views, you can sort results across multiple dimensions:Clips view: DriveID, Duration, Start TimestampFrames view: DriveID, TimestampObjects view: DriveID, Timestamp, Object Class, ConfidenceYou can choose from three states for each dimension: no sort, ascending (A-Z, 1-9), or descending (Z-A, 9-1). The SiaSearch team is already hard at work on a new set of features for launch next month. To stay up to date on SiaSearch releases as they're shipped, sign up to receive our newsletter.Ready to explore all the new features? Check them out now on the public version of our platform:Get Started More from the SiaSearch blog: