The face recognition algorithm of Brightics Visual Search, Samsung SDS’s visual analytics solution, took 6th place in the “Face Mask Effects” category of the latest Face Recognition Vendor Test (FRVT).
The National Institute of Standards and Technology (NIST), an organization under the United States Department of Commerce, tests and announces the accuracy and performance of face recognition vendor’s algorithms in various categories. Almost all major face recognition vendors from all over the world are currently participating in the FRVT.
In September, Samsung SDS submitted its algorithm to NIST FRVT, for the third time, in “1:1 Verification” and “Face Mask Effects” categories: 1) VisaBorder (comparison of a visa photo and a photo taken at immigration or emigration, 2) Mugshot +12 Years (comparison of a mugshot photo and one taken after at least 12 years), 3) Kiosk (comparison of kiosk face photos), 4) Face Mask Effects (comparison of a visa photo and a photo taken while wearing a face mask), etc.
In Face Mask Effects category, Samsung SDS’s algorithm was in top 6 with the False Non-Match Rate (@False Match Rate =0.00001) of 0.0127, a 28% improvement from 0.0176, the test result of the previous algorithm submitted to NIST FRVT in May.
In FRVT 1:1 Verification category, Samsung SDS ranked 5th for VisaBorder, the same rank it achieved in its last participation in May.
Samsung SDS and Samsung Advanced Institute of Technology (SAIT) have been cooperating to improve the face recognition algorithm since last year. They have continuously applied various new optimization technologies and training datasets and repeatedly tested the performances of the upgraded algorithms to get better results. The face dataset, made thanks to the voluntary participation of Samsung SDS colleagues, also played an important role in getting good results in the FRVT.
|Area and Category||Nov. 2021||May 2022||Sep. 2022|
|FRVT 1:1 Verification VISABORDER FNMR@FMR= 0.000001||0.0099||136||0.0024||5||0.0021||5|
|FRVT 1:1 Verification MUGSHOT (ΔT≥12YRS) FNMR@FMR= 0.00001||0.0081||132||0.0023||6||0.0022||5(△1)|
|FRVT 1:1 Verification KIOSK FNMR@FMR= 0.00001||0.0991||52||0.2598||156||0.0489||8 (△148)|
|FRVT FACE MASK Effects FNMR@FMR= 0.00001||-||-||0.0176||12||0.0127||6 (△6)|
Until recently, Brightics Visual Search has been used mainly by media companies such as CJ ENM, for video metadata generation, advanced search, content recommendation and automated editing purposes. However, nowadays, more and more companies and industries are adopting this solution to analyze, search, edit and manage their video data and improve their visual communication services:
• Customer analysis in retail shops of global autobile and electronics manufacturers.
• Attendance check in online-education service of Brazilian local governments;
• Searching and editing of video manuals or promotional video materials in manufacturing companies and public organizations.
Samsung SDS’s customers are also adopting Brightics Visual Search along with RPA solution in business automation applications.