- Solution enables more than 3x faster object detection and recognition performance while preserving accuracy using V-Nova’s PPro technology and Metaliquid’s video content analysis
- Strategic Partnership between V-Nova and Metaliquid to develop and deploy commercial products in 2020
- Builds on successful Media-Telecom IBC Catalyst programme proof of concept project demonstrated at IBC 2019
Video compression solutions provider V-Nova and Metaliquid AI video analysis solutions provider have announced a strategic partnership that will build upon the success of their Media-Telecom Catalyst project, to develop and commercialize ground-breaking products for machine learning powered content indexing.
The IBC and TM Forum AI Content Indexing for Regulatory Compliance Catalyst brought together media companies to pioneer new ways for broadcasters to efficiently automate video indexing for metadata enrichment and regulatory compliance. It was championed by Al Jazeera, Associated Press, and RTÈ. The participating companies were V-Nova, Metaliquid, Tech Mahindra and Qatar Computing Research Institute.
To effectively deliver video analysis, a combination of speed and accuracy is paramount. Currently, broadcasters can only afford to analyze a small portion of their media archive or a limited sample of frames. They are often forced to reduce the resolution at which the analysis is performed because it’s faster and cheaper to process. However, lower resolutions lose details, which reduce the accuracy when recognizing key features like faces or the OCR of small text.
The successful proof-of-concept Catalyst took a different approach by bringing together Metaliquid’s state-of-the-art video analysis solution and V-Nova’s PPro (previously PERSEUS Pro), a high-performance AI-powered software library for encoding and decoding SMPTE VC-6, which uses a hierarchical approach to represent images.
Guendalina Cobianchi, SVP Business Development & Partnerships at V-Nova, comments “PPro is very smart: each video frame includes multiple levels of resolution and you can not only selectively access these resolutions, but also decode specific areas of the frame that are important for the analysis, plus it’s extremely fast. We can perform each video analysis task on the most appropriate set of pixels without having to trade off speed and accuracy.”
The initial proof-of-concept demonstrated an outstanding 3.2x performance gain thanks to the use of PPro instead of JPEG, which combined with the best-in-class performance of Metaliquid’s algorithm, outperformed by over an order of magnitude the benchmarked solutions currently used by the sponsors, with a comparable or higher accuracy level. Even further gains are expected during productization.
Alan Winthroub, Director, Software Engineering at Associated Press said “We have one of the world’s largest multimedia archives and its long-term value is dependent on powerful indexing to deliver the rich metadata to make it discoverable. The step-change in performance this catalyst project has delivered means we can process more content, more quickly while generating richer data.”
Deirdre Temple, Head of Solutions, Transformation & Technology at RTÈ said “If we have an election or referendum, as a public service provider we need to show that we’re giving balanced coverage for all parties involved, or for both sides of the debate. Providing this data is very labour-intensive, during a live debate we use stopwatches. Ideally, we would like to have real time data available online to show our balanced coverage throughout a campaign. Metaliquid and V-Nova’s solution that has emerged from the Catalyst programme is a real game-changer for us”.
Simone Bronzin, CEO and founder at Metaliquid said “The full-stack control and customization capabilities we have over our proprietary deep-learning technology has yielded products that respond to industry challenges that are not easy to solve with general purpose AI solutions. Increasing the performance of image encoding and decoding in our workflow was another important step in offering a best-in-class solution. We are tremendously excited by the results of the catalyst project and look forward to delivering this step-change solution to the market very soon.”
V-Nova, a London based IP and software company, is dedicated to improving data compression by building a vast portfolio of innovative technologies based on the game-changing use of AI and parallel processing for data, video, imaging, point cloud compression, with applications across several verticals.
This is achieved through deep-science R&D (300+ international patents) and the development of products that test, prove and continuously enhance the technology portfolio.
V-Nova have released two innovative compression solutions: P+ is the industry’s first highly optimized software library for encoding and decoding enhanced video streams with MPEG-5 Part 2, low-complexity video enhancement coding (LCEVC). PPro is a high-performance AI-powered software library for SMPTE VC-6 (ST-2117) which is used primarily for professional production workflows and imaging applications.
V-Nova has developed multiple award-winning software products to kickstart the ecosystems for its technologies and allow their immediate deployment, addressing use cases in TV, media, entertainment, social networks, eCommerce, ad-tech, security, aerospace, defence, automotive and gaming.
V-Nova’s business model is to monetize its technologies through software licensing, IP royalties and product sales.
For more information please visit www.vnova.com
Metaliquid is a computer vision company focusing on delivering AI recognition and classification services to the broadcast and media industry.
Metaliquid has developed a proprietary deep learning framework and neural network architecture which ensures high accuracy and performance in extracting descriptive metadata from videos.
Along with a wide range of out of the box services, Metaliquid works side by side with broadcasters developing innovative solutions.
The advanced descriptive metadata insights offered by Metaliquid enable companies to offer improved and powerful services to enrich metadata in archives, deliver premium viewer experiences and support media companies in videos monitoring to satisfy regulatory compliance.