The Forrester Wave™: Computer Vision Tools, Q1 2024

Computer Vision Tools Vendor Product Comparisons 2024

Key features and pros and cons of top Computer Vision Tools products:

Amazon Web Services - Leaders

Pros:

Comprehensive MLOps capabilities that complement its CV platform
SageMaker Ground Truth creates accurate ML training capabilities with human-in-the-loop approach
Leverages advanced, pretrained models for various applications including defect identification, medical image analyses, and social media content identification
Strong customer-centric innovation strategy addressing diverse industry requirements

Cons:

Platform could benefit from a more comprehensive and intuitive user interface
Vision and strategy would benefit from adding sustainable and ethical practices
Declined to participate in the full Forrester Wave evaluation process

Clarifai - Leaders

Pros:

One-stop-shop CV platform with robust prebuilt industry applications
Strong in data management including AI-based data synthesis, autolabeling, advanced augmentation, and cross-modal data integration
Distinguishes itself by letting users alter third-party models readily and extensively
Supports multi-industry use cases with content flow, visual inspection, intelligent surveillance reconnaissance, and content organization
Best-of-breed full-stack infrastructure with model orchestration, fine-tuning, and supervision all under one umbrella

Cons:

Scope for improvement in pricing transparency, with reference customers struggling to understand how and why they are charged
Should invest in more advanced automated data validation tools and AI-driven data quality monitoring systems
Reference customers want a more straightforward user interface to access the platform's full possibilities

Chooch - Leaders

Pros:

Pre-integrated and prebuilt capabilities make it a versatile CV platform for scaled deployments
Innovation around edge modeling and inference capabilities guarantees flexibility in wide range of environments
Compellingly deals with diverse data inputs including 3D, satellite, drone, robotic dogs, and CAD images
ReadyNow models enable various use cases including weapons identification, object and face recognition, fire, smoke, and slip-and-fall
ImageChat technology helps fine-tune inquiries and outcomes using meta-prompts in a conversational way

Cons:

Should consider implementing a more comprehensive data quality testing framework
Product vision could benefit from the addition of ethical AI
Only one reference customer responded to Forrester's outreach for this evaluation

Google - Leaders

Pros:

Offers best-in-class vision models through Vertex AI
Model Garden provides an extensive assortment of vision models and APIs
Neural Architecture Search optimizes complex and large CV models in weeks rather than months
Built on Google Cloud with superior architecture leveraging GPUs and tensor processing units
Strong security best practices including customer-managed encryption keys, access transparency, and various third-party certifications

Cons:

Needs to incorporate more detailed and specific milestones, including better user experience, into overall computer vision product roadmap
Further investment in data management, particularly in bulk data annotation, would help enhance overall solution
Only one reference customer responded to Forrester's outreach for this evaluation

H2O.ai - Leaders

Pros:

Differentiates with focus on CV democratization through no-code tools
Label Genie excels in data lineage and health checks using unsupervised learning, cluster, and zero-shot techniques
Provides fantastic user experience supported by beautiful UI and attractive CV model input and output visualizations
Proven deep learning models found on Kaggle leaderboards
Ability to aid with automated annotations and pre-annotations using text-based descriptions

Cons:

Roadmap would benefit from additional compliance and advanced security features
Needs to extend support to additional sources of third-party CV models beyond timm library
Should automate the feedback loop between inference and model training and improve edge capabilities
Did not provide reference customers for this evaluation

Cogniac - Strong Performers

Pros:

Enables quick return on CV spend by shortening time from idea generation to deployment
Highly effective data anomaly detection functionality with iterative dashboards
Excels in edge solutions with EdgeFlow inference performing GPU-accelerated near-real-time inference
Partner network facilitates pre-integration with multiple cameras, tech stacks, and infrastructure providers
Minimizes data labeling and model training efforts early in project lifecycle

Cons:

Platform would benefit from addition of third-party models, mainly via a marketplace
Would benefit from more frequent engagement with customers via webinars, newsletters, and customer advisory boards
Only one reference customer responded to Forrester's outreach for this evaluation

Deepomatic - Strong Performers

Pros:

Strong in field operation with industry-specific off-the-shelf features preintegrated with field operations solution providers
Workflow combination of CV models effectively takes care of use cases in field operations
Good, easily deployable CV capabilities on the edge via single click
Invested in emerging technologies such as genAI for use within workflows

Cons:

Needs to include more sophisticated annotation capabilities including AI assistance and cross-modal functionalities
Would benefit from more comprehensive, AI-supported, and guided custom model training and inferencing capabilities
Missing broader capabilities such as extensive data management, model development and testing
Could benefit from strategic consultancy services to help customers align platform with business objectives
Reference customers did not respond to Forrester's outreach for this evaluation

Matroid - Strong Performers

Pros:

Excels at monitoring and detection with comprehensive pretrained detectors
Rapidly spins bespoke detectors for various industry use cases including anomaly detection, predictive maintenance, and X-ray detection
Simplified visual analysis and overall user experience aimed at broader user base beyond data scientists
No-code CV platform allows customers to create, install, and maintain detectors without coding skills

Cons:

Strategy would benefit from more extensive partner ecosystems including collaborative research initiatives and strategic partnerships
Currently missing extensive edge capabilities such as customizable edge deployment choices
Lacks extensive third-party collaboration
More extensive change management support such as workshops, webinars, and certification courses could help drive adoption
Declined to participate in the full Forrester Wave evaluation process

SAS - Strong Performers

Pros:

Provides solid AI analytics platform with support for convolutional neural networks and deep learning models
Performs well in data lineage and health insights
Offers reasonable CV data augmentation capabilities inside image action sets in Viya
Model bias evaluation is crucial element that CV models may use
Focuses on democratizing AI by allowing users to collaborate in unified platform

Cons:

Needs to add more comprehensive CV-specific capabilities ranging from data management and training to inferencing
Lacks prebuilt CV models and applications to compete in CV platform space
AI platform should offer more extensive customization options for edge deployments
Declined to participate in the full Forrester Wave evaluation process

Cognex Corporation - Contenders

Pros:

Pioneers logistics CV solutions as established provider of vision systems, software, and sensors
Low-/no-code CV capabilities enable individuals without specialist knowledge to address business challenges
Edge Intelligence offers CV models that are prevalidated and pre-integrated with edge devices
Solution allows concurrent processing of multiple images on different devices

Cons:

Requires more sophisticated features such as advanced model guidance process and robust model customization tools
Needs enhanced data and model quality assurance systems to become serious competitor in developing bespoke CV models
Roadmap must include data management, model development, and testing capabilities for strategic shift to software subscriptions
Declined to participate in the full Forrester Wave evaluation process

Cigniti - Challengers

Pros:

Offers good annotation capabilities with focus on redefining data annotation
Strength lies in data management including data collecting, annotation, and anomaly avoidance
Offers customers flexibility with ability to leverage existing data storage solutions without data migration
Offers automated segmentation tasks beyond manual annotation capability

Cons:

Falls short of full-fledged CV platform - needs to build exhaustive set of CV platform capabilities
Has functional gaps in model development and testing, particularly in using third-party models
Complementary technologies such as edge capability are missing from offerings
Needs to add services like data unit testing, model quality assessment, model validation, and full-fledged model inferencing
Current roadmap focuses mainly on annotation-related features
Reference customers did not respond to Forrester's outreach for this evaluation

Veritone - Challengers

Pros:

Does well in media content with various multimodal CV models for facial recognition, object recognition, translation, and transcription
Has developed search tools in photos and movies to help find specific items
Solution allows customers to connect to disparate systems and ingest third-party models
Simple pricing strategy based on active usage of pretrained models
Innovation centered around seamlessly switching AI engines without disruptions

Cons:

Needs to expand CV offerings and develop better capabilities for building bespoke models
Should consider creating more expansive partner ecosystem where partners can coinnovate and deliver CV solutions
Needs advanced data quality assurance frameworks and more developed model optimization methodologies
Reference customers want more efficient onboarding process, documentation, and workflow features
Business proposition is to orchestrate CV solutions for specific outcomes rather than being full-fledged CV platform provider

FAQs

Q: Which vendors are Leaders in 2024?

A: Amazon Web Services, Clarifai, Chooch, Google, H2O.ai

Q: What does "Leader" mean in Forrester Wave terms?

A: Leaders in the Forrester Wave demonstrate strong current offerings and robust strategies. They excel in delivering comprehensive computer vision capabilities across both horizontal and vertical use cases, with superior performance in data management, model development, architecture, and market presence.

Q: How do I interpret a Forrester Wave?

A: https://www.forrester.com/policies/forrester-wave-methodology/

Report:

Top Vendor Products for Computer Vision Tools in 2024

Computer Vision Tools Vendor Product Comparisons 2024

Pros:

Cons:

Pros:

Cons:

Pros:

Cons:

Pros:

Cons:

Pros:

Cons:

Pros:

Cons:

Pros:

Cons:

Pros:

Cons:

Pros:

Cons:

Pros:

Cons:

Pros:

Cons:

Pros:

Cons:

FAQs

Q: Which vendors are Leaders in 2024?

Q: What does "Leader" mean in Forrester Wave terms?

Q: How do I interpret a Forrester Wave?

Reference