Yolo Vision Shenzhen
Shenzhen
Join now
Back to customer stories

SiteAssist improves construction site safety with Ultralytics YOLO

Problem

SiteAssist needed a reliable way to verify safety compliance across large construction sites, where manual image checks were slow, inconsistent, and often unreliable.

Solution

Using Ultralytics YOLO models, SiteAssist automated image verification, enabling real-time detection of compliance issues and streamlining safety workflows across thousands of users and various sites.

Construction sites involve high-risk activities like lifting operations and hot work, where teams need to follow strict safety procedures before work begins. To confirm these checks, workers usually upload photos as proof through digital workflows.

However, reviewing these images isn't always straightforward. They can be unclear, incomplete, or sometimes misleading, making it difficult to know if safety requirements have actually been met, especially during large projects.

SiteAssist supports these workflows through its digital platform, using a combination of tools and AI. In particular, computer vision models like Ultralytics YOLO models are used to analyze uploaded images, helping the platform understand what is happening on site, flag invalid submissions, and highlight potential issues. This reduces manual effort and enables teams to maintain consistent safety standards.

Improving safety and compliance on construction sites using AI

SiteAssist is a control-of-work platform designed for teams managing high-risk activities across construction, infrastructure, and other critical industries. It replaces complex, paper-based processes with structured digital workflows, supporting tasks such as excavation, hot work, lifting, and confined-space operations.

Companies like Balfour Beatty, Taylor Woodrow (VINCI), Skanska, and HG Construction use SiteAssist to improve consistency, maintain compliance, and keep projects running smoothly. By digitizing permits and workflows, the platform helps teams identify potential risks and ensure that safety requirements are applied consistently.

Today, SiteAssist supports thousands of workers, giving teams clearer insight into day-to-day operations. Having this improved visibility gives teams greater control over safety processes.

Why construction safety checks break down at scale

Keeping construction sites safe and running smoothly isn’t simple. Large projects often involve thousands of workers operating across multiple locations, each carrying out high-risk tasks that require strict safety checks before work begins. 

To verify that these checks have been completed, workers are typically required to upload photos as proof into digital workflows or permit systems. But reviewing these submissions isn’t always straightforward. 

Images can be unclear, incomplete, or sometimes misleading, making it difficult to confirm whether safety requirements have actually been met. Approvers have to manually check each submission, looking for the correct equipment, proper setup, and overall compliance. 

As the number of submissions increases, this process becomes more time-consuming and harder to manage consistently. At the same time, many projects still rely on paper-based permits or partially digitized workflows. 

This slows down approvals, creates bottlenecks, and limits real-time visibility into site activities. Teams may need to follow up in person or repeat checks, which adds further delays. 

As operations scale, these challenges make it harder to maintain consistent safety standards and increase the risk of missed or delayed checks.

Enabling robust safety checks with Ultralytics YOLO models

SiteAssist simplifies safety checks by combining permit workflows with real-time image verification. Instead of relying on manual reviews, teams can capture and upload images directly from the field, with each submission validated before approvals proceed. This helps ensure safety checks happen consistently, even in changing conditions.

Behind the scenes, each uploaded image is analyzed using Ultralytics YOLO models, leveraging vision tasks like object detection and image classification to understand what is present on site. 

Models like Ultralytics YOLO26 have been fine-tuned on SiteAssist’s own datasets, built from images collected across real construction sites through its platform. This includes around 45 construction-related objects, such as fire extinguishers, safety gear, gas canisters, and common power tools and machinery.

The system identifies these objects and checks whether required items are visible, flagging anything that is missing or doesn’t meet the expected criteria. It can also highlight invalid submissions, such as images that aren’t taken in real site conditions. Across these submissions, an average of 1.7 objects per image is detected, rising to 2.7 when excluding background images, highlighting the density of meaningful activity on site.

Here are a couple of examples of how Ultralytics YOLO models are used within SiteAssist:

  • Validating live images: The system can detect when an uploaded image isn’t taken in real conditions, such as a photo of a screen, and flag it for review.
  • Detecting and counting equipment: The system can identify required items, such as fire extinguishers, and check whether the correct number is present. In some cases, optical character recognition (OCR) is used alongside YOLO to extract text from images, such as reading labels to determine the type of equipment.
Fig 1. Detecting fire extinguishers using Ultralytics YOLO models on SiteAssist (Source)

Why choose Ultralytics YOLO models?

Ultralytics YOLO models provide the speed and accuracy SiteAssist needs for real-world image validation. Images can be processed quickly as they are uploaded, making it easier to run safety checks without delays.

In fact, since January 2025, SiteAssist has processed over 770,918 images using Ultralytics YOLO models, detecting more than 1,302,315 objects and demonstrating reliable performance at scale.

The Ultralytics Python package also makes it straightforward to train and fine-tune models using data collected from real site workflows. This means model performance can keep improving as more data is captured over time.

From a deployment perspective, YOLO models are efficient and flexible. SiteAssist currently processes images in the cloud as part of its backend, handling uploads from workers’ devices in real time. At the same time, the models can also run locally on devices, making it possible to support future use cases where processing happens directly on site.

Beyond this, with support for export formats like ONNX and ExecuTorch, the Ultralytics YOLO models can be integrated into different edge systems without adding complexity. This gives SiteAssist a practical and scalable way to build and expand its vision AI workflows.

SiteAssist and Ultralytics YOLO boost real-time safety checks

As of now, SiteAssist supports around 12,000 active users on approximately 4,000 devices, enabling safety workflows to scale efficiently for large, complex projects.

By introducing automated image verification, teams have reduced reliance on manual reviews and sped up approval processes. Tasks that previously required repeated checks can now be validated more quickly, helping work start on time and reducing delays.

YOLO-powered image analysis has also improved consistency in how safety checks are carried out. Submissions are evaluated in a more structured way, making it easier to identify missing equipment, artificial images, or incomplete checks. The most commonly detected objects, since January 2025, include over 283,000 vehicles and more than 201,000 people, as well as nearly 68,500 artificial images and over 55,000 fire extinguishers. 

This gives site managers clearer visibility into ongoing work and greater confidence that safety requirements are being met.

Fig 2. An example of an artificial photo detected by SiteAssist using Ultralytics YOLO.

On top of this, reducing manual paperwork has made it possible for teams to spend less time on administrative tasks and more time on-site. As a result, operations run more smoothly, and safety processes become more reliable across different locations.

Bringing vision-driven construction safety workflows to the edge

Looking ahead, SiteAssist is exploring edge AI to run Ultralytics YOLO models closer to where data is captured on site. By processing images directly on devices, the team aims to reduce cloud costs, improve data privacy, and support real-time decision-making. They plan to continue expanding these capabilities to enable more advanced, real-time safety and operational workflows.

Want to bring vision AI into your operations? Join our community and learn about applications like AI in healthcare and vision AI in agriculture. Visit our GitHub repository and discover licensing options to get started today!

Our solution to your industry

View all

Frequently asked questions

What are Ultralytics YOLO models?

Ultralytics YOLO models are computer vision architectures developed to analyze visual data from images and video inputs. These models can be trained for tasks including Object detection, classification, pose estimation, tracking and instance segmentation.Ultralytics YOLO models include:

  • Ultralytics YOLOv5
  • Ultralytics YOLOv8
  • Ultralytics YOLO11

What is the difference between Ultralytics YOLO models?

Ultralytics YOLO11 is the latest version of our Computer Vision models. Just like its previous versions, it supports all computer vision tasks that the Vision AI community has come to love about YOLOv8. The new YOLO11, however, comes with greater performance and accuracy, making it a powerful tool and the perfect ally for real-world industry challenges.

Which Ultralytics YOLO model should I choose for my project?

The model you choose to use depends on your specific project requirements. It's key to take into account factors like performance, accuracy, and deployment needs. Here's a quick overview:

  • Some of Ultralytics YOLOv8's key features:
  1. Maturity and Stability: YOLOv8 is a proven, stable framework with extensive documentation and compatibility with earlier YOLO versions, making it ideal for integrating into existing workflows.
  2. Ease of Use: With its beginner-friendly setup and straightforward installation, YOLOv8 is perfect for teams of all skill levels.
  3. Cost-Effectiveness: It requires fewer computational resources, making it a great option for budget-conscious projects.
  • Some of Ultralytics YOLO11's key features:
  1. Higher Accuracy: YOLO11 outperforms YOLOv8 in benchmarks, achieving better accuracy with fewer parameters.
  2. Advanced Features: It supports cutting-edge tasks like pose estimation, object tracking, and oriented bounding boxes (OBB), offering unmatched versatility.
  3. Real-Time Efficiency: Optimized for real-time applications, YOLO11 delivers faster inference times and excels on edge devices and latency-sensitive tasks.
  4. Adaptability: With broad hardware compatibility, YOLO11 is well-suited for deployment across edge devices, cloud platforms, and NVIDIA GPUs

What license do i need?

Ultralytics YOLO repositories, such as YOLOv5 and YOLO11, are distributed under the AGPL-3.0 License by default. This OSI-approved license is designed for students, researchers, and enthusiasts, promoting open collaboration and requiring that any software using AGPL-3.0 components also be open-sourced. While this ensures transparency and fosters innovation, it may not align with commercial use cases.
If your project involves embedding Ultralytics software and AI models into commercial products or services and you wish to bypass the open-source requirements of AGPL-3.0, an Enterprise License is ideal.

Benefits of the Enterprise License include:

  • Commercial Flexibility: Modify and embed Ultralytics YOLO source code and models into proprietary products without adhering to the AGPL-3.0 requirement to open-source your project.
  • Proprietary Development: Gain full freedom to develop and distribute commercial applications that include Ultralytics YOLO code and models.

To ensure seamless integration and avoid AGPL-3.0 constraints, request an Ultralytics Enterprise License using the form provided. Our team will assist you in tailoring the license to your specific needs.

Let’s build the future of AI together!

Begin your journey with the future of machine learning