Running Ultralytics object detection and segmentation models in a few lines of code

Getting started with Ultralytics models

Ultralytics offers a comprehensive framework that supports multiple object detection and segmentation models. This includes the popular YOLO models, ranging from YOLOv3 to the latest YOLOv8, as well as YOLO-NAS and SAM models. These models are designed to handle a variety of tasks such as real-time detection, segmentation, and pose estimation.

To start, visit the Ultralytics documentation page. Here, you can find detailed information about each model, including their key features, architectures, and how to use them in your Python scripts.

Setting Up Your Environment

First, ensure you have Ultralytics installed. You can do this by running:

bash

Copy code

1<pre style="width: 75%;">
2<code>
3pip install ultralytics
4</code>
5</pre>

Once this is done, you can start using these models in your projects. Let's start with the YOLOv8 model as an example.

Key features of YOLOv8

YOLOv8 comes with several enhancements over its predecessors. It’s designed to be faster and more accurate, making it perfect for real-time applications. Some key features include: 

• Enhanced speed and accuracy
• Pre-trained weights for multiple tasks
• Support for object detection, segmentation, and classification
• Improved model architecture for better performance

Running YOLOv8 in Python

Here's how you can get started with YOLOv8 in just a few lines of code:

Copy code

<pre style="width: 75%;">
<code>
# Copy code
import ultralytics
model = ultralytics.YOLO('yolov8')
results = model.predict('path/to/your/image.jpg')
results.show()
</code>
</pre>

‍

That's it! You’ve just run a YOLOv8 model on an image. This simplicity is what makes Ultralytics models so powerful and user-friendly.

Live webcam detection

Want to see YOLOv8 in action on a live webcam feed? Here's how you can do it:

python

Copy code

1<pre style="width: 75%;">
2<code>
3# Copy code
4import ultralytics
5model = ultralytics.YOLO('yolov8')
6# Open a live webcam feed
7cap = cv2.VideoCapture(0)
8while True:
9	ret, frame = cap.read()
10	if not ret:
11		break
12	results = model.predict(frame)
13	results.show()
14	if cv2.waitKey(1) & 0xFF == ord('q'):
15		break
16cap.release()
17cv2.destroyAllWindows()
18</code>
19</pre>

‍

This script will open your webcam and apply the YOLOv8 model to detect objects in real-time.

Exploring other models

Ultralytics doesn't just stop at YOLOv8. They also support various other models like YOLOv5, YOLO-NAS, and transformer-based models for real-time detection. Each model has its own strengths and use cases.

Transformer models and how to run them

The RT-DETR model developed by Baidu and supported by Ultralytics, is a state-of-the-art, end-to-end object detector that offers real-time performance and high accuracy. It uses a conv-based backbone and an efficient hybrid encoder for real-time speed, excelling on CUDA with TensorRT, and supports flexible inference speed adjustment.

Here's how you can run a RT-DETR model:

Copy code

1<pre style="width: 75%;">
2<code>
3from Ultralytics import YOLO
4# Load a pretrained YOLOv8n model
5model = YOLO("rtdetr-l.pt")
6
7# Run inference on 'bus.jpg' with arguments
8model.predict("bus.jpg", save=True, imgsz=320, conf=0.5)
9</code>
10</pre>

‍

Running FastSAM

FastSAM is optimized for real-time segmentation, and here's how you can run it:

Copy code

1<pre style="width: 75%;">
2<code>
3import ultralytics
4model = ultralytics.SAM("FastSAM-s.pt")
5results = model.predict('path/to/your/image.jpg')
6results.show()
7</code>
8</pre>

‍

This model is perfect for applications that require quick and accurate segmentation.

Performance and comparisons

One of the great features of the Ultralytics framework is the ability to compare different models side by side. You can easily determine which model works best for your specific application by looking at performance metrics such as inference speed and mean average precision (mAP).

Main takeaways

Ultralytics makes it incredibly easy to run object detection and segmentation models with just a few lines of code. Whether you’re working on real-time applications or need high-precision models, Ultralytics has a solution for you. Make sure to check out Nicolai Nielsen's full tutorial on the Ultralytics YouTube channel for more in-depth information and examples.

Stay tuned for more tutorials and updates from the Ultralytics community!