OpenCV AI Kit OAK-D-Lite: OV7251×2+IMX214+Intel Movidius Myriad X for Depth AI OAK
Note: The product is now for presale and the estimated delivery date is at the beginning of January 2022
- Depth camera: OV7251
- Color camera: IMX214
- AI chip: Intel Myriad X 4T
- Video codec: [email protected], H265
- NN platform supports: All platform
- interface: USB3.0
- Power consumption: 2.5W
- Development language: Python C++
- Development Platform: Win10/Linux/macOS/RPI and more
You’re up and running in 3 clicks. On Raspberry Pi, Mac, Windows & Linux.
It just works. And it’s open source – so you can dig in and change anything you want.
Packs a Punch
Tons of Power. Tons of Examples. You’re up and running in 30 seconds:
3D Object Detection
3D object detection is what humans do. We know where objects are – and where they are in physical space. It’s why we can pick up a coffee cup, or catch a ball.
3D Object Pose
Get the pose of objects in yaw, pitch, and role – in addition to where they are in physical space.
3D Semantic Segmentation
3D depth information that is semantically labeled per pixel. This allows your robot to stay on the sidewalk, or know when there’s some object in your path.
Human Pose Estimation
Track hands and/or full body pose in full 3D coordinates.
3D Human Pose Estimation
Motion Capture – without any additional hardware/sensors/etc. with direct Unity tie-in.
3D Hand Pose Estimation
The possibilities are endless. From keeping hands safe – to all sorts of interactive control.
3D Manipulation and Control
Pair with a holographic display from the Looking Glass Factory… and make the future now.
3D Gaze Estimation
Someone giving you elevator eyes? Now your robot can know this too. Or your smart dash cam. Or your assistive robot that will grab what you’re looking at.
3D Vehicle Detection
Know the full speed, trajectory, and vehicle type/color, license plate region/province, and plate number.
3D Pedestrian Detection
The spatial data of OAK-D-Lite doing privacy-first analytics of dwell time (in physical space), the direction of travel, and people counting – including direction, travel speed, and interest estimation.
3D Edge Detection
Edge detection is useful in so many ways. Find the edge of the lane, use it to better get 3D locations of objects (semantic labeling to the edge), or just have a fantastic real-time techno dance party. It’s incredibly fun and fascinating to play with.
3D Feature Tracking
This allows your robot to orient itself, and know how it’s moving, visually. Just like Lionel Messi does when sprinting a field, now your thing can too.
Onboard 4K Video Encoding
This alone is a reason to have an OAK-D-Lite (or 10) in your toolbox (or schoolbox) – you can now record 4k video on a Pi Zero! 373MB/s -> 3.125MB/s – all on-camera. h.264, h.265, MJPEG, JPEG, and lossless JPEG at up to 13MP.
Disparity Depth (Global Shutter For Fast Motion)
Depth+ AI Driven Focus for Perfect Shots
The built-in 13MP color camera can be lossless zoomed 6x and panned – all guided by AI and with 1080p HD or 4k encoded output.
Anonymize On-Device for Privacy-First Recordings
The onboard AI can be used to automatically blur faces (or any other details) prior to video encoding – to allow having a video of what you need (e.g. is the product damaged?) without sacrificing the privacy of people.
ROS1 and ROS2 Plug&Play
Your imagination is the only limit. OAK—D. LITE gives you a human-like perception as a building block.
From minute 0.
Learn By Doing – The Perfect Gift for Kids
The Open Source Cortic AI Toolkit allows you to drag and drop to make powerful custom applications. And better yet, also runs on Raspberry Pi – a perfect pairing for OAK-D Lite.
Control Anything With Gestures – From Anywhere
The DepthAI pipeline builder allows you to do things like below. Where a person is found, then the limbs are found, and then from there the hand is found, and from there a hand-pose (and/or sign-language) model is run on the hand. The 13 MegaPixel helps a TON here – to have enough pixels left after the whole pipeline has effectively 40x zoomed.
Make Your Drone Super Smart
Augmented Startups even has a course on building what you see below yourself with OAK-D-Lite.
Make Mini Pupper As Smart as a Border Collie
Seriously. The Mini Pupper is already a blast. But with OAK-D-Lite vision, it’s now your Border-Collie-level smart robotic dog. Border Collies are amazing because they can learn very specific hand signals (and they’re neurotic about them). Now Mini Pupper can be just as amazing (and neurotic)!
Make Multiplayer VR, AR, XR
Knowing what things are, and where – in real-time on a low-cost device – has the promise of allowing all sorts of multi-player experiences. Imagine if Laser Tag was no longer tech from the 1980s? We think OAK-D-Lite will help here.
Make Your Robot Fun and Interactive
The built-in AI unlocks all sorts of fun applications. Your imagination is the only limit.
Make an Autonomous Lawn Mower
Finally… a Roomba for your back yard. And you can make one!
Perform Sports Analytics
The global shutter cameras – which give depth at over 200FPS – allow the device to see at speeds that a human can. So just like a person can track a ping pong ball in physical space – OAK-D-Lite can too. But since it’s tech-based, it can record the position of the ball at 200+FPS. Full trajectory and speed of your shots!
Enable Your Robot to Navigate Autonomously
Feature tracking, depth, object detection in 3D space. OAK-D-Lite is like a cheat mode for robotic navigation.
Communicate Holographically with The Looking Glass Factory
The Looking Glass Factory has solved the Holographic part. But the capture part of holograms is still painful. We think that over time – and with community support – OAK-D-Lite will be a piece of allowing real-time Holographic communication for the first time.
Here’s our 3D Engineer Sachin on the Looking Glass Portrait.
Give Unity Spatial AI Super Powers
Figure Out Where You Are Without GPS
Using the feature tracking above – and an external IMU – it is now possible to estimate your (robot’s) position without GPS.
Make Wheelchairs Smart and Safe
Depth and AI allow making powered wheelchairs automatically prevent commands that would cause harm (like an errant comment that would bring the wheelchair down a flight of stairs).
Translate Sign Language and Track it in 3D Space
Not kidding. It can do this. And Cortic Technology makes an Open Source education platform that makes building this easier than building the lego that holds OAK-D-Lite
Monitor Life-Signs Passively and Safely
Keep pre-term babies safe using human-like perception to know if everything is OK. This allows not having potentially dangerous, invasive monitoring. And also acts as a force multiplier for doctors, nurses and parents.
Monitor Pulse Visually
We actually didn’t believe this one at first. It’s crazy such a thing can be detected passively.
Monitor Breathing Health Passively
The combination of depth and artificial intelligence allows you to monitor things that previously would feel like science fiction. Identify the sections of the chest with AI, and use depth to know the breathing profile over time.
Improve the Well-Being of Animals
Just like helping people. This can be used to know when animals are stressed, injured, or otherwise have a health problem – by monitoring behavior and activity in physical space.
Make a Dash Cam That Helps Keep Everyone Safe
Build off of OAK, bluebox Co-pilot keeps your vehicle safe, you safe, and can automatically log (other) aggressive drivers and dangerous situations.
Give Legos Super Powers
This is what we all dreamed of as kids. It’s now possible. So jealous.
Translate Semaphore Alphabet
Yep, in 3D Space too. We didn’t even know this was a thing. But OAK-D-Lite can do it. Thanks to geax. Gotta love open source.
Film Wildlife Automatically
The GIF doesn’t do it justice. This is a beautiful 4K video.
Automatically record 4k videos and/or beautiful 13MP JPEGs when certain species are detected.
Pick only the ripe ones. Sort by ripeness. Avoid people with Strawberry Allergies.
Detect Pests in Your Garden or Farm
Lasers instead of harmful chemicals. Feels like science fiction. It’s the future.
Estimate Biomass for Smart Agriculture
This one is above our heads. But super cool and agriculture geeks have to love this, right?
Efficiently Sort & Pack Parcel
We get this one. Algorithms are great at packing. Given them the information they need, real-time. Let robotics pack for us!
Improve Your Workouts
I can’t touch my toes. With OAK-D-Lite… maybe I’ll be able to.
Explore the Ocean
Only some tiny portion of the Ocean is explored. No, really. IPOZ is changing that with OAK technology.
Control Your Robots with Your Hands
When we saw this we were blown away! We couldn’t control ourselves. Thanks, Boris!
Did We Mention ROBOTS? 🤖 ⚡️ 🤖
Detect Falls While Respecting Privacy
Depth view gives an idea of what is happening – while respecting privacy. And you can just send metadata instead of images at all.
Improve Your Manufacturing Process
AI for detecting defects is great. But often without depth, the error rate is just too high. Depth is the missing piece – a piece that humans have – which allows the accuracy to be sufficiently high to finally be useful.
Save Hands and Limbs
The capability to mimic a human-like understanding of what things are and where enables tons of human-machine safety applications.
Count Crowds – And Return Meta Data
Since the counting is done on-device – there’s actually no need to return anything more than the metadata itself (the crowd count). Enabling communication over extremely-low bandwidth links like LoRa.
Keep People Safe from Distracted Drivers
This is what started it all. And it remains our North Star. Distracted driving causes fender benders when between cars. When between a car and a person, it kills.
Spatial AI can be used to change the course of history as it’s happening. To prevent accidents as they were going to occur.
OAK—D. LITE is built on the open-source DepthAI ecosystem, with out-of-the-box supported by the following frameworks, but since the API (and hardware) are open-source, it’s easy to extend support to nearly any language & framework.
Out-of-the-box Python, C++, Java, ROS & ROS2, Roboflow, CEP Support
Any Operating System
Works with any OS. You name it. Pre-built binaries are regularly released for Mac, Windows, Ubuntu, Raspberry Pi OS, and the Jetson series.
And since it’s heavily open source (including being able to download the design files), every day we wake up to some new integration with a new language, or suite of tools, etc.
We worked hand-in-hand with ArduCam to design cameras from the ground up for OAK-D Lite.
The mechanical design of OAK-D Lite was highly iterative – taking in feedback from Alpha testing and initial field deployments of the first prototypes built to refine to the final design.