Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Control DJI Tello 🛸 using hand gesture recognition on drone`s camera video-stream. Feel free to contribute!
| Date | Stars |
|---|---|
| 2026-07-24 | 342 |
| 2026-07-25 | 342 |
| 2026-07-28 | 342 |
| 2026-07-30 | 342 |
| 2026-08-06 | 342 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# DJI Tello Hand Gesture control
-------
🏆 This project featured in [Official Google Dev Blog](https://developers.googleblog.com/2021/09/drone-control-via-gestures-using-mediapipe-hands.html)
-------
The main goal of this project is to control the drone using hand gestures without any gloves or additional equipment.
Just camera on the drone or your smartphone(soon), laptop and human hand.<br>
<img alt="demo_gif" src="https://user-images.githubusercontent.com/13486777/111168690-fb2e9280-85aa-11eb-894f-fe70633072fd.gif">
## Index
1. [Introduction](#Introduction)
2. [Setup](#Setup)
1. [Install pip packages](#1.-Installing-pip-packages)
2. [Connect and test Tello](#2.-Connect-Tello)
3. [Usage](#Usage)
* [Keyboard control](##Keyboard-control)
* [Gesture control](#Gesture-control)
4. [Adding new gestures](#Adding-new-gestures)
* [Technical description](#Technical-details-of-gesture-detector)
* [Creating dataset](#Creating-dataset-with-new-gestures)
* [Retrain model](#Notebook-for-retraining-model)
5. [Repository structure](#Repository-structure)
## Introduction
This project relies on two main parts - DJI Tello drone and Mediapipe fast hand keypoints recognition.
DJI Tello is a perfect drone for any kind of programming experiments. It has a rich Python API (also Swift is available) which helps to almost fully control a drone, create drone swarms and utilise its camera for Computer vision.
Mediapipe is an amazing ML platform with many robust solutions like Face mesh, Hand Keypoints detection and Objectron. Moreover, their model can be used on the mobile platforms with on-device acceleration.
Here is a starter-pack that you need:
<img alt="starter_pack" width="80%" src="https://user-images.githubusercontent.com/13486777/111294166-b65e3680-8652-11eb-8225-c1fb1e5b867d.JPG">
## Setup
### 1. Installing pip packages
First, we need to install python dependencies. Make sure you that you are using `python3.7`
List of packages
```sh
ConfigArgParse == 1.2.3
djitellopy == 1.5
numpy == 1.19.3
opencv_python == 4.5.1.48
tensorflow == 2.4.1
mediapipe == 0.8.2
```
Install
```sh
pip3 install -r requirements.txt
```
### 2. Connect Tello
Turn on drone and connect computer to its WiFi
<img width="346" alt="wifi_connection" src="https://user-images.githubusercontent.com/13486777/110932822-a7b30f00-8334-11eb-9759-864c3dce652d.png">
Next, run the following code to verify connectivity
```sh
python3 tests/connection_test.py
```
On successful connection
```json
1. Connection test:
Send command: command
Response: b'ok'
2. Video stream test:
Send command: streamon
Response: b'ok'
```
If you get such output, you may need to check your connection with the drone
```json
1. Connection test:
Send command: command
Timeout exceed on command command
Command command was unsuccessful. Message: False
2. Video stream test:
Send command: streamon
Timeout exceed on command streamon
Command streamon was unsuccessful. Message: False
```
## Usage
The most interesting part is demo. There are 2 types of control: keyboard and gesture. You can change between control types during the flight. Below is a complete description of both types.
Run the following command to start the tello control :
```sh
python3 main.py
```
This script will start the python window with visualization like this:
<img width="60%" alt="window" src="https://user-images.githubusercontent.com/13486777/111294470-09d08480-8653-11eb-895d-a8ca9f6a288d.png">
### Keyboard control
To control the drone with your keyboard at any time - press the `k` key.
The following is a list of keys and action description -
* `k` -> Toggle Keyboard controls
* `g` -> Toggle Gesture controls
* `Space` -> Take off drone(if landed) **OR** Land drone(if in flight)
* `w` -> Move forward
* `s` -> Move back
* `a` -> Move left
* `d` -> Move right
* `e` -> Rotate clockwise
* `q` -> Rotate counter-clockwise
* `r` -> Move up
* `f` -> Move down
* `Esc` -> End program and land the drone
Excerpt of 9,629 characters
Read on GitHubWould you bet a product on this? Bounded 0–100 and slow moving.
matched fp:dfd9439533179c91, topic:tensorflow