Hey everybody,

I’ve a eager curiosity in drones and would like to get some recommendation from the neighborhood.

My Background: I'm an skilled backend developer and a drone hobbyist.

Notice: My questions usually are not DJI-specific, and I'm not utilizing DJI merchandise.

What I'm Making an attempt to Obtain

My aim is to automate drone flights by importing an XML file to the drone and processing the video feed with my AI/ML mannequin to extract some analytics.

Present Understanding and Setup

I’ve a fundamental understanding of drone parts, such because the Flight Controller, Companion PC (like a Raspberry Pi or comparable), and controllers.

In my present setup, we have now an MQTT Dealer that serves as the principle communication channel between the drone and my app.

https://preview.redd.it/e5v24kb74bid1.png?width=1650&format=png&auto=webp&s=8bb87666872d8ebdbe4036dcd7573ce8a38f6577

App Performance: My app is actually a Mission XML builder, which sends this mission file through MQTT to the Companion PC. The Companion PC then communicates with the flight controller.

Drone Platform: The drones I'm utilizing are geared up with ArduPilot, and we make the most of MAVLink instructions throughout the XML file.

I've hooked up the structure diagram for reference.

https://preview.redd.it/14dmrrt84bid1.png?width=1140&format=png&auto=webp&s=f07032f8ea4f02a785122628e21c04446d504075

My Questions

1. What’s MAVLink? What are the opposite choices obtainable?
2. Drone Internals: I perceive that drones have a flight controller, however what precisely are the {hardware} and software program parts right here? Why do we’d like a separate Companion PC? Can't we combine every part right into a single Companion PC? What are the completely different software program choices obtainable for Companion PCs?
3. Customized Flight Controller: If I wish to create my very own flight controller, what steps ought to I take? I desire a absolutely custom-made setup—what do I would like to change?
4. AI/ML Processing: If I must introduce a server to run my AI/ML logic, the place ought to it’s positioned? I doubt that the Companion PC alone might be enough.
5. Video Feed Show: We're utilizing WebRTC to point out video feeds. What’s the easiest way to show these video feeds?
6. 3D Mission Preview: Is there any library obtainable that may present a 3D preview of the drone's flight path primarily based on the uploaded mission XML?
7. Complete Overview: May somebody present a transparent image of all of the software program and {hardware} parts concerned in a drone setup?
8. Roadmap: What could be one of the best roadmap to attain my objectives?

Thanks prematurely for any insights or suggestions! I'm trying ahead to your solutions.