Skip to content

This project aims to find a possible solution to a search problem in a given environment with two players using Proximal Policy Optimization as AI algorithm.

License

Notifications You must be signed in to change notification settings

EnriqManComp/smart-disks-PPO

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Smart Disks PPO

This project aims to find a potential solution to a search problem within a specified environment involving two players, utilizing Proximal Policy Optimization (PPO) as the AI algorithm.

Problem Statement

The primary objective of this project is to implement an AI solution for the blue disk to search the vicinity of the red disk. It's worth noting that both disks can be considered as robots with the ability to move along the x and y axes.

States

The states represent distance measurements obtained from a laser in the x and y directions, as can be observed in the following figure

Reward Model

The reward model is a combination of two reward functions. The first function provides the agent with a negative penalty if the disk enters the danger zone, where a collision could occur.



The second function provides the agent with a positive reward proportional to the Euclidean distance between the two disks. Additionally, if the blue disk achieves its goal, it receives a higher reward.



Training results

Test results

Video Demonstration

About

This project aims to find a possible solution to a search problem in a given environment with two players using Proximal Policy Optimization as AI algorithm.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages