DI-engine + sumo-rl demo

[PaParaZz1]

Hi, I am the developer of DI-engine, we are developing a new DRL platform with various algorithms and all kinds of environments.

It is very nice of your project and I want to ask whether you are willing to prepare a DI-engine + sumo-rl demo together, like the following examples:

[LucasAlegre]

Hi @PaParaZz1 !

Sure, what do you have in mind?

[PaParaZz1]

Hi @PaParaZz1 !

Sure, what do you have in mind?

OK, I think we can do some cooperations by the following steps:

1. A simple demo about DI-engine + sumo-rl, like current dqn_2way-single-intersection.py for SB3, which environment do you suggest is siutable for this demo, and can you offer the results of SB3 like reward curve for comparison.
2. Fancy video demo, we can design a visually expressive demo to attract more people for AI in traffic control. Do you have some materials or ideas about this?
3. Application for sumo-rl with other sub-domain RL research, like imitation learning, offline RL, MARL and so on. DI-engine integrates many different domains RL algorithms, so we can explore some interesting topics such as multi-agent cooperation, behavior cloning on expert policy and data on sumo-rl.

[PaParaZz1]

Can you provide more results(e.g. training curve) on different cases? We are doing some experiments on this repo with DI-engine and want to compare your previous results using SB3 and RLlib.