Advertisement · 728 × 90

Posts by André Biedenkapp

something

8 months ago 0 0 0 0
In building IntersectionZoo, three main logical layers are used to abstract functionality as shown in this figure. In the traffic scenario modeling layer, we first build data-driven simulation environments of signalized intersections and then use them to build traffic scenarios at those intersections. Concretely, an intersection is first defined by factors such as lane lengths, lane counts, road grades, turn lane configuration, and speed limit of each approach. Then, vehicle type, age, and fuel type distributions are used with appropriate traffic flow rates and human driven vehicle behaviors to define a realistic traffic flow. Each intersection is then used to define traffic scenarios by further assigning representative atmospheric temperature and humidity values based on the season. Further scenario variations can be achieved by changing the eco-driving adoption level (0%-100%).

Once traffic scenarios are modeled, the CMDP modeling layer is used to contain them as Conextual Markov Decision Process (CMDP) and define the state, action, reward to be used with the reinforcement learning algorithms. CMDP is used to model problem variations. In IntersectionZoo, each city is modeled as a CMDP with each traffic scenario stemming from the city as a problem variation. In a CMDP, each problem variation is an MDP defined by a problem variation context and called a context-MDP. In eco-driving, those context-MDPs are defined by the following state, action and reward functions and formulate as a multi-agent control problem.

In user configuration layer, we provide users the flexibility to configure their experimental setup.

In building IntersectionZoo, three main logical layers are used to abstract functionality as shown in this figure. In the traffic scenario modeling layer, we first build data-driven simulation environments of signalized intersections and then use them to build traffic scenarios at those intersections. Concretely, an intersection is first defined by factors such as lane lengths, lane counts, road grades, turn lane configuration, and speed limit of each approach. Then, vehicle type, age, and fuel type distributions are used with appropriate traffic flow rates and human driven vehicle behaviors to define a realistic traffic flow. Each intersection is then used to define traffic scenarios by further assigning representative atmospheric temperature and humidity values based on the season. Further scenario variations can be achieved by changing the eco-driving adoption level (0%-100%). Once traffic scenarios are modeled, the CMDP modeling layer is used to contain them as Conextual Markov Decision Process (CMDP) and define the state, action, reward to be used with the reinforcement learning algorithms. CMDP is used to model problem variations. In IntersectionZoo, each city is modeled as a CMDP with each traffic scenario stemming from the city as a problem variation. In a CMDP, each problem variation is an MDP defined by a problem variation context and called a context-MDP. In eco-driving, those context-MDPs are defined by the following state, action and reward functions and formulate as a multi-agent control problem. In user configuration layer, we provide users the flexibility to configure their experimental setup.

An example of cooperative eco-driving at signalized intersections where CVs are controlled to minimize the total exhaust emissions of the fleet (both CVs and HDVs) while minimizing the impact on the travel time of each vehicle. While CVs are controllable by some defined eco-driving strategy, HDVs are driven by humans and can not be controlled. However, CVs implicitly control HDVs through car-following dynamics and by forming locally cooperative teams for better system control (by controlling the oppotunities of HDVs to overake CVs).

An example of cooperative eco-driving at signalized intersections where CVs are controlled to minimize the total exhaust emissions of the fleet (both CVs and HDVs) while minimizing the impact on the travel time of each vehicle. While CVs are controllable by some defined eco-driving strategy, HDVs are driven by humans and can not be controlled. However, CVs implicitly control HDVs through car-following dynamics and by forming locally cooperative teams for better system control (by controlling the oppotunities of HDVs to overake CVs).

we show the intersection distribution of each city and the distributions of intersection features of each city. The full dataset of 16,334 intersections in compliance with SUMO simulator can be found in the [here](https://drive.google.com/drive/folders/1y3W83MPfnt9mSFGbg8L9TLHTXElXvcHs?usp=sharing).

we show the intersection distribution of each city and the distributions of intersection features of each city. The full dataset of 16,334 intersections in compliance with SUMO simulator can be found in the [here](https://drive.google.com/drive/folders/1y3W83MPfnt9mSFGbg8L9TLHTXElXvcHs?usp=sharing).

Excited to announce IntersectionZoo, a benchmark that uses a real-world traffic problem to test generalization progress in deep reinforcement learning, particularly multi-agent contextual RL. 🤖🧠

MIT News coverage: news.mit.edu/2025/new-too...
Benchmark: intersectionzoo-docs.readthedocs.io

11 months ago 16 3 1 1
NAS Unseen-Data

The 5th NAS Unseen-Data Challenge at #AutoML25 is on! 🥊 How well do your #NAS pipelines perform on completely new, unseen datasets? 📊
Phase 1 is open until June - grab the starter kit and start building! Winners will be announced at #AutoMLConf in #NYC 🗽
More info 👉 www.nascompetition.com

11 months ago 6 4 0 0
AutoML

The #AutoMLConf deadline was extended! We’re looking for groundbreaking contributions in #AutoML, NAS, LLMs, agent-based systems, hyperparameter optimization, benchmarking, algorithm selection, and more. Don’t miss your chance to showcase your work in #NYC!
📅 Deadline: March 31
🌐 CfP: 2025.automl.cc

1 year ago 8 5 0 1

📣 The 5th AutoML School is coming to Tübingen! Whether you are new to #AutoML or an experienced researcher, this is the Summer School for you.

Join us for 4 exciting days exploring basic topics, studying cutting edge-research and having fun.

📅 June 10th-13th, Tübingen, Germany
🔗 automlschool.org

1 year ago 13 7 4 2
Preview
Choose France - CNRS AI Rising Talents As part of the French Strategy in Artificial Intelligence (AI), the Choose France - CNRS AI Rising Talents program offers exceptionally tal

Job alert: full-time researcher position for AI with CNRS here in France. Initial contract for 5 years (tenure track). Attractive starting package and better salary than regular positions. I have been w/ @cnrs.fr since 2013, it's great!
Applications due 31/03
www.ins2i.cnrs.fr/en/cnrsinfo/...

1 year ago 21 21 1 0
2024 in AutoRL TL;DR: From integrating RL with VLMs and LLMs to hyperparameter tuning, environment design, and generalization, 2024 was packed with innovation. We’ve highlighted top advancements in AutoRL and inclu...

Starting the year off with some AutoRL inspiration: the autorl.org team put together our favorite papers on how to make RL work that we found in 2024 - and it's been a pretty great year! 🌟🚀 Let us know what we missed!

autorl.org/blog/retrosp...

1 year ago 9 2 1 0
Post image

Ah didn't know that. Then have a screenshot instead 😅

1 year ago 1 0 1 0
Post image

And I've just been teasered by audible about my stats, so I'll share them as well 🙃
Of the ~420 hours if listened a lot to The Expanse, Harry Potter and Rivers of London

1 year ago 1 0 0 0
Preview
Mein Wrapped 2024 – hol dir deins 2024 Wrapped

I've been instructed by @saiprasanna.in to post more. But I'm lazy and it off ideas, so I'll just post my Spotify wrapped 😅
Apparently I made it into the top 2% of Linkin park listeners this year.
open.spotify.com/wrapped/shar...

1 year ago 2 0 2 0
Advertisement
AutoML

Big news! The AutoML Conference is back! 🎉

Next year, we’re heading to the city that never sleeps: New York City🗽. Save the date: Sept 8–11, 2025.

Stay tuned for updates, and in the meantime, check out our website: 2025.automl.cc.

See you there?
#AutoML25 #AutoMLConf #NYC #AutoML

1 year ago 19 5 0 2
[AUTOML24] Automated Reinforcement Learning
[AUTOML24] Automated Reinforcement Learning YouTube video by AutoMLConf

Already working on it 😉

Hoping to see more RL in and for AutoML after Theresa's and my tutorial at this years conf youtu.be/3vYlUGRk6oY?...

1 year ago 1 0 0 0
Preview
ICLR 2025 Workshop Proposals Welcome to the OpenReview homepage for ICLR 2025 Workshop Proposals

The list of accepted workshops for ICLR 2025 is available at openreview.net/group?id=ICL...
@iclr-conf.bsky.social

We received 120 wonderful proposals, with 40 selected as workshops.

1 year ago 57 15 1 5
Preview
Dreaming of Many Worlds: Learning Contextual World Models Aids Zero-Shot Generalization Zero-shot generalization (ZSG) to unseen dynamics is a major challenge for creating generally capable embodied agents. To address the broader challenge, we start with the simpler setting of contextual...

Our paper "Dreaming of Many Worlds" studied zero-shot generalization in world models for Contextual RL and was later accepted by RLC and EWRL. Here's a thread summarizing the work and putting it in the context in retrospect as ideas for potential future collaborations!

arxiv.org/abs/2403.10967

1 year ago 62 8 3 0
Welcome to the Home of Automated Reinforcement Learning AutoRL aims to make RL applicable out of the box by using AutoML and Meta-Learning to make it more efficient, robust and general. AutoRL.org provides an overview of the state of AutoRL.

🔧 autorl.org - crowdsourcing what actually works in RL tuning. Early days & growing! Got insights on hyperparameters, design decisions, or automation? Join us! #RL

1 year ago 1 2 0 0

If there's still room, could you please add me? :)

1 year ago 1 0 1 0