Sunday, October 18, 2026
Social icon element need JNews Essential plugin to be activated.
No Result
View All Result
Digital Currency Pulse
  • Home
  • Crypto/Coins
  • NFT
  • AI
  • Blockchain
  • Metaverse
  • Web3
  • Exchanges
  • DeFi
  • Scam Alert
  • Analysis
Crypto Marketcap
Digital Currency Pulse
  • Home
  • Crypto/Coins
  • NFT
  • AI
  • Blockchain
  • Metaverse
  • Web3
  • Exchanges
  • DeFi
  • Scam Alert
  • Analysis
No Result
View All Result
Digital Currency Pulse
No Result
View All Result

New tool evaluates progress in reinforcement learning | MIT News

May 9, 2025
in Artificial Intelligence
Reading Time: 4 mins read
A A
0

[ad_1]

If there’s one factor that characterizes driving in any main metropolis, it’s the fixed stop-and-go as visitors lights change and as automobiles and vehicles merge and separate and switch and park. This fixed stopping and beginning is extraordinarily inefficient, driving up the quantity of air pollution, together with greenhouse gases, that will get emitted per mile of driving. 

One strategy to counter this is called eco-driving, which will be put in as a management system in autonomous automobiles to enhance their effectivity.

How a lot of a distinction might that make? Would the influence of such programs in lowering emissions be well worth the funding within the know-how? Addressing such questions is one in every of a broad class of optimization issues which were tough for researchers to deal with, and it has been tough to check the options they give you. These are issues that contain many various brokers, akin to the numerous completely different sorts of automobiles in a metropolis, and various factors that affect their emissions, together with velocity, climate, street situations, and visitors gentle timing.

“We received a number of years in the past within the query: Is there one thing that automated automobiles might do right here when it comes to mitigating emissions?” says Cathy Wu, the Thomas D. and Virginia W. Cabot Profession Improvement Affiliate Professor within the Division of Civil and Environmental Engineering and the Institute for Information, Methods, and Society (IDSS) at MIT, and a principal investigator within the Laboratory for Info and Choice Methods. “Is it a drop within the bucket, or is it one thing to consider?,” she puzzled.

To deal with such a query involving so many elements, the primary requirement is to assemble all accessible knowledge concerning the system, from many sources. One is the structure of the community’s topology, Wu says, on this case a map of all of the intersections in every metropolis. Then there are U.S. Geological Survey knowledge exhibiting the elevations, to find out the grade of the roads. There are additionally knowledge on temperature and humidity, knowledge on the combo of car varieties and ages, and on the combo of gas varieties.

Eco-driving entails making small changes to reduce pointless gas consumption. For instance, as automobiles strategy a visitors gentle that has turned purple, “there’s no level in me driving as quick as attainable to the purple gentle,” she says. By simply coasting, “I’m not burning gasoline or electrical energy within the meantime.” If one automotive, akin to an automatic automobile, slows down on the strategy to an intersection, then the standard, non-automated automobiles behind it would even be compelled to decelerate, so the influence of such environment friendly driving can lengthen far past simply the automotive that’s doing it.

That’s the essential concept behind eco-driving, Wu says. However to determine the influence of such measures, “these are difficult optimization issues” involving many various components and parameters, “so there’s a wave of curiosity proper now in methods to clear up onerous management issues utilizing AI.” 

The brand new benchmark system that Wu and her collaborators developed based mostly on city eco-driving, which they name “IntersectionZoo,” is meant to assist handle a part of that want. The benchmark was described intimately in a paper introduced on the 2025 Worldwide Convention on Studying Illustration in Singapore.

approaches which were used to deal with such advanced issues, Wu says an essential class of strategies is multi-agent deep reinforcement studying (DRL), however an absence of satisfactory normal benchmarks to guage the outcomes of such strategies has hampered progress within the subject.

The brand new benchmark is meant to deal with an essential concern that Wu and her staff recognized two years in the past, which is that with most current deep reinforcement studying algorithms, when skilled for one particular scenario (e.g., one specific intersection), the end result doesn’t stay related when even small modifications are made, akin to including a motorcycle lane or altering the timing of a visitors gentle, even when they’re allowed to coach for the modified situation.

The truth is, Wu factors out, this drawback of non-generalizability “isn’t distinctive to visitors,” she says. “It goes again down all the way in which to canonical duties that the group makes use of to guage progress in algorithm design.” However as a result of most such canonical duties don’t contain making modifications, “it’s onerous to know in case your algorithm is making progress on this type of robustness concern, if we don’t consider for that.”

Whereas there are various benchmarks which might be presently used to guage algorithmic progress in DRL, she says, “this eco-driving drawback contains a wealthy set of traits which might be essential in fixing real-world issues, particularly from the generalizability standpoint, and that no different benchmark satisfies.” Because of this the 1 million data-driven visitors eventualities in IntersectionZoo uniquely place it to advance the progress in DRL generalizability.  Consequently, “this benchmark provides to the richness of the way to guage deep RL algorithms and progress.”

And as for the preliminary query about metropolis visitors, one focus of ongoing work can be making use of this newly developed benchmarking device to deal with the actual case of how a lot influence on emissions would come from implementing eco-driving in automated automobiles in a metropolis, relying on what share of such automobiles are literally deployed.

However Wu provides that “relatively than making one thing that may deploy eco-driving at a metropolis scale, the principle purpose of this examine is to assist the event of general-purpose deep reinforcement studying algorithms, that may be utilized to this utility, but additionally to all these different purposes — autonomous driving, video video games, safety issues, robotics issues, warehousing, classical management issues.”

Wu provides that “the venture’s purpose is to supply this as a device for researchers, that’s overtly accessible.” IntersectionZoo, and the documentation on methods to use it, are freely accessible at GitHub.

Wu is joined on the paper by lead authors Vindula Jayawardana, a graduate scholar in MIT’s Division of Electrical Engineering and Laptop Science (EECS); Baptiste Freydt, a graduate scholar from ETH Zurich; and co-authors Ao Qu, a graduate scholar in transportation; Cameron Hickert, an IDSS graduate scholar; and Zhongxia Yan PhD ’24. 

[ad_2]

Source link

Tags: Cathy Wucontextual reinforcement learningdeep reinforcement learning (DRL)Eco-drivingevaluatesInstitute for Data Systems and SocietyIntersectionZooLaboratory for Information and Decision Systems (LIDS)LearningMITMIT CEEMIT IDSSMIT LIDSNewsprogressReinforcementTool
Previous Post

RWKV-X Combines Sparse Attention and Recurrent Memory to Enable Efficient 1M-Token Decoding with Linear Complexity

Next Post

Nomad Hacker Suspect Arrested in Israel to Be Extradited to US

Next Post
Nomad Hacker Suspect Arrested in Israel to Be Extradited to US

Nomad Hacker Suspect Arrested in Israel to Be Extradited to US

VeeFriends TCG Play Network Launches for 2025 Competitive Season

VeeFriends TCG Play Network Launches for 2025 Competitive Season

Q&A: A roadmap for revolutionizing health care through data-driven innovation | MIT News

Q&A: A roadmap for revolutionizing health care through data-driven innovation | MIT News

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Social icon element need JNews Essential plugin to be activated.

CATEGORIES

  • Analysis
  • Artificial Intelligence
  • Blockchain
  • Blog
  • Crypto/Coins
  • DeFi
  • Exchanges
  • Metaverse
  • NFT
  • Scam Alert
  • Web3
No Result
View All Result

SITEMAP

  • About us
  • Disclaimer
  • DMCA
  • Privacy Policy
  • Terms and Conditions
  • Cookie Privacy Policy
  • Contact us

Copyright © 2024 Digital Currency Pulse.
Digital Currency Pulse is not responsible for the content of external sites.

No Result
View All Result
  • Home
  • Crypto/Coins
  • NFT
  • AI
  • Blockchain
  • Metaverse
  • Web3
  • Exchanges
  • DeFi
  • Scam Alert
  • Analysis
Crypto Marketcap

Copyright © 2024 Digital Currency Pulse.
Digital Currency Pulse is not responsible for the content of external sites.