-
Notifications
You must be signed in to change notification settings - Fork 2
/
Copy pathresearch.html
253 lines (211 loc) · 15.9 KB
/
research.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1.0,maximum-scale=1">
<title>IS3R Lab</title>
<!-- Loading logo -->
<link rel="shortcut icon" href="images/logo/2/is3r_logo.ico">
<!-- Loading third party fonts -->
<link href="fonts/novecento-font/novecento-font.css" rel="stylesheet" type="text/css">
<link href="fonts/font-awesome.min.css" rel="stylesheet" type="text/css">
<!-- Loading main css file -->
<link rel="stylesheet" href="style.css">
<!--[if lt IE 9]>
<script src="js/ie-support/html5.js"></script>
<script src="js/ie-support/respond.js"></script>
<![endif]-->
</head>
<body>
<div class="site-content">
<header class="site-header">
<div class="container">
<h1 class="page-title"><a href="index.html"><img src="images/logo/2/is3r_logo.png" alt="IS3R" width="64"> <strong>Intelligent Social Systems and Swarm Robotics Lab (IS<sup>3</sup>R)</strong></a></h1>
<!-- <h1 class="page-title"><a href="#"><strong>Intelligent Social Systems and Swarm Robotics Lab (IS<sup>3</sup>R)</strong></a></h1> -->
<div class="main-navigation">
<button class="menu-toggle"><i class="fa fa-bars"></i> Menu</button>
<ul class="menu">
<li class="menu-item"><a href="index.html">Home</a></li>
<li class="menu-item current-menu-item"><a href="research.html">Research</a></li>
<li class="menu-item"><a href="projects.html">Projects</a></li>
<li class="menu-item"><a href="members.html">Members</a></li>
<li class="menu-item"><a href="facilities.html">Facilities</a></li>
<li class="menu-item"><a href="publications.html">Publications</a></li>
<li class="menu-item"><a href="services.html">Services</a></li>
<li class="menu-item"><a href="media.html">Media</a></li>
<li class="menu-item"><a href="contact.html">Contact</a></li>
</ul>
</div>
<div class="mobile-navigation"></div>
</div>
</header> <!-- .site-header -->
<div class="page-head" data-bg-image="images/page_head/mrs_page_head.jpg">
<div class="container">
<h2 class="page-title">Research</h2>
</div>
</div>
<main class="main-content">
<div class="fullwidth-block">
<div class="container">
<div class="row">
<div class="content col-md-9">
<h2 class="section-title"><a name="1">Intelligent Social Systems</a></h2>
<div class="row">
<div class="col-lg-7">
<img class="img-fluid project-image rounded shadow-sm" src="images/research/overview_r.jpg" width="450" alt="project name" />
<!-- <img class="img-fluid project-image rounded shadow-sm" src="images/research/rne.png" width="450" alt="project name" /> -->
</div>
<div class="col-lg-5">
<h3 class="title"><a href="https://arxiv.org/pdf/2306.09445.pdf" target="_blank">Understanding the Application of Utility Theory in Robotics and Artificial Intelligence</a></h3>
<p class="mb-2">As a unifying concept in economics, game theory, and operations research, even in the Robotics and AI field, the utility
is used to evaluate the level of individual needs, preferences, and interests.
This research introduces a utility-orient needs paradigm to describe and evaluate inter and outer relationships among agents' interactions.
Then, we survey existing literature in relevant fields to support it and propose several promising research directions along with some open
problems deemed necessary for further investigations.</p>
<!-- <p><a class="more-link" href="https://arxiv.org/abs/2306.09445" target="_blank"><i class="fas fa-external-link-alt"></i>Find out more</a></p> -->
</div><!--//desc-->
</div>
<h2 class="section-title"><a name="2">Agent Learning</a></h2>
<div class="row">
<div class="col-lg-7">
<img class="img-fluid project-image rounded shadow-sm" src="images/research/policy_network.png" width="450" alt="project name" ><br />
<img class="img-fluid project-image rounded shadow-sm" src="images/research/walker2d_v2_5bsac.png" width="150" alt="project name" ><img class="img-fluid project-image rounded shadow-sm" src="images/research/walker2d-v2_5bsac.gif" width="75" alt="project name" ><img class="img-fluid project-image rounded shadow-sm" src="images/research/humanoid-v2_5bsac.png" width="150" alt="project name" ><img class="img-fluid project-image rounded shadow-sm" src="images/research/humanoid-v2_3bsac.gif" width="75" alt="project name" />
</div>
<div class="col-lg-5">
<h3 class="title"><a href="https://dl.acm.org/doi/10.1145/3643862" target="_blank">Bayesian Strategy Network (BSN) based Soft Actor Critic in Deep Reinforcement Learning</a></h3>
<p class="mb-2">Adopting reasonable strategies is challenging but crucial for an intelligent agent with limited resources working in hazardous, unstructured, and dynamic environments to improve the system utility, decrease the overall cost,
and increase mission success probability. Deep Reinforcement Learning (DRL) helps organize agents' behaviors and actions based on their state and represents complex strategies.
This research introduces a novel hierarchical strategy decomposition approach based on Bayesian chaining to separate an intricate policy into several simple sub-policies and organize their relationships as Bayesian strategy networks (BSN). </p>
<p><a class="more-link" href="https://github.com/RickYang2016/Bayesian-Soft-Actor-Critic--BSAC" target="_blank"><i class="fas fa-external-link-alt"></i>Find out more</a></p>
</div><!--//desc-->
</div><!--//item-->
<h2 class="section-title"><a name="3">Trust Among Agents</a></h2>
<div class="row">
<div class="col-lg-7">
<img class="img-fluid project-image rounded shadow-sm" src="images/research/REN_Trust.png" width="450" alt="project name" />
<!-- <img class="img-fluid project-image rounded shadow-sm" src="images/research/rne.png" width="450" alt="project name" /> -->
</div>
<div class="col-lg-5">
<h3 class="title"><a href="https://ieeexplore.ieee.org/abstract/document/9659187" target="_blank">How can robots trust each other for better cooperation? A relative needs entropy based robot-robot trust assessment model.</a></h3>
<p class="mb-2">Cooperation in MAS/MRS can help agents build various formations, shapes, and patterns presenting corresponding functions and purposes adapting to different situations. Relationship between agents such as their spatial proximity and functional similarities could play a crucial role in cooperation between agents. Trust level between agents is an essential factor in evaluating their relationships' reliability and stability, much as people do. </p>
<p><a class="more-link" href="https://github.com/RickYang2016/RNE-Agent-Trust-Model-SMC2021" target="_blank"><i class="fas fa-external-link-alt"></i>Find out more</a></p>
</div><!--//desc-->
</div>
<h2 class="section-title"><a name="4">MAS Decision-Making</a></h2>
<div class="row">
<div class="col-lg-7">
<!-- <img class="img-fluid project-image rounded shadow-sm" src="images/research/gut.jpg" width="450" alt="project name" /> -->
<img class="img-fluid project-image rounded shadow-sm" src="images/research/frontpic.jpg" width="450" alt="project name" />
<img class="img-fluid project-image rounded shadow-sm" src="images/research/gut_s.gif" width="450" alt="project name" />
<!-- <img class="img-fluid project-image rounded shadow-sm" src="images/research/gut.gif" width="450" alt="project name" /> -->
</div>
<div class="col-lg-5">
<h3 class="title"><a href="https://dl.acm.org/doi/abs/10.1145/3555776.3577642" target="_blank">A Hierarchical Game-Theoretic Decision-Making for Cooperative Multi-Agent Systems Under the Presence of Adversarial Agents</a></h3>
<p class="mb-2">The relationships among Multi-agent systems (MAS) working in hazardous and risky scenarios are complex, and game theory provides various methods to model agents' behaviors and strategies. In adversarial environments, the adversary can be regarded as
intentional or unintentional based on its needs and motivations. The agent will adopt suitable strategies to maximize the utilities achieving its current needs and minimizing expected costs. This research proposes a new network model called the Game-Theoretic Utility Tree (GUT),
combining the core principles of game theory and utility theory to achieve cooperative decision-making for MAS in adversarial environments. </p>
<p><a class="more-link" href="https://github.com/RickYang2016/Game-theortic-Utility-Tree--GUT" target="_blank"><i class="fas fa-external-link-alt"></i>Find out more</a></p>
</div><!--//desc-->
</div>
<div class="row">
<div class="col-lg-7">
<img class="img-fluid project-image rounded shadow-sm" src="images/research/gut_pursuit_overview.png" width="200" alt="project name" ><img class="img-fluid project-image rounded shadow-sm" src="images/research/gut_pursuit_game_5vs1.gif" width="250" alt="project name" />
</div>
<div class="col-lg-5">
<h3 class="title"><a href="https://ieeexplore.ieee.org/abstract/document/9861828" target="_blank">Game-theoretic Utility Tree for Multi-Robot Cooperative Pursuit Strategy</a></h3>
<p class="mb-2">This work extends the GUT in the pursuit domain to achieve MAS cooperative decision-making in catching an evader. We demonstrate the GUT's performance in the real robot implementing the Robotarium platform compared to the conventional constant bearing (CB) and pure pursuit (PP) strategies. </p>
<p><a class="more-link" href="https://github.com/RickYang2016/Gut-Pursuit-Domain-in-Robotarium-ISR2022" target="_blank"><i class="fas fa-external-link-alt"></i>Find out more</a></p>
</div><!--//desc-->
</div><!--//item-->
<h2 class="section-title"><a name="5">Cooperative MAS Cognitive Modeling</a></h2>
<div class="row">
<div class="col-lg-7">
<img class="img-fluid project-image rounded shadow-sm" src="images/research/robot-needs.png" width="175" alt="project name" ><img class="img-fluid project-image rounded shadow-sm" src="images/research/overview.png" width="275" alt="project name" />
<!-- <img class="img-fluid project-image rounded shadow-sm" src="images/research/diffE.gif" width="225" alt="project name" > -->
<img class="img-fluid project-image rounded shadow-sm" src="images/research/ddpl.gif" width="450" alt="project name" />
</div>
<div class="col-lg-5">
<h3 class="title"><a href="https://ieeexplore.ieee.org/abstract/document/9283249" target="_blank">Hierarchical Needs Based Self-Adaptive Framework For Cooperative Multi-Robot System</a></h3>
<p class="mb-2"> Natural systems (living beings) and artificial systems (robotic agents) are characterized by apparently complex behaviors that emerge as a result of often nonlinear spatiotemporal interactions among a large number of components at different levels of organization.
Simple principles acting at the agent level can result in complex behavior at the global level in a swarm system. Swarm intelligence is the collective behavior of distributed and self-organized systems.
Moreover, Multi-Robot systems (MRS) potentially share the properties of swarm intelligence in practical applications such as search, rescue, mining, map construction, exploration.</p>
<p><a class="more-link" href="https://github.com/RickYang2016/Self-Adaptive-Swarm-System_SASS_MRS2019" target="_blank"><i class="fas fa-external-link-alt"></i>Find out more</a></p>
</div><!--//desc-->
</div><!--//item-->
<!-- <h2 class="section-title"><a name="6">MAS Communication</a></h2> -->
<!-- <h2 class="section-title"><a name="7">Human-Robot Interaction</a></h2> -->
</div>
<!-- <div class="sidebar col-md-3 col-md-offset-1"> -->
<div class="sidebar col-md-3">
<div id="box">
<div id="float" class="div1">
<div class="widget">
<h3 class="widget-title">Research Areas</h3>
<ul class="bullet">
<li><a href="#1"><strong>Intelligent Social Systems</strong></a></li>
<li><a href="#2"><strong>Agent Learning</strong></a></li>
<li><a href="#3"><strong>Trust Among Agents</strong></a></li>
<li><a href="#4"><strong>MAS Decision-Making</strong></a></li>
<li><a href="#5"><strong>Cooperative MAS Cognitive Modeling</strong></a></li>
<li><a href="#6"><strong>MAS Consensus</strong></a></li>
<li><a href="#7"><strong>Human-Robot Interaction</strong></a></li>
<li><a href="#8"><strong>Cognitive Robotics</strong></a></li>
<li><a href="#8"><strong>Edge Cognitive Computing</strong></a></li>
</ul>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</main> <!-- .main-content -->
<footer class="site-footer">
<div class="container">
<div class="row">
<div class="col-md-5">
<div class="widget">
<h3 class="widget-title">General Info.</h3>
<p style="color:;font-size:18px;">PI: <a href="https://rickyang2016.github.io/" target="blank">Qin Yang</a>, Ph.D.</p>
<p>Intelligent Social Systems and Swarm Robotics Lab (IS<sup>3</sup>R)
<br> Computer Science and Information Systems Department
<br> College of Liberal Arts and Sciences
<br> Bradley University</p>
</div>
</div>
<div class="col-md-4">
<div class="widget">
<h3 class="widget-title">Address</h3>
<ul class="address">
<li><i class="fa fa-map-marker"></i> 1501 W Bradley Ave, Peoria, IL 61625</li>
<li><i class="fa fa-building-o"></i> Bradley Hall 195</li>
<li><i class="fa fa-phone"></i> (309)677-2459</li>
<li><i class="fa fa-envelope"></i> is3rlab@gmail.com</li>
</ul>
</div>
</div>
<div class="col-md-3">
<div class="widget">
<h3 class="widget-title">Follow Us</h3>
<table>
<tr>
<td><a href="https://www.youtube.com/channel/UCq7COfQQEO4gTbWEHp9XAvQ" target="blank"><img src="images/YT_logo.jpg" height="50" width="50"/></a></td>
<td><a href="https://github.com/is3rlab" target="blank"><img src="images/GitHub-logo.png" height="50" width="50"/></a></td>
<td><a href="https://www.researchgate.net/lab/Intelligent-Social-Systems-and-Swarm-Robotics-Lab-IS3R-Qin-Yang" target="blank"><img src="images/rg-logo.png" height="50" width="50"/></a></td>
<td><a href="https://www.linkedin.com/in/qin-yang-71ab2b94/" target="blank"><img src="images/LI_logo.jpg" height="50" width="50"/></a></td>
<td><a href="https://twitter.com/is3rlab" target="blank"><img src="images/twitter.jpg" height="50" width="50"/></a></td>
</tr>
</table>
</div>
</div>
</div> <!-- .row -->
<p class="colophon">Copyright 2024 <strong>IS<sup>3</sup>R Lab</strong>. All right reserved</p>
</div><!-- .container -->
</footer> <!-- .site-footer -->
</div>
<script src="js/jquery-1.11.1.min.js"></script>
<script src="js/plugins.js"></script>
<script src="js/app.js"></script>
</body>
</html>