Dr. Mark Colley

Mark Colley
Dr. Mark Colley
PhD Research Assistant
                 

Mark Colley, Dr.

Mark Colley joined the HCI group in April 2019 as a research associate and doctoral candidate. Prior to that, he worked as a software engineer at Airbus since 2015. His main research interests lay in the intersection of future mobility, accessibility, and computational methods.

Mark defended his dissertation, "Calibrating Trust in Automated Vehicles - Theoretical, Design, and Empirical Insights into Effects of Visualizations on Trust", on April 26th, 2024.

Mark holds an M. Sc. in Computer Science (2018) from the University of Ulm. The title of the master thesis was: Identification, Investigation and Classification of Use Cases for Cooperation in Highly Autonomous Driving and the Applicability thereof. This was done within the project KoFFI - Kooperative Fahrer-Fahrzeug-Interaktion.

Mark received his B. Eng. in Information Technology in 2015 at the Duale Hochschule Baden-Württemberg Ravensburg/Friedrichshafen in cooperation with Airbus.

Research interests

  • Autonomous Driving
  • Driver-Vehicle Interaction
  • Augmented Reality
  • Virtual Reality
  • Mobile Devices
  • Head Mounted Displays

Projects

As part of the "Smart Mobility" research funding program of the state of Baden-Württemberg, the "Intuitiver" project for interaction between automated vehicles and easily vulnerable road users will start in November 2018. The project focuses on how autonomous vehicles and pedestrians can recognize each other's intentions, for example when crossing the road, and how autonomous vehicles inform occupants of their intentions. Prof. Dr. Martin Baumann (Psychology), Prof. Dr. Klaus Dietmayer (Measurement, Control and Microtechnology), Prof. Dr. Christian Waldschmidt (Microwave Technology) and Prof. Dr. Enrico Rukzio (Media Informatics) of the University of Ulm are part of the consortium.

 

Mark examines in the context of the joint project <a class="external-link-new-window" href="https://www.uni-ulm.de/in/omi/institut/blog/details/article/neues-projekt-intuitiver-zur-interaktion-zwischen-automatisierten-fahrzeugen-und-leicht-verletzbaren-verkehrsteilnehmern/" title="Opens internal link in current window">Intuitiver</a> communication possibilities between highly automated vehicles and easily vulnerable road users (pedestrians, cyclists, etc.)

Cooperation partner: Ulm University, AVL Software & Functions GmbH, Human-Factors-Consult GmbH, Humatects GmbH, OFFIS e.V..

SituWare addresses a central obstacle to the introduction of highly automated vehicles (see also BASt) into complex traffic: The required time reserve for a safe transfer of control to distracted Driver. Even medium-term available environment sensors cannot always guarantee large time reserves. SituWare reduces the takeover time by means of a targeted, driver situational awareness
Adapted driver guidance and allows a fluid vehicle behaviour with high user acceptance by adapting the automation to the driver's situation awareness.

 

Mark examines how transfer processes can be made safer and faster through multimodal attention and information guidance.

The goal of the project SEMULIN (Self-supporting Multimodal Interaction) is the development of a self-supporting, natural and consistent human-machine interface for automated driving vehicles by means of multimodal input and output concepts.

In cooperation with Elektrobit Automotive GmbH (project lead), audEERING GmbH, Eesy Innovation GmbH, Fraunhofer Institute for Integrated Circuits, Infineon Technologies AG, University of Ulm, and the associated partner Mercedes-Benz AG, novel interaction concepts are developed considering multimodal input and output concepts.


Mark investigates how previous interaction takes place in vehicles and how it can be improved by multimodal interaction.

 

 

People with vision impairments (VIP) are among the most vulnerable road users in traffic. Autonomous vehicles are believed to reduce accidents but still demand some form of external communication signaling relevant information to pedestrians. Recent research on the design of vehicle-pedestrian communication (VPC) focuses strongly on concepts for a non-disabled population. Our work presents an inclusive user-centered design for VPC, beneficial for both vision impaired and seeing pedestrians. We conducted a workshop with VIP (N=6), discussing current issues in road traffic and comparing communication concepts proposed by literature...

Read more...

Teaching

I am happy to supervise Bachelor and Master theses with a focus on the interaction with (partially) autonomous vehicles and their bigger scale effects. The focus is on the interaction in the car, but also on the interaction of outsiders (passers-by, cyclists, ...) with autonomous vehicles. I am always open to suggestions for topics from you.

Please contact me by e-mail if you are interested. Below are listed some potential fields of work.

I am looking forward to our cooperation.

 

Open Topics:

Multimodal Interaction in Automated Driving
Uncertainty Visualization in Automated Driving
Aiding Impaired Persons Through Autonomous Vehicles External Communication
Information Needs in Highly Automated Driving
External Communication in Highly Automated Driving

Implicit Communication of (Highly Automated) Vehicles

Incorporating Human Operators in Vehicle-Human Communication

Macroscopic Effects of eHMIs on Traffic

Further topics can be found under this Link

 

Master Theses

  • Investigations on the Use of Augmented Reality for Information Visualization in Connected Automated Driving
  • Exploring the Social Context of Collaborative Driving
  • Optimizing Localization of Sound for the Hearing Impaired in Traffic with AVs
  • SwiVR-Car-Seat: Utilizing a Motorized Swivel Seat to Explore Effects of Vehicle Motion on Interaction Quality in Virtual Reality Automated Driving
  • User-Centric Exploration of In-Car Augmented Reality UI Concepts for See-Through Head-Mounted Displays

Bachelor Theses

  • Informationsbedürfnisse in autonomen Fahrzeugen und Auswirkung der Visualisierung der Fußgängerintention auf Vertrauen und kognitive Belastung
  • External Communication of Heavy Machinery (or Autonomous Trucks) on Construction Sites
  • Effect of Displaying Semantic Segmentation on Trust, Situation Awareness and Cognitive Load
  • Increasing Pedestrian Safety Using External Communication of Autonomous Vehicles for Signalling Hazards
  • Auswirkung der Visualisierung der Wahrnehmung Autonomer Fahrzeuge in Kritischen Verkehrssituationen auf Vertrauen und Kognitive Belastung
  • Investigating the Effects of Prosocial External Communication of Autonomous Vehicles
  • Auswirkungen von Abstraktionsebenen in der Informationsvisualisierung auf Situationsbewusstsein, Kognitive Belastung und Benutzerfreundlichkeit bei Kontrollübernahme-Aufforderungen in Hochautomatisierten Fahrzeugen
  • Effects of Scene Detection, Scene Prediction, and Maneuver Planning Visualizations on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles
  • Realistic Scenarios for the Communication between Autonomous Vehicle and Pedestrians
  • Investigating the Effects of External Communication and Automation Behavior on Manual Drivers
  • Mode Confusion of External Communication

Scientific Activities

I reviewed more than 240 papers and Late-Breaking Works, for example, for:

Conference Reviewer: MobileHCI '19'21'22'23, AutoUI '19'20'21'22'23, CHI PLAY '19'20'21'22'23, CHI'20'21'22, TEI'21'23, HRI'21'22, IUI'21'23, DIS'21'22'23, ICMI'21'22, C&C'21'22, ISCW'21'22, ISMAR'21'22'23, IASDR'21, ISS'21, VRST '21'22, EICS'22'23, SUI'21'22, HAI'21'22, IEEE VR'22'23'24, OzCHI'22'23, ETRA'22'23, IDC'22, ICWSM'22, IMX'22'23, NordiCHI'22, CogSci'23, WHC'23, UIST'23, HRI'24,

Journal Reviewer: Frontiers in Human Dynamics, CSCW '21'22'23, Case Studies on Transport Policy, IJHCI, IMWUT'22'23, Behaviour & Information Technology '23, ToCHI'23

Book Reviewer: User Experience Design in the Era of Automated Driving

 

For this, I received some awards:

1 "Special Recognition for Outstanding Reviews" CHI 2021

1 "Special Recognition for Outstanding Reviews" CHI 2022

1 "Special Recognition for Outstanding Reviews" AutoUI 2021

1 "Special Recognition for Outstanding Reviews" IMWUT 2023

1 "Special Recognition for Outstanding Reviews" UIST 2023

1 "Special Recognition for Outstanding Reviews" MobileHCI 2023

Distinguished Reviewer Award for MobileHCI'23

3 "Special Recognition for Outstanding Reviews" CHI 2024

 

I also helped to organize some conferences:

Organizer LBW: CHI'21'22'23'24  Late Breaking Work AC, ETRA'24

Organizer Full Paper: AutoUI'21'22'23, MobileHCI'23, MuC'22'23, CHI'24 Full Paper AC

Best Paper Committe for CHI'24

 

Conference Organizer: Workshop and Tutorial Co-Chair AutoUI'23, Demo Co-Chair AutoUI'24

 

 

Some of my papers also received awards:

1 Best Full Paper Honorable Mention at CHI'20

1 Best Full Paper Honorable Mention at MobileHCI'22

1 Best Full Paper Honorable Mention at MobileHCI'23

1 Best Video at AutoUI'23

 

Publications

2024

93.
Fink, Paul; Milne, Hannah; Caccese, Anthony; Alsamsam, Maher; Loranger, Jacob; Colley, Mark; Giudice, Nicholas
Accessible Maps for the Future of Inclusive Ridesharing
Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’24) (Conditionally Accepted)
09 2024
Publisher: ACM
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/AutoUI_2024_accessible_maps_ridesharing_preprint.pdf
92.
Ebel, Patrick; Bazilinskyy, Pavlo; Colley, Mark; Goodridge, Courtney; Hock, Philipp; Janssen, Christian P.; Sandhaus, Hauke; Srinivasan, Aravinda Ramakrishnan; Wintersberger, Philipp
Changing Lanes Toward Open Science: Openness and Transparency in Automotive User Research
Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’24) (Conditionally Accepted)
09 2024
Publisher: ACM
91.
Stampf, Annika; Colley, Mark
Deriving Non-Driving-Related Activities in Highly Automated Driving via an Autoethnographic Approach by Traveling Canada in a Recreational Vehicle
Mensch und Computer 2024, Joint First Authors
09 2024
DOI:10.1145/3670653.3670663
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/MuC2024_NDRT_Camper_preprint.pdf
90.
Stampf, Annika; Colley, Mark; Knuth, Ann-Kathrin; Tasci, Cagla; Rukzio, Enrico
Examining Psychological Conflict-Handling Strategies for Highly Automated Vehicles to Resolve Legal User-Vehicle Conflicts
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. (IMWUT)
09 2024
Publisher: ACM
DOI:10.1145/3678511
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/IMWUT24_ConflictResolutionStrategies.pdf
89.
Stampf, Annika; Colley, Mark; Girst, Bettina; Rukzio, Enrico
Exploring Passenger-Automated Vehicle Negotiation Utilizing Large Language Models for Natural Interaction
Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’24)
09 2024
Publisher: ACM
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/AutoUI24_ConflictResolutionStrategies.pdf
88.
Asha, Ashratuz Zavin; Colley, Mark; Sultana, Sharifa; Sharlin, Ehud
Introducing AV-Sketch: An Immersive Participatory Design Tool for Automated Vehicle --- Passenger Interaction
Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’24)
09 2024
Publisher: ACM
DOI:10.1145/3640792.3675705
ISBN:979-8-4007-0510-6/24/09
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/AutoUI2024_Paper_Design_Ideation_in_VR_preprint.pdf
87.
Stampf, Annika; Sasalovici, Markus; Meinhardt, Luca-Maxim; Colley, Mark; Giss, Marcel; Rukzio, Enrico
Move, Connect, Interact: Introducing a Design Space for Cross-Traffic Interaction
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. (IMWUT)
09 2024
Publisher: ACM
DOI:10.1145/3678580
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/IMWUT2024_Cross_Traffic_Interaction.pdf
86.
Wagner, Tobias; Colley, Mark; Breckel, Daniel; Kösel, Michael; Rukzio, Enrico
UnitEye: Introducing a User-Friendly Plugin to Democratize Eye Tracking Technology in Unity Environments
Mensch und Computer 2024, Joint First Authors, cond. accepted
09 2024
DOI:10.1145/3670653.3670655
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/MuC2024_UnitEye_preprint.pdf
85.
Stampf, Annika; Knuth, Ann-Kathrin; Colley, Mark; Rukzio, Enrico
Law and Order: Investigating the Effects of Conflictual Situations in Manual and Automated Driving in a German Sample
International Journal of Human-Computer Studies
07 2024
Publisher: Elsevier
DOI:10.1016/j.ijhcs.2024.103260
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/IJHCS2024_Law_and_Order.pdf
84.
Colley, Mark; Wanner, Beate; Rädler, Max; Rötzer, Marcel; Frommel, Julian; Hirzle, Teresa; Jansen, Pascal; Rukzio, Enrico
Effects of a Gaze-Based 2D Platform Game on User Enjoyment, Perceived Competence, and Digital Eye Strain
In Proc. of CHI 2024 (SIGCHI Conference on Human Factors in Computing Systems)
May 2024
Publisher: ACM
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/CHI_2024_Shed_Some_Fear_preprint.pdf
83.
Colley, Mark; Rajabi, Omid; Rukzio, Enrico
Investigating the Effects of External Communication and Platoon Behavior on Manual Drivers at Highway Access
In Proc. of CHI 2024 (SIGCHI Conference on Human Factors in Computing Systems)
May 2024
Publisher: ACM
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/CHI_2024_Platooning_preprint.pdf
82.
Dey, Debargha; Senan, Toros; Hengeveld, Bart; Colley, Mark; Habibovic, Azra; Ju, Wendy
Multi-Modal eHMIs: The Relative Impact of Light and Sound in AV-Pedestrian Interaction
In Proc. of CHI 2024 (SIGCHI Conference on Human Factors in Computing Systems)
May 2024
Publisher: ACM
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/CHI_2024_Multimodal_eHMIs_preprint.pdf
81.
Bu, Fanjun; Li, Stacey; Goedicke, David; Colley, Mark; Sharma, Gyanendra; Ju, Wendy
Portobello: Extending Driving Simulation from the Lab to the Road
In Proc. of CHI 2024 (SIGCHI Conference on Human Factors in Computing Systems)
May 2024
Publisher: ACM+
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/CHI_2024_Portobello_preprint.pdf
80.
Jansen, Pascal; Colley, Mark; Pfeifer, Tim; Rukzio, Enrico
Visualizing Imperfect Situation Detection and Prediction in Automated Vehicles: Understanding Users’ Perceptions via User-Chosen Scenarios
Transportation Research Part F: Traffic Psychology and Behaviour, Joint First Authors
05 2024
Publisher: Elsevier
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/TRF24__Skepticism_Towards_Imperfect_AI_in_Automated_Driving_preprint.pdf
79.
Colley, Mark; Hartwig, Sebastian; Zeqiri, Albin; Ropinski, Timo; Rukzio, Enrico
AutoTherm: A Dataset and Benchmark for Thermal Comfort Estimation Indoors and in Vehicles
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. (IMWUT); Joint First Authors
2024
Publisher: ACM
DOI:10.1145/3678503
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/IMWUT2024_Thermal_Comfort_final_preprint.pdf
78.
Colley, Mark; Speidel, Oliver; Strohbeck, Jan; Rixen, Jan Ole; Belz, Jan Henry; Rukzio, Enrico
Effects of Uncertain Trajectory Prediction Visualization in Highly Automated Vehicles on Trust, Situation Awareness, and Cognitive Load
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 7 (4)
January 2024
Publisher: Association for Computing Machinery
DOI:10.1145/3631408
File:https://doi.org/10.1145/3631408
77.
Meinhardt, Luca-Maxim; Rück, Maximilian; Zähnle, Julian; Elhaidary, Maryam; Colley, Mark; Rietzler, Michael; Rukzio, Enrico
Hey, What’s Going On? Conveying Traffic Information to People with Visual Impairments in Highly Automated Vehicles: Introducing OnBoard
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. (IMWUT)
2024
Publisher: ACM
DOI:10.1145/3659618
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/IMWUT2024_Hey_whats_going_on_PrePrint.pdf
76.
Colley, Mark; Czymmeck, Julian; Kücükkocak, Mustafa; Jansen, Pascal; Rukzio, Enrico
PedSUMO: Simulacra of Automated Vehicle-Pedestrian Interaction Using SUMO To Study Large-Scale Effects
9th Annual ACM/IEEE International Conference on Human Robot Interaction (HRI)
2024
Publisher: ACM/IEEE
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2024/HRI2024_SUMO_AV_eHMI_final_no_DOI.pdf

2023

75.
Colley, Mark; Stampf, Annika; Fischer, William; Rukzio, Enrico
Effects of 3D Displays on Mental Workload, Situation Awareness, Trust, and Performance Assessment in Automated Vehicles
International Conference on Mobile and Ubiquitous Multimedia (MUM ’23)
December 2023
Publisher: ACM
DOI:10.1145/3626705.3627786
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2023/MUM_2023_3D_Display_final_compressed.pdf
74.
Colley, Mark; Speidel, Oliver; Strohbeck, Jan; Rixen, Jan Ole; Belz, Jan Henry; Rukzio, Enrico
Effects of Uncertain Trajectory Prediction Visualization in Highly Automated Vehicles on Trust, Situation Awareness, and Cognitive Load
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) :23
December 2023
Publisher: ACM
DOI:10.1145/3631408
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2023/IMWUT_2023_Uncertainty_Trajectory_final.pdf
73.
Jansen, Pascal; Britten, Julian; Häusele, Alexander; Segschneider, Thilo; Colley, Mark; Rukzio, Enrico
A Demonstration of AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies
Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’23 Adjunct)
09 2023
Publisher: ACM
DOI:10.1145/3581961.3610374
Weblink:https://autovis-demo.onrender.com/
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2023/AutoUI23_AutoVis_Demo_Jansen.pdf
72.
Suzuki, Saki; Colley, Mark; Li, Stacey; Mandel, Ilan; Stampf, Annika; Ju, Wendy
Design Methods for Mobility After Manual Driving: Prototyping Mobile Lifestyle
Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’23 Adjunct)
09 2023
Publisher: ACM
71.
Colley, Mark; Evangelista, Cristina; Rubiano, Tito Daza; Rukzio, Enrico
Effects of Urgency and Cognitive Load on Interaction in Highly Automated Vehicles
Proceedings of the 25th International Conference on Mobile Human-Computer Interaction (MobileHCI '23)
09 2023
Publisher: ACM
DOI:10.1145/3604254
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2023/MobileHCI2023_multimodal_interaction_final_compressed.pdf
70.
Woide, Marcel; Miller, Linda; Colley, Mark; Damm, Nicole; Baumann, Martin
I've Got the Power: Exploring the Impact of Cooperative Systems on Driver-Initiated Takeovers and Trust in Automated Vehicles
Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’23)
09 2023
Publisher: ACM
69.
Meinhardt, Luca-Maxim; Colley, Mark; Fassbender, Alexander; Rukzio, Enrico
Stairway to Heaven: A Demonstration of Different Trajectories and Weather Conditions in Automated Urban Air Mobility
Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’23 Adjunct); Joint First Authors
09 2023
Publisher: ACM
DOI:https://doi.org/10.1145/3581961.3610372
File:/fileadmin/website_uni_ulm/iui.inst.100/1-hci/hci-paper/2023/AutoUI2023_UAM_Interactive_Demo.pdf