Dr. Aaron C. Elkins
Past Member
Biography
Aaron investigates how the voice, face, body, and language, reveal emotion, deception, and cognition for advanced human-computer interaction (HCI) and artificial intelligence applications. Complementary to the development of advanced artificial intelligence systems is their impact on the people using them to make decisions. Aaron also investigates how human decision makers are psychologically affected by, use, perceive, and incorporate the next generation of screening technologies into their lives.
Face analysis:
Affect analysis
Body gesture analysis:
Human activity detection and its application to social signals detection
Audiovisual human behaviour analysis:
Audiovisual human behaviour data capture,
Non-linguistic vocalisation recognition,
Social signal processing,
Affect analysis
Publications
Book chapters
Unobtrusive Deception Detection
A. C. Elkins, S. Zafeiriou, J. Burgoon, M. Pantic. Handbook of Affective Computing, R. Calvo, S. DMello, A. Kappas and J. Gratch Eds.. Springer, pp. 503 - 515, 2014.
author = {A. C. Elkins and S. Zafeiriou and J. Burgoon and M. Pantic},
pages = {503--515},
booktitle = {Handbook of Affective Computing, R. Calvo, S. DMello, A. Kappas and J. Gratch Eds.},
publisher = {Springer},
title = {Unobtrusive Deception Detection},
year = {2014},
}
%A Elkins, A. C.
%A Zafeiriou, S.
%A Burgoon, J.
%A Pantic, M.
%B Handbook of Affective Computing, R. Calvo, S. DMello, A. Kappas and J. Gratch Eds.
%D 2014
%I Springer
%F unobtrusive_deception_detection_aaron_2013
%P 503-515
Journal articles
The automatic detection of chronic pain-related expression: requirements, challenges and a multimodal dataset
M. S. Aung, S. Kaltwang, B. Romera-paredes, B. Martinez, A. Singh, M. Cella, M. F. Valstar, H. Meng, A. Kemp, A. C. Elkins, N. Tyler, P. J. Watson, A. C. Williams, M. Pantic, N. Berthouze. IEEE Transactions on Affective Computing. 2016.
author = {M. S. Aung and S. Kaltwang and B. Romera-paredes and B. Martinez and A. Singh and M. Cella and M. F. Valstar and H. Meng and A. Kemp and A. C. Elkins and N. Tyler and P. J. Watson and A. C. Williams and M. Pantic and N. Berthouze},
journal = {IEEE Transactions on Affective Computing},
title = {The automatic detection of chronic pain-related expression: requirements, challenges and a multimodal dataset},
year = {2016},
}
The Sound of Trust: Voice as a Measurement of Trust During Interactions with Embodied Conversational Agents
A. C. Elkins, D. Derrick. Group Decision and Negotiation. January 2013.
author = {A. C. Elkins and D. Derrick},
journal = {Group Decision and Negotiation},
month = {January},
title = {The Sound of Trust: Voice as a Measurement of Trust During Interactions with Embodied Conversational Agents},
year = {2013},
}
%T The Sound of Trust: Voice as a Measurement of Trust During Interactions with Embodied Conversational Agents
%A Elkins, A. C.
%A Derrick, D.
%J Group Decision and Negotiation
%D 2013
%8 January
%F elkins2013sound
Are Users Threatened by Credibility Assessment Systems?
A. C. Elkins, N. Dunbar, B. Adame, J. Nunamaker. Journal of Management Information Systems. in press 2013.
author = {A. C. Elkins and N. Dunbar and B. Adame and J. Nunamaker},
journal = {Journal of Management Information Systems},
month = {in press},
title = {Are Users Threatened by Credibility Assessment Systems?},
year = {2013},
}
%T Are Users Threatened by Credibility Assessment Systems?
%A Elkins, A. C.
%A Dunbar, N.
%A Adame, B.
%A Nunamaker, J.
%J Journal of Management Information Systems
%D 2013
%8 in press
%F elkins2013users
Vocal Analysis Software for Security Screening: Validity and Deception Detection Potential
A. C. Elkins, J. Burgoon, J. Nunamaker. Homeland Security Affairs. March 2012.
journal = {Homeland Security Affairs},
month = {March},
title = {Vocal Analysis Software for Security Screening: Validity and Deception Detection Potential},
year = {2012},
}
%T Vocal Analysis Software for Security Screening: Validity and Deception Detection Potential
%J Homeland Security Affairs
%D 2012
%8 March
%F ref4
Embodied Conversational Agent-Based Kiosk for Automated Interviewing
J. Nunamaker, D. Derrick, A. C. Elkins, J. Burgoon, M. Patton. Journal of Management Information Systems. 28(1): pp. 17 - 48, 2011.
pages = {17--48},
journal = {Journal of Management Information Systems},
number = {1},
title = {Embodied Conversational Agent-Based Kiosk for Automated Interviewing},
volume = {28},
year = {2011},
}
%T Embodied Conversational Agent-Based Kiosk for Automated Interviewing
%J Journal of Management Information Systems
%D 2011
%V 28
%N 1
%F ref2
%P 17-48
Social Intelligence and Cultural Awareness
J. Burgoon, D. Derrick, A. C. Elkins. IEEE Intelligent Systems. 26(4): pp. 84 - 87, July/August 2011.
author = {J. Burgoon and D. Derrick and A. Elkins},
pages = {84--87},
journal = {IEEE Intelligent Systems},
month = {July/August},
number = {4},
title = {Social Intelligence and Cultural Awareness},
volume = {26},
year = {2011},
}
%T Social Intelligence and Cultural Awareness
%A Burgoon, J.
%A Derrick, D.
%A Elkins, A.
%J IEEE Intelligent Systems
%D 2011
%8 July/August
%V 26
%N 4
%F ref1
%P 84-87
Border Security Credibility Assessments via Heterogeneous Sensor Fusion
D. Derrick, A. C. Elkins, J. Burgoon, J. Nunamaker, D. Zeng. IEEE Intelligent Systems. 25: pp. 41 - 49, May/June 2010.
pages = {41--49},
journal = {IEEE Intelligent Systems},
month = {May/June},
title = {Border Security Credibility Assessments via Heterogeneous Sensor Fusion},
volume = {25},
year = {2010},
}
%T Border Security Credibility Assessments via Heterogeneous Sensor Fusion
%J IEEE Intelligent Systems
%D 2010
%8 May/June
%V 25
%F ref3
%P 41-49
Conference articles
Are Human Judges as Accurate as Automated Tools in Detecting Truth and Deceit?
J. Burgoon, A. C. Elkins, J. Nunamaker, D. Metaxas. International Communication Association 2013 Conference. London, UK, June 2013.
author = {J. Burgoon and A. C. Elkins and J. Nunamaker and D. Metaxas},
address = {London, UK},
booktitle = {International Communication Association 2013 Conference},
month = {June},
title = {Are Human Judges as Accurate as Automated Tools in Detecting Truth and Deceit?},
year = {2013},
}
%T Are Human Judges as Accurate as Automated Tools in Detecting Truth and Deceit?
%A Burgoon, J.
%A Elkins, A. C.
%A Nunamaker, J.
%A Metaxas, D.
%B International Communication Association 2013 Conference
%D 2013
%8 June
%C London, UK
%F ICA2013HumanJudges
The face of an imposter: Computer Vision for Deception Detection
A. C. Elkins, Y. Sun, S. Zafeiriou, M. Pantic. Forty-Sixth Annual Hawaii International Conference on System Sciences. Maui, Hawaii, 2013.
author = {A. C. Elkins and Y. Sun and S. Zafeiriou and M. Pantic},
address = {Maui, Hawaii},
booktitle = {Forty-Sixth Annual Hawaii International Conference on System Sciences},
title = {The face of an imposter: Computer Vision for Deception Detection},
year = {2013},
}
%T The face of an imposter: Computer Vision for Deception Detection
%A Elkins, A. C.
%A Sun, Y.
%A Zafeiriou, S.
%A Pantic, M.
%B Forty-Sixth Annual Hawaii International Conference on System Sciences
%D 2013
%C Maui, Hawaii
%F elkins2013face
Alternative Cues in Concealed Information Testing
N. Twyman, J. Burgoon, A. C. Elkins, J. Proudfoot. Forty-Sixth Annual Hawaii International Conference on System Sciences. Maui, Hawaii, 2013.
author = {N. Twyman and J. Burgoon and A. C. Elkins and J. Proudfoot},
address = {Maui, Hawaii},
booktitle = {Forty-Sixth Annual Hawaii International Conference on System Sciences},
title = {Alternative Cues in Concealed Information Testing},
year = {2013},
}
%T Alternative Cues in Concealed Information Testing
%A Twyman, N.
%A Burgoon, J.
%A Elkins, A. C.
%A Proudfoot, J.
%B Forty-Sixth Annual Hawaii International Conference on System Sciences
%D 2013
%C Maui, Hawaii
%F twyman2013alternative
The Voice and Eye Gaze Behavior of an Imposter: Automated Interviewing and Detection for Rapid Screening at the Border
A. C. Elkins, D. Derrick, M. Gariup. Conference of the European Chapter of the Association for Computational Linguistics. Avignon, France, 2012.
address = {Avignon, France},
booktitle = {Conference of the European Chapter of the Association for Computational Linguistics},
title = {The Voice and Eye Gaze Behavior of an Imposter: Automated Interviewing and Detection for Rapid Screening at the Border},
year = {2012},
}
%T The Voice and Eye Gaze Behavior of an Imposter: Automated Interviewing and Detection for Rapid Screening at the Border
%B Conference of the European Chapter of the Association for Computational Linguistics
%D 2012
%C Avignon, France
%F ref18
Are Deception Detection Experts Threatened by Artificial Intelligence Based Credibility Assessment Systems? Improving Assisted Detection Accuracy and Objectivity
A. C. Elkins, N. Dunbar. Forty-Fifth Annual Hawaii International Conference on System Sciences. Maui, Hawaii, 2012.
address = {Maui, Hawaii},
booktitle = {Forty-Fifth Annual Hawaii International Conference on System Sciences},
title = {Are Deception Detection Experts Threatened by Artificial Intelligence Based Credibility Assessment Systems? Improving Assisted Detection Accuracy and Objectivity},
year = {2012},
}
%T Are Deception Detection Experts Threatened by Artificial Intelligence Based Credibility Assessment Systems?: Improving Assisted Detection Accuracy and Objectivity
%B Forty-Fifth Annual Hawaii International Conference on System Sciences
%D 2012
%C Maui, Hawaii
%F ref17
Predicting Users’ Perceived Trust in Embodied Conversational Agents Using Vocal Dynamics
A. C. Elkins, D. Derrick, J. Burgoon, J. Nunamaker. Forty-Fifth Annual Hawaii International Conference on System Sciences. Maui, Hawaii, 2012.
author = {A. Elkins and D. Derrick and J. Burgoon and J. Nunamaker},
address = {Maui, Hawaii},
booktitle = {Forty-Fifth Annual Hawaii International Conference on System Sciences},
title = {Predicting Users’ Perceived Trust in Embodied Conversational Agents Using Vocal Dynamics},
year = {2012},
}
%T Predicting Users’ Perceived Trust in Embodied Conversational Agents Using Vocal Dynamics
%A Elkins, A.
%A Derrick, D.
%A Burgoon, J.
%A Nunamaker, J.
%B Forty-Fifth Annual Hawaii International Conference on System Sciences
%D 2012
%C Maui, Hawaii
%F ref14
A Rigidity Detection System for the Guilty Knowledge Test
N. Twyman, A. C. Elkins, J. Burgoon. Forty-Fourth Annual Hawaii International Conference on System Sciences. Koloa, Kauai, Hawaii, 2011.
address = {Koloa, Kauai, Hawaii},
booktitle = {Forty-Fourth Annual Hawaii International Conference on System Sciences},
title = {A Rigidity Detection System for the Guilty Knowledge Test},
year = {2011},
}
%T A Rigidity Detection System for the Guilty Knowledge Test
%B Forty-Fourth Annual Hawaii International Conference on System Sciences
%D 2011
%C Koloa, Kauai, Hawaii
%F ref11
The Effect of Cognitive Dissonance on Argument Language and Vocalics
A. C. Elkins, J. Stone. Forty-Fourth Annual Hawaii International Conference on System Sciences. Koloa, Kauai, Hawaii, 2011.
address = {Koloa, Kauai, Hawaii},
booktitle = {Forty-Fourth Annual Hawaii International Conference on System Sciences},
title = {The Effect of Cognitive Dissonance on Argument Language and Vocalics},
year = {2011},
}
%T The Effect of Cognitive Dissonance on Argument Language and Vocalics
%B Forty-Fourth Annual Hawaii International Conference on System Sciences
%D 2011
%C Koloa, Kauai, Hawaii
%F ref10
Improving the Screening Process to Facilitate Trade at U.S. – Mexico Ports of Entry
E. Golob, A. C. Elkins, G. Agraz. Second Puentes Symposium on Border Security: Economic Development and the US-Mexico Border. Houston, Texas, 2011.
author = {E. Golob and A. Elkins and G. Agraz},
address = {Houston, Texas},
booktitle = {Second Puentes Symposium on Border Security: Economic Development and the US-Mexico Border},
title = {Improving the Screening Process to Facilitate Trade at U.S. – Mexico Ports of Entry},
year = {2011},
}
%T Improving the Screening Process to Facilitate Trade at U.S. – Mexico Ports of Entry
%A Golob, E.
%A Elkins, A.
%A Agraz, G.
%B Second Puentes Symposium on Border Security: Economic Development and the US-Mexico Border
%D 2011
%C Houston, Texas
%F ref9
Validating Vocal Analysis Software to Assess Credibility in Interpersonal Interaction: A Multilevel Factor Analytic Approach
A. C. Elkins, J. Burgoon. National Communication Association 96th Annual Convention. San Francisco, California, 2010.
address = {San Francisco, California},
booktitle = {National Communication Association 96th Annual Convention},
title = {Validating Vocal Analysis Software to Assess Credibility in Interpersonal Interaction: A Multilevel Factor Analytic Approach},
year = {2010},
}
%T Validating Vocal Analysis Software to Assess Credibility in Interpersonal Interaction: A Multilevel Factor Analytic Approach
%B National Communication Association 96th Annual Convention
%D 2010
%C San Francisco, California
%F ref12
Rapid Noncontact Credibility Assessment via Linguistic/Vocalic Analyses
S. Humpherys, K. Moffitt, A. C. Elkins, J. Burgoon, J. Nunamaker. National Communication Association 96th Annual Convention. San Francisco, California, 2010.
author = {S. Humpherys and K. Moffitt and A. Elkins and J. Burgoon and J. Nunamaker},
address = {San Francisco, California},
booktitle = {National Communication Association 96th Annual Convention},
title = {Rapid Noncontact Credibility Assessment via Linguistic/Vocalic Analyses},
year = {2010},
}
%T Rapid Noncontact Credibility Assessment via Linguistic/Vocalic Analyses
%A Humpherys, S.
%A Moffitt, K.
%A Elkins, A.
%A Burgoon, J.
%A Nunamaker, J.
%B National Communication Association 96th Annual Convention
%D 2010
%C San Francisco, California
%F ref13
Improving the Primary Screening Process at North American Ports of Entry
E. Golob, A. C. Elkins. Forty-Third Annual Hawaii International Conference on System Sciences. Koloa, Kauai, Hawaii, 2010.
address = {Koloa, Kauai, Hawaii},
booktitle = {Forty-Third Annual Hawaii International Conference on System Sciences},
title = {Improving the Primary Screening Process at North American Ports of Entry},
year = {2010},
}
%T Improving the Primary Screening Process at North American Ports of Entry
%B Forty-Third Annual Hawaii International Conference on System Sciences
%D 2010
%C Koloa, Kauai, Hawaii
%F ref16
Potential Noncontact Tools for Rapid Credibility Assessment from Physiological and Behavioral Cues
J. Nunamaker, C. Diller, J. Burgoon, A. C. Elkins, S. Humpherys, M. Jensen. International Carnahan Conference on Security Technology. Prague, Czech Republic, 2008.
address = {Prague, Czech Republic},
booktitle = {International Carnahan Conference on Security Technology},
title = {Potential Noncontact Tools for Rapid Credibility Assessment from Physiological and Behavioral Cues},
year = {2008},
}
%T Potential Noncontact Tools for Rapid Credibility Assessment from Physiological and Behavioral Cues
%B International Carnahan Conference on Security Technology
%D 2008
%C Prague, Czech Republic
%F ref15
Theses
Vocalic Markers of Deception and Cognitive Dissonance for Automated Emotion Detection Systems
A. C. Elkins. PhD Thesis, 2011.
institution = {University of Arizona},
title = {Vocalic Markers of Deception and Cognitive Dissonance for Automated Emotion Detection Systems},
year = {2011},
}
%T Vocalic Markers of Deception and Cognitive Dissonance for Automated Emotion Detection Systems
%D 2011
%F ref8
%9 Ph.D. thesis
Other publications
Vocal Stress Analysis
A. C. Elkins. Encyclopedia of Lying and Deception. in press 2013.
author = {A. C. Elkins},
booktitle = {Encyclopedia of Lying and Deception},
month = {in press},
title = {Vocal Stress Analysis},
year = {2013},
}
%T Vocal Stress Analysis
%A Elkins, A. C.
%B Encyclopedia of Lying and Deception
%D 2013
%8 in press
%F elkins2013vocal
Embodied Conversational Agent-Based Kiosk for Automated Interviewing
A. C. Elkins. Provisional Patent. United States, 2011.
author = {A. Elkins},
address = {United States},
booktitle = {Provisional Patent},
title = {Embodied Conversational Agent-Based Kiosk for Automated Interviewing},
year = {2011},
}
%T Embodied Conversational Agent-Based Kiosk for Automated Interviewing
%A Elkins, A.
%B Provisional Patent
%D 2011
%C United States
%F ref22