Selected Publications

Monitoring Critical Infrastructure Facilities During Disasters Using Large Language Models

Abdul Wahab Ziaullah, Ferda Ofli, Muhammad Imran

International Conference on Information Systems for Crisis Response and Management (ISCRAM). Münster, Germany. May 2024.

[PDF]

[Bibtex]

Flood Insights: Integrating Remote and Social Sensing Data for Flood Exposure, Damage, and Urgent Needs Mapping

Zainab Akhtar, Umair Qazi, Aya El-Sakka, Rizwan Sadiq, Ferda Ofli, Muhammad Imran

AAAI Conference on Artificial Intelligence (AAAI). Vancouver, CA. Feb 2024.

[PDF]

[Bibtex]

[System]

[Deployed Application Award]

Landslide Detection in Real-Time Social Media Image Streams

Ferda Ofli, Muhammad Imran, Umair Qazi, Julien Roch, Catherine Pennington, Vanessa Banks, Remy Bossu

Neural Computing and Applications (NCAA). 2023.

[PDF]

[Bibtex]

[arXiv]

Mapping Flood Exposure, Damage, and Population Needs Using Remote and Social Sensing: A Case Study of 2022 Pakistan Floods

Zainab Akhtar, Umair Qazi, Rizwan Sadiq, Aya El-Sakka, Muhammad Sajjad, Ferda Ofli, Muhammad Imran

International World Wide Web Conference (WWW). Austin, TX, USA. May 2023.

[PDF]

[Bibtex]

[Video]

Towards Fine-grained Object-level Damage Assessment during Disasters

Rizwan Sadiq, Zainab Akhtar, Steve Peterson, Katelyn Keegan, Aya El-Sakka, Muhammad Imran, Ferda Ofli

Frontiers in Earth Science, 11:990930, 2023.

[PDF]

[Bibtex]

Incidents1M: A Large-Scale Dataset of Images with Natural Disasters, Damage, and Incidents

Ethan Weber, Dim P. Papadopoulos, Agata Lapedriza, Ferda Ofli, Muhammad Imran, Antonio Torralba

IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 45(4):4768--4781, 2023.

MEDIC: A Multi-task Learning Dataset for Disaster Image Classification

Firoj Alam, Tanvirul Alam, Md. Arid Hasan, Abul Hasnat, Muhammad Imran, Ferda Ofli

Neural Computing and Applications (NCAA), 35(3):2609--2632, 2023.

A Survey on Computer Vision based Human Analysis in the COVID-19 Era

Fevziye Irem Eyiokur, Alperen Kantarcı, Mustafa Ekrem Erakın, Naser Damer, Ferda Ofli, Muhammad Imran, Janez Križaj, Albert Ali Salah, Alexander Waibel, Vitomir Štruc, Hazım Kemal Ekenel

Image and Vision Computing (IMAVIS), 130:104610, 2023.

[PDF]

[Bibtex]

[arXiv]

Fine-grained Population Mapping from Coarse Census Counts and Open Geodata

Nando Metzger, John E. Vargas-Muñoz, Rodrigo C. Daudt, Benjamin Kellenberger, Thao Ton-That Whelan, Ferda Ofli, Muhammad Imran, Konrad Schindler, Devis Tuia

Nature Scientific Reports, 12:20085, 2022.

Robust Training of Social Media Image Classification Models

Firoj Alam, Tanvirul Alam, Ferda Ofli, Muhammad Imran

IEEE Transactions on Computational Social Systems (TCSS). 2022.

[PDF]

[Bibtex]

[arXiv]

A Near-Real-Time Global Landslide Incident Reporting Tool Demonstrator using Social Media and Artificial Intelligence

Catherine Pennington, Remy Bossu, Ferda Ofli, Muhammad Imran, Umair Qazi, Julien Roch, Vanessa Banks

International Journal of Disaster Risk Reduction (IJDRR), 77(1):103089, 2022.

[PDF]

[Bibtex]

Integrating Remote Sensing and Social Sensing for Flood Mapping

Rizwan Sadiq, Zainab Akhtar, Muhammad Imran, Ferda Ofli

Remote Sensing Applications: Society and Environment (RSASE), 25(1):100697, 2022.

[PDF]

[Bibtex]

A Real-time System for Detecting Landslide Reports on Social Media using Artificial Intelligence

Ferda Ofli, Umair Qazi, Muhammad Imran, Julien Roch, Catherine Pennington, Vanessa Banks, Remy Bossu

International Conference on Web Engineering (ICWE). Bari, Italy. July 2022.

Learning Program Representations for Food Images and Cooking Recipes

Dim P. Papadopoulos, Enrique Mora, Nadiia Chepurko, Kuan Wei Huang, Ferda Ofli, Antonio Torralba

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, LA, USA. June 2022.

[PDF]

[Bibtex]

[arXiv]

AI for Disaster Rapid Damage Assessment from Microblogs

Muhammad Imran, Umair Qazi, Ferda Ofli, Steve Peterson, Firoj Alam

AAAI Conference on Artificial Intelligence (AAAI). Online. Feb 2022.

[PDF]

[Bibtex]

Fight Detection from Still Images in the Wild

Şeymanur Aktı, Ferda Ofli, Muhammad Imran, Hazım Kemal Ekenel

IEEE/CVF Winter Conference on Applications of Computer Vision Workshops. Los Alamitos, CA, USA. Jan 2022.

Bias-Aware Face Mask Detection Dataset

Alperen Kantarcı, Ferda Ofli, Muhammad Imran, Hazım Kemal Ekenel

arXiv preprint arXiv:2211.01207 2022.

Food Insufficiency and Twitter Emotions during a Pandemic

Stephan J. Goetz, Connor Heaton, Muhammad Imran, Yuxuan Pan, Zheng Tian, Claudia Schmidt, Umair Qazi,

Ferda Ofli, Prasenjit Mitra

Applied Economic Perspectives and Policy (AEPP), 2022.

[PDF]

[Bibtex]

TBCOV: Two Billion Multilingual COVID-19 Tweets with Sentiment, Entity, Geo, and Gender Labels

Muhammad Imran, Umair Qazi, Ferda Ofli

Data, 7(1):8, 2022.

Non-traditional data sources: providing insights into sustainable development

Ingmar Weber, Muhammad Imran, Ferda Ofli, Fouad Mrad, Jennifer Colville, Mehdi Fathallah, Alissar Chaker, Wigdan Seed Ahmed

Communications of the ACM (CACM). 2021.

[PDF]

[Bibtex]

Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images

Javier Marin, Aritro Biswas, Ferda Ofli, Nicholas Hynes, Amaia Salvador, Yusuf Aytar, Ingmar Weber,

Antonio Torralba

IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 43(1):187-203, 2021.

Mapping Vulnerable Populations with AI

Benjamin Kellenberger, John E. Vargas-Muñoz, Devis Tuia, Rodrigo C. Daudt, Konrad Schindler, Thao T-T Whelan, Brenda Ayo, Ferda Ofli, Muhammad Imran

KDD Workshop on Data-Driven Humanitarian Mapping. Online. August 2021.

[PDF]

[Bibtex]

[arXiv]

HumAID: Human-Annotated Disaster Incidents Data from Twitter with Deep Learning Benchmarks

Firoj Alam, Umair Qazi, Muhammad Imran, Ferda Ofli

International AAAI Conference on Web and Social Media (ICWSM). Online. June 2021.

CrisisBench: Benchmarking Crisis-related Social Media Datasets for Humanitarian Information Processing

Firoj Alam, Hassan Sajjad, Muhammad Imran, Ferda Ofli

International AAAI Conference on Web and Social Media (ICWSM). Online. June 2021.

Towards Using Remote Sensing and Social Media Data for Flood Mapping

Zainab Akhtar, Ferda Ofli, Muhammad Imran

International Conference on Information Systems for Crisis Response and Management (ISCRAM). Online. May 2021.

[PDF]

[Bibtex]

GeoCoV19: A Dataset of Hundreds of Millions of Multilingual COVID-19 Tweets with Location Information

Umair Qazi, Muhammad Imran, Ferda Ofli

ACM SIGSPATIAL Special, 12(1):6--15, 2020.

Using AI and Social Media Multimodal Content for Disaster Response and Management: Opportunities, Challenges, and Future Directions

Muhammad Imran, Ferda Ofli, Doina Caragea, Antonio Torralba

Information Processing and Management (IPM), 57(5):102261, 2020.

[PDF]

[Bibtex]

Detection of Disaster-Affected Cultural Heritage Sites from Social Media Images Using Deep Learning Techniques

Pakhee Kumar, Ferda Ofli, Muhammad Imran, Carlos Castillo

ACM Journal on Computing and Cultural Heritage (JOCCH), 13(3):23.1-23.31, 2020.

Descriptive and Visual Summaries of Disaster Events using Artificial Intelligence Techniques: Case Studies of Hurricanes Harvey, Irma, and Maria

Firoj Alam, Ferda Ofli, Muhammad Imran

Behavior & Information Technology (BIT), 39(3):288-318, 2020.

[PDF]

[Bibtex]

Deep Learning Benchmarks and Datasets for Social Media Image Classification for Disaster Response

Firoj Alam, Ferda Ofli, Muhammad Imran, Tanvirul Alam, Umair Qazi

International Conference on Advances in Social Networks Analysis and Mining (ASONAM). Online. December 2020.

[PDF]

[Bibtex]

[arXiv]

Detecting Natural Disasters, Damage, and Incidents in the Wild

Ethan Weber, Nuria Marzo, Dim P. Papadopoulos, Aritro Biswas, Agata Lapedriza, Ferda Ofli, Muhammad Imran, Antonio Torralba

European Conference on Computer Vision (ECCV). Online. August 2020.

The Relative Value of Facebook Advertising Data for Poverty Mapping

Masoomali Fatehkia, Benjamin Coles, Ferda Ofli, Ingmar Weber

International AAAI Conference on Web and Social Media (ICWSM). Online. June 2020.

[PDF]

[Bibtex]

Analysis of Social Media Data using Multimodal Deep Learning for Disaster Response

Ferda Ofli, Firoj Alam, Muhammad Imran

International Conference on Information Systems for Crisis Response and Management (ISCRAM). Blacksburg, VA, USA. May 2020.

[PDF]

[Bibtex]

[arXiv]

Rapid Damage Assessment Using Social Media Images by Combining Human and Machine Intelligence

Muhammad Imran, Firoj Alam, Umair Qazi, Steve Peterson, Ferda Ofli

International Conference on Information Systems for Crisis Response and Management (ISCRAM). Blacksburg, VA, USA. May 2020.

[PDF]

[Bibtex]

[arXiv]

[Best Paper Award]

How to Make a Pizza: Learning a Compositional Layer-based GAN Model

Dim P. Papadopoulos, Youssef Tamaazousti, Ferda Ofli, Ingmar Weber, Antonio Torralba

IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Long Beach, CA, USA. June 2019.

Identifying Disaster Damage Images Using a Domain Adaptation Approach

Xukun Li, Doina Caragea, Cornelia Caragea, Muhammad Imran, Ferda Ofli

International Conference on Information Systems for Crisis Response and Management (ISCRAM). Valencia, Spain. May 2019.

[PDF]

[Bibtex]

[Best Insight Paper Award]

CrisisDPS: Crisis Data Processing Services

Firoj Alam, Muhammad Imran, Ferda Ofli

International Conference on Information Systems for Crisis Response and Management (ISCRAM). Valencia, Spain. May 2019.

[PDF]

[Bibtex]

[Website]

[Best Paper Award Runner-up]

Recurrent Neural Networks for Remote Sensing Image Classification

Mohamed Ilyes Lakhal, Hakan Çevikalp, Sergio Escalera, Ferda Ofli

IET Computer Vision, 12(7):1040--1045, 2018.

[PDF]

[Bibtex]

Processing Social Media Images by Combining Human and Machine Computing during Crises

Firoj Alam, Ferda Ofli, Muhammad Imran

International Journal of Human-Computer Interaction (IJHCI), 34(4):311-327, 2018.

[PDF]

[Bibtex]

Using Computer Vision to Study the Effects of BMI on Online Popularity and Weight-Based Homophily

Enes Kocabey, Ferda Ofli, Javier Marin, Antonio Torralba, Ingmar Weber

International Conference on Social Informatics (SocInfo). Saint Petersburg, Russia. September 2018.

[PDF]

[Bibtex]

CrisisMMD: Multimodal Twitter Datasets from Natural Disasters

Firoj Alam, Ferda Ofli, Muhammad Imran

International AAAI Conference on Web and Social Media (ICWSM). Stanford, CA, USA. June 2018.

A Twitter Tale of Three Hurricanes: Harvey, Irma, and Maria

Firoj Alam, Ferda Ofli, Muhammad Imran, Michael Aupetit

International Conference on Information Systems for Crisis Response and Management (ISCRAM). Rochester, NY, USA. May 2018.

[PDF]

[Bibtex]

[arXiv]

Nazr-CNN: Fine-Grained Classification of UAV Imagery for Damage Assessment

Nazia Attari, Ferda Ofli, Muhammad Awad, Ji Lucas, Sanjay Chawla

IEEE International Conference on Data Science and Advanced Analytics (DSAA). Tokyo, Japan. October 2017.

[PDF]

[Bibtex]

[arXiv]

Damage Assessment from Social Media Imagery Data During Disasters

Dat T. Nguyen, Ferda Ofli, Muhammad Imran, Prasenjit Mitra

International Conference on Advances in Social Networks Analysis and Mining (ASONAM). Sydney, NSW, Australia. August 2017.

Image4Act: Online Social Media Image Processing for Disaster Response

Firoj Alam, Muhammad Imran, Ferda Ofli

International Conference on Advances in Social Networks Analysis and Mining (ASONAM). Sydney, NSW, Australia. August 2017.

[PDF]

[Bibtex]

[System]

Learning Cross-modal Embeddings for Cooking Recipes and Food Images

Amaia Salvador, Nicholas Hynes, Yusuf Aytar, Javier Marin, Ferda Ofli, Ingmar Weber, Antonio Torralba

IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI, USA. July 2017.

[PDF]

[Bibtex]

[Website]

Automatic Image Filtering on Social Networks Using Deep Learning and Perceptual Hashing During Crises

Dat T. Nguyen, Firoj Alam, Ferda Ofli, Muhammad Imran

International Conference on Information Systems for Crisis Response and Management (ISCRAM). Albi, France. May 2017.

[PDF]

[Bibtex]

[Slides]

[Best Paper Award Runner-up]

[arXiv]

Face-to-BMI: Using Computer Vision to Infer Body Mass Index on Social Media

Enes Kocabey, Mustafa Camurcu, Ferda Ofli, Yusuf Aytar, Javier Marin, Antonio Torralba, Ingmar Weber

International AAAI Conference on Web and Social Media (ICWSM). Montreal, Canada. May 2017.

[PDF]

[Bibtex]

[arXiv]

Is Saki #delicious? The Food Perception Gap on Instagram and Its Relation to Health

Ferda Ofli, Yusuf Aytar, Ingmar Weber, Raggi al Hammouri, Antonio Torralba

International World Wide Web Conference (WWW). Perth, WA, Australia. April 2017.

Implementing 360-degree Quantified Self for Childhood Obesity: Feasibility Study and Experiences from a Weight Loss Camp in Qatar

Luis Fernandez-Luque, Meghna Singh, Ferda Ofli, Yelena Mejova, Ingmar Weber, Michael Aupetit, Sahar K. Jreige, Ahmed Elmagarmid, Jaideep Srivastava, Mohamed Ahmedna

BMC Medical Informatics and Decision Making (BMC), 17(1):1-37, 2017.

[PDF]

[Bibtex]

Sleep Quality Prediction from Wearable Data Using Deep Learning

Aarti Sathyanarayana, Shafiq Joty, Luis Fernandez-Luque, Ferda Ofli, Jaideep Srivastava, Ahmed Elmagarmid, Teresa Arora, Shahrad Taheri

Journal of Medical Internet Research: mHealth and uHealth (JMIR), 4(4):e125, 2016.

[PDF]

[Bibtex]

Robust Automated Human Activity Recognition and its Application to Sleep Research

Aarti Sathyanarayana, Ferda Ofli, Luis Fernandez-Luque, Jaideep Srivastava, Ahmed Elmagarmid, Teresa Arora, Shahrad Taheri

IEEE International Conference on Data Mining Workshops (ICDMW). Bercelona, Spain. December 2016.

[PDF]

[Bibtex]

[arXiv]

Combining Human Computing and Machine Learning to Make Sense of Big (Aerial) Data for Disaster Response

Ferda Ofli, Patrick Meier, Muhammad Imran, Carlos Castillo, Devis Tuia, Nicolas Rey, Julien Briant, Pauline Millet, Friedrich Reinhard, Matthew Parkan, Stephane Joost

Big Data Journal (Big Data), 4(1):47--59, 2016.

[PDF]

[Bibtex]

Design and Evaluation of an Interactive Exercise Coaching System for Older Adults: Lessons Learned

Ferda Ofli, Gregorij Kurillo, Stepan Obdrzalek, Ruzena Bajcsy, Holly Jimison, and Misha Pavel

IEEE Journal of Biomedical and Health Informatics (JBHI), 20(1):201--212, 2016.

[PDF]

[Bibtex]

360-degree Quantified Self

Hamed Haddadi, Ferda Ofli, Yelena Mejova, Ingmar Weber, and Jaideep Srivastava

IEEE International Conference on Healthcare Informatics (ICHI). Dallas, TX, USA. October 2015.

[PDF]

[Bibtex]

[arXiv]

Evaluation of Pose Tracking Accuracy in the First and Second Generations of Microsoft Kinect

Qifei Wang, Gregorij Kurillo, Ferda Ofli, and Ruzena Bajcsy

IEEE International Conference on Healthcare Informatics (ICHI). Dallas, TX, USA. October 2015.

[PDF]

[Bibtex]

[arXiv]

Unsupervised Temporal Segmentation of Repetitive Human Actions Based on Kinematic Modeling and Frequency Analysis

Qifei Wang, Gregorij Kurillo, Ferda Ofli, and Ruzena Bajcsy

International Conference on 3D Vision (3DV). Lyon, France. October 2015.

[PDF]

[Bibtex]

[arXiv]

Multi-disciplinary Design and In-Home Evaluation of Kinect-Based Exercise Coaching System for Elderly

Gregorij Kurillo, Ferda Ofli, Jennifer Marcoe, Paul Gorman, Holly Jimison, Misha Pavel, and Ruzena Bajcsy

Human Aspects of IT for the Aged Population. Design for Everyday Life in Proceedings of HCI International Conference. Los Angeles, CA, USA. August 2015.

[PDF]

[Bibtex]

Sequence of the Most Informative Joints (SMIJ): A New Representation for Human Skeletal Action Recognition

Ferda Ofli, Rizwan Chaudhry, Gregorij Kurillo, Rene Vidal, and Ruzena Bajcsy

Journal of Visual Communication and Image Representation (JVCI), 25(1):24--38, 2014.

[PDF]

[Bibtex]

[Best Paper Award 2015]

Bio-inspired Dynamic 3D Discriminative Skeletal Features for Human Action Recognition

Rizwan Chaudhry, Ferda Ofli, Gregorij Kurillo, Ruzena Bajcsy and Rene Vidal

International Workshop on Human Activity Recognition from 3D Data (HAU3D) in conjunction with the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Portland, OR, USA. June 2013.

[PDF]

[Bibtex]

Berkeley MHAD: A Comprehensive Multimodal Human Action Database

Ferda Ofli, Rizwan Chaudhry, Gregorij Kurillo, Rene Vidal, and Ruzena Bajcsy

IEEE Winter Conference on Applications of Computer Vision (WACV). Clearwater Beach, FL, USA. January 2013.

[PDF]

[Bibtex]

[Website]

Accuracy and Robustness of Kinect Pose Estimation in the Context of Coaching of Elderly Population

Stepan Obdrzalek, Gregorij Kurillo, Ferda Ofli, Ruzena Bajcsy, Edmund Seto, Holly Jimison, and Misha Pavel

International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). San Diego, CA, USA. August 2012.

[PDF]

[Bibtex]

[Website]

Sequence of the Most Informative Joints (SMIJ): A New Representation for Human Skeletal Action Recognition

Ferda Ofli, Rizwan Chaudhry, Gregorij Kurillo, Rene Vidal, and Ruzena Bajcsy

International Workshop on Human Activity Recognition from 3D Data (HAU3D) in conjunction with the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Providence, RI, USA. June 2012.

[PDF]

[Bibtex]

Learn2Dance: Learning Statistical Music-to-Dance Mappings for Choreography Synthesis

Ferda Ofli, Engin Erzin, Yücel Yemez, and A. Murat Tekalp

IEEE Transactions on Multimedia (TMM), 14(3):747--759, 2012.

[PDF]

[Bibtex]

[Demo]

Multi-modal Analysis of Dance Performances for Music-Driven Choreography Synthesis

Ferda Ofli, Engin Erzin, Yücel Yemez, and A. Murat Tekalp

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). Dallas, TX, USA. March 2010.

[PDF]

[Bibtex]

[Demo]

An Audio-Driven Dancing Avatar

Ferda Ofli, Cristian Canton-Ferrer, Yasemin Demir, Koray Balcı, Joëlle Tilmanne, Elif Bozkurt, İdil Kızoğlu, Yücel Yemez, Engin Erzin, A. Murat Tekalp, Lale Akarun, A. Tanju Erdem

Journal on Multimodal User Interfaces (JMUI), 2(2):93--103, 2008.

[PDF]

[Bibtex]

[Demo]

Unsupervised Dance Figure Analysis from Video for Dancing Avatar Animation

Ferda Ofli, Engin Erzin, Yücel Yemez, A. Murat Tekalp, Çiğdem E. Erdem, A. Tanju Erdem, Tolga Abacı, Mehmet K. Özkan

IEEE International Conference on Image Processing (ICIP). San Diego, CA, USA. October 2008.

[PDF]

[Bibtex]

[Demo]

Audio-Driven Human Body Motion Analysis and Synthesis

Ferda Ofli, Cristian Canton-Ferrer, Joëlle Tilmanne, Yasemin Demir, Elif Bozkurt, Yücel Yemez, Engin Erzin, A. Murat Tekalp

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). Las Vegas, NV, USA. April 2008.

[PDF]

[Bibtex]

[Demo]

Multicamera Audio-Visual Analysis of Dance Figures Using Segmented Body Model

Ferda Ofli, Yasemin Demir, Engin Erzin, Yücel Yemez, A. Murat Tekalp

15th European Signal Processing Conference (EUSIPCO). Poznan, Poland. September 2007.

[PDF]

[Bibtex]

Estimation and Analysis of Facial Animation Parameter Patterns

Ferda Ofli, Engin Erzin, Yücel Yemez, A. Murat Tekalp

IEEE International Conference on Image Processing (ICIP). San Antonio, TX, USA. September 2007.

[PDF]

[Bibtex]

Multicamera Audio-Visual Analysis of Dance Figures

Ferda Ofli, Yasemin Demir, Engin Erzin, Yücel Yemez, A. Murat Tekalp

IEEE International Conference on Multimedia and Expo (ICME). Beijing, China. July 2007.

[PDF]

[Bibtex]

Combined Gesture-Speech Analysis and Speech Driven Gesture Synthesis

M. Emre Sargın, Oya Aran, Alexey Karpov, Ferda Ofli, Yelena Yasinnik, Stephen Wilson, Engin Erzin, Yücel Yemez, A. Murat Tekalp

IEEE International Conference on Multimedia and Expo (ICME). Toronto, Ontario, Canada. July 2006.

[PDF]

[Bibtex]