An Insight of Smartphone-Based Lifelogging Research: Issues, Challenges, and Research Opportunities
Insight of Smartphone-Based Lifelogging Research
Keywords:
Smartphone, Lifelogging, Sensors, Privacy & Security, Semantic Organization, Memory AugmentationAbstract
The technological advancements have turned smartphone into a de-facto lifelogging device and fostered smartphone-based lifelogging (SBL) research as a mainstream activity. A SBL system can capture and store information about peoples' daily life activities, behaviours, interactions, contexts, etc., into a comprehensive personal lifelogs. The smartphone-based personal lifelogs can be of interest to the different stakeholders including users, information sciences researchers, and policies/decisions makers in governments and organizations because of the availability of information for solving different real-world problems (e.g., memory augmentation, medicine and health care, business and commerce, government policy making, society development, etc.), which would otherwise be impossible. Despite of potential advantages, SBL research is in its early stages and has several issues and challenges, which impedes its large-scale adaptation. Therefore, more research efforts are needed in the SBL domain. This paper is aimed to provide an insight review of SBL research and highlight several issues, challenges, and research opportunities. Firstly, the smartphone is demonstrated as a de-facto lifelogging device and available SBL research is analysed to highlight research shortcomings and gaps. Secondly, a generalized architecture for SBL systems is presented to unify and accelerate the research and development efforts. Lastly, several issues and challenges are highlighted, which could be turned into potential research opportunities. This paper can be a valuable resource for new researchers to find research topics to contribute and explore the SBL research area.
References
Itzgibbon, A, & E. Reiter, Memories for life: Managing information over a human lifetime. UK Computing Research Committee Grand Challenge proposal, 22: 13-16 (2003).
Dodge, M, & R. Kitchin, Outlines of a world coming into existence: pervasive computing and the ethics of forgetting, Environment and Planning B:Planning and Design 34: 431-445 (2007).
Mohamed, E.S.T. Designing and evaluating a user interface for continues embedded life logging based on physical context. Ph.D Thesis, School of Computing Science, Newcastle University, Newcastle: (2012).
Gurrin, C., A.F. Smeaton, & A.R. Dohetry. LifeLogging: Personal Big Data. Foundations and Trends in Information Retrieval, 8: 1-125 (2014).
Kalnikaite, V., A. Sellen., S. Whittaker. & D.Kirk. Now let me see where i was: understanding how lifelogs mediate memory. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: 2045-2054 (2010).
Sellen, A, & S. Whittaker. Beyond Total Capture: A Constructive Critique of Lifelogging. Communications of the ACM, 53: 70-77 (2010).
Hodges, S., L. Williams., E. Berry., S. Izadi., J.Srinivasan., A. Butler.,G. Smyth., N. Kapur. & K. Wood. SenseCam: a retrospective memory aid.Proceedings of the 8th international conference on Ubiquitous Computing: 177-193(2006).
Siewiorek, D., A. Smailagic., J. Furukawa., A. Krause., N. Moraveji., K. Reiger., J. Shaffer. & F. L. Wong. SenSay: A Context-Aware Mobile Phone. Proceedings of the 7th IEEE International Symposium on Wearable Computers: 248 (2003).
Shah, M., B. Mears., C. Chakrabarti. & A. Spanias. Lifelogging: Archival and retrieval of continuously recorded audio using wearable devices. IEEE International Conference on Emerging Signal Processing Applications (ESPA): 99-102 (2012).
Chennuru, S. K., P. Chen., J. Zhu. & J. Y. Zhang. Mobile Lifelogger - Recording, Indexing, and Understanding a Mobile User's Life. International Conference on Mobile Computing, Applications, and Services: 263-281 (2010).
Belimpasakis, P., K. Roimela. & Y. Yu. Experience Explorer: A Life-Logging Platform Based on Mobile Context Collection. 3rd Int. Conference on Next Generation Mobile Applications, Services and Technologies: 77-82 (2009).
Albatal, R., C. Gurrin., J. Zhou., Y. Yang. & D. Carthy. SenseSeer Mobile-Cloud-Based Lifelogging framework. The IEEE International Symposium on Technology and Society (ISTAS): 27-29 (2013).
Rawassizadeh, R., M. Tomitsch., K. Wac. & A. M. Toja. UbiqLog: a generic mobile phone-based lifelog framework. Personal Ubiquitous Comput.17:621-637 (2013).
Ali, S., S. Khusro., A. A. Khan. & L. Hassan. A Survey of Mobile Phones Context-Awareness Using Sensing Computing Research. Journal of Engineering and Applied Sciences 33: 75-93 (2014).
Ali, S., S. Khusro., A. Rauf. & S. Mahfooz. Sensors and Mobile Phones: Evolution and State-of-the-Art. Pakistan journal of science 66: 386-400 (2014).
Myka, A. Nokia lifeblog -- towards a truly personal multimedia information system. Workshop on Mobile Data Banken and Information Systemes: 21-30 (2005).
Memon, M. A., S, Bhatti. & N. A. Mahoto. A Digital Diary: Remembering the Past Using the Present Context. Mehran University Research Journal of Engineering & Technology 35: 275-286 (2016).
Ali, S. Exploiting Sensor Data Semantics for Smartphone-Based Lifelogging: Towards the Development of Digital Prosthetic Memory on Smartphone. PhD Thesis, Department of Computer Science, University of Peshawar: (2018).
Khan, I., S. Ali. & S. Khusro. Smartphone Based Lifelogging: Investigation of Data Volume Generation Strength of Smartphone Sensors. In Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.
Song H., Jiang D. (eds) Simulation Tools and Techniques, Springer, Berlin, Germany, p. 63-73 (2019).
Wong, K. Y. Cell phones as mobile computing devices. IT professional 12: 40-45 (2010).
Barton, J. J., S. Zhai. & S. B. Cousins. Mobile phones will become the primary personal computing devices. Proc. of 7th IEEE Workshop on Mobile Computing Systems and Applications: 3-9 (2006).
Gemmell, J., G. Bell. & R. Lueder. MyLifeBits: a personal database for everything," Commun. ACM 49: 88-95(2006).
Ali, S. & S. Khusro. Mobile Phone Sensing: A New Application Paradigm," Indian Journal of Science and Technology 9: (1-41) (2016).Gurrin, C., Z. Qiu., M. Hughes., N. Caprani., A. R. Doherty.m S.E. Hodges. & A. F. Smeaton. The Smartphone As a Platform for Wearable Cameras in Health Research. American Journal of Preventive Medicine 44: 308–313 (2013).
Aizenbud-Reshef, N., E. Belinsky., M. Jacovi., D. Laufer. & V. Soroka. Pensieve: augmenting human memory. Extended Abstracts on Human Factors in Computing Systems: 3231-3236 (2008).
Froehlich, J., M. Y. Chen., S. Consolvo., B. Harrison. & J. A. Landay. MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones. Proc. of the 5th international conference on Mobile systems, applications and services: 57-70 (2007).
Packer, H. S., A. Smith. & P. Lewis. Memorybook: Generating Narratives from Lifelogs. Proceedings of the 2nd Workshop on Narrative and Hypertext:7-12 (2012).
Sravanthi, K.and T. S. Reddy. Applications of Big data in Various Fields. International Journal of Computer Science and Information Technologies: 4629-4632 (2015).
Sangkeun, L., G. Gihyun., H. Inbeom. L. Sanggoo. LifeLogOn: A Practical Lifelog System for Building and Exploiting Lifelog Ontology. IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (SUTC):367-373 (2010).
Ahmed, M., H. H. Hoang., M. S. Karim., S. Khusro. M. Lanzenberger., K. Latif., E. Michlmayr. K. Mustofa. H. T. Nguyen. & A. Rauber. SemanticLIFE'-A Framework for Managing Information of A Human Lifetime. Sixth International Conference on Information Integration and Web Based Applications & Services: (2004).
Chen, C. P. & C.-Y. Zhang. Data-intensive applications, challenges, techniques and technologies: A survey on Big Data. Information Sciences 275: 314-347 (2014).
Rawassizadeh, R. A holistic multi-purpose life logging framework. Ph.D Thesis, uniwien, (2012).
Doherty, A. R. & A. F. Smeaton. Automatically segmenting lifelog data into events. Ninth International Workshop on Image Analysis for Multimedia Interactive Services: 20-23 (2008).
Yen, An-Zi., H. Huang. & H. Chen. Personal Knowledge Base Construction from Text-based Lifelogs. Proc. of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval: 185-194 (2019).
Liggins II, M., D. Hall. & J. Llinas. Handbook of multisensor data fusion: theory and practice. CRC press, (2017).
Zafeiropoulos, A., N. Konstantinou., S. Arkoulis., D. E. Spanos. & N. Mitrou. A Semantic-Based Architecture for Sensor Data Fusion. 2nd Int. Conf. on Mobile Ubiquitous Computing, Systems, Services and Technologies: 116-121 (2008).
Jacquemard, T., P. Novitzky., F. O’ Brolchain. A. F. Smeaton. & B. Gordijn. Challenges and Opportunities of Lifelog Technologies: A Literature Review and Critical Analysis. Science and Engineering Ethics 20: 379-409 (2014).
Langheinrich, M. Privacy by design—principles of privacy-aware ubiquitous systems. International conference on Ubiquitous Computing: 273-291 (2001).
Elagroudy,P., M. Khamis., F. Mathis., D. Irmscher., A. Bulling. & A. Schmidt. Can Privacy-Aware Lifelogs Alter Our Memories?. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems: (2019).
Vemuri,S., S. Chris. & B. Walter. iRemember: a Personal, Long-term Memory Prosthesis. 3rd ACM Workshop on Continous Archival and Retrieval of Persoanl Experiences CARPE' 06: 65-74 (2006).
