Hi! I'm Aryo Pradipta Gema.

Ph.D. in Biomedical AI at the University of Edinburgh

About Me

Hi! My name is Aryo Pradipta Gema. I am currently a Ph.D. student in Biomedical AI at the University of Edinburgh under the supervision of Dr. Beatrice Alex, Dr. Pasquale Minervini, and Dr. Luke Daines. My research interests are in the intersection between NLP and the clinical domain. Specifically, I'm interested in retrieval-augmented clinical LLMs and efficient adaptation of LLMs for clinical NLP tasks through parameter-efficient fine-tuning techniques.

Publications

2023

  • Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain.
    Aryo Pradipta Gema, Luke Daines, Pasquale Minervini, Beatrice Alex
  • Knowledge Graph Embeddings in the Biomedical Domain: Are They Useful? A Look at Link Prediction, Rule Learning, and Downstream Polypharmacy Tasks.
    Aryo Pradipta Gema, Dominik Grabarczyk, Wolf De Wulf, Piyush Borole, Javier Antonio Alfaro, Pasquale Minervini, Antonio Vergari, Ajitha Rajan
  • Vaxformer: Antigenicity-controlled Transformer for Vaccine Design Against SARS-CoV-2.
    Aryo Pradipta Gema, Michał Kobiela, Achille Fraisse, Ajitha Rajan, Diego A Oyarzún, Javier Antonio Alfaro

    • 2022

  • BERT and ULMFiT Ensemble for Personality Prediction from Indonesian Social Media Text.
    Noptovius Halimawan, Derwin Suhartono, Aryo Pradipta Gema, Rezki Yunanda
  • Leveraging BERT with Extractive Summarization for Depression Detection on Social Media.
    David William, Said Achmad, Derwin Suhartono, Aryo Pradipta Gema

    • 2021

  • Automatic Piano Sheet Music Transcription with Machine Learning.
    Fernandes Saputra, Un Greffin Namyu, Derwin Suhartono, Aryo Pradipta Gema

    • 2020

  • Argument annotation and analysis using deep learning with attention mechanism in Bahasa Indonesia.
    Derwin Suhartono, Aryo Pradipta Gema, Suhendro Winton, Theodorus David, Mohamad Ivan Fanany, Aniati Murni Arymurthy
  • Sequence-to-Sequence Learning for Motion-aware Claim Generation.
    Derwin Suhartono, Aryo Pradipta Gema, Suhendro Winton, Theodorus David, Mohamad Ivan Fanany, Aniati Murni Arymurthy

    • 2018

  • Attention-based Argumentation Mining.
    Derwin Suhartono, Aryo Pradipta Gema, Suhendro Winton, Theodorus David, Mohamad Ivan Fanany, Aniati Murni Arymurthy
  • Facial Attractiveness Classification using Deep Learning.
    Ricky Anderson, Aryo Pradipta Gema, Suharjito Suharjito, Sani Muhamad Isa

    • 2017

  • Hierarchical Attention Network with XGBoost for Recognizing Insufficiently Supported Arguments.
    Derwin Suhartono, Aryo Pradipta Gema, Suhendro Winton, Theodorus David, Mohamad Ivan Fanany, Aniati Murni Arymurthy
  • It Takes Two To Tango: Modification of Siamese Long Short Term Memory Network with Attention Mechanism in Recognizing Argumentative Relations in Persuasive Essay.
    Aryo Pradipta Gema, Suhendro Winton, Theodorus David, Derwin Suhartono, Muhsin Shodiq, Wikaria Gazali
  • Recurrent Neural Network (RNN) dan Gated Recurrent Unit (GRU).
    Aryo Pradipta Gema, Derwin Suhartono

    • Education

  • University of Edinburgh - Edinburgh, Scotland (September 2022 - Present)

    Ph.D. in Biomedical AI (MSc(Res) expected August 2023)

  • Bina Nusantara University - Jakarta, Indonesia (September 2014 - August 2018)

    Bachelor of Science in Computer Science

    • Experience

    • October 2021 - August 2022

      Senior Data Scientist at Epigene Labs

      Paris, France

    • October 2019 - September 2021

      Data Scientist at Epigene Labs

      Paris, France

    • February 2019 - October 2019

      Staff AI Research Scientist at Riminder

      Paris, France

    • October 2018 - January 2019

      AI Research Scientist at Riminder

      Paris, France

    • September 2017 - July 2018

      Data Scientist at Julo

      Jakarta, Indonesia

    • March 2017 - July 2018

      Junior Deep Learning Researcher at Bina Nusantara University

      Jakarta, Indonesia

    • July 2017 - September 2017

      Freelance Web Developer at RE/MAX 2000

      California, USA (Remote)

    • August 2016 - July 2017

      Senior Software Engineer at volantech.io

      Jakarta, Indonesia

    • February 2016 - August 2016

      Senior Full Stack Developer at anakmuda.net

      Jakarta, Indonesia

    Invited Talks

  • What is ChatGPT (Sutton Summer School, July 2023)
  • Knowledge Graph Embeddings in the Biomedical Domain (Bina Nusantara University, May 2023)
  • Knowledge-Augmented Clinical Language Models (Bina Nusantara University, May 2023)
  • ChatGPT: A Biomedical AI Perspective (University of Edinburgh, May 2023)
  • Knowledge-Augmented Clinical Language Models (Bina Nusantara University, March 2023)
  • Clinical Language Models (Bina Nusantara University, February 2023)
  • Building a Knowledge Base from Biomedical Literature (Bina Nusantara University, July 2022)
  • Augmenting Intelligence to Drug Discovery (Bina Nusantara University, December 2021)
  • Augmenting Intelligence to Drug Discovery (Bina Nusantara University, April 2021)
  • Introduction to Artificial Intelligence (Bina Nusantara University, October 2020)

    • Awards and Achievements

    Academics

  • Bina Nusantara University (August 2018)

    Binusian Award (awarded to the most achieving graduate)

  • Bina Nusantara University (August 2018)

    Magna Cum Laude

  • International Conference on Computer Science and Computational Intelligence (ICCSCI) (July 2017)

    Best Presenter

  • Penelitian Produk Terapan (PPT) Binus Research Grant (2017)

    Research Grant Awardee

  • Bina Nusantara University (September 2015)

    Student of Excellence honor (awarded to students with international and national achievements)

  • Bina Nusantara University (2015)

    Binus Student Learning Community Scholarship awardee (awarded to students who enrolled as mentors)

  • Bina Nusantara University (December 2014)

    Student of Excellence honor (awarded to students with international and national achievements)


    • Other

  • United Asian Debating Championship (July 2015)

    Quarterfinalist in English as Foreign Language Category

  • Asian Law Students' Association University of Indonesia (April 2015)

    Octofinalist

  • Asian Law Students' Association Universitas Padjadjaran (February 2015)

    Semifinalist and 8th Best Speaker

  • Indonesian Varsity English Debate University of Indonesia (February 2015)

    Champion in Novice Category

  • Founder’s Trophy Debating Championship University of Indonesia (December 2014)

    Best Novice Team

  • Newbies Debating Championship University of Indonesia (November 2014)

    1st Runner Up and 3rd Best Speaker

    • Miscellaneous

    Languages:

    Indonesian – Native, English – Fluent, French – Basic

    Skills:

    Python, Golang, C++, Tensorflow, Pytorch, H2O, Scikit-Learn, spaCy, NLTK, Pandas, MySQL, MongoDB, Azure Cosmos DB, CI/CD

    Other Interests:

    Chess ♟, Parliamentary Debate 💬, Cooking 👨‍🍳