Shreyas Rajesh

About

Iโ€™m a PhD student at UCLA advised by Prof. Vwani Roychowdhury. Iโ€™m broadly interested in language modeling and information retrieval. My current focus is on building better information representation systems for LLMs (memory systems) to enable more dynamic, adaptable representations. Iโ€™m also interested in applying advances in language modeling to problems in the sciences and in health.

Research interests

  • Language modeling and retrieval-augmented generation
  • Information retrieval
  • Memory and representation systems for LLMs
  • Applications of NLP in scientific and health domains

Papers

[1] Beyond Fact Retrieval: Episodic Memory for RAG with Generative Semantic Workspaces

AAAI 2026 Oral
NeurIPS 2025 โ€” Language, Agents and World Models Spotlight

Shreyas Rajesh, Pavan Holur, Chenda Duan, David Chong, Vwani Roychowdhury

We introduce GSW, which equips LLMs with human-like episodic memory through structured semantic representations that track actors, roles, and states across space and time, outperforming standard RAG frameworks on episodic memory tasks.

[2] Embed-Search-Align: DNA sequence alignment using Transformer models

Bioinformatics 2025

Pavan Holur*, Kenneth C Enevoldsen*, Shreyas Rajesh, Lajoyce Mboning, Thalia Georgiou, Louis-S Bouchard, Matteo Pellegrini, Vwani Roychowdhury

We introduce DNARDE, a DNA language model trained with a contrastive objective for sequence alignment, pairing it with vector-store retrieval over nucleotide sequences. DNARDE outperforms prior transformer baselines on alignment and transfers across chromosomes and species.

[3] Customizing Open Source LLMs for Quantitative Medication Attribute Extraction across Heterogeneous EHR Systems

NeurIPS 2025 โ€” GenAI for Health Workshop

Zhe Fei*, Mehmet Yigit Turali*, Shreyas Rajesh*, Xinyang Dai, Huyen Pham, Pavan Holur, Yuhui Zhu, Larissa Mooney, Yih-Ing Hser, Vwani Roychowdhury

We develop a framework using open-source LLMs to standardize opioid use disorder prescriptions from diverse EHRs, enabling consistent analysis across different EHR sources and formats.

[4] Creating an AI Observer: Generative Semantic Workspaces

arXiv

Pavan Holur, Shreyas Rajesh, David Chong, Vwani Roychowdhury

Exploration of generative semantic workspaces for AI observation.

* denotes equal contribution.