multimodal-llm — all

118 papers ← all tags

Date	Title	Authors	arXiv
2026-06-02	CP-Agent: Context-Aware Multimodal Reasoning for Cellular Morphological Profiling under Chemical Perturbations drug-discovery · molecular-representation	Yuxin Zhang et al.	2606.03435
2026-06-02	GroupToM-Bench: Benchmarking Group Theory of Mind and Nonlinear Social Emergence in MLLMs	Weidong Tang et al.	2606.04184
2026-05-26	Heterogeneous Parallelism for Multimodal Large Language Model Training	Yashaswi Karnati et al.	2605.27678
2026-05-19	EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs	Yang Dai et al.	2605.19559
2026-05-19	Miller-Index-Based Latent Crystallographic Fracture Plane Reasoning with Vision-Language Models	Qinwu Xu et al.	2605.20416
2026-05-17	CatalyticMLLM: A Graph-Text Multimodal Large Language Model for Catalytic Materials generative-model · property-prediction	Yanjie Li	2605.17254
2026-05-12	MolDeTox: Evaluating Language Model's Stepwise Fragment Editing for Molecular Detoxification drug-discovery · molecular-generation	Jueon Park et al.	2605.12181
2026-05-12	Images in Sentences: Scaling Interleaved Instructions for Unified Visual Generation	Yabo Zhang et al.	2605.12305
2026-05-11	SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation	Longteng Guo et al.	2605.10187
2026-05-09	PPI2Text: Captioning Protein-Protein Interactions with Coordinate-Aligned Pair-Map Decoding	Xiao Fei et al.	2605.08924
2026-05-05	Material Database Agent: A Multimodal Agentic Framework for Scientific Literature Mining materials-science	Achuth Chandrasekhar et al.	2605.04278
2026-05-04	Bolek: A Multimodal Language Model for Molecular Reasoning property-prediction	Frederic Grabowski et al.	2605.02745
2026-05-01	Proteo-R1: Reasoning Foundation Models for De Novo Protein Design drug-discovery · generative-model · protein-structure	Fang Wu et al.	2605.02937
2026-04-21	EgoMotion: Hierarchical Reasoning and Diffusion for Egocentric Vision-Language Motion Generation	Ruibing Hou et al.	2604.19105
2026-04-21	Unveiling Fine-Grained Visual Traces: Evaluating Multimodal Interleaved Reasoning Chains in Multimodal STEM Tasks	Jing Jin et al.	2604.19697
2026-04-20	Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning	Yibo Yan et al.	2502.02871
2026-04-16	Precision Synthesis of Multi-Tracer PET via VLM-Modulated Rectified Flow for Stratifying Mild Cognitive Impairment generative-model	Tuo Liu et al.	2604.11176
2026-04-15	LongVideo-R1: Smart Navigation for Low-cost Long Video Understanding reinforcement-learning	Jihao Qiu et al.	2602.20913
2026-04-13	CFMS: A Coarse-to-Fine Multimodal Synthesis Framework for Enhanced Tabular Reasoning	Qixian Huang et al.	2604.10973
2026-04-09	Cognitive Mismatch in Multimodal Large Language Models for Discrete Symbol Understanding	Yinghui Li et al.	2603.18472
2026-04-09	MARINER: A 3E-Driven Benchmark for Fine-Grained Perception and Complex Reasoning in Open-Water Environments	Xingming Liao et al.	2604.08615
2026-04-08	Do MLLMs Really Understand Space? A Mathematical Reasoning Evaluation	Shuo Lu et al.	2602.11635
2026-04-04	Computational emotion analysis with multimodal LLMs: Current evidence on an emerging methodological opportunity	Hauke Licht	2512.10882
2026-04-03	PolyReal: A Benchmark for Real-World Polymer Science Workflows	Wanhao Liu et al.	2604.02934
2026-04-02	Omni123: Exploring 3D Native Foundation Models with Limited 3D Data by Unifying Text to 2D and 3D Generation	Chongjie Ye et al.	2604.02289
2026-03-31	AGILE: Hand-Object Interaction Reconstruction from Video via Agentic Generation generative-model	Jin-Chuan Shi et al.	2602.04672
2026-03-30	ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Models	Linqing Zhong et al.	2601.11404
2026-03-26	On-Demand Instructional Material Providing Agent Based on MLLM for Tutoring Support	Takumi Kato et al.	2603.25195
2026-03-19	Perceptio: Perception Enhanced Vision Language Models via Spatial Token Generation	Yuchen Li et al.	2603.18795
2026-03-17	OpenQlaw: An Agentic AI Assistant for Analysis of 2D Quantum Materials 2d-materials	Sankalp Pandey et al.	2603.17043
2026-03-17	Mitigating Premature Discretization with Progressive Quantization for Robust Vector Tokenization protein-structure	Wenhao Zhao et al.	2603.22304
2026-03-13	Vision-Language Based Expert Reporting for Painting Authentication and Defect Detection	Eman Ouda et al.	2603.13437
2026-03-12	MaterialFigBENCH: benchmark dataset with figures for evaluating college-level materials science problem-solving abilities of multimodal large language models materials-science	Michiko Yoshitake et al.	2603.11414
2026-03-09	CrystaL: Spontaneous Emergence of Visual Latents in MLLMs	Yang Zhang et al.	2602.20980
2026-03-09	Text to Automata Diagrams: Comparing TikZ Code Generation with Direct Image Synthesis	Ethan Young et al.	2603.07936
2026-03-06	A Multi-Agent System Enables Versatile Information Extraction from the Chemical Literature	Yufan Chen et al.	2507.20230
2026-03-05	Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation catalysis · generative-model	Steffen Eger et al.	2502.05151
2026-02-19	QuPAINT: Physics-Aware Instruction Tuning Approach to Quantum Material Discovery	Xuan-Bac Nguyen et al.	2602.17478
2026-02-16	Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysis diffusion-model	Yuan Gao et al.	2506.11526
2026-02-15	ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization reinforcement-learning	Youqi Wang et al.	2602.14098
2026-02-11	Grandes Modelos de Linguagem Multimodais (MLLMs): Da Teoria à Prática	Neemias da Silva et al.	2602.12302
2026-02-07	Scene2Hap: Generating Scene-Wide Haptics for VR from Scene Context with Multimodal LLMs materials-science	Arata Jingu et al.	2504.19611
2026-02-05	Human-AI Co-Embodied Intelligence for Scientific Experimentation and Manufacturing	Xinyi Lin et al.	2511.02071
2026-02-05	Ethology of Latent Spaces	Philippe Boisnard	2602.05710
2026-02-02	SciTextures: Collecting and Connecting Visual Patterns, Models, and Code Across Science and Art generative-model	Sagi Eppel et al.	2511.01817
2026-02-01	Achieving Time Series Reasoning Requires Rethinking Model Design, Tasks Formulation, and Evaluation	Yaxuan Kong et al.	2502.01477
2026-02-01	A Survey of Token Compression for Efficient Multimodal Large Language Models	Kele Shao et al.	2507.20198
2026-01-28	Breaking Bad Molecules: Are MLLMs Ready for Structure-Level Molecular Detoxification? property-prediction	Fei Lin et al.	2506.10912
2026-01-28	RxnBench: A Multimodal Benchmark for Evaluating Large Language Models on Chemical Reaction Understanding from Scientific Literature	Hanzheng Li et al.	2512.23565
2026-01-07	UniVideo: Unified Understanding, Generation, and Editing for Videos	Cong Wei et al.	2510.08377
2026-01-01	MotionPhysics: Learnable Motion Distillation for Text-Guided Simulation diffusion-model	Miaowei Wang et al.	2601.00504
2025-12-28	HiSciBench: A Hierarchical Multi-disciplinary Benchmark for Scientific Intelligence from Reading to Discovery	Yaping Zhang et al.	2512.22899
2025-12-28	With Great Context Comes Great Prediction Power: Classifying Objects via Geo-Semantic Scene Graphs materials-science	Ciprian Constantinescu et al.	2512.23024
2025-12-24	LiveProteinBench: A Contamination-Free Benchmark for Assessing Models' Specialized Capabilities in Protein Science	Dingyi Rong et al.	2512.22257
2025-12-22	Multimodal LLMs for Historical Dataset Construction from Archival Image Scans: German Patents (1877-1918)	Niclas Griesshaber et al.	2512.19675
2025-12-11	Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tables	Yitong Zhou et al.	2506.11375
2025-11-25	MTBBench: A Multimodal Sequential Clinical Decision-Making Benchmark in Oncology	Kiril Vasilev et al.	2511.20490
2025-11-22	ChemVTS-Bench: Evaluating Visual-Textual-Symbolic Reasoning of Multimodal Large Language Models in Chemistry	Zhiyuan Huang et al.	2511.17909
2025-11-22	Plan-X: Instruct Video Generation via Semantic Planning diffusion-model	Lun Huang et al.	2511.17986
2025-11-22	RoadBench: Benchmarking MLLMs on Fine-Grained Spatial Understanding and Reasoning under Urban Road Scenarios	Jun Zhang et al.	2511.18011
2025-11-17	Part-X-MLLM: Part-aware 3D Multimodal Large Language Model	Chunshi Wang et al.	2511.13647
2025-11-03	Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception materials-science	Jiajing Lin et al.	2411.16800
2025-11-01	OpenFACADES: An Open Framework for Architectural Caption and Attribute Data Enrichment via Street View Imagery	Xiucheng Liang et al.	2504.02866
2025-11-01	Towards Robust Evaluation of STEM Education: Leveraging MLLMs in Project-Based Learning catalysis	Xinyi Wu et al.	2505.17050
2025-10-30	Omni-Mol: Multitask Molecular Model for Any-to-any Modalities molecular-generation · molecular-representation	Chengxin Hu et al.	2502.01074
2025-10-28	LeMat-Synth: a multi-modal toolbox to curate broad synthesis procedure databases from scientific literature materials-discovery · materials-science	Magdalena Lederbauer et al.	2510.26824
2025-10-26	ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Area chemical-llm	Junxian Li et al.	2408.07246
2025-10-23	Beyond Text: Multimodal Jailbreaking of Vision-Language and Audio Models through Perceptually Simple Transformations	Divyanshu Kumar et al.	2510.20223
2025-10-17	Reasoning-Enhanced Large Language Models for Molecular Property Prediction drug-discovery · materials-science · molecular-llm · property-prediction · reinforcement-learning	Jiaxi Zhuang et al.	2510.10248
2025-10-13	ExpVid: A Benchmark for Experiment Video Understanding & Reasoning	Yicheng Xu et al.	2510.11606
2025-10-11	Doc2SAR: A Synergistic Framework for High-Fidelity Extraction of Structure-Activity Relationships from Scientific Documents drug-discovery	Jiaxi Zhuang et al.	2506.21625
2025-09-30	Thin Bridges for Drug Text Alignment: Lightweight Contrastive Learning for Target Specific Drug Retrieval drug-discovery · molecular-representation	Mallikarjuna Tupakula	2510.03309
2025-09-27	TATTOO: Training-free AesTheTic-aware Outfit recOmmendation	Yuntian Wu et al.	2509.23242
2025-09-26	Patient-specific Biomolecular Instruction Tuning	Irsyad Adam et al.	2509.22853
2025-09-25	SoM-1K: A Thousand-Problem Benchmark Dataset for Strength of Materials	Qixin Wan et al.	2509.21079
2025-09-11	Can Multimodal LLMs See Materials Clearly? A Multimodal Benchmark on Materials Characterization materials-science	Zhengzhao Lai et al.	2509.09307
2025-09-04	Sample-efficient Integration of New Modalities into Large Language Models	Osman Batur İnce et al.	2509.04606
2025-09-03	Human Preference-Aligned Concept Customization Benchmark via Decomposed Evaluation	Reina Ishikawa et al.	2509.03385
2025-09-02	Language-Guided Long Horizon Manipulation with LLM-based Planning and Visual Perception	Changshi Zhou et al.	2509.02324
2025-08-19	MME-SCI: A Comprehensive and Challenging Science Benchmark for Multimodal Large Language Models	Jiacheng Ruan et al.	2508.13938
2025-08-14	Chem3DLLM: 3D Multimodal Large Language Models for Chemistry drug-discovery · reinforcement-learning	Lei Jiang et al.	2508.10696
2025-08-04	ChemMLLM: Chemical Multimodal Large Language Model chemical-llm	Qian Tan et al.	2505.16326
2025-07-21	Can Your Model Separate Yolks with a Water Bottle? Benchmarking Physical Commonsense Understanding in Video Generation Models materials-science	Enes Sanli et al.	2507.15824
2025-07-15	Evaluating Multimodal Large Language Models on Educational Textbook Question Answering	Hessa A. Alawwad et al.	2506.21596
2025-06-09	SOLIDGEO: Measuring Multimodal Spatial Math Reasoning in Solid Geometry catalysis	Peijie Wang et al.	2505.21177
2025-06-09	HAIBU-ReMUD: Reasoning Multimodal Ultrasound Dataset and Model Bridging to General Specific Domains	Shijie Wang et al.	2506.07837
2025-05-23	Seeing Beyond Words: MatVQA for Challenging Visual-Scientific Reasoning in Materials Science materials-discovery · materials-science	Sifan Wu et al.	2505.18319
2025-05-21	Multicrossmodal Automated Agent for Integrating Diverse Materials Science Data materials-discovery · property-prediction	Adib Bazgir et al.	2505.15132
2025-05-20	Task-oriented Robotic Manipulation with Vision Language Models	Nurhan Bulus Guran et al.	2410.15863
2025-05-19	AutoMat: Enabling Automated Crystal Structure Reconstruction from Microscopy via Agentic Tool Use materials-science · mlip · property-prediction	Yaotian Yang et al.	2505.12650
2025-04-18	Scaling LLaNA: Advancing NeRF-Language Understanding Through Large-Scale Training	Andrea Amaduzzi et al.	2504.13995
2025-04-17	ProteinGPT: Multimodal LLM for Protein Property Prediction and Structure Understanding	Yijia Xiao et al.	2408.11363
2025-04-08	MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models	Pengfei Zhou et al.	2504.05782
2025-04-06	MLLM-as-a-Judge for Image Safety without Human Labeling	Zhenting Wang et al.	2501.00192
2025-04-03	The Plot Thickens: Quantitative Part-by-Part Exploration of MLLM Visualization Literacy	Matheus Valentim et al.	2504.02217
2025-03-27	Online Reasoning Video Segmentation with Just-in-Time Digital Twins catalysis	Yiqing Shen et al.	2503.21056
2025-03-24	MuMA: 3D PBR Texturing via Multi-Channel Multi-View Generation and Agentic Post-Processing materials-science	Lingting Zhu et al.	2503.18461
2025-03-11	Towards Large-scale Chemical Reaction Image Parsing via a Multimodal Large Language Model	Yufan Chen et al.	2503.08156
2025-03-08	FedMLLM: Federated Fine-tuning MLLM on Multimodal Heterogeneity Data	Binqian Xu et al.	2411.14717
2025-03-08	VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Models diffusion-model	Xinan He et al.	2503.06142
2025-03-04	Aligning Large Language Models and Geometric Deep Models for Protein Representation	Dong Shu et al.	2411.05316
2025-03-03	RemiHaven: Integrating "In-Town" and "Out-of-Town" Peers to Provide Personalized Reminiscence Support for Older Drifters	Xuechen Zhang et al.	2503.01358
2025-02-18	VLMaterial: Procedural Material Generation with Large Vision-Language Models	Beichen Li et al.	2501.18623
2025-01-16	Interpretable Droplet Digital PCR Assay for Trustworthy Molecular Diagnostics	Yuanyuan Wei et al.	2501.09218
2025-01-09	Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark	Yunzhuo Hao et al.	2501.05444
2024-12-19	TalkWithMachines: Enhancing Human-Robot Interaction for Interpretable Industrial Robotics Through Large/Vision Language Models	Ammar N. Abbas et al.	2412.15462
2024-12-09	LLaVA-SpaceSGG: Visual Instruct Tuning for Open-vocabulary Scene Graph Generation with Enhanced Spatial Relations	Mingjie Xu et al.	2412.06322
2024-11-22	LLaNA: Large Language and NeRF Assistant	Andrea Amaduzzi et al.	2406.11840
2024-11-09	TourSynbio-Search: A Large Language Model Driven Agent Framework for Unified Search Method for Protein Engineering protein-structure	Yungeng Liu et al.	2411.06024
2024-10-04	Many-Shot In-Context Learning in Multimodal Foundation Models	Yixing Jiang et al.	2405.09798
2024-08-15	DM2RM: Dual-Mode Multimodal Ranking for Target Objects and Receptacles Based on Open-Vocabulary Instructions	Ryosuke Korekata et al.	2408.07910
2024-07-30	Diffusion Augmented Agents: A Framework for Efficient Exploration and Transfer Learning diffusion-model · reinforcement-learning	Norman Di Palo et al.	2407.20798
2024-07-23	Vision Language Model is NOT All You Need: Augmentation Strategies for Molecule Language Models drug-discovery	Namkyeong Lee et al.	2407.09043
2024-07-21	V-Zen: Efficient GUI Understanding and Precise Grounding With A Novel Multimodal LLM catalysis	Abdur Rahman et al.	2405.15341
2024-07-08	Multimodal Chain-of-Thought Reasoning via ChatGPT to Protect Children from Age-Inappropriate Apps	Chuanbo Hu et al.	2407.06309
2024-06-19	PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes	He Cao et al.	2406.13193
2024-06-14	Generative AI-based Prompt Evolution Engineering Design Optimization With Vision-Language Model generative-model	Melvin Wong et al.	2406.09143
2024-05-23	Make-it-Real: Unleashing Large Multimodal Model for Painting 3D Objects with Realistic Materials generative-model · materials-science	Ye Fang et al.	2404.16829