multimodal-llm — 360d

84 papers ← all tags

Date	Title	Authors	arXiv
2026-06-02	CP-Agent: Context-Aware Multimodal Reasoning for Cellular Morphological Profiling under Chemical Perturbations drug-discovery · molecular-representation	Yuxin Zhang et al.	2606.03435
2026-06-02	GroupToM-Bench: Benchmarking Group Theory of Mind and Nonlinear Social Emergence in MLLMs	Weidong Tang et al.	2606.04184
2026-05-26	Heterogeneous Parallelism for Multimodal Large Language Model Training	Yashaswi Karnati et al.	2605.27678
2026-05-19	EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs	Yang Dai et al.	2605.19559
2026-05-19	Miller-Index-Based Latent Crystallographic Fracture Plane Reasoning with Vision-Language Models	Qinwu Xu et al.	2605.20416
2026-05-17	CatalyticMLLM: A Graph-Text Multimodal Large Language Model for Catalytic Materials generative-model · property-prediction	Yanjie Li	2605.17254
2026-05-12	MolDeTox: Evaluating Language Model's Stepwise Fragment Editing for Molecular Detoxification drug-discovery · molecular-generation	Jueon Park et al.	2605.12181
2026-05-12	Images in Sentences: Scaling Interleaved Instructions for Unified Visual Generation	Yabo Zhang et al.	2605.12305
2026-05-11	SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation	Longteng Guo et al.	2605.10187
2026-05-09	PPI2Text: Captioning Protein-Protein Interactions with Coordinate-Aligned Pair-Map Decoding	Xiao Fei et al.	2605.08924
2026-05-05	Material Database Agent: A Multimodal Agentic Framework for Scientific Literature Mining materials-science	Achuth Chandrasekhar et al.	2605.04278
2026-05-04	Bolek: A Multimodal Language Model for Molecular Reasoning property-prediction	Frederic Grabowski et al.	2605.02745
2026-05-01	Proteo-R1: Reasoning Foundation Models for De Novo Protein Design drug-discovery · generative-model · protein-structure	Fang Wu et al.	2605.02937
2026-04-21	EgoMotion: Hierarchical Reasoning and Diffusion for Egocentric Vision-Language Motion Generation	Ruibing Hou et al.	2604.19105
2026-04-21	Unveiling Fine-Grained Visual Traces: Evaluating Multimodal Interleaved Reasoning Chains in Multimodal STEM Tasks	Jing Jin et al.	2604.19697
2026-04-20	Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning	Yibo Yan et al.	2502.02871
2026-04-16	Precision Synthesis of Multi-Tracer PET via VLM-Modulated Rectified Flow for Stratifying Mild Cognitive Impairment generative-model	Tuo Liu et al.	2604.11176
2026-04-15	LongVideo-R1: Smart Navigation for Low-cost Long Video Understanding reinforcement-learning	Jihao Qiu et al.	2602.20913
2026-04-13	CFMS: A Coarse-to-Fine Multimodal Synthesis Framework for Enhanced Tabular Reasoning	Qixian Huang et al.	2604.10973
2026-04-09	Cognitive Mismatch in Multimodal Large Language Models for Discrete Symbol Understanding	Yinghui Li et al.	2603.18472
2026-04-09	MARINER: A 3E-Driven Benchmark for Fine-Grained Perception and Complex Reasoning in Open-Water Environments	Xingming Liao et al.	2604.08615
2026-04-08	Do MLLMs Really Understand Space? A Mathematical Reasoning Evaluation	Shuo Lu et al.	2602.11635
2026-04-04	Computational emotion analysis with multimodal LLMs: Current evidence on an emerging methodological opportunity	Hauke Licht	2512.10882
2026-04-03	PolyReal: A Benchmark for Real-World Polymer Science Workflows	Wanhao Liu et al.	2604.02934
2026-04-02	Omni123: Exploring 3D Native Foundation Models with Limited 3D Data by Unifying Text to 2D and 3D Generation	Chongjie Ye et al.	2604.02289
2026-03-31	AGILE: Hand-Object Interaction Reconstruction from Video via Agentic Generation generative-model	Jin-Chuan Shi et al.	2602.04672
2026-03-30	ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Models	Linqing Zhong et al.	2601.11404
2026-03-26	On-Demand Instructional Material Providing Agent Based on MLLM for Tutoring Support	Takumi Kato et al.	2603.25195
2026-03-19	Perceptio: Perception Enhanced Vision Language Models via Spatial Token Generation	Yuchen Li et al.	2603.18795
2026-03-17	OpenQlaw: An Agentic AI Assistant for Analysis of 2D Quantum Materials 2d-materials	Sankalp Pandey et al.	2603.17043
2026-03-17	Mitigating Premature Discretization with Progressive Quantization for Robust Vector Tokenization protein-structure	Wenhao Zhao et al.	2603.22304
2026-03-13	Vision-Language Based Expert Reporting for Painting Authentication and Defect Detection	Eman Ouda et al.	2603.13437
2026-03-12	MaterialFigBENCH: benchmark dataset with figures for evaluating college-level materials science problem-solving abilities of multimodal large language models materials-science	Michiko Yoshitake et al.	2603.11414
2026-03-09	CrystaL: Spontaneous Emergence of Visual Latents in MLLMs	Yang Zhang et al.	2602.20980
2026-03-09	Text to Automata Diagrams: Comparing TikZ Code Generation with Direct Image Synthesis	Ethan Young et al.	2603.07936
2026-03-06	A Multi-Agent System Enables Versatile Information Extraction from the Chemical Literature	Yufan Chen et al.	2507.20230
2026-03-05	Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation catalysis · generative-model	Steffen Eger et al.	2502.05151
2026-02-19	QuPAINT: Physics-Aware Instruction Tuning Approach to Quantum Material Discovery	Xuan-Bac Nguyen et al.	2602.17478
2026-02-16	Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysis diffusion-model	Yuan Gao et al.	2506.11526
2026-02-15	ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization reinforcement-learning	Youqi Wang et al.	2602.14098
2026-02-11	Grandes Modelos de Linguagem Multimodais (MLLMs): Da Teoria à Prática	Neemias da Silva et al.	2602.12302
2026-02-07	Scene2Hap: Generating Scene-Wide Haptics for VR from Scene Context with Multimodal LLMs materials-science	Arata Jingu et al.	2504.19611
2026-02-05	Human-AI Co-Embodied Intelligence for Scientific Experimentation and Manufacturing	Xinyi Lin et al.	2511.02071
2026-02-05	Ethology of Latent Spaces	Philippe Boisnard	2602.05710
2026-02-02	SciTextures: Collecting and Connecting Visual Patterns, Models, and Code Across Science and Art generative-model	Sagi Eppel et al.	2511.01817
2026-02-01	Achieving Time Series Reasoning Requires Rethinking Model Design, Tasks Formulation, and Evaluation	Yaxuan Kong et al.	2502.01477
2026-02-01	A Survey of Token Compression for Efficient Multimodal Large Language Models	Kele Shao et al.	2507.20198
2026-01-28	Breaking Bad Molecules: Are MLLMs Ready for Structure-Level Molecular Detoxification? property-prediction	Fei Lin et al.	2506.10912
2026-01-28	RxnBench: A Multimodal Benchmark for Evaluating Large Language Models on Chemical Reaction Understanding from Scientific Literature	Hanzheng Li et al.	2512.23565
2026-01-07	UniVideo: Unified Understanding, Generation, and Editing for Videos	Cong Wei et al.	2510.08377
2026-01-01	MotionPhysics: Learnable Motion Distillation for Text-Guided Simulation diffusion-model	Miaowei Wang et al.	2601.00504
2025-12-28	HiSciBench: A Hierarchical Multi-disciplinary Benchmark for Scientific Intelligence from Reading to Discovery	Yaping Zhang et al.	2512.22899
2025-12-28	With Great Context Comes Great Prediction Power: Classifying Objects via Geo-Semantic Scene Graphs materials-science	Ciprian Constantinescu et al.	2512.23024
2025-12-24	LiveProteinBench: A Contamination-Free Benchmark for Assessing Models' Specialized Capabilities in Protein Science	Dingyi Rong et al.	2512.22257
2025-12-22	Multimodal LLMs for Historical Dataset Construction from Archival Image Scans: German Patents (1877-1918)	Niclas Griesshaber et al.	2512.19675
2025-12-11	Benchmarking Multimodal LLMs on Recognition and Understanding over Chemical Tables	Yitong Zhou et al.	2506.11375
2025-11-25	MTBBench: A Multimodal Sequential Clinical Decision-Making Benchmark in Oncology	Kiril Vasilev et al.	2511.20490
2025-11-22	ChemVTS-Bench: Evaluating Visual-Textual-Symbolic Reasoning of Multimodal Large Language Models in Chemistry	Zhiyuan Huang et al.	2511.17909
2025-11-22	Plan-X: Instruct Video Generation via Semantic Planning diffusion-model	Lun Huang et al.	2511.17986
2025-11-22	RoadBench: Benchmarking MLLMs on Fine-Grained Spatial Understanding and Reasoning under Urban Road Scenarios	Jun Zhang et al.	2511.18011
2025-11-17	Part-X-MLLM: Part-aware 3D Multimodal Large Language Model	Chunshi Wang et al.	2511.13647
2025-11-03	Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception materials-science	Jiajing Lin et al.	2411.16800
2025-11-01	OpenFACADES: An Open Framework for Architectural Caption and Attribute Data Enrichment via Street View Imagery	Xiucheng Liang et al.	2504.02866
2025-11-01	Towards Robust Evaluation of STEM Education: Leveraging MLLMs in Project-Based Learning catalysis	Xinyi Wu et al.	2505.17050
2025-10-30	Omni-Mol: Multitask Molecular Model for Any-to-any Modalities molecular-generation · molecular-representation	Chengxin Hu et al.	2502.01074
2025-10-28	LeMat-Synth: a multi-modal toolbox to curate broad synthesis procedure databases from scientific literature materials-discovery · materials-science	Magdalena Lederbauer et al.	2510.26824
2025-10-26	ChemVLM: Exploring the Power of Multimodal Large Language Models in Chemistry Area chemical-llm	Junxian Li et al.	2408.07246
2025-10-23	Beyond Text: Multimodal Jailbreaking of Vision-Language and Audio Models through Perceptually Simple Transformations	Divyanshu Kumar et al.	2510.20223
2025-10-17	Reasoning-Enhanced Large Language Models for Molecular Property Prediction drug-discovery · materials-science · molecular-llm · property-prediction · reinforcement-learning	Jiaxi Zhuang et al.	2510.10248
2025-10-13	ExpVid: A Benchmark for Experiment Video Understanding & Reasoning	Yicheng Xu et al.	2510.11606
2025-10-11	Doc2SAR: A Synergistic Framework for High-Fidelity Extraction of Structure-Activity Relationships from Scientific Documents drug-discovery	Jiaxi Zhuang et al.	2506.21625
2025-09-30	Thin Bridges for Drug Text Alignment: Lightweight Contrastive Learning for Target Specific Drug Retrieval drug-discovery · molecular-representation	Mallikarjuna Tupakula	2510.03309
2025-09-27	TATTOO: Training-free AesTheTic-aware Outfit recOmmendation	Yuntian Wu et al.	2509.23242
2025-09-26	Patient-specific Biomolecular Instruction Tuning	Irsyad Adam et al.	2509.22853
2025-09-25	SoM-1K: A Thousand-Problem Benchmark Dataset for Strength of Materials	Qixin Wan et al.	2509.21079
2025-09-11	Can Multimodal LLMs See Materials Clearly? A Multimodal Benchmark on Materials Characterization materials-science	Zhengzhao Lai et al.	2509.09307
2025-09-04	Sample-efficient Integration of New Modalities into Large Language Models	Osman Batur İnce et al.	2509.04606
2025-09-03	Human Preference-Aligned Concept Customization Benchmark via Decomposed Evaluation	Reina Ishikawa et al.	2509.03385
2025-09-02	Language-Guided Long Horizon Manipulation with LLM-based Planning and Visual Perception	Changshi Zhou et al.	2509.02324
2025-08-19	MME-SCI: A Comprehensive and Challenging Science Benchmark for Multimodal Large Language Models	Jiacheng Ruan et al.	2508.13938
2025-08-14	Chem3DLLM: 3D Multimodal Large Language Models for Chemistry drug-discovery · reinforcement-learning	Lei Jiang et al.	2508.10696
2025-08-04	ChemMLLM: Chemical Multimodal Large Language Model chemical-llm	Qian Tan et al.	2505.16326
2025-07-21	Can Your Model Separate Yolks with a Water Bottle? Benchmarking Physical Commonsense Understanding in Video Generation Models materials-science	Enes Sanli et al.	2507.15824
2025-07-15	Evaluating Multimodal Large Language Models on Educational Textbook Question Answering	Hessa A. Alawwad et al.	2506.21596