Skip to main navigation Skip to search Skip to main content

TRM: An Efficient Hypervisor-Based Framework for Malware Analysis and Memory Reconstruction

Research output: Chapter in Book / Report / Conference proceeding › Conference contribution › Academic › peer-review

Abstract

Modern rootkits leverage kernel privileges to hide from analysis tools, while obfuscation techniques render them resistant to static analysis. Reverse engineering malware requires observing memory usage and reconstructing data structures. Existing tools rely on instrumentation or emulation, which introduce high overhead, leave detectable artifacts, and cannot reliably analyze kernel-level malware. We present The Reversing Machine (TRM), a hypervisor-based framework for high-performance introspection of evasive malware. It is the first system to support selective memory tracing and structure reconstruction in the hypervisor. TRM repurposes hardware virtualization to efficiently detect user-kernel mode transitions and obtain memory traces independently of a potentially compromised guest kernel. TRM introduces new insights into leveraging hardware virtualization for runtime memory reconstruction and analysis of data structures while remaining invisible to malware. We demonstrate automatic reconstruction of function signatures and data structures, reduce system call latency overhead from 142% to 57% compared to prior work, and accelerate manual reverse engineering by 43% on average, even for complex kernel objects. TRM shows that hypervisor-level memory tracing makes data structure reconstruction practical in hostile environments, bridging the gap between prior feasibility studies and real-world malware analysis.

Original languageEnglish
Title of host publicationWSESE '26: Proceedings of the 2026 IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering
PublisherAssociation for Computing Machinery, Inc
Pages68-82
Number of pages15
ISBN (Electronic)9798400723568
DOIs
Publication statusPublished - Jun 2026
Event21st ACM Asia Conference on Computer and Communications Security, AsiaCCS 2026 - Bangalore, India
Duration: 1 Jun 2026 → 5 Jun 2026

Conference

Conference21st ACM Asia Conference on Computer and Communications Security, AsiaCCS 2026
Country/TerritoryIndia
CityBangalore
Period1/06/26 → 5/06/26

Bibliographical note

Publisher Copyright:
© 2026 Copyright held by the owner/author(s).

Keywords

  • Efficient Reverse Engineering
  • Hardware-Assisted Analysis
  • Low-Overhead Kernel Monitoring
  • Runtime Structure Reconstruction
  • Transparent Malware Analysis

Fingerprint

Dive into the research topics of 'TRM: An Efficient Hypervisor-Based Framework for Malware Analysis and Memory Reconstruction'. Together they form a unique fingerprint.

Cite this