# pcodedmp.py - A VBA p-code disassembler
## Introduction
It is not widely known, but macros written in VBA (Visual Basic for Applications; the macro programming language used in Microsoft Office) exist in three different executable forms, each of which can be what is actually executed at run time, depending on the circumstances. These forms are:
- _Source code_. The original source code of the macro module is compressed and stored at the end of the module stream. This makes it relatively easy to locate and extract and most free DFIR tools for macro analysis like [oledump](https://blog.didierstevens.com/programs/oledump-py/) or [olevba](http://www.decalage.info/python/olevba) or even many professional anti-virus tools look only at this form. However, most of the time the source code is completely ignored by Office. In fact, it is possible to remove the source code (and therefore make all these tools think that there are no macros present), yet the macros will still execute without any problems. I have created a [proof of concept](http://bontchev.my.contact.bg/poc2.zip) illustrating this. Most tools will not see any macros in the documents in this archive it but if opened with the corresponding Word version (that matches the document name), it will display a message and will launch `calc.exe`. It is surprising that malware authors are not using this trick more widely.
- _P-code_. As each VBA line is entered into the VBA editor, it is immediately compiled into p-code (a pseudo code for a stack machine) and stored in a different place in the module stream. The p-code is precisely what is executed most of the time. In fact, even when you open the source of a macro module in the VBA editor, what is displayed is not the decompressed source code but the p-code decompiled into source. Only if the document is opened under a version of Office that uses a different VBA version from the one that has been used to create the document, the stored compressed source code is re-compiled into p-code and then that p-code is executed. This makes it possible to open a VBA-containing document on any version of Office that supports VBA and have the macros inside remain executable, despite the fact that the different versions of VBA use different (incompatible) p-code instructions.
- _Execodes_. When the p-code has been executed at least once, a further tokenized form of it is stored elsewhere in the document (in streams, the names of which begin with `__SRP_`, followed by a number). From there it can be executed much faster. However, the format of the execodes is extremely complex and is specific for the particular Office version (not VBA version) in which they have been created. This makes them extremely non-portable. In addition, their presence is not necessary - they can be removed and the macros will run just fine (from the p-code).
Since most of the time it is the p-code that determines what exactly a macro would do (even if neither source code, nor execodes are present), it would make sense to have a tool that can display it. This is what prompted us to create this VBA p-code disassembler.
## Installation
The script will work both in Python version 2.6+ and in Python 3.x. The simplest way to install it is from [PyPi](https://pypi.org/) with `pip`:
pip install pcodedmp -U
The above command will install the latest version of `pcodedmp` (upgrading an older one if it already exists), while also installing all the necessary dependencies (currently only `oletools` and `win_unicode_console` but there might be additional ones in the future).
If you would rather install it from the GitHub repository, you can do it like this:
git clone https://github.com/bontchev/pcodedmp.git
cd pcodedmp
pip install .
## Usage
The script takes as a command-line argument a list of one or more names of files or directories. If the name is an OLE2 document, it will be inspected for VBA code and the p-code of each code module will be disassembled. If the name is a directory, all the files in this directory and its subdirectories will be similarly processed. In addition to the disassembled p-code, by default the script also displays the parsed records of the `dir` stream, as well as the identifiers (variable and function names) used in the VBA modules and stored in the `_VBA_PROJECT` stream.
The script supports VBA5 (Office 97, MacOffice 98), VBA6 (Office 2000 to Office 2009) and VBA7 (Office 2010 and higher).
The script also accepts the following command-line options:
`-h`, `--help` Displays a short explanation how to use the script and what the command-line options are.
`-v`, `--version` Displays the version of the script.
`-n`, `--norecurse` If a name specified on the command line is a directory, process only the files in this directory; do not process the files in its subdirectories.
`-d`, `--disasmonly` Only the p-code will be disassembled, without the parsed contents of the `dir` stream or the identifiers in the `_VBA_PROJECT` stream.
`-b`, `--verbose` The contents of the `dir` and `_VBA_PROJECT` streams is dumped in hex and ASCII form. In addition, the raw bytes of each compiled into p-code VBA line are also dumped in hex and ASCII.
`-o OUTFILE`, `--output OUTFILE` Save the results to the specified output file, instead of sending it to the standard output.
For instance, using the script on one of the documents in the [proof of concept](http://bontchev.my.contact.bg/poc2.zip) mentioned above produces the following results:
```shell
python pcodedmp.py -d Word2013.doc
Processing file: Word2013.doc
===============================================================================
Module streams:
Macros/VBA/ThisDocument - 1517 bytes
Line #0:
FuncDefn (Private Sub Document_Open())
Line #1:
LitStr 0x001D "This could have been a virus!"
Ld vbOKOnly
Ld vbInformation
Add
LitStr 0x0006 "Virus!"
ArgsCall MsgBox 0x0003
Line #2:
LitStr 0x0008 "calc.exe"
Paren
ArgsCall Shell 0x0001
Line #3:
EndSub
```
For reference, it is the result of compiling the following VBA code:
```vba
Private Sub Document_Open()
MsgBox "This could have been a virus!", vbOKOnly + vbInformation, "Virus!"
Shell("calc.exe")
End Sub
```
## Known problems
- Office 2016 64-bit only: When disassembling variables declared as being of custom type (e.g., `Dim SomeVar As SomeType`), the type (`As SomeType`) is not disassembled.
- Office 2016 64-bit only: The `Private` property of `Sub`, `Function` and `Property` declarations is not disassembled.
- Office 2016 64-bit only: The `Declare` part of external function declarations (e.g., `Private Declare PtrSafe Function SomeFunc Lib "SomeLib" Alias "SomeName" () As Long`) is not disassembled.
- Office 2000 and higher: The type of a subroutine or function argument of type `ParamArray` is not disassembled correctly. For instance, `Sub Foo (ParamArray arg())` will be disassembled as `Sub Foo (arg)`.
- All versions of Office: The `Alias "SomeName"` part of external function declarations (e.g., `Private Declare PtrSafe Function SomeFunc Lib "SomeLib" Alias "SomeName" () As Long`) is not disassembled.
- All versions of Office: The `Public` property of custom type definitions (e.g., `Public Type SomeType`) is not disassembled.
- All versions of Office: The custom type of a subroutine or function argument is not disassembled correctly and `CustomType` is used instead. For instance, `Sub Foo (arg As Bar)` will be disassembled as `Sub Foo (arg As CustomType)`.
- If the output of the program is sent to a file, instead of to the console (either by using the `-o` option or by redirecting `stdout`), any non-ASCII strings (like module names, texsts used in the macros, etc.) might not be properly encoded.
I do not have access to 64-bit Office 2016 and the few samples of documents, generated by this version of Office, that I have, have been insufficient for me to figure out where the corresponding information resides. I know where it resides in the other versions of Office, but it has been moved elsewhere in 64-bit Office 2016 and the old algorithms no longer work.
## To do
- Implement support of VBA3 (Excel95).
- While the script should support documents created by MacOffice, this has not been tested (and you know how well untested code usually works). This should be tested and any bugs related to it should be fixed.
- I am not an experienced Python programmer and the code is ugly. Somebody more familiar with Python than me should probably rewrite the script and make it look better.
## Change log
Version 1.2.6:
- Changed it not to require the `win_unicode_console` module when it is not available - e.g., when not running on a Windows machine or when running under the PyPy implementation of Python, thanks to [Philippe Lagadec](https://github.com/decalage2).
Version 1.2.5:
- Added a sanity check to avoid errors when parsing object declarations
- The functions that produce output now have the output file (default is `stdout`) as a parameter, for better integration with other tools, thanks to [Philippe Lagadec](https://github.com/decalage2).
Version 1.2.4:
- Implemented support for module names with non-ASCII characters in their names. Thanks to [Philippe Lagadec](https://github.com/decalage2) for helping me with that.
- Fixed a parsing error when disassembling object declarations.
- Removed some unused variables.
- Improved the documentation a bit.
Version 1.2.3:
- Fixed a few crashes and documented better some disassembly failures.
- Converted the script into a package that can be installed with ``pip``. Use the command ``pip install pcodedmp``.
Version 1.2.2:
- Implemented handling of documents saved in Open XML format (which is the default format of Office 2007 and higher) - `.docm`, `.xlsm`, `.pptm`.
Version 1.2.1:
- Now runs under Python 3.x too.
- Improved support of 64-bit Office documents.
- Implemented support of some VBA7-specific features (`Friend`, `PtrSafe`, `LongPtr`).
- Improved the disassembling of `Dim` declarations.
Version 1.2.0:
- Disassembling the various declarations (`New`, `Type`, `Dim`, `ReDim`, `Sub`, `Function`, `Property`).
Version 1.1.0:
- Storing the opcodes in a more efficient manner.
- Implemented VBA7 support.
- Implemented support for documents created by the 64-bit version of Office.
Version 1.0.0:
- Initial version.
Raw data
{
"_id": null,
"home_page": "https://github.com/bontchev/pcodedmp",
"name": "pcodedmp",
"maintainer": "Vesselin Bontchev",
"docs_url": null,
"requires_python": "",
"maintainer_email": "vbontchev@yahoo.com",
"keywords": "vba,p-code,disassembler",
"author": "Vesselin Bontchev",
"author_email": "vbontchev@yahoo.com",
"download_url": "https://files.pythonhosted.org/packages/3d/20/6d461e29135f474408d0d7f95b2456a9ba245560768ee51b788af10f7429/pcodedmp-1.2.6.tar.gz",
"platform": "",
"description": "# pcodedmp.py - A VBA p-code disassembler\n\n## Introduction\n\nIt is not widely known, but macros written in VBA (Visual Basic for Applications; the macro programming language used in Microsoft Office) exist in three different executable forms, each of which can be what is actually executed at run time, depending on the circumstances. These forms are:\n\n- _Source code_. The original source code of the macro module is compressed and stored at the end of the module stream. This makes it relatively easy to locate and extract and most free DFIR tools for macro analysis like [oledump](https://blog.didierstevens.com/programs/oledump-py/) or [olevba](http://www.decalage.info/python/olevba) or even many professional anti-virus tools look only at this form. However, most of the time the source code is completely ignored by Office. In fact, it is possible to remove the source code (and therefore make all these tools think that there are no macros present), yet the macros will still execute without any problems. I have created a [proof of concept](http://bontchev.my.contact.bg/poc2.zip) illustrating this. Most tools will not see any macros in the documents in this archive it but if opened with the corresponding Word version (that matches the document name), it will display a message and will launch `calc.exe`. It is surprising that malware authors are not using this trick more widely.\n\n- _P-code_. As each VBA line is entered into the VBA editor, it is immediately compiled into p-code (a pseudo code for a stack machine) and stored in a different place in the module stream. The p-code is precisely what is executed most of the time. In fact, even when you open the source of a macro module in the VBA editor, what is displayed is not the decompressed source code but the p-code decompiled into source. Only if the document is opened under a version of Office that uses a different VBA version from the one that has been used to create the document, the stored compressed source code is re-compiled into p-code and then that p-code is executed. This makes it possible to open a VBA-containing document on any version of Office that supports VBA and have the macros inside remain executable, despite the fact that the different versions of VBA use different (incompatible) p-code instructions.\n\n- _Execodes_. When the p-code has been executed at least once, a further tokenized form of it is stored elsewhere in the document (in streams, the names of which begin with `__SRP_`, followed by a number). From there it can be executed much faster. However, the format of the execodes is extremely complex and is specific for the particular Office version (not VBA version) in which they have been created. This makes them extremely non-portable. In addition, their presence is not necessary - they can be removed and the macros will run just fine (from the p-code).\n\nSince most of the time it is the p-code that determines what exactly a macro would do (even if neither source code, nor execodes are present), it would make sense to have a tool that can display it. This is what prompted us to create this VBA p-code disassembler.\n\n## Installation\n\nThe script will work both in Python version 2.6+ and in Python 3.x. The simplest way to install it is from [PyPi](https://pypi.org/) with `pip`:\n\n pip install pcodedmp -U\n\nThe above command will install the latest version of `pcodedmp` (upgrading an older one if it already exists), while also installing all the necessary dependencies (currently only `oletools` and `win_unicode_console` but there might be additional ones in the future).\n\nIf you would rather install it from the GitHub repository, you can do it like this:\n\n git clone https://github.com/bontchev/pcodedmp.git\n cd pcodedmp\n pip install .\n\n## Usage\n\nThe script takes as a command-line argument a list of one or more names of files or directories. If the name is an OLE2 document, it will be inspected for VBA code and the p-code of each code module will be disassembled. If the name is a directory, all the files in this directory and its subdirectories will be similarly processed. In addition to the disassembled p-code, by default the script also displays the parsed records of the `dir` stream, as well as the identifiers (variable and function names) used in the VBA modules and stored in the `_VBA_PROJECT` stream.\n\nThe script supports VBA5 (Office 97, MacOffice 98), VBA6 (Office 2000 to Office 2009) and VBA7 (Office 2010 and higher).\n\nThe script also accepts the following command-line options:\n\n`-h`, `--help` Displays a short explanation how to use the script and what the command-line options are.\n\n`-v`, `--version` Displays the version of the script.\n\n`-n`, `--norecurse` If a name specified on the command line is a directory, process only the files in this directory; do not process the files in its subdirectories.\n\n`-d`, `--disasmonly` Only the p-code will be disassembled, without the parsed contents of the `dir` stream or the identifiers in the `_VBA_PROJECT` stream.\n\n`-b`, `--verbose` The contents of the `dir` and `_VBA_PROJECT` streams is dumped in hex and ASCII form. In addition, the raw bytes of each compiled into p-code VBA line are also dumped in hex and ASCII.\n\n`-o OUTFILE`, `--output OUTFILE` Save the results to the specified output file, instead of sending it to the standard output.\n\nFor instance, using the script on one of the documents in the [proof of concept](http://bontchev.my.contact.bg/poc2.zip) mentioned above produces the following results:\n\n```shell\npython pcodedmp.py -d Word2013.doc\n\nProcessing file: Word2013.doc\n===============================================================================\nModule streams:\nMacros/VBA/ThisDocument - 1517 bytes\nLine #0:\n FuncDefn (Private Sub Document_Open())\nLine #1:\n LitStr 0x001D \"This could have been a virus!\"\n Ld vbOKOnly\n Ld vbInformation\n Add\n LitStr 0x0006 \"Virus!\"\n ArgsCall MsgBox 0x0003\nLine #2:\n LitStr 0x0008 \"calc.exe\"\n Paren\n ArgsCall Shell 0x0001\nLine #3:\n EndSub\n```\n\nFor reference, it is the result of compiling the following VBA code:\n\n```vba\nPrivate Sub Document_Open()\n MsgBox \"This could have been a virus!\", vbOKOnly + vbInformation, \"Virus!\"\n Shell(\"calc.exe\")\nEnd Sub\n```\n\n## Known problems\n\n- Office 2016 64-bit only: When disassembling variables declared as being of custom type (e.g., `Dim SomeVar As SomeType`), the type (`As SomeType`) is not disassembled.\n\n- Office 2016 64-bit only: The `Private` property of `Sub`, `Function` and `Property` declarations is not disassembled.\n\n- Office 2016 64-bit only: The `Declare` part of external function declarations (e.g., `Private Declare PtrSafe Function SomeFunc Lib \"SomeLib\" Alias \"SomeName\" () As Long`) is not disassembled.\n\n- Office 2000 and higher: The type of a subroutine or function argument of type `ParamArray` is not disassembled correctly. For instance, `Sub Foo (ParamArray arg())` will be disassembled as `Sub Foo (arg)`.\n\n- All versions of Office: The `Alias \"SomeName\"` part of external function declarations (e.g., `Private Declare PtrSafe Function SomeFunc Lib \"SomeLib\" Alias \"SomeName\" () As Long`) is not disassembled.\n\n- All versions of Office: The `Public` property of custom type definitions (e.g., `Public Type SomeType`) is not disassembled.\n\n- All versions of Office: The custom type of a subroutine or function argument is not disassembled correctly and `CustomType` is used instead. For instance, `Sub Foo (arg As Bar)` will be disassembled as `Sub Foo (arg As CustomType)`.\n\n- If the output of the program is sent to a file, instead of to the console (either by using the `-o` option or by redirecting `stdout`), any non-ASCII strings (like module names, texsts used in the macros, etc.) might not be properly encoded.\n\nI do not have access to 64-bit Office 2016 and the few samples of documents, generated by this version of Office, that I have, have been insufficient for me to figure out where the corresponding information resides. I know where it resides in the other versions of Office, but it has been moved elsewhere in 64-bit Office 2016 and the old algorithms no longer work.\n\n## To do\n\n- Implement support of VBA3 (Excel95).\n\n- While the script should support documents created by MacOffice, this has not been tested (and you know how well untested code usually works). This should be tested and any bugs related to it should be fixed.\n\n- I am not an experienced Python programmer and the code is ugly. Somebody more familiar with Python than me should probably rewrite the script and make it look better.\n\n## Change log\n\nVersion 1.2.6:\n\n- Changed it not to require the `win_unicode_console` module when it is not available - e.g., when not running on a Windows machine or when running under the PyPy implementation of Python, thanks to [Philippe Lagadec](https://github.com/decalage2).\n\nVersion 1.2.5:\n\n- Added a sanity check to avoid errors when parsing object declarations\n- The functions that produce output now have the output file (default is `stdout`) as a parameter, for better integration with other tools, thanks to [Philippe Lagadec](https://github.com/decalage2).\n\nVersion 1.2.4:\n\n- Implemented support for module names with non-ASCII characters in their names. Thanks to [Philippe Lagadec](https://github.com/decalage2) for helping me with that.\n- Fixed a parsing error when disassembling object declarations.\n- Removed some unused variables.\n- Improved the documentation a bit.\n\nVersion 1.2.3:\n\n- Fixed a few crashes and documented better some disassembly failures.\n- Converted the script into a package that can be installed with ``pip``. Use the command ``pip install pcodedmp``.\n\nVersion 1.2.2:\n\n- Implemented handling of documents saved in Open XML format (which is the default format of Office 2007 and higher) - `.docm`, `.xlsm`, `.pptm`.\n\nVersion 1.2.1:\n\n- Now runs under Python 3.x too.\n- Improved support of 64-bit Office documents.\n- Implemented support of some VBA7-specific features (`Friend`, `PtrSafe`, `LongPtr`).\n- Improved the disassembling of `Dim` declarations.\n\nVersion 1.2.0:\n\n- Disassembling the various declarations (`New`, `Type`, `Dim`, `ReDim`, `Sub`, `Function`, `Property`).\n\nVersion 1.1.0:\n\n- Storing the opcodes in a more efficient manner.\n- Implemented VBA7 support.\n- Implemented support for documents created by the 64-bit version of Office.\n\nVersion 1.0.0:\n\n- Initial version.\n\n\n",
"bugtrack_url": null,
"license": "GPL",
"summary": "A VBA p-code disassembler",
"version": "1.2.6",
"project_urls": {
"Homepage": "https://github.com/bontchev/pcodedmp"
},
"split_keywords": [
"vba",
"p-code",
"disassembler"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "ba72b380fb5c89d89c3afafac8cf02a71a45f4f4a4f35531ca949a34683962d1",
"md5": "8cceca2520b7b789b49fe3b7dd06ce04",
"sha256": "4441f7c0ab4cbda27bd4668db3b14f36261d86e5059ce06c0828602cbe1c4278"
},
"downloads": -1,
"filename": "pcodedmp-1.2.6-py2.py3-none-any.whl",
"has_sig": false,
"md5_digest": "8cceca2520b7b789b49fe3b7dd06ce04",
"packagetype": "bdist_wheel",
"python_version": "py2.py3",
"requires_python": null,
"size": 30939,
"upload_time": "2019-07-30T18:05:40",
"upload_time_iso_8601": "2019-07-30T18:05:40.483419Z",
"url": "https://files.pythonhosted.org/packages/ba/72/b380fb5c89d89c3afafac8cf02a71a45f4f4a4f35531ca949a34683962d1/pcodedmp-1.2.6-py2.py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "3d206d461e29135f474408d0d7f95b2456a9ba245560768ee51b788af10f7429",
"md5": "9b9b4e85203a6dd19757793bf2d87af4",
"sha256": "025f8c809a126f45a082ffa820893e6a8d990d9d7ddb68694b5a9f0a6dbcd955"
},
"downloads": -1,
"filename": "pcodedmp-1.2.6.tar.gz",
"has_sig": false,
"md5_digest": "9b9b4e85203a6dd19757793bf2d87af4",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 35549,
"upload_time": "2019-07-30T18:05:42",
"upload_time_iso_8601": "2019-07-30T18:05:42.516848Z",
"url": "https://files.pythonhosted.org/packages/3d/20/6d461e29135f474408d0d7f95b2456a9ba245560768ee51b788af10f7429/pcodedmp-1.2.6.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2019-07-30 18:05:42",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "bontchev",
"github_project": "pcodedmp",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "pcodedmp"
}
JSON
