Merge branch 'Dan_DevGuide-updates'

Conflicts:
	Ghidra/Features/PDB/src/global/docs/README_PDB.html

DevGuide.md

@@ -1,33 +1,52 @@
-# Developer's Guide 
+# Developer's Guide
 
 ## Catalog of Dependencies
 
 The following is a list of dependencies, in no particular order.
-This guide includes instructions for obtaining each of these at the relevant step(s).
+This guide includes instructions for obtaining many of these at the relevant step(s).
 You may not need all of these, depending on which portions you are building or developing.
 
 * JDK 11 - We test and build using OpenJDK 11.0.2.
+    - https://jdk.java.net/11/
 * Eclipse - It must support JDK 11. Eclipse 2018-12 or later should work. Other IDEs may work, but we have not tested them.
+    - https://www.eclipse.org/downloads/
 * Gradle 5.0 - Later versions may work, but you'll need to modify our version check.
-* A C/C++ compiler - We use Visual Studio 2017 on Windows, GCC on Linux, and Xcode (Clang) on macOS.
+    - https://gradle.org/next-steps/?version=5.0&format=bin
-* Git - We use git-bash on Windows. Most Linux distros have git in their repos. Xcode provides git on macOS.
+* A C/C++ compiler - We use GCC on Linux, Xcode (Clang) on macOS, and Visual Studio 2017 on Windows, .
+    - https://gcc.gnu.org/
+    - https://developer.apple.com/xcode/
+    - https://visualstudio.microsoft.com/downloads/
+* Git - We use the official installer on Windows. Most Linux distros have git in their repos. Xcode provides git on macOS.
+    - https://git-scm.com/downloads
 * Bash - This is moot on Linux and macOS. On Windows, we use MinGW. This may be distributed with Git for Windows.
-* Bison and Flex - We use MinGW on Windows. Most Linux distros have these in their reposs. Xcode provides these for macOS.
+    - https://osdn.net/projects/mingw/releases/
-* dex2jar
+* Bison and Flex - We use win-flex-bison v2.5.17. These packages may also be available in MSYS (MinGW). Most Linux distros have these in their repos. Xcode provides these for macOS.
+    - https://sourceforge.net/projects/winflexbison/
+* dex2jar. We use version 2.0.
+    - https://github.com/pxb1988/dex2jar/releases
 * AXMLPrinter2
-* HFS Explorer 0.21
+    - https://code.google.com/archive/p/android4me/downloads
-* Yet Another Java Service Wrapper 12.12 - Only to build Ghidra package.
+* HFS Explorer. We use version 0.21.
-* Eclipse PDE - Only for the GhidraDev plugin.
+    - https://sourceforge.net/projects/catacombae/files/HFSExplorer/0.21/
-* Eclipse CDT 8.6.0 - Only for the GhidraDev plugin
+    - https://github.com/unsound/hfsexplorer/releases (newer versions)
-* PyDev 6.3.1 - Only for the GhidraDev plugin
+* Yet Another Java Service Wrapper. We use version 12.12 - Only to build Ghidra package.
+    - https://sourceforge.net/projects/yajsw/files/yajsw/yajsw-stable-12.12/
+* Eclipse PDE - Environment for developing the GhidraDev plugin.
+    - https://www.eclipse.org/pde/
+* Eclipse CDT. We use version 8.6.0 - Build dependency for the GhidraDev plugin.
+    - https://www.eclipse.org/cdt/
+* PyDev. We use version 6.3.1 - Build dependency for the GhidraDev plugin.
+    - https://sourceforge.net/projects/pydev/files/pydev/
 
-There are many others automatically downloaded by Gradle from Maven Central and Bintray JCenter when building and/or setting up the development environment.
+There are many, many others automatically downloaded by Gradle from Maven Central and Bintray JCenter when building and/or setting up the development environment.
+If you need these offline, a reasonable course of action is to set up a development environment online, perhaps perform a build, and then scrape Gradle's cache.
 
 ## Install Development and Build Tools
 
-If you're on Windows, install Git.
+If you're on Windows, install Git, MinGW, Bison, and Flex.
-You may also need to install MinGW.
+Many of the commands given below must be executed in Bash (Use git-bash or MSYS from MinGW).
-Many of the commands given below must be executed in Bash.
+**IMPORTANT**: The bison and flex executables may be named `win-bison.exe` and `win-flex.exe`.
+Our build cannot currently cope with that, so you should rename them to `bison.exe` and `flex.exe`.
 
 Install OpenJDK 11 and make sure it's the default java.
 
@@ -160,72 +179,28 @@ Some of Ghidra's components are built for the native platform.
 We currently support Linux, macOS, and Windows 64-bit x86 systems.
 Others should be possible, but we do not test on them.
 
-#### decompile
+Ensure bison and flex are installed and in your `PATH`.
-
-Install bison and flex.
 Now build using Gradle:
 
 On Linux:
 
 ```bash
-gradle decompileLinux64Executable
+gradle buildNatives_linux64
 ```
+
 On macOS:
 
 ```bash
-gradle decompileOsx64Executable
+gradle buildNatives_osx64
 ```
 
-On Windows:
-
-```cmd
-gradle decompileWin64Executable
-```
-
-#### demangler_gnu
-
-Build using Gradle:
-
-On Linux:
-
-```bash
-gradle demangler_gnuLinux64Executable
-```
 On macOS:
 
 ```bash
-gradle demangler_gnuOsx64Executable
+gradle buildNatives_win64
 ```
 
-On Windows:
+This will build the decompiler, the demangler for GNU toolchains, the sleigh compiler, and (on Windows only) the PDB parser.
-
-```cmd
-gradle demangler_gnuWin64Executable
-```
-
-#### sleigh
-
-The sleigh compiler has been ported to Java and integrated with Ghidra.
-The native sleigh compiler may still be useful for those who'd like quicker feedback by compiling from the command line.
-To build the native sleigh compiler, install bison and flex.
-Now, use Gradle:
-
-On Linux:
-
-```bash
-gradle sleighLinux64Executable
-```
-On macOS:
-
-```bash
-gradle sleighOsx64Executable
-```
-
-On Windows:
-
-```cmd
-gradle sleighWin64Executable
-```
 
 ## Run Ghidra from Eclipse
 
@@ -285,14 +260,31 @@ Some features of Ghidra require the curation of rather extensive data bases.
 These include the Data Type Archives and Function ID Databases, both of which require collecting header files and libraries for the relevant SDKs and platforms.
 Much of this work is done by hand.
 Until this process is documented, those artifacts can be extracted from an official distribution and combined with your build output.
+The archives included in our official builds can be found in the [ghidra-data] repository.
 
 ## Building Data Type Archives
 
-TODO
+This task is often done manually from the Ghidra GUI, and the archives included in our official build require a fair bit of fine tuning.
+From a CodeBrowser window, select File -> Parse C Source.
+From here you can create and configure parsing profiles, which lists headers and pre-processor options.
+Then, click "Parse to File" to create the Data Type Archive.
+The result can be added to an installation or source tree by copying it to `Ghidra/Features/Base/data/typeinfo`.
 
 ## Building FID Databases
 
-TODO
+This task is often done manually from the Ghidra GUI, and the archives included in our official build require a fair bit of fine tuning.
+You will first need to import the relevant libraries from which you'd like to produce a FID database.
+This is often a set of libraries from an SDK.
+We include a variety of Visual Studio platforms in the official build.
+
+From a CodeBrowser window, select File -> Configure.
+Enabled the "Function ID" plugins, and close the dialog.
+Now, from the CodeBrowser window, select Tools -> Function ID -> Create new empty FidDb.
+Choose a destination file.
+Now, select Tools -> Function ID -> Populate FidDb from programs.
+Fill out the options appropriately and click OK.
+
+If you'd like some details of our fine tuning, take a look at `Ghidra/Features/FunctionID/building_fid.txt`.
 
 # Developing / Building the GhidraDev Plugin
 
@@ -341,3 +333,5 @@ gradle cdtUnpack pyDevUnpack
 
 If you're using BuildShip, simply refresh the Gradle project in Eclipse.
 If you're not using BuildShip, re-run `gradle eclipse` and import the new project.
+
+[ghidra-data]: https://github.com/NationalSecurityAgency/ghidra-data