This has made me wonder: a tablet app that took a codebase and let you sketch notes and reference anchors to other files in a transparent canvas layered over the code (a stylus would be required, though).

Something like mindmapping over a code printout that could be exported back to your IDE or text editor via a plugin, maybe.