For sanitizing, replace rather than remove

[jon-freed]

When sanitizing, consider replacing rather than removing. Replace with distinct tokens that can then be referenced in downstream analysis and extraction work. For example, replace all instructor names with "INSTRUCTORNAME" (or something similar).

[grahamsack]

Good suggestion. Done.

On Jun 13, 2014, at 5:04 PM, Jon Freed notifications@github.com wrote:

When sanitizing, consider replacing rather than removing. Replace with distinct tokens that can then be referenced in downstream analysis and extraction work. For example, replace all instructor names with "INSTRUCTORNAME" (or something similar).

—
Reply to this email directly or view it on GitHub.