What is Depth-First Search (DFS)?

What is Depth-First Search? What problems does it solve, and how do we use it?