Dolley Madison served as First Lady during the presidency of James Madison, the 4th President. James Madison served from 1809 to 1817 as a member of the Democratic-Republican Party.