Which robert Frost poem had this line ever take a fence down until you know why it was put up?

The line "Before I built a wall I'd ask to know / What I was walling in or walling out, / And to whom I was like to give offense. / Something there is that doesn't love a wall, / That wants it down." is from the poem "Mending Wall" by Robert Frost.