that's essentially what my friends dad did

bought an old run down house on 1/2 acre. tore everything down except the chimney. after the inspector came he tore that down too. the advantage is that the new house gets taxed on improvements only and not the whole property value (land + improvements).