Existing Building Tolerance Issues

We’re currently renovating an existing building, we’re finding that the columns are up and down alot throughout the floor. My superintendent and I aren’t sure if we should set everything off of a benchmark or follow the floor / beams.

Any feedback on this type of problem would be appreciated!