[Epic] Replace `OffsetBufferBuilder` / `BufferBuilder` usage with `Vec`, when possible

[alamb]

Is your feature request related to a problem or challenge?

As @Jefffrey has observed in #10229 (comment), switching from OffsetBufferBuilder / BufferBuilder to use Vec<..> often results in a non trivial speedup.

This is likely because the Rust language has a highly optimized Vec implementation

Describe the solution you'd like

Basically try and change any code like this

    let mut values = BufferBuilder::<T::Native>::new(len);

To use

let mut values = Vec<T::Native>::with_capacity(len);

And various equivalent

Note to contributors:

please make targeted PRs (that change one or two usages each) to keep the PRs easy to review and thus fast to merge

Describe alternatives you've considered

No response

Additional context

No response

[comphead]

Thanks @alamb adding apache/datafusion#23195 as the reference where Vec replaces OffsetBufferBuilder