Context for transfer calls

Hi there, 

When I use the transfer call function, I'm having trouble getting the context to who the person my AI agent was speaking to.

Having their phone number would be nice. At the moment, when I transfer a call, the caller ID is the twilio number rather than theirs.

Any ideas?