Replicate!

Use replicate (and any other LMTP models) for QA.

Add replicate deployments

Adding the ability to use replicate deployments for LLM calls

First release

Can get inline probabilities using a decorator for single token outputs limited in a where clause. Only tested for gpt-3.5-turbo-instruct. There, it only works for 5 logprobs.