Together AI Client

[marklysze]

This is a Together AI Client that provides a way to use the Together AI cloud inference service, which provides options to use many LLMs, such as Google's Gemma, Meta's Llama 2/3, Qwen, Mistral.AI's Mistral, and Mixtral, NousResearch's Hermes models.

This client supports text generation and function/tool calling (when using certain models as noted by Together AI).

Token costs are also implemented.

Will be used in the upcoming blog post #2965.

Related issue number

Can be used for #2916.

Checks

• I've included any doc changes needed for https://microsoft.github.io/autogen/. See https://microsoft.github.io/autogen/docs/Contribute#documentation to build and test documentation locally.
• I've added tests (if relevant) corresponding to the changes introduced in this PR.
• I've made sure all auto checks have passed.

[marklysze]

Converting from draft, utilising the updated client_utils, now. I think this is ready for review.

[Hk669]

we can retire this notebook https://microsoft.github.io/autogen/docs/topics/non-openai-models/cloud-togetherai/

[marklysze]

we can retire this notebook https://microsoft.github.io/autogen/docs/topics/non-openai-models/cloud-togetherai/

Yes, I think you're right. I'll go through and tidy up references to it.

Can someone provide guidance on what we do if we remove a document page, e.g. External links may break

[Hk669]

we can retire this notebook https://microsoft.github.io/autogen/docs/topics/non-openai-models/cloud-togetherai/

Yes, I think you're right. I'll go through and tidy up references to it.

Can someone provide guidance on what we do if we remove a document page, e.g. External links may break

@qingyun-wu @sonichi @yiranwu0

[marklysze]

Thanks @yiranwu0 for working through the code. I've updated most items, just a couple of conversations to discuss and resolve.

[marklysze]

@Hk669, I'll wait for feedback on removing the old notebook. I'm thinking perhaps we could just replace the old notebook for this and Mistral with the new ones. What do you think?

[Hk669]

@Hk669, I'll wait for feedback on removing the old notebook. I'm thinking perhaps we could just replace the old notebook for this and Mistral with the new ones. What do you think?

Yeah sounds good.

[marklysze]

@Hk669, I'll wait for feedback on removing the old notebook. I'm thinking perhaps we could just replace the old notebook for this and Mistral with the new ones. What do you think?

Yeah sounds good.

All done :)... same in both Mistral and Together PRs

[qingyun-wu]

Looks great! Thanks @marklysze!

[Hk669]

I'm waiting for a few clarifications on the comments made by yiran. Otherwise it looks good to me.

cc @marklysze @qingyun-wu

[yiranwu0]

LGTM!

[marklysze]

LGTM!

Thanks for all your help!!

[yiranwu0]

Resolve the conflict and we are good to go!

[Hk669]

lgtm. Thanks @marklysze