Skip to content

[RNE Rewrite] Add LLM chat pipeline implementation #1245

Description

@barhanc

Implement LLM chat pipeline using the new approach to achieve parity with current implementation. It should support:

  • text-only LLMs,
  • multimodal LLMs,
  • tool calling,
  • structured output.

For models like Gemma which require custom runners there should be a separate runner implementation. Also see: #429, #1226, #1225, #1220.

For PoC implementation and discussion see: barhanc/rnet-poc#3.

Metadata

Metadata

Assignees

Labels

improvementPRs or issues focused on improvements in the current codebaserefactoring

Type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions