Skip to content

bug: Topical Rails making lot of embedding's calls, can we do it in a single call? #1127

Open
@abhishekpandey3

Description

@abhishekpandey3

Did you check docs and existing issues?

  • I have read all the NeMo-Guardrails docs
  • I have updated the package to the latest version before submitting this issue
  • (optional) I have used the develop branch
  • I have searched the existing issues of NeMo-Guardrails

Python version (python --version)

Python 3.11.9

Operating system/version

Windows 11

NeMo-Guardrails version (if you must use a specific version and not the latest

0.12.0

Describe the bug

Foe Execution of Topical Rails , lot of embedding calls are bieng made, which is taking around 25 seconds for 8 topics configured on disallowed_topics.co,

Can it be optimized so that it makes only 1 embedding call.

Steps To Reproduce

Foe Execution of Topical Rails , lot of embedding calls are bieng made, which is taking around 25 seconds for 8 topics configured on disallowed_topics.co,

Can it get optimized so that it makes only 1 embedding call.

Expected Behavior

Can it get optimized so that it makes only 1 embedding call.

Actual Behavior

Foe Execution of Topical Rails , lot of embedding calls are bieng made, which is taking around 25 seconds for 8 topics configured on disallowed_topics.co,

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingstatus: needs triageNew issues that have not yet been reviewed or categorized.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions