Skip to content

Evaluation experiment runs #54

Description

@sahil-sagwekar2652

What happened?

The agents-cli eval submit command does not create experiments on the agent platform. Is this supposed to happen?

Steps to Reproduce

  1. Deploy the agent to agent_runtime - agents-cli deploy
  2. Run agents-cli eval generate
  3. and the agents-cli eval submit
  4. Go to the Evaluations inside the agent deployment on GCP console.

What did you expect to happen?

Eval runs to be listed as experiments in the GCP console.

Client information

Client Information

Run agents-cli info to output debugging information about your client.

Command Output / Logs

No response

Anything else we need to know?

No response

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions