7 Commits

Author SHA1 Message Date
Abhitej John 19b885551e Revert Vally CLI 0.16 upgrade
Restore Vally CLI 0.14.0 because 0.16.0 rejects legacy config, executionShard metadata, and tool constraints used by most repository evals.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
2026-09-16 16:30:19 -07:00
dependabot[bot] d8ebaed63a Bump @microsoft/vally-cli from 0.14.0 to 0.16.0 in /eng/evaluation-tools
Bumps @microsoft/vally-cli from 0.14.0 to 0.16.0.

---
updated-dependencies:
- dependency-name: "@microsoft/vally-cli"
  dependency-version: 0.16.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-09-16 05:44:10 +00:00
Abhitej John 65e48c9b3f Pin Vally CLI to 0.14.0
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
2026-09-09 10:11:02 -07:00
dependabot[bot] af059f7469 Bump @microsoft/vally-cli from 0.14.0 to 0.15.0 in /eng/evaluation-tools
Bumps @microsoft/vally-cli from 0.14.0 to 0.15.0.

---
updated-dependencies:
- dependency-name: "@microsoft/vally-cli"
  dependency-version: 0.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-09-09 05:45:24 +00:00
dependabot[bot] 3774d08eb3 Bump @microsoft/vally-cli from 0.13.0 to 0.14.0 in /eng/evaluation-tools
Bumps @microsoft/vally-cli from 0.13.0 to 0.14.0.

---
updated-dependencies:
- dependency-name: "@microsoft/vally-cli"
  dependency-version: 0.14.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-08-26 05:44:37 +00:00
dependabot[bot] e156bb30c9 Bump @microsoft/vally-cli from 0.9.0 to 0.13.0 in /eng/evaluation-tools
Bumps @microsoft/vally-cli from 0.9.0 to 0.13.0.

---
updated-dependencies:
- dependency-name: "@microsoft/vally-cli"
  dependency-version: 0.13.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-08-17 19:47:21 +00:00
Jan Krivanek ca093a06ef Automate Vally dependency updates (#1010)
* Automate Vally dependency updates

Move the evaluation CLI pins into a trusted npm manifest and configure weekly Dependabot updates for Vally.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: d4443741-2ca2-47b3-a2db-0f91e937dbf9

* Smoke test evaluation tool updates

Run a secretless install and CLI smoke test whenever the evaluation tool manifest changes.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: d4443741-2ca2-47b3-a2db-0f91e937dbf9

* Generate evaluation tools lockfile in CI

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 8779074c-8123-4bfc-98ff-6a9c2da72cf0

* Make evaluation tool installs reproducible

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>

Copilot-Session: 8779074c-8123-4bfc-98ff-6a9c2da72cf0

---------

Copilot-Session: d4443741-2ca2-47b3-a2db-0f91e937dbf9
Copilot-Session: 8779074c-8123-4bfc-98ff-6a9c2da72cf0
2026-08-17 21:46:24 +02:00