feat: add launchdarkly-flag-drift skill#119
Open
nieblara wants to merge 2 commits into
Open
Conversation
Detect and reconcile drift between a feature flag's in-code SDK fallback default and its LaunchDarkly default rule (fallthrough), updating only the default argument without removing the flag or changing its evaluation. Co-authored-by: Cursor <cursoragent@cursor.com>
3 tasks
Skill eval results
Only suites whose source actually changed since their last recorded score were re-run. Soft-failing while we stabilise the baseline. |
Add a promptfoo suite covering drift reconciliation, the no-drift (no code change, no PR) case, and a registry-declared default, asserting the agent resolves the fallthrough via get-flag and never mutates the flag. Register the suite in the manifest and add npm scripts. Co-authored-by: Cursor <cursoragent@cursor.com>
ldhenry
requested changes
Jul 22, 2026
ldhenry
left a comment
There was a problem hiding this comment.
This is cool Though do we need the skill to check the default variation across all critical environments in LD? What happens if those are different (e.g. EU differs from Federal)?
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a new LaunchDarkly agent skill,
launchdarkly-flag-drift, underskills/feature-flags/, following the repo's SKILL.md + README.md + references convention. Updates the repoREADME.mdskill table and regeneratesskills.json.The skill detects and reconciles drift between a feature flag's in-code SDK fallback default and its LaunchDarkly default rule (fallthrough):
get-flagreferences/sdk-default-patterns.md)references/pr-template.mdIsolated PR containing only this skill (branched from
main).Validation
python3 scripts/validate_skills.pypassespython3 scripts/generate_catalog.py --checkreportsskills.jsonup to datepython3 -m unittest tests.test_validate_skillspassesTest plan
skills/feature-flags/launchdarkly-flag-drift/drift_detected: falseand opens no PRMade with Cursor