Skip to content

Added support runbook#2100

Open
pulkeet-wq wants to merge 10 commits into
datacommonsorg:masterfrom
pulkeet-wq:master
Open

Added support runbook#2100
pulkeet-wq wants to merge 10 commits into
datacommonsorg:masterfrom
pulkeet-wq:master

Conversation

@pulkeet-wq

Copy link
Copy Markdown
Contributor

Added support run book to enable auto debugging of failures via LLM tools. Currently this runbook talks about following scenarios:

  1. Handling data source side issues
  2. Handling Minot deletions at Data source
  3. Handling major deletions at Data source
  4. Adding golden checks in the import
  5. RCA runbook

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adds a comprehensive troubleshooting guide and runbook for DataCommons production support, detailing procedures for handling source-side data changes, deletions, golden checks, and root cause analysis. The review feedback identifies several areas for improvement in the document, including consolidating redundant headers and sections, fixing broken list formatting and empty headers, correcting copy-paste errors in URLs and import names, and updating the dashboard branding from Looker Studio to Data Studio per project guidelines.

Comment thread troubleshooting_guide/DC_runbook.md Outdated
Comment thread troubleshooting_guide/DC_runbook.md Outdated
Comment thread troubleshooting_guide/DC_runbook.md Outdated
Comment thread troubleshooting_guide/DC_runbook.md Outdated
* **validation\_output.csv:** This tells you the exact reason the checks failed. In my case, 3 checks passed, but the check\_deleted\_records\_percent failed because 3,908 records were deleted. (See table below)
* Link to my file: [validation\_output.csv](https://storage.mtls.cloud.google.com/datcom-prod-imports/scripts/world_bank/wdi/WorldDevelopmentIndicators/2026_06_09T04_07_31_200635_07_00/input0/validation/validation_output.csv?authuser=0)
* **Nodes\_deleted.mcf:** This file shows you the actual list of records that were deleted.
* Link to my file:[nodes\_deleted.mcf](https://storage.mtls.cloud.google.com/datcom-prod-imports/scripts/world_bank/wdi/WorldDevelopmentIndicators/2026_06_09T04_07_31_200635_07_00/input0/validation/obs_diff_log.csv?authuser=0)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The link text is nodes_deleted.mcf but the URL points to obs_diff_log.csv. Please correct the URL to point to the correct file.

Suggested change
* Link to my file:[nodes\_deleted.mcf](https://storage.mtls.cloud.google.com/datcom-prod-imports/scripts/world_bank/wdi/WorldDevelopmentIndicators/2026_06_09T04_07_31_200635_07_00/input0/validation/obs_diff_log.csv?authuser=0)
* Link to my file:[nodes\_deleted.mcf](https://storage.mtls.cloud.google.com/datcom-prod-imports/scripts/world_bank/wdi/WorldDevelopmentIndicators/2026_06_09T04_07_31_200635_07_00/input0/validation/nodes_deleted.mcf?authuser=0)

Comment thread troubleshooting_guide/DC_runbook.md Outdated
Comment on lines +595 to +598
##

##

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

There are empty headers (## ) here that should be removed to keep the document clean.

Comment thread troubleshooting_guide/DC_runbook.md Outdated
Comment thread troubleshooting_guide/DC_runbook.md

This section highlights the steps that can be taken to perform RCA for the failed production pipelines.

Step 1: Go to the looker [dashboard](https://lookerstudio.google.com/c/reporting/e88fda74-50c9-46c6-88aa-c84342ceba48/page/eaXdF) and get the latest status of all the pipelines from the dashboard. The probable different states of each pipelines could be as below:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

According to the project guidelines, please refer to 'Data Studio' and use 'datastudio.google.com' instead of 'Looker Studio' and 'lookerstudio.google.com'.

Suggested change
Step 1: Go to the looker [dashboard](https://lookerstudio.google.com/c/reporting/e88fda74-50c9-46c6-88aa-c84342ceba48/page/eaXdF) and get the latest status of all the pipelines from the dashboard. The probable different states of each pipelines could be as below:
Step 1: Go to the Data Studio [dashboard](https://datastudio.google.com/c/reporting/e88fda74-50c9-46c6-88aa-c84342ceba48/page/eaXdF) and get the latest status of all the pipelines from the dashboard. The probable different states of each pipelines could be as below:
References
  1. Use 'Data Studio' and 'datastudio.google.com' instead of 'Looker Studio' and 'lookerstudio.google.com' when referring to the dashboard branding.

pulkeet-wq and others added 9 commits July 17, 2026 09:50
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

@pulkeet-wq pulkeet-wq left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Resolved major AI comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant