Add facilities dataset and proximity builder Scripts#1087
Open
amit-spatial wants to merge 7 commits into
Open
Conversation
Shared helpers keep path resolution, schema constants, CSV/GPKG writing, taxonomy handling, and QA metadata consistent across the facilities build scripts.
The cleaner module contains the source-specific and generic raw-file transformations needed to standardize raw facility files before building pan_india_facilities.gpkg.
This CLI orchestrates raw cleaning, pan-India facility asset creation, proximity rebuilds, and monitoring commands from tracked YAML config instead of one-off local scripts.
This script builds cs_village_facility_proximity.gpkg from cs_admin_standard and pan_india_facilities.gpkg, storing actual village polygons and materialized proximity tables for downstream API and GEE use.
This YAML is the tracked source of truth for raw facility source definitions, output schema, taxonomy, and proximity settings. It is required to reproduce pan_india_facilities.gpkg and cs_village_facility_proximity.gpkg.
The template documents the config block required to add new raw facility datasets safely without editing pipeline code.
The README explains how to run the facilities build and proximity steps, what outputs are expected, and how to add new sources without tracking raw files or generated outputs.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adding facilities raw-source cleaning/build pipeline, source template, master config, and CS village proximity builder scripts.
All these scripts were used for creating facilities datasets, and are independent of django setup. We need to keep tracking these, as now they can be used to simply plugin any new facility type (suppose in future we want to add Data Centers dataset) using yaml config.
I've also added its documentation in README file, which we can use anywhere as its documentation, and be used to learn how to reuse it.