Skip to content

OECDRegionalDemography_Population| Fixed missing data issue #2152

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Ashwani725 wants to merge 11 commits into
base: master
Choose a base branch
from
Open

OECDRegionalDemography_Population| Fixed missing data issue #2152

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
b2f15e1
fixed missing data issue
Aug 10, 2026
00f7c28
new stat vars added
Aug 11, 2026
0c2ad15
Delete goldens
Ashwani725 Aug 24, 2026
ac37f85
Delete goldens
Ashwani725 Aug 24, 2026
6f2c032
Goldens removed
Ashwani725 Aug 24, 2026
696ac32
Adding additional checks as per CRA
Aug 27, 2026
0a9d2e0
Merge branch 'master' into OECDRegionalDemography_Population_missing_…
Ashwani725 Aug 27, 2026
74ed760
Fix JSON syntax in validation_config.json
Ashwani725 Aug 28, 2026
cb0e95f
Remove check_max_date_consistent validation rule
Ashwani725 Aug 28, 2026
3143e78
reduced the test data size
Ashwani725 Aug 31, 2026
0281420
Merge branch 'master' into OECDRegionalDemography_Population_missing_…
Ashwani725 Aug 31, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 46 additions & 0 deletions scripts/oecd/regional_demography/population/OECD_population_stat_vars.mcf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -477,3 +477,49 @@ age: [Years 65 -]
gender: schema:Male
measuredProperty: dcs:count
statType: dcs:measuredValue

Node: dcid:Count_Person_20To64Years
typeOf: dcs:StatisticalVariable
populationType: schema:Person
age: [Years 20 64]
measuredProperty: dcs:count
statType: dcs:measuredValue

Node: dcid:Count_Person_20To64Years_Female
typeOf: dcs:StatisticalVariable
populationType: schema:Person
age: [Years 20 64]
gender: schema:Female
measuredProperty: dcs:count
statType: dcs:measuredValue

Node: dcid:Count_Person_20To64Years_Male
typeOf: dcs:StatisticalVariable
populationType: schema:Person
age: [Years 20 64]
gender: schema:Male
measuredProperty: dcs:count
statType: dcs:measuredValue

Node: dcid:Count_Person_25To54Years
typeOf: dcs:StatisticalVariable
populationType: schema:Person
age: [Years 25 54]
measuredProperty: dcs:count
statType: dcs:measuredValue

Node: dcid:Count_Person_25To54Years_Female
typeOf: dcs:StatisticalVariable
populationType: schema:Person
age: [Years 25 54]
gender: schema:Female
measuredProperty: dcs:count
statType: dcs:measuredValue

Node: dcid:Count_Person_25To54Years_Male
typeOf: dcs:StatisticalVariable
populationType: schema:Person
age: [Years 25 54]
gender: schema:Male
measuredProperty: dcs:count
statType: dcs:measuredValue
37 changes: 25 additions & 12 deletions scripts/oecd/regional_demography/population/columns.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,9 @@
'Y_LT15_T': 'Count_Person_Upto14Years',
'Y15T64_T': 'Count_Person_15To64Years',
'Y_GE65_T': 'Count_Person_65OrMoreYears',
'Y20T64_T': 'Count_Person_20To64Years',
'Y25T54_T': 'Count_Person_25To54Years',
'Y55T64_T': 'Count_Person_55To64Years',
Comment thread
Ashwani725 marked this conversation as resolved.
'_TM': 'Count_Person_Male',
'Y_LT5M': 'Count_Person_Upto4Years_Male',
'Y5T9M': 'Count_Person_5To9Years_Male',
Expand All @@ -41,6 +44,9 @@
'Y_LT15M': 'Count_Person_Upto14Years_Male',
'Y15T64M': 'Count_Person_15To64Years_Male',
'Y_GE65M': 'Count_Person_65OrMoreYears_Male',
'Y20T64M': 'Count_Person_20To64Years_Male',
'Y25T54M': 'Count_Person_25To54Years_Male',
'Y55T64M': 'Count_Person_55To64Years_Male',
'_TF': 'Count_Person_Female',
'Y_LT5F': 'Count_Person_Upto4Years_Female',
'Y5T9F': 'Count_Person_5To9Years_Female',
Expand All @@ -62,6 +68,9 @@
'Y_LT15F': 'Count_Person_Upto14Years_Female',
'Y15T64F': 'Count_Person_15To64Years_Female',
'Y_GE65F': 'Count_Person_65OrMoreYears_Female',
'Y20T64F': 'Count_Person_20To64Years_Female',
'Y25T54F': 'Count_Person_25To54Years_Female',
'Y55T64F': 'Count_Person_55To64Years_Female',
}

reindex_column = population_columns = [
Expand All @@ -75,7 +84,8 @@
'Count_Person_65To69Years', 'Count_Person_70To74Years',
'Count_Person_75To79Years', 'Count_Person_80OrMoreYears',
'Count_Person_Upto14Years', 'Count_Person_15To64Years',
'Count_Person_65OrMoreYears', 'Count_Person_Male',
'Count_Person_65OrMoreYears', 'Count_Person_20To64Years',
'Count_Person_25To54Years', 'Count_Person_55To64Years', 'Count_Person_Male',
'Count_Person_Upto4Years_Male', 'Count_Person_5To9Years_Male',
'Count_Person_10To14Years_Male', 'Count_Person_15To19Years_Male',
'Count_Person_20To24Years_Male', 'Count_Person_25To29Years_Male',
Expand All @@ -86,15 +96,18 @@
'Count_Person_70To74Years_Male', 'Count_Person_75To79Years_Male',
'Count_Person_80OrMoreYears_Male', 'Count_Person_Upto14Years_Male',
'Count_Person_15To64Years_Male', 'Count_Person_65OrMoreYears_Male',
'Count_Person_Female', 'Count_Person_Upto4Years_Female',
'Count_Person_5To9Years_Female', 'Count_Person_10To14Years_Female',
'Count_Person_15To19Years_Female', 'Count_Person_20To24Years_Female',
'Count_Person_25To29Years_Female', 'Count_Person_30To34Years_Female',
'Count_Person_35To39Years_Female', 'Count_Person_40To44Years_Female',
'Count_Person_45To49Years_Female', 'Count_Person_50To54Years_Female',
'Count_Person_55To59Years_Female', 'Count_Person_60To64Years_Female',
'Count_Person_65To69Years_Female', 'Count_Person_70To74Years_Female',
'Count_Person_75To79Years_Female', 'Count_Person_80OrMoreYears_Female',
'Count_Person_Upto14Years_Female', 'Count_Person_15To64Years_Female',
'Count_Person_65OrMoreYears_Female'
'Count_Person_20To64Years_Male', 'Count_Person_25To54Years_Male',
'Count_Person_55To64Years_Male', 'Count_Person_Female',
'Count_Person_Upto4Years_Female', 'Count_Person_5To9Years_Female',
'Count_Person_10To14Years_Female', 'Count_Person_15To19Years_Female',
'Count_Person_20To24Years_Female', 'Count_Person_25To29Years_Female',
'Count_Person_30To34Years_Female', 'Count_Person_35To39Years_Female',
'Count_Person_40To44Years_Female', 'Count_Person_45To49Years_Female',
'Count_Person_50To54Years_Female', 'Count_Person_55To59Years_Female',
'Count_Person_60To64Years_Female', 'Count_Person_65To69Years_Female',
'Count_Person_70To74Years_Female', 'Count_Person_75To79Years_Female',
'Count_Person_80OrMoreYears_Female', 'Count_Person_Upto14Years_Female',
'Count_Person_15To64Years_Female', 'Count_Person_65OrMoreYears_Female',
'Count_Person_20To64Years_Female', 'Count_Person_25To54Years_Female',
'Count_Person_55To64Years_Female'
]
6 changes: 4 additions & 2 deletions scripts/oecd/regional_demography/population/manifest.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,13 +13,15 @@
"import_inputs": [
{
"template_mcf": "OECD_population_cleaned.tmcf",
"cleaned_csv": "OECD_population_cleaned.csv"
"cleaned_csv": "OECD_population_cleaned.csv",
"node_mcf": "OECD_population_stat_vars.mcf"
}
],
"source_files": [
"REGION_DEMOGR_population.csv"
],
"cron_schedule": "0 10 1,15 * *"
"cron_schedule": "0 10 1,15 * *",
"validation_config_file": "validation_config.json"
}
]
}
Loading