Monday, March 15, 2021

More Data Now Discoverable Through Geodisy

February 10, 2021

Geodisy now includes a much larger collection of data for map-based search and discovery! Geodisy, an open-source geospatial discovery platform for Canadian open research data, previously harvested data exclusively from Scholars Portal Dataverse. 


With this update, Geodisy now pulls directly from the Federated Research Data Repository (FRDR)’s harvested metadata collection, which includes content from over 70 Canadian research data repositories. In addition to indexing datasets from Dataverse repositories with either geospatial metadata or geospatial files, Geodisy now also includes datasets with bounding box metadata from all repositories harvested by FRDR. The team continues to work toward processing geospatial files and place name metadata from additional repository platforms.


For more information please contact support@frdr-dfdr.ca.

SHS 2017 Bootstrap Weights

February 12, 2021


Question

I have a prof using the 2017 SHS. They have a question about the bootstrap weights :


"I have a question you might be able to answer about these bootstrap weights. In order to use them in Stata, I need to know whether they were produced using the 'mean bootstrap' method and if so, I would need to specify how many samples were used to produce each weight in order to adjust the variance estimates to account for mean bootstrap weights (see for example https://www150.statcan.gc.ca/n1/pub/12-002-x/2014001/article/11901-eng.htm under “STATA 12”; the example refers to the GSS, but I’m assuming the procedure applies as well to the SHS PUMF)."


Maybe there is some literature we missed?


Answer

The bootstrap weights created for the SHS2017 PUMF should be treated as regular bootstrap weights, and therefore, you are right that the mean bootstrap method is not used, and that the number of samples should be set to 1 (bsn=1).

Canadian Internet Use Survey

February 10, 2021


Since the release of the 2018 Canadian Internet Use Survey (CIUS) microdata file, it was noticed that the ‘Valid skip’ (valid skip = 6) and the ‘Not stated’ (not stated = 9) were missing from some of the ‘Universe statements’ in the Codebook (data dictionary).

 

In general, this issue only impacts questions that rely on a flow from a previous question. Please refer to the questionnaire flow document to ensure that you are using the proper universe when conducting research and creating indicators.

 

Note, this issue is in the process of being corrected and  a new version of the 2018 CIUS codebook will be released when it becomes available.

The Federated Research Data Repository (FRDR) is now in Full Production

February 3, 2021


Portage’s Federated Research Data Repository (FRDR) has officially launched into full production! Full production offers many new features and benefits:


  • Publish research data in a Canadian-owned, bilingual national repository option
  • 1 TB of repository storage available to all faculty members at Canadian post-secondary institutions - more storage may be available upon request
  • Secure repository storage, distributed geographically across multiple Compute Canada Federation hosting sites
  • Data curation support provided by Portage
  • Ability to work with multiple collaborators on a single submission 
  • Your data will be discoverable alongside other Canadian collections in the FRDR Discovery Portal


FRDR is designed to address a longstanding gap in Canada's research infrastructure by providing researchers with a robust repository option into which large research datasets can be ingested, curated, processed for preservation, discovered, cited, and shared. 


The FRDR Discovery Portal enables discovery of and access to Canadian research data, while FRDR’s repository services will help researchers store and manage their data, preserve their research for future use, and comply with institutional and funding agency data management requirements.


FRDR is made possible through a collaboration between Portage, the Compute Canada Federation and the Canadian Association of Research Libraries, with development and infrastructure support from the University of Saskatchewan, Simon Fraser University, the University of Waterloo, and the University of Toronto.


Several Portage Expert and Working Groups have contributed to FRDR’s development, including the FRDR Policy Working Group, the FRDR User Experience and Training Working Group, the FRDR Discovery Service Working Group, the FAST & the FRDR Working Group, and the Data Repositories Expert Group. The FRDR Steering Committee has been instrumental in providing direction and governance for FRDR from inception to full production. 


More information about FRDR and its partners can be found at www.frdr-dfdr.ca.


Portage is offering webinars on FRDR to help researchers, faculty, librarians, and others learn how to use the platform for data sharing, deposit, and discovery. See the announcement for more details.


If you have any questions or would like to know more about FRDR, please contact support@frdr-dfdr.ca.


Funding in support of the Portage Network’s stewardship of research data within Canada is administered through the New Digital Research Infrastructure Organization (NDRIO).

RDR Metadata Available in ProQuest Central Discovery Index

February 1, 2021


We now have a way to make all datasets indexed by the Federated Research Data Repository (FRDR) findable in ProQuest’s Central Discovery Index (CDI). Academic libraries using Summon, Primo, or Alma can now easily include records from FRDR in their discovery service using the ProQuest CDI. Simply navigate to your library’s ProQuest Client Center, search for FRDR, and include it in your ProQuest subscriptions. Detailed instructions are available on FRDR. Many thanks to our partners at UBC Library for working with ProQuest on this initiative to increase the discoverability of Canadian research data!


FRDR is a steward of Canada’s largest index of research metadata, and currently harvests metadata from over 70 Canadian research data repositories for inclusion in its discovery service, with more repositories being added.


For more information please contact support@frdr-dfdr.ca.

Maternal Mental Health 2019 Dataset

January 25, 2021


Question

I have a student looking for the Maternal Mental Health 2019 dataset. Is that available?


Answer

Unfortunately we do not have this available as a PUMF.

Census 2006 Data Question

January 6, 2021


Question

II've pulled data for each CSD from the 2006 census using Beyond 20/20 and my advisor wanted me to ask , based on the info for StatsCan that I've copied below - how can I know if zeroes in my dataset represent data suppression or are true zeroes? He is thinking that those that were suppressed will likely need to be treated as missing for my analyses, since they aren't true zeroes, but I'm not sure how to accurately differentiate these. He's thinking that I can likely do this by looking at CSD population size and the number of total private households, and if neither of these thresholds is exceeded (as outlined below) then the zero is likely a true zero (likely not many of these), otherwise I can replace the other zeroes as missing values. Does that make sense?


Census Info 

Area suppression for income characteristic data 

Area suppression, when applied for data quality purposes, is used to replace all income characteristic data with zeroes for geographic areas with populations and/or number of households below a specific threshold. 


If a census tabulation contains any data showing income characteristics for individuals, families or households, then the following rule applies. Income characteristic data are zeroed out for areas where the population is less than 250 or where the number of private households is less than 40. These thresholds are applied to 2006 Census data as well as all previous census data. The threshold of 40 private households is based upon the fact that weighted data are being used. With the weighting factor for each household being 5, setting a threshold of 40 ensures that there will be at least 8 households used in the calculation. The private household threshold does not apply for tabulations based on place of work geographies. 


This seems to be what was happening in my data, as some variables for a single CSD have ‘.’ And others zeroes. Those with zeroes typically seem to relate to income, proportion of household spend etc.



Answer

Statistics Canada places the highest priority on maintaining the privacy and confidentiality of respondents. If necessary, data are suppressed to prevent direct or residual disclosure of identifiable data.   Because of this and the data quality measures in place, your client will not be able to distinguish between all “true zeros” and these suppression zeros. Area suppression is one type of suppression which involves removing all characteristic data for geographic areas with populations below a specified size.


Having counts based on the geography should let them filter most of those out.

250 people, if the table contains income data, and if the table also contains place-of-residence data, at least 40 private households 100 people, if it is a six-character postal code area, that is, a local delivery unit (LDU), or if it is a custom area 40 people, in all other cases.


In regards to your client’s question on individual cell suppression please see the following paragraph from Chapter One of the 2006 Overview of the Census: Dissemination Rules for Statistics:

“Tables are sometimes accompanied by statistics such as averages, totals and standard deviations. There are various ways of ensuring that these statistics do not reveal sensitive information; for instance, they may be suppressed or made less precise. Some statistics, such as totals, ratios and percentages, are based on the rounded values in the tables to which they apply. A statistic will be suppressed if there are too few data to compute it. In cases of data items expressed in dollars, if the statistic must be calculated from data where the values are too close or if a value is too high compared to the others, then the statistic will be suppressed.”

 

Depending on the income source variable, income medians and averages are most always never true 0. When there is a zero for most things it is a suppression. As for counts that have been rounded to zero, it is a feature of the confidentiality system and you cannot distinguish those rounded down from the true zeros.