Research Data Management Resources

Portage has recently published some new Training Aids for Research Data Management.

They include the following:

• an online training module - Research Data Management (RDM) 101
• Additions to the “Good Enough” series (1 page guides for busy people)

• Data Curation
• Dataverse
• FRDR

These bilingual resources are available for everyone here:

https://portagenetwork.ca/training-resources/portage-training-resources/ 

2006 APS Available in Stata?

Question

I see these are available via the EFT site in SPSS and SAS. Are they also available (elsewhere?) in Stata?

Answer

As far as I know Statistics Canada doesn't provide files in a Stata format. There is a good site at UCLA’s idre (Institute for Digital research and Education) http://www.ats.ucla.edu/stat/stata/faq/convert_pkg.htm that provides information of working with SPSS, SAS and Stata files including information on how to convert one format to another.

From the Nesstar platform (http://www62.statcan.ca/webview/) you can download the file in various formats. You can even download the file in Stata v.8 and v.7.
For more information on the DLI's Nesstar, see Accessing and Citing DLI Data.

Most Recent PCCF+

Question
Which files are most recent PCCF+ to dowload? I am assuming that pccfa1-fccp6a1 is the most recent, but there seems to be three choices:

* pccfa1-fccp6a1 — A directory
* pccfa1-fccp6a1.zip — Is this the same directory, but zipped?
* pccfa1-fccp6a1-ver2.zip — Is this actually the most recent?

Answer

The most recent version is pccfa1-fccp6a1-ver2.zip. I have removed the previous version as is our practice to reduce confusion.

Flash Drives for Researchers

Question

Just wondering if you provide a flash drive/memory stick to a researcher with data on it, do you ask that the stick be returned to you so you can use it again or do you just keep buying more media?

Answer

We keep a couple for researchers to use, but we ask that they return them for re-use. We will also burn data onto DVD/CD for clients, as they are relatively inexpensive (as flash drives are NOT). We encourage our clients to bring their own memory sticks or external drives for large files so we can skip the CD/DVD-creation process. 

Alternatively, if bringing a flash drive is not feasible, then: for lower demand files, this is as simple as sending the files including a readme file as email attachments; where files of some value, like ones that other researchers may want to use, or ones that took considerable time to produce, then we put the files on our secure data server as appropriate with distribution via html file links that we insert into an e-mail or via multiple links on class libguide pages. 

Because new mobile devices and laptops mostly lack CD / DVD drives, welend flash drives to users through our circ system as we do for other centre materials like maps. These flash drives are on lanyards with barcodes. We can also deposit the file on a secure server, and he can download it with a password (student identifier). Html link to the file is sent by e-mail.

PCCF+

Question

Please forgive my confusion, but where on the EFT site do I find the latest PCCF+? Rooting around, I can't find anything labelled as such, but I must be missing something. I would be grateful for any enlightenment you can offer.

Answer

When you first connect, you should see options for what EFT folder to connect to - MAD_DLI, MAD_DLI_CIHI, MAD_DLI_Nesstar, and MAD_DLI_PCCF - you want to go into the last of those options. If you are set up to move directly into one of the folders (e.g., MAD_DLI, you will have to change directories to go up to MAD_DLI_PCCF.

We are, however, waiting for the 2015 April release of the Postal CodeOM Conversion File (PCCF) and Postal CodesOM by Federal Ridings File (PCFRF) from Geography Division. These files reflect postal codeOM data from the Canada Post Corporation up to and including November 2014. Once we receive these files from subject matter and place them on the EFT, will notify the community right away.

Public Links to DLI Updates

Question

The "public" links to the DLI Update do not seem to work. I have checked the URLs and I get an "Access Forbidden" -- to cite one example, this link does not work: <http://www.statcan.gc.ca/dli-ild/doc/update2004-miseajour2004-eng.pdf>.

I've also checked the URL from the Stat Can Library catalogue and get the same result when I try to access the link found in the catalogue record at: <http://statcan.egcatalogue.ca/eg/opac/record/66391>

Answer

As part of a redesign of the DLI website, certain content was removed. In order to meet accessibility standards, documents that were not in an accessible format were removed, such as the PDF versions of the DLI update. These are now archived on the DLI EFT site. These changes were brought forth and discussed with the community over a two year period at DLI Regional Training Sessions. At this time, they are only available through the EFT site.

We can investigate alternative access modes, such as the new DLI Training Repository to host these documents.

Master Files vs. PUMFs

Question

From what I've understood, even if a PUMF was not created, a masterfile is always typically available for social survey data. Are all master files accessible through an RDC? In other words, are there some master files that are not available through an RDC (and whose data
can only be accessed through customized tabulations)?

Answer

The RDC explained that: "Not all the master files are available through the Research Data Centre (RDC) program. The RDC program usually only houses social survey microdata
while the Centre for Data Development and Economic Research (CDER) program typically houses business survey microdata.

Custom tabs can be acquired through the subject matter divisions or through Microdata Access Division’s Real Time Remote Access (RTRA) program for a fee.
For a list of RDC data sets, please visit the RDC data page: <http://www.statcan.gc.ca/rdc-cdr/data-donnee-eng.htm>. For a list of RTRA data sets, please visit the RTRA data page: <http://www.statcan.gc.ca/rdc-cdr/rtra-adtr/surv-enq-eng.htm>. For a list of CDER data sets, please visit the CDER data page: <http://www.statcan.gc.ca/eng/cder/data>

EAPA/APS PUMF

Question

Will the EAPA/APS PUMF will be available this fall as planned. If so, is there an estimate for its release date?

My researcher would like to use the Aboriginal Peoples Survey/Enquête auprès des peuples autochtones,if possible.

Answer

Our anticipated release date is January 2015. However, this date may have to be moved due to a lack of methodology resources but that decision has not been made yet.

Survey of Innovation 2002-2005

Question

There were more questions on the Survey of Innovation 2002-2005. I have the following questions:
1) Is SIBS data available at the provincial level? The Excel files I downloaded from the FTP site only give data at the national level, whereas the Survey of Innovation (2003) gave provincial data in the Excel sheets.
2) For SIBS, we are only finding limited documentation: Data Accuracy, Standard Symbols and the list of files. Is there any intention to develop something similar to the Survey of Innovation's more detailed "How to Read the Tables" PDF document?
3) Is the division ready and able to provide custom tabulations for SIBS 2012 data?

Answer

As indicated, Data for SIBS 2012 has been stratified by regions: Atlantic provinces; Ontario; Quebec; Alberta; and Rest of Canada. This data for 2009 and 2012 is available on CANSIM.

We have already released all questions for the innovation
<http://www.statcan.gc.ca/daily-quotidien/140617/dq140617c-eng.htm>
module and global value chains <http://www.statcan.gc.ca/daily-quotidien/140730/dq140730d-eng.htm>.

SIBS 2009 was not stratified with these regions and we suggest that users use this data with caution. This note appeared in our Note to Readers for all three major releases.

The Business Strategy module is set to be released for August 25, 2014.

In terms of custom tabulation, we are presently not prepared to offer this service as we have other priorities to fulfill to complete this project. We will be discussing a custom tabulation strategy at the start of the month for it involves three divisions.

Discontinued Surveys

Question

Does anyone have a list of surveys that have been discontinued since 2006? A former StatCan employee stated this morning that only inconsequential surveys have been cut at the agency. His work focuses strictly on economic surveys. I seem to recall that social surveys took a large hit. I know that the longitudinal surveys were all cut but would like to have more information about the rest of those that have been discontinued.

Answer

We started to keep track of some surveys that had discontinued PUMFs, but because researchers use old data and discontinued data we have never thought of keeping a list. We just check IMDB if we need to know the status of a survey. We will discuss starting a list.

Suppressed CCHS Variable

Question

I've got a researcher looking for a data point that doesn't appear to be in the 2012 CCHS PUMF - "HCU_01AC: Do you and this doctor speak in English, French or other?" I presume this variable was suppressed to preserve anonymity? Is it possible for the researcher to get access to this data?

Answer

That is correct that the HCU_1AC variable is not available on the PUMF.

The master files contain all variables and all records from the survey collected during a collection period. These files are accessible at Statistics Canada for internal use and in Statistics Canada’s Research Data Centres (RDC), and are also subject to custom tabulation requests. The RDC Program enables researchers to use the survey data in the master files in a secure environment in several universities across Canada. Researchers must submit research proposals that, once approved, give them access to the RDC. For more information, please consult the following web page: <http://www.statcan.ca/english /rdc/index.htm>

Another way to access data in the master files is to purchase a custom tabulations. This service is offered on a cost-recovery basis. The results are screened for confidentiality and reliability concerns before release. For more information, please contact Client Services.

Finally, the remote access service to the survey master files is another way to have access to these data if, for some reason, the user cannot access a Research Data Centre. Each purchaser of the microdata product can be supplied with a synthetic or ‘dummy’ master file and a corresponding record layout. With these tools, the researcher can develop his own set of analytical computer programs. There is no charge for this service.

Film, Television and Video Post-production Service Bulletin

Question

A student is trying to access the 1997 to 2004 issues of Film, Television and Video Post-production Service Bulletin (87-009X). As far as I can tell, the pre-2006 issues of that publication are no longer available online and I do not believe they have been released as print publications, at least not through the DLP. Can we obtain a copy of those publications? <http://www5.statcan.gc.ca/olc-cel/olc.action?ObjId=87-009-X&ObjType=2&lang=en&limit=1>

Answer

I have submitted the request for the broken link to be repaired. In the meantime, I have confirmed with the library that it can be ordered via interlibrary loans. The university library should submit an ILL request on behalf of the student.

National Graduate Survey

Question

It seems that the National Graduate Survey has been dormant for sometime. Did something replace it?

Answer

There will be a PUMF for the 2013 National Graduates Survey (Class of 2009/2010) produced. This will be available in the next eight months.

PCCF Usage

Question

I have a PCCF question that may require clarification:

An established research group on campus - whose members are all part of the university community as either faculty or graduate students - have taken on a contract to conduct research for a local government agency. PCCFs will almost certainly be required to complete the work and submit the results to the agency. Data will not be shared but results of the research will be, as per Appendix A of the EULA, which allows use of postal code resources for research purposes.

But given that the research group's work is for a third party and that money will change hands for services rendered, does the postal code resources EULA apply?

This has been a very tricky situation for the research group. They are acting as agents of the university, i.e, the actual, capital-R, capital-G Research Group has been contracted to do the work and not the researchers working in their individual capacity beyond the university's mandate. This means that the university's Research Ethics Board requires ethics approval before research begins. At the same time, since the research is for a third party, other administrative units on campus see their work as external to the school and its policies. So we want to clarify where things stand with the postal code resources EULA.

Answer

I consulted with our Licensing section and have confirmed that their use is not acceptable under the EULA with the DLI since this is being done for a third party. The DLI was granted a Licence for the research, teaching and planning purposes. The third party must contact a Regional Office to acquire the file. The end-use licence which will be provided by the Regional Office will permit the third party to provide the PCCF to the university solely for the purpose of consulting services.

The Regional Office can provide the third party with information about the acquisition process. If you would like more information, please let me know and I can put you in touch with the appropriate party here at Statistics Canada.

GSS Cycle 26

Question

Will the GSS Cycle 26 PUMF file may be available before April 1st?

Answer

The GSS Cycle 26 PUMF will not be available by April 1st, but will be available early this summer. There will also be a DLI Webinar for GSS Cycle 26 that's set for the end of April (date has yet to be set). I have asked that the presenters provide an overview of what to anticipate in the PUMF

NHS-RDC

Question

Since the links:

-The list home page: <http://dli-idd.statcan.gc.ca/scripts/wa.exe?A0=DLILIST>

-The list subscription page: <http://dli-idd.statcan.gc.ca/scripts/wa.exe?SUBED1=DLILIST>

are not currently working, when will the NHS masterfile be in the RDCs?

Answer

We apologize for the broken links, there was an unforeseen delay with the archive site when we went live with the new Listserv. It will be operational soon, with the launch of the DLI’s new WDS. It is available in the RDCs.

CIUS and SPSS Access

Question

A student here is unable to use SPSS to work with Canadian Internet Use Surveys. I am not surprised by his first complaint – I could see that already - but can anyone give me advice on how to resolve his other two issues? Is there some step he might be missing in installing the syntax files? He reports:
1. They are not self extracting. Instead they use a syntax to load the files.
2. The syntax does not appear to work on my version of spss.
3. The error messages tell me that I am unable to save the output file and that text file is not compatible

Answer

I'd check that the path statements pointing to the data file and saved files are correct -- it's a common mistake to make. Being unable to save the output file may mean that the program has had no data file to work with, which would be true if the path was incorrect. If he's using a student version, they can be limited in the number of cases and columns the data file is allowed to have. Also, ask the student to attach the output from running the SPSS syntax; that would help a lot with diagnosing any problems.

CHS 2012 PUMF

Question

The Canadian Community Health Survey 2012 Pumf is listed as to be released in the Fall of 2013. Is there anymore information on when this PUMF might be available ?

Answer
There is no specific release date yet, but it will be later in the Fall.

2012 SFS PUMF Release

Question

A researcher is looking for the Nov. 2012 Survey of Financial Security. I can only see the SFS for 1983, 1999 and 2005 listed in the DLI Collection and no mention of it on the soon-to-be-released list. Can you tell me its status?

Answer

They are planning for an SFS PUMF to be released sometime in the Spring of 2014. I will update the Tentative release dates of DLI products accordingly.

2006 Work Tables

Question

I am trying to locate the following tables in the DLI collection:

Place of Work Status (7), Occupation - National Occupational Classification for Statistics 2006 (11) and Work Activity (4) for the Employed Labour Force 15 Years and Over

Canada, Provinces, Territories, Census Divisions and
Census Subdivisions - Cat. No. 97C0056.

Census Metropolitan Areas, Tracted Census Agglomerations
and Census Tracts - Cat. No. 97C0073.

Both of them have "contact us" next to them, but I assumed I would find them on the FTP site; however, there is nothing that corresponds to the given catalogue numbers in the 2006/Topic-based-tabulations/place-of-work-and-commuting-to-work folder. Am I looking in the wrong place? Are they, in fact, not a DLI product?

Answer

You'll find these tables at the following locations on EFT site:
Cat. No. 97C0056: /MAD_DLI/Root/census_pop_recens/2006/pow_consortium/csds_static_and_flows/canada
Cat. No. 97C0073: /MAD_DLI/Root/census_pop_recens/2006/pow_consortium/cts_static/canada