Friday, March 1, 2019

Training Resources for Scraping Data

Question:
The name of the survey is "Tuition and Living Accommodation Costs", yet 
I have been unable to find any accommodation costs data anywhere. Do 
they exist? If so, where? If not, why not?

Answer:
Accommodation costs are in Table 7.

Eg: "TABLE 7. LIVING ACCOMMODATION COSTS FOR RESIDENCES, 2017-2018 (actual), annual (dollars)”

It’s hard to find because you have to scroll to the end of all the worksheets, so it’s not immediately obvious  or especially intuitive if you’re not using a large monitor.


Wednesday, February 27, 2019

GSS Cycle 31 and 32

Question:
I was wondering when the PUMF for the GSS Cycle 31 (Family) would be available? According to this product page - http://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&SDDS=4501 – the data was released on February 7, 2019.

For the GSS Cycle 32 (Caregiving and Care Receiving), the product page (http://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&SDDS=4502) says the first release is scheduled for autumn 2019. Would this include the PUMF or would that be later? I have a researcher who is interested in using this survey for a research project and would like to give her an estimate for when the PUMF would be available.

Answer:
We’ve received the following response from subject matter:

“For GSS Cycle 31 (Family), it is safe to say Winter 2020.
As for GSS Cycle 32 (Caregiving and Care Receiving), the release of the analytical file is planned for November 2019.  The PUMF for GSS 32 (Caregiving and Care Receiving) will not be ready till sometime in 2020; We don’t have a specific time frame at this time.

The researcher use the PUMF for the cycle 26 (2012 GSS on Caregiving and Care Receiving) in the interim, if they haven’t already.”

Farms Expenses Income Yields By Type of Farm Over Years

Question:
Researcher wants to know the smallest geography possible to obtain:
-expenses
-farm income
-off farm income
-yields
--by specific type of farm
--- barley, canola, durum, pea and wheat by ‘small area’ in AB
---(or by Oilseed and grain farming [1111])

and

--- blueberries and grapes by ‘small area’ in BC
---(or by Fruit and tree nut farming [1113])

and
-by at least 5 separate (preferably consecutive) years

(i/we know of:
Estimated areas, yield and production of principal field crops by Small Area Data Regions
https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=3210000201

Farm financial survey, financial structure by farm type
https://www150.statcan.gc.ca/t1/tbl1/en/cv.action?pid=3210010201

(which has Oilseed and grain farming versus Fruit and tree nut farming) and its predecessor

Farm financial survey, financial structure by farm type, 2001-2011
https://www150.statcan.gc.ca/t1/tbl1/en/cv.action?pid=3210028701

and

Estimated areas, yield and production of principal field crops by Small Area Data Regions
https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=3210000201

Total and average off-farm income by source
https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=3210005701 )

Answer:
I’ve received the following response from subject matter:

“The best source of this information would be the Census of Agriculture which releases at something along the lines of township level geography.  The census of course is every five years not every year.

The off farm income would be from the AgPop linkage data set if you wanted it associated with the Census of AG (available only at province level). 

Intercensal data is available from our survey programs but those produce data at much higher levels of geography.” 

Tuesday, February 26, 2019

CCHS Rapid Response Files

Question:
I have a student looking to access data from two of the rapid response components of the CCHS: 

Food skills – knowledge, planning and transference of skills (2012)
Food skills – mechanical skills and food conceptualization (2013)  
I'm thinking that they are likely not available as PUMFs, as via odeso I am only seeing documentation for the first, and nothing for the second, an no further luck on the EFT. Just want to throw it out there to the community though to see if anyone has insights and/or if anyone knows if they may perhaps be available instead via RDCs before I go any further. 

Answer:
Subject matter has responded with the following:
“These 2 Rapid response files are available via RDC request.”

Sex Education in the Schools

Question:
I just received this request from a prof.

Any tips would be greatly appreciated!

“I was looking for any sort of general population survey that actually measured whether someone had been exposed to sex education in their schooling. Hopefully, some other relevant aspects of their behaviour would be measured, but the key thing is a question measuring exposure to formal sex ed.”

Answer:
We’ve received the following from subject matter:

“Please note that we do not have data that actually measured whether someone had been exposed to sex education in their schooling (details about specific classes or data before postsecondary.)”

Monday, February 25, 2019

Data Requested on Pay Frequency

Question:
A researcher is searching for a data source where he can get “employee pay frequency”, see figure 1 below, for the following variables:
- for private and public companies,
- industries at the 2 digit NAICS code level, &
- provinces and territories (or provinces).

Figure 1, e.g., two questions asked so that StatCan can calculate employees’ weekly earnings or hourly earnings

_____________________________________________________________

LFI_Q202 — [Including tips and commissions,] what is his/her hourly rate of pay? Go to 220


If no hourly rate then next question is …

LFI_Q204 — What is the easiest way for you to tell us his/her wage or salary, [including tips and commissions,] before taxes and other deductions? Would it be yearly, monthly, weekly, or on some other basis?

If “Yearly”, go to 209

If “Monthly”, go to 208

If “Semi-monthly”, go to 207

If “Bi-weekly”, go to 206

If “Weekly” or “Other”, go to 205

 _____________________________________________________________

Source, Labour Force Survey user guide

I wasn’t able to find other surveys (other than the Survey of Employment, Payrolls and Hours) which ask about pay frequency, but then this was not an exhaustive search.

And please see U.S. example:- link:  “How frequently do private businesses pay workers?” [https://www.bls.gov/opub/btn/volume-3/how-frequently-do-private-businesses-pay-workers.htm] Beyond the Numbers, May 2014, BLS

Re: Figure 2 … *Email included an attached screen capture of Fig. 2

Any leads would be appreciated.  It would be great if this could be retrieved from a PUMF or RTRA, but if not, what are the options.

Follow-Up Question:
This is in follow-up to this data request (pay frequency…) below.  The researcher just specified to me that he wants to obtain firm-level data.  Noting that this would likely require the  Survey of Employment, Payrolls and Hours (SEPH), I am looking for validation please on whether SEPH it is available in the RDC’s or CDER.  I don’t find it on either the page of survey data sources for the RDC’s or CDER.

Answer:
The SEPH data is unfortunately not available in the RDCs, and is not currently available in CDER, however they have been in discussions with the SEPH manager about including it in CDER and he was open to the idea, provided there is a demand for it. He noted that it would take some time to prepare the files for use though.

Follow-up Question:
Thank you so much for confirming information about access to SEPH data.  This is what I had thought could be the answer.  And although we have at least one request a year for SEPH data, how that would translate to CDER users I am not sure J

In the meantime, it would be great to find out more about another possible source or sources for tabulations.

On a pure curiosity level, could DLI contacts request information on CDER researchers from their institutions, e.g., numbers?

Follow-up Answer:
Unfortunately it doesn’t look as if we’ll be able to get this particular bit of information:

“In theory the data is available but not something that we publish. Also the concept is not quite what the researcher is looking for. There is a difference in “employee pay frequency” and “easiest way to tell us your wage/salary”.

I am also not sure how CDER numbers would work, but I can look into that for you!

Follow-up Question:
Thank you so much for looking into data sources for this research question.

The researcher would like to please inquire into the possibility of using multiple years of SEPH data for pay frequency at the firm level in CDER.  The researcher acknowledges that the SEPH measure of “easiest way to tell us your wage/salary” would only be a proxy for pay frequency.  Given this somewhat restrictive definition, and the fact that SEPH is not currently available in CDER, what would be the next steps for inquiring about the possibility of using SEPH in CDER?  Does the researcher need to provide any specific information at this stage and would it be acceptable for me to be looped in the discussions?

Follow-up Answer:
Our CDER contact has replied with the following:

“Do you know a bit more about the scope of the project? CDER only provides access to business microdata for research projects and not custom tabulations. If this is indeed the case, I will get in touch with the manager of SEPH and perhaps we can organize a call with the researcher.”

Friday, February 22, 2019

SPSD/M Licence Agreement

Question:
The Licence Agreement for the SPSD/M is still in place, right? The open data licence is for PUMFs only?

Answer:
Yes, the SPSD/M Licence Agreement is still in place.