open-data | James Colliander

Open Toolchain

Fri, 27 Aug 2021 10:00:00 +0000

Open Toolchain

Fri, 27 Aug 2021 00:00:00 +0000

`Open Toolchain`

Canadian Open Data Society Board meeting

2021-08-27

Idea

People, with the right data, tools and resources, can do good things working together.

James Colliander

Professor of Mathematics: UBC
Cofounder: 2i2c, Callysto, Syzygy, Crowdmark
Past Director (2016-2021): PIMS

Background

PIMS: Distributed Mathematical Sciences Institute

Inspirations

Data 8 at Berkeley

Partners

Idea: Jupyter for 🇨🇦

Development History

gantt
title Timeline
section Syzygy
23 universities, 10 research teams: 2020-02-25, 25d
40,000 users : 2021-08-15, 25d
25,000 users : 2020-01-01, 25d
16,000 users : 2019-08-22, 25d
8,000 users : 2017-08-24, 25d
Syzygy service announcement : 2017-03-15, 25d
PIMS + Compute Canada Agreement : 2016-06-02, 25d
Compute Canada Discussions : 2015-12-03, 2016-06-01
Jessica Hamrick's Post : 2015-03-24, 25d
JupyterHub for 🇨🇦 idea : 2015-02-01, 90d
section Callysto
CanCode 2.0 🇨🇦 $1.5M : 2019-10-15, 25d
Callysto content creation : 2018-05-01, 2018-08-31
CanCode 1.0 🇨🇦 $1.5M : 2018-01-30, 25d
Callysto Launched: 2017-10-01, 25d

Examples

Lessons Learned

Research and education transforming
Demand can be met with cloud strategy
Scaling requires infrastructure

Sustainable business model?

`2i2c`

International Interactive Computing Collaboration

NSERC Open Data Exploration

Sat, 24 Nov 2018 00:00:00 +0000

NSERC Open Data Exploration

The 2018 federal budget of Canada 🇨🇦 announced significant new investments in research. The Canada Research Coordinating Committee is defining a work plan to promote “international and risky research; support for Canada’s next generation of researchers; equity, diversity and inclusion; and indigenous research and capacity building”.

This site explores the NSERC Awards Data with the goal of helping Canada to achieve the best outcomes for research and training of future researchers. Open analysis of research investments also helps advance the goals outlined in the Mandate Letter to the Minister of Science.

Canada’s Open Government Portal includes NSERC Awards Data from 1995 through 2016. The awards data (in .csv format) were copied to an Amazon Web Services S3 bucket and analyzed using computing resources from PIMS on cloud infrastructure from Compute Canada and Cybera.

You are invited to collaborate on the analysis of investments made by NSERC. Access to the data and source code are shared in a public repository on GitHub.

TODO Set up similar analyses for SSHRC

TODO Set up similar analysis for CIHR

Overview

Interactive Notebook: Exploring NSERC

NSERC Budget

Year	Total	Not Discovery	Discovery
1995	451159747	267113329	184046418
1996	434116337	247533171	186583166
1997	417146970	227810152	189336818
1998	477141539	266731883	210409656
1999	526133116	299956302	226176814
2000	537934451	294508093	243426358
2001	554698568	316537927	238160641
2002	615320903	357333281	257987622
2003	696997644	423803197	273194447
2004	765643760	488699482	276944278
2005	820640167	519567082	301073085
2006	854567999	545233090	309334909
2007	968713281	655321429	313391852
2008	980889930	664642572	316247358
2009	1003483757	680426976	323056781
2010	1026366682	702101715	324264967
2011	1035205511	705872398	329333113
2012	1021894152	685991741	335902411
2013	1018139165	681486392	336652773
2014	1038149414	698064881	340084533
2015	1068044894	727279990	340764904
2016	1142066427	791496311	350570116

Accumulated Program Investments [1995 - 2016] Top 25

ProgramNameEN	Reported Dollars
Discovery Grants Program - Individual	5949789135
Canada Research Chairs	1590512911
Collaborative Research and Development Grants	948122955
Strategic Projects - Group	908959760
Networks of Centres of Excellence	762559105
Research Tools and Instruments - Category 1 (<$150,000)	565583275
Postgraduate Scholarships	435601321
Industrial Research Chairs	398835692
Research Networks	382614308
Alexander Graham Bell Canada Graduate Scholarships - Doctoral	352888065
Postgraduate Scholarships - Doctoral	340062867
Postdoctoral Fellowships	283101969
Subatomic Physics Envelope - Project	267988202
University Undergraduate Student Research Awards	258863102
Major Resources Support Program - Infrastructure	201128769
Centres of Excellence for Commercialization and Research - Group	186214812
Engage Grants Program	185938402
Alexander Graham Bell Canada Graduate Scholarships - Master’s	175254486
Cooperative Activities	163228194
College and Community Innovation Program	161161262
Major Facilities Access Grants	159523772
Collaborative Research and Training Experience	147907095
Canada Excellence Research Chairs	137314666
Discovery Grants Program - Accelerator Supplements	121369119
Postgraduate Scholarships - Master’s	114880771

Accumulated Principal Investigator Investments [1995-2016] Top 25

Name	Reported Dollars
Hormes , Josef	99836800
Gupta , Arvind	97587570
McWalter , Ian	75503588
Fortier , Louis	72542772
Frise , Peter	63874923
Barge , Brian	50400000
Thomlinson , William	46610800
Fedosejevs , Robert	40720798
McDonald , Arthur	36781300
Orr , Robert	32043881
Smith , Donald	31227906
Mufti , Aftab	28761712
Wallace , Douglas	28433833
Servos , Mark	28130452
Rogers , Harry	27590000
Salama , Andre	26296562
Burton , Howard	25000000
Yada , Rickey	24982617
Clowes , Ronald	24072844
Pelton , Robert	23985763
Svensson , Carl	22782441
Lamb , Robert	21349800
Chrisman , Nicholas	21286250
Larter , Stephen	20024564
Bourbonnais , Normand	17753965

TODO NSERC’s Open Data does not report gender of PIs. Find ways to measure equity, diversity, inclusion metrics over past investments.
TODO How can we connect the reported dollar investments to measurements of research output?

Discovery

Interactive Notebook: Evaluation Groups Analysis

Evaluation Groups

Award Amounts

TODO Why do 1501 and 1502 receive so much more investment than other EGs?

Number of Awards

TODO Why are there so many more awards in 1501 and 1502 than in other EGs?

Bin Frequency

Example: 1504 (Chemistry); FiscalYear 2013

TODO Find a way to infer bin levels based on awards data amounts

Engage

Interactive Notebook: Engage Grants

TODO Find a way to connect Engage Grant investments to economic impact metrics.

Toward Global Science Excellence

Sun, 28 Aug 2016 19:27:19 +0000

Prime Minister Justin Trudeau’s ministerial mandate letters for Science and Innovation, Science and Economic Development (ISED) outline an agenda to investigate and improve the nation’s innovation ecosystem. Roundtable discussions on various themes are taking place across the nation as part of Canada’s Innovation Agenda, an initiative driven by Minister Navdeep Bains (ISED) and Minister Kirsty Duncan (Science). Minister Duncan has also launched Canada’s Fundamental Science Review and empowered an eminent panel chaired by Dr. David Naylor with a mandate to review and make recommendations to improve Canada’s science policy.

I recently participated in a roundtable discussion on the theme Global Science Excellence. The event was convened by Dr. Maurice Moloney, CEO of the Global Institute for Food Security, and took place at the University of Saskatchewan. The roundtable panel included representatives from biology, chemistry, computer science, environmental science, geoscience, mathematics, pharmacy, physics and leaders from provincial and federal governments.

After reflecting on the panel discussion, here are four points that stand out for me:

Transparent sharing of government data through resources like the Open Government Portal should continue. Government decisions will be better when based upon insights informed by publicly accessible data. (Some panelists requested access to my open Jupyter notebooks on NSERC investments during 1995-2014 and 2012-2016.)
Decisions on government investments in scientific research should be decided scientifically through vigorous peer review and not politically through direct line items in the federal budget.
Ideas from mathematical sciences (computer science, statistics, mathematics) are influencing almost all areas of inquiry. The measured impact of mathematical sciences on the economy far exceeds expectations typically held by policy makers. Systematic underfunding of mathematics, statistics and computer science obstructs Canada’s potential for global science excellence.
Researchers from various disciplines request greater coherence across the programs offered by government. Advancing human knowledge through basic research, applying breakthroughs to solve problems in society or industry, developing and validating applications and prototypes, and scaling innovations through commercialization or other social processes are all endeavours that merit government investment. These activities unfold over differing time scales, involve differing sources of inspiration, and are driven by differing incentive systems and require a coherent collection of programs designed around these differences.

The Government of Canada is reviewing its approach to supporting research, development and commercialization. I encourage everyone to share their views.

open-data | James Colliander

Open Toolchain

Open Toolchain

Open Toolchain

Idea

James Colliander

Background

PIMS: Distributed Mathematical Sciences Institute

Inspirations

Jessica Hamrick’s Post

Data 8 at Berkeley

Partners

Idea: Jupyter for 🇨🇦

Development History

Examples

Lessons Learned

Sustainable business model?

2i2c

NSERC Open Data Exploration

NSERC Open Data Exploration

TODO Set up similar analyses for SSHRC

TODO Set up similar analysis for CIHR

Overview

NSERC Budget

Accumulated Program Investments [1995 - 2016] Top 25

Accumulated Principal Investigator Investments [1995-2016] Top 25

Discovery

Evaluation Groups

Award Amounts

Number of Awards

Bin Frequency

Engage

Toward Global Science Excellence

`Open Toolchain`

`2i2c`