Skip to Main Content
XClose

Library Services

Home

UCL LIBRARY SERVICES

Reusable content guide

A collection of content boxes that can be re-used in your own guide. We will be continuously adding content here.

Finding data

Data analyst

Photo by Nastya Kroshka on freepik.com

Primary data are generated by researchers within a research design of their making. Secondary data are data made available to others to reuse and analyse which are generated by others. One person’s primary data can be another person’s secondary data. In seeking such data for your work, a number of approaches can be adopted.

Economic trends

Selected websites:

Selected e-books:

Census and population

UK census longitudinal data can be found at:

  • CeLSIUS: England and Wales (ONS LS)
  • SLS-DSU: Scotland (SLS)
  • NILS-RSU: Northern Ireland (NILS)
  • CALLS Hub: information on all three census longitudinal studies

Selected websites:

Collen Programme Data: The Collen Programme has developed interactive data visualisation tools to help explore key statistics on fertility. Interactive graphics on international population statistics and specific country profiles for Sub Saharan Africa are also available.

Global Ageing Survey (GLAS) contains interviews with 44,000 people aged 40-80 in 25 countries drawn from Asia, Americas, Europe and Africa carried out in 3 waves. It comprises cross comparative modules with HRS and SHARE on health and retirement, explores attitudes, expectations and behaviours towards later life and retirement, including financial planning for retirement.

Future of Retirement is a series of corporate reports produced for HSBC by the Institute.

Geospatial data and maps

Conflict and political risk

Selected websites:

Event Data on Armed Conflict and Security (EDACS) project compiles and analyses spatially and temporally disaggregated data on the use of violence in the context of civil wars in Sub-Sahara-Africa, starting with the end of the cold war until 2009.

Consolidated List Of Wars (CoLoW) aims at simplifying comparisons of data quality and data collection in the field of quantitative research on the causes and dynamics of war. Through a discussion of problematic cases and data gathering strategies, the aim is to increase transparency regarding the development and use of datasets in the field and make it easier for researchers and practitioners alike to choose the right data for their purposes.

Private Security Database (PSD) collects data on the use of Private Military and Security Companies (PMSCs) by public actors (governments and international organisations) in areas of limited statehood, and asks in general who consumed what kind of private security in failing states (where, for how long). The data are focused on a specific set of countries that experienced state failure or even collapse in at least one year in the period 1990–2007.

Polling and behaviour

Includes the Survey of Consumer Attitudes and Behavior. Undertaken quarterly in the United States of America, the Survey of Consumers measures changes in consumer attitudes and expectations.

International Election Monitoring: Three Global Datasets on Election Quality, Election Events and International Election Observation (ICPSR 31461) is a data collection focusing on elections and election monitoring throughout the world on the national level.

An archive of social science research that makes data available from many key governmental surveys and academic research projects. Content may be downloaded or analysed online on various issues including race, economic wellbeing, voting behaviour and social attitudes.

Includes the British Social Attitudes Survey (BSA). A survey that produces annual measures of attitudinal change. It complements information gathered from large-scale government surveys that deal largely with facts and behaviour patterns, and party political attitudes data produced by polls. The data reflects patterns of continuity and change in political and religious beliefs, social identities, and charts the relative rates at which social attitudes change over time.

The Citizenship Survey provides an evidence base for government policy, principally covering the issues of community cohesion, civic engagement, race and faith, and volunteering.

Selected websites:

Bonds, CDS and interest rates

Includes the All Quotes App that allows users to view a list of all market quotes available for a chosen bond or swap.

The Bond Calculator App performs in-depth price and yield analysis on a bond, including future cash flows and sensitivity analysis.

The Best Broker Quotes App provides a unique and exclusive overview of the global Emerging Eurobond markets, consolidating the quotes from the world’s leading interdealer brokers.

There’s the Bond Curve Overview for World Government Bond Curves.

Bond Futures allows users to monitor and analyse bond futures deliverable basket information, such as cheapness-to-deliver and cash-and-carry, perform hedging simulations, etc.

There’s CDS for a Credit Default Swap overview.

Corporate Bond Prices includes criteria and a real-time based screener, allowing you to identify and monitor corporate bonds based on their issuer, sector, price changes from up to 3 price sources at once, etc.

Fixed China Analytics provides market statistics, analytic reports and macro-economic charts for the fixed income market in China.

Includes OTC Markets. Access comprehensive, timely and accurate data available on the 10K securities that trade on the OTCQX, OTCQB and OTC Pink Marketplaces.

  • Access closing quote and trade data
  • Key security reference data includes Security Type, Security Class, Security Status and Number of Market Participants

TRACE. All broker-dealers who are FINRA member firms have an obligation to report transactions in TRACE-eligible securities. FINRA is the Financial Industry Regulatory Authority, a non-governmental regulator of the entire securities industry. It was formed in the summer of 2007 from the NYSE and the NASD.

There are several categories of securities in TRACE:

  • BTDS: corporate bonds (US dollar-denominated, investment grade and high yield)
  • ATDS: US government agency bonds
  • SPDS: securitized products including asset-backed securities and mortgage-backed securities. WRDS separates SPDS by Sub-Product Type into SPDS-ABS, SPDS-CMO, SPDS-MBS, SPDS-TBA
  • BTDS144A: corporate bonds falling under Rule 144a of the Securities Act of 1933
  • SPDS144A: securitized products falling under Rule 144a of the Securities Act of 1933.

Federal Reserve Bank Reports. Interest Rates (Federal Reserve Board’s H.15 Report). The WRDS RATES database is based upon the Federal Reserve Board’s H.15 release that contains selected interest rates for US Treasuries and private money market and capital market instruments. All rates are reported in annual terms. Daily figures are for business days and monthly figures are averages of business days unless otherwise noted.

Selected websites:

Futures, options and commodities

The Commodities App is the best way to monitor, analyse and research the commodities market at a glance.

The CME Group Guide App is available for futures, spreads, options, and related information. Energy, Agriculture, Metals, FX, Interest Rates and Index Futures.

Commodity Polls for forecasts collected by Reuters and LSEG from top experts on commodities.

The Commodities Document Library is a key way to access any kind of resources related to commodities.

Crack Spread Chart provides inter-market analysis charting showing the WTI Crack Spread.

The International Monertary Fund (IMF) Primary Commodity Prices (PCP) database includes monthly data from 1980 onwards. The index, maintained by the IMF, tracks prices of internationally traded primary commodities, including industrial metals, foodstuffs, beverages, agricultural raw materials and fuels. It reports benchmark prices that are representative of the global market, determined by the largest exporter of a given commodity. It differs from the World Bank’s (WB) Commodity index as the WB's basket, which is designed to be representative of developing countries, does not include advanced economies' trade for the purposes of constructing the index.

The International Monetary Fund (IMF) World Economic Outlook (WEO) database contains selected macroeconomic data series from the statistical appendix of the World Economic Outlook report, which presents the IMF staff's analysis and projections of economic developments at the global level, in major country groups and in many individual countries.

The International Energy Agency (IEA) World Energy Prices database includes annual energy prices data for gasoline, automotive diesel, electricity and other products.

Selected websites

Company fundamentals

Includes the Advanced Filings App for criteria based searches for company filings.

Selected websites

Currencies and exchange rates

Includes the FX Polls App for foreign exchange forecasts from Reuters Polls. Access foreign exchange forecasts for 1, 3, 6 and 12 month horizons.

As one of North America’s primary marketplaces for the trading of stocks, equity options, index options and currency options, the Philadelphia Stock Exchange (PHLX) continues to be a market leader in the development and introduction of innovative new products and services. United Currency Options Market offers choice of expiration date, strike price, etc and any combination of 10 currencies available.
Federal Reserve Bank Reports. Foreign Exchange Rates (Federal Reserve Board’s H.10 Report). The WRDS FX database is based upon the Federal Reserve Board’s H.10 release and contains Foreign Exchange rates for over 30 world currencies and trade-weighted indices. WRDS carries all of these FX rates in currency units per U.S. dollar, e.g. yen/$, and a few are also available in “inverted form”, e.g. $/pound.

Selected websites

ESG

M&A and corporate ownership

Along with officers & directors' details, ownership, insiders and Institutional profiles are available.
The Companies Deals App provides an overview of a company's M&A activity, plus equity, bond & syndicated loan issues.

Compustat for extensive debt and equity capital structure for thousands of global public and private companies.
Includes: Execucomp for executive compensation data collected directly from each company’s annual proxy (DEF14A SEC form).

People Intelligence covers over 4.5 million professionals and over 2.4 million people including private and public company executives, board members, and investment professionals, globally. Each professional in the Capital IQ database has a distinct profile which can include contact details, biography, education, job functions and titles, board memberships, compensation, insider activity, and options holdings.

Selected websites

Market and industry research

DMEF Academic Data - Direct Marketing Educational Foundation contains customer buying history for about 100,000 customers of nationally known catalogue and non-profit database marketing businesses.
Corporate names are anonymous and customer names and addresses have been removed, but the business type is indicated. ZIP codes have been retained (if possible) to provide a potential link to Census ZIP level demographics.

Private equity, venture capital and hedge funds

Selected websites

Real estate

Selected websites

Stocks, indexes and public funds (ETFs & mutuals)

Includes the All Quotes – Equity App to view a list of all market quotes available for a given equity. Covers all venues/ADRs/Classes/Security Type.
The Argus App provides an overview of the commodity content from Argus.
The All Quotes – Equity App allows users to view a list of all market quotes available for a given equity. Includes all venues/ADRs/Classes/Security Types.
Portfolio Intraday allows you to monitor all the assets/securities within your portfolio in (near) real time.

Compustat Fundamentals provides standardized North American and global financial statement and market data for over 80,000 active and inactive publicly traded companies that financial professionals have relied on for over 50 years.

CBOE Indexes CBOE (Chicago Board Options Exchange) Volatility Index (VIX) is a key measure of market expectations of near-term volatility conveyed by S&P 500 stock index option prices. The New VIX still measures the market’s expectation of 30-day volatility, but in a way that conforms to the latest thinking and research among industry practitioners. The New VIX is based on S&P 500 index option prices and incorporates information from the volatility “skew” by using a wider range of strike prices rather than just at-the-money series.

Intraday Indicators by WRDS (IID) contains daily stock market indicators obtained from NYSE TAQ data. At daily frequency, it provides per-stock variables such as volume, returns, and a variety of others.

Event Study by WRDS. The event studies are widely used by empirical researchers in finance, economics, accounting, law, and other business disciplines to analyse the market reaction to firm-specific and market-wide events using either returns or volume around the time when the event occurred.

WRDS SEC MIDAS offers Market Information Data and Analytics System (MIDAS) to promote a better understanding of the U.S. equity markets and market structure. WRDS SEC MIDAS contains the Individual Security Metrics published by SEC MIDAS. The Individual Security Metrics provides market trading metrics for over 8,300 securities (stocks and exchange-traded portfolios).

As one of North America’s primary marketplaces for the trading of stocks, equity options, index options and currency options, the PHLX continues to be a market leader in the development and introduction of innovative new products and services. United Currency Options Market offers choice of expiration date, strike price, etc and any combination of 10 currencies available.

Historical SPDJI. Access the largest global resource for essential index-based concepts, data and research.

S&P Dow Jones Indices is a division of S&P Global which provides essential intelligence for individuals, companies, and governments to make decisions.

World Indices by WRDS. Country total return indices (with dividends). 40+ countries. Daily and monthly frequencies.

CRSP. See above.

Selected websites

Trade analysis and news articles

Conceptual focus

What are your goals? Clearly define your geographical area, time period and the coverage required. Try thinking about the ways in which potential data might be gathered. For instance, by a government department, nongovernmental or intergovernmental organisation, private business or industry group, or academic researchers.

Databases and repositories

If your data need falls within the finding data themes covered by this guide, browse resource lists and interrogate thoroughly what databases and selected websites have to offer. Help pages, promotional material and even helpdesks are often available.

If your data theme is not covered, consult subject guides and the A-Z list of databases. Our team of subject liaison and site librarians always welcome enquiries and may be able to offer specialised advice.  

Along with the Google Dataset SearchData Commons is an initiative from Google to organise the world's publicly available data and make it more accessible and useful with the use of AI.

Data Citation Index is a point of access to search and assess quality research data from international data repositories across disciplines. For an overview, please view our Web of Science guide

Our Research Data Management pages include selected data repositories (along with sections on data management, metadata and ethics) for each of the UCL faculties. 

Please note due to the very high costs involved, we’re not always able to rapidly acquire new databases, but we do review subscriptions and would like to hear from UCL departments about their priorities in order to support teaching and research.      

Publication search

Find material which adopt a similar empirical approach or cite a specific dataset. Such content might be readily available (try the options above) or the researchers involved may be willing to assist directly. Use Explore, as part of your literature review, to search for research studies based on secondary analysis of available datasets. Material on your topic may cite relevant data providers, or volumes with statistical tables may identify sources of data.

Library Services also provides access to a wide range of bibliographic databases for finding journal articles and a range of other material. Along with subject guides, your site or subject liaison librarian will be able to advise you of relevant databases.

UCL’s research community

To find and re-use data deposited by UCL researchers, you can perform basic and advanced searches in the UCL Research Data Repository. To search across all of Figshare, enter search terms and filter on the left based on content type, date range, licence, item type, source and category. Once filter parameters have been selected, click ‘Apply filters’ to apply.

Meanwhile, UCL Profiles can help you to discover our staff and doctoral researchers. Find out about their research and teaching activities, collaborations, industry partnerships, publications and more. Search by name, keyword or discipline to identify people and their expertise.

Energy

Selected websites

The environment

Selected websites