# Market Data Sources

> Supabase-backed market, CRE, listings, REIT, academic, dataset, FRED, and national macro surfaces exposed through curated Corbis tools.

Corbis blends **official U.S. statistics**, **curated commercial real estate data**, **live listing and offering-memo facts**, **academic retrieval**, **dataset discovery**, and **on-demand economic series**. Coverage, update cadence, and geography vary by dataset. Not every metric exists for every market, property type, date, or plan.

The chatbot does not expose raw Supabase tables directly. It routes through curated tools and MCP equivalents, with `getDataCatalog` and `getMetricDefinitions` acting as the safest way to discover what exists right now.

## Main Supabase-backed surfaces

- **Economic and demographic market data** - `cbsa_market_data`, `time_series`, `national_macro`, `data_freshness`, `cbsas`, and `airport_activity` power `getMarketData`, `getMetricDefinitions`, `compareMarkets`, `searchMarkets`, `screenMarkets`, `getMarketTrends`, `getNationalMacro`, and map/scatter visualizations.
- **CRE transaction and asking-side analytics** - the `credeals` schema powers `getCREMarket`, `searchCREMarkets`, `getCRETrend`, `getCREComps`, `searchCREListings`, `getCREOperating`, and `getREITTransactionCaps`.
- **Academic and research retrieval** - `academic_documents`, chunks, sections, authors, journals, embeddings, and hybrid-search RPCs power paper search, paper details, literature search, research opportunity maps, top-cited articles, and researcher lookup.
- **Dataset discovery** - open-dataset metadata powers `searchDatasets`. Dataset discovery helps find sources; it is not the same thing as querying every underlying dataset.
- **Private app data** - chats, projects, documents, files, workflows, billing, and organization records are user-scoped. They are not part of the public market-data surface and require authenticated product tools.
- **FRED direct API** - `fredSearch` and `fredSeriesBatch` query FRED directly for additional economic series outside the Supabase tables.

Below, each source family matches source names and categories currently used by tool schemas, the live metric catalog in `data_freshness._metric_definitions`, or the `credeals` tooling layer.

---

## Labor market

- **BLS CES and LAUS** - Metro employment, job change, labor force, and unemployment series (`bls_employment`, `bls_laus`).
- **BLS OEWS and QCEW** - Occupational employment/wage mix and industry employment/wage series (`bls_oews`, `bls_qcew`).
- **Census Quarterly Workforce Indicators (QWI)** - Industry-level hires, separations, turnover, and earnings dynamics where the series is populated (`census_qwi`).
- **Census LODES** - Workplace/residence job flows and sector mix signals (`census_lodes`).

---

## Housing and real estate

- **Census Building Permits Survey (BPS)** - New-construction and supply-pipeline signals.
- **FHFA House Price Index (HPI)** - House-price movement and growth comparisons.
- **HUD Fair Market Rents and LIHTC** - Rent benchmarks, affordable-housing inventory, and low-income housing tax credit indicators where populated (`hud_lihtc`).
- **Zillow Research** - ZHVI, ZORI, inventory, days-to-pending, price-cut share, sale-to-list metrics, and rent/home-value trend context (`zillow`).
- **Housing and affordability pipeline** - `getMarketTrends` accepts source filters such as `housing` and `affordability` for longer metro histories alongside supply and rent-pressure context.

---

## Demographics

- **Census Population Estimates Program (PEP)** - Population levels and growth.
- **American Community Survey (ACS)** - Income, rent, household counts, commute and workforce characteristics, education, poverty, and related demographic context.

---

## Macro and national benchmarks

- **Federal Reserve Economic Data (FRED)** - Macro series via `fredSearch` and `fredSeriesBatch` (CPI, Fed funds, Treasuries, GDP, mortgage and rate context, and other discoverable series).
- **Bureau of Economic Analysis (BEA)** - Regional output and income-style series in metro trend history (`bea`).
- **Curated national macro (`national_macro`)** - In-product national benchmarks such as real GDP, CPI, key Treasury yields, the 30-year mortgage rate, and the Fed funds rate. Use `getNationalMacro` for this table; use FRED tools for ad hoc series.

---

## Business and industry

- **County Business Patterns (CBP)** - Establishment counts, employment, payroll, and industry mix (`census_cbp`).
- **Business Dynamics Statistics (BDS)** - Establishment births, deaths, net formation, and related dynamics (`census_bds`).
- **Business Formation Statistics (BFS)** - Business applications and application intensity (`census_bfs`).
- **Opportunity Insights** - Spending and job-postings momentum style measures where loaded from Affinity or Lightcast-derived sources (`opportunity_insights`).

---

## Financial, lending, and hazard risk

- **FDIC Summary of Deposits** - Banking and deposits-oriented context (`FDIC SOD` / banking metrics).
- **CFPB HMDA** - Mortgage origination and lending-condition signals aggregated for metros (`cfpb_hmda`).
- **FFIEC CRA** - Small-business lending indicators where populated (`ffiec_cra`).
- **SBA FOIA** - SBA loan count, loan amount, jobs-supported, and related small-business credit measures (`sba`).
- **FEMA NRI and OpenFEMA** - Natural-hazard, resilience, disaster-count, and expected-annual-loss indicators used in risk snapshots (`fema_nri` / OpenFEMA).

---

## Migration and tax data

- **IRS Statistics of Income (SOI)** - Tax-return-based migration and income-flow perspectives (`irs_soi`).

---

## Airport connectivity

- **Airport activity metrics** - Where data exists, Corbis can surface airport-oriented measures such as enplanements, enplanements per capita, year-over-year change, national rank, and hub classification. The structured data lives in the market pipeline and `airport_activity`; metric definitions currently cite FAA ACAIS where applicable.

---

## Commercial real estate and listings

- **CMBS / securitized property data** - `credeals.cmbs_properties` and `credeals.cmbs_loans` support property comps and transaction-side CRE metrics. Always read sample sizes such as `cmbs_n` and `cap_rate_n` before treating a median as strong evidence.
- **CRE market index and benchmarks** - `credeals.cre_market_index`, `cre_market_benchmarks`, and `cre_market_timeseries` support metro by property-type snapshots, national benchmarks, annual trends, pooled current-market stats, cap rates, occupancy, vacancy, DSCR, NOI per SF, price per SF, and asking-rent context.
- **Live CRE listings and offering-memo facts** - `credeals.cre_listings` and related listing tables support keyword search, structured filters, listing drill-ins, and optional offering-memo facts through `searchCREListings`.
- **REIT supplementals** - `credeals.cre_operating_fundamentals`, `cre_reit_timeseries`, `cre_reit_transaction_caps`, and `cre_reit_cap_timeseries` support same-store revenue/NOI growth, economic occupancy, effective rent change, and national by-sector REIT acquisition/disposition cap rates.
- **Cap-rate survey surfaces** - survey-derived cap-rate tables may appear in the CRE schema where present. Treat them as curated CRE context rather than a raw public-table surface.

Important caveats:

- REIT transaction cap rates are **national by sector**, not by metro. Use `getCREMarket` for by-metro cap-rate context.
- Listing rents, CMBS transaction economics, REIT same-store growth, and Zillow ZORI are different lanes. Do not merge them into one rent number.
- The current structured market surface does **not** include an absorption metric. Use supply, vacancy, occupancy, listings, and trend metrics instead.

---

## How Corbis uses these sources

Corbis combines the above to power:

- metro snapshots, peer comparisons, and rankings
- multi-factor market screens and map/scatter visualizations
- multi-year `getMarketTrends` history with optional `source` filters matching the pipeline
- CRE metro snapshots, rankings, trends, comps, listings, and REIT-supplemental views
- national overlays via `getNationalMacro` plus broader macro exploration via FRED tools
- academic source retrieval through the research corpus when the question needs papers
- optional web search for context beyond the structured tables

When you need exact figures, rely on the metric labels, source hints, and dates shown in tool output; coverage gaps are expected for some metros and series.