Data Collection

2 posts

google2 min readCurated summary

Four ways Google Research scientists have been using Empirical Research Assistance

Empirical Research Assistance (ERA) is being used by Google researchers to tackle practical scientific problems rather than only benchmark exercises. Early applications span public-health forecasting, cosmology, and climate monitoring, showing that AI can improve prediction, solve difficult mathematical problems, and extract new value from existing data. The results suggest ERA could make advanced computational research more accessible while producing interpretable, scientifically grounded models. ## Public Health Forecasting - Google expanded ERA-based hospitalization forecasts from COVID-19 to influenza and RSV. - The team submits weekly forecasts for every U.S. state, covering horizons of up to four weeks. - Google forecasts have performed at or near the top of public CDC flu and COVID-19 leaderboards, with similarly strong internal results for RSV. - Forecast accuracy is evaluated using the Weighted Interval Score on log-transformed hospitalization data. - This approach could broaden access to epidemiological modeling and support forecasting for more diseases and regions. ## Cosmology: Cosmic Strings - Cosmic strings are theoretical spacetime defects that may emit gravitational radiation. - Calculating their radiation spectrum is difficult because the governing equations contain singularities. - Earlier work found only a partial solution for a square loop with an angle of 90 degrees. - By combining ERA with Gemini Deep Think, researchers derived six general solutions and a concise formula for the asymptotic limit. - The result demonstrates how AI systems can help explore advanced mathematical techniques and address previously unsolved cosmological problems. ## Climate Monitoring with Weather Satellites - Existing CO₂ satellites provide highly precise but infrequent and geographically limited measurements. - Geostationary satellites such as GOES East scan large areas every 10 minutes, but were not designed to measure CO₂. - Researchers used ERA to create a physics-guided neural network that combines: - 16 GOES East wavelength bands - Lower-troposphere meteorology - Solar angles - Time of year - Trained using sparse OCO-2 and OCO-3 observations, the model estimated column-averaged CO₂ continuously across the satellite’s coverage area. - Comparisons with independent satellite and ground-based observations showed that it captured real CO₂ variation. - The work illustrates how AI can repurpose existing instruments and improve the value of expensive scientific datasets. ERA’s early applications indicate that AI-assisted empirical software can support accurate forecasting, novel mathematical discovery, and higher-resolution environmental monitoring. Its greatest potential may lie in combining domain expertise with existing data and infrastructure to solve problems that would otherwise require substantial time and specialized resources.

Read original(opens in new tab)
google3 min readCurated summary

WAXAL: A large-scale open resource for African language speech technology

WAXAL is an open speech dataset designed to address the severe lack of technology resources for African languages. Covering 27 Sub-Saharan African languages spoken by more than 100 million people, it offers 1,846 hours of transcribed speech for ASR and over 565 hours of high-quality recordings for TTS under the permissive CC-BY-4.0 license. Built with African academic and community organizations, WAXAL aims to support inclusive speech systems while preserving and expanding access to the continent’s linguistic diversity. ## The Need for African-Language Speech Data - Voice assistants and transcription tools primarily support high-resource languages. - Hundreds of millions of African speakers remain underserved, despite Sub-Saharan Africa having more than 2,000 languages. - Limited training data makes it difficult to build accurate systems for tonal, morphologically complex, and code-switching languages. - WAXAL was developed beginning in 2021 to provide openly accessible resources for research and commercial innovation. ## WAXAL-ASR: Natural, Spontaneous Speech - Contains approximately 1,846 hours of transcribed audio. - Participants described image prompts across more than 50 topics rather than reading prepared scripts. - The method captured: - Natural linguistic variation - Tonal distinctions - Spontaneous speech patterns - Code-switching - Image-based elicitation produced more realistic speech data than conventional scripted recordings. ## WAXAL-TTS: High-Quality Voice Recordings - Includes more than 565 hours of phonetically balanced, high-fidelity audio. - Community members collaborated in pairs to create scripts of 10,000–20,000 words and alternate between reading and recording. - Some participants built custom studio boxes to improve recording quality. - Audio was segmented, aligned with transcripts, and reviewed for accuracy. - The clean recordings support natural-sounding synthetic voices and conversational systems. ## Supporting Full-Duplex Conversational Systems - The ASR data represents varied, real-world speech input. - The TTS data provides high-quality material for generating clear and natural speech. - Together, the datasets can support systems that both understand and respond using African languages. ## Community-Led Development - African universities and community organizations led the data collection, with guidance from Google Research. - Makerere University contributed data for nine languages. - The University of Ghana worked on eight languages, including image-prompted ASR collection. - Digital Umuganda and Addis Ababa University supported ASR collection for regional languages. - Media Trust, Loud n Clear, and the African Institute for Mathematical Sciences Senegal led studio-quality TTS recordings. - Partners retain ownership of the data while making it openly available under CC-BY-4.0. ## Research Enabled by the Project - A community-driven impaired-speech collection cookbook produced an open Akan dataset covering conditions such as cerebral palsy and stammering. - A separate project introduced a 5,000-hour corpus for five Ghanaian languages: Akan, Ewe, Dagbani, Dagaare, and Ikposo. - Benchmarking of Whisper, XLS-R, MMS, and W2v-BERT across 13 African languages showed that scaling benefits depend on linguistic complexity and domain alignment. - A literature review cataloged 74 datasets spanning 111 African languages and emphasized the need for conversational, multi-domain data and metrics such as Character Error Rate (CER). WAXAL provides a strong foundation for building more accurate and inclusive African-language speech technologies. Researchers and developers should use the openly licensed corpus, contribute derivative work, and help extend the collection to additional languages and communities.

Read original(opens in new tab)