Collection
How to gather raw data from APIs, web scraping, streaming sources, and open data repositories.
8 articles
-
Operational Telemetry, Explained for the Person Reading the Dashboard
Why that little dashboard you check for two seconds a day exists — and how it lets one person keep tabs on far more systems than they could ever check by hand.
🍎 Low Hanging Fruit -
Start With Data Stakeholders Already Trust
Building analytics on well-known public datasets earns stakeholder credibility before you write a single custom pipeline. Once the framework proves itself on familiar ground, automation and analytics compound the value without the credibility risk.
🍎 Low Hanging Fruit -
The Golden Age of API Access Is Over
Free, open, and generous API access was a brief anomaly. Understand what changed, why it happened, and how to adapt your data collection strategies.
🍎 Low Hanging Fruit -
Working with WebSockets and Streaming Data
Move beyond request-response APIs and collect real-time data streams using WebSockets — with practical examples for market data, news feeds, and social platforms.
🌳 High Hanging Fruit -
Low-Hanging Data Sources for Stock Market Prediction
A curated list of freely accessible data sources and their supporting research literature for augmenting stock prediction models — starting with the easiest wins.
🌳 High Hanging Fruit -
Pulling Data from REST APIs
Use HTTP requests to fetch structured data from any REST API — including authentication, pagination, rate limiting, and error handling.
🍎 Low Hanging Fruit -
Working with CSV and JSON
The two most common data formats explained — how to read, write, convert, and handle the edge cases that always come up.
🍎 Low Hanging Fruit -
Getting Started with Data Collection
Understand data sources, formats, and the basic workflow for collecting and organizing data before you write a single line of code.
🍎 Low Hanging Fruit