Web Intelligence Stack
A beautiful website nobody finds is an expensive business card. In 2026, visibility means three things: ranking on Google (SEO), being cited by AI answer engines (AEO), and being trusted by LLMs (GEO). Here is how FreeMalta built for all three.
Firecrawl runs on a Cloudflare cron trigger. Every 2 hours it scrapes each source and returns clean markdown — no HTML noise, no JavaScript rendering issues, no bot detection. Claude API receives content it can actually read. The News Beast pipeline runs without maintenance.
Supabase D1 (SQLite at Cloudflare's edge) stores the article. Cloudflare Worker serves requests from the nearest edge node — Frankfurt for Malta readers. No origin server hit for cached content. TTFB: ~80ms.
The full pipeline costs under €20/month at current News Beast traffic. Scale 10x — still under €50/month. This is the architecture that makes programmatic SEO economically viable.
Supabase D1 (store at edge) → Cloudflare KV (cache) →
Cloudflare Worker (serve · 80ms TTFB) → IndexNow (submit to Google)
Programmatic SEO is the practice of creating large numbers of unique, data-driven pages at scale — each targeting a specific search query. The key word is unique. Not duplicated content with one word changed. Genuinely different pages, each with its own data, schema and metadata.
| Property | Template logic | Example slug | Scale |
|---|---|---|---|
| Pharmacy Tool | 1 template × locality × pharmacy × opening hours | /pharmacies/sliema |
400+ pages |
| Markets / Garage | 1 template × company × sector + category pages | /markets/company-stories/acme-igaming |
300+ pages |
| News Beast | 1 template × article × category × date | /news/igaming/article-slug |
27/day · growing |
| Hub Partners | 1 template × partner × category | /hub/partners/deel |
44 partner pages |
| Hub Stacks | 1 template × stack × FAQ schema | /hub/outbound-sales |
8 stack pages |
Every page type has a matching schema implementation — Local Business + Rating for pharmacy pages, NewsArticle for News Beast, Organization + FAQ for hub pages. Schema is injected via PHP template, not manually per page. Write the template once. Generate the schema a thousand times.
News Beast publishes 27 articles per day. Without proactive indexing, Google's crawler might take days to discover new content. Indexing speed is a competitive advantage in news.
In 2026, an increasing share of information retrieval happens not through Google, but through AI interfaces. Users ask Perplexity, ChatGPT or Claude a question and get a synthesised answer with citations. The sites that get cited are the new page 1.
llms.txt is an emerging standard (analogous to robots.txt) that tells LLMs what content on your site is available and how it's structured. MCP (Model Context Protocol) — Anthropic's open standard — goes further: it allows AI agents to directly query your database or APIs without scraping your website. FreeMalta's live data could be surfaced by a Claude agent via MCP, returning current figures rather than cached web content.
FreeMalta's 2,000+ indexed pages of unique Malta-specific data are exactly what AI answer engines need — specific, verifiable, regularly updated, with clear authorship. The citation is the new backlink.
AI agents. Automated newsrooms. Workflows that run while you sleep.