---
title: "About HarZaviyaBot"
description: "Compare how Pakistani outlets cover the same story, side by side — the same news across every outlet."
url: https://harzaviya.com/about-bot.md
site: HarZaviya
language: en
---

# About HarZaviyaBot

**HarZaviyaBot** is the crawler behind [HarZaviya](https://harzaviya.com/). It fetches the public RSS/Atom feeds of Pakistani news outlets to build one combined headline feed that links back to each outlet.

It identifies itself with this User-Agent:

```
HarZaviyaBot/0.1 (+https://harzaviya.com/about-bot)
```

## How it behaves

- **Public feeds only.** It reads RSS/Atom feeds, and — to fill in a missing thumbnail or summary — the Open Graph metadata of an article's own public page. It never stores or republishes the full text of an article.
- **It identifies itself** with the User-Agent above, which links here.
- **Conditional requests.** It sends `ETag` / `If-Modified-Since` so it only downloads a feed when something has changed.
- **Gentle pace.** It checks each feed roughly once every 20 minutes and throttles any per-article requests.
- **Honors robots.txt.**

## Contact & opt-out

If you run an outlet and would like HarZaviyaBot to stop, want a different feed used, or have any concern, email hello@harzaviya.com — or simply disallow the `HarZaviyaBot` User-Agent in your `robots.txt` and it will comply.

## For agents reading this site

Every public page on HarZaviya is available as markdown: send `Accept: text/markdown`, or add `.md` to the path (for example `/stories/123-slug.md` or `/gold-prices.md`). The response carries `Content-Type: text/markdown` and an estimated `x-markdown-tokens` header. Please keep to the same rules we keep with the outlets: headlines and excerpts belong to the outlets that wrote them, and HarZaviya's figures are what outlets reported, never market data.

Our [content signals](https://contentsignals.org/) are in `robots.txt` and on every markdown response: `search=yes, ai-input=yes, ai-train=no`. Index us, cite us and link back; do not train on the outlets' text, which is not ours to give.

---

HarZaviya compares how Pakistani outlets cover the same story. It stores and shows each outlet's headline and a short excerpt, and links out — it never copies article text, and every headline belongs to the outlet that wrote it. It takes no stance on any outlet.

Pages: [Top stories](https://harzaviya.com/) · [Latest headlines](https://harzaviya.com/feed) · [Archive](https://harzaviya.com/archive) · [Why](https://harzaviya.com/why) · [Sources](https://harzaviya.com/sources) · [Methodology](https://harzaviya.com/methodology) · [About](https://harzaviya.com/about) · [About the bot](https://harzaviya.com/about-bot)
Trackers: [Gold prices](https://harzaviya.com/gold-prices) · [Fuel prices](https://harzaviya.com/fuel-prices) · [Stock exchange](https://harzaviya.com/stock-exchange)

Any page on this site is available as markdown: send `Accept: text/markdown`, or add `.md` to the path.