Top Sites>מגזין הטכנולוגיה של ישראל | HT magazine

Sitemap: https://htmag.co.il/wp-sitemap.xml
Sitemap: https://htmag.co.il/feed
Sitemap: https://htmag.co.il/phpbb/app.php/feed

User-agent: Googlebot-Image
Disallow: /

User-agent: Googlebot
crawl-delay: 2
Allow: /
Disallow: /wp-json/
Disallow: /*?rest_route=
Disallow: /*&rest_route=
Disallow: /files/
Disallow: /images/
Disallow: /pir/
Disallow: /modules.php?name=Your_Account
Disallow: /phpbb/memberlist.php
Disallow: /phpbb/posting.php
Disallow: /phpbb/ucp.php
Disallow: /wideyoutube.php
Disallow: /phpbb/app.php/thankslist
Disallow: /phpbb/search.php
Disallow: /out/
Disallow: /out.php
Disallow: /ofer/

User-agent: Bingbot
crawl-delay: 5
Allow: /
Disallow: /wp-json/
Disallow: /*?rest_route=
Disallow: /*&rest_route=
Disallow: /files/
Disallow: /images/
Disallow: /pir/
Disallow: /modules.php?name=Your_Account
Disallow: /phpbb/memberlist.php
Disallow: /phpbb/posting.php
Disallow: /phpbb/ucp.php
Disallow: /wideyoutube.php
Disallow: /phpbb/app.php/thankslist
Disallow: /phpbb/search.php
Disallow: /out/
Disallow: /out.php
Disallow: /ofer/

User-agent: PerplexityBot
crawl-delay: 5
Allow: /
Disallow: /wp-json/
Disallow: /*?rest_route=
Disallow: /*&rest_route=
Disallow: /files/
Disallow: /images/
Disallow: /pir/
Disallow: /modules.php?name=Your_Account
Disallow: /phpbb/memberlist.php
Disallow: /phpbb/posting.php
Disallow: /phpbb/ucp.php
Disallow: /wideyoutube.php
Disallow: /phpbb/app.php/thankslist
Disallow: /phpbb/search.php
Disallow: /out/
Disallow: /out.php
Disallow: /ofer/

User-agent: Applebot
crawl-delay: 5
Allow: /
Disallow: /wp-json/
Disallow: /*?rest_route=
Disallow: /*&rest_route=
Disallow: /files/
Disallow: /images/
Disallow: /pir/
Disallow: /modules.php?name=Your_Account
Disallow: /phpbb/memberlist.php
Disallow: /phpbb/posting.php
Disallow: /phpbb/ucp.php
Disallow: /wideyoutube.php
Disallow: /phpbb/app.php/thankslist
Disallow: /phpbb/search.php
Disallow: /out/
Disallow: /out.php
Disallow: /ofer/

User-agent: facebookexternalhit
crawl-delay: 4
Allow: /
Disallow: /wp-json/
Disallow: /*?rest_route=
Disallow: /*&rest_route=
Disallow: /files/
Disallow: /images/
Disallow: /pir/
Disallow: /modules.php?name=Your_Account
Disallow: /phpbb/memberlist.php
Disallow: /phpbb/posting.php
Disallow: /phpbb/ucp.php
Disallow: /wideyoutube.php
Disallow: /phpbb/app.php/thankslist
Disallow: /phpbb/search.php
Disallow: /out/
Disallow: /out.php
Disallow: /ofer/


User-agent: ChatGPT-User
crawl-delay: 5
Allow: /
Disallow: /wp-json/
Disallow: /*?rest_route=
Disallow: /*&rest_route=
Disallow: /files/
Disallow: /images/
Disallow: /pir/
Disallow: /modules.php?name=Your_Account
Disallow: /phpbb/memberlist.php
Disallow: /phpbb/posting.php
Disallow: /phpbb/ucp.php
Disallow: /wideyoutube.php
Disallow: /phpbb/app.php/thankslist
Disallow: /phpbb/search.php
Disallow: /out/
Disallow: /out.php
Disallow: /ofer/

User-agent: GPTBot
Disallow: /
User-agent: anthropic-ai
crawl-delay: 5
Disallow: /
Disallow: /phpbb/app.php/feed/*
User-agent: Claude-Web
crawl-delay: 5
Disallow: /
Disallow: /phpbb/app.php/feed/*
User-agent: Google-Extended
crawl-delay: 5
Disallow: /
User-agent: Amazonbot
crawl-delay: 5
Disallow: /
User-agent: CCbot
crawl-delay: 5
Disallow: /
User-agent: PiplBot
crawl-delay: 5
Disallow: /
User-agent: Yandex
crawl-delay: 5
Disallow: /
User-agent: SemrushBot
crawl-delay: 5
Disallow: /
User-agent: SemrushBot/7~bl
crawl-delay: 5
Disallow: /
User-agent: SiteAuditBot
crawl-delay: 5
Disallow: /
User-agent: SemrushBot-BA
crawl-delay: 5
Disallow: /
User-agent: SemrushBot-SI
crawl-delay: 5
Disallow: /
User-agent: SemrushBot-SWA
crawl-delay: 5
Disallow: /
User-agent: SemrushBot-CT
crawl-delay: 5
Disallow: /
User-agent: SplitSignalBot
crawl-delay: 5
Disallow: /
User-agent: SemrushBot-COUB
crawl-delay: 5
Disallow: /
User-agent: SemrushBot/2~bl
crawl-delay: 5
Disallow: /
User-agent: SemrushBot/3~bl
crawl-delay: 5
Disallow: /
User-agent: SemrushBot/4~bl
crawl-delay: 5
Disallow: /
User-agent: SemrushBot/5~bl
crawl-delay: 5
Disallow: /
User-agent: SemrushBot/6~bl
crawl-delay: 5
Disallow: /
User-agent: PetalBot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: dotbot
Disallow: /
User-agent: rogerbot
Disallow:/
User-agent: Neticle Crawler
Disallow:/
User-agent: test-bot
Disallow:/
User-agent: Googlebot-Image
Disallow: /

User-agent: *
crawl-delay: 4
Allow: /
Disallow: /wp-json/
Disallow: /*?rest_route=
Disallow: /*&rest_route=
Disallow: /files/
Disallow: /images/
Disallow: /pir/
Disallow: /modules.php?name=Your_Account
Disallow: /phpbb/memberlist.php
Disallow: /phpbb/posting.php
Disallow: /phpbb/ucp.php
Disallow: /wideyoutube.php
Disallow: /phpbb/app.php/thankslist
Disallow: /phpbb/search.php
Disallow: /out/
Disallow: /out.php
Disallow: /ofer/

# HT Magazine LLM Configuration (llms.txt)
# ========================================================
# Site Overview:
SiteName: HT Magazine
URL: https://htmag.co.il
Language: Hebrew
Purpose: Deliver up-to-date technology news, reviews, and insights,
         catering to Israeli tech enthusiasts and professionals.

# ========================================================
# 1. Articles (Primary Focus)
[Articles]
Description: מאמרים, ביקורות וניתוחים של מוצרי קולנוע ביתי, אודיו, וידאו, מסכים, סטרימינג, טכנולוגיה וג'אדג'טים
Categories:
  - Home Theater
  - HT Mobile (Mobile & Wearables)
  - HT Gaming
  - HT Home (Smart Home & Appliances)
  - Additional topics: Photography, Audio, Vehicles, etc.
Metadata Extraction:
  - Title
  - Author
  - Publication Date
  - Summary/Abstract
  - Multimedia (Images, Videos)
Priority: Highest – Use robust summarization techniques ensuring that 
          key details and context remain intact.

# ========================================================
# 2. Forum
[Forum]
Description: Interactive community space for discussions, Q&A, and sharing 
             opinions on tech-related topics.
Structure:
  - Main Forum Index: Lists latest topics, announcements, and discussions.
  - Sub-forums: Organized by specific tech domains or user interests.
Content: User posts, threads, and comments.
Purpose: Enhance community engagement and provide supplementary insights 
         to the main articles.


- [HT forum](https://htmag.co.il/forum): forum links for users
- [HT forum](https://htmag.co.il/phpbb): forum contents


# ========================================================
# 3. Site Purpose & Audience
[SitePurpose]
Mission: Inform and educate readers with accurate, timely, and comprehensive 
         technology news and reviews.
Audience: Tech enthusiasts, consumers, and professionals in Israel.
Goals:
  - Deliver engaging, factual tech content.
  - Foster interactive discussions via the forum.
  - Ensure a seamless and dynamic user experience with rich multimedia support.

- [articles](https://htmag.co.il/blog): blog list and articles
- [articles](https://htmag.co.il/s?=<search>): search for content


# ========================================================
# 4. Technical & Processing Notes
[Processing]
- Language Handling: Primarily Hebrew; some technical English terms.
- Summarization: Prioritize extracting core points and maintaining metadata integrity.
- Flexibility: Allow for periodic configuration updates as new sections or content types emerge.
- Context Preservation: Ensure article narratives and forum threads are processed with full context.

# ========================================================
# End of Configuration File