Top Sites>Digital Customer Journey & User Behavior Analytics Platform | RealityMine

# ---------------------------------------------------------
# Global Rules (apply to all crawlers)
# ---------------------------------------------------------
User-agent: *
# Block access to WordPress admin area
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

# Block feed URLs to prevent duplicate content indexing
Disallow: */feed

# Block search result pages and filtered content to avoid low-value indexing
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

# Sitemap location for better indexing efficiency
Sitemap: https://www.realitymine.com/sitemap.xml

# ---------------------------------------------------------
# AI & LLM Bot Access (explicit, follows same global rules)
# ---------------------------------------------------------
# AI usage preferences: /llms.txt


# OpenAI
User-agent: GPTBot
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=


User-agent: OAI-SearchBot
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

User-agent: ChatGPT-User
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

# Perplexity bots
User-agent: PerplexityBot
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

User-agent: Perplexity-User
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=


# Anthropic (Claude) bots
User-agent: ClaudeBot
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

User-agent: Claude-Web
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

User-agent: anthropic-ai
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

User-agent: Claude-User
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

User-agent: Claude-SearchBot
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=


# Meta (Facebook/Instagram) AI agents
User-agent: meta-externalagent
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

# DeepSeek AI bots
User-agent: DeepSeekBot
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

# Google Gemini AI bot
User-agent: Google-Extended
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

# Potential new Gemini crawler (future-proof)
User-agent: Gemini-Deep-Research
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

# Apple
User-agent: Applebot
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=

# Apple (Apple Intelligence / Siri)
User-agent: Applebot-Extended
Disallow: */feed
Disallow: /*?from=
Disallow: /*?utm_
Disallow: /*?trk=
Disallow: /*?__hstc=
Disallow: /*?__hssc=
Disallow: /*?__hsfp=


Sitemap: https://www.realitymine.com/sitemap.xml

# RealityMine: Digital Customer Journey & User Behavior Analytics Data Provider


> RealityMine is a leading measurement technology company that enables brands and agencies to make informed decisions through privacy-first, real-world consumer digital behavior and advanced user behavior. Our technology captures cross-platform interactions across apps, web, social media, and streaming services to reveal the full spectrum of the digital customer journey.


## Realitymine
- [Home](https://www.realitymine.com/): The central entry point for RealityMine, offering an overview of our cross-platform behavioral data collection, measurement capabilities, and consumer journey analytics services.


## Use Cases
- [Use Cases Overview](https://www.realitymine.com/use-cases): How teams across product, marketing, media, and research functions leverage cross-platform behavioral data to solve specific business challenges.
- [Competitive Intelligence](https://www.realitymine.com/competitive-intelligence): Access cross-platform intelligence on competitor app usage, feature development, pricing strategies, and market share across digital channels.
- [Product Strategy](https://www.realitymine.com/product-strategy): Track consumer behavior across entire product categories to inform development decisions with data beyond your own first-party data.
- [Advertising Intelligence](https://www.realitymine.com/advertising-intelligence): Track ad exposure and consumer actions across walled gardens, enabling the linking of touchpoints to outcomes like app downloads and purchases.
- [Audience Measurement](https://www.realitymine.com/audience-measurement): Passive, content-level behavioral data collection for comprehensive digital, streaming, and cross-device audience measurement.




## Solutions
- [Solutions Overview](https://www.realitymine.com/solutions): RealityMine's behavioral data solutions across app & web usage, social media engagement, streaming consumption, advertising exposure, e-commerce behavior, and cross-platform user journeys.
- [App & Web](https://www.realitymine.com/app-web): Cross-platform and cross-device behavioral data tracking user engagement across apps and websites on iOS, Android, Windows and Mac, revealing usage patterns across multiple platforms with privacy-first measurement.
- [Social Media](https://www.realitymine.com/social-media): Engagement data measuring how real users interact with content, creators and competitors across major social platforms, beyond surface-level metrics.
- [Streaming Media](https://www.realitymine.com/streaming-media): Streaming consumption data measuring content performance, viewer engagement, platform loyalty and churn across video and audio streaming services.
- [Advertising Insights](https://www.realitymine.com/advertising-insights): Digital ad exposure and post-view behavioral data tracking user responses to advertising across devices and platforms.
- [E-Commerce](https://www.realitymine.com/ecommerce): Online shopping behavioral data tracking the full digital path to purchase, including searches, product views, cart behavior and conversion touchpoints.
- [User Journey](https://www.realitymine.com/user-journey): Cross-platform journey data mapping how users move across touchpoints, platforms and devices from awareness to conversion.


## Company
- [About Us](https://www.realitymine.com/about-us): Overview of RealityMine's mission, privacy-first approach, and expertise in consumer digital behavior.
- [Leadership Team](https://www.realitymine.com/meet-the-team): Profiles of the executive leadership and experts driving RealityMine's innovation.
- [Careers](https://www.realitymine.com/careers): Current job openings and information on company culture and the innovation team.
- [Awards & Certifications](https://www.realitymine.com/awards): List of industry recognition and certifications in consumer data and measurement excellence.


## Insights
- [Insights Hub](https://www.realitymine.com/insights): Central resource for market trends, best practices, and innovations in digital behavior analytics.


### Blog & Articles
- [Blog Overview](https://www.realitymine.com/articles): Archive of articles covering digital behavior, industry trends, and strategic insights.
- [AI Agents at RealityMine Hackathon](https://www.realitymine.com/articles/from-chatbots-to-colleagues-ai-agents-at-realitymine-hackathon): Recap of internal exploration into AI agents for workplace efficiency and collaboration.
- [What Happens When Anyone Can Write Software?](https://www.realitymine.com/articles/what-happens-when-anyone-can-write-software): Analysis of how AI lowers barriers to software creation and the persisting need for human guidance.
- [What to measure when you could measure 'everything'?](https://www.realitymine.com/articles/what-to-measure-when-you-could-measure-everything): Strategies for balancing user experience with effective data collection in a data-rich environment.
- [Why market research will still matter despite AI](https://www.realitymine.com/articles/why-market-research-will-still-matter-despite-ai): Discussion on the enduring value of traditional market research methods alongside AI advancements.
- [Who Is Your Real Competition?](https://www.realitymine.com/articles/who-is-your-real-competition-obvious-answers-can-be-misleading): Insights on identifying indirect competitors, using Subway and McDonald's as a case study.
- [User Journeys in a Post-Privacy World](https://www.realitymine.com/articles/user-journeys-in-a-post-privacy-world): Methodologies for understanding user journeys as traditional tracking methods become obsolete.
- [The App Economy’s Blind Spot](https://www.realitymine.com/articles/the-app-economys-blind-spot-why-first-party-data-isnt-enough): Analysis of why first-party data is insufficient for a complete view of user behavior in the app economy.
- [Three Takeaways from Big Data LDN](https://www.realitymine.com/articles/three-takeaways-from-big-data-ldn-why-data-still-comes-down-to-fundamentals): Key trends from Big Data LDN 2025 regarding AI adoption, data quality, and integrated platforms.
- [Promos And Consumer Decisions](https://www.realitymine.com/articles/promos-and-consumer-decisions): Data analysis on why "free" promotions often outperform percentage discounts in food delivery.
- [The Attention Cascade](https://www.realitymine.com/articles/the-attention-cascade-where-users-go-when-they-leave-your-app): Investigation into app switching behavior and user flow patterns.
- [Unlocking the Power of Behavioural Data](https://www.realitymine.com/articles/unlocking-the-power-of-behavioural-data-for-strategic-decisions): How behavioral data differentiates between what consumers say and what they actually do.
- [Prime Day Check-in](https://www.realitymine.com/articles/prime-day-check-in-is-chatgpt-really-changing-how-people-shop): Data regarding the impact (or lack thereof) of ChatGPT on Amazon Prime Day shopping behaviors.
- [How ChatGPT Is Already Changing Discovery](https://www.realitymine.com/articles/how-chatgpt-changing-discovery-is-just-the-beginning): Examination of how AI tools are reshaping product discovery and search experiences.
- [Big Brands, Small Share](https://www.realitymine.com/articles/food-delivery-big-brands-vs-local-chains): Market analysis of food delivery, contrasting big brand dominance with local chain performance.
- [From Ideas to Action: Hackathon Highlights](https://www.realitymine.com/articles/from-ideas-to-action-highlights-from-our-ai-agents-hackathon): Showcase of innovative projects from the RealityMine AI Agents Hackathon.
- [The Discount Dilemma](https://www.realitymine.com/articles/discount-dilemma-promos-pay-off): Analysis of how discount usage impacts long-term order value and consumer spending.
- [AI, Data, and Consumer Insight](https://www.realitymine.com/articles/ai-data-shifting-landscape-of-consumer-insight): How AI is reshaping consumer insights through enhanced data analysis.
- [Building the AI-Powered Future](https://www.realitymine.com/articles/building-the-ai-powered-future): Exploration of predictive analytics and real-time insights in market research.


### News
- [News Overview](https://www.realitymine.com/news): Latest headlines, industry announcements, and press coverage regarding RealityMine.
- [RealityMine and On Device Partnership](https://www.realitymine.com/news/realitymine-and-on-device-partner-to-launch-groundbreaking-passive-social-media-ad-measurement-technology): Announcement of the partnership to launch passive social media ad measurement technology.
- [ChatGPT isn’t reshaping Prime Day shopping — yet](https://www.realitymine.com/news/chatgpt-isnt-reshaping-prime-day-shopping-yet): News release on data findings concerning AI tools and their current impact on e-commerce events.
- [US Consumers Use 18 Apps a Day](https://www.realitymine.com/news/us-consumers-use-18-apps-a-day): Research findings on US smartphone usage patterns and app concentration.


### Case Studies
- [Breaking Through Walled Gardens](https://www.realitymine.com/case-studies/breaking-through-walled-gardens-to-unlock-actionable-social-media-insights): How to harness first and third-party data to unlock actionable insights within social media walled gardens.
- [The Say-Do Gap in Streaming](https://www.realitymine.com/case-studies/what-are-viewers-really-watching-exploring-the-say-do-gap-in-streaming-content-research): Research exploring the discrepancy between reported viewing habits and actual streaming content consumption.
- [Winning The Food Fight](https://www.realitymine.com/case-studies/winning-the-food-fight-the-secret-ingredient-to-beating-the-competition): Key findings on how food delivery brands can use competitive intelligence to outperform rivals.
- [Streaming Habits in APAC](https://www.realitymine.com/success-stories/uncovering-detailed-consumption-habits-of-streaming-services-across-apac): Success story detailing the consumption habits and service usage of streaming audiences across the Asia-Pacific region.
- [Fallout: Cross-Media Influence](https://www.realitymine.com/case-studies/fallout-a-blast-from-the-past): Analysis of how binge-watching the *Fallout* series influenced user behavior and listening trends on music platforms.
- [TikTok Unraveled (Award Winner)](https://www.realitymine.com/case-studies/best-international-media-research-project-at-adwanted-media-research-awards-2024): Award-winning research comparing actual TikTok user behavior against widely held media perceptions.




## Policies & Terms
- [Environmental Policy](https://www.realitymine.com/environmental-policy)
- [Health and Safety Policy](https://www.realitymine.com/health-and-safety-policy)
- [Information Security Policy](https://www.realitymine.com/information-security-policy)
- [Privacy Policy](https://www.realitymine.com/privacy-policy)
- [Quality Policy](https://www.realitymine.com/quality-policy)
- [Modern Day Slavery and Human Trafficking Policy](https://www.realitymine.com/realitymine-modern-day-slavery-and-human-trafficking-policy)


## Support & Contact
- [Contact Us](https://www.realitymine.com/lets-talk): Form to connect with RealityMine for custom solutions and inquiries.


## Sitemap
- [Sitemap](https://www.realitymine.com/sitemap.xml)