Top Sites>Berklee

#
# robots.txt
#
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
#
# This file will be ignored unless it is at the root of your host:
# Used:    http://example.com/robots.txt
# Ignored: http://example.com/site/robots.txt
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html

User-agent: *
Crawl-delay: 10
# CSS, JS, Images
Allow: /core/*.css$
Allow: /core/*.css?
Allow: /core/*.js$
Allow: /core/*.js?
Allow: /core/*.gif
Allow: /core/*.jpg
Allow: /core/*.jpeg
Allow: /core/*.png
Allow: /core/*.svg
Allow: /profiles/*.css$
Allow: /profiles/*.css?
Allow: /profiles/*.js$
Allow: /profiles/*.js?
Allow: /profiles/*.gif
Allow: /profiles/*.jpg
Allow: /profiles/*.jpeg
Allow: /profiles/*.png
Allow: /profiles/*.svg
# Directories
Disallow: /core/
Disallow: /profiles/
# Files
Disallow: /README.md
Disallow: /composer/Metapackage/README.txt
Disallow: /composer/Plugin/ProjectMessage/README.md
Disallow: /composer/Plugin/Scaffold/README.md
Disallow: /composer/Plugin/VendorHardening/README.txt
Disallow: /composer/Template/README.txt
Disallow: /modules/README.txt
Disallow: /sites/README.txt
Disallow: /themes/README.txt
Disallow: /web.config
# Paths (clean URLs)
Disallow: /admin/
Disallow: /comment/reply/
Disallow: /filter/tips
Disallow: /node/add/
Disallow: /search/
Disallow: /user/register
Disallow: /user/password
Disallow: /user/login
Disallow: /user/logout
Disallow: /media/oembed
Disallow: /*/media/oembed
# Paths (no clean URLs)
Disallow: /index.php/admin/
Disallow: /index.php/comment/reply/
Disallow: /index.php/filter/tips
Disallow: /index.php/node/add/
Disallow: /index.php/search/
Disallow: /index.php/user/password
Disallow: /index.php/user/register
Disallow: /index.php/user/login
Disallow: /index.php/user/logout
Disallow: /index.php/media/oembed
Disallow: /index.php/*/media/oembed
## CUSTOM
# Directories
Disallow: /sites/default/files/noindex/
Disallow: /sites/default/files/d7/bcm/noindex/
Disallow: /sites/default/files/d7/bcb/noindex/
Disallow: /cdc/
# Paging
Disallow: /*?id=*
Disallow: /*?keys=*
Disallow: /*?sid=*
Disallow: /*?action=*
Disallow: /*?pid=*
Disallow: /*?newwindow=*
Disallow: /*?field_category_tid=*
Disallow: /*?utm_medium=*
Disallow: /*?page=*
Disallow: /*?*&id=*
Disallow: /*?*&keys=*
Disallow: /*?*&sid=*
Disallow: /*?*&action=*
Disallow: /*?*&pid=*
Disallow: /*?*&newwindow=*
Disallow: /*?*&field_category_tid=*
Disallow: /*?*&utm_medium=*
Disallow: /*?*&page=*
# Files
Disallow: *.csv
Disallow: *.doc
Disallow: *.docm
Disallow: *.docx
Disallow: *.dot
Disallow: *.dotx
Disallow: *.exe
Disallow: *.gzip
Disallow: *.ics
Disallow: *.key
Disallow: *.key.zip
Disallow: *.numbers
Disallow: *.ods
Disallow: *.opd
Disallow: *.pages
Disallow: *.pages.zip
Disallow: *.pdf
Disallow: *.pps
Disallow: *.ppsx
Disallow: *.ppt
Disallow: *.pptm
Disallow: *.pptx
Disallow: *.rtf
Disallow: *.tar
Disallow: *.txt
Disallow: *.xls
Disallow: *.xlsb
Disallow: *.xlsm
Disallow: *.xlsx
Disallow: *.zip
# Sitemap overrides
Allow: /*/sitemap.xml*
Allow: /sitemap.xml*
# Llms.txt 
Allow: /llms.txt

# Berklee
> Berklee is the premier institute of music and the performing arts, offering degrees at its campuses in Boston, New York City, and Valencia, Spain, and online.

## Apply
[Apply](https://berklee.my.site.com/onlineapplication/TX_CommunitiesSelfReg)

## Find Your Program
[Find Your Program](https://www.berklee.edu/academics/programs)

## Undergraduate Programs
[Undergraduate Programs](https://www.berklee.edu/undergraduate)

## Graduate Programs
[Graduate Programs](https://www.berklee.edu/graduate)

## Non-degree Programs
[Non-degree Programs](https://www.berklee.edu/academics/non-degree-programs)

## Cost-Saving Paths to Berklee
[Cost-Saving Paths to Berklee](https://www.berklee.edu/student-financial-services/other-sources)

## Student Financial Services
[Student Financial Services](https://www.berklee.edu/student-financial-services)

## Scholarships
[Scholarships](https://www.berklee.edu/scholarships)

## Financial Aid
[Financial Aid](https://www.berklee.edu/student-financial-services/financial-aid)

## Academics
[Academics](https://www.berklee.edu/academics)

## Academic Calendar
[Academic Calendar](https://www.berklee.edu/calendar)

## Undergraduate Admissions
[Undergraduate Admissions](https://college.berklee.edu/admissions/undergraduate)

## Graduate Admissions
[Graduate Admissions](https://college.berklee.edu/admissions/graduate)

## Berklee College of Music
[Berklee College of Music](https://college.berklee.edu/)

## Boston Conservatory at Berklee
[Boston Conservatory at Berklee](https://bostonconservatory.berklee.edu/)

## Berklee Valencia
[Berklee Valencia](https://valencia.berklee.edu/)

## Berklee NYC
[Berklee NYC](https://nyc.berklee.edu/)

## Summer Programs
[Summer Programs](https://summer.berklee.edu/)

## Boston Conservatory
[Boston Conservatory](https://bostonconservatory.berklee.edu)

## Berklee Career Manager
[Berklee Career Manager](https://www.berklee.edu/welcome-berklee-career-manager)

## Boston Conservatory at Berklee Admissions
[Boston Conservatory at Berklee Admissions](https://bostonconservatory.berklee.edu/admissions)

## Online Undergraduate Degree Admissions
[Online Undergraduate Degree Admissions](https://online.berklee.edu/degrees/about/undergraduate-degree-admissions-requirements)

## Online Graduate Degree Admissions
[Online Graduate Degree Admissions](https://online.berklee.edu/degrees/about/graduate-degree-admissions-requirements)


## Cost-Saving Paths to Berklee
[Cost-Saving Paths to Berklee](https://www.berklee.edu/student-financial-services/other-sources)

## About
[About](https://www.berklee.edu/about)

## Facts and Statistics
[Facts and Statistics](https://www.berklee.edu/about/facts-and-statistics)

## History
[History](https://www.berklee.edu/about/brief-history)

## Awards and Achievements
[Awards and Achievements](https://www.berklee.edu/awards/awards-and-achievements)

## Contact Us
[Contact Us](https://www.berklee.edu/contact)

## Events
[Events](https://www.berklee.edu/events)

## News
[News](https://www.berklee.edu/berklee-now)

## Alumni
[Alumni](https://www.berklee.edu/alumni-combined)

## Student Services and Support
[Student Services and Support](https://www.berklee.edu/services-and-support/students)

## Careers in the Performing Arts
[Careers in the Performing Arts](https://www.berklee.edu/careers)

## Boston Campus Map
[Boston Campus Map](https://college.berklee.edu/boston-campus/interactive-campus-map)

## Berklee Online
[Berklee Online](https://online.berklee.edu?pid=6874&c3ch=Affiliate&c3nid=bcm_start_career)

## Arranging
[Arranging](https://www.berklee.edu/academics/programs?filters=210606)

## Composition
[Composition](https://www.berklee.edu/academics/programs?filters=210611)

## Conducting
[Conducting](https://www.berklee.edu/academics/programs?filters=210616)

## Dance
[Dance](https://www.berklee.edu/academics/programs?filters=211871)

## Electronic Music
[Electronic Music](https://www.berklee.edu/academics/programs?filters=210626)

## Engineering
[Engineering](https://www.berklee.edu/academics/programs?filters=210631)

## Entrepreneurship
[Entrepreneurship](https://www.berklee.edu/academics/programs?filters=210636)

## Liberal Arts
[Liberal Arts](https://www.berklee.edu/academics/programs?filters=210651)

## Live Experience Design
[Live Experience Design](https://www.berklee.edu/academics/programs?filters=214696)

## Music Business
[Music Business](https://www.berklee.edu/academics/programs?filters=210656)

## Music Education
[Music Education](https://www.berklee.edu/academics/programs?filters=210661)

## Music History
[Music History](https://www.berklee.edu/academics/programs?filters=210666)

## Music Technology
[Music Technology](https://www.berklee.edu/academics/programs?filters=210671)

## Music Theory, Ear Training, Harmony
[Music Theory, Ear Training, Harmony](https://www.berklee.edu/academics/programs?filters=210681)

## Music Therapy
[Music Therapy](https://www.berklee.edu/academics/programs?filters=210686)

## Performance
[Performance](https://www.berklee.edu/academics/programs?filters=210696)

## Production
[Production](https://www.berklee.edu/academics/programs?filters=210701)

## Scoring (Film, TV, Games)
[Scoring (Film, TV, Games)](https://www.berklee.edu/academics/programs?filters=210706)

## Singing
[Singing](https://www.berklee.edu/academics/programs?filters=210756)

## Songwriting
[Songwriting](https://www.berklee.edu/academics/programs?filters=210711)

## Sound Design
[Sound Design](https://www.berklee.edu/academics/programs?filters=210716)

## Theater
[Theater](https://www.berklee.edu/academics/programs?filters=210676)

## Bass
[Bass](https://www.berklee.edu/academics/programs?filters=210726)

## Brass
[Brass](https://www.berklee.edu/academics/programs?filters=210731)

## Electronic Digital Instruments
[Electronic Digital Instruments](https://www.berklee.edu/academics/programs?filters=213301)

## Guitar
[Guitar](https://www.berklee.edu/academics/programs?filters=210746)

## Percussion
[Percussion](https://www.berklee.edu/academics/programs?filters=210741)

## Piano
[Piano](https://www.berklee.edu/academics/programs?filters=210751)

## Strings
[Strings](https://www.berklee.edu/academics/programs?filters=210721)

## Woodwinds
[Woodwinds](https://www.berklee.edu/academics/programs?filters=210736)

## Dance
[Dance](https://bostonconservatory.berklee.edu/dance)

## Music
[Music](https://bostonconservatory.berklee.edu/music)

## Theater
[Theater](https://bostonconservatory.berklee.edu/theater)

## Berklee Global
[Berklee Global](https://www.berklee.edu/global)

## Berklee Abu Dhabi Center
[Berklee Abu Dhabi Center](https://www.berklee.edu/berklee-abu-dhabi)

## Upcoming performances
[Upcoming performances](https://www.berklee.edu/events/performances)

## Alumni stories
[Alumni stories](https://www.berklee.edu/berklee-now/berklee-today)

## Hire Berklee Talent
[Hire Berklee Talent](https://www.berklee.edu/hire-berklee-talent)

## Jobs at Berklee
[Jobs at Berklee](https://www.berklee.edu/jobs)

## Policies
[Policies](https://www.berklee.edu/policies/terms)

## Accreditation
[Accreditation](https://www.berklee.edu/institutional-assessment/accreditation)

## Accessibility
[Accessibility](https://www.berklee.edu/accessibility)