[Advanced Search] - [Help]
Web
Publications
News
Browse
 About AthenusBot

What is Athenus Bot?
AthenusBot is the crawler and indexer used by Athenus to build it's database and provide users with the most up-to-date information possible on internet engineering and science resources.


Frequently Asked Questions about AthenusBot

- How often will AthenusBot crawl my site?
AthenusBot is configured to 'creep' slowly across the web rather than impose large burdens on your servers. Small sites can expect to be crawled a few times a month. If you feel your site is being too frequently or too heavily fetched by AthenusBot, please contact us at [email protected] and we will endeavour to adjust the crawl pattern to alleviate the problem.

- Does AthenusBot respect ROBOTS.TXT?
Absolutely. If you do not want it to index parts or all of your site (for example dynamic content), please refer to http://www.robotstxt.org/wc/exclusion.html#robotstxt

- How does AthenusBot work?
AthenusBot is powered by proprietary technology developped from a variety of sources. Thinknew.ca provides a very similar packaged search solution for enterprise and business search requirements that indexes most types of files and is scaleable from tens to thousands of users. If you need a similar solution for your organization, consider contacting us at [email protected] to see if we can help or contact the good people at thinknew.ca.

- How can I add a site to your database?
We are always eager to add quality resources to Athenus.com. E-mail us at [email protected] and include your website information. Please do not send inappropriate or pornographic materials, as they will not be indexed and just waste everybody's time. If deemed relevant, AthenusBot will crawl your site next time it is launched. As Athenusbot respects the ROBOTS.TXT protocol, please ensure that it is configured to allow entry for our spider.

- How are results ranked?
The rank of Athenus.com search results is closely tied both to the overall site popularity and the relevance of the search keywords to the sites in question. Unlike other search engines, we do not sell the top positions in our search results to advertisers. Additionally, we take proprietary steps to eliminate sites that 'spam' keywords and content from our results.

- How can I improve my site's ranking?
As with most search engines, the best thing to do is simply to improve the targeting and quality of your content. Additionally, you might consider making proper use of META tags in the headers of your webpages. Also, make sure your robots.txt file is correctly configured to allow AthenusBot to index your pages
We also offer advertising opportunities for those sites trying to get more visibility in the engineering and science sectors. Banner and text ads are displayed on the top and to the side of search results and are naturally targeted to our audience. This is an effective way to use Athenus.com to gain new customers and users, and may work best for sites which do not rank high in more general searches. To find out more click here or contact us at [email protected]




[Advanced Search] - [Help]
[Athenus Home] - [About us] - [Advertise with us] - [Contact us] - [Help] - [Submit a site]


Athenus is a service designed & provided by thinknew
All materials on these pages including, but not limited to, graphics, information and scripts are 2004. All Rights Reserved.