HOME | DD
james-egan-root — Graphical Spider Bot - Concept
by-nc-sa
#conceptdesign #index #navigate #spiderbot #applicationdesign
Published: 2015-04-30 20:06:15 +0000 UTC; Views: 375; Favourites: 0; Downloads: 0
Redirect to original
Description
Sorry for the typo in the "Logs" box.This is a concept for a Spider Bot at I'm working on.
To avoid crashes caused by excessive memory consumption links and image links are splitted in Clusters (1000 entries for each cluster, both types of links are counted);
When the count of saved Clusters reaches 1500, all saved Clusters are archived in a Mega Cluster (see "Archived data size" in "Status" box);
Once a session finishes I can decide if save the collected data or not (see "DB Size" in "Status" box);
Finally, anti-aliasing can be deactivated if the application freezes.
This concept is released under CC BY-ND-NC 3.0 license.
