rezpondr - the crawler

the core component of rezpondr a fast crawler that can handle thousands of feeds per subdomain and scales into the cloud from a pool of resources - we hope to get this recoded in c early jan or maybe python - something with native multithreading.