Octogo is a distributed web crawler on the cloud. It uses multiple AWS EC2 instances to spawn up worker nodes to crawl the web simultaneously.

This project is part of my effort to build a boutique search engine. Along with Beehive, this project will serve as a base service.

• PlatformWindows/macOS/Linux
• StackGolang, Redis, etcd, Serf.io, Docker, Kafka, Cassandra, AWS
• Source Codehttps://www.github.com/quarterblue/octogo
• StatusActive Development