🕷️ GURL — Go URL Email Crawler

🕷️ GURL — Go URL Email Crawler

Nov 11, 2025

image

https://github.com/luisra51/gurl

Was born from a client request — they needed a way to automatically extract contact emails from websites and connect them to automation tools like n8n, Zapier, or internal systems.
The project evolved into a powerful, modular, and high-performance system built in Go, designed for speed, scalability, and integration.

It combines:

  • Intelligent crawling with configurable depth

  • Asynchronous processing powered by Redis queues

  • Webhook callbacks for easy automation integration

  • Persistent caching with long-term storage for faster repeated scans

  • A REST API fully containerized with Docker

The result is a versatile microservice that fits perfectly into modern automation workflows or serves as a foundation for more advanced data-collection and analysis projects.

Although the original purpose may seem controversial, the idea was to make it open source — since it had to be built anyway — and share it as a tool and learning resource for other developers.

Подобається цей допис?

Купити для Luis Sánchez каву

Більше від Luis Sánchez

КонфіденційністьУмовиПоскаржитись