Event-driven service base architecture v2 w/ observability

ContactRich Pipeline Refactoring

Project Goal: Modernize the ContactRich Pipeline to handle high-volume contact enrichment and form submissions more efficiently by transitioning from a monolithic architecture to a scalable, event-driven system powered by Trigger.dev.

Key Improvements:

• Decompose the pipeline into distinct, orchestrated stages to eliminate memory bottlenecks when processing large URL volumes

• Implement explicit concurrency controls through Trigger.dev's queue management system

• Automate sender email variation generation for improved deliverability

• Organize processing scripts within the existing nx monorepo structure (apps/contact-rich-pipeline/scripts/) using Python and uv package management

Expected Outcome: A resilient, scalable pipeline capable of handling enterprise-level contact enrichment workloads with improved performance, maintainability, and monitoring capabilities.