O SEU PRÓXIMO CAPÍTULO
Senior Data Engineer
Sobre a vaga
• Own Fundable’s data platform from architecture through production
• Build concurrent ingestion for provider APIs, webhooks, files, and web scraping, with rate limits and failure handling
• Orchestrate scheduled workflows and historical backfills using Airflow, Dagster, or Prefect
• Build event-driven intake with Pub/Sub or Cloud Tasks, including retries, dead-letter queues, and controlled replay of failed work
• Preserve original provider payloads in Google Cloud Storage before transforming them with dbt
• Establish medallion layers for raw, standardized, and curated data
• Implement idempotent upserts, safe retries, replay, and historical backfills
• Make data traceable to its source and safe to reprocess
• Define data contracts, automated validation, pipeline tests, freshness and failure monitoring
• Design and optimize PostgreSQL schemas, queries, and loading patterns
• Integrate provider enrichment and LLM-based structured extraction from text
• Experience building multi-source production data platforms from zero to one, from initial architecture and pipeline implementation through deployment and ongoing operation
• Production experience with workflow orchestration tools such as Airflow, Dagster, Prefect, or Temporal, including dependencies, retries, and failure recovery; Airflow experience is preferred
• Hands-on production experience with dbt and GCP
• Experience building event-driven systems with messaging or task queues, including asynchronous processing and failure recovery
• Strong SQL and PostgreSQL skills, including data modeling, query optimization, and reliable incremental loading
• Experience with data contracts, raw and curated storage, retention policies, and automated quality checks
• Strong Python skills, including asynchronous HTTP and concurrent processing with tools such as asyncio, aiohttp, or HTTPX
• Hands-on web scraping experience with tools such as Scrapy, Playwright, Selenium, or Beautiful Soup, including concurrent scraping, rate limits, and failure handling
• Physically located in Argentina