YOUR NEXT CHAPTER
Python Developer – Senior
About the role
• Design, develop, and enhance data collection, processing, and integration systems using Python, ensuring scalability, resilience, and high performance
• Lead technical initiatives from solution design through implementation, testing, and production rollout
• Develop automated data collection solutions using web scraping, web crawling, browser automation, API consumption, and integration with external sources
• Build large-scale data collection architectures, considering parallelism, concurrency, session management, and resource efficiency
• Develop strategies for extracting data from dynamic websites, JavaScript applications, and structured and unstructured documents
• Build pipelines for the extraction, transformation, normalization, validation, and enrichment of large data volumes
• Identify and resolve performance bottlenecks, optimizing throughput, latency, memory usage, and operating costs
• Implement resilience mechanisms such as retries, timeouts, backoff, idempotency, and failure recovery
• Evolve the architecture of Python services by promoting modularization, component reuse, and technical debt reduction
• Develop observability mechanisms to monitor source availability, success rates, execution times, and data quality
• Investigate production incidents, identify root causes, and implement structural improvements
• Explore new data collection technologies and strategies, including AI for intelligent information extraction and process automation
• Use AI tools in development (AI First) to increase productivity, quality, and delivery speed
• Contribute to architectural decisions, conduct code reviews, and support the technical development of less experienced professionals
• Strong experience with Python, including asynchronous programming, concurrency, memory management, and performance optimization
• Proven experience with web scraping and web crawling using Scrapy, BeautifulSoup, Playwright, Selenium, or equivalent technologies
• Strong understanding of HTTP/HTTPS, headers, cookies, sessions, authentication, and how web applications work
• Experience with browser automation and data extraction from dynamic JavaScript-rendered applications
• Good knowledge of software architecture, design patterns, and building distributed, scalable systems in Python
• Experience with frameworks such as FastAPI, Django, and/or Flask
• Experience processing large volumes of data using Pandas, Polars, or equivalent tools
• Knowledge of asynchronous and parallel processing using asyncio, multiprocessing, queues, and workers
• Experience with messaging systems such as RabbitMQ, Kafka, SQS, Redis, or equivalent technologies
• Experience with MongoDB and/or PostgreSQL, including modeling, indexing, and query optimization
• Ability to develop resilient data collection solutions with reprocessing, deduplication, execution control, and failure recovery
• Experience with automated testing, observability, monitoring, and production troubleshooting
• Knowledge of Docker, Linux, and cloud infrastructure (AWS and/or GCP)
• Familiarity with AI development tools (AI First), incorporating them into daily workflows
• Autonomy to investigate complex problems, propose solutions, and drive end-to-end delivery
• Strong communication, analytical thinking, sense of ownership, and ability to collaborate effectively with other developers
• University degree or technical diploma
• English proficiency
• Wellhub (Gympass)
• Language Allowance
• Pet Life and Dog Life
• English Pass
• Life Insurance
• Contractor arrangement (PJ)