Infrastructure and Automation Engineer
DualBird is building the next-generation data acceleration platform that brings hardware-level performance to cloud infrastructure with software-level simplicity. We're looking for an Infrastructure & Automation Engineer to build automated systems that validate our Spark acceleration layer on a large scale. The Role You will design and operate our CI/CD for our core framework. This is a SW role focused on building infrastructure and internal tools on AWS (EMR/EKS) to ensure data correctness, system stability, and performance parity. What You’ll Do Framework Development: Build an automation frameworks to build, validate, orchestrate and release our SW suites. CI/CD Integration: Integrate automated tests into GitHub Actions CI pipelines, ensuring every release is correctness and performance. System and CI Monitoring: Implement observability (Prometheus/Grafana/CloudWatch) to monitor our SW health. Cross-Team Collaboration: Work with low-level system architects to provide automated feedback loops for hardware-level optimizations. What You Bring 4–7+ Years Experience: Proven track record in SW Development , QA Automation or DevOps within cloud or distributed data environments. Advanced Python: Ability to build complex, modular automation tools (Pytest, custom SDKs, Build tools, debug tools). Cloud & K8s: Hands-on experience with AWS (EMR, S3, EC2) and EKS (Kubernetes) networking/orchestration. CI/CD & Observability: Experience building automated release pipelines and monitoring distributed system as well as SW health. Advantage: Spark & Data Lakes: Technical knowledge of Apache Spark (shuffles, memory tuning, executors) and Apache Iceberg . Linux/Systems: Strong CLI skills and comfort debugging failures across the OS and container layers.