Data Infrastructure Engineer
Speedata is modernizing analytics infrastructure with the first purpose-built ASIC processor, the Analytics Processing Unit (APU), for analytics and AI data workloads. Delivering up to 100x faster Apache Spark performance while cutting infrastructure TCO by 90%, the APU executes analytics operations directly in silicon with seamless integration and no code changes. This is a senior role with real ownership. You’ll get open problems, not task lists. You’ll research the options, design the solution, make the architecture calls, and drive them to production. You’ll work closely with SW and HW engineers and business leaders, and help set the team’s technical direction. Responsibilities Design and build our performance benchmarking and analysis infrastructure, end to end Make architecture and technology decisions, and own their trade-offs Research new tools and approaches and decide what we adopt (Spark, Comet, Velox, Dagster, hardware emulators, software simulators) Build services and tools for performance measurement and analysis Lead deep performance investigations and regression analysis Mentor teammates and raise the team’s engineering bar Requirements BSc in Computer Science or Software Engineering 5+ years of hands-on software engineering, building backend or infrastructure systems (Python preferred) Proven experience designing systems and making architecture decisions: services, scaling, state, failure handling A track record of owning problems end to end: researching, choosing the approach, and delivering it without step-by-step direction Strong understanding of concurrency and async programming Hands-on experience with SQL and large-scale data processing Strong debugging and problem-solving skills across application, infrastructure, and data layers. Strongly preferred Apache Spark or other distributed query engines Kubernetes and containerized environments Airflow, Dagster, or similar orchestration systems Performance benchmarking and regression analysis using metrics, logs, profiling, and controlled experiments Query execution internals: plans, partitioning, joins, skew, shuffle, I/O, CPU and memory bottlenecks Advantages SQL benchmarks, especially TPC-H and TPC-DS GPUs or other hardware accelerators Experience leading a technical initiative or a small team This role is not a fit if Your background is mainly BI, reporting, or ETL/DWH development You prefer working from well-defined tasks rather than open problems Speedata is the creator of the Analytics Processing Unit (APU), the first processor purpose-built for Apache Spark SQL, batch ETL, and AI data preparation workloads. By executing Spark operations natively in silicon rather than memory, the APU delivers up to 100x faster performance and 90% lower total cost of ownership compared to general-purpose compute, with zero code changes required. In one enterprise AI data preprocessing deployment, customers replaced 37 servers with just 3. Speedata integrates directly into existing data pipelines, accelerating the most demanding analytics and AI data layer workloads at scale. Our hardware, the C200 APU card with the Callisto ASIC on PCIe Gen 5, delivers transparent acceleration for Spark SQL, DataFrame, and batch ETL workloads.
משרות נוספות ב-Speedata.io
- Senior Software Engineer – Spark
- Senior SW Engineer [Codegen]
- VLSI Verification Team Leader
- Verification Engineer
- Lead SoC Architect
משרות דומות
- Senior Big Data Infrastructure Engineer 2572
- Data Center Sales Engineer (Critical Infrastructure)
- Big Data Infrastructure Engineer
- Big Data & Data Infrastructure Engineer
- Senior Data Engineer (Infrastructure)
- Senior Full Stack Engineer | Data-Driven Infrastructure
מצאו את המשרה הבאה שלכם בלוח הדרושים של ישראל.
כל המשרות