Data Infrastructure Engineer

Speedata.io · israel

Speedata is modernizing analytics infrastructure with the first purpose-built ASIC processor, the Analytics Processing Unit (APU), for analytics and AI data workloads. Delivering up to 100x faster Apache Spark performance while cutting infrastructure TCO by 90%, the APU executes analytics operations directly in silicon with seamless integration and no code changes. In this role, you will be responsible for building data infrastructure for performance tuning, and analysis of a new analytics product. As a member of our Data Performance team, you will collaborate closely with other SW & HW Engineers to improve the performance of our new cutting-edge APUs. You will collaborate with our business leaders and participate in the product design and implementation. You will evaluate, implement, and integrate a diverse set of tools and technologies such as Spark, Comet, Velox, Dagster, Hardware emulators and software simulators. Join a multi-disciplinary team of experts operating at the foundation of Speedata’s data infrastructure stack Build a robust data benchmarking infrastructure Develop in-house measurements and ETL tools Conduct detailed performance analysis and characterization Research state-of-the-art benchmarks and techniques for SQL and data optimization BS degree in Computer Science +5 years of experience in a Data Engineering role +5 years of experience of programming +2 years of experience of SQL Tuning and Data Pipeline In depth knowledge of SQL Experience with SQL benchmarks, specifically TPC-H and TPC-DS Experience with GPUs or other hardware accelerators Speedata is the creator of the Analytics Processing Unit (APU), the first processor purpose-built for Apache Spark SQL, batch ETL, and AI data preparation workloads. By executing Spark operations natively in silicon rather than memory, the APU delivers up to 100x faster performance and 90% lower total cost of ownership compared to general-purpose compute, with zero code changes required. In one enterprise AI data preprocessing deployment, customers replaced 37 servers with just 3. Speedata integrates directly into existing data pipelines, accelerating the most demanding analytics and AI data layer workloads at scale. Our hardware, the C200 APU card with the Callisto ASIC on PCIe Gen 5, delivers transparent acceleration for Spark SQL, DataFrame, and batch ETL workloads.

Apply »