Senior Spark QA Engineer
InfraCloud
AI assistant
Job Description
Senior Spark QA Engineer – Functional & Performance Testing
Location: Remote
Experience: 5+ Years
Job Description -
We are looking for a Senior Spark QA Engineer with strong expertise in functional and performance testing of Apache Spark applications and distributed data platforms.
Key Responsibilities -
Location: Remote
Experience: 5+ Years
Job Description -
We are looking for a Senior Spark QA Engineer with strong expertise in functional and performance testing of Apache Spark applications and distributed data platforms.
Key Responsibilities -
- Perform manual and automated testing of Spark jobs, Spark SQL queries, and ETL pipelines.
- Execute functional, scalability, and performance testing for Spark workloads.
- Set up and manage Spark clusters on Standalone, YARN, Kubernetes, Mesos, Databricks, EMR, and Dataproc.
- Conduct benchmarking, validation, and performance analysis of Spark applications.
- Identify bottlenecks and troubleshoot distributed