Design, develop, test, deploy and maintain large-scale data processing pipelines using Scala and Spark.
Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
Develop high-quality code that is efficient, scalable, and easy to maintain.
Troubleshoot issues related to data processing pipeline failures.
Job Requirements :
5-13 years of experience in software development with a focus on big data processing using Scala or PySpark.
Strong understanding of Hadoop ecosystem (HDFS, YARN, Oozie) and Spark (Scala).
Experience working with relational databases such as MySQL or PostgreSQL.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Software Development - OtherEmployement Type: Full time