Data Engineer
- Persistent
- 10 - 15 years
- Pune
- 2 months ago
- Email to a friend
- Report this job
Job Description
About Position:
We are seeking a highly skilled Data Engineering Specialist with strong expertise in Spark and Scala, who can design and implement scalable data pipelines and work with large-scale distributed systems. In this role, you will collaborate with business stakeholders, deliver highquality data solutions, and contribute to performance optimization across the data ecosystem. A willingness to learn Java is expected.
- Role: Data Engineer (Spark and Scala)
- Location: All Persistent Location
- Experience: 10 to 15 Years
- Job Type: Full Time Employment
What You'll Do:
- Design and develop scalable and reliable data pipelines for transformation and aggregation of data from multiple sources.
- Collaborate with stakeholders to understand business needs and map them to appropriate data solutions.
- Build and optimize Spark-based applications leveraging Spark Core, Spark SQL.
- Apply performance tuning and optimization techniques such as caching, broadcasting, and efficient data partitioning.
- Work in an Agile/Scrum environment, participating in ceremonies and ensuring sprint deliverables.
- Communicate professionally with end clients via email and phone.
Expertise You'll Bring:
- Strong hands-on experience with Scala and the Spark ecosystem.
- Excellent understanding of Spark architecture and components.
- Willingness and motivation to learn and work with Java as needed.
- Basic knowledge of Linux and shell scripting.
- Experience with Git Bash for version control.
- Familiarity with performance optimization in distributed processing environments.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent - persistent.com/careers
"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: IT & Information SecurityRole Category: IT Infrastructure ServicesRole: IT Infrastructure Services - OtherEmployement Type: Full timeContact Details:
Company: PersistentLocation(s): Pune
Similar positions
Persistent
Persistent Systems builds software that drives our customers business, for enterprises and software product companies with software at the core of their digital transformation. For more information, please visit www.persistent.com
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in