Hadoop Data Engineer
- Persistent
- 7 - 9 years
- Pune
- 2 months ago
- Email to a friend
- Report this job
Job Description
About Position:
The role involves managing and supporting Hadoopbased data pipelines with handson work across Linux, SQL Server, ETL processes, and Big Data environments.
- Role: Hadoop Data Engineer
- Location: Pune
- Experience: 7 to 9 years
- Job Type: Full Time Employment
What You'll Do:
- Be responsible for monitoring and executing data loads.
- Manage and execute monthly/quarterly Hadoopbased data pipelines.
- Work with HDFS, Hive, and other Hadoop ecosystem components for data processing and maintenance.
- Execute Linux commands, manage file systems, and develop/maintain shell scripts for automation.
- Monitor ETL batch loads, identify failures, and perform rootcause analysis.
- Troubleshoot issues across Unix systems, SQL Server environments, and pipeline components.
- Work with SQL Server features, including archival processes and databaserelated operational tasks.
- Modify or enhance ETL workflows based on evolving business or technical requirements.
- Write, optimize, and troubleshoot SQL queries, including joins, window functions, and performance tuning.
- Collaborate with crossfunctional teams to ensure timely delivery and smooth workflow.
Expertise You'll Bring:
- Strong handson experience with Hadoop components.
- Experience working in Linux environments.
- Experience with SQL Server.
- Experience with ETL pipelines.
- Ability to debug issues across Unix, SQL environments, and Big Data environments.
- Experience supporting enhancements to existing pipelines.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent
"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: IT & Information SecurityRole Category: IT Infrastructure ServicesRole: IT Infrastructure Services - OtherEmployement Type: Full timeContact Details:
Company: PersistentLocation(s): Pune
Keyskills: Linux ETL processes SQL Server
Persistent
Persistent Systems builds software that drives our customers business, for enterprises and software product companies with software at the core of their digital transformation. For more information, please visit www.persistent.com
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in