Senior Data Engineer
- Thomson Reuters
- 7 - 12 years
- Bengaluru
- 3 months ago
- Email to a friend
- Report this job
Job Description
The Data Analytics - Enterprise Data Lake Team has been established to create, operate, and run the Enterprise AI, BI, and Data platforms that facilitate faster time to market for reporting, analytics, and data science teams to run experiments, train models, and generate insights. The Data Factory team sits at the heart of this mission ingesting data from various sources into the Enterprise Data Lake and performing content-agnostic transformations to provide end-users with clean, reliable, and well-governed datasets. As a Senior Software Engineer , you will take a pivotal role in shaping the future of our data ingestion and transformation solutions within the Enterprise Data Lake. You will lead the development of complex data pipelines and systems, focusing on delivering high-quality, scalable data solutions while leveraging your experience to enhance data accessibility, reliability, and usability. This role requires deep expertise in distributed data systems design, ETL/ELT pipeline development, data modeling, and cloud-based infrastructure, along with the ability to evaluate AI and automation tools for specific data engineering use cases. Youll manage technical debt effectively while designing scalable data ingestion frameworks, transformation pipelines, and reusable data products. About the Role: -- Design and implement end-to-end solutions to ingest data from multiple structured, semi-structured, and unstructured sources into the Enterprise Data Lake.
- Conduct source data analysis in collaboration with data subject matter experts to build robust data pipelines and thoroughly document data transformations.
- Develop and maintain scalable, sustainable ETL/ELT pipelines for both on-premises and cloud environments, ensuring efficiency, reliability, and performance.
- Innovate with new approaches for source ingestion, ELT data pipelines, AWS-based frameworks, and stakeholder-facing documentation and usability.
- Design and build data products that serve downstream consumers including data science, business analytics, and reporting teams.
- Perform end-to-end deployment of data pipelines using CI/CD processes, ensuring high-quality releases and minimal disruption to data consumers.
- Collaborate with business analysts, data architects, and cross-functional teams to gather requirements, define data contracts, and deliver solutions aligned with business goals.
- Effectively communicate and liaise with data management teams embedded across the organization to ensure alignment on data governance standards and best practices.
- Contribute to improving the overall data consumer experience by delivering clean, well-documented, and easily accessible datasets.
- Manage and prioritize technical debt while maintaining a high standard of code quality, pipeline reliability, and system scalability.
- Evaluate and adopt AI-powered tools and frameworks to improve pipeline development, data quality monitoring, and operational efficiency.
- Core Data Engineering
- Expert in Data Pipeline Development ETL/ELT tooling for on-premises and cloud environments
- Expertise in ETL tools, preferably Informatica
- Working experience building sustainable data pipelines to Data Lakes, Data Warehouses, and Data Marts
- Expertise in handling semi-structured and unstructured data
- Big Data experience with distributed processing frameworks
- Programming Databases
- Highly proficient in SQL
- Proficient in Python and/or Spark for data engineering workloads
- Highly experienced in working with relational and non-relational databases, including Snowflake
- Strong knowledge of ingesting data from APIs, RDBMS, SaaS Application ( CRM and ERP ), Social Medial and Realtime/Eventr streaming sources
- Hands-on experience on DBT Transformation, Shell Scripting, Store procedures etc
- Cloud Infrastructure
- Proficient in AWS services including S3, EC2, Lambda, IAM, VPC, Load Balancer, Glue, and RDS ( Mandatory Hands-on AWS Glue )
- End-to-end deployment of data pipelines using CI/CD processes
- Experience or working knowledge of Terraform for infrastructure deployment
- Architecture Design
- Strong understanding of data modeling 3NF and dimensional modeling, including conceptual, logical, and physical layers
- Information systems design and solution design experience, including use case diagrams and architectural workflows
- Master and Reference Data Management knowledge
- Awareness of Data Governance standards and best practices
- Soft Skills Ways of Working
- Strong written and oral communication skills
- Effective stakeholder management across technical and business audiences
- Business analysis capabilities to translate requirements into data engineering solutions
- Agile method of working comfortable operating in iterative, fast-paced delivery environments
- Ability to mentor junior engineers, conduct code and design reviews, and foster a culture of continuous learning and improvement
- #LI-AD2
What s in it For You
-
.
-
Flexibility Work-Life Balance: Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, including work from anywhere for up to 8 weeks per year, empowering employees to achieve a better work-life balance.
-
programming and skills-first approach ensures you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future.
-
Industry Competitive Benefits: We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing.
-
Culture: Globally recognized, award-winning reputation for inclusion and belonging, flexibility, work-life balance, and more. We live by our values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together.
-
Social Impact: Make an impact in your community with our Social Impact Institute. We offer employees two paid volunteer days off annually and opportunities to get involved with pro-bono consulting projects and Environmental, Social, and Governance (ESG) initiatives.
-
Making a Real-World Impact: We are one of the few companies globally that helps its customers pursue justice, truth, and transparency. Together, with the professionals and institutions we serve, we help uphold the rule of law, turn the wheels of commerce, catch bad actors, report the facts, and provide trusted, unbiased information to people all over the world.
We are powered by the talents of 26,000 employees across more than 70 countries, where everyone has a chance to contribute and grow professionally in flexible work environments. At a time when objectivity, accuracy, fairness, and transparency are under attack, we consider it our duty to pursue them. Sound excitingJoin us and help shape the industries that move society forward.
As a global business, we rely on the unique backgrounds, perspectives, and experiences of all employees to deliver on our business goals. To ensure we can do that, we seek talented, qualified employees in all our operations around the world regardless of race, color, sex/gender, including pregnancy, gender identity and expression, national origin, religion, sexual orientation, disability, age, marital status, citizen status, veteran status, or any other protected classification under applicable law. Thomson Reuters is proud to be an Equal Employment Opportunity Employer providing a drug-free workplace.
We also make reasonable accommodations for qualified individuals with disabilities and for sincerely held religious beliefs in accordance with applicable law. More information on requesting an accommodation here .
Learn more on how to protect yourself from fraudulent job postings here .
More information about Thomson Reuters can be found on thomsonreuters.com.
Job Classification
Industry: Accounting / AuditingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Thomson ReutersLocation(s): Bengaluru
Keyskills: ERP RDBMS Business analysis Shell scripting Flex Agile Informatica SQL CRM Python
Similar positions
Thomson Reuters
Nagarro helps future-proof your business through a forward-thinking, fluidic, and CARING mindset. We excel at digital engineering and help our clients become human-centric, digital-first organizations, augmenting their ability to be responsive, efficient, intimate, creative, and sustainable. Today, ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in