Data Engineer
- Our Client
- 5 - 7 years
- Bengaluru
- 2 months ago
- Email to a friend
- Report this job
Job Description
Role & responsibilities
About the Role
As a Data Analyst & Engineer for O2C Phase1, you will build robust batch pipelines into a managed PostgreSQL data layer to ingest from CUBE/RegBook, MetricStream and
Entity master. You will implement highquality, auditable data flows with strong contracts, lineage and idempotency.
You will collaborate with the Data Architect, Integrations Engineer and Reporting to deliver reliable datasets and views that power personabased dashboards.
Key Responsibilities
1. Pipeline Engineering
Build and operate batch ingestion jobs (files/APIs) with retries, alerting and replay.
Implement sourcetotarget mappings, data quality checks, and schema evolution safely.
2. Data Layer build
Create and optimize tables, indexes and views for analytics and application use.
Contribute to PDM standards, partitioning, retention and performance baselines.
3. Lineage & Controls
Capture lineage and provenance; ensure auditability of changes and versioning.
Handle PII/sensitive fields per policy; follow leastprivilege patterns.
4. Collaboration
Work with data integrations to stabilize upstream feeds; support reporting on semantic models.
Support QA with data fixtures and automated validation for UAT.
Preferred Skills & Experience
59 years in data engineering with strong SQL and ETL/ELT experience.
Proficiency in Python and SQL for data manipulation and data analysis.
Hands-on experience with AWS services including Postgres, Step Functions, Lambda, Glue, S3.
Strong understanding of data modelling, schema design, and performance tuning.
Experience integrating with enterprise systems via batch/APIs; strong understanding of DQ and idempotency.
Familiarity with Azure data services and CI/CD for data pipelines and AWS Sage Maker is a plus.
Build batch ingestion pipelines into managed PostgreSQL (Flexible Server) for CUBE/RegBook, MetricStream and Entity Master. Implement sourcetotarget mappings, data quality checks, idempotent loads, lineage capture and schedules per O2C Phase1 scope (no AI). Optimize schemas, indexes and views used by reporting.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Analytics - OtherRole: Data Science & Analytics - OtherEmployement Type: ContractContact Details:
Company: Our ClientLocation(s): Bengaluru
Keyskills: Build Postgresql Finance Order To Cash AWS Design o2c API Pipeline
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in