Principal Data Engineer
- DXC Technology
- 5 - 10 years
- Bengaluru
- 5 days ago
- Email to a friend
- Report this job
Job Description
Role:
Drive the evolution of Data & Services products/platforms with an impact-focused on data engineering.
Design and implement scalable data architecture and data pipelines.
Solving complex problems with multi-layered data sets, as well as optimizing existing machine learning libraries and frameworks.
Provide support for deployed data applications and analytical models by being a trusted advisor to Data Scientists and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers.
Ensure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.
Discover, ingest, and incorporate new sources of real-time, streaming, batch, and API-based data into our platform to enhance the insights we get from running tests and expand the ways and properties on which we can test and experiment with new tools to streamline the development, testing, deployment, and running of our data pipelines.
Mentor junior colleagues on relevant technical and product trends through training classes
Participate in the development of data and analytic infrastructure for product development Continuously innovate and determine new approaches, tools, techniques & technologies to solve business problems and generate business insights & recommendations.
Partner with roles across the organization including consultants, engineering, and sales to determine the highest priority problems to solve.
Evaluate trade-offs between many analytics solutions to a problem, considering usability, technical feasibility, timelines, and differing stakeholder opinions to make a decision.
Break large solutions into smaller, releasable milestones to collect data and feedback from product managers, clients, and other stakeholders.
Evangelize releases to users, incorporating feedback, and tracking usage to inform future development.
Work with small, cross-functional teams to define the vision, establish team culture and processes.
Consistently focus on key drivers of organization value and prioritize operational activities accordingly.
Escalate technical errors or bugs detected in project work
Maintain awareness of relevant technical and product trends through self-learning/study, training classes, and job shadowing.
Ideal Candidate Qualifications:
Working proficiency in using Python/Scala, Spark (tuning jobs), SQL, Hadoop platforms to build Big Data products & platforms.
Good programming skills in Java, spring boot and Junit. Experience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts
Knowledge in software development test approaches & frameworks
Familiarity with RESTful APIs and micro-services architectures
Experience in working with CI/CD.
Consistently focus on key drivers of organization value and prioritize operational activities accordingly.
Experience in working with Cloud APIs (e. g. , Azure, AWS)
Experience in working with SQL database like Postgres, Oracle
Preferably with hands-on experience with Hadoop big data tools (Hive, Impala, Spark)
Experience with data pipeline and workflow management tools: NIFI, Airflow.
Comfortable in developing shell scripts for automation.
Good troubleshooting and debugging skills.
Proficient in standard software development, such as version control, testing, and deployment
Demonstrated knowledge of coding and data engineering.
Ability to quickly learn and implement new technologies.
Ability to Solve complex problems with multi-layered data sets.
Ability to innovate and determine new approaches & technologies to solve business problems and generate business insights & recommendations.
Ability to multi-task and strong attention to detail
Flexibility to work as a member of a matrix based diverse and geographically distributed project teams
Good communication skills - both verbal and written and strong relationship, collaboration skills, and organizational skills
Degree in Computer Architecture, Computer Science, Electrical Engineering or equivalent experience
The following skills will be considered as a plus.
Experience participating in complex engineering projects in an Agile setting e. g. Scrum
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: DXC TechnologyLocation(s): Bengaluru
Keyskills: Performance tuning Automation Coding Social media Debugging Agile Scrum Oracle Troubleshooting Python
Similar positions
DXC Technology
DXC.technology DXC is the world¢¢s leading independent, end- to-end IT services company, helping clients harness the power of innovation to thrive on change. Created by the merger of CSC and the Enterprise Services business of Hewlett Packard Enterprise, DXC Technology is a $25 billi...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in