Data Engineer ( AWS , Python )
- Tata Consultancy
- 6 - 10 years
- Hyderabad
- 3 days ago
- Email to a friend
- Report this job
Job Description
Job description :
Must have:
Experience developing R shiny and Python apps
- Experience with Hadoop
- Experience with Agile development methods
- Experience building data pipelines for various heterogenous data sources.
- Identifying, designing and implementing scalable data delivery pipelines and automating manual processes
- Building required infrastructure for optimal data extraction, transformation and loading of data using cloud technologies like AWS, Azure etc.,
Develop end to end processes on the enterprise level for use by the clinical data configuration specialist to prepare data extraction and transformations of raw data quickly and efficiently from various sources at the study level
- Coordinate with downstream users such as statistical programmers, SDTM programming, analytics, and clinical data programmers to ensure that outputs meet requirements of end users
- Experience creating ELT and ETL to ingest data into data warehouse and data lakes
- Experience creating reusable data pipelines for heterogenous data ingestions
- Manage and maintain pipelines and troubleshoot data in data lake or warehouse
- Provide visualization and analysis of data stored in data lake
- Define and track KPIs and provide continuous improvement
Good-to-Have
- Strong attention to detail, and organizational skills
- Strong Project Management skills
Strong understating of end-to-end processes for data collection, extraction and analysis needs by end users
- Strong ability to communicate with cross functional stakeholders
- Strong ability to develop technical specifications based on communication from stakeholders
- Quick learner and comfortable asking questions, learning new technologies and systems
- Good knowledge of office software (Microsoft Office).
- Experience creating custom functions Python/R
Cloud computing (AWS, Snowflakes, Databricks) Ability to visualize large datasets R shiny/ Python App experience a plus
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: IT & Information SecurityRole Category: IT & Information Security - OtherRole: IT & Information Security - OtherEmployement Type: Full timeContact Details:
Company: Tata ConsultancyLocation(s): Hyderabad
Keyskills: Cloud Computing Hadoop AWS Python
Similar positions
Tata Consultancy
EY | Building a better working world\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\n\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\nEY exi...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in