Senior Databricks Platform Engineer Azure Cloud & Data Operations
- Cirruslabs
- 6 - 11 years
- Bengaluru
- 1 month ago
- Email to a friend
- Report this job
Job Description
Engagement Domain Focus: Databricks, Azure Cloud, Enterprise Data Platforms, Platform Engineering, DevOps Enablement
---
About the Opportunity
Our client is undergoing a large-scale enterprise modernization initiative focused on Azure-native infrastructure, platform engineering, automation, and modernization of data-intensive application ecosystems.
As part of this transformation, multiple calculation-heavy and operationally critical applications are being integrated into a growing Databricks-centered enterprise data platform spanning:
Azure cloud services
AKS and containerized platforms
GitHub and CI/CD ecosystems
Enterprise automation and analytics environments
We are seeking a Senior Databricks Platform Engineer to support architecture, operational engineering, platform enablement, and modernization activities across this evolving environment.
This role blends:
Databricks platform expertise
Cloud infrastructure awareness
DevOps-aligned engineering
operational platform support
The ideal candidate understands how Databricks workloads, APIs, pipelines, storage layers, and operational processes integrate within broader enterprise cloud ecosystems.
---
Role Overview
The Senior Databricks Platform Engineer will support the design, operational enablement, modernization, and ongoing support of enterprise Databricks platforms and associated data processing environments.
This engineer will work closely with:
Cloud platform teams
DevOps organizations
Infrastructure engineering teams
Application modernization groups
data and analytics stakeholders
The role requires strong awareness of how Databricks modernization activities impact:
Existing CI/CD pipelines
Automation frameworks
Operational governance
Enterprise cloud platform standards
---
Key Responsibilities
- Databricks Platform Engineering Operations
- Support architecture and operational engineering across enterprise Databricks environments
- Design and maintain scalable Lakehouse, Delta Lake, and Unity Catalog solutions
- Support administration of:
- Databricks Workspaces
- Jobs
- Notebooks
- Clusters
- Optimize Spark workloads, cluster configurations, and platform performance
- Support batch and streaming data processing workloads
- Assist with multi-environment platform management across Dev, QA, and Production
- Platform Integration DevOps Alignment
- Support integration of Databricks platforms with Azure-native ecosystems and enterprise applications
- Work across integrations involving:
- APIs
- Azure Storage Accounts
- Data Lakes
- reporting and analytics platforms
- Collaborate with platform and DevOps teams to align Databricks activities with existing CI/CD and automation standards
- Support deployment workflows utilizing:
- GitHub
- Azure DevOps
- Infrastructure as Code frameworks
- Help ensure modernization activities do not disrupt existing automated deployment pipelines and operational processes
- Governance, Reliability Platform Support
- Support governance, access management, monitoring, logging, and operational security practices
- Assist with implementation of:
- RBAC
- lineage
- encryption
- platform governance controls
- Participate in troubleshooting, operational support, and root cause analysis activities
- Contribute to documentation, operational standards, and platform best practices
---
Required Qualifications
- 6+ years of experience within cloud, platform engineering, data engineering, or enterprise analytics ecosystems
- 3+ years of hands-on experience supporting enterprise Databricks environments
- Strong experience with:
- Delta Lake
- Unity Catalog
- Spark workloads
- cluster operations
- Databricks Workspaces
- Experience with Azure cloud services and cloud-native platform concepts
- Familiarity with:
- Azure DevOps
- GitHub workflows
- CI/CD pipeline concepts
- deployment automation
- Experience supporting APIs, distributed application integrations, and enterprise data platforms
- Strong troubleshooting and operational support capabilities
- Strong communication and stakeholder collaboration skills
---
Preferred Qualifications
- PySpark
- Python
- SQL
- Spark SQL
- Scala
- AKS/Kubernetes
- Terraform
- Bicep
- Infrastructure as Code practices
---
What This Role Is
A hands-on enterprise Databricks platform engineering role
A modernization-focused engineering opportunity within a large Azure ecosystem
A hybrid role spanning cloud integration, operational engineering, and DevOps-aware platform support
A collaborative engineering role supporting scalable enterprise data and analytics platforms
Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.Job Classification
Industry: Software ProductFunctional Area / Department: Engineering - Software & QARole Category: DevOpsRole: Site Reliability EngineerEmployement Type: Full timeContact Details:
Company: CirruslabsLocation(s): Bengaluru
Keyskills: Automation Enterprise applications Access management Consulting Cloud Troubleshooting Operations Analytics Monitoring SQL
Cirruslabs
We are CirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in