About the Role:
We are looking for a skilled Platform Support Engineer to manage and optimize our Databricks Environment. This role involves a combination of platform administration, DevOps automation, incident resolution, and cross-functional collaboration to ensure the Databricks platform is secure, efficient, and high-performing. Key responsibilities include:
Platform Administration & Support:
- Administer and support Databricks workspaces, clusters, jobs, and integrations with Azure services
- Troubleshoot and resolve platform issues such as job failures, cluster misconfigurations, and access control challenges
- Implement and maintain monitoring and alerting tools to ensure real-time observability of platform health, performance, and cost
Infrastructure Automation & DevOps:
- Manage Databricks and Azure infrastructure using Terraform
- Develop and maintain CI/CD pipelines to automate deployments and synchronize environments
- Identify opportunities for automation to reduce manual overhead and improve platform reliability and efficiency
Security, Compliance & Governance:
- Enforce platform security best practices including RBAC, network security configurations, data encryption, and audit logging
- Manage integrations with Azure Active Directory and ensure secure access via private endpoints and identity controls
- Ensure compliance with internal security policies and applicable regulatory requirements
Incident Management:
- Respond to incidents/service requests and document root causes
- Manage change requests and maintain detailed documentation of solutions, processes, and configurations
- Participate in rotational shifts to ensure global coverage and timely resolution
Collaboration & Continuous Improvement:
- Provide Databricks and DevOps expertise to internal teams and customers
- Stay up-to-date with emerging cloud and data technologies to drive innovation and continuous improvement of the platform
Skills & Qualifications:
- Bachelor's degree in Computer Science, IT, or related field
- 5+ years of experience in DevOps, Cloud Operations, or Platform Engineering with hands-on expertise in Databricks administration
- Advanced proficiency in Microsoft Azure (VMs, VNets, NSGs, Storage, Active Directory, IAM)
- Strong scripting skills in Python, Bash, SQL or PowerShell
- Expertise in IaC tools (Terraform, ARM templates) and CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins etc)
- Experience with incident management tools (ServiceNow, Jira) and ITIL processes
- Deep understanding of Databricks architecture, Delta Lake, and Spark optimization
- Ability to troubleshoot platform performance bottlenecks, security gaps, and cost inefficiencies
- Excellent communication, collaboration, and stakeholder management
- Proactive problem-solving and ability to thrive in fast-paced environments
Preferred Qualifications:
- Databricks Certified Engineer, Azure Administrator/Engineer, or equivalent
- Experience with MLOps tools (MLflow, Kubeflow) and data visualization platforms (Power BI, Tableau)
- Knowledge of real-time data processing (Kafka, Event Hubs) and advanced analytics workflows
","employment_type":null,"industry":"","job_template":false,"country":{"name":"India","country_code":"IN","region":"Asia"},"is_job_displayable":true,"job_url":"https://talent500.com/jobs/allianz/senior-software-engineer_d-2208-pune-T500_AZ_90810","created_at":"2026-04-22T01:30:27.346858+05:30","updated_at":"2026-04-22T01:30:27.346879+05:30","title_alias_1":null,"slug":"senior-software-engineer_d-2208-pune-T500_AZ_90810","summary":null,"typical_workday":null,"what_you_offer":null,"what_you_need_to_succeed":null,"responsibilities":null,"type":null,"min_experience_years":5,"max_experience_years":10,"ctc_unit":"LPA","is_featured_job":false,"is_active":true,"job_code":"T500_AZ_90810","external_id":null,"external_job_code":null,"is_anonymized":false,"mercurial_skills":null,"open_date":"2026-04-22T01:30:27.339530+05:30","published_at":null,"anonymization_needed":null,"anonymized_description":null,"xml_feed_anonymization":null,"unregistered_user_anonymization":null,"registered_user_anonymization":null,"pre_application_email_anonymization":null,"mettl_account":null,"job_table_sub_head":null,"job_table_short_desc":null,"is_remote":false,"job_video":null,"job_video_title":null,"job_video_description":null,"job_image_url":null,"role_summary":null,"syndication_control":true,"syndication_status":"new","syndication_job_title_alias":null,"sourcing_requirements_updated_at":null,"t500_sourcing_control":true,"status":"open","job_redirection_url":"https://careers.allianz.com/global/en/job/90810/Senior-Software-Engineer-D-2208","is_external_job":true,"is_leadership_job":false,"leadership_confidentiality_level":null,"pricing_type":null,"is_auto_apply_eligible":false,"external_apply_url":null,"ats_provider":null,"apply_timeout_seconds":null,"recruiter":"1154daea-f24c-4f7f-aad6-494543ee6112","category":73,"job_sub_category":138,"role":null,"job_function":null,"job_sub_function":null,"naukri_industry":null,"naukri_functional_area":null,"naukri_role":null,"role_category":null,"linkedin_industry":null,"syndication_partners":[],"candidate_job_status":null,"candidate_job_id":null,"mettl_assessment_to_be_taken":false,"company_font_data":{"font-family":"Montserrat","url":"https://fonts.googleapis.com/css2?family=Montserrat:ital,wght@0,100;0,200;0,300;0,400;0,500;0,600;0,700;0,800;0,900;1,100;1,200;1,300;1,400;1,500;1,600;1,700;1,800;1,900&display=swap"}}