DevOps Engineer

Role

DevOps Engineer (Databricks platform)

Skills

Databricks, Azure, GitHub, IaaC & Terraform.

Location

Madrid, Spain (2 days per week at the office)

Languages

English C1

Key Responsibilities

• Operate, maintain, and continuously improve the Databricks platform in Azure.
• Develop and maintain deployment automation using Azure DevOps (and progressively GitHub as part of the migration).
• Collaborate with cloud networking and security teams to ensure topics such as secure connectivity, private endpoints, firewalls, routing, identity integration, etc.
• Provide guidance to internal consumers on efficient use of Databricks (clusters, jobs, UC, storage patterns).
• Participate in Agile ceremonies and contribute to SAFe PI planning and continuous improvement.

Required Technical Skills

• Strong Cloud Engineering expertise, primarily Azure (VNETs, DNS, NSG, Load Balancing, routing, identity, private networking).
• Infrastructure-as-Code expertise.
• CI/CD pipelines using Azure DevOps; familiarity with GitHub is a plus.
• Proficiency with Databricks platform administration:

- Workspaces, cluster policies, job orchestration

- Unity Catalog, metastore configuration

- Storage integration (ADLS)

• Solid understanding of cloud networking in enterprise environments.
• Experience with scripting languages (Python, Bash, PowerShell).
• Knowledge of monitoring tools (Azure Monitor, Prometheus, Grafana, Datadog, etc.).
• Experience working in Agile/Scrum or SAFe environments.

Nice-to-Have

• Experience with Databricks in AWS (IAM roles, S3, networking models).
• Familiarity with FinOps principles.