DevOps Engineer

Role: DevOps Engineer

Location: Sydney & Melbourne

Employment Type: Permanent

Job Description:

• Design, implement, and manage cloud-based platforms using Databricks to ensure efficient, scalable, and secure data engineering operations.
• Automate the provisioning, configuration, and management of Databricks environments using tools like Terraform, Kubernetes, or CloudFormation.
• Build and optimize data pipelines in Databricks, integrating diverse data sources to enable efficient processing and analysis.
• Continuously monitor and optimize the performance of Databricks clusters and jobs, ensuring fast and cost-effective execution.
• Implement security best practices, including data encryption, access controls, and compliance policies, in Databricks environments.
• Work closely with data scientists and engineers to implement end-to-end data workflows, ensuring smooth integration of Databricks with other tools.
• Provide ongoing technical support for Databricks platform environments, resolving issues related to infrastructure, performance, and data pipeline failures.
• Manage cloud resources, such as AWS or Azure, to provide optimal resources for Databricks workloads.
• Implement continuous integration/continuous deployment pipelines for Databricks notebooks and data workflows to streamline code deployment.

Interested consultants can share their updated resume at [email protected] or call +61 283 195 538.