Job Description

DevOps (Cloud Engineer)

Iselin, NJ/ NY (Need Onsite day 1, Hybrid 3 days from office )

Job Description:

We are seeking a highly skilled and motivated Cloud Engineer with extensive experience in Databricks, Infrastructure management, Terraform, DevOps, and Azure. The successful candidate will be responsible for designing, implementing, and managing robust cloud solutions that support our business needs. This role requires a deep understanding of cloud architecture, automation, and continuous integration/continuous deployment (CI/CD) practices.

Responsibilities:

• Cloud Infrastructure Management:
  • Design and implement scalable and secure cloud infrastructure using Azure services.
  • Manage and optimize cloud resources to ensure high availability and performance.
  • Monitor and troubleshoot cloud infrastructure and services.
• Databricks Expertise:
  • Develop and manage Databricks environments for data processing and analytics.
  • Implement ETL pipelines using Databricks and integrate with other data sources.
  • Optimize Databricks performance and cost.
• Terraform Configuration:
  • Write and maintain Terraform scripts to automate infrastructure provisioning.
  • Implement infrastructure as code (IaC) practices to ensure reproducibility and consistency.
  • Collaborate with development teams to integrate Terraform into CI/CD pipelines.
• DevOps Practices:
  • Implement and manage CI/CD pipelines for automated deployments and testing.
  • Use tools like Jenkins, GitHub Actions, or Azure DevOps for continuous integration and continuous deployment.
  • Ensure security and compliance in DevOps workflows.
• Azure Cloud Services:
  • Utilize Azure services such as Azure VMs, Azure Kubernetes Service (AKS), Azure SQL Database, Azure Blob Storage, etc.
  • Implement and manage Azure Networking, including VNETs, VPNs, and ExpressRoute.
  • Manage Azure Active Directory and role-based access control (RBAC).
• Collaboration and Documentation:
  • Work closely with cross-functional teams including developers, data scientists, and IT operations.
  • Document infrastructure designs, configurations, and procedures.
  • Provide training and support to team members on cloud technologies and best practices.

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 7+ years of experience in cloud engineering with a focus on Azure.
• Proven experience with Databricks and data engineering.
• Strong knowledge of Terraform and infrastructure as code principles.
• Hands-on experience with DevOps tools and practices.
• Proficiency in scripting languages such as Python, PowerShell, or Bash.
• Solid understanding of networking concepts and cloud security best practices.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.

Preferred, but not required:

• Certifications in Azure (e.g., Azure Solutions Architect, Azure DevOps Engineer).
• Experience with other cloud platforms (AWS, Google Cloud).
• Knowledge of containerization and orchestration tools like Docker and Kubernetes.
• Familiarity with Big Data technologies and frameworks.
• Strong communication and collaboration skills.
• Ability to work independently and as part of a team.
• Adaptability to learn new technologies and methodologies.

Job Tags

Similar Jobs