Azure Databricks Engineer

Job Post Information* : Posted Date 1 week ago(12/20/2024 2:08 PM)
ID
2024-13177
# of Positions
1
Pay Range
$132,000 - $152,000

What You Will Do

 

  • Understand all concepts covered in Azure Data Engineer Associate, Azure Database Administrator Associate, Microsoft Azure Data Fundamentals and Power Bl Data Analyst Associate certifications.
  • Provide expertise and ownership of Azure Databricks development tasks within the scrum team. Interacts effectively with clients and leadership, and can adapt communication for the appropriate audience.
  • Reads and comprehends software requirements, assisting with development of agile user stores and tasks. Assists with troubleshooting configuration and performance issues.
  • Assists with Azure Databricks deployments, testing, configuration, and installation.
  • Ensures security is a priority and understands the various areas where security vulnerabilities arise with database technologies.
  • Ensures database resiliency, and disaster recovery capabilities.
  • Comprehensive understanding of backups, restores, redundancy, geo-replication and Azure storage concepts. Documentation and Knowledge Sharing, creates detailed documentation for the database. Facilitates knowledge sharing within the team for effective collaboration.

Skills and Experience You Will Need

Required:

 

  • 5+ years proven experience working with Azure Databricks Analytics database capabilities, specifically Azure Databricks and other relational database technologies supported in Azure.
  • 5+ years proven experience with Azure Data Lake Storage Gen 2, Azure Databricks, Azure Data Explorer, Azure Event Hubs, Spark Pools, Python, PySpark, SOL, Azure Landing Zone, Azure Networking Services, Microsoft EntralD.
  • 5+ years proven experience with Azure geo-redundancy, HA/failover technologies.
  • 5+ years proven experience designing and implementing data pipelines using Azure Databricks for data cleaning, transformation, and loading into Data Lakehouse.
  • 5+ years proven experience with Infrastructure as Code {laC) tools such as Terraform.
  • 5+ years proven experience with programming languages such as Python, PySpark and data constructs such as JSON or XML.
  • Understanding of implementing Medallion Architecture using Azure Services. Strong experience with relational and/or dimensional data modeling.

 

Desired:

 

  • Experience in large scale cloud data migrations using Databricks, Python, Spark, SOL. Understanding of Azure DevOps tools in an Azure production setting.
  • Strong experience with Azure Data Studio, Visual Studio database management/projects/design capabilities, Azure CLI, and Powershell.
  • Strong and current familiarity with Azure platforms and services, including Azure App Services, Azure API Management, Azure Monitor, Azure Application Insights, Azure SOL, etc.
  • Experience with Cl/CD pipelines and deployment automation using tools like Azure DevOps. Experience with Agile methodologies.
  • Strong understanding of security best practices for Azure database deployments, including, access controls, 1AM, data encryption (TOE), Azure key vaults and masking.
  • Awareness of FedRAMP, FISMA, and/or Zero Trust Architecture strongly desired. Experience with SOL Server versions 2005 - 2022 is a plus.
  • Experience with Oracle or Microsoft Sql Server, either in Azure or on-prem, is a plus.
  • Preferred Certifications:Azure Data Engineer Associate, Azure Database Administrator Associate, Azure Data Fundamentals, Power Bl Data Analyst Associate

Who We Are

GalaxE, now Endava, is a professional IT services firm that specializes in platform-driven solutions and the use of automation to achieve enterprise business transformation and mission-critical change for some of the largest companies in the world. Using our proprietary solution set, GxFource®, we apply machine learning techniques and predictive analytics tools as part of a broad artificial intelligence strategy that provides effective impact and data-driven business transformation. 

 

Since its founding, GalaxE has been dedicated to advancing the benefits of technology. Recently, we have joined forces with Endava, to offer our employees global exposure and enhanced opportunities. As we continue that legacy and look to the future, a focus on business enablement through agile, cost-efficient, and effective integration of people, process, and technology anchors our success. We revolutionize change in the costs of doing business that transform companies and their ability to leap beyond the competition.

 

We value people and are committed to diversity and inclusion where our employees are made to feel comfortable and are encouraged to be authentic.

 

We are always looking for passionate, entrepreneurial-minded innovators and disrupters; game-changers that take ownership of the work they produce and bring it each and every day. Working with like-minded team members you will get a chance to discover, develop, and use cutting-edge technologies to transform the way we deliver creative business solutions.

 

Sound like you? Join us and find out for yourself what it means for you, and your career, to be part of the GalaxE team. Let’s build something, together.

 

*Equal Opportunity Employer/Veterans/Disabled

** Pay is based on several factors including market location and may vary depending on actual job-related knowledge, skills, and experience.

 

Physical Requirements:

  • Prolonged periods of remaining stationary at a desk and working on a computer
  • Must be able to lift to 15 lbs., as needed
  • Must be able to work on-site (corporate/client offices), as needed (not applicable for 100% remote roles)
  • Occasionally required to bend, kneel, crouch, and reach overhead.
  • Hand-eye coordination necessary to operate computers and various pieces of office equipment. 
  • Specific vision abilities required include close vision, the ability to tolerate fluorescent lighting, and the ability to adjust focus.

Employees must be able to perform the physical requirements of the position satisfactorily and, if requested, reasonable accommodations will be made to enable employees requiring accommodations to perform the essential functions of their jobs, absent undue hardship.

 

For more information, please visit https://info.endava.com/galaxe-has-joined-endava

Options

Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed