Data Platform Engineer

Job Post Information* : Posted Date 5 days ago(11/15/2024 7:59 PM)
ID
2024-13145
# of Positions
1
Pay Range
$133,000 - $153,000

What You Will Do

 

  • Build a Critical Foundation: Lead the development of a critical data quality framework that will impact how capital markets data is managed across the organization.
  • Autonomy and Ownership: As the sole architect for the first several months, will have significant responsibility and the freedom to shape the initiative's direction.
  • Growth Opportunities: As the project expands, there will be opportunities to grow the team, scale the initiative, and take on a leadership role in the longer-term data contracts strategy.
  • Collaborate with Leadership: Work directly with our team of technical leaders with deep expertise, in a highly collaborative environment.
  • Design and Implement Data Quality Frameworks: Adopt a proactive (and reactive), scalable data quality framework to ensure that all critical capital markets data flows meet high standards of accuracy, completeness, and timeliness.
  • Collaborate with Data Engineers and Business Teams: Work with data engineering and business teams to identify key data quality issues, establish validation rules, and implement solutions that prevent data quality problems before they arise.
  • Develop Monitoring and Automation Tools: Implement automated data quality checks and monitoring systems that flag and address data issues in real time. Leverage tools like Great Expectations or similar frameworks to validate data integrity across pipelines.
  • Define Data Quality Metrics and SLAs: Establish clear metrics for measuring data quality (e.g., accuracy, completeness, consistency) and set up service level agreements (SLAs) that data producers and consumers can use to track performance.
  • Pilot Initial Data Flows: Lead a pilot focused on a few key data streams (such as risk analytics and trade execution data) to refine the framework, demonstrate value, and gain early insights into how proactive data quality can support downstream data use cases.
  • Drive Data Governance: Build the governance structures that will ensure long-term data quality, including clear data ownership and stewardship responsibilities, processes for addressing data quality issues, and reporting tools for business and technical teams.
  • Support Long-Term Vision for Data Contracts: While the primary focus is on proactive data quality, this work will lay the foundation for establishing formal data contracts in the future, where data quality metrics and SLAs become formalized agreements between teams.

Skills and Experience You Will Need

Required:

 

  • 7+ years of experience in data quality, data architecture, or a similar role in capital markets or financial services.
  • Proven experience designing and implementing data quality frameworks that ensure accuracy, completeness, and timeliness of data.
  • Expertise in data validation tools such as Great Expectations, whylogs, dbt expectations, Apache Griffin, or custom-built solutions for real-time data quality checks.
  • Strong skillset and experience in building full-stack in Python
  • Understanding of cloud infrastructure (GCP or Azure) and how to implement scalable data quality systems within cloud-native architectures.
  • Ability to work closely with data engineers to support their data pipeline development by embedding data quality checks and standards.
  • Experience establishing and tracking data quality metrics and SLAs, and working with teams to ensure compliance.
  • Proficiency in data engineering languages ( Python) to support the creation and automation of data quality check patterns in multiple clients.

Desired:

 

  • Familiarity with data governance frameworks and how data quality ties into governance processes.
  • Experience working in environments that emphasize data accountability and clear data ownership across multiple teams and systems.
  • Hands-on experience in capital markets, financial services, or similar high-performance data environments.
  • Familiarity with capital markets data structures (e.g., trades, pricing, risk data) and the unique challenges around managing and ensuring quality in high-frequency, transactional data environments.
  • Database: Dremio / SQL / NoSQL

Who We Are

GalaxE, now Endava, is a professional IT services firm that specializes in platform-driven solutions and the use of automation to achieve enterprise business transformation and mission-critical change for some of the largest companies in the world. Using our proprietary solution set, GxFource®, we apply machine learning techniques and predictive analytics tools as part of a broad artificial intelligence strategy that provides effective impact and data-driven business transformation. 

 

Since its founding, GalaxE has been dedicated to advancing the benefits of technology. Recently, we have joined forces with Endava, to offer our employees global exposure and enhanced opportunities. As we continue that legacy and look to the future, a focus on business enablement through agile, cost-efficient, and effective integration of people, process, and technology anchors our success. We revolutionize change in the costs of doing business that transform companies and their ability to leap beyond the competition.

 

We value people and are committed to diversity and inclusion where our employees are made to feel comfortable and are encouraged to be authentic.

 

We are always looking for passionate, entrepreneurial-minded innovators and disrupters; game-changers that take ownership of the work they produce and bring it each and every day. Working with like-minded team members you will get a chance to discover, develop, and use cutting-edge technologies to transform the way we deliver creative business solutions.

 

Sound like you? Join us and find out for yourself what it means for you, and your career, to be part of the GalaxE team. Let’s build something, together.

 

*Equal Opportunity Employer/Veterans/Disabled

** Pay is based on several factors including market location and may vary depending on actual job-related knowledge, skills, and experience.

 

Physical Requirements:

  • Prolonged periods of remaining stationary at a desk and working on a computer
  • Must be able to lift to 15 lbs., as needed
  • Must be able to work on-site (corporate/client offices), as needed (not applicable for 100% remote roles)
  • Occasionally required to bend, kneel, crouch, and reach overhead.
  • Hand-eye coordination necessary to operate computers and various pieces of office equipment. 
  • Specific vision abilities required include close vision, the ability to tolerate fluorescent lighting, and the ability to adjust focus.

Employees must be able to perform the physical requirements of the position satisfactorily and, if requested, reasonable accommodations will be made to enable employees requiring accommodations to perform the essential functions of their jobs, absent undue hardship.

 

For more information, please visit https://info.endava.com/galaxe-has-joined-endava

Options

Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed