Sr. Data Engineer

• Implement methods to improve data reliability and quality.
• Deploy programmable, easily customizable infrastructure that embraces change and automates the deployment process to reduce risk
• Analyze all platform level changes, monitor application impact, and provide appropriate technical solutions to resolve all issues quickly and efficiently
• Actively manages and escalates risk and customer-impacting issues within the day-to-day role to management
• Achieve product commitments (and influences others to do the same) by using informal leadership & highly developed communication skills and contributes to or led technology communities
• Uses automation, system tools, open-source solutions, observability and 'security first' principles in daily work
• Contribute to team agile ceremonies, leads demos and presentations, helps new engineers learn established norms
• Initiate high level solution design approaches, and guides team to achieve desired key software delivery capabilities using automated, coded enterprise and observability
• Participate in internal speaking and advocacy events
• Support research activities to adopt new technology solutions in ways of developing new capabilities
  to oversee and work independently on a variety of complex initiatives end-to-end (primarily on short- to medium- term issues (6-12 months) requiring specialist knowledge and/or the integration of cross-functional processes (within your own area of expertise).
• Provide thought leadership and/or industry knowledge specific (but not limited to) your own area of expertise.
• Provide guidance and influencing multiple teams across a broad spectrum of initiatives and functional domains.

Required:

• 5+ years relevant experience. (HDFS/SPARK/YARN/DREMIO/KAFKA/Azure PaaS)
• Knowledge of at least one programming language (e.g. Java, Python, R)
• Knowledge of Databricks (Spark with Scala or Pyspark)
• Hands-on experience with ETL/ELT processes and SQL database design
• Proven ability to design, develop and secure data pipelines
• Great numerical and analytical skills.
• Experience with DevOps and CI/CD pipelines
• Experience in IaaS Data Platform and capability enablement.
• Compute via Spark, storage via HDFS, ADLS, orchestration via Airflow, Dremio, etc.
• Experience in streaming data ingestion and processing using Kafka
• Experience in PaaS offerings from Azure / GCP (ADF/Databricks, etc.)
• Familiarity with data catalog and metadata management tools (e.g.: Unity Catalog, Collibra)
• Knowledge of data modeling, data quality and governance practices
• Must be able to lead complex projects and competing priorities with a high level of technical acumen and strong communication skills
• Familiar with data management Access Control (Rbac / Abac).

Education

• Undergraduate Degree or Technical Certificate.

GalaxE, now Endava, is a professional IT services firm that specializes in platform-driven solutions and the use of automation to achieve enterprise business transformation and mission-critical change for some of the largest companies in the world. Using our proprietary solution set, GxFource®, we apply machine learning techniques and predictive analytics tools as part of a broad artificial intelligence strategy that provides effective impact and data-driven business transformation. 

Since its founding, GalaxE has been dedicated to advancing the benefits of technology. Recently, we have joined forces with Endava, to offer our employees global exposure and enhanced opportunities. As we continue that legacy and look to the future, a focus on business enablement through agile, cost-efficient, and effective integration of people, process, and technology anchors our success. We revolutionize change in the costs of doing business that transform companies and their ability to leap beyond the competition.

We value people and are committed to diversity and inclusion where our employees are made to feel comfortable and are encouraged to be authentic.

We are always looking for passionate, entrepreneurial-minded innovators and disrupters; game-changers that take ownership of the work they produce and bring it each and every day. Working with like-minded team members you will get a chance to discover, develop, and use cutting-edge technologies to transform the way we deliver creative business solutions.

Sound like you? Join us and find out for yourself what it means for you, and your career, to be part of the GalaxE team. Let’s build something, together.

*Equal Opportunity Employer/Veterans/Disabled

** Pay is based on several factors including market location and may vary depending on actual job-related knowledge, skills, and experience.

Physical Requirements:

• Prolonged periods of remaining stationary at a desk and working on a computer
• Must be able to lift to 15 lbs., as needed
• Must be able to work on-site (corporate/client offices), as needed (not applicable for 100% remote roles)
• Occasionally required to bend, kneel, crouch, and reach overhead.
• Hand-eye coordination necessary to operate computers and various pieces of office equipment. 
• Specific vision abilities required include close vision, the ability to tolerate fluorescent lighting, and the ability to adjust focus.

Employees must be able to perform the physical requirements of the position satisfactorily and, if requested, reasonable accommodations will be made to enable employees requiring accommodations to perform the essential functions of their jobs, absent undue hardship.

For more information, please visit https://info.endava.com/galaxe-has-joined-endava