Azure Data Engineer
Arlington, Virginia, United States, Remote
Excella is a transformative technology firm that helps organizations unlock new possibilities. We believe the key to helping clients challenge the status quo and reach new heights lies in our talented people. That’s why we’re committed to developing talent and providing opportunities for career growth at every stage. Join our collaborative team dedicated to solving complex problems with sustainable solutions while building your future as a leader. At Excella, you’re empowered to make lasting impact, turning today’s challenges into tomorrow’s mission successes.
- Workplace locations look different for everyone. Excellians are a distributed workforce and whether you're working from your home office or a client site, we support a flexible work/life integration regardless of your location.
- We offer top of industry medical, dental, and vision benefits with multiple options to choose from such as an employer-contributed health savings account, infertility coverage, and orthodontia so you can select the plan that works best for you.
- Regardless of what stage of life you’re in, Excella wants to support you. We provide 8 weeks of Parental Leave, discounted pet insurance, and a Care.com membership with 3 back-up emergency child or elder care days annually – all available to you on your first day.
- Starting day one, every employee is bonus eligible and receives 15 days of paid vacation, 6 federal holidays, and 4 floating holidays.
- Doing your best work means having the best tools! Excella’s TechEleX program provides you with multiple options to suit your technology needs. Choose between a variety of Mac or PC devices, and to ensure your hardware remains current, at the end of a 3-year period Excella will replace your existing computer with a new model from the program. Plus, we’ll even give you the original device to keep for your personal use!
- With Excella’s Annual Internet Reimbursement benefit, all employees receive an additional $25 per month to help offset the cost of internet access. This initiative reflects our commitment to supporting you in staying connected and productive, no matter where you work.
- We'll invest in your career by providing 3 days of paid professional development every year, including an allowance for registration fees to attend classes, conferences, or obtain professional certifications.
- We encourage mindfulness and overall well-being through employee wellness events, a HeadSpace membership, as well as access to TalkSpace and mental health coverage through our medical plans.
Overview
The Data Engineer participates in the design and build of modern data products that comprise of raw data stores (data lakes) and cleansed data repositories, populated by batch or streaming data pipelines. The Data Engineer works with a team to create a robust, sustainable and flexible design and leads the technical delivery using Agile delivery frameworks like Scrum or Kanban.
Responsibilities
- Work closely with stakeholders across departments to architect, build and deploy various data acquisition initiatives across multiple-tenants.
- Participate in all stages of data pipeline development - from early brainstorming to coding and bug fixing
- Design, develop, deploy and maintain data services and/or pipelines to AWS
- Develop best practices and approaches to support continuous process automation for data ingestion and data pipeline workflows
- Perform multiple tasks simultaneously under changing requirements and deadlines
- Prepare and present proof of concept, solution evaluation and recommendation to various stakeholders including executives
Qualifications
Minimum Qualifications:
- 5+ years relevant professional work experience
- Design and develop SQL or python data pipelines that power our data lake and data warehouse
- Design and develop big data pipelines with both structured and unstructured data
- Proficiency with Microsoft Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure Databricks,
- Comfortable with modern data orchestration tools like DBT, AWS Glue, Apache NiFi and Airflow
- Design and develop strategies to acquire data as product
- Experience with test-driven code development practices
- Experience with GitLab code development practices
- Comfortable to develop infrastructure as code such as CloudFormation or Terraform
Preferred Qualifications:
- Advocating for adopting industry tools and practices at the right time
- Appreciate the importance of schema design, and can evolve an analytics schema on top of unstructured data.
- Excited to try out new technologies and produce proof-of-concepts that balance technical advancement and user experience.
- Empathetic working with stakeholders, listen to them, ask the right questions, and collaboratively come up with the best solutions for their needs.
- Champion for data privacy and integrity, and always act in the best interest of consumers.
- Understanding of DevOps Research and Assessment (DORA) and the capabilities within the DORA capability catalog is encouraged.
Excella is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected veteran status, age, or any other characteristic protected by law. Excella is committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. To request reasonable accommodation to participate in the job application or interview process, contact Recruiting@excella.com or 703-840-8600.
Know Your Rights
Pay Transparency Notice
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow AWS AWS Glue Azure Big Data CloudFormation Databricks Data pipelines Data warehouse dbt DevOps GitLab Kanban NiFi Pipelines Privacy Python Research Scrum SQL Streaming Terraform Unstructured data
Perks/benefits: Career development Conferences Flex hours Flex vacation Health care Insurance Medical leave Parental leave Salary bonus Team events Wellness
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.