Data Engineer

Overview

• Agile Defense is looking for a Data Engineer to join our growing team! The Data Engineer will service existing products with enhancements, bug fixes and updates while also creating new analytics products at the request of the PO. The role operates in an Agile environment that continuously deploys code and requires a solid understanding of the full software lifecycle, including DevSecOps, Software Development, System Integration, Infrastructure Management, and Cyber Security related to public-facing government products. As a direct employee of Agile Defense, you would receive a benefit package that includes health/dental/vision insurance coverage, 401K with company match, PTO & paid holidays, and annual tuition/training assistance. For more information, please visit our website.

Clearance

• Public Trust

Responsibilities/Duties

• Strong oral and written communication skills.
• o Able to communicate effectively with Product Owners (POs) and stakeholders to understand requirements/scope and be able to translate that into user stories.
• o Able to effectively communicate and coordinate between stakeholders, POs, and team members including designers, business analysts, developers, and Scrum Masters across other development teams.
• · Work to become a subject matter expert for the products that are supported.
• · Able to assist with testing/communication/de-bugging with external integration partner system teams.
• · After team onboarding, work independently to continue to learn the system and products by reviewing resources and documentation, testing, and engaging with design, development, Product Owner and stakeholders in great detail.
• · Design, build, and maintain efficient ETL/ELT data pipelines
• · Develop and optimize SQL queries for large-scale data processing
• · Implement data quality checks and monitoring systems
• · Create and maintain database schemas and data models
• · Collaborate with cross-functional teams to integrate data from multiple sources
• · Optimize database performance through indexing, query analysis, and partitioning
• · Automate data workflows using CI/CD pipelines

Required Qualifications

• · 3-5 Years of Experience working in an Agile and Scrum software development environment performing the duties of a Data Engineer.
• · Experience with Databricks notebooks, job schedules, SQL query tools
• · Experience managing multi-hope data processing pipelines (185 separate nodes in data pipeline)
• · Experience with scripting in SQL, pyspark, and bash shell
• · Experience with postgres database management
• · Experience with FlaskAPI
• · Experience with AWS Cloudflare, S3, EC2, EKS, ALB
• · Experience with Docker containerization
• · Experience with Apigee
• · Experience with Jenkins, GitHub and separate code environment

Preferred Qualifications

• · Familiar with and experience using tools like Jira, Confluence, Mural, and Teams to communicate requirements, design, processes, and content.
• · Experience working in an Agile software development environment and familiar with Scrum structure and ceremonies
• · Knowledge of cloud platforms (AWS, Azure, etc.)
• · Experience with Jenkins or similar CI/CD tools
• · Familiarity with data visualization tools
• · USCIS or DHS Experience

Employees of Agile Defense are our number one priority, and the importance we place on our culture here is fundamental. Our culture is alive and evolving, but it always stays true to its roots. Here, you are valued as a family member, and we believe that we can accomplish great things together. Agile Defense has been highly successful in the past few years due to our employees and the culture we create together. 
What makes us Agile? We call it the 6Hs, the values that define our culture and guide everything we do. Together, these values infuse vibrancy, integrity, and a tireless work ethic into advancing the most important national security and critical civilian missions. It's how we show up every day. It's who we are.
We also believe in supporting our employees by offering a competitive and comprehensive benefits package. To explore the benefits we offer, please visit our website under the Careers section.
Happy - Be Infectious.Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.
Helpful - Be Supportive.Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.
Honest - Be Trustworthy.Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support.
Humble - Be Grounded.Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.
Hungry - Be Eager.Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.
Hustle - Be Driven.Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities