Data Engineer
Netanya, Center District, IL
DRS RADA Technologies
Description
Join Our Team as a Senior Data Engineer at DRS RADA Technologies!
Job Summary:
We are seeking an experienced Senior Data Engineer to join our data engineering team. In this role, you will play a crucial part in designing, developing, and maintaining scalable data pipelines and infrastructure to support our AI department. This is an opportunity to work with cutting-edge technologies in a fast-paced production environment, driving impactful, data-driven solutions for the business.
Key Responsibilities:
- Design, develop, and optimize ETL/ELT pipelines for large-scale data processing.
- Work with a modern data stack, including Databricks (Spark, SQL), Apache Airflow, Azure services.
- Troubleshoot and optimize queries and jobs for performance improvements.
- Implement best practices for data governance, security, and monitoring.
- Stay updated with industry trends and emerging technologies in data engineering.
Requirements
Required Qualifications:
- 4+ years of experience in data engineering or related fields.
- Proficiency in Python for data processing and automation.
- Expertise in Apache Airflow for workflow orchestration -Must
- Deep understanding of Apache Spark and Databricks for big data processing.
- Familiarity with cloud-based environments, particularly Azure.
- Advanced proficiency in SQL and query optimizations.
- Familiarity with data modeling, ETL/ELT principles, and performance tuning.
- Knowledge of CI/CD, containerization (Docker).
- An enthusiastic, fast-learning, team-oriented, and motivated individual who loves working with data.
If you're passionate about building scalable data solutions and thrive in a fast-paced environment, we’d love to hear from you!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Azure Big Data CI/CD Databricks Data governance Data pipelines Docker ELT Engineering ETL Pipelines Python Security Spark SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.