Senior Data Engineer
Tasks
- Automate workflows using Databricks Workflows or Jobs API
- Build test and orchestrate data pipelines in Databricks
- Collaborate with developers and analysts to ensure reliability
- Design and optimize data structures, schemas, and ETL processes
- Diagnose data gaps and quality issues and design validation test cases
- Integrate code into GitHub or GitLab
- Manage database objects in development environments
- Support CI/CD practices
- Translate business use cases into SQL queries, reports, and dashboards
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Apache Airflow | Apache Spark | Azure | CI/CD | Cloud platform | Data Quality | Databricks | Databricks Workflows | ETL | GitHub | GitLab | Google Cloud | Google Cloud Platform | Jobs API | Kafka | SQL
Education
Roles
Regions
Countries
States
Related jobs
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeFayetteville, North Carolina, United States6h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | TS/SCI clearance | Vision insuranceSenior-level Full TimeSneads Ferry, North Carolina, United States6h ago
-
Data Engineer - Mid-Level USD 130K-160KAirflow | Automated Deployment | Automated testing | CI/CD | Control workflows401k matching | Dental insurance | Health insurance | Lunch and snacks provided | Maternity & paternity leaveMid-level Full TimeEl Segundo, California, United States6h ago
-
Senior Software Engineer - Experiment Platform USD 159K-235KA/B | A/B Testing | B testing | Data Pipelines | Data Quality401k plan | Basic life insurance | Dental insurance | Flexible time off | Long-Term Disability coverageSenior-level Full TimeSeattle, Washington, United States8h ago
-
Senior Full Stack Software Development Engineer - AI USD 135K-188KAWS | Agile | Amazon SQS | Automated testing | CI/CD401k matching | Flexible time off | Fully remote | Medical, dental, and vision coverage | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R9h ago
-
AWS | Azure | CI/CD | Cloud platform | Data PipelinesLong-term contractSenior-level Contract Full TimeDallas, TX, United States10h ago
-
Sr. Data Engineer USD 120K-160KAPI | AWS | AWS Glue | Airflow | Amazon RedshiftComprehensive benefits package | In-person collaboration opportunities | Mentorship and growth opportunities | On-call rotation | Remote-firstSenior-level Full TimeOrlando, FL, United States R10h ago
-
Senior AI ML Engineer USD 137K-188KAPI Integration | AWS | AWS Bedrock | AWS Fargate | AWS GlueCareer growth opportunities | Flexible work schedule | Remote-first work environmentSenior-level Contract Full TimeUnited States11h ago
-
Senior Machine Learning (ML) Engineer USD 165K-218KAir-gapped | Air-gapped systems | Airflow | Anomaly Detection | Apache Spark401k match | Caregiver leave | Commuter benefits | Dental benefits | Generous time offSenior-level Full TimeFort Collins, Colorado, United States12h ago
-
Software Engineer, Infrastructure - Autonomy & Robotics USD 130K-285KAlgorithms | Data Processing | Data Structures | Distributed Systems | Distributed data401k match | Basic life insurance | Commuter benefits match | Dental benefits | Disability insuranceMid-level Full TimeSan Francisco, CA13h ago
-
Senior Data Engineer USD 160K-190KAWS | AWS Glue | Apache Spark | Azure | CI/CD401k match | Dental insurance | Medical insurance | Paid parental leave | Paid time offSenior-level Full TimeProvo, Utah14h ago
-
Software Engineer in Data Science USD 180K-253KAPIs | AWS | Airflow | Code review | Continuous DeliveryCompetitive benefits package | In office five days per weekSenior-level Full TimeHouston, TX, United States15h ago
-
Machine Learning Engineer USD 180K-250KAWS | Azure | CUDA | DDP | Distributed Training401k employer match | Health, dental, vision insurance | Paid time off | Professional development | Work-life balanceMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R15h ago
-
Apache Airflow | Data Architecture | Data Engineering | Data Governance | Data ModelingCollaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeMassachusetts R15h ago
-
AI Tooling | Apache Airflow | Data Architecture | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeMinnesota R15h ago
-
Apache Airflow | Data Architecture | Data Compliance | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeIllinois R15h ago
-
Airflow | Analytics engineering | Data Architecture | Data Compliance | Data GovernanceAccess to cutting-edge technologies | Collaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programsSenior-level Full TimeIdaho R15h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Data ObservabilityAccess to cutting-edge technologies | Collaborative work environment | Continuous learning | Flexible work hours | Health and wellness programsSenior-level Full TimeColumbia R15h ago
-
Apache Airflow | Data Architecture | Data Compliance | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Remote workSenior-level Full TimeColorado R15h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Data orchestrationCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeFlorida R15h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Data orchestrationCollaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programs | Remote workSenior-level Full TimeCalifornia R15h ago
-
Apache Airflow | Data Architecture | Data Governance | Data Modeling | Dimensional dataCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Remote workSenior-level Full TimeArizona R15h ago
-
Apache Airflow | Data Architecture | Data Engineering | Data Governance | Data ModelingAccess to cutting edge technologies and data tools | Collaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programsSenior-level Full TimeConnecticut R15h ago
-
Machine Learning Engineer - Computer Vision USD 220K-250KAmazon Bedrock | Cloud ML | Cloud ML services | Computer Vision | Convolutional Neural NetworksCareer growth mindset | Equity | Meaningful impact on product and users | Remote-first work environmentMid-level Full TimeRemote (U.S.) R16h ago
-
Entry-level InternshipHerndon, VA16h ago