Data Engineer
Atlanta, Georgia, United States
R
USD 140K-174K (estimate) Mid-level Full Time
Tasks
- Build batch and streaming ingestion pipelines
- Deliver pipelines from requirements to production with documentation
- Implement data quality checks
- Maintain Medallion architecture
- Manage Unity Catalog governance
- Model datasets for analytics
- Own production pipeline health
- Promote pipelines using CI CD
- Set up monitoring and alerting
- Write PySpark transformations
- Write and tune SQL transformations
Perks/Benefits
Skills/Tech-stack
Airflow | Alerting | Apache Spark | Avro | CDC | CI/CD | Dagster | Data Quality | Databricks | Declarative Pipelines | Delta Lake | Dimensional Modeling | Git | Idempotency | Incremental processing | Lakeflow Declarative Pipelines | Lakeflow Jobs | Late Arriving Data | Merge | Monitoring | Optimize | Parquet | Plan analysis | PySpark | Python | Query Plan | Query plan analysis | SQL | Schema drift | Schema evolution | Slowly Changing Dimensions | Time Travel | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | High School Diploma
Roles
Related jobs
-
Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr) USD 200K-400KClaude Code | Cursor | JavaScript | OpenAI Codex | PythonSenior-level Full TimeMiami R11h ago
-
AI Security Engineer USD 140K-200K800-53 | ABAC | AI RMF | AI Studio | AKS401k matching | Dental insurance | Employee development program | Employee referral program | Medical insuranceSenior-level Full TimeRemote, MD, US R12h ago
-
Junior AI Engineer USD 86K-120KAPI Integration | Authentication | Cloud deployment | Docker | Error Handling401k matching | BYOD reimbursement | Company holidays | Flexible spending accounts | Health savings accountEntry-level Full TimeHouston, Texas, United States (Hybrid) R13h ago
-
Staff Machine Learning Engineer, Traffic Intelligence USD 212K-265KBayesian Calibration | Bayesian Inference | Calibration | Causal Inference | Data PipelinesSenior-level Full TimeUnited States R14h ago
-
Senior Machine Learning Engineer USD 150K-241KC++ | Cloud Architecture | Computer Vision | Data Privacy | EncryptionDiscretionary paid time off | Emotional & mental wellness support | Employer 401k match | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R14h ago
-
Active Learning | Auto-labeling | Computer Vision | Confidence Scores | Data BalancingBonus program | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, CA, USA; San Francisco, … R14h ago
-
Solution Engineer USD 165K-216KCloud Computing | Data Lake | Data Warehouse | Data fabric | Data meshTravelSenior-level Full TimeUS-OH-Remote R16h ago
-
Principal Data Engineer (Remote) USD 151K-189KAmazon Kinesis | Apache Spark | CI/CD | Cloud Data | Cloud Data Services12 weeks new parent leave | Coworking support | Flexible PTO | Learning & development stipend | Time allotment for learning and developmentSenior-level Full TimeUnited States R16h ago
-
Lead Data Engineer (Remote) USD 126K-157KAWS | AWS Redshift | Amazon Kinesis | Azure | Azure DataCoworking support | Flexible PTO | Learning and development stipend | New parent leave | Remote workSenior-level Full TimeUnited States R16h ago
-
Senior Machine Learning Engineer, Vehicle Perception USD 140K-230KAblation Studies | C plus plus | Cloud Computing | Computer Vision | Data CurationComprehensive benefits package | Hybrid work schedule | Incentive programsSenior-level Full TimePalo Alto, CA R17h ago
-
Senior Analytics Engineer USD 141K-176KAWS Glue | Amazon Athena | Apache Hive | Apache Spark | CI/CDGenerous time off | Healthcare | Occasional travel for in person meetings | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R17h ago
-
Senior Software Engineer (Forward Deployed) USD 180K-264KAWS | Automation | Data Contracts | Data Governance | Data QualityHybrid work | On-call support | Travel opportunitiesSenior-level Full TimeLondon - Hybrid; New York - … R18h ago
-
Data Scientist USD 90K-120KAWS | Agentic AI | Azure | Cypress | Data Analysis401k employer contribution | Remote work optionMid-level Full TimeRemote, USA R19h ago
-
Senior AI Engineer USD 170K-190KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon AuroraCareer advancement | Employee assistance program | Employee recognition | LinkedIn Learning Platform | Open PTOSenior-level Full TimeRemote US R19h ago
-
Senior Machine Learning Engineer I, AI & ML Platform USD 183K-205KAWS | Azure | DevOps | K8s | Kubernetes401k match | Child care backup care and elder care | Donation matching | Fertility care support | Fitness Mindfulness Nutrition and Sleep SubscriptionSenior-level Full TimeSan Francisco, CA (Hybrid) R20h ago
-
Data Analytics Engineer USD 130K-204KCommon table expressions | Data Modeling | Data Quality | Data Transformation | Data ValidationHealth insurance | Paid Company Holidays | Paid time offMid-level Full TimeUnited States R20h ago
-
AI Engineer (Remote) USD 169K-230KAWS | Agent systems | Application development | Automation | Azure401k plan | Accident insurance | Dental insurance | Disability insurance | Flexible spending accountExecutive-level Full TimeFort Washington, PA, United States R20h ago
-
Software Engineer, Storage USD 80K-105KAnsible | Ceph | Continuous Deployment | Continuous integration | Distributed Systems401k match | Anniversary bonus | Dental insurance premium paid by employer | Gym membership reimbursement | Health Insurance Premium Paid by EmployerMid-level Full TimeRemote - United States R20h ago
-
Senior Storage Engineer USD 130K-150KAutomation | Bash | Cause analysis | Ceph | Cloud infrastructure401k match | Company-paid health insurance | Gym membership reimbursement | Internet reimbursement | Paid sabbaticalSenior-level Full TimeRemote - United States R20h ago
-
Storage Operations Engineer USD 80K-100KAnsible | Automation | Bash | Block Storage | Ceph100 percent company paid insurance premiums | 401k match | Company paid Wellable subscription | Gym membership reimbursement | Internet reimbursementMid-level Full TimeRemote - United States R20h ago
-
Staff/Senior Agentic AI Engineers (Multiple roles) USD 180K-215KAPI Design | AWS | Agent Orchestration | Agentic AI | Cloud infrastructureSenior-level Full TimeSan Francisco, California R21h ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Machine Learning | CI/CDRemote | USC OnlySenior-level Full TimeDallas, TX. R21h ago
-
ABAC | AWS CloudFormation | AWS Lambda | AWS Step Functions | AWS-APIsOnsite/hybrid workSenior-level Full TimeChantilly, Virginia R21h ago
-
Senior Site Reliability Engineer USD 168K-200KAWS | Alerting | Amazon S3 | Apache Kafka | AutoscalingSenior-level Full TimeRemote - United States R22h ago
-
Senior Machine Learning Engineer USD 216K-303KAd Ranking | Convolutional Neural Networks | Data Pipelines | Deep learning | Feature Engineering401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Health care benefitsSenior-level Full TimeRemote - United States R23h ago