Data Engineer - Purchasing Power (Open to Relocation | Hybrid - Atlanta, GA)
Remote - GA, United States
R
USD 135K-180K (estimate) Senior-level Full Time
Tasks
- Build Spark transformations and enrichment
- Configure Kafka topics and consumer groups
- Develop streaming and batch data pipelines
- Ensure reliable delivery to analytics systems
- Implement Kafka ingestion pipelines
- Manage schema registration and schema evolution
- Monitor pipeline performance and data latency
- Orchestrate workflows with Airflow DAGs
- Perform data validation and monitoring
- Support incident resolution and root cause analysis
- Troubleshoot streaming pipeline issues
- Tune system performance and optimize platform
Perks/Benefits
- 401k retirement plan
- Career development opportunities
- Employee purchase program
- Flexible paid time off
- Hybrid work model
- Relocation support
Skills/Tech-stack
AWS | Airflow | Change Data Capture | Data Capture | Data Monitoring | Data Validation | Elasticsearch | Greenplum | Kafka | Kafka Connect | Kibana | PySpark | S3 | SQL | Spark
Education
N/A
Roles
Related jobs
-
Staff Software Engineer, AI Data Platform USD 250K-280KCloud platform | Google Cloud | Google Cloud Platform | GraphQL | KafkaSenior-level Full TimeSan Francisco Bay Area R15h ago
-
Data Platform Engineer USD 182K-240KAWS | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Kafka401k | Dental insurance | Family leave | Flexible paid time off | Free food and snacksSenior-level Full TimeOrlando, Florida, United States - Remote R17h ago
-
Senior Data Engineer IS - Remote USD 122K-208KAPI | API Integration | Access Control | Alerting | BashRemote work | Rotational on-call supportSenior-level Full TimeRenton, WA, United States R17h ago
-
Senior-level Full TimeUnited States - Remote R18h ago
-
Sr Data Engineer USD 115K-145KAWS S3 | Apache Airflow | Azure Blob | Azure Blob Storage | BigQuery401k | Dental insurance | Discounts | Fully remote | Health insuranceSenior-level Full TimeNew York, NEW YORK, United States R18h ago
-
Senior Staff Software Engineer, Data Platform USD 253K-298KAI Agents | Agent systems | Batch Processing | Change Data Capture | Compliance401k | Quarterly in person surges | Remote-firstSenior-level Full TimeRemote - USA R20h ago
-
Senior Software Engineer, Data Systems (Python) USD 170K-200KAPI Design | API Keys | Apache Airflow | Authentication | BigQuery12 Company Paid Holidays | 401k | Company-Paid Holidays | Flexible PTO | Healthcare benefitsSenior-level Full TimeRemote - USA R20h ago
-
AI/ML Security Engineer USD 102K-163KAPI Integration | AWS | Azure | Benchmarking | EvaluationCorporate holidays | Flexible time off | Group dental insurance | Group health insurance | Pet benefit optionMid-level Full TimeRemote R20h ago
-
Senior Staff Engineer - Senior Data Engineer USD 135K-165KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | DatabricksRemote workSenior-level Full TimeRemote, REMOTE, United States R21h ago
-
Staff Engineer - AI Engineer USD 110K-130KERP | Hugging Face | Langchain | MES | ModbusRemote workSenior-level Full TimeRemote, REMOTE, United States R21h ago
-
Principal AI Engineer USD 160K-220KAI Governance | API Design | AWS | AWS Bedrock | Agent OrchestrationSenior-level Full TimeUS - Remote R21h ago
-
AI/ML Engineer II USD 159K-211KAPI Design | AWS | Agent Orchestration | Agent systems | AzureHealth benefits | Onsite collaboration | Paid time off | Professional developmentMid-level Full TimeRemote, USA R21h ago
-
AI/ML Engineer USD 150K-211KAWS | Agent systems | Cloud platform | Data Pipelines | DockerOnsite schedule | WFH FridayEntry-level Full TimeRemote, USA R21h ago
-
Sr. Machine Learning Engineer, Applied Science USD 161K-332KComputer Vision | Diffusion Models | Fine Tuning | Generative Modeling | Human FeedbackSenior-level Full TimeSan Francisco, CA, US; Remote, US R21h ago
-
Data Engineer USD 130KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | CI/CDEmployer paid medical/dental/vision | Flexible work | Health savings account | Life insurance | Remote work policyMid-level Full TimeRosslyn, VA or Remote R22h ago
-
Senior Data Engineer II, Finance USD 183K-232KAirflow | Amazon Redshift | Apache Iceberg | Apache Spark | AuditabilityFlex First work policy | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
Senior AI Engineer USD 95K-197KAWS | Autogen | Azure | CI/CD | Clean CodeAutonomy | Learning and development programs | MentorshipSenior-level Full TimeSeattle, Washington, USA R23h ago
-
ML Ops Lead USD 175K-340KAWS Glue | AWS Lambda | AWS S3 | Airflow | Amazon RedshiftPotential contract conversion to full time | Quarterly team offsites | Remote workSenior-level Full TimeRemote (US) R23h ago
-
1094- AI Platform Engineer (Generative AI) USD 158K-168KAI Agents | AWS | CI/CD | DevOps | Generative AIRemote workMid-level Full TimeUnited States of America R23h ago
-
Senior Software Engineer - Data Platform USD 186K-218KAirflow | Apache Kafka | Apache Spark | Caching | Cloud DataQuarterly in person surges | Remote-first work modelSenior-level Full TimeRemote - USA R1d ago
-
AI/ML Engineer USD 125K-173KAWS | Data Analysis | Embeddings | Experimentation | Feature Engineering401k match | Commuter benefit | Generous vacation policy | Hybrid work environment | Medical, dental, vision, life, and disability benefitsEntry-level Full TimeSan Francisco, CA, USA R1d ago
-
Senior AI/ML Engineer USD 172K-238KAWS | Apache Airflow | Apache Kafka | Deep learning | Language Processing401k match | Commuter benefit | Health benefits | In-office/hybrid work | Paid parental leaveSenior-level Full TimeChicago, IL, USA; New York, NY, … R1d ago
-
Staff ML Risk Analytics USD 193K-228KBig Data | Data Quality | Feature Engineering | Feature Store | Fraud Detection401k matching | Medical/Dental/Vision | Quarterly in person surges | Remote-first work cultureSenior-level Full TimeRemote - USA R1d ago
-
Consulting Pre-Sales Systems Engineer, Data Management USD 141K-212KAWS | Ansible | Apache Kafka | Azure | ContainersCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeRemote, United States R1d ago
-
AWS Glue | Access Control | Amazon Kinesis | Apache Airflow | Automated testingData sharing governance | Hybrid workSenior-level Full TimeNew York, New York, United States R1d ago