Data Engineer - (Purchasing Power) | Hybrid - Atlanta, GA)
Remote - GA, United States
R
USD 130K-184K (estimate) Senior-level Full Time
Tasks
- Build Airflow DAGs
- Build batch data pipelines
- Collaborate with analytics teams for BI data delivery
- Design streaming data pipelines
- Develop data ingestion pipelines
- Implement CDC ingestion
- Implement data quality, monitoring, and alerting
- Implement schema evolution practices
- Maintain Kafka topic configuration
- Manage consumer groups
- Monitor pipeline performance and data latency
- Optimize streaming pipeline performance
- Support incident resolution and root cause analysis
- Support platform modernization and integrations
- Transform and enrich data with Spark
- Troubleshoot pipeline issues
- Tune system performance and optimize platform
Perks/Benefits
- 401k retirement plan
- Career development opportunities
- Company paid life insurance
- Employee purchase program
- Flexible paid time off
- Hybrid work model
- Medical, dental & vision coverage
Skills/Tech-stack
AWS | Amazon S3 | Apache Airflow | Apache Spark | CDC | Elastic | Greenplum | Kafka | Kafka Connect | Kibana | PySpark | SQL
Education
N/A
Roles
Related jobs
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R6h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R14h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R14h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R14h ago
-
ML Ops Engineer USD 174K-226KAWS | Cloud infrastructure | Cost Optimization | Data Ingestion | GCPHybrid work schedule | In-office at least 3 days per weekMid-level Full TimeSan Francisco HQ Office R15h ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R17h ago
-
Data Engineer USD 130K-145KApache Spark | CI/CD | Cloud platform | Containerization | Data GovernancePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R22h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingFlexible work environment | Open office environment | Remote work | Team building eventsSenior-level Full TimeMinnesota R22h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Team building eventsMid-level Full TimeMassachusetts R22h ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeIdaho R22h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative open office environment | Flexible work environment | Remote work | Team building eventsSenior-level Full TimeIllinois R22h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work environment | Flexible work atmosphere | Team building eventsSenior-level Full TimeColumbia R22h ago
-
Apache Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work culture | Flexible work environment | Open office environment | Team building eventsMid-level Full TimeColorado R22h ago
-
Airflow | BigQuery | Cloud platform | Data Governance | Data ModelingCollaborative work culture | Flexible work environment | Team building eventsSenior-level Full TimeFlorida R22h ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data ConsistencyCollaborative work environment | Remote work flexibility | Team building eventsMid-level Full TimeCalifornia R22h ago
-
Airflow | BigQuery | Cloud platform | Data Modeling | Database ManagementFlexible work environment | Open office environment | Team building eventsSenior-level Full TimeArizona R22h ago
-
Apache Airflow | BigQuery | Business Intelligence | Cloud platform | Data GovernanceCollaborative open office | Flexible work environment | Team building eventsSenior-level Full TimeConnecticut R22h ago
-
Sr. Analytics Engineer, Business Intelligence USD 115K-145KDBT | Data Architecture | Data Modeling | Data Quality | Data Warehouse401k | Dental insurance | Discounts and perks | Medical insurance | Paid leaveSenior-level Full TimeNew York, NEW YORK, United States R23h ago
-
API Integration | Asynchronous processing | Chatbots | Deep learning | Distributed Systems100% remote | Flexible scheduleMid-level Full TimeAnnapolis, Maryland, United States R1d ago
-
Mid-level Full TimeRemote, United States R1d ago
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R1d ago
-
Apache Airflow | AtScale | BigQuery | CI/CD | Cloud DataSenior-level Full TimeGEORGIA - VIRTUAL - GA01, United … R1d ago
-
Airflow | BigQuery | CI/CD | Data Modeling | Data WarehousingRemoteMid-level Full TimeGEORGIA - VIRTUAL - GA01, United … R1d ago
-
Senior Analytics Engineer USD 87K-161KData Lakehouse | Data Modeling | Data mesh | Data pipeline | Databricks401k | Health insurance | Hybrid work options | Paid Holidays | Paid time offSenior-level Full TimeRemote-MO, United States R1d ago
-
Data Engineer II USD 63K-114KData Validation | Data orchestration | Data pipeline | ETL | SQL401k | Flexible work schedule | Health insurance | Paid time off | Stock purchase plansMid-level Full TimeRemote-MN, United States R1d ago