Senior Data Engineer - Technology
Duluth, Georgia, United States
USD 125K-160K (estimate) Senior-level Full Time
Tasks
- Architect testable version controlled observable data transformations
- Build pipelines for near real time and batch workloads
- Design ETL/ELT pipelines
- Establish pipeline development patterns and best practices
- Evaluate and implement stream processing technologies
- Integrate data models for reporting AI ML and features
- Migrate ETL workloads to AWS Glue and S3
- Optimize Redshift materialized views and query performance
- Reduce Redshift data warehouse cost
- Support production incidents for data infrastructure
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Step Functions | Amazon Kinesis | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Flink | Apache Kafka | CI/CD | DBT | Data orchestration | Error Handling | Infrastructure as Code | Kafka Streams | Materialized views | Monitoring | PySpark | Python | Redshift | SQL | SQL Linting | Step Functions | “as-code”
Education
Roles
Related jobs
-
Data Engineer USD 114K-190KApache Airflow | Big Data | Data profiling | EJB | ETLHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Chantilly3h ago
-
Apache Spark | Automated testing | CI/CD | Data Governance | Data Modeling401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeNew York3h ago
-
Databricks Engineer USD 107K-179KAPI Integration | Agile | Data Governance | Data Modeling | Data QualityDiscretionary incentive program | Mentorship | Professional development | Travel opportunitiesMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …3h ago
-
Senior ML Engineer, AI-Driven SDLC Quality USD 174K-253KAgentic Systems | Dataset development | Distributed Computing | Evaluation Frameworks | Generative AISenior-level Full TimeSan Jose, CA, USA4h ago
-
Staff Software Engineer, Data USD 117K-171KAPIs | AWS | CI/CD | Data Engineering | Data ObservabilityBonus/incentive programs | Dental | Health care | Paid time off | RetirementSenior-level Full TimeCreve Coeur, Missouri, US7h ago
-
Senior / Principal Infrastructure Engineer - ML Platform USD 278K-345KAWS | CI/CD | Cloud infrastructure | Cloud platform | Cluster managementEquity compensation | Onsite schedule Tuesday Wednesday ThursdaySenior-level Full TimeSan Mateo, CA, United States R10h ago
-
Senior-level Full TimeCosta Mesa, California, United States13h ago
-
Robotics Software Engineer, Sensor Integration USD 191K-253KAgent systems | C++ | Computer Vision | Distributed Systems | Embedded SystemsEmployee assistance programs | Health benefits | Recovery Benefits | Travel opportunitiesMid-level Full TimeCosta Mesa, California, United States13h ago
-
Software Engineer - Business Analytics USD 100K-125KAPI Integration | Cloud Computing | Data Modeling | Data Visualization | Database401k matching | Equity package | Global Entry | Health and wellness stipend | Health, dental, vision insuranceEntry-level Full TimeSan Diego14h ago
-
Entry-level Full TimeAlcoa, TN, US15h ago
-
Senior Software Engineer - Backend & Machine Learning USD 180K-250KAWS | Amazon Web Services | Argo | Blue-Green Deployment | Blue/greenSenior-level Full TimeNew York, New York, United States15h ago
-
Mid-level Full TimeCarmel, Indiana- Hybrid OR St. Louis, … R15h ago
-
Senior-level Full TimeUS-WA-Bellevue16h ago
-
Senior-level Full TimeMansfield, MA (Remote) R16h ago
-
Staff Software Engineer, Applied AI USD 200K-240KDataset curation | Evaluation | FastAPI | LLM | Langchain401k | Co-working space reimbursement | Equity incentive | Flexible vacation policy | HSA contributionSenior-level Full TimeU.S. (Remote) R17h ago
-
Software Engineer - Training/Inference (C++) USD 180K-440KAuto Scaling | C++ | CI/CD | CUDA | Code generation401k plan | Dental insurance | Disability insurance | Discounts | Health insuranceSenior-level Full TimePalo Alto, CA18h ago
-
Mid-level Full TimeMountain View, California, United States18h ago
-
Sr. Lead Software Engineer - AWS Data Engineer - AI/ML USD 170K-185KAWS | Airflow | Apache Airflow | Automated testing | BedrockBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeHouston, TX, United States18h ago
-
AWS | Airflow | Apache Flink | Apache Spark | CrawlingCareer growth | Competitive pay | Remote workMid-level Full TimeColumbia - Maryland18h ago
-
Airflow | Amazon Neptune | Apache Cassandra | Apache Flink | Apache SparkRemote work | US time zones supportMid-level Full TimeColumbia - Maryland18h ago
-
Sr AI Engineer I USD 123K-215KAWS | Agent Orchestration | Distributed Systems | Evaluation | Event DrivenVisa sponsorshipSenior-level Full TimePhoenix, AZ, United States18h ago
-
Senior ML Ops Engineer USD 210K-300KAWS | Airflow | Amazon SageMaker | Aurora | Bedrock401k matching | Catered meals | Dental and vision coverage | Desk setup stipend | Paid health coverageSenior-level Full TimeNYC Office18h ago
-
Applied AIML, Senior Associate USD 176K-215KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AlertingBackup childcare | Financial coaching | Health insurance | Mental health support | On-site wellness centersSenior-level Full TimeJersey City, NJ, United States18h ago
-
AI Integration Engineer USD 125K-188KAWS | AWS Lambda | Algorithms | Amazon S3 | Artificial Intelligence401k matching | Commuter benefits | Dental insurance | Free snacks | Health insuranceMid-level Full TimeWashington D.C.20h ago
-
Staff Software Engineer, Data Platform (FedRamp) USD 194K-267KApache Beam | Apache Flink | Apache Hadoop | Apache Spark | Data Observability401k | Dental insurance | Flexible spending account | Health insurance | Paid leaveSenior-level Full TimeSan Francisco, California20h ago