Senior Data Engineer
Tasks
- Add observability metrics logs lineage and alerting
- Apply data security and governance for PII
- Build batch and streaming data pipelines
- Create orchestration workflows and scheduling
- Define schemas and data contracts
- Design data aggregates and marts
- Implement data quality validation and anomaly detection
- Optimize compute and storage performance
- Run backfills and reconciliation
- Set up CI CD for data pipelines
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Step Functions | Amazon Athena | Amazon EMR | Amazon Kinesis | Amazon Redshift | Amazon S3 | Anomaly Detection | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Spark | CI/CD | Dagster | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Delta Lake | Dimensional Modeling | Event modeling | Go | Incremental processing | Java | Kafka | PII | Parquet | Partitioning | Python | SQL | Scala | Snowflake Schema | Star Schema | Step Functions
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R10d ago
-
Senior AI Solutions Builder, People USD 134K-192KAgent Development | Artificial Intelligence | Automation | Coding | Data GovernanceSenior-level Full TimeRemote, United States R10h ago
-
Data Engineer USD 100KAPIs | Apache Kafka | Apache Spark | Azure | Azure Data401k match | Dental insurance | Life insurance | Medical insurance | Paid sick leaveEntry-level Full TimeRemote, US R10h ago
-
Data Automation Engineer USD 110K-125KAPI Integration | AWS | Airflow | Azure | C SharpDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceMid-level Full TimeRemote - United States R11h ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Ad Exchanges | Apache Kafka | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R11h ago
-
Lead AI Engineer USD 200K-215KA/B | A/B Testing | AWS Bedrock | Agentic LLM | Agentic LLM systemsDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R11h ago
-
Data Engineer USD 135K-200KAPI Integration | AWS Firehose | AWS Kinesis | AWS Lambda | Amazon ECS401k | Dental insurance | Disability insurance | EAP | Employee assistance programSenior-level Full TimeNew York, NY (remote) R11h ago
-
Data Engineer - Governance and QA USD 120K-150KCI/CD | DBT | Data Architecture | Data Contracts | Data Modeling401k with company match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeDallas, TX - Hybrid (3x in … R16h ago
-
Analytics Engineer (Finance) USD 74K-143KAgent Design | Churn analysis | Cohort Analysis | DBT | Data Modeling401k | Dental insurance | Health insurance | Hybrid work | Paid time offMid-level Full TimeUS - Remote R16h ago
-
Senior Sales Engineer - Key Accounts Northcentral USD 149K-198K.NET | CRM | Go | Java | Node.jsCommunity guilds | Employee stock purchase plan | Hybrid work | Inclusion talks | Mentor/Buddy programSenior-level Full TimeChicago, Illinois, USA; Michigan, USA, Remote; … R16h ago
-
Senior Data Engineer USD 143K-229KAnalysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services Tabular | Azure DataMentorship | Remote work optionSenior-level Full TimeKansas City, MO, United States R16h ago
-
Databricks Pipeline Architect USD 150K-180KAWS Glue | AWS Lambda | AWS S3 | Agile | Amazon Web ServicesPublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R16h ago
-
Tier 3 Network Systems Engineer (Remote) USD 80K-101KActive Directory | Ansible | Ansible Playbook | Apache HTTP | Apache HTTP ServerAfter hours availability | Customer support support | On-call rotation | Remote workMid-level Full TimeDallas, TX, US R17h ago
-
Account-based marketing | Airflow | Amazon Redshift | Amazon SageMaker | BigQueryCompetitive paid time off | Education reimbursement | Employee assistance program | Health care coverage | Monthly Wellness or Home Office ReimbursementSenior-level Full TimeChicago, IL, United States R20h ago
-
Account-based marketing | Amazon Redshift | Amazon SageMaker | Apache Airflow | DBTAccess to employee assistance program | Charitable contribution match | Competitive paid time off | Education reimbursement | Health care coverageSenior-level Full TimeWashington, DC, United States R20h ago
-
Alteryx | Amazon Redshift | Amazon SageMaker | Apache Airflow | DBTCharitable contribution match | Competitive paid time off | Education reimbursement | Employee assistance program | Health care coverageSenior-level Full TimeAtlanta, GA, United States R20h ago
-
Account-based marketing | Airflow | Amazon Redshift | Amazon SageMaker | Customer health scoringCompetitive paid time off | Education reimbursement | Employee assistance program | Health care coverage | Monthly Wellness or Home Office ReimbursementSenior-level Full TimeDallas, TX, United States R20h ago
-
Senior Machine Learning Engineer USD 150K-200KDistributed Systems | Feature Engineering | Feature Selection | Language Models | Language Processing401k matching | Cell phone and internet stipend | Employee stock purchase plan | Flexible time off | Learning programsSenior-level Full TimeRemote - USA R1d ago
-
Senior Software Engineer - Data Platform USD 186K-218KAccess Control | Airflow | Apache Kafka | Apache Spark | CachingSenior-level Full TimeRemote - USA R1d ago
-
Senior-level Full TimeHybrid (Salt Lake City, UT, US) R1d ago
-
Robotics Perception Engineer USD 140K-204KC++ | CI/CD | Camera-based perception | Cameras | Cloud processingCompany-provided laptop | Dental insurance | Health insurance | Paid time off | Remote work optionMid-level Full TimeAtlanta, Georgia, United States - Remote R1d ago
-
Robotics Hardware Integration Engineer USD 120K-158KAWS IoT | AWS IoT Core | AWS IoT Greengrass | C++ | CANDirect impact on shipped products | Early-stage company | Equity | Health, dental, and vision insurance | Permissive time off policyMid-level Full TimeAtlanta, Georgia, United States - Remote R1d ago
-
Robotics Navigation and Control Engineer USD 160K-240KA Star | C++ | CI/CD | EKF | GazeboCompany laptop | Health, dental, vision benefits | Permissive time off | Remote work | Travel to Atlanta facility for hardware integrationSenior-level Full TimeAtlanta, Georgia, United States - Remote R1d ago
-
Sr. Full Stack Engineer – AI/ML USD 151K-220KAPI Design | Alerting | Architecture Documentation | Artificial Intelligence | Capacity PlanningSenior-level Full TimeRemote Office - KY, United States R1d ago
-
Agentic AI Engineering Intern USD 48K-86KAgent systems | Autogen | Automated testing | CI/CD | CrewAIEntry-level Full Time Internship6314 Remote/Teleworker US, United States R1d ago