Senior Data Engineer
Tasks
- Architect data pipelines with Data Science and Product
- Build and maintain batch and streaming pipelines
- Consult on cross functional data projects
- Define global data ontology
- Develop automated data tooling and self service tools
- Implement data governance and lifecycle management
- Manage dataset SLAs
- Optimize data infrastructure performance
Perks/Benefits
Skills/Tech-stack
AWS | Airflow | Azure | BigQuery | CI/CD | Composer | Dataflow | Dataproc | ELT | ETL | GCP | GDPR | GitOps | Oozie | Pr | PySpark | SQL | Scala
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R19d ago
-
Senior Data & ML Ops Engineer USD 137K-206KAWS | Airflow | Amazon SageMaker | Automated retraining | Automated testingHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeBoston, Massachusetts, US, 022105h ago
-
Accessibility API | Algorithms | Analytics | App SDK | Asynchronous programmingSenior-level Full TimeKansas City, MO, USA6h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Career growth | Competitive compensation | Remote-friendly cultureMid-level Full TimeLong Beach, CA, USA6h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Friendly work environment | Remote workMid-level Full TimeSalt Lake City, UT, USA6h ago
-
AI Data | Bash | Cloud infrastructure | Data Ingestion | Data Ingestion PipelinesAsynchronous culture | Flexible team environment | Remote-friendlyMid-level Full TimeBerkeley, CA, USA6h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous work culture | Career growth | Flexible management | Impactful missionMid-level Full TimeIrvine, CA, USA6h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Flexible management approach | Remote/distributed work | Supportive teamMid-level Full TimeHuntsville, AL, USA7h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environment | Remote-first environmentMid-level Full TimeTampa, FL, USA7h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly work environment | Portfolio supportMid-level Full TimeNew Haven, CT, USA7h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Flexible work environment | Impactful product mission | Remote workMid-level Full TimeColorado Springs, CO, USA7h ago
-
Bash | Data Processing | Data Processing Pipelines | Docker | GCPAsynchronous culture | Bonus | Equity | Flexible management | Remote workMid-level Full TimeHonolulu, HI, USA7h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous work culture | Bonus opportunity | Friendly work environment | Remote-friendlyMid-level Full TimeMilwaukee, WI, USA7h ago
-
Bash | Cloud Computing | Data Processing | Docker | GCPAsynchronous culture | Flexible working style | Portfolio support | Remote-friendly environmentMid-level Full TimeNorfolk, VA, USA7h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Remote-friendly | Supportive teamMid-level Full TimeLouisville, KY, USA7h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Friendly atmosphere | Opportunity to impact product | Remote-friendlyMid-level Full TimeTbilisi, Georgia7h ago
-
Senior-level Full TimeSan Francisco10h ago
-
Senior Machine Learning Engineer, Shield USD 211K-263KAnomaly Detection | Apache Spark | BigQuery | Cloud platform | DataflowSenior-level Full TimeRedwood City, CA, United States R12h ago
-
Analytics Engineer USD 116K-152KAWS S3 | Command Line | Data Modeling | Data Validation | Data pipeline401k match | Commuter benefits | Dental insurance | Fitness benefits | Health insuranceMid-level Full TimeJersey City, New Jersey, United States13h ago
-
Software Engineer - Database Engineering USD 160K-230KC++ | Concurrency | Data Processing | Data Structures | Data structures algorithmsOn site work opportunityMid-level Full TimeUS-CA-Menlo Park13h ago
-
Data Engineer USD 120K-153KAirflow | CI/CD | CRM | Cloud Data | Cloud Data Warehouse401k match | Cell phone reimbursement | Dinner provided weekly | EV charging | Flexible PTOMid-level Full TimeEl Segundo, California, United States14h ago
-
Data Engineer, Palo Alto USD 110K-180KAPI | AWS | C Sharp | C plus plus | Data Governance401k matching | Bonus incentives | Dental insurance | Flexible spending account | Health insuranceMid-level Full TimePalo Alto, California, United States14h ago
-
Data Engineer USD 85K-105KAJAX | AWS | Access Management | Active Directory | Amazon ECS401k match | Charitable donation match | Childcare Account | Company holidays | Dental insuranceMid-level Full TimeDurham15h ago
-
Embedded Software Engineer, Onboard Test Automation USD 209K-266KBuildkite | C++ | CI/CD | Debugging | Hardware-in-the-loopSenior-level Full TimeSunnyvale15h ago
-
Forward Deployed AI Solutions Engineer USD 105K-132KAPIs | Auditability | Authentication | Command Line | Command-line Interface401k benefits | Baby bonding leave | Commuter benefits | Disability coverage | Employee referral programMid-level Full TimeUS Remote R15h ago