Cloud Platform - Data Engineer
Tasks
- Build ETL pipelines
- Build dashboard infrastructure
- Build observability dashboards
- Collaborate with data scientists on training pipelines
- Design data quality checks
- Develop dbt transformations
- Implement incremental loading
- Implement infrastructure-as-code
- Ingest validate transform and load robot telemetry
- Maintain data warehouse schemas
- Manage ML training infrastructure
- Optimize BigQuery and Athena queries
- Orchestrate model training evaluation and registration
- Participate in data pipeline on call
- Set up CI/CD pipelines
Perks/Benefits
- 401k
- Dental insurance
- HSA
- Health insurance
- Onsite work five days per week
- Paid Holidays
- Paid parental leave
- Paid sick time
- Paid time off
- Vision insurance
Skills/Tech-stack
Airflow | Amazon Athena | Amazon S3 | Argo Workflows | BigQuery | CI/CD | Cloud platform | DBT | Docker | ETL | GCP | Google Cloud | Google Cloud Platform | Grafana | Kubernetes | Machine Learning | Pandas | Prefect | Python | SQL | Superset | Terraform
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R8d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R21d ago
-
Sr. Solutions Engineer USD 180K-247KAmazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | AzureFlexible work arrangements | Travel reimbursementSenior-level Full TimeUnited States3h ago
-
Distributed Systems | Failover | Go | High Availability | Incident ResponseSenior-level Full TimeBellevue, Washington9h ago
-
Software Engineer II, Data Platform USD 150K-225KAWS | Amazon Kinesis | Amazon SQS | Apache Flink | Apache SparkBonus eligibility | Dental insurance | Employee discounts | Health insurance | Matching 401kMid-level Full TimeUnited States, San Diego, CA10h ago
-
Sr. Director, Platform & Product Analytics USD 292K-438KA/B | A/B Testing | Adoption Metrics | Analytics frameworks | B testingBonus eligible | Dental insurance | Employee discounts | Matching 401k | Medical insuranceSenior-level Full TimeUnited States, San Mateo, CA11h ago
-
Senior System Administrator II (Storage Engineer) USD 180K-243KAWS EBS | AWS S3 | Ansible | Ceph | ClusteringMid-level Full TimeChicago; San Francisco11h ago
-
Analytics Engineer USD 84K-101KAgile | Amazon Redshift | Apache Airflow | BigQuery | DBTCollaborative inclusive work environment | Flexible work arrangements | Hybrid work model | Paid time off | Professional developmentMid-level Full TimeWaltham, MA12h ago
-
Principal Data Engineer USD 170K-200KData Contracts | Data Governance | Data Lifecycle Management | Data Lineage | Data Modeling401k | Dental insurance | Discounts | Medical insurance | Paid leaveSenior-level Full TimeNew York, NY, United States13h ago
-
Computer Scientist I USD 122K-135KC++ | Configuration Management | Integration Testing | Linux | Modeling401k match | Dental insurance | Disability insurance | Health savings account | Life insuranceMid-level Full TimeEdwards AFB, CA, United States14h ago
-
Jr Data Engineer USD 104K-125KData Pipelines | Data Transformation | Geospatial Data | JSON | Machine LearningEntry-level Full TimeFAIRFAX, VA, United States15h ago
-
Senior Databricks Migration Engineer USD 130K-158KActive Directory | Azure Active Directory | Column-Level Security | Data Governance | Data QualityOnsite work 4 days per week | Public Trust background investigation requiredSenior-level Full TimeArlington, VA, United States15h ago
-
3D Object Detection | BEV | C++ | CUDA | Computer VisionSenior-level Full TimeFoster City, CA15h ago
-
Chemical Data Scientist USD 120K-135KData Deduplication | Data Matching | Data Normalization | Data Pipelines | Data cleaningSenior-level Full TimeRemote, San Francisco, CA R15h ago
-
Chemical Data Scientist USD 120K-135KCAS Number | Classification | Data Matching | Data Normalization | Data QualityGenerous benefits | Remote workSenior-level Full TimeRemote, San Francisco, CA R15h ago
-
Data Engineer USD 85KAgile | CI/CD | Cloud | DBT | Data ModelingBackground check required | Hybrid remote option | Paid time off | Visa sponsorship availableMid-level Full TimeMoscow, Off Campus Location - Possible … R16h ago
-
Sr Applied LLM Engineer USD 144K-240KAPI Development | AWS | Anthropic | Azure | CI/CDFast-paced startup environment | In person work scheduleSenior-level Full TimeSan Francisco, United States17h ago
-
Sr. Data Engineer USD 108K-180KAWS IAM | AWS MSK | AWS S3 | Apache Kafka | CI/CD401k match | Dental insurance | Health insurance | PTO | Paid parental leaveSenior-level Full TimeRemote, US R18h ago
-
Amazon S3 | Cloud Computing | Cybersecurity | Data Quality | Data integrationSenior-level ContractRaleigh, United States18h ago
-
Vice President, AI / Machine Learning Software Engineer USD 120K-190KCI/CD | Cloud Native | Cloud Native Architecture | Data Pipelines | Distributed tracingFlexible resources and tools | Health and wellbeing programs | Paid leave | Paid volunteer timeExecutive-level Full TimeJersey City, NJ, United States18h ago
-
Mid-level Full TimeJersey City, New Jersey, United States; …19h ago
-
Applied AI Engineer II - Encore Program USD 93K-170K.NET | AI Agent | AI agent orchestration | AWS | AWS BedrockMentorship | Professional growthMid-level Full TimeJersey City, New Jersey, United States; …19h ago
-
Analytics Engineer, Employee Technology Support USD 110K-130KCause analysis | Data Governance | Data Modeling | Data Monitoring | Data Quality401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNew York19h ago
-
Controls Room AI/ML Developer - Senior Associate USD 170K-185KAPI Integration | Agent systems | Asynchronous programming | Context Management | EvaluationBackup childcare | Financial coaching | Mental health support | Onsite health and wellness centers | Retirement savings planSenior-level Full TimeJersey City, NJ, United States19h ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Cloud Computing | Data Privacy | Data exfiltration | Distributed SystemsSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA20h ago