Senior Data Engineer
Tasks
- Add observability logging monitoring and error handling
- Build distributed data pipelines
- Collaborate on data validation rules
- Design distributed data pipelines
- Develop ETL/ELT workflows
- Implement QA checks
- Implement automated testing
- Implement data schema transformations
- Implement type conversions
- Integrate structured data sources
- Integrate unstructured data sources
- Migrate data warehouses to BigQuery
- Optimize data pipelines
- Optimize pipeline performance
- Support data migrations
- Tune performance for high volume workloads
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuery | CI/CD | Cloud Composer | Cloud Dataflow | Cloud platform | Data Quality | Databricks | Dataflow | Dataform | Dataproc | ELT | ETL | Google Cloud | Google Cloud Dataflow | Google Cloud Platform | MLOps | PubSub | Python | SQL | Snowflake
Education
N/A
Roles
Related jobs
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R8h ago
-
Software Engineer, Data Platform USD 105K-132KAPI | AWS | CI/CD | Code review | DBT401k | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R11h ago
-
Senior Software Engineer, Data Platform USD 125K-156KAPI Development | AWS | Automation | CI/CD | Data Engineering401k benefits | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R11h ago
-
Finance Analytics Engineer USD 185K-221KAnomaly Detection | Apache Airflow | Business Intelligence | Data Modeling | Data MonitoringEquity compensation | Health benefitsMid-level Full TimeSan Mateo, CA, United States R12h ago
-
Data Engineer II USD 101K-153KAmazon RDS | Amazon Redshift | Apache Spark | DBT | Data GovernanceComprehensive health plans | Parental leave | Professional development stipend | Remote workMid-level Full TimeRemote - US R12h ago
-
Staff Machine Learning Engineer, AI Research USD 230K-275KComputer Vision | Feature Engineering | Fine Tuning | Hyperparameter Tuning | Kubeflow401k | Dental insurance | Equity | Fertility treatment benefit | Health insuranceSenior-level Full TimeRemote - United States R13h ago
-
Full-Stack Analytics Engineer II USD 95K-118KAirflow | BigQuery | CI/CD | DBT | Dagster401k match | Dental insurance | Educational reimbursement | Flexible schedule | Health insuranceMid-level Full TimeWashington DC R13h ago
-
A/B | A/B Testing | AWS | Adversarial Testing | Amazon SQSHybrid work | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R13h ago
-
Principal Engineer, AI Architect USD 190K-210KCloud Architecture | Conversational AI | Enterprise SaaS | GCP | Generative AI401k match | Critical illness insurance | Dedicated WeWork space | Employee assistance program | Employee stock purchase programSenior-level Full TimeRemote - Colorado R14h ago
-
Principal Engineer, AI Architect USD 190K-210KCloud Native | Conversational AI | Enterprise Architecture | GCP | Generative AI401k match | Dental insurance | Development resources | Employee assistance program | Employee stock purchase programSenior-level Full TimeRemote - Colorado R14h ago
-
Senior Machine Learning Engineer USD 180K-200KCloud Computing | Continuous integration | Fine Tuning | Generative AI | Language Models401k match | Dental insurance | Equity package | Health insurance | Hybrid workSenior-level Full TimeRemote - United States R16h ago
-
Senior Machine Learning Engineer, Roblox Assistant USD 196K-243KData Processing | Distributed data | Distributed data processing | Fine Tuning | Language ModelSenior-level Full TimeSan Mateo, CA, United States R16h ago
-
Data Engineer USD 100K-128KData Governance | Data Modeling | Data Security | Databricks | ELT401k match | Adoption Assistance | Community volunteer opportunities | Continuing education support | Dental insuranceMid-level Full TimeSouth Sioux City, NE, United States R18h ago
-
Machine Learning Engineer CAD 70K-100KAWS | Data cleaning | Django | GRPC | KubernetesBirthday off | Parental leave | Remote-first | Work anywhere up to 3 months | Work from home stipendMid-level Full TimeCanada - Remote, E. Europe - … R19h ago
-
Data Science - Pool (LATAM) USD 117K-155KAWS | Apache Airflow | Azure | Cloud platform | DatabricksCareer development plans | Company-provided equipment | English lessons | Flexible working options | Industry certifications supportSenior-level Full TimeMontevideo, Uruguay R19h ago
-
AI Foundry | AI Security | API Design | API Security | Access ManagementComprehensive medical insurance | Generous annual leave | Remote work flexibilitySenior-level Full TimeBogotá, Bogota, Colombia R19h ago
-
Data Engineer USD 148K-263KAPI | Apache Kafka | Apache Spark | Cassandra | Distributed SystemsDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceMid-level Full TimeUSA-Remote Work R19h ago
-
Benchmarking | C++ | Docker | FP16 | INT8Fully remote work | Indefinite contract | Long-term engagement | Occasional on-site visitsSenior-level Full TimeBrazil R20h ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure EventFully remote work | International projects | Long-term project stability | Professional growthSenior-level Full TimeBrazil R20h ago
-
Data Engineer - AWS/Databricks - Mid Level USD 113K-169KAWS | AWS Glue | Amazon IAM | Amazon RDS | Apache SparkMentorship | Personalized development plans | Training reimbursement | Work/life balance focusMid-level Full TimeReston, VA, United States R1d ago
-
Senior-level Full TimeRemote - United States R1d ago
-
Data Reliability Engineer/Software Engineer USD 110K-177KAmazon S3 | BigQuery | CI/CD | Cause analysis | Data Catalog401k match | Flexible spending account | Health savings account | Paid parental leave | Paid time off and holidaysMid-level Full TimeLowell, United States R1d ago
-
Senior Machine Learning Engineering (Remote) USD 108K-270KAWS | Agile | Azure | Bias detection | CI/CDConference and journal article opportunities | Mentorship culture | Remote workSenior-level Full TimeDurham, North Carolina, United States of … R1d ago
-
AI Engineer - Application Development USD 75K-158KAWS | AWS Bedrock | AWS GovCloud | Agno | Amazon BedrockFlexible time off | Learning resourcesMid-level Full Time999 REMOTE, United States R1d ago
-
Senior Data Engineer- Data Science & AI USD 165K-216KAWS Glue | AWS Lambda | AWS S3 | Airflow | Azure DataGreat place to work | Work-life balanceSenior-level Full TimeTelecommuter TN, United States R1d ago