Sr. Data Engineer - Full Stack
Tasks
- Apply DataOps practices
- Apply DevOps practices
- Build and optimize dbt transformations
- Champion data platform roadmap
- Collaborate with data scientists and stakeholders
- Define data pipeline architecture
- Design build and optimize data ingestion
- Develop and maintain workflow orchestration
- Drive delivery of data products
- Ensure data security and privacy
- Implement data anonymization and compliance
- Implement real-time streaming pipelines
- Integrate monitoring and observability with Splunk
- Manage Iceberg table formats
- Mentor engineers and conduct code reviews
- Optimize query performance and cost in Athena
- Optimize query performance and cost in Redshift
- Optimize query performance and cost in Snowflake
- Optimize schema evolution with Iceberg
- Troubleshoot production pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | Amazon Athena | Amazon Kinesis | Amazon Redshift | Amazon S3 | Confluent | DBT Core | Dagster | Data Modeling | Data Security | Data Vault | Data Vault Modeling | Data anonymization | DataOps | DevOps | Dimensional Modeling | ELT | ETL | Git | IAM | Iceberg | Metadata Management | PySpark | Python | SQL | Snowflake | Splunk | Streaming | Talend | VPC | Vault modeling
Education
N/A
Related jobs
-
AWS | Agentic AI | Angular | CI/CD | DatabricksHybrid work | Technical mentorshipSenior-level Full TimeNormal, United States5h ago
-
Sr. Data Engineer USD 108K-158KAWS | Apache Spark | Automated testing | Azure Event | Azure Event Hubs401k matching | Dental insurance | Disability insurance | Educational growth | Employee discount programSenior-level Full TimeNew York-TONAWANDA5h ago
-
Artificial Intelligence | Data Modeling | Data Pipelines | Data Quality | Data Visualization401k match | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeNew York5h ago
-
AWS | AWS SDK | Amazon MSK | Apache Kafka | Generative AISenior-level Full TimeNew York, New York, United States6h ago
-
Production Engineer USD 178K-200KApache | Apache Spark | Application Programming | Application Programming Interfaces | C++Entry-level Full TimeMenlo Park, CA7h ago
-
Research Engineer - MSL FAIR Foundations USD 117K-173KBenchmarking | Code review | Data Pipelines | Distributed Systems | Language ModelEntry-level Full TimeMenlo Park, CA7h ago
-
Staff Software Engineer, Agentic Data and Evals USD 207K-300KC++ | CSS | Cloud | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Senior Data Engineer USD 155K-180KAWS | Agile | Alerting | Azure | Bash401k savings plan | Dental insurance | Employee assistance plan | Group medical insurance | Gym reimbursementSenior-level Full TimeBoston, United States8h ago
-
Data Engineer USD 118K-125KAWS | Agile | Apache Spark | Azure | Bash401k savings plan with profit sharing | Commuter parking tax savings | Employee assistance program | Group medical insurance | Gym reimbursementSenior-level Full TimeBoston, United States8h ago
-
Software Engineer, Applied AI USD 130K-500KData Pipelines | Data Quality | Evaluation Frameworks | Experimental Design | GoDental insurance | Equity grant | Free Equinox Membership | Health insurance | Housing bonusMid-level Full TimeSan Francisco12h ago
-
Staff Machine Learning Engineer USD 188K-221KAWS | Amazon Redshift | Amazon SageMaker | Apache Airflow | Apache FlinkGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R14h ago
-
Staff Software Engineer, Data & AI USD 183K-214KAWS | Airflow | Analytics | Artificial Intelligence | BI AnalyticsSenior-level Full TimeCA - San Francisco; WA - …15h ago
-
ASR | Automatic Speech Recognition | CTC | Data Augmentation | Knowledge Distillation401k matching | Annual offsites | Dental insurance | Free snacks and drinks | Health insuranceSenior-level Full TimeSan Francisco, CA16h ago
-
Application Software Engineer, Data USD 150K-225KAngular | C# | CI/CD | Continuous integration | DeploymentSenior-level Full TimeStarbase, TX17h ago
-
Deployed Engineer (Denver) USD 150K-250KAI Agent | AI agent deployment | AWS | Agent deployment | Agent-based401-k plan | Dental coverage | Flexible vacation | Meals on in office days | Medical coverageSenior-level Full TimeDenver, CO18h ago
-
Deployed Engineer (Las Vegas) USD 150K-250KAWS | Azure | Docker | Failure handling | GCP401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceSenior-level Full TimeLas Vegas, NV18h ago
-
Deployed Engineer (Phoenix) USD 150K-250KAWS | Agent Frameworks | Azure | Cloud Computing | Containers401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceSenior-level Full TimePhoenix, AZ18h ago
-
Full Stack AI Developer USD 146K-222KAgile | Angular | Auto-tagging | CI/CD | Chunking401k | Education reimbursement program | Flexible schedule | Hybrid schedule | MentorshipSenior-level Full TimeLivermore, CA, United States R18h ago
-
Senior Data Engineer USD 239K-271KAirflow | Alerting | Amazon Redshift | Automated testing | Cost OptimizationFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R18h ago
-
AI Security | API Security | Adversarial Machine Learning | Data exfiltration | Evasion TechniquesLife insurance | Mental health support | Private medical coverageMid-level Full TimePortland, Oregon, United States18h ago
-
Mid-level Full TimeUnited States - Remote R18h ago
-
Adversarial Machine Learning | Data leakage | Fine Tuning | ISO 27001 | ISO 27017Life insurance | Mental Health Expenses | Private medical coverageExecutive-level Full TimePortland, Oregon, United States18h ago
-
AI/ML Subject Matter Expert (SME) / Analytics Team Lead USD 128K-206KData Visualization | Feature Engineering | Language Processing | Machine Learning | Model Evaluation100 percent on site | Active secret clearance requiredSenior-level Full TimeArlington, VA18h ago
-
Data Engineer USD 124K-149KAutomation | Data Analysis | Data Modeling | Data Security | Data Validation401k match | Paid time offSenior-level Full TimeUSA DC Washington - 330 C …18h ago
-
AI Developer USD 128K-173KAI Automation | Artificial Intelligence | Databricks | Generative AI | Language Models401k matching | Dental insurance | Flexible work hours | Health insurance options | Paid time offSenior-level Full TimeUSA DC Washington - 475 L'Enfant …18h ago