Senior Data Engineer
Tasks
- Architect Snowflake data warehouse
- Build automated data pipelines for marketing outputs
- Build data quality checks and monitoring
- Create dashboards and reports with Tableau
- Design ETL and ELT pipelines
- Develop complex analytical SQL queries
- Enable LLM access to data with RAG
- Implement infrastructure as code with Terraform or AWS CDK
- Implement serverless ingestion with AWS Lambda
- Ingest data from SFTP and REST APIs
- Integrate machine learning for forecasting and anomaly detection
- Optimize query performance and cost
- Orchestrate pipelines with Apache Airflow
- Set up CI/CD pipelines with GitHub Actions
- Transform and normalize data to a unified model
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CDK | AWS Lambda | AWS MWAA | Amazon S3 | Anomaly Detection | Apache Airflow | CI/CD | CTE | CloudWatch | Data Governance | Data Quality | ELT | ETL | Embeddings | Forecasting | GitHub Actions | Machine Learning | Prompt engineering | Python | Query Tuning | RAG | Recursive queries | SQL | Slack | Snowflake | Snowflake Stages | Snowpipe | Tableau | Terraform | Vector Search | Window Functions
Education
N/A
Roles
Related jobs
-
Staff Software Engineer, AI Data Platform USD 250K-280KCloud platform | Google Cloud | Google Cloud Platform | GraphQL | KafkaSenior-level Full TimeSan Francisco Bay Area R8h ago
-
Sr Data Engineer USD 115K-145KAWS S3 | Apache Airflow | Azure Blob | Azure Blob Storage | BigQuery401k | Dental insurance | Discounts | Fully remote | Health insuranceSenior-level Full TimeNew York, NEW YORK, United States R11h ago
-
Senior Staff Software Engineer, Data Platform USD 253K-298KAI Agents | Agent systems | Batch Processing | Change Data Capture | Compliance401k | Quarterly in person surges | Remote-firstSenior-level Full TimeRemote - USA R12h ago
-
Senior Software Engineer, Data Systems (Python) USD 170K-200KAPI Design | API Keys | Apache Airflow | Authentication | BigQuery12 Company Paid Holidays | 401k | Company-Paid Holidays | Flexible PTO | Healthcare benefitsSenior-level Full TimeRemote - USA R13h ago
-
AI/ML Security Engineer USD 102K-163KAPI Integration | AWS | Azure | Benchmarking | EvaluationCorporate holidays | Flexible time off | Group dental insurance | Group health insurance | Pet benefit optionMid-level Full TimeRemote R13h ago
-
Senior Staff Engineer - Senior Data Engineer USD 135K-165KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | DatabricksRemote workSenior-level Full TimeRemote, REMOTE, United States R13h ago
-
Staff Engineer - AI Engineer USD 110K-130KERP | Hugging Face | Langchain | MES | ModbusRemote workSenior-level Full TimeRemote, REMOTE, United States R14h ago
-
Principal AI Engineer USD 160K-220KAI Governance | API Design | AWS | AWS Bedrock | Agent OrchestrationSenior-level Full TimeUS - Remote R14h ago
-
A/B | A/B Testing | Active Learning | Auto-labeling | B testingDental insurance | Dependent Care Account | Disability insurance | Flexible spending account | Flexible vacationMid-level Full TimeAnywhere, USA R14h ago
-
Batching | C# | C++ | CUDA | FP16Dental insurance | Disability insurance | Flexible spending account | Flexible vacation | Health insuranceMid-level Full TimeAnywhere, USA R14h ago
-
Senior AI/ML Engineer USD 160K-230KAgent systems | Agentic Systems | Data Pipelines | Docker | Driven systemsSenior-level Full TimeRemote, USA R14h ago
-
Machine Learning Engineer USD 80K-90KDeep learning | Evaluation metrics | Generalization | Language Models | Large Language ModelsSenior-level Full TimeFremont, California R14h ago
-
Machine Learning Engineer USD 80K-90KDeep learning | Evaluation metrics | Generalization | Language Models | Large Language ModelsBonus | Health insurance | Onsite work | Paid time offSenior-level Full TimeManteno, Illinois R14h ago
-
AI/ML Engineer II USD 159K-211KAPI Design | AWS | Agent Orchestration | Agent systems | AzureHealth benefits | Onsite collaboration | Paid time off | Professional developmentMid-level Full TimeRemote, USA R14h ago
-
Mid-level Full TimeHerndon, VA and/or Columbia, MD R14h ago
-
AI/ML Engineer USD 150K-211KAWS | Agent systems | Cloud platform | Data Pipelines | DockerOnsite schedule | WFH FridayEntry-level Full TimeRemote, USA R14h ago
-
Sr. Machine Learning Engineer, Applied Science USD 161K-332KComputer Vision | Diffusion Models | Fine Tuning | Generative Modeling | Human FeedbackSenior-level Full TimeSan Francisco, CA, US; Remote, US R14h ago
-
Data Engineer USD 130KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | CI/CDEmployer paid medical/dental/vision | Flexible work | Health savings account | Life insurance | Remote work policyMid-level Full TimeRosslyn, VA or Remote R15h ago
-
Senior Staff Machine Learning Engineer, Guest & Host USD 244K-305KDeep learning | Intent detection | Language Models | Language Processing | Large Language ModelsEmployee travel credits | Health benefits | Remote eligibleSenior-level Full TimeRemote - USA R15h ago
-
Senior Data Engineer II, Finance USD 183K-232KAirflow | Amazon Redshift | Apache Iceberg | Apache Spark | AuditabilityFlex First work policy | Remote workSenior-level Full TimeUnited States - Remote R15h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Computing | Containers | Fine TuningSenior-level Full TimeSeattle, Washington, USA R16h ago
-
Senior AI Engineer USD 95K-197KAWS | Autogen | Azure | CI/CD | Clean CodeAutonomy | Learning and development programs | MentorshipSenior-level Full TimeSeattle, Washington, USA R16h ago
-
ML Ops Lead USD 175K-340KAWS Glue | AWS Lambda | AWS S3 | Airflow | Amazon RedshiftPotential contract conversion to full time | Quarterly team offsites | Remote workSenior-level Full TimeRemote (US) R16h ago
-
1094- AI Platform Engineer (Generative AI) USD 158K-168KAI Agents | AWS | CI/CD | DevOps | Generative AIRemote workMid-level Full TimeUnited States of America R16h ago
-
Senior Software Engineer - Data Platform USD 186K-218KAirflow | Apache Kafka | Apache Spark | Caching | Cloud DataQuarterly in person surges | Remote-first work modelSenior-level Full TimeRemote - USA R17h ago