Senior Data Engineer
Tasks
- Architect Snowflake data warehouse
- Build automated data pipelines for marketing outputs
- Build data quality checks and monitoring
- Create dashboards and reports with Tableau
- Design ETL and ELT pipelines
- Develop complex analytical SQL queries
- Enable LLM access to data with RAG
- Implement infrastructure as code with Terraform or AWS CDK
- Implement serverless ingestion with AWS Lambda
- Ingest data from SFTP and REST APIs
- Integrate machine learning for forecasting and anomaly detection
- Optimize query performance and cost
- Orchestrate pipelines with Apache Airflow
- Set up CI/CD pipelines with GitHub Actions
- Transform and normalize data to a unified model
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CDK | AWS Lambda | AWS MWAA | Amazon S3 | Anomaly Detection | Apache Airflow | CI/CD | CTE | CloudWatch | Data Governance | Data Quality | ELT | ETL | Embeddings | Forecasting | GitHub Actions | Machine Learning | Prompt engineering | Python | Query Tuning | RAG | Recursive queries | SQL | Slack | Snowflake | Snowflake Stages | Snowpipe | Tableau | Terraform | Vector Search | Window Functions
Education
N/A
Roles
Related jobs
-
Staff Software Engineer, AI Data Platform USD 250K-280KCloud platform | Google Cloud | Google Cloud Platform | GraphQL | KafkaSenior-level Full TimeSan Francisco Bay Area R6h ago
-
Sr Data Engineer USD 115K-145KAWS S3 | Apache Airflow | Azure Blob | Azure Blob Storage | BigQuery401k | Dental insurance | Discounts | Fully remote | Health insuranceSenior-level Full TimeNew York, NEW YORK, United States R10h ago
-
Senior Staff Engineer - Senior Data Engineer USD 135K-165KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | DatabricksRemote workSenior-level Full TimeRemote, REMOTE, United States R12h ago
-
Staff Engineer - AI Engineer USD 110K-130KERP | Hugging Face | Langchain | MES | ModbusRemote workSenior-level Full TimeRemote, REMOTE, United States R12h ago
-
Principal AI Engineer USD 160K-220KAI Governance | API Design | AWS | AWS Bedrock | Agent OrchestrationSenior-level Full TimeUS - Remote R12h ago
-
A/B | A/B Testing | Active Learning | Auto-labeling | B testingDental insurance | Dependent Care Account | Disability insurance | Flexible spending account | Flexible vacationMid-level Full TimeAnywhere, USA R12h ago
-
Batching | C# | C++ | CUDA | FP16Dental insurance | Disability insurance | Flexible spending account | Flexible vacation | Health insuranceMid-level Full TimeAnywhere, USA R12h ago
-
Senior AI/ML Engineer USD 160K-230KAgent systems | Agentic Systems | Data Pipelines | Docker | Driven systemsSenior-level Full TimeRemote, USA R12h ago
-
Machine Learning Engineer USD 80K-90KDeep learning | Evaluation metrics | Generalization | Language Models | Large Language ModelsSenior-level Full TimeFremont, California R12h ago
-
Machine Learning Engineer USD 80K-90KDeep learning | Evaluation metrics | Generalization | Language Models | Large Language ModelsBonus | Health insurance | Onsite work | Paid time offSenior-level Full TimeManteno, Illinois R12h ago
-
AI/ML Engineer II USD 159K-211KAPI Design | AWS | Agent Orchestration | Agent systems | AzureHealth benefits | Onsite collaboration | Paid time off | Professional developmentMid-level Full TimeRemote, USA R12h ago
-
AI/ML Engineer USD 150K-211KAWS | Agent systems | Cloud platform | Data Pipelines | DockerOnsite schedule | WFH FridayEntry-level Full TimeRemote, USA R12h ago
-
Data Engineer USD 130KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | CI/CDEmployer paid medical/dental/vision | Flexible work | Health savings account | Life insurance | Remote work policyMid-level Full TimeRosslyn, VA or Remote R13h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Computing | Containers | Fine TuningSenior-level Full TimeSeattle, Washington, USA R14h ago
-
Senior AI Engineer USD 95K-197KAWS | Autogen | Azure | CI/CD | Clean CodeAutonomy | Learning and development programs | MentorshipSenior-level Full TimeSeattle, Washington, USA R14h ago
-
ML Ops Lead USD 175K-340KAWS Glue | AWS Lambda | AWS S3 | Airflow | Amazon RedshiftPotential contract conversion to full time | Quarterly team offsites | Remote workSenior-level Full TimeRemote (US) R14h ago
-
1094- AI Platform Engineer (Generative AI) USD 158K-168KAI Agents | AWS | CI/CD | DevOps | Generative AIRemote workMid-level Full TimeUnited States of America R15h ago
-
Senior AI/ML Engineer USD 172K-238KAWS | Apache Airflow | Apache Kafka | Deep learning | Language Processing401k match | Commuter benefit | Health benefits | In-office/hybrid work | Paid parental leaveSenior-level Full TimeChicago, IL, USA; New York, NY, … R17h ago
-
Lead AI Solutions Delivery Engineer USD 158K-232KAutonomous Agents | C++ | Claude | Cloud | ComplianceCompassionate care leave | Health benefits | Learning and development | Paid parental leave | Paid time offSenior-level Full TimeRemote, WA, United States R1d ago
-
Azure Data Engineer USD 118K-163K3NF | API Management | Agile | Azure Data | Azure Data Factory401k match | Employee resource group network | Holiday pay | Paid time off | Remote workSenior-level Full TimeUnited States R1d ago
-
Senior Systems Engineer, Storage - DGX Cloud USD 208K-414KAlerting | Algorithms | Ansible | Argo CD | CI/CDSenior-level Full TimeUS, CA, Remote, United States R1d ago
-
Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Data Factory401k match | Disability insurance | Education benefit | Employee stock purchase plan | Life insuranceSenior-level Full TimePrudential Tower, 655 Broad Street, Newark, … R1d ago
-
Machine Learning Engineer USD 125K-234KA/B | A/B Testing | Apache Spark | B testing | Causal InferenceMid-level Full TimeSan Jose, United States R1d ago
-
Prompt Engineering Architect USD 100K-150KAgent architecture | Chunking | Embeddings | Evaluation | Fine Tuning100 percent remote | Career growth | MentorshipSenior-level Full TimeUnited States - Remote R1d ago
-
Prompt Engineering Architect USD 100K-150KAgent Frameworks | Agent systems | Chunking | Embeddings | EvaluationSenior-level Full TimeUnited States - Remote R1d ago