Senior Data Engineer
Tasks
- Build cloud-based data integration solutions
- Collaborate in agile/scrum teams
- Create automated testing for data pipelines
- Design CI CD and deployment automation
- Design batch and real-time data pipelines
- Design data architectures and dimensional models
- Develop ETL/ELT workflows
- Implement data catalog metadata lineage and governance
- Implement streaming data solutions
- Maintain technical documentation and runbooks
- Monitor pipeline performance and troubleshoot issues
- Optimize ETL processes and Spark jobs
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Airflow | Amazon Redshift | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics | BigQuery | CI/CD | Cassandra | Data Factory | Data Governance | Data Lakes | Data Modeling | Data Quality | Data Warehousing | Databricks | Dimensional Modeling | Docker | ELT | ETL | Encryption | Git | GitHub Actions | Google Cloud | Indexing | Java | Jenkins | Kafka | Kubernetes | MongoDB | MySQL | Oracle | Partitioning | PostgreSQL | Python | SQL | SQL Server | Scala | Security | Snowflake | Snowflake Schema | Star Schema | Synapse Analytics | Terraform
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R9h ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R13d ago
-
AI Engineer USD 112K-161KAWS | Anomaly Detection | Azure | C++ | Cause analysis401k matching | Educational assistance | Maternity leave | Paid Holidays | Paid sick timeMid-level Full TimePlano,Texas,United States R9h ago
-
Senior Analytics Engineer USD 87K-161KAutomation | CI/CD | DBT | Data Ingestion | Data Modeling401k | Flexible workplace options | Hybrid work options | Paid time off | Remote work optionsSenior-level Full TimeRemote-FL, United States R1d ago
-
Applied Scientist USD 120K-238KConditional Generation | Data Curation | Diffusion Models | Distributed Training | Image CaptioningEntry-level Full TimeSan Jose, United States R1d ago
-
Senior AI/ML Engineer - Hybrid in Eden Prairie, MN USD 120K-214KAPI | Agentic AI | Artificial Intelligence | Azure | CI/CD401k contribution | Career development opportunities | Comprehensive benefits | Equity stock purchase | Incentive and recognition programsSenior-level Full TimePrimary location: Eden Prairie, Minnesota R1d ago
-
Sr AI/ML Engineer - Remote Nationwide or Hybrid in MN/DC USD 120K-214KASR | Anomaly Detection | Autogen | Azure Cognitive | Azure Cognitive Search401k contribution | Comprehensive benefits package | Equity stock purchase | Flexible hybrid option | Incentive and recognition programsSenior-level Full TimePrimary location: Eden Prairie, Minnesota R1d ago
-
Assembly | Binary Analysis | C++ | Exploit analysis | False PositiveComprehensive wellness programs | Employee networks | Paid parental and adoption leaves | Paid time off | Professional development opportunitiesSenior-level Full TimeUSA VA Remote, United States R1d ago
-
Senior Machine Learning Engineer - Fully Remote! USD 160K-218KAutoml | CD | CI | CI/CD | ClassificationDiscounted Child Care | Employee assistance programs | Employee discounts | Health and wellness programs | Medical, dental, and vision benefitsSenior-level Full TimeWork From Home OR, United States R1d ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | Device security | Edge inference | Energy optimizationSenior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | DSP | Edge inference | Embedded Systems100 percent remote | Career growth potential | H1B transfer support | Long term multi year engagementSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KBenchmarking | C++ | Core ML | DSP | Device deploymentCareer growth potential | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Deep learning | Distributed Training100 percent remote work | Equal opportunity employer | Long-term career growthMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data quality monitoring | Deep learningBenefits package | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualityLong term multi year engagement | Remote work | W2 employmentMid-level Full TimeUnited States - Remote R1d ago
-
Postdoctoral Data Analytics Computational Sciences USD 79K-127KAdversarial Networks | Computer Vision | Confocal microscopy | Convolutional Neural Networks | Deep learning401k matching | Dental insurance | Health insurance | Holiday pay | Life insuranceMid-level Full TimeUS026 PA Spring House - 1400 … R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Flink | Apache Hive | Apache HudiCareer growth | Equal opportunity employer | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KApache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache OozieCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache PigCareer growth | Full-time W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Generative AI Specialist USD 100K-150KAgent architecture | Chunking | Embeddings | Evaluation Frameworks | Fine Tuning100% remote | Career growthMid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter methods | DPO | Data Generation | Dataset Distillation | Distributed TrainingRemote workMid-level Full TimeUnited States - Remote R1d ago