Senior Data Engineer
USD 110K-125K Senior-level Full Time
Tasks
- Build reusable Python ingestion and loading frameworks
- Design batch and streaming data pipelines
- Develop AI facing data interfaces and semantic search indexes
- Document and share technical knowledge
- Embed authentication secrets and access control
- Implement Git branching and pull requests
- Implement data quality validation and pipeline observability
- Integrate enterprise and factory data sources into lakehouses
- Maintain dimensional data models star schemas
- Monitor troubleshoot and optimize data pipeline reliability performance and cost
- Set up CI CD pipelines with automated testing
- Translate stakeholder requirements into analytics ready solutions
Perks/Benefits
- 401k match
- Employee assistance program
- Paid parental leave
- Paid time off
- Student loan repayment
- Tuition reimbursement
- Wellness reimbursement
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Explorer | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Event | Azure Event Hubs | Azure Functions | Azure Key Vault | Azure SQL | Azure SQL Database | CI/CD | Data Explorer | Data Factory | Data Lake Storage | Data Warehousing | Databricks | Delta Lake | Dimensional Modeling | Entra ID | Event Hubs | Git | KQL | Key Vault | Kimball Method | Medallion Architecture | Microsoft Entra | Microsoft Entra ID | PySpark | Python | Retrieval-Augmented Generation | SQL | SQL Database | Semantic Search | Star Schema
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Associate Cloud Data Engineer II USD 78K-97KAgile | Airflow | Apache Beam | BigQuery | Cloud ComposerOnsite workMid-level Full TimeAda, MI, United States, 493552h ago
-
Staff Software Engineer USD 114K-178KAI Safety | AWS | AWS Bedrock | Agentic Systems | AirflowHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-23552h ago
-
Senior Cell Modeling & Analytics Engineer USD 140K-175K3D Modeling | Circuit modeling | D Q D V | Data Analysis | Data Visualization401k plan | Equity opportunities | Flexible time off | Medical, dental, and vision coverageSenior-level Full TimeBroomfield, Colorado or Burlingame, California7h ago
-
Forward Deployed AI Engineer (GenAI, AWS) USD 175K-200KAWS | AWS CDK | AWS Neptune | Amazon ECS | Amazon SageMakerRemote-friendly cultureSenior-level Full TimeNew Jersey9h ago
-
Staff Data Engineer USD 200K-260KApache Airflow | Apache Beam | Apache Spark | BigQuery | DBT401k plan | Dental insurance | Disability insurance | Equity | Flexible time offSenior-level Full TimeSunnyvale, CA9h ago
-
[C] Data Engineer, Safeguards USD 380K-485KAccess Control | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache SparkFlexible work schedule | Flexible working hours | Generous vacation | Parental leaveSenior-level Full TimeSan Francisco, CA | New York …10h ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R10h ago
-
Robotics Engineer USD 170K-221KC++ | Camera Object Detection | Computer Vision | Gazebo | Isaac Sim401k matching | Background check clearance | Dental insurance | Drug Test Clearance | Life insuranceEntry-level Contract Full TimeSunnyvale, California11h ago
-
Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricSenior-level Full TimeUS-FL-Remote R11h ago
-
Software Engineer, ML Data USD 180K-230KAWS | Apache Hive | Apache Spark | ClickHouse | GolangDental insurance | Equity | Health insurance | Hybrid work | Team gatherings once per quarterSenior-level Full TimeSan Francisco Bay Area11h ago
-
Senior-level Full TimeSan Francisco, California, United States11h ago
-
Senior-level Full TimeNew York, New York, United States11h ago
-
Solution Engineer USD 138K-181KAI machine learning | Analytics | Cloud Computing | Data Warehouse | ETLSenior-level Full TimeUS-CO-Denver12h ago
-
Solution Engineer USD 138K-181KData Warehousing | Generative AI | Language Models | Language Processing | Large Language ModelsMid-level Full TimeFins Only-US-CA-San Mateo12h ago
-
AI Software Engineer USD 127K-175KAPI Development | Agent Orchestration | Agent runtimes | Agent systems | C++Dental insurance | Employee assistance program | Flexible Paid Vacation | Flexible paid sick leave | Flexible spending accountEntry-level Full TimeSan Francisco, CA12h ago
-
Senior Data Engineer USD 126K-180KAmazon Kinesis | Apache Airflow | Apache Beam | Apache Flink | Apache Spark401k match | Bonus | Equity grant | Flexible time off | Health plansSenior-level Full TimeNew York, New York; Miami, Florida; … R12h ago
-
Lead Algorithm & Signal Processing Engineer USD 157K-220KAdaptive Signal Processing | Bayesian Methods | C plus plus | Deep learning | Electronic WarfareTop Secret clearanceSenior-level Full TimeDayton, OH12h ago
-
Lead Algorithm & Signal Processing Engineer USD 157K-220KAdaptive Signal Processing | C++ | Deep learning | Electronic Warfare | Graph Neural NetworksSenior-level Full TimeWoburn, MA12h ago
-
Senior Applied Scientist USD 170K-286KApache Spark | C++ | Computer Vision | Data Processing | Edge inferenceComprehensive health insurance | Parental leave | Professional development stipend | Remote work | Travel up to 5 percentSenior-level Full TimeRemote - US R12h ago
-
Cleared AI/ML Engineer USD 114K-159KAWS | Airflow | Azure | Cloud platform | Continuous integrationSenior-level Full TimeChantilly, VA13h ago
-
Applied AI Inference Engineer USD 250K-300KC++ | CUDA | Docker | GPU | Kubernetes401k match | Cell phone stipend | Commuter benefits | Daily meals allowance | Emergency assistanceSenior-level Full TimeSan Francisco, CA - US13h ago
-
AI Ops Engineer USD 122K-191KAgent Development Kit | Agile | CI/CD | Cloud platform | DockerCareer coaching | Employee assistance programme | Flexible working hours | Global career opportunities | Hybrid workEntry-level Full TimeColorado, United States13h ago
-
Lead Consultant Data Engineer (DHS) USD 138K-185KAWS | AWS Glue | Agile | Amazon EMR | Amazon RedshiftBonus eligible | Care Com Membership | Child and elder care days | Dental insurance | Employer contributed health savings accountSenior-level Full TimeArlington, Virginia, United States14h ago
-
AI Integrations Staff Engineer USD 150K-230KAI Models | Agent Harness | Agent SDK | Back-end | Back-end development401k contribution | Company retreats | Dental insurance | Employee referral program | EquitySenior-level Full TimeRemote R14h ago