Senior Data Engineer
Tasks
- Architect batch and streaming data pipelines
- Build authoritative datasets from Windows Census and device telemetry
- Build observability with metrics logging alerts runbooks incident response
- Debug production data issues and drive root cause to closure
- Design and enforce data contracts schemas and semantic models
- Develop curated analytical layers for Power BI dashboards
- Ensure data quality and reliability validation deduplication anomaly detection backfills reprocessing
- Ingest telemetry data from internal Windows systems
- Integrate privacy security and governance into data pipelines
- Mentor engineers and improve operational maturity
- Optimize compute storage retention and performance
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Anomaly Detection | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | By Design | C# | Data Backfill | Data Contracts | Data Deduplication | Data Governance | Data Lake Storage | Data Modeling | Data Processing | Data Quality | Data reprocessing | Databricks | Dimension modeling | Fact-Dimension Modeling | Fact/Dimension | Java | Kusto | Logging | Microsoft Fabric | Monitoring | Observability | Power BI | Privacy by Design | Python | SQL | Scala | Synapse Analytics | Telemetry Data Processing | Telemetry data
Education
Roles
Related jobs
-
Senior Full Stack AI Developer USD 145K-180KArtificial Intelligence | Cloud Computing | Continuous Delivery | Continuous integration | Language ModelsRemote workSenior-level Full TimeWork from home, VA, United States R5h ago
-
Junior Data Engineer - Intern USD 42K-60KPython | SQLContribution to AI initiatives | Exposure to real datasets | Mentorship | Professional development opportunities | Real-world experienceEntry-level Full Time InternshipFAIRFAX, VA, United States5h ago
-
Senior Embedded Software Engineer USD 142K-182KAMD Xilinx | ARM Cortex | C# | Digital Signal Processing | Embedded Linux401k match | Dental insurance | Employee assistance program | Every other Friday off | FSASenior-level Full TimeCamarillo, CA, United States5h ago
-
Senior Data Engineer USD 130K-175K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R6h ago
-
Analytics Engineer USD 89K-140KAnalytics | Azure Data | Azure Data Factory | DAX | Data Factory401k match | Dental insurance | Health insurance | Health savings account | Life insuranceMid-level Full TimeMurrysville, PA, United States6h ago
-
AWS Glue | Amazon Redshift | Amazon SageMaker | Data Modeling | Data PipelinesMid-level Full TimeHouston, TX, United States7h ago
-
Data Engineer USD 90K-125KAnomaly Detection | Azure | Data Analysis | Data Migration | Data Modeling401k | Dental insurance | Disability coverage | Employee assistance program | Flexible spending accountsMid-level Full TimeSt. Louis, MO, United States7h ago
-
Agile | Automation | Azure AD | Azure Monitor | Azure SentinelKnowledge transfer opportunities | Long-term contract | Onsite in Deerfield Beach FLSenior-level ContractDeerfield Beach, United States8h ago
-
AWS S3 | Amazon Redshift | Apache Airflow | Azure Storage | Cloud PlatformsSenior-level ContractLincoln, United States R8h ago
-
Machine Learning Engineer, Physical AI USD 150K-200KAWS | CUDA | Computer Vision | Deep learning | FastAIBi-annual offsites | Dental insurance | Flexible PTO | Health insurance | Learning and development budgetMid-level Full TimeSan Francisco, CA, US8h ago
-
Robotics Systems Engineer, Physical AI USD 150K-200KCalibration | Computer Vision | Data pipeline | Deep learning | DockerDental insurance | Flexible PTO | Health insurance | Learning and development budget | Monthly socialsMid-level Full TimeSan Francisco, CA, US8h ago
-
Head of AI USD 150K-300KAPI Integration | AWS | Artificial Intelligence | Automations | ChatGPT401k with company matching | Dental insurance | Fully remote work environment | Health insurance | Vision insuranceExecutive-level Full TimeAustin, Texas, Austin HQ, Dallas, Texas, … R8h ago
-
AWS Data Architect USD 140K-216KAPI Integration | AWS CloudFormation | AWS Glue | AWS Lake Formation | AWS LambdaOnsite daily at officeSenior-level Full TimeFremont, United States9h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Apache Airflow | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeTampa, United States9h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeFort Lauderdale, United States9h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flextime with remote and office options | Mentorship | Personalized growth roadmapsSenior-level Full TimeJacksonville, United States9h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Amazon SageMaker | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeOrlando, United States9h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeTallahassee, United States9h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsSenior-level Full TimeBaltimore, United States9h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | Data LakeEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRichmond, United States9h ago
-
Data Engineer ID50062 USD 148K-164KAWS SageMaker | Amazon Web Services | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Remote and office options | TechtalksSenior-level Full TimeMiami, United States9h ago
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeAustin, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | Big DataFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeHouston, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Apache Spark | Avro | Data LakehouseFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBlacksburg, United States10h ago
-
Data Engineer ID50062 USD 148K-164KAWS | Airflow | Avro | Data Lake | Data LakehouseFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeWest Palm Beach, United States10h ago