Fabric Data Engineer
Scottsdale, Arizona, United States
USD 142K-261K (estimate) Senior-level Full Time
Tasks
- Apply data governance with sensitivity labels
- Architect and optimize end to end data pipelines
- Build low latency streaming pipelines
- Catalog data in Microsoft Purview
- Create and maintain Power BI semantic models
- Design lakehouse and warehouse models
- Drive CI CD with Fabric deployment pipelines and Git
- Implement chunking embeddings and vector search
- Implement incremental loads and scheduling
- Implement retrieval augmented generation data support
- Maintain automated testing for data assets
- Manage role-based access control
- Mentor junior engineers through code reviews
- Migrate on premise relational databases to cloud
- Monitor SLAs for data pipelines
- Optimize T SQL Spark SQL and PySpark performance
Perks/Benefits
- 401-k match
- Dental insurance
- Employee travel rates
- Health insurance
- Travel discounts
- Unlimited PTO
- Vision insurance
Skills/Tech-stack
Access Control | Apache Spark | Automated testing | Azure Event | Azure Event Hubs | Azure IoT | Azure IoT Hub | CI/CD | Chunking | Data Factory | Data Vault | Data Warehousing | Dataflows Gen2 | Dimensional Modeling | Embeddings | Event Hubs | Fabric Data Factory | Fabric Eventstream | Git | IoT Hub | Kafka | LLM | Lakehouse | Medallion Architecture | Microsoft Fabric | Microsoft Fabric Data Factory | Microsoft Purview | OneLake | Power BI | PySpark | Python | Retrieval-Augmented Generation | Role-Based Access | Role-Based Access Control | SQL | Spark | Spark SQL | T-SQL | Vector Search
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R25d ago
-
Mid-level Full TimeUS-Kansas-Wichita1h ago
-
Gen AI Developer Specialist USD 118K-204KAI Evaluation | AWS | AWS Bedrock | Access Management | Cause analysisSenior-level Full TimeUnited States2h ago
-
Mid-level Full TimeUS-Kansas-Wichita2h ago
-
Advertising Systems | Algorithms | C# | C++ | Data StructuresEntry-level Full TimeSan Jose, California, United States2h ago
-
Machine Learning/Research Engineer Graduate (Monetization Technology-Ads Core Global) - 2027 Start (PhD) USD 113K-250KAlgorithms | C++ | Computer Vision | Counterfactual Optimization | Data StructuresEntry-level Full TimeSan Jose, California, United States2h ago
-
Active Learning | C# | C++ | CNN | CTR modelingEntry-level Full TimeSan Jose, California, United States2h ago
-
Algorithms | C plus plus | Convolutional Neural Networks | Data Structures | Deep learningEntry-level Full TimeSan Jose, California, United States2h ago
-
API Development | API Gateway | Access Control | Artificial Intelligence | Audit LoggingEntry-level Full TimeSan Jose, California, United States2h ago
-
Staff Software Engineer, Agentic AI, Trust and Safety USD 207K-300KAgentic AI | Anti-Abuse Engineering | Anti-abuse | Artificial Intelligence | CI/CDBonus | Employee support programs | Equity | Health insurance | Paid time offSenior-level Full TimeKirkland, WA, USA3h ago
-
Senior Software Engineer, AI/ML System Infrastructure USD 174K-252KArtificial Intelligence | C# | C++ | CI/CD | Cloud infrastructureSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA3h ago
-
Software Engineer, Gemini Eval Infra, DeepMind USD 207K-300KAutomated testing | Data Structures | Data Structures and Algorithms | Distributed Systems | GCUSenior-level Full TimeSan Diego, CA, USA3h ago
-
Alooma | Batch Processing | Big Data | C plus plus | Cloud platformSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …3h ago
-
Senior Software Engineer, Embedded Systems/Firmware, XR USD 174K-252KC# | C++ | Code review | Embedded Development | Embedded operating systemsSenior-level Full TimeSan Jose, CA, USA; Miami, FL, …3h ago
-
C# | C++ | Cryptography | Distributed Systems | GoSenior-level Full TimeSunnyvale, CA, USA3h ago
-
C# | C++ | Compute Technologies | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeNew York, NY, USA; Madison, WI, …3h ago
-
Artificial Intelligence | Fine Tuning | GPU | Google Kubernetes | Google Kubernetes EngineSenior-level Full TimeSunnyvale, CA, USA; Cambridge, MA, USA3h ago
-
As-a-Service | C++ | Cloud platform | Data Structures | Data Structures and AlgorithmsBonus | Equity compensation | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Senior Staff Software Engineer, Search Ads, AdsML, LLM USD 262K-364KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA; Pittsburgh, PA, …3h ago
-
Software Engineer III, Google Security Operations, AI/ML USD 147K-210KAlgorithms | Angular | C# | Cloud infrastructure | Computer VisionSenior-level Full TimeReston, VA, USA3h ago
-
Senior Platform Engineer - Data Infrastructure EUR 65K-80KAWS | Amazon Aurora | Amazon EKS | Amazon ElastiCache | Amazon MSKChildcare compensation | Company events | English classes reimbursement | Flexible hours | Gym subscriptionSenior-level Full TimeMadrid, MD, Spain6h ago
-
Data Engineer II USD 116K-163KAgile | Alteryx | Azure Data | Azure Data Factory | Business IntelligenceSenior-level Full TimeSaint Louis, MO, US, 631017h ago
-
Senior Robotics Software Engineer USD 162K-221K3D Geometry | APIs | C++ | CI/CD | Collision Checking401k matching | Dental insurance | Equity | Free Lunches | Free parkingSenior-level Full TimeBerkeley, California9h ago
-
PIM - Sr Databricks & Reporting Analyst USD 123K-178KAI | Apache Spark | Artificial Intelligence | Azure Data | Azure Data FactoryRelocation assistance | TeleworkSenior-level Full TimeReston, VA, US9h ago
-
AI Engineer, Senior - Enterprise Value Creation (NJUS) USD 131K-190KAWS | Azure | CI/CD | Data Engineering | Distributed Computing401k match | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountSenior-level Full TimeColumbus, OH, US9h ago