Fabric Data Engineer
Scottsdale, Arizona, United States
USD 142K-261K (estimate) Senior-level Full Time
Tasks
- Apply data governance with sensitivity labels
- Architect and optimize end to end data pipelines
- Build low latency streaming pipelines
- Catalog data in Microsoft Purview
- Create and maintain Power BI semantic models
- Design lakehouse and warehouse models
- Drive CI CD with Fabric deployment pipelines and Git
- Implement chunking embeddings and vector search
- Implement incremental loads and scheduling
- Implement retrieval augmented generation data support
- Maintain automated testing for data assets
- Manage role-based access control
- Mentor junior engineers through code reviews
- Migrate on premise relational databases to cloud
- Monitor SLAs for data pipelines
- Optimize T SQL Spark SQL and PySpark performance
Perks/Benefits
- 401-k match
- Dental insurance
- Employee travel rates
- Health insurance
- Travel discounts
- Unlimited PTO
- Vision insurance
Skills/Tech-stack
Access Control | Apache Spark | Automated testing | Azure Event | Azure Event Hubs | Azure IoT | Azure IoT Hub | CI/CD | Chunking | Data Factory | Data Vault | Data Warehousing | Dataflows Gen2 | Dimensional Modeling | Embeddings | Event Hubs | Fabric Data Factory | Fabric Eventstream | Git | IoT Hub | Kafka | LLM | Lakehouse | Medallion Architecture | Microsoft Fabric | Microsoft Fabric Data Factory | Microsoft Purview | OneLake | Power BI | PySpark | Python | Retrieval-Augmented Generation | Role-Based Access | Role-Based Access Control | SQL | Spark | Spark SQL | T-SQL | Vector Search
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R25d ago
-
API Development | API Gateway | Access Control | Artificial Intelligence | Audit LoggingEntry-level Full TimeSan Jose, California, United States1h ago
-
Senior Software Engineer, Embedded Systems/Firmware, XR USD 174K-252KC# | C++ | Code review | Embedded Development | Embedded operating systemsSenior-level Full TimeSan Jose, CA, USA; Miami, FL, …2h ago
-
C# | C++ | Cryptography | Distributed Systems | GoSenior-level Full TimeSunnyvale, CA, USA2h ago
-
C# | C++ | Compute Technologies | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeNew York, NY, USA; Madison, WI, …2h ago
-
Senior Staff Software Engineer, Search Ads, AdsML, LLM USD 262K-364KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA; Pittsburgh, PA, …2h ago
-
Data Engineer II USD 116K-163KAgile | Alteryx | Azure Data | Azure Data Factory | Business IntelligenceSenior-level Full TimeSaint Louis, MO, US, 631016h ago
-
Senior Robotics Software Engineer USD 162K-221K3D Geometry | APIs | C++ | CI/CD | Collision Checking401k matching | Dental insurance | Equity | Free Lunches | Free parkingSenior-level Full TimeBerkeley, California8h ago
-
PIM - Sr Databricks & Reporting Analyst USD 123K-178KAI | Apache Spark | Artificial Intelligence | Azure Data | Azure Data FactoryRelocation assistance | TeleworkSenior-level Full TimeReston, VA, US8h ago
-
AI Engineer, Senior - Enterprise Value Creation (NJUS) USD 131K-190KAWS | Azure | CI/CD | Data Engineering | Distributed Computing401k match | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountSenior-level Full TimeColumbus, OH, US8h ago
-
Software Engineer II, Data Platform USD 150K-225KAWS | Amazon Kinesis | Amazon SQS | Apache Flink | Apache Spark401k matching | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, Los Angeles, CA9h ago
-
Software Engineer II, Data Platform USD 150K-225KAWS | Apache Flink | Apache Spark | CI/CD | ELT401k matching | Employee discounts | Medical/Dental/Vision | On site hybrid work option | Paid time offMid-level Full TimeUnited States, Aliso Viejo, CA9h ago
-
Software Engineer, Monetization Data Platform USD 293K-385KAPI Design | Access Control | Auditability | C++ | Capacity PlanningMid-level Full TimeMountain View11h ago
-
Quality Analytics Site Lead USD 165K-218KAutomated Monitoring | Cause analysis | Dashboards | Data Modeling | Data QualityHealth insurance | On-site work | Travel up to 25 percentSenior-level Full TimeAshville, Ohio, United States11h ago
-
Software Engineer: Data Platform/Analytics Intern Opportunities for University Students, Redmond USD 68K-134KC# | Cloud Data | Cloud Data Platforms | Data Engineering | Data QualityEntry-level InternshipUnited States, Washington, Redmond12h ago
-
APIs | Algorithms | Cloud services | Data Structures | Distributed ComputingEntry-level InternshipUnited States, Washington, Redmond12h ago
-
Senior Analytics Engineer, Product USD 155K-233KAmplitude | CI/CD | DBT | Data Governance | Data ModelingSenior-level Full TimeSan Francisco13h ago
-
Data Scientist USD 250K-350KData Enrichment | Data Pipelines | Data leakage | Data leakage detection | Entity ScoringCareer acceleration | Direct exposure to founders and executives | High autonomy | Work onsite in New York CityMid-level Full TimeNew York, New York, United States13h ago
-
Senior ML Engineer USD 300K-375KAPI | Background Jobs | Backtesting | Calibration | Cost OptimizationCareer growth opportunities | High autonomy | High-trust environment | Networking opportunities | Startup environmentSenior-level Full TimeNew York, New York, United States13h ago
-
Senior-level Full TimeCupertino14h ago
-
Machine Learning Engineer, Platform USD 170K-220KAgentic Systems | Continuous Improvement | Deep learning | Distribution Shift | Fine TuningMid-level Full TimeSan Francisco Bay Area14h ago
-
Computer Vision Engineer USD 141K-184KCI/CD | CUDA | Computer Vision | Deep learning | Edge AIEquity | Health coverage | Paid time off | Retirement or Pension ContributionsSenior-level Full TimeSan Francisco, California15h ago
-
Applied AI Architect, National Security USD 240K-270KCloud Architecture | Enterprise Integration | LLM | Machine Learning | PythonSenior-level Full TimeWashington, DC15h ago
-
Senior Computer Vision Engineer USD 195K-255K3D Computer Vision | ARM64 | C++ | CUDA | Camera CalibrationEquity | Health coverage | Paid time off | Retirement or Pension ContributionsSenior-level Full TimeSan Francisco, California15h ago
-
Machine Learning Engineer, Assistant Quality USD 180K-205KAgent Orchestration | C++ | Evaluation | Experimentation | Go401k plan | Dental | Education stipend | Healthy lunches | Home office stipendMid-level Full TimeSan Francisco, CA16h ago