Fabric Data Engineer — Workplace Engineering
Wayne, PA, United States
USD 119K-250K (estimate) Senior-level Full Time
Tasks
- Automate Dev Test Prod promotion using service principals and Workload Identity Federation
- Build Data Factory pipelines and Dataflows Gen2
- Build Real Time Intelligence solutions with Eventstreams Eventhouses and KQL
- Build and maintain Spark notebooks and PySpark
- Build telemetry and monitoring dashboards for refresh and pipeline failures
- Define alerts and run root cause analysis for incidents
- Design and implement scalable data storage in OneLake
- Implement CI CD with Fabric Git and Deployment Pipelines
- Implement Copy Jobs and mirroring ingestion
- Implement Fabric standards using Terraform IaC
- Implement RBAC RLS CLS OLS dynamic data masking and sharing
- Integrate Purview for sensitivity labels DLP metadata scanning and lineage
- Lead proof of concept for new Fabric capabilities
- Operate Fabric capacity monitoring and right size workloads
- Operate on call for production data pipelines
- Optimize Lakehouse tables and Direct Lake datasets
- Publish governed AI ready data products with semantic models and Prep for AI
- Serve Tier 3 escalation and provide technical consultation
- Set up cross cloud integration patterns with OneLake Direct Lake and AWS S3
- Set up environment aware bindings with Variable Libraries and parameter yml
Perks/Benefits
- N/A
Skills/Tech-stack
AI Foundry | Azure AD | Azure AI | Azure AI Foundry | Azure Data | Azure Data Factory | Azure DevOps | Azure REST API | Azure SQL | Azure Synapse | Bicep | CI/CD | CLS | Capacity Metrics App | Capacity metrics | Conditional Access | Copilot Studio | Copy Jobs | DLP | Data Factory | Data masking | Databricks | Dataflows Gen2 | Dynamic data | Dynamic data masking | Entra ID | Eventhouse | Eventstreams | GitHub | Identity Federation | KQL | Lakehouse | MIP | Microsoft Defender | Microsoft Fabric | Microsoft Purview | Microsoft Sentinel | Mirroring | Monitoring Hub | OLS | Okta | OneLake | Power BI | Prep for AI | PySpark | RBAC | REST API | RLS | Real Time | Real-time intelligence | SQL | SQL Server | Semantic models | Service principals | Structured Streaming | Terraform | Time intelligence | Warehouse | Workload Identity | Workload Identity Federation
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior Data Engineer (Remote) USD 155KAgile | Apache Spark | BigQuery | Cassandra | Data Governance401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible scheduleSenior-level Full TimeWork From Home, United States R6h ago
-
Senior AI Operations Engineer USD 170K-180KAI infrastructure | Azure | CI/CD | Cloud infrastructure | Container Engine for Kubernetes401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Flexible spending accountSenior-level Full TimeWork From Home, United States R6h ago
-
API Development | Airflow | Automated retraining | CI/CD | Cloud PlatformsEquityMid-level Full TimeNaples, United States9h ago
-
API Design | AWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud developmentSenior-level ContractGlendale, United States10h ago
-
Mid-level Full TimeUS-Kansas-Wichita10h ago
-
Senior-level Full TimeCincinnati, OH, United States10h ago
-
Acceptance Testing | Data Analysis | Data Visualization | Data reporting | ExcelOn site work authorizationSenior-level Full TimeArlington/Rosslyn, Virginia, United States10h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 119K-208K.NET | AWS | Agentic AI | Agile | AngularSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …10h ago
-
Software Engineer/Researcher, AI-Native Database Systems USD 156K-387KC++ | Database Architecture | Distributed Systems | Indexing | Information RetrievalSenior-level Full TimeSan Jose, California, United States10h ago
-
Data Pipelines | Data Storage | Distributed Systems | High Performance | High-Performance ComputingCareer growthEntry-level Full TimeSan Jose, California, United States11h ago
-
Agentic data | Apache Hive | Apache Spark | Coding Data | Data CurationSenior-level Full TimeMenlo Park, CA11h ago
-
Staff Software Engineer, Agentic AI, Trust and Safety USD 207K-301KAgentic AI | Anti-abuse | Anti-abuse systems | Architecture ownership | Artificial IntelligenceSenior-level Full TimeKirkland, WA, USA12h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KBigtable | C++ | Cloud Databases | Cloud SQL | Cloud platformTravel up to 30%Mid-level Full TimeReston, VA, USA12h ago
-
Data Engineer USD 123K-151KC++ | Cloud platform | Data Migration | Data Modeling | Data PartitioningBenefits | Hybrid scheduleMid-level Full TimeAustin, TX, USA R12h ago
-
Senior Software Engineer, Spam and Abuse, AI/ML USD 174K-253KAPI Development | Algorithms | Continuous Deployment | Continuous Training | Data ProcessingSenior-level Full TimeSan Jose, CA, USA12h ago
-
Data Engineer I - API USD 152K-220KAlteryx | Business Control Systems Integration | Business control | Clean | Control systems integration401k contribution | Dental insurance | Disability insurance | Employee referral awards | Health insuranceMid-level Full TimeClayton, NC, US15h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-408KContinuous Improvement | Deep learning | Experimentation | Feature Engineering | JavaDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeNew York, New York19h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-352KContinuous Improvement | Deep learning | Distributed Systems | Experimentation | Feature EngineeringCommuter benefits | Dental insurance | Disability benefits | Equity awards | Health insuranceSenior-level Full TimeBoston, Massachusetts19h ago
-
Lead Analytics Engineer USD 123K-175KCI/CD | DBT | Data Governance | Data Modeling | NetsuiteFull-time telecommuting | Remote work optionSenior-level Full TimePalo Alto, California19h ago
-
Sr. Software Development Engineer, MLOPs USD 168K-227KAlerting | Amazon EKS | CI/CD | Checkpointing | Data IngestionSenior-level Full TimeBellevue, Washington, USA23h ago
-
Data Platform Engineer USD 182K-240KAWS | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Kafka401k | Dental insurance | Family leave | Flexible paid time off | Free food and snacksSenior-level Full TimeOrlando, Florida, United States - Remote R23h ago
-
Senior-level Full TimeInnovation Point, United States23h ago
-
CI/CD | Data Analysis | Database | Git | PythonCareer development | Comprehensive benefits | Educational initiatives | Family benefitsMid-level Full TimeCharlotte, United States23h ago
-
Mid-level Full TimePENNANT PARK, ATLANTA - 9141, United …23h ago
-
Manager Data Engineering USD 102K-177KAWS | Airflow | Automated testing | Azure | Azure DataInclusive work environment | Remote work possibility | Travel up to 20 percentMid-level Full TimeUS014 MA Raynham - 325 Paramount …23h ago