Data Engineer MS Fabric
Irving, Texas US, United States
USD 117K-238K (estimate) Mid-level Full Time
Tasks
- Apply medallion architecture concepts
- Build solutions with Azure Data Factory notebooks Spark PySpark SQL and Python
- Collaborate with stakeholders on requirements
- Design scalable data pipelines
- Develop data products for analytics
- Document technical designs and migration approaches
- Implement ingestion patterns full delta and CDC
- Migrate data products from Azure Synapse to Microsoft Fabric
- Perform data quality checks performance tuning monitoring
- Refactor pandas transformations to PySpark
- Support code reviews testing release and deployment
- Troubleshoot pipeline code and environment issues
- Validate migrated code and outputs
Perks/Benefits
- N/A
Skills/Tech-stack
Active Directory | Apache Spark | Azure Active Directory | Azure Data | Azure Data Factory | Azure DevOps | Azure Notebooks | Azure Security | Azure Storage | Azure Synapse | Azure Synapse Analytics | CI/CD | CSV | Data Factory | Data Modeling | Data Transformation | Data Warehousing | Delta Lake | Git | JSON | Medallion Architecture | Microsoft Fabric | Pandas | Parquet | Performance Tuning | PySpark | Python | SQL | Synapse Analytics | Terraform
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R27d ago
-
Mechanical Robotics Engineer USD 77K-130KAutomation Controls | CAD design | Cause analysis | Condition Monitoring | Current Signature AnalysisMid-level Full TimeLincolnton, NC, United States9h ago
-
Sr. Systems Engineer - AI USD 141K-209KAlerting | Artificial Intelligence | Auto Scaling | Automation | Backup and RecoverySenior-level Full TimeKansas City, KS, United States10h ago
-
Data Analytics Engineer USD 139K-230KAWS | Azure | Azure Data | Azure Data Lake | Cloud platformDEI initiatives | Dental insurance | Medical insurance | Mental health support | Remote workSenior-level Full TimeRemote, United States R10h ago
-
Data Engineer USD 126K-208KAPI Integration | APIs | AWS | Amazon Redshift | Apache AirflowDEI initiatives | Dental insurance | Employee recognition program | Medical insurance | Mental health supportMid-level Full TimeRemote, United States R10h ago
-
Senior-level Full TimePleasanton, CA, United States10h ago
-
Data Engineer (Healthcare) USD 105K-130KAWS | AWS Redshift | Apache Airflow | Azure | Azure DataKnowledge sharing | Mentoring | Quarterly travel | Remote workMid-level Full TimeUSA, Remote; USA, Remote; USA, Remote R10h ago
-
ETL | Elasticsearch | JSON | Jupyter Notebooks | Kibana401k match | Paid medical | Paid time off | Training supportSenior-level Full TimeColumbia, MD R10h ago
-
Applied AI Intern USD 70K-80KArtificial Intelligence | C++ | Data-driven | Data-driven analysis | PythonCommuting Stipend | Team mealsEntry-level InternshipMountain View, CA, US12h ago
-
Applied AI Engineer USD 140K-220KAWS SageMaker | Agentic Workflows | C++ | Fine Tuning | Foundation Models401k | Dental insurance | Health insurance | Team meals | Vision insuranceEntry-level Full TimeMountain View, CA, US / San …12h ago
-
Senior Engineer, Data Management USD 140K-150KAPI Development | AWS | Agile | Azure | Cloud platform401k | Dental insurance | Disability insurance | Employee assistance program | Life insuranceSenior-level Full TimeNew York, NY, United States13h ago
-
Lead Data Engineer USD 170K-185KAWS Athena | AWS Data | AWS Data Pipeline | AWS EMR | AWS Glue401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeMcLean, VA, United States13h ago
-
Data Engineer III USD 97K-163KApache Spark | Data Modeling | Data Quality | Data integration | DatabricksAbility to work independently | Mentorship | Professional development | Travel opportunitiesSenior-level Full TimeBaltimore, Maryland, United States14h ago
-
Senior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …14h ago
-
Senior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …14h ago
-
Algorithms | C++ | Data Mining | Data Pipelines | Data StructuresDevelopment workshops | Learning programs | Mentorship | Social eventsEntry-level InternshipSeattle, Washington, United States14h ago
-
Security Engineer, Investigator - GenAI USD 143K-208KAI detection | Agent Orchestration | Bias Mitigation | Big Data | Cyber ThreatsMid-level Full TimeMenlo Park, CA | Seattle, WA …15h ago
-
ABAQUS | ANSYS | Bearings | Bolted Joints | CADSenior-level Full TimeRedmond, WA15h ago
-
Software Engineer, AI/ML, Google Lens USD 147K-210KA/B | A/B Testing | API Design | Accessibility | B testingMid-level Full TimeMountain View, CA, USA15h ago
-
Partner Forward Deployed Engineer V, GenAI, Google Cloud USD 262K-364KAgent systems | Cloud platform | CrewAI | Evaluation Pipelines | Google CloudSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …15h ago
-
Senior Staff Software Engineer, Cloud AI, Full Stack USD 262K-364KC++ | CSS | Data Storage | Distributed Computing | GoBonus | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Agentic AI | C++ | Cloud Security | Computer Vision | Data PreparationSenior-level Full TimeSan Francisco, CA, USA15h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL16h ago
-
Staff Algorithm Engineer USD 150K-250KAWS EC2 | AWS S3 | AWS SageMaker | Active Learning | Amazon Web ServicesHigh autonomy | Mentorship and knowledge-sharing | Startup environmentSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL17h ago
-
Forward Deployment AI Engineer USD 200K-250KActive Directory | Azure Active Directory | C++ | IT Infrastructure | JavaDental insurance | Health insurance | Hybrid work | Learning and growth budget | Paid time offSenior-level Full TimeNew York, NY, US17h ago