Data Engineer / Azure Fabric Engineer Consultant
Tasks
- Build analytics ready data models
- Build reusable data enrichment patterns
- Conduct workshops and communicate architecture tradeoffs
- Design AI enabled analytics products
- Design agentic retrieval augmented generation workflows
- Design analytical data store
- Design data lakehouse architecture
- Design data warehouse architecture
- Enable SQL and Spark workloads
- Establish data lineage and access controls
- Implement data ingestion pipelines
- Implement data quality validation and testing
- Implement data transformation pipelines
- Implement logging and metrics
- Implement pipeline orchestration
- Implement security and governance controls
- Integrate data from APIs and third party sources
- Lead client discovery
- Monitor pipelines and troubleshoot failures
- Optimize query and pipeline performance
- Produce consulting deliverables and design documentation
Perks/Benefits
- N/A
Skills/Tech-stack
AI Search | Access Control | Automated Monitoring | Azure AI | Azure AI Search | Azure OpenAI | CI/CD | Cause analysis | Data Factory | Data Lineage | Data Modeling | Data Protection | Data Quality | Data Reconciliation | Data Warehouse | Databricks | Dimensional Modeling | Error Handling | Incident Management | Infrastructure as Code | KQL | Key Vault | Lakehouse | Least Privilege | Microsoft Fabric | Model Evaluation | Observability | OneLake | Orchestration | Power Apps | Power BI | Prompt engineering | PySpark | Root Cause Analysis | Root cause | SQL | SQL Database | Scheduling | Semantic Modeling | Spark | Spark SQL | Synapse Analytics | “as-code”
Education
N/A
Related jobs
-
Senior Software Engineer, Generative AI, Ads Safety USD 174K-252KAI Agents | Algorithms | C++ | Computer Vision | Context learningSenior-level Full TimeMountain View, CA, USA2h ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Artificial Intelligence | Cloud Architecture | Cloud Computing | Data PrivacySenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA2h ago
-
Senior Software Engineer, Google.org, Data Analytics USD 174K-252KArtificial Intelligence | Data Structures | Data Structures and Algorithms | Distributed Systems | Integration TestingSenior-level Full TimeSeattle, WA, USA2h ago
-
C++ | Compute Optimization | Deep learning | GPU | JAXSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA2h ago
-
Software Engineer, ML Fleet Intelligence USD 207K-300KAnomaly Detection | Artificial Intelligence | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Forward Deployed Engineer II, Applied AI, Cloud USD 127K-183KAPIs | Agent systems | Agentic Workflows | Conversational AI | DebuggingTravel 50% timeSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …2h ago
-
Data Engineer, Geo 3P and Developer Data Operations USD 106K-151KArtificial Intelligence | BigQuery | C++ | Cloud Dataflow | Data MiningEntry-level Full TimeMountain View, CA, USA2h ago
-
Senior Data Engineer USD 150K-220KAmazon Redshift | Apache Hudi | Apache Iceberg | Apache Pinot | Autovacuum401k match | Dental insurance | Hardware provided | Health insurance | Unlimited PTOSenior-level Full TimeNew York8h ago
-
Staff Engineer, Datacenter Server Lifecycle USD 320K-405KAWS | Asset tracking | Coreboot | Decommissioning | Firmware verificationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York …8h ago
-
Mid-level Full TimeTysons, VA, United States9h ago
-
Mid-level Full TimeRemote, United States R9h ago
-
Senior AI Infrastructure Engineer - Training Platform USD 216K-270KAWS | Admission controllers | C++ | CUDA | Custom ResourcesCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …10h ago
-
Data Analyst, Payments Performance USD 124K-187KCode review | Data Visualization | Data analytics | Git | Python401k plan | Company bonus | Equity | Medical, dental, vision benefits | Wellness stipendsSenior-level Full TimeSeattle, WA10h ago
-
Analytics Engineer USD 124K-187KCode review | Data Visualization | Git | Python | SQL401k plan | Company bonus | Dental benefits | Equity | Medical benefitsSenior-level Full TimeSeattle, WA10h ago
-
Principal Engineer, Data & ML Platform USD 120K-180KAPIs | Automated testing | Batch Processing | Cloud platform | Data ModelingSenior-level Full TimeScottsdale, AZ13h ago
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R13h ago
-
Data Science and AI Intern USD 50K-50KAWS | Cloud Computing | DBT | Data Visualization | ETLFree daily on site lunches | Free on site EV charging | Latest hardware | On-site gym | Open & transparent cultureEntry-level InternshipMenlo Park, CA14h ago
-
Machine Learning Engineer, Growth USD 0K-0KFeature Engineering | Machine Learning | Model Deployment | Model Evaluation | Model TrainingCell phone allowance | Childcare allowance | Company holidays | Dogfood budget | Family planning benefitMid-level Full TimeSan Francisco, CA14h ago
-
Software Engineer USD 153K-237KAPI | API Gateway | API Management | AWS | Apache Airflow401k employer match | Employer Disability Insurance | Employer health insurance | Employer life insurance | Paid HolidaysSenior-level Full TimeChantilly, VA14h ago
-
Machine Learning Engineer, PhD Intern USD 123K-161KAWS | Azure | Code review | Data Analysis | ExperimentationIn office work 5 days per week | Mentorship | Structured intern programming | Team eventsEntry-level InternshipSan Francisco, CA15h ago
-
AMD Public-Dallas-Associate-Software Engineering USD 123K-188KAWS | AWS Glue | Amazon EMR | Amazon Redshift | Amazon S3Senior-level Full TimeDallas, Texas, United States15h ago
-
Senior ML/AI Engineer USD 130K-160KAgent Frameworks | Artificial Intelligence | Evaluation | Fine Tuning | Inference401k match | Company housing | Company technology package | Dental insurance | Flexible vacationSenior-level Full TimeSan Francisco16h ago
-
Staff, Data Scientist USD 90K-180KBigQuery | Data Wrangling | DeepAR | Hive | Keras401k | Company discounts | Health insurance | Paid time off | Parental leaveSenior-level Full TimeBentonville, AR, United States16h ago
-
Data Engineer II USD 150K-180KAWS | Apache Airflow | Apache Kafka | Apache Spark | Argo Workflows401k match | CLEAR Plus membership | Catered lunches | Family building benefits | Flexible time offMid-level Full TimeNew York, NY, United States16h ago
-
Dynamics Data Engineer Senior USD 119K-258K.NET | Azure | Azure Functions | Azure Logic | Azure Logic AppsSenior-level Full TimeHouston, TX, United States16h ago