Senior Data Engineer
Jacksonville, FL, United States
USD 120K-170K (estimate) Senior-level Full Time
Tasks
- Build Bronze Silver lakehouse layers
- Create curated Gold warehouse data products
- Design Microsoft Fabric lakehouse architecture
- Develop Data Factory pipelines
- Develop incremental loading patterns
- Establish data classification and lifecycle policies
- Implement change data capture patterns
- Implement data quality governance and access controls
- Implement ingestion transformation and publishing pipelines
- Integrate AEC system data sources
- Publish metadata and lineage for AI use cases
- Set up monitoring alerting and runbooks
- Support production DataOps practices
- Use Lakehouse Warehouse notebooks and Spark
- Write SQL for transformation and curated datasets
Perks/Benefits
- Childcare resources
- Flexible scheduling
- Internal training programs
- Medical, dental, and vision insurance
- New parent leave
- Paid time off
- Retirement plan match
- Tuition reimbursement
Skills/Tech-stack
AI Search | Access Control | Alerting | Analytical Data | Analytical data modeling | Apache Spark | Azure AI | Azure AI Search | Azure Data | Azure Data Factory | CDC | CI/CD | Change Data Capture | Chunking | Data Capture | Data Catalog | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | DataOps | Embeddings | Hybrid search | Incremental loading | Medallion Architecture | Metadata Management | Microsoft Fabric | Microsoft Purview | Monitoring | Notebooks | OneLake | Python | Relational Data | Relational Data Modeling | Retrieval-Augmented Generation | SQL | Vector Search
Education
N/A
Roles
Related jobs
-
Data Engineer USD 185K-196KApache Spark | Artificial Intelligence | CSS | Data Governance | Data ModelingMid-level Full TimeMenlo Park, CA1h ago
-
Entry-level Full TimeMenlo Park, CA1h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Computer Vision | Data Processing | Data StorageSenior-level Full TimeKirkland, WA, USA1h ago
-
Software Engineer, TPU Inference, AI/ML USD 147K-211KCloud Computing | Compilers | GPU | GPU Programming | InferenceMid-level Full TimeKirkland, WA, USA1h ago
-
Backup and Recovery | BigQuery | C++ | Consistency models | Copy-on-writeSenior-level Full TimeKirkland, WA, USA1h ago
-
Software Engineer, Decoding, Quantum AI USD 147K-211KC++ | Concurrency | DSP | Error correction | FPGAMid-level Full TimeLos Angeles, CA, USA; Goleta, CA, …1h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud AI USD 147K-211KC++ | Data Processing | Debugging | Generative AI | Language ModelsSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, Full Stack, Gen AI Formats USD 174K-252KArtificial Intelligence | C++ | Data Storage | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1h ago
-
Customer Engineer, Data Analytics, Google Cloud USD 153K-222KBatch Processing | Big Data | Cloud Native | Cloud Native Architecture | Cloud platformSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, AI/ML, Retail Ads, Fullstack USD 174K-252KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeMountain View, CA, USA1h ago
-
Algorithms | Data Structures | Deep learning | Embeddings | Information RetrievalSenior-level Full TimeMountain View, CA, USA1h ago
-
AWS | Azure | CI/CD | Data Engineering | DockerCross-functional collaboration | Documentation support | Flexible teamwork environment | MentorshipEntry-level InternshipIrvine, CA, US4h ago
-
AI Engineer USD 109K-155KAI Agents | API Integration | Generative AI | Language Models | Large Language Models401k matching | Dental insurance | Disability coverage | Medical insurance | Paid HolidaysSenior-level Full TimeOverland Park, KS, US5h ago
-
Senior IT Solution Engineer (Power BI) USD 110K-166KAgile | Azure | DAX | Power BI | Power Query401k match | Annual bonus programs | Dental insurance | Health insurance | Life insuranceSenior-level Full TimeHolland, MI, US, 494236h ago
-
Staff Backend Software Engineer- (AI Platform) USD 166K-225KCI/CD | Cloud Native | Cloud-native infrastructure | Distributed Systems | GPUSenior-level Full TimeSan Francisco, California8h ago
-
Senior-level Full TimeNew York City or Chicago11h ago
-
Data Engineer - Finance USD 130K-204KApache Airflow | Business Intelligence | DBT | Dagster | DashboardingIn-office 5 days a weekMid-level Full TimeSan Francisco Bay Area12h ago
-
Principal Data Engineer - League Studios USD 209K-293KApache Airflow | Apache Spark | Batch Processing | DBT | Data Governance401k company match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA12h ago
-
Langchain | Language Models | Large Language Models | MLOps | Machine LearningFreelance project based engagement | Part-time project workMid-level FreelanceNew York, United States - Remote R12h ago
-
Big Data | Feature Engineering | Langchain | MLOps | Machine LearningFreelance work | Part-time projects | Project based workMid-level FreelanceUnited States - Remote R12h ago
-
LLM | Langchain | MLOps | Machine Learning | MatplotlibEnglish proficiency assessment | Flexible hours | Part-time project work | Project-based employmentMid-level FreelanceTexas, United States - Remote R12h ago
-
Generative AI | Langchain | Language Models | Large Language Models | MLOpsPart-time project-based workMid-level FreelanceUnited States - Remote R12h ago
-
LLM | Langchain | MLOps | NumPy | PandasPart-time availability | Project based workMid-level FreelanceNew York, United States - Remote R12h ago
-
Sr. Analytics Engineer USD 145KAWS | Azure | Business Intelligence | Data analytics | DatabricksEmployee assistance program | Group term life insurance | Home-office allowance | Internet reimbursement | Long-term disabilitySenior-level Full TimeUnited States - Remote R12h ago
-
AI Search | AWS Bedrock | Agent systems | Amazon SageMaker | Anthropic401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago