Senior Data Engineer
Jacksonville, FL, United States
USD 120K-170K (estimate) Senior-level Full Time
Tasks
- Build Bronze Silver lakehouse layers
- Create curated Gold warehouse data products
- Design Microsoft Fabric lakehouse architecture
- Develop Data Factory pipelines
- Develop incremental loading patterns
- Establish data classification and lifecycle policies
- Implement change data capture patterns
- Implement data quality governance and access controls
- Implement ingestion transformation and publishing pipelines
- Integrate AEC system data sources
- Publish metadata and lineage for AI use cases
- Set up monitoring alerting and runbooks
- Support production DataOps practices
- Use Lakehouse Warehouse notebooks and Spark
- Write SQL for transformation and curated datasets
Perks/Benefits
- Childcare resources
- Flexible scheduling
- Internal training programs
- Medical, dental, and vision insurance
- New parent leave
- Paid time off
- Retirement plan match
- Tuition reimbursement
Skills/Tech-stack
AI Search | Access Control | Alerting | Analytical Data | Analytical data modeling | Apache Spark | Azure AI | Azure AI Search | Azure Data | Azure Data Factory | CDC | CI/CD | Change Data Capture | Chunking | Data Capture | Data Catalog | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | DataOps | Embeddings | Hybrid search | Incremental loading | Medallion Architecture | Metadata Management | Microsoft Fabric | Microsoft Purview | Monitoring | Notebooks | OneLake | Python | Relational Data | Relational Data Modeling | Retrieval-Augmented Generation | SQL | Vector Search
Education
N/A
Roles
Related jobs
-
AWS | Azure | CI/CD | Data Engineering | DockerCross-functional collaboration | Documentation support | Flexible teamwork environment | MentorshipEntry-level InternshipIrvine, CA, US2h ago
-
AI Engineer USD 109K-155KAI Agents | API Integration | Generative AI | Language Models | Large Language Models401k matching | Dental insurance | Disability coverage | Medical insurance | Paid HolidaysSenior-level Full TimeOverland Park, KS, US3h ago
-
Senior IT Solution Engineer (Power BI) USD 110K-166KAgile | Azure | DAX | Power BI | Power Query401k match | Annual bonus programs | Dental insurance | Health insurance | Life insuranceSenior-level Full TimeHolland, MI, US, 494234h ago
-
Staff Backend Software Engineer- (AI Platform) USD 166K-225KCI/CD | Cloud Native | Cloud-native infrastructure | Distributed Systems | GPUSenior-level Full TimeSan Francisco, California6h ago
-
Senior-level Full TimeNew York City or Chicago9h ago
-
Data Engineer - Finance USD 130K-204KApache Airflow | Business Intelligence | DBT | Dagster | DashboardingIn-office 5 days a weekMid-level Full TimeSan Francisco Bay Area10h ago
-
Principal Data Engineer - League Studios USD 209K-293KApache Airflow | Apache Spark | Batch Processing | DBT | Data Governance401k company match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA11h ago
-
Langchain | Language Models | Large Language Models | MLOps | Machine LearningFreelance project based engagement | Part-time project workMid-level FreelanceNew York, United States - Remote R11h ago
-
Big Data | Feature Engineering | Langchain | MLOps | Machine LearningFreelance work | Part-time projects | Project based workMid-level FreelanceUnited States - Remote R11h ago
-
LLM | Langchain | MLOps | Machine Learning | MatplotlibEnglish proficiency assessment | Flexible hours | Part-time project work | Project-based employmentMid-level FreelanceTexas, United States - Remote R11h ago
-
Generative AI | Langchain | Language Models | Large Language Models | MLOpsPart-time project-based workMid-level FreelanceUnited States - Remote R11h ago
-
LLM | Langchain | MLOps | NumPy | PandasPart-time availability | Project based workMid-level FreelanceNew York, United States - Remote R11h ago
-
AI Search | AWS Bedrock | Agent systems | Amazon SageMaker | Anthropic401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States11h ago
-
Senior Data Scientist II (ML) USD 182K-266KAWS | Apache Spark | Cloud Computing | Data labeling | Dataset curationDental & vision coverage | Disability plans | Flexible spending account | Flexible vacation policy | Health savings accountMid-level Full TimeRemote, USA R11h ago
-
Principal Machine Learning Engineer USD 220K-300KCUDA | Continuous Learning | Data Preparation | Drift monitoring | Embedding401k | Employee assistance program | Employee stock purchase plan | Health savings account | Medical/Dental/Vision insuranceSenior-level Full TimeUnited States | Remote R11h ago
-
Sr. Solutions Engineer - GSI's and FinTech Data USD 152K-209KAWS | Apache Spark | Artificial Intelligence | Cloud platform | Data EngineeringTravel opportunitiesSenior-level Full TimeGeorgia; Illinois; Massachusetts; New Jersey; New …12h ago
-
Senior Machine Learning Engineer, Voice AI USD 200K-260KAudio codecs | Audio signal processing | Automatic Speech Recognition | Batching | CUDAHealth insurance | Startup equitySenior-level Full TimeSan Francisco12h ago
-
Data Engineer (4867) USD 135K-227KAPI Integration | AWS Glue | Apache Spark | Azure Data | Azure Data FactoryHealth insurance | Paid leave | RetirementSenior-level Full TimeQuantico, VA12h ago
-
Machine Learning Engineer, Growth USD 150K-180KA/B | A/B Testing | AWS | Airflow | B testing401k plan | Disability coverage | Healthcare benefits | Life insurance | Office in person at least four days per weekEntry-level Full TimeSeattle, Washington, United States12h ago
-
Trainee - Data Storytelling and Analytics USD 36K-36KAI tools | Alation | Amazon QuickSight | Analytics storytelling | DashboardingHands-on project experience | In office work experience | Mentorship | Networking opportunities | Weekly training sessionsEntry-level Full TimeUnited States12h ago
-
APIs | Agent Orchestration | Agentic Systems | Air-gapped | Air-gapped environments401k option | Comprehensive health care | Equity Incentives Option | FSA option | Mental health benefitsSenior-level Full TimeSeattle, WA or McLean, VA or … R13h ago
-
Data Scientist, Product USD 180K-260KApache Airflow | DBT | Dashboarding | Data Modeling | Data pipeline401k | Catered lunch daily | Dental insurance | DoorDash dinner credit | Fertility benefitsMid-level Full TimeNew York City; San Francisco, CA13h ago
-
Staff Conversational AI Engineer USD 171K-213KAPI Integration | Agent Assist | CCAI Insights | Conversational Design | Dialogflow401k | Courses | Flexible work arrangements | Health insurance | Mentorship programsSenior-level Full TimePlano, TX13h ago
-
Staff AI Engineer – Agentic AI and Automaton USD 155K-243KAWS | Amazon SQS | Batch Processing | Cloud platform | Data Lineage401k | Health insurance | Hybrid work | Paid time offSenior-level Full TimeSan Francisco, CA | Lehi, UT …13h ago
-
Staff Data Engineer USD 190K-212KAmazon Kinesis | Apache Flink | Apache Kafka | Apache Spark | Business IntelligenceSenior-level Full TimeRemote-United States R13h ago