Senior Data Engineer
Raleigh, NC, United States
USD 120K-180K (estimate) Senior-level Full Time
Tasks
- Build Data Factory pipelines
- Build data warehouse curated datasets
- Create notebooks and Spark jobs
- Design data lakehouse architecture on OneLake
- Develop ingestion transformation and publishing pipelines
- Establish data quality and production DataOps practices
- Implement bronze silver gold data layers
- Implement data governance and access controls
- Implement incremental loads and CDC
- Integrate AEC data sources
- Publish data products metadata and lineage
- Set up data monitoring alerting and runbooks
- Write SQL transformations and queries
Perks/Benefits
- Childcare resources
- Dental insurance
- Flexible scheduling
- Health insurance
- Internal training programs
- New parent leave
- Paid time off
- Retirement plan match
- Student loan matching
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
Access Control | Apache Spark | Azure Data | Azure Data Factory | CDC | CI/CD | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Transformation | DataOps | Incremental loading | Metadata Management | Microsoft Fabric | Orchestration | Python | SQL | SQL Server
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R15d ago
-
Accessibility | Artificial Intelligence | Data Analysis | Data Mining | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Software Engineer III, Embedded Systems Firmware, Platforms Infrastructure Engineering USD 147K-211KC# | C++ | Data Structures | Data Structures and Algorithms | Device DriversSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Staff Software Engineer, AI/ML Performance USD 207K-300KAlgorithm Design | Auto sharding | C++ | Code generation | Compiler optimizationSenior-level Full TimeSunnyvale, CA, USA1h ago
-
AI Middleware Engineer USD 99K-195KAI Agent | AI Agent Frameworks | API Design | API Security | Agent FrameworksClient-facing work | Production impactMid-level Full TimeSan Francisco8h ago
-
Software Engineer, Applied AI USD 130K-500KData Pipelines | Data Quality | Evaluation | Experimental Design | GoEquity 4 year vest | Free gym membership | Health insurance | Housing bonus | Meal stipendMid-level Full TimeSan Francisco9h ago
-
Software Engineer, Storage USD 157K-185KAsynchronous processing | CDC | Change Data Capture | Data Capture | Data IngestionEmployee travel credits | Oncall rotation | Remote eligibleSenior-level Full TimeUnited States10h ago
-
Senior Data Engineer USD 136K-160KApache Spark | Azure Data | Azure Data Factory | Azure Event | Azure Event Hubs401k match | Employee assistance program | Free parking | Healthcare | Hybrid workplace flexibilitySenior-level Full TimeCharlotte, North Carolina, United States; Virtual R10h ago
-
Optimization Software Engineer USD 132K-198KAPIs | AWS | Algorithms | Amazon CodeWhisperer) | Azure401k matching | Commuter benefits | Healthcare benefits | Life and disability insurance | Mental health resourcesMid-level Full TimeWashington, District of Columbia, United States10h ago
-
Quantum Software Engineer USD 132K-198KC# | C++ | CI/CD | CUDACUDAQ | CUDALabCaregiver leave | Commuter benefits | Disability insurance | Family planning support | Life insuranceMid-level Full TimeWashington, District of Columbia, United States10h ago
-
Mid-level Full TimeDes Moines, Iowa12h ago
-
Senior-level Full TimeNew York, NY, United States12h ago
-
Robotic Software Engineer - Air Autonomy USD 135K-175KAgile | ArduPilot | Bash | C++ | CI/CDIn-office work flexibility | Occasional remote work | Paid time off | Travel opportunitiesMid-level Full TimeWashington, District of Columbia, United States13h ago
-
Robotic Software Engineer - Aerial Autonomy USD 125K-165KAgile | ArduPilot | Bash | C++ | CI/CDTravel for site integration and demonstrationsMid-level Full TimeFort Walton Beach, Florida, United States13h ago
-
Senior Application Data Engineer USD 160K-200KAWS EKS | AWS PostgreSQL | AWS Redshift | Amazon DynamoDB | Amazon RDSEquity | Life insurance | Medical, dental & vision coverage | Paid parental leave | Paid time offSenior-level Full TimeLos Angeles, CA14h ago
-
Robot Learning Engineering Intern USD 80K-116KBehavior Cloning | Computer Vision | Force control | Imitation Learning | Learning from DemonstrationCatered lunches | Employee Assistance Program (EAP) | Flexible PTO | Healthy snacks | Paid sick leaveEntry-level InternshipOnsite- Pittsburgh, PA14h ago
-
Product Enablement Data Engineer USD 112K-182KAWS | Authentication | Azure | Curl | DNS401k | Dental insurance | Disability benefits | Flexible time off | Health insuranceSenior-level Full TimeUSA14h ago
-
AI Data Engineer USD 133K-256KAWS | Agile | Apache Kafka | Apache Spark | AzureHybrid work | Work from home up to three days per weekEntry-level Full TimeMaryland, United States14h ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Cloud Computing | Data AnalysisDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States14h ago
-
AWS Lambda | Amazon Bedrock | Amazon ECR | Amazon S3 | Amazon SageMaker401k match | Dental insurance | Health insurance | Long-term engagement | Remote-firstSenior-level Full TimeUSA15h ago
-
Software Engineer III USD 112K-176KAWS | Angular | Apache Airflow | Apache Beam | Apache SparkHealth and wellness programsSenior-level Full TimeWaltham, Massachusetts, United States15h ago
-
BACnet | BMS | Control Systems | Control loops | Cooling systemsFlexible working hours | Generous vacation | Optional equity donation matching | Parental leave | Visa sponsorship assistanceMid-level Full TimeRemote-Friendly, United States R15h ago
-
AI/ML Research Engineer USD 120K-220KAWS | Cloud Computing | Computational Biology | Data Processing | Data pipelineMid-level Full TimeBoston15h ago
-
IT AI&S Senior Data Engineer USD 132K-202KAWS | Apache Spark | Azure | Data Governance | Data LineageSenior-level Full TimeBoston, MA, United States15h ago
-
Senior/Lead Bioinformatics Engineer USD 133K-166KAWS | CI/CD | Containerization | Distributed Computing | Docker401k benefits | Commuter benefits | Comprehensive medical/dental/vision coverage | Employee referral program | Fertility care benefitsSenior-level Full TimeUS Remote R15h ago