Senior Data Engineer
Orlando, FL, United States
USD 119K-165K (estimate) Senior-level Full Time
Tasks
- Apply infrastructure as code with version control and CI CD
- Architect data solutions across cloud data platforms
- Build and deploy containerized pipeline jobs
- Build logging alerting and retry logic
- Collaborate with analysts and stakeholders to deliver data solutions
- Containerize workloads with Docker
- Deploy and operate container apps jobs with schedules and event triggers
- Design and build scalable data pipelines
- Design idempotent fault tolerant pipelines
- Develop Python ETL and ELT pipelines
- Develop governed data models for analytics
- Enforce data security and access governance
- Implement layered medallion architecture
- Maintain technical documentation including runbooks and diagrams
- Manage Azure and AWS data infrastructure
- Manage data movement between on premises SQL Server and cloud
- Mentor junior engineers
- Monitor platform health and optimize compute and storage costs
- Perform code reviews and testing
Perks/Benefits
- N/A
Skills/Tech-stack
ANSI SQL | AWS EC2 | AWS S3 | Amazon Kinesis | Amazon RDS | Amazon Redshift | Azure Container | Azure Container Apps | Azure Container Apps Jobs | Azure Container Registry | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure SQL | Azure SQL Database | Bicep | CI/CD | Container Registry | DBT | Data Factory | Data Lake | Data Lake Storage | Dimensional Modeling | Docker | Dockerfile | Entity Relationship Modeling | Entity relationship | Event Hubs | Git | GitHub Actions | Infrastructure as Code | Kafka | Key Vault | Medallion Architecture | Microsoft Fabric | OneLake | Power BI | Python | Relationship Modeling | SQL Database | Snowflake Schema | Star Schema | T-SQL | Tableau | Terraform | “as-code”
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Data Visualization & Integration Specialist USD 115K-150KAPI Integration | Bill of Materials | Data Governance | ETL | ExcelHybrid work scheduleMid-level Full TimeMarietta, GA, United States8h ago
-
Software Engineer, Scientific Computing USD 90K-160KCUDA | Debugging | Deployment | Numerical Methods | Performance optimizationEntry-level Full TimeRedwood City9h ago
-
Entry-level Full TimeRedwood City9h ago
-
Senior-level Full TimeHoboken, NJ, United States9h ago
-
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS Step Functions100 percent on siteSenior-level ContractMc Lean, United States10h ago
-
AI | Adversarial Machine Learning | Bot Detection | Data Analysis | Data IntegrityMid-level Full TimeMountain View, CA, USA12h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R19h ago
-
Senior-level Full TimeMountain View, CA20h ago
-
Staff Software Engineer, AI Integrations USD 170K-240KAgile | Alerting | Amazon Web Services | C++ | CSSSenior-level Full TimeMountain View, CA21h ago
-
Senior Principal AI Engineer USD 152K-254KData Processing | Git | Hugging Face | Language Models | Language ProcessingAdoption Assistance | Dental vision prescription coverage | Disability benefits | Employee assistance program | Health benefitsSenior-level Full TimeCambridge, United States23h ago
-
Principal / Sr Principal Data Analytics Engineer USD 98K-184KAgile | CI/CD | Data Governance | Data Modeling | Data MonitoringCompany-Paid Holidays | Disability insurance | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeFLME229, United States23h ago
-
Sr. Data Engineer USD 109K-145KAWS | Agile | CI/CD | Compliance | Data Governance401k matching | Employee assistance program | Flexible working hours | Learning platform access | Medical, dental, and vision insuranceSenior-level Full TimeRemote, TX, United States R23h ago
-
Sr. Principal Embedded Software Engineer USD 142K-213KADA | Automated Regression | Bitbucket | C# | C++On-site work required | Relocation assistance not provided | Travel includedSenior-level Full TimeCACM01, United States23h ago
-
Senior Machine Learning Engineer USD 134K-168KData Drift | Databricks | Ethical AI | Feature Engineering | KubernetesSenior-level Full TimeNew York, NY, United States23h ago
-
Senior-level Full TimeSan Jose, CA, United States23h ago
-
Edge AI Engineer USD 100K-150KBenchmarking | Bias Evaluation | C++ | Core ML | Edge inferenceCareer growth | Direct W2 employment | Remote work | Technical coding assessmentSenior-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data quality monitoring | Deep learningCareer growthMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer USD 100K-150KAccelerator hardware | Computer Vision | Data Quality | Data labeling | Data quality monitoringCareer growth | Equal opportunity employment | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data quality monitoringKnowledge sharing | Long-term career growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache HBase | Apache Hive | Apache Hudi100 percent remote | Career growth | Full-time W2 employmentSenior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hive | Apache Hudi | Apache IcebergSenior-level Full TimeUnited States - Remote R23h ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | Code reviewCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R23h ago