Principal Data Engineer
Tasks
- Build and maintain production data pipelines on Azure Databricks
- Collaborate with AI Engineers and platform teams
- Develop scalable data models for claims and related data
- Enforce data quality and observability
- Engineer data preparation pipelines for AI workloads
- Implement medallion architecture with data quality controls
- Manage pipeline orchestration CI/CD and recovery
- Work with data owners to manage access and dependencies
Perks/Benefits
- AI learning paths
- Celebrations and support
- Certifications
- English lessons
- Flexible working
- Learning opportunities
- Mentoring and development
- Travel opportunities
- Udemy courses
Skills/Tech-stack
ADLS Gen2 | Azure ADLS | Azure ADLS Gen2 | Azure Fundamentals | CI/CD | Data Governance | Data Modeling | Data Observability | Data Quality | Data Reliability | Data pipeline | Data pipeline orchestration | Data quality frameworks | Databricks | Delta Lake | Key Vault | Networking | Performance Tuning | Pipeline Orchestration | PySpark | Quality frameworks | SQL | Schema evolution | Security | Structured Streaming | Unity Catalog
Roles
Regions
Countries
States
Related jobs
-
AWS RDS | AWS Security | Amazon Web Services | Apache Spark | AutomationEquipment and office stipend | Flexible PTO | Laptop and tools | Learning and development stipend | Paid exams and certificationsSenior-level Full TimeARGENTINA R15h ago
-
Airflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCareer development | Company-provided equipment | English lessons | Flexible working options | Learning opportunitiesSenior-level Full TimeBogotá, Bogota, Colombia R18h ago
-
AWS | Apache Spark | Application Profiling | C# | C++Flextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeManizales, Colombia20h ago
-
AWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote work optionsSenior-level Full TimeCali, Colombia20h ago
-
Amazon Web Services | Apache Spark | Application Profiling | Application debugging | C#Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeCartagena, Colombia20h ago
-
AWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Growth roadmaps | MentorshipSenior-level Full TimeBucaramanga, Colombia20h ago
-
Amazon Web Services | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimePereira, Colombia20h ago
-
AWS | Apache Spark | Application Profiling | C# | C++Competitive compensation | Education budget | Fitness budget | Flextime | MentorshipSenior-level Full TimeBarranquilla, Colombia20h ago
-
AWS | Apache Spark | Application Profiling | C# | C++Flexible schedule | Mentorship | Office option | Personalized growth roadmaps | Remote work optionSenior-level Full TimeVillavicencio, Colombia20h ago
-
AWS | Apache Spark | Application Profiling | C# | C++Competitive compensation | Education budget | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeMedellín, Colombia20h ago
-
AWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeUsaquen, Colombia20h ago
-
API Development | AWS SageMaker | Azure Machine Learning | CI/CD | Computer VisionContinuous learning opportunities | International team collaboration | Remote work optionsSenior-level Full TimeMedellin, Colombia1d ago
-
Senior-level Full TimeMedellin, Colombia1d ago
-
Big Data | Business Intelligence | CapEx | Cash Flow | Cloud DataSenior-level Full TimeBogotá, Bogota, Colombia1d ago
-
Amazon Kinesis | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkAnnual team trip | Birthday off | English lessons | Extra vacation week | Monthly benefits creditsSenior-level Full TimeArgentina R1d ago
-
Senior-level Full TimeBogotá, CO, 1102312d ago
-
Amazon Web Services | Apache Airflow | Apache Spark | Data Lakes | Data PipelinesEvery other Friday off | Flexible work schedule | Health bonus | Local holidays | Paid sick daysEntry-level InternshipColombia R2d ago
-
AWS Bedrock | AWS Glue | Airflow | Amazon Kinesis | Amazon OpenSearch100% remote work | Annual stipend for Learning and Development | Equipment and office stipend | Flexible PTO | Generous holidaysSenior-level Full TimeARGENTINA R2d ago
-
Data Engineer (FinOps) ID56348 COP 54000K-74400KAWS | Apache Airflow | CD pipelines | CI/CD | CI/CD pipelinesEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeCali, Colombia2d ago
-
Data Engineer (FinOps) ID56348 COP 54000K-74400KAWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeCartagena, Colombia2d ago
-
Data Engineer (FinOps) ID56348 COP 54000K-74400KAWS | Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flextime | Mentorship | Office workMid-level Full TimeManizales, Colombia2d ago
-
Data Engineer (FinOps) ID56348 COP 54000K-74400KAWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsMid-level Full TimeVillavicencio, Colombia2d ago
-
Data Engineer (FinOps) ID56348 COP 54000K-74400KAWS | Apache Airflow | CI/CD | Cloud platform | DBTEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeUsaquen, Colombia2d ago
-
Data Engineer (FinOps) ID56348 COP 54000K-74400KAWS | Apache Airflow | CI/CD | DBT | DagsterFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksMid-level Full TimeBucaramanga, Colombia2d ago
-
Data Engineer (FinOps) ID56348 COP 54000K-74400KAWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsMid-level Full TimePereira, Colombia2d ago