Senior Data Engineer - Databricks
Tasks
- Collaborate with architects analysts and stakeholders
- Communicate technical solutions and trade-offs
- Design Lakehouse architectures
- Design build and maintain end to end data pipelines
- Develop and optimize data processing logic with PySpark
- Ensure data quality reliability performance and observability
- Implement CI CD version control and pipeline automation
- Implement ETL/ELT pipelines
- Manage data workflows with orchestration tools
- Optimize Spark jobs
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CD | Caching | Data Factory | Data Observability | Data Processing | Data Quality | Databricks | Delta Lake | ELT | ETL | Git | Lakehouse | Partitioning | Performance Tuning | PySpark | Python | SQL
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science
Roles
Regions
Countries
States
Related jobs
-
Data Engineer ID52278 COP 54000K-74400KAWS | Amazon Redshift | DBT | Data Architecture | Data LakesEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeBucaramanga, Colombia11h ago
-
Data Engineer ID52278 COP 54000K-74400KAWS | Amazon Redshift | Computer Science | Computer science fundamentals | DBTFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksMid-level Full TimeCali, Colombia11h ago
-
Data Engineer ID52278 COP 54000K-74400KAmazon Redshift | Amazon Web Services | DBT | Data Architecture | Data LakeFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksMid-level Full TimeBogota, Colombia11h ago
-
Data Engineer ID52278 COP 54000K-74400KAWS | Amazon Redshift | DBT | Data Lakes | Data WarehousingFlextime | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksMid-level Full TimeManizales, Colombia11h ago
-
Data Engineer ID52278 COP 54000K-74400KAWS | Amazon Redshift | Amazon Web Services | DBT | Data LakesFlexible schedule | Mentorship | Office options | Remote work | TechtalksMid-level Full TimePereira, Colombia11h ago
-
Data Engineer ID52278 COP 54000K-74400KAmazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flexible schedule | Mentorship | Professional growth roadmapsMid-level Full TimeMedellín, Colombia11h ago
-
Data Engineer ID52278 COP 54000K-74400KAWS | Amazon Redshift | DBT | Data Architecture | Data LakesEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeCartagena, Colombia11h ago
-
Data Engineer ID52278 COP 54000K-74400KAmazon Redshift | Amazon Web Services | DBT | Data Architecture | Data LakesEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeVillavicencio, Colombia11h ago
-
Data Engineer ID52278 COP 54000K-74400KAmazon Redshift | Amazon Web Services | DBT | Data Lakes | Data QualityEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeBarranquilla, Colombia11h ago
-
Agentic AI Engineer COP 240000K-312000KAPIs | Agent Orchestration | Agile | Anthropic API | Context engineeringDental insurance | Health Savings Account contribution | Hybrid work options | Medical insurance | Professional developmentEntry-level Full TimeBogotá1d ago
-
Junior Analytics Engineer COP 111600K-127200KAPIs | AWS CloudFormation | AWS Lambda | Amazon S3 | Apache IcebergCell Phone Device | Cell phone stipend | Dental insurance | E-learning catalog | EAPEntry-level Full TimeBogota1d ago
-
AWS Lambda | Amazon Redshift | Apache Airflow | DBT | Data GovernancePaid time off | Remote work | Work autonomy | Work with top companies | Work-life balanceSenior-level Full TimeBogota R1d ago
-
Data Ingestion | Data Normalization | Data Pipelines | Data Quality | Data TransformationCompany-provided equipment | Flexible working options | Learning opportunities | Mentorship programs | Travel opportunitiesSenior-level Full TimeBogotá, Bogota, Colombia1d ago
-
AWS Lambda | AWS S3 | Amazon EventBridge | Automated data quality | Automated data quality checksDEI initiatives | Employee development programs | Fully remote | Healthcare stipend | Hybrid workMid-level Full TimeRemote - Argentina; Remote - Brazil; … R1d ago
-
Entry-level Full TimeCOL-Bogotá, Colombia2d ago
-
Senior Software Engineer (Pipeline team) COP 54000K-57000KA/B | A/B Testing | AWS Bedrock | AWS ECS | AWS EKSRemote workSenior-level Full TimeBogota2d ago
-
Data Monitoring | Data Normalization | Data Pipelines | Data Quality | Data TransformationAI learning paths | Company-provided equipment | English lessons | Flexible working options | Learning opportunitiesSenior-level Full TimeBogotá, Bogota, Colombia2d ago
-
AI Ops | APIs | AWS | Anthropic API | AzureCareer coaching | Certifications support | Coaching | Employee assistance programme | Flexible working hoursSenior-level Full TimeMedellín, Antioquia, Colombia2d ago
-
AI Ops | API Development | AWS | Artificial Intelligence | AzureCareer coaching | Career development programmes | Certifications support | Coaching | Employee assistance programmeSenior-level Full TimeCali, Valle del Cauca, Colombia2d ago
-
API Development | AWS | Artificial Intelligence | Azure | CI/CDCareer coaching | Employee assistance programme | Flexible working hours | Hybrid work | TrainingSenior-level Full TimeBogotá, Bogota D.C., Colombia2d ago
-
Airflow | Anomaly Detection | BigQuery | DBT | Data GovernanceSenior-level Full TimeMedellín, Antioquia, Colombia2d ago
-
SD Solutions COP 54000K-74400KApache Spark | CI/CD | Change Data Capture | Change Data Feed | Data CaptureMid-level Full TimeMedellin, CO / Argentina2d ago
-
AI/ML Engineer: RAG & API Pipelines COP 30000K-32500KAPIs | AWS Step Functions | Amazon Bedrock | Amazon SQS | Apache KafkaFloating holidays | Good working environment | Remote work | Vacation daysSenior-level Full TimeColombia - Remote R3d ago
-
.NET | AI SDK | AWS Step Functions | Amazon Bedrock | Amazon MSKFloating holidays | Good working environment | Paid time off | Remote workSenior-level Full TimeColombia - Remote R3d ago
-
AWS Glue | AWS Step Functions | Agile | Amazon Athena | Amazon S3Company-provided equipment | English lessons | Flexible working options | Learning opportunities | Mentorship programsSenior-level Full TimeBogotá, Bogota, Colombia3d ago