Senior Data Engineer (Databricks)
Tasks
- Build ETL pipelines
- Design Lakehouse architectures
- Develop batch and streaming processing
- Ensure data governance, security, and compliance
- Integrate data sources
- Lead end to end data engineering implementations
- Migrate data solutions to production
- Optimize Databricks clusters and jobs
- Provide technical leadership and mentorship
- Support pre-sales efforts
Perks/Benefits
Skills/Tech-stack
Amazon Web Services | Apache Spark | Autoscaling | Azure | Batch Processing | Caching | Cloud platform | Cluster configuration | DBT | Data Governance | Data Security | Databricks | Delta Lake | ETL | Google Cloud | Google Cloud Platform | Job orchestration | Lakehouse | MLflow | Partitioning | Power BI | PySpark | Python | SQL | Scala | Streaming | Terraform | Web Services
Roles
Regions
Countries
States
Related jobs
-
AI Engineer COP 36000K-36000KClean Code | Cost Optimization | Data Pipelines | Design Patterns | Distributed Version ControlContinuing education program | Continuous learning | Flexible time off | Health care coverage | Retirement planningMid-level Full TimeCO - VIRTUAL, Colombia R23h ago
-
AI Engineer COP 60000K-71400KAgile | Anthropic Claude | Anthropic Claude API | Autogen | Claude APISenior-level Full TimeBogotá D.C., Colombia23h ago
-
Data Engineer COP 54000K-74400KAWS Glue | Amazon Athena | Amazon S3 | Apache Spark | Data Pipeline ArchitectureAI learning paths | Company-provided equipment | English lessons | Flexible working | Learning opportunitiesMid-level Full TimeBogotá, Bogota, Colombia1d ago
-
AWS Glue | AWS Step Functions | Amazon Athena | Amazon S3 | Change Data CaptureAI learning paths | Birthday rewards | Company-provided equipment | English lessons | Flexible working optionsSenior-level Full TimeBogotá, Bogota, Colombia1d ago
-
API Integration | Automation | Data Analysis | Language Models | Language ProcessingProfessional development | Remote work | Travel 10 to 20 percentEntry-level InternshipCualquier ciudad en Colombia, Colombia R1d ago
-
CI/CD | DevOps | Git | High Performance | High-Performance ComputingBilingual work environmentEntry-level Full TimeColombia1d ago
-
A/B | A/B Testing | Apache Spark | B testing | CI/CDFull-time | Remote workSenior-level ContractColombia - Remote R1d ago
-
Data Engineer COP 54000K-74400KApache Spark | CI/CD | Data Governance | Data Modeling | Data SecurityMid-level Full TimeBogota, CO R1d ago
-
HR AI Specialist COP 23500K-23500KAdvanced Analytics | Artificial Intelligence | Bias Mitigation | Data Governance | Machine LearningContinuous learning and professional growth | Flexible work options | Health, wellness, and retirement plansMid-level Full TimeCOL - Iron Mountain Services, Colombia1d ago
-
Agile | Behavior-Driven Development | Cloud platform | Cost Optimization | DockerRemote workSenior-level Full TimeColombia2d ago
-
AI Software Engineer COP 65000K-100000KAPI Gateway | AWS | Amazon Bedrock | Amazon SageMaker | Distributed SystemsRemote workSenior-level Full TimeColombia2d ago
-
Senior-level Full TimeColombia2d ago
-
Senior-level Full TimeColombia2d ago
-
Azure Data | Azure Data Factory | Azure Databricks | Azure Synapse | Azure Synapse AnalyticsRemote workSenior-level Full TimeColombia2d ago
-
AWS Athena | Amazon Redshift | Amazon Redshift Serverless | DBT | Data ModelingAt home medical assistance | Christmas kit | Day off for academic graduation | Educational subsidies | Family dayEntry-level Full TimeBogotá, Bogota, Colombia2d ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon DMSPaid Holidays | Paid time off | Remote work | Rewards and recognition programs | Work-life balanceSenior-level Full TimeColombia2d ago
-
Amazon Redshift | Apache Airflow | Apache Hive | Apache Kafka | Apache SparkEducation budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimeBucaramanga, Colombia4d ago
-
Airflow | Amazon Redshift | Apache Hive | Apache Kafka | Apache SparkFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionSenior-level Full TimeCartagena, Colombia4d ago
-
Agile | Amazon Redshift | Apache Airflow | Apache Hive | Apache KafkaFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeVillavicencio, Colombia4d ago
-
Amazon Redshift | Apache Airflow | Apache Hive | Apache Kafka | Apache SparkFlexible schedule | Flextime | Mentorship | Personalized growth roadmaps | Professional growthSenior-level Full TimeCali, Colombia4d ago
-
Amazon Redshift | Apache Airflow | Apache Hive | Apache Kafka | Apache SparkFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeManizales, Colombia4d ago
-
Amazon Redshift | Apache Airflow | Apache Hive | Apache Kafka | Apache SparkEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeMedellín, Colombia4d ago
-
Amazon Redshift | Apache Airflow | Apache Hive | Apache Kafka | Apache SparkFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote optionsSenior-level Full TimePereira, Colombia4d ago
-
Amazon Redshift | Apache Airflow | Apache Hive | Apache Kafka | Apache SparkFlextime | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeBogota, Colombia4d ago
-
Agile | Amazon Redshift | Apache Airflow | Apache Hive | Apache KafkaFlextime | Mentorship | Office option | Personalized growth roadmaps | Remote work optionSenior-level Full TimeBarranquilla, Colombia4d ago