Senior Data Engineer - Databricks
Tasks
- Collaborate with architects analysts and stakeholders
- Communicate technical solutions and trade-offs
- Design Lakehouse architectures
- Design build and maintain end to end data pipelines
- Develop and optimize data processing logic with PySpark
- Ensure data quality reliability performance and observability
- Implement CI CD version control and pipeline automation
- Implement ETL/ELT pipelines
- Manage data workflows with orchestration tools
- Optimize Spark jobs
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CD | Caching | Data Factory | Data Observability | Data Processing | Data Quality | Databricks | Delta Lake | ELT | ETL | Git | Lakehouse | Partitioning | Performance Tuning | PySpark | Python | SQL
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science
Roles
Regions
Countries
States
Related jobs
-
AWS Glue | Apache Spark | Azure Data | Azure Data Factory | Azure SQLHealthcare domain exposure | Onsite workMid-level Full TimeMedellin, Colombia3h ago
-
Azure | CI/CD | DAX | Data Lake | Data ModelingHolidays | Paid time off | Rewards and recognition programs | Work-life balanceSenior-level Full TimeColombia1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapsePaid Holidays | Paid time off | Rewards and recognition programs | Work-life balanceSenior-level Full TimeColombia1d ago
-
AWS | Azure | CI/CD | Cloud platform | DockerHolidays | Paid time off | Rewards and recognition programs | Work-life balanceSenior-level Full TimeColombia1d ago
-
Data Warehousing | ETL | Google Sheets | Looker | Microsoft ExcelCI&T University | Life insurance | Maternity leave | Meal voucher | Mobile services subsidyMid-level Full TimeColombia R1d ago
-
API Integration | API Security | Anthropic Claude | Anthropic Claude API | CI/CDComprehensive benefits | Flexible work model | Growth opportunities | Hybrid remote work | Wellness supportMid-level ContractColombia; Argentina; Mexico R1d ago
-
Data Modeling | Data Pipelines | Data Quality | Databricks | GitHubAI learning paths | Career development plans | Company-provided equipment | English lessons | Flexible working optionsSenior-level Full TimeBogotá, Bogota, Colombia1d ago
-
Airbyte | Azure Data | Azure Data Factory | Coalesce | Data FactoryHybrid flexibility | Medical healthcare | Ongoing learning reimbursement | Referral bonuses | Remote flexibilitySenior-level Full TimeBrazil, Colombia2d ago
-
Access Controls | Architecture patterns | Automation | Bronze Silver Gold | CI/CDAdvanced English working environment | Hybrid work | Remote workSenior-level Full TimeBogota2d ago
-
Senior-level Full TimeColombia R3d ago
-
AI Engineer COP 36000K-36000KClean Code | Cost Optimization | Data Pipelines | Design Patterns | Distributed Version ControlContinuing education program | Continuous learning | Flexible time off | Health care coverage | Retirement planningMid-level Full TimeCO - VIRTUAL, Colombia R3d ago
-
AI Engineer COP 60000K-71400KAgile | Anthropic Claude | Anthropic Claude API | Autogen | Claude APISenior-level Full TimeBogotá D.C., Colombia3d ago
-
API Integration | Azure AI | Azure OpenAI | Cloud services | Data AnalysisCareer developmentEntry-level Full TimeBogotá D.C., Bogotá D.C., CO, 1101113d ago
-
AI Engineer COP 36000K-36000KData Pipelines | Data Retrieval | Design Patterns | Generative AI | LLM monitoringCompany-matched student loan contribution | Continuing education program | Continuous learning resources | Family-friendly perks | Financial wellness programsMid-level Full TimeCO - VIRTUAL, Colombia R3d ago
-
Data Engineer COP 54000K-74400KAWS Glue | Amazon Athena | Amazon S3 | Apache Spark | Data Pipeline ArchitectureAI learning paths | Company-provided equipment | English lessons | Flexible working | Learning opportunitiesMid-level Full TimeBogotá, Bogota, Colombia3d ago
-
AWS Glue | AWS Step Functions | Amazon Athena | Amazon S3 | Change Data CaptureAI learning paths | Birthday rewards | Company-provided equipment | English lessons | Flexible working optionsSenior-level Full TimeBogotá, Bogota, Colombia3d ago
-
API Integration | Automation | Data Analysis | Language Models | Language ProcessingProfessional development | Remote work | Travel 10 to 20 percentEntry-level InternshipCualquier ciudad en Colombia, Colombia R4d ago
-
CI/CD | DevOps | Git | High Performance | High-Performance ComputingBilingual work environmentEntry-level Full TimeColombia4d ago
-
A/B | A/B Testing | Apache Spark | B testing | CI/CDFull-time | Remote workSenior-level ContractColombia - Remote R4d ago
-
Data Engineer COP 54000K-74400KApache Spark | CI/CD | Data Governance | Data Modeling | Data SecurityMid-level Full TimeBogota, CO R4d ago
-
Agile | Behavior-Driven Development | Cloud platform | Cost Optimization | DockerRemote workSenior-level Full TimeColombia4d ago
-
AI Software Engineer COP 65000K-100000KAPI Gateway | AWS | Amazon Bedrock | Amazon SageMaker | Distributed SystemsRemote workSenior-level Full TimeColombia4d ago
-
Senior-level Full TimeColombia4d ago
-
Azure Data | Azure Data Factory | Azure Databricks | Azure Synapse | Azure Synapse AnalyticsRemote workSenior-level Full TimeColombia4d ago
-
AWS Athena | Amazon Redshift | Amazon Redshift Serverless | DBT | Data ModelingAt home medical assistance | Christmas kit | Day off for academic graduation | Educational subsidies | Family dayEntry-level Full TimeBogotá, Bogota, Colombia4d ago