Data Engineer Specialist- ScotiaTech
Tasks
- Build data pipelines
- Develop ETL/ELT processes
- Ensure data governance security compliance
- Implement data models transformations
- Implement data quality integrity testing
- Monitor and optimize data pipeline performance
- Support data migration onto Azure Databricks
- Troubleshoot pipeline issues root cause analysis
Perks/Benefits
Skills/Tech-stack
Access Control | Apache Spark | Azure Databricks | Bicep | CI/CD | Data Governance | Data Lineage | Data Modeling | Data Warehousing | Delta Lake | Encryption | FinOps | Git | Key Management | Lakehouse Architecture | PySpark | Python | Role-Based Access | Role-Based Access Control | SQL | Schema Design | Terraform | Unity Catalog
Education
Roles
Regions
Countries
States
Related jobs
-
DataOps Engineer Specialist- ScotiaTech COP 54000K-74400KApache Spark | Automated testing | Azure Databricks | CI/CD | Cloud modernizationMid-level Full TimeBogota, DC, CO13h ago
-
Senior Data Engineer COP 88000K-120000KAI | Agentic Engineering | BigQuery | Cloud Storage | Cloud platformSenior-level Full TimeColombia R14h ago
-
Analytics Consultant COP 31853K-31853KApache Spark | Artificial Intelligence | Automation | Classification | ClusteringMid-level Full TimeBogotá, Colombia17h ago
-
Automated testing | Azure | Azure Databricks | CI/CD | DBTSenior-level Full TimeColombia; Costa Rica; Peru20h ago
-
AWS ECS | AWS ECS Fargate | AWS EMR | AWS S3 | AWS SNSDiversity and inclusion working groups | Flexible working practices | Parental leaveEntry-level Full TimeColombia - Remote R23h ago
-
Ingeniero de datos - Senior COP 78000K-83999KAWS Glue | AWS IAM | AWS Lambda | Airflow | Amazon AthenaSenior-level Full TimeBogotá, Bogota, Colombia1d ago
-
Data Engineer Specialist COP 54000K-74400KAccess Control | Apache Spark | Automated testing | Azure Databricks | CI/CDMid-level Full TimeBogota, DC, CO1d ago
-
Senior Data Engineer Lead COP 60000K-83999KAccess Control | Apache Spark | Asset bundles | Automated testing | Azure DataSenior-level Full TimeBogota, DC, CO1d ago
-
Senior Data Engineer Lead- ScotiaTech COP 19500K-24000KAccess Control | Asset bundles | Automated testing | Azure | Azure DataSenior-level Full TimeBogota, DC, CO1d ago
-
DataOps Engineer Specialist COP 54000K-74400KAgile | Apache Spark | Automated testing | Azure Databricks | CI/CDMid-level Full TimeBogota, DC, CO1d ago
-
Business Analytics Specialist COP 49838K-57505KAPIs | BI Integration | Batch Processing | Cloud Object Storage | DBTCatered lunches | Co-working travel perk | Health insurance | Home-office equipment | Indefinite term contractMid-level Full TimeBogotá, Bogotá D.C.1d ago
-
Senior-level Full TimeBogota, Colombia / Argentina (Remote Friendly) R3d ago
-
Conversational AI Engineer - Google/GECX & Code Agents COP 240000K-310000KBigQuery | CCaaS | CI/CD | CRM | Cloud loggingMid-level Full TimeBogota3d ago
-
Lead Data Engineer COP 89364K-102180KApache Spark | CI/CD | CTE | DBT | DBT CoreFixed-term contract | Fully remoteSenior-level Full TimeColombia R3d ago
-
Senior Applied Scientist COP 88000K-94620KAWS Bedrock | AWS EKS | AWS Lambda | AWS OpenSearch | AWS TextractFuneral assistance | Home office stipend | Internet allowance | Life insurance | Paid time offSenior-level Full TimeBogotá, Colombia R4d ago
-
Senior Applied Scientist COP 88000K-94620KAWS | AWS AgentCore | AWS Bedrock | AWS Lambda | AWS TextractFuneral assistance | Home office stipend | Internet allowance | Life insurance | MentorshipSenior-level Full TimeBogotá, Colombia R4d ago
-
Data Quality Assurance Engineer (Temporary) COP 36000K-36000KALM | Apache Airflow | Autosys | Case design | Cloud platformEntry-level Full Time TemporaryBogotá, Bogota, Colombia4d ago
-
Fairlead - Lead Data Engineer COP 113244K-129420KBigQuery | Cloud Functions | Cloud Run | Cloud Storage | Cloud platformSenior-level Full TimeBogotá, CO, 1102316d ago
-
Senior-level Full TimeBogotá, CO, 1102316d ago
-
Ingeniero de Datos Azure / Microsoft Fabric Semi Senior COP 70000K-83999KAzure Data | Azure Data Factory | Data Factory | Databricks | Delta LakeCareer development | Full-time employment | Remote workSenior-level Full TimeBogotá, Colombia R6d ago
-
Apache Spark | Azure Synapse | DAX | Data Lake | Data ModelingBirthday day off | Life insurance | Prepaid medicine | Work from homeMid-level Full TimeColombia, United States R7d ago
-
Analista BI & GenAI COP 66000K-78000KAccess Control | Azure | Azure Data | Azure Data Factory | Azure SynapseSenior-level Full TimeBogotá, Colombia7d ago
-
Senior Data Engineer COP 90840K-102180KApache Spark | CI/CD | CTE | DBT | Databricks SQLRemote workSenior-level Full TimeColombia7d ago
-
Mid-level Full TimeColombia8d ago
-
Agent Orchestration | Amazon Neptune | Asynchronous Communication | D3.js | Data VisualizationAsynchronous collaboration | Professional growth opportunities | Remote work supportSenior-level Full TimeMexico - Monterrey R10d ago