Microsoft Fabric Data Engineer
Medellín, Antioquia, Colombia
A COP 60000K-89988K (estimate) Senior-level Full Time
Tasks
- Build data migration pipelines
- Collaborate with stakeholders
- Design ingestion solutions
- Develop PySpark transformations
- Develop T-SQL transformations
- Implement Medallion Architecture pipelines
- Implement data validation and reconciliation
- Migrate SQL Server and Azure SQL to Microsoft Fabric
- Optimize query performance
- Optimize spark job performance
- Perform schema mapping
- Run data quality checks
- Use source control and deployment automation
- Validate row counts
Perks/Benefits
- N/A
Skills/Tech-stack
AI Services | Azure AI | Azure AI Services | Azure DevOps | Azure SQL | Azure Security | Data Factory | Data Migration | Data Quality | Data Reconciliation | Data Validation | Dataframes | Distributed Computing | Fabric Data Factory | Fabric Lakehouse | Fabric Pipelines | Fabric Warehouse | GitHub Copilot | Medallion Architecture | Microsoft Fabric | Microsoft Fabric Data Factory | Microsoft Fabric Lakehouse | Microsoft Fabric Warehouse | PySpark | Row Count Validation | SQL | SQL Server | Schema mapping | Spark | Spark Notebooks | T-SQL
Education
N/A
Regions
Countries
States
Related jobs
-
Java + Data Technical Leader COP 18000K-18000KAPI Design | AWS | Agile | Apache Kafka | Apache SparkCareer development opportunities | Challenging multicultural environment | International projects | Training opportunitiesSenior-level Full TimeBogotá, Bogota, Colombia1d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Spark | AzureRemote workMid-level Full TimeSouth Africa - Cape Town1d ago
-
AWS | Azure | BigQuery | DVC | DaskCompetitive pay | Growth opportunities | Remote workMid-level Full TimeColumbia - Bogotá1d ago
-
Senior-level Full TimeMexico-Remote, Colombia-Remote R1d ago
-
AWS EKS | Agent Orchestration | Azure DevOps | Azure Kubernetes | Azure Kubernetes ServiceSenior-level Full TimeBogotá, Bogotá, Colombia2d ago
-
AWS | Amazon Web Services | CI/CD | Data Quality | DatabricksOn-call support | Remote workSenior-level Contract Full TimeColombia - Remote R2d ago
-
AI Engineer II (Remote) USD 39K-72KAWS | CI/CD | Docker | Embeddings | GolangFull-time position | Remote workMid-level Full TimeBogota, Colombia R4d ago
-
Senior Data Engineer (Snowflake) COP 78000K-89988KAWS | Azure | Data Migration | Data Modeling | Data PipelinesCareer coaching | Employee assistance programme | Flexible working hours | Hybrid work | Internal tech communitiesSenior-level Full TimeCali, Valle del Cauca, Colombia4d ago
-
Senior Data Engineer (Snowflake) COP 78000K-89988KAWS | Agile | Azure | Data Migration | Data QualityCareer coaching | Employee assistance programme | Flexible working hours | Global career opportunities | Hybrid workSenior-level Full TimeBogotá, Bogota D.C., Colombia4d ago
-
Senior Data Engineer (Snowflake) COP 78000K-89988KData Modeling | ETL | Microsoft SQL | Microsoft SQL Server | Microsoft SSISCareer coaching | Employee assistance program | Flexible working hours | Hybrid work | Internal tech community participationSenior-level Full TimeMedellín, Antioquia, Colombia4d ago
-
Sr. Data Engineer (Snowflake/dbt) USD 165K-216KAWS | Access Control | Airflow | Azure | ClusteringCertification programs | Fully remote | MentorshipSenior-level Full TimeRemote (Mexico); Remote (Uruguay); Remote (Chile); … R5d ago
-
Senior Data Engineer COP 78000K-89988KAzure | Azure Databricks | CI/CD | DBT | Data EngineeringRemote workSenior-level Full TimeColombia5d ago
-
API Integration | AWS | Data Modeling | Data Pipelines | PythonRemote workSenior-level Full TimeColombia5d ago
-
API Integrations | Amazon Web Services | Anomaly Detection | Apache Airflow | Asynchronous MessagingContinuous learning and training | Technical growthSenior-level Contract Full TimeColombia - Remote R6d ago
-
Cloud Computing | Computer Vision | Data Quality | Data labeling | Image ProcessingEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsEntry-level Full TimeMedellín, Colombia7d ago
-
Annotation | Cloud Computing | Computer Vision | Data Quality | Image ProcessingEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsEntry-level Full TimeVillavicencio, Colombia7d ago
-
Agile | Airflow | BigQuery | Data Pipelines | GCPHybrid work modelEntry-level Full TimeBogota, DC, CO R7d ago
-
Data Engineer- Sctotiatech COP 42000K-42000KAPI Development | Agile | Airflow | Amazon Redshift | Apache SparkCompetitive benefits | Inclusive work environmentMid-level Full TimeBogota, DC, CO7d ago
-
Senior-level Full TimeBogotá, Bogota, Colombia7d ago
-
API Design | API performance | API performance optimization | Big Data | Continuous DeliveryHybrid workSenior-level Full TimeBogotá,Colombia8d ago
-
AI Productionization | APIs | Batch Processing | BigQuery | Cause analysisInternational travel | Remote workSenior-level Full TimeSão Paulo, Brazil8d ago
-
Senior-level Full TimeBogota, Colombia(Remote Friendly) R10d ago
-
Data Analysts / QA COP 60000K-86000KData Lineage | Data Quality | Data Reconciliation | Data Validation | Data profilingCompany-provided equipment | English lessons | Flexible working options | Learning opportunities | Mentorship programsMid-level Full TimeBogotá, Bogota, Colombia11d ago
-
Data Consultant COP 27600K-216000KAgile | Alation | Apache Spark | Azure Blob | Azure Blob StorageCareer coaching | Employee assistance programme | Flexible working hours | Hybrid work | Online learning subscriptionsSenior-level Full TimeCali, Valle del Cauca, Colombia11d ago
-
Data Consultant COP 27600K-216000KAgile Scrum | Alation | Apache Spark | Azure Blob | Azure Blob StorageCareer coaching | Conferences | Employee assistance programme | Flexible working hours | Hybrid workSenior-level Full TimeBogotá, Bogota D.C., Colombia11d ago