Azure Data Lake (ADLS) Data Platform Specialist
COP 50004K-54000K (estimate) Mid-level Full Time
Tasks
- Build azure data factory etl elt pipelines
- Design Azure Data Lake Storage Gen2 architecture
- Design data ingestion pipelines
- Develop data transformation and storage standards
- Implement data governance, security, and access controls
- Implement data lifecycle management and indexing
- Implement medallion bronze silver gold layers
- Integrate ADLS with Azure Synapse Analytics Databricks and Power BI
- Integrate batch and streaming data
- Manage data quality lineage and metadata
- Monitor pipeline performance and troubleshoot issues
- Optimize cost vs performance in Azure
- Optimize data storage partitioning and performance
- Support data modeling and availability
Perks/Benefits
- Continued education support
- Employee recognition program
- Flexible working
- Healthcare
- Learning and development
- Retirement plans
- Sustainability Opportunities
- Volunteer opportunities
Skills/Tech-stack
Access Control | Access Control Lists | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Governance | Data Lake Storage | Data Lifecycle Management | Data Lineage | Data Modeling | Data Quality | Data lifecycle | Databricks | ELT | ETL | IAM | Indexing | Lifecycle Management | Metadata Management | Partitioning | Power BI | Power Query | Python | RBAC | SQL | Synapse Analytics
Education
N/A
Regions
Countries
States
Related jobs
-
Senior-level Full TimeAnywhere Colombia, Colombia R17h ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS EKS | Amazon S3 | Apache Airflow | Athena | BigQueryFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeVillavicencio, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAI Development | AI development tools | AWS Bedrock | Amazon EKS | Amazon S3Flexible hours | Internal TechTalks | Learning budget | Mentorship | People focused supportSenior-level Full TimeManizales, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Amazon Athena | Amazon S3 | Apache Airflow | BigQueryFlexible hours | Learning budget | Mentorship | Remote work | TechtalksSenior-level Full TimeMedellín, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Amazon Athena | Amazon EKS | Amazon S3 | Apache AirflowFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeCartagena, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Airflow | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Remote workSenior-level Full TimeCali, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Airflow | Athena | BigQuery | Claude CodeFlexible hours | Internal technical talks | Learning budget | Mentorship | People focused supportSenior-level Full TimeBarranquilla, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS | Airflow | Amazon Athena | Amazon S3 | Apache SparkAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimePereira, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAWS Athena | Airflow | Amazon S3 | Apache Spark | BigQueryAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeBucaramanga, Colombia R2d ago
-
Lead Data Engineer ID71008 COP 84000K-94620KAmazon EKS | Amazon S3 | Apache Airflow | Apache Parquet | AthenaAnnual learning budget | Flexible hours | Internal technical talks | Mentorship | People focused supportSenior-level Full TimeBogota, Colombia R2d ago
-
Lead Applied Scientist, Marketing COP 72000K-73200KAWS | Adtech | Collaborative Filtering | Content-Based Filtering | Content-basedSenior-level Full TimeBarranquilla, Colombia (remote); Bogota, Colombia (remote); … R2d ago
-
Data Engineer COP 39600K-39600KAWS Glue | AWS Step Functions | Amazon Athena | Amazon S3 | Batch IngestionAt home medical assistance | Christmas kit | Day off for academic graduation | Family day | Forgivable education loansMid-level Full TimeBogotá, Bogota, Colombia R2d ago
-
Senior AI Engineer (LLMs & Agentic AI) COP 89364K-94620KAgentic AI | Anthropic API | CI/CD | Context Management | GPU AccelerationConfidentiality per EEO guidelines | Remote work with overlapping business hoursSenior-level Full TimeBogotá, Bogota, Colombia R2d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Data CatalogAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workMid-level Full TimeBarranquilla, Colombia R2d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportMid-level Full TimeManizales, Colombia R2d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Data CatalogAnnual learning budget | Flexible hours | Mentorship | Remote work | Supportive cultureMid-level Full TimeVillavicencio, Colombia R2d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Flexible hours | Learning budget | Mentorship | People focused support | Remote workMid-level Full TimeBucaramanga, Colombia R2d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Internal tech talks | MentorshipMid-level Full TimeMedellín, Colombia R2d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Mentorship | Remote work | Well-being programsMid-level Full TimeBogota, Colombia R2d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Challenging projects | Flexible hours | Mentorship | Remote workMid-level Full TimeCali, Colombia R2d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access control RBAC | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportMid-level Full TimeCartagena, Colombia R2d ago
-
Data Engineer ID80135 COP 70000K-90000KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Flexible hours | Internal tech talks | Learning budget | Mentorship | People focused supportMid-level Full TimePereira, Colombia R3d ago
-
Data Engineer USD 66K-81KAWS | Airflow | Amazon Redshift | Azure | BigQueryFlexible U S overlapping hours | Fully remote | Long-term contractSenior-level Contract Full TimeColombia - Remote R3d ago
-
AI-Assisted Software Engineer, Web Applications COP 82000K-113000KAPI Design | Agile | Asana | Automated testing | CI/CDSenior-level Contract Full TimeMedellín, Medellin, Colombia - Remote R3d ago
-
Senior Data Engineer (Snowflake/SQL) - Software Industry COP 58800K-58800KAWS Aurora | AWS DMS | AWS Data | AWS Data Migration | AWS Data Migration ServicePaid time off | Remote work | Work autonomySenior-level Full TimeBogota R3d ago