Azure Data Lake (ADLS) Data Platform Specialist
COP 50004K-54000K (estimate) Mid-level Full Time
Tasks
- Build azure data factory etl elt pipelines
- Design Azure Data Lake Storage Gen2 architecture
- Design data ingestion pipelines
- Develop data transformation and storage standards
- Implement data governance, security, and access controls
- Implement data lifecycle management and indexing
- Implement medallion bronze silver gold layers
- Integrate ADLS with Azure Synapse Analytics Databricks and Power BI
- Integrate batch and streaming data
- Manage data quality lineage and metadata
- Monitor pipeline performance and troubleshoot issues
- Optimize cost vs performance in Azure
- Optimize data storage partitioning and performance
- Support data modeling and availability
Perks/Benefits
- Continued education support
- Employee recognition program
- Flexible working
- Healthcare
- Learning and development
- Retirement plans
- Sustainability Opportunities
- Volunteer opportunities
Skills/Tech-stack
Access Control | Access Control Lists | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Governance | Data Lake Storage | Data Lifecycle Management | Data Lineage | Data Modeling | Data Quality | Data lifecycle | Databricks | ELT | ETL | IAM | Indexing | Lifecycle Management | Metadata Management | Partitioning | Power BI | Power Query | Python | RBAC | SQL | Synapse Analytics
Education
N/A
Regions
Countries
States
Related jobs
-
#126318 - Senior Software Engineer COP 84000K-113000KAWS | Airflow | CI/CD | Databricks | HTMLContract role | Remote workSenior-level Contract Full TimeBogotá, Bogota, Colombia R1d ago
-
APIs | AWS | Data Infrastructure | Distributed Systems | GCPRemote workSenior-level Full TimeBrazil R6d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Flexible work location | Fully remoteSenior-level Contract Full TimeColombia R8d ago
-
Analytics Engineer COP 111600K-127200KAWS | Amazon Redshift | Azure | BigQuery | Cloud DataCareer development resources | Indefinite term contract | Remote work | Wellbeing programsMid-level Full TimeBogota, Colombia R8d ago
-
Forward Deployment Engineer COP 113244K-129420KAPI Keys | APIs | Authentication | CI/CD | Code platformsCareer growth | Remote workSenior-level Full TimeColombia - Remote R8d ago
-
Mid Machine Learning Engineer USD 145K-190KAWS SageMaker | Airflow | Azure Machine Learning | DBT | GitRemote workSenior-level Full TimeBolivia; Colombia; Costa Rica; Peru R9d ago
-
Agentic AI Engineer COP 240000K-312000KAPI Integration | APIs | Agent Orchestration | Agile methodologies | Anthropic APICareer advancement | Dental insurance | Health savings account contributions | Hybrid work options | Learning and developmentEntry-level Full TimeBogotá R9d ago
-
Freelance Senior Data Engineer COP 113244K-144000KAgile | Data Quality | Digital measurement | Event Tracking | Google AnalyticsFreelance contract | Remote workSenior-level FreelanceColombia R9d ago
-
Senior Data Engineer COP 49200K-49200KApache Airflow | BigQuery | Cloud Composer | Cloud platform | Google CloudCareer path mentorship programs | Collaborative work environment | Hybrid work | International customer exposure | Professional developmentSenior-level Full TimeColombia R10d ago
-
Backpressure handling | Chunking | Cloud platform | Cloudflare Queues | Cloudflare WorkersCompetitive pay | Growth opportunities | Remote workSenior-level Full TimeSouth Africa - Cape Town R13d ago
-
AWS | Autogen | Azure | Chroma | CrewAICareer growth opportunities | Competitive pay | Employer vetted recruitment | Remote workMid-level Full TimeColumbia - Bogotá R13d ago
-
AI Solutions Engineer COP 66000K-90000KAI Agents | APIs | Artificial Intelligence | Azure | C#Annual review and appraisal process | Flexible work hours | Health insurance | Holiday extra pay | Mental health daysSenior-level Full TimeColombia - Remote R14d ago
-
AI Analytics Engineer COP 89364K-94620KAI orchestration | Airflow | Anomaly Detection | BigQuery | DBTEquity | Health benefitsSenior-level Full TimeColombia R14d ago
-
Data Engineer (CRM) USD 85K-97KApache Airflow | Cloud platform | DBT | Data Governance | Data ModelingAgile team collaboration | English communication environment | Remote workMid-level Full TimeBrazil / Colombia / Argentina / … R15d ago
-
Sr Analyst, Business Operations Support COP 27600K-113000KAgile | Apache Airflow | Apache Hadoop | Apache Kafka | Apache SparkHybrid work | Work-life flexibilitySenior-level Full TimeBogota, Colombia R15d ago
-
Data QA Engineer – Enterprise Data | Colombia COP 60000K-72000KApache JMeter | Database Indexing | ELT | ETL | Execution PlansPaid time off | Remote work | Work with autonomy | Work with top companiesMid-level Full TimeBogota R15d ago
-
DevOps Engineer COP 89364K-98400KAWS | Ansible | Automation | Bash | CI/CDAgile work environment | Remote workSenior-level Full TimeColombia R15d ago
-
Data Visualization Engineer SAP AC/BO Sr COP 70000K-90000KAnalytics | Analytics Cloud | Analytics designer | Augmented analytics | Business IntelligenceHybrid work | Remote workMid-level Full TimeColombia R16d ago
-
Senior Analytics Engineer COP 113244K-125000KCause analysis | DBT | Data Modeling | Data Monitoring | Data QualityMentorship | Opportunity for growth and impact | Remote work during US business hours | Travel for team/offsitesSenior-level Full TimeBogotá, Colombia R17d ago
-
Machine Learning Engineer COP 18000K-18000KBigQuery | Data Pipelines | HuggingFace Transformers | LLM-Ops | Machine LearningHybrid workMid-level Full TimeBogotá,Colombia R17d ago
-
Senior AI Engineer COP 95420K-101090KAWS | Amazon Textract | Confidence scoring | Data Validation | Document AISenior-level Full TimeColombia R17d ago
-
Lead Applied Scientist, Marketing COP 72000K-73200KAWS | Adtech | Collaborative Filtering | Content-Based Filtering | Content-basedSenior-level Full TimeBarranquilla, Colombia (remote); Bogota, Colombia (remote); … R22d ago
-
Data Engineer COP 39600K-39600KAWS Glue | AWS Step Functions | Amazon Athena | Amazon S3 | Batch IngestionAt home medical assistance | Christmas kit | Day off for academic graduation | Family day | Forgivable education loansMid-level Full TimeBogotá, Bogota, Colombia R22d ago
-
Senior AI Engineer (LLMs & Agentic AI) COP 89364K-94620KAgentic AI | Anthropic API | CI/CD | Context Management | GPU AccelerationConfidentiality per EEO guidelines | Remote work with overlapping business hoursSenior-level Full TimeBogotá, Bogota, Colombia R22d ago
-
Data Engineer USD 66K-81KAWS | Airflow | Amazon Redshift | Azure | BigQueryFlexible U S overlapping hours | Fully remote | Long-term contractSenior-level Contract Full TimeColombia - Remote R23d ago