Lead Spark Data Engineer
Colombia - Remote
R
Senior-level Contract Found 12d ago
Tasks
- Build Query Validator
- Design scalable data solutions on Spark and Flink
- Develop Spark Adapter for metrics translation
- Enforce data governance, security, and quality practices
- Ensure parity between Spark and Flink implementations
- Implement IoT Query Language grammar
- Implement relationships logic using Graph/Ontology
- Maintain documentation
- Manage Azure and Databricks resources
- Monitor and optimize workloads
- Participate in agile activities
- Transform and prepare data with SQL, Python, Java
Perks/Benefits
- N/A
Skills/Tech-stack
ANTLR | Agile methodologies | Apache Flink | Apache Spark | Artifact management | Azure DevOps | Azure ecosystem | CI/CD | Data Governance | Data Modeling | Data Quality | Data Security | Data Warehousing | Databricks | Delta Lake | GitHub | Graph/Ontology | Java | Python | SDLC | SQL
Education
Roles
Regions
Countries
States
Language: en |
Views: 1 |
Clicks: 0
Related jobs
-
AWS | Agent Frameworks | CI/CD | Containerization | Data ProcessingSenior-level Full TimeColombia - Remote R5d ago
-
AI/ML | API Integration | Agile methods | Azure | Backend DevelopmentCollaborative environment | Exposure to GenAI delivery | Impactful AI solutions | Learning alongside senior engineersSenior-level Full TimeBogota, Colombia (Remote Friendly) R5d ago
-
AWS | Airflow | Automation | Bash | CDKCompetitive USD pay | Paid time off | Projects with US industry-leading companies | Remote work | Work with autonomySenior-level Full TimeBogota R8d ago
-
Azure | DBT Cloud | Data Engineering | Data Modeling | Data PipelinesAutonomy | Competitive pay | Paid time off | Remote work | Team with professionalsSenior-level Full TimeBogota R9d ago
-
Senior-level ContractColombia - Remote R9d ago
-
AI Engineer COP 40000K-60000KAI systems | Cloud infrastructure | Communication | Data Processing | DebuggingAccess to advanced AWS resources | Collaboration with experienced engineers | Hands-on cloud-native delivery | Partnership with AWS | Professional growth opportunitiesMid-level Full TimeBogota, Colombia (Remote Friendly) R9d ago
-
API | Agile | Airflow | CloudInfrastructure | Cost OptimizationCollaborate with U.S. companies | Competitive USD pay | Paid time off | Remote work | Work autonomySenior-level Full TimeBogota R10d ago
-
Senior-level Full TimeHybrid, Bogotá, Colombia R11d ago
-
AI | AWS | Airflow | CDK | CI/CDAutonomy | CompetitiveUSDpay | PaidTimeOff | RemoteWork | TeamCollaborationSenior-level Full TimeBogota R11d ago
-
AWS | Airflow | Amundsen | Athena | BigQueryBonuses | Growth environment | Impactful projects | Professional development supportMid-level Full TimeMedellín, Antioquia, Colombia R13d ago