Lead Spark Data Engineer
Mexico - Remote
R
MXN 721K-900K (estimate) Senior-level Contract Found 12d ago
Tasks
- Architect data solutions on Spark and Flink
- Build Query Validator
- Develop Spark Adapter
- Enforce data governance and security practices
- Ensure logic parity between Spark and Flink
- Implement IoT Query Language grammar
- Implement relationships logic
- Maintain documentation
- Manage Azure and Databricks resources
- Monitor and optimize workloads
- Participate in agile activities
- Transform and prepare data with SQL, Python, Java
Perks/Benefits
- N/A
Skills/Tech-stack
ANTLR v4 | Abstract syntax trees | Apache Spark | Apache Spark internals | Artifact management | Azure AD | Azure DevOps | CI/CD | Compliance | Custom DSLs | Data Design | Data Modeling | Data Warehousing | Databricks | Delta Lake | Encryption | GitHub | Graph/Ontology | Graph/Ontology traversal | Java | Parsers | Python | SQL | Spark internals
Education
N/A
Roles
Language: en |
Views: 1 |
Clicks: 0
Related jobs
-
Full Stack Software Engineer, Dash Experiences MXN 1040K-1300KAI Technologies | AI integration | API Development | Application development | Backend DevelopmentCollaboration culture | Impactful product development | Opportunities to learn and growMid-level Full TimeRemote - Mexico R1d ago
-
AI Development | API Integration | AWS | Anthropic Claude | Autonomous decision systemsCertified great place to work | Courses and certifications | Day off on birthday | English classes | Growth opportunitiesSenior-level Full TimeMexico - Remote R3d ago
-
AWS | Automation | Azure | Bash | CircleCIFast-paced environment | Growth opportunities | International projects | Remote workMid-level Full TimeMexico City, Mexico City, Mexico - … R4d ago
-
AI | Computational Algorithms | Machine Learning | NumPy | Numerical MethodsFlexible schedule | Impact on AI development | Project experience | Remote workMid-level FreelanceMexico - Remote R5d ago
-
AI orchestration | API Development | API Integration | AWS | Async ProgrammingBirthday day off | Career growth opportunities | Courses and certifications | English classes | Global brand exposureSenior-level Full TimeMexico - Remote R5d ago
-
FBS Data Engineer (Javascript, SQL experience) MXN 721K-1001KAPI Development | Agile | Artificial Intelligence | Batch Processing | Data GovernanceComprehensive benefits | Flexible work options | Health insurance | Paid time off | Performance bonusesSenior-level Full TimeMexico - Remote R5d ago
-
Senior Infrastructure Engineer (AWS) - Technology MXN 1040K-1410KAWS | Airflow | Automation | Bash | CDKAutonomy | Competitive USD pay | Paid time off | Remote work | Work with top US companiesSenior-level Full TimeMexico City R8d ago
-
Azure | Business Intelligence | Cloud Storage | DBT Cloud | Data AnalysisAutonomy | Paid time off | Remote work | USD pay | Work with top US companiesSenior-level Full TimeMexico City R9d ago
-
Senior-level ContractMexico - Remote R9d ago
-
API Integration | AWS | Alerts | Automation | CI/CDCourses and certifications | English classes | Global Brand Access | Great Place to Work certified | International teamsMid-level Full TimeMexico - Remote R9d ago
-
Senior Data Engineer (LATAM Remote) MXN 1040K-1474KAzure | Cloud Platforms | Data Pipelines | Data Transformation | Data WarehousingRemote workSenior-level Full TimeRemote, Guadalajara, Mexico R9d ago
-
Senior Software Automation Engineer (AI & IT Systems) MXN 1040K-1300KAI | APIs | Automation | CI/CD | Code QualityCollaboration | Development opportunities | Flexible work environment | Innovation cultureSenior-level Full TimeRemote, MX R9d ago
-
APIs | AWS | Agile | Airflow | CI/CDAutonomy | Competitive USD pay | Paid time off | Remote work | Work with top US companiesSenior-level Full TimeMexico City R10d ago
-
Senior-level Full TimeMonterrey, Mexico R10d ago
-
Data Architecture | Data Migration | Data Processing | Data integration | DatabricksCareer growth opportunities | Cultural teams | Events and meetups | Global brands | Language classesSenior-level Full TimeMexico City, Mexico - Remote R11d ago
-
Staff Data Engineer MXN 1040K-1300KAWS | Apache Hadoop | Apache Spark | Automation | AzureCell phone stipend | Healthcare | Internet reimbursement | Learning stipend | Travel opportunitiesSenior-level Full TimeRemote, Mexico R11d ago
-
Lead Flink Data Engineer IoT MXN 721K-721KApache Flink | Azure Data | Azure Data Engineer | Azure Data Services | Azure DevOpsSenior-level ContractMexico - Remote R12d ago
-
Data Engineer (BI) MXN 554K-600KAI/ML | Cloud Environments | Data Architecture | Data Automation | Data ModelingHolidays | Insurance (medical, life, funeral) | Language classes | Laptop policy | Maternity leaveSenior-level Full TimeMexico - Remote R12d ago