Ingeniero PySpark
Tasks
- Apply development best practices version control and documentation
- Automate and improve data platforms
- Design ETL/ELT processes
- Design data architectures and big data solutions
- Develop data processing pipelines
- Implement data validation cleaning and transformation
- Integrate data from databases APIs and files
- Monitor and troubleshoot data pipelines
- Optimize Spark jobs
- Process structured and unstructured data
- Transform large volume data
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Amazon EMR | Amazon Web Services | Apache Airflow | Apache Spark | Avro | Azure | Azure Databricks | Azure Synapse | Azure Synapse Analytics | CI/CD | CSV | Cloud platform | Databricks | Docker | ELT | ETL | Git | Google Cloud | Google Cloud Platform | JSON | Linux | NoSQL | Parquet | PySpark | Python | Relational databases | SQL | Synapse Analytics | Unix | Web Services
Education
N/A
Roles
Related jobs
-
Data Architect / Engineer MXN 950K-1250KAirflow | Change Data Capture | Cloud Data | Cloud Data Services | Data CaptureSenior-level Full TimeSan José, Medellin, Bogota, Mexico City, …1d ago
-
Executive-level Full TimeMexico City, Mexico City, Mexico; Mexico, …1d ago
-
Manager/ Sr. Manager - Analytics Consulting MXN 789K-990KCloud Platforms | HDFS | Hadoop | Hive | Machine LearningCareer development opportunities | High individual responsibility | Small, fast-growing environmentSenior-level Full TimeMexico City, Mexico - Remote R1d ago
-
Bash | Data Processing | Docker | GCP | LinuxMid-level Full TimeMonterrey, Mexico1d ago
-
Mid-level Full TimeRemote - Mexico R2d ago
-
Senior-level Full TimeCiudad de México, CDMX, MX R3d ago
-
Analytics Engineer MXN 405K-485KAccounting | Accruals | BI Dashboard | BigQuery | Data QualityCatered lunches | Co-working travel perk | Disability insurance | Health insurance | Home office equipment allowanceMid-level Full TimeMexico City, CDMX3d ago
-
Data Visualization Engineer PowerBI Sr MXN 660K-986KAttributes | Business Intelligence | Cubes | Data Modeling | LookerAdvanced English language environment | Hybrid workSenior-level Full TimeMexico R3d ago
-
Senior Data Engineer MXN 950K-1300KDBT | Data Modeling | Data Pipeline Monitoring | Data Quality | Data pipelineFlexible work arrangements | Professional development opportunitiesSenior-level Full TimeRemote - Mexico R4d ago
-
Agent Orchestration | Amazon Neptune | Asynchronous Communication | D3.js | Data VisualizationAsynchronous collaboration | Professional growth opportunities | Remote work supportSenior-level Full TimeMexico - Monterrey R4d ago
-
AI Agent | AI Agent Frameworks | Agent Frameworks | Agent Orchestration | Amazon NeptuneAsynchronous collaboration | Remote workSenior-level Full TimeSouth Africa - Cape Town R4d ago
-
AWS | Amazon Redshift | Apache Spark | BigQuery | Cloud platformCompetitive pay | Growth opportunities | Remote workMid-level Full TimeColumbia - Bogotá R4d ago
-
ID 10049 | Data Modeler MXN 480K-492KAlation | Atlan | Clustering keys | Collibra | Cortex AIEnhanced legal benefits | Learning and development programs | Life insurance | Meal vouchers | Medical insuranceSenior-level Full TimeMonterrey, N.L., Mexico4d ago
-
ID 10048 | Data App Engineer MXN 480K-480KAzure DevOps | CI/CD | CTE | Code-splitting | Cortex AIFood vouchers | International project growth opportunities | Life insurance | Medical expenses insurance | Professional development platform accessSenior-level Full TimeMonterrey, N.L., Mexico4d ago
-
ID 10047 | Data Ingestion Engieer MXN 456K-480KApache Airflow | Attribute Views | Azure Data | Azure Data Factory | Calculation viewsInternational projects | Life insurance | Meal vouchers | Medical insurance | Performance recognitionSenior-level Full TimeMonterrey, N.L., Mexico4d ago
-
Mid-level Contract Full TimeMexico4d ago
-
API Testing | Application Insights | Asynchronous systems | Azure Application Insights | Azure OpenAI100% remote work | Flexible working environment | Hands On Modern Generative AI | Long-term engagementSenior-level Contract Full TimeMexico R4d ago
-
AI Foundry | AWS | AWS Bedrock | Agentic AI | Amazon SageMaker401k match | Career development | Dental insurance | Disability coverage | Flexible work arrangementsSenior-level Full TimeMexico4d ago
-
Senior Data Engineer - Databricks MXN 990K-1300KAWS | Apache Spark | Automation Scripting | CI/CD | Cost OptimizationEquipment and office stipend | Flexible PTO | Learning and development stipend | Paid Holidays | Paid exams and certificationsSenior-level Full TimeMEXICO R4d ago
-
Automation | Azure Data | Azure Data Explorer | CSV | Cloud SecurityCollaborative global working environment | Cross-functional collaboration | Exposure to large scale security telemetry | Opportunity to contribute to threat detection and incident response | Opportunity to develop automation and data quality solutionsMid-level Full TimeMexico R4d ago
-
AI / ML Engineer Lead MXN 900K-1100KAI Governance | AI Services | AI architecture | Agent Orchestration | Agentic AISenior-level Full TimeMexico City, Torre Arcos4d ago
-
Cloud Data Engineer- ONSITE CDMX MXN 420K-444KAgile | BigQuery | Cloud Composer | Data Pipelines | Data QualityContinuous learning | Employee networks | Internal academies | MentorshipMid-level Full TimeAguascalientes, MX4d ago
-
Lead Data Warehouse Operations Engineer (On-site, CDMX) MXN 660K-1080KAWS | Azure | BigQuery | Cause analysis | Cloud ComposerSenior-level Full TimeAguascalientes, MX4d ago
-
Data Engineer MXN 420K-420KApache Airflow | Apache Spark | CI/CD | Cypher | DBTCareer development plan | Long term contract stability | Training opportunitiesMid-level Full TimeMexico City, Mexico City, Mexico4d ago
-
AI Services | Agile | Automated testing | Azure AI | Azure AI ServicesMid-level Full TimeMexico City, México5d ago