Data Engineer – Web Scraping, LLM Pipelines and Scalable Data Infrastructure
Tasks
- Build structured datasets
- Create LLM evaluation frameworks
- Define database schemas
- Design scalable data architectures
- Develop ETL pipelines
- Improve reliability observability and deployment workflows
- Parse clean and transform content
Perks/Benefits
- N/A
Skills/Tech-stack
API | AWS | Airflow | BigQuery | Docker | ETL | FastAPI | GCP | LLM Pipelines | Playwright | PostgreSQL | Scrapy | Supabase | Web Scraping
Education
N/A
Roles
Related jobs
-
Access Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Company-sponsored coursework | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeZapopan, Jalisco, Mexico R1d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Conference attendance | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeSan Luis Potosi, Mexico R1d ago
-
Access Control | Agile | Azure Data | Azure Data Factory | Azure Data LakeCompany Sponsored Coursework Exams and Certifications | Continuing education | Flexible working hours | Paid time off | Remote workSenior-level Full TimePuebla City, Mexico R1d ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Continuing education | Flexible working hours | Paid time off | Remote workSenior-level Full TimeMexico City, Mexico R1d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany Sponsored Coursework Exams and Certifications | Continuing education training conferences | Flexible working hours | Paid time off | Remote workSenior-level Full TimeMexicali, Baja California, Mexico R1d ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany-sponsored certifications | Conference attendance | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeGuadalajara, Jalisco, Mexico R1d ago
-
Access Control | Agile | Azure | Azure Data | Azure Data FactoryCompany-sponsored certifications | Company-sponsored coursework | Conference attendance | Continuing education | Flexible working hoursSenior-level Full TimeGuadalupe, Nuevo León, Mexico R1d ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany sponsored certifications exams and coursework | Conference opportunities | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeChihuahua City, Mexico R1d ago
-
Senior AI Engineer - Generative AI & LLMs - México Only MXN 444K-456KAI Agents | Amazon Web Services | Azure | CI/CD | Cloud platformAccess to courses and certifications | English classes | Home office | Life insurance | Medical insuranceSenior-level Contract Full TimeMexico - Remote R1d ago
-
Analytics Associate Director, GOC MXN 380K-420KAdobe Analytics | Amazon Redshift | Amazon Web Services | Azure DevOps | Business IntelligenceDental insurance | Employee Learning and Development | Employee resource groups | Medical insurance | Mental Health Awareness DaysMid-level Full TimeBarranquilla, Colombia; Bogota, Colombia; Medellin, Colombia; … R1d ago
-
Entry-level Full TimeMexico, Remote R1d ago
-
Mid-level Full TimeMexico R1d ago
-
Mid-level Full TimeMexico R1d ago
-
App Maint Engineer BackEnd SQL/ETL Sr MXN 276K-300KAzure SQL | Data integration | Database Modeling | Deadlock Resolution | ETLHybrid work | L3 supportMid-level Full TimeMéxico R1d ago
-
Senior Data Engineer – Data Quality & Observability |1789 MXN 911K-1300KAlerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLCross-functional collaboration | Fully remote | Opportunity for ownershipSenior-level Full TimeChihuahua, Mexico R1d ago
-
Data Engineer MXN 720K-800KAWS | Apache Airflow | Azure | Azure Data | Azure Data FactoryFluent English working environment | Quarterly travel to United States | Remote workSenior-level Full TimeMexico - Remote R2d ago
-
API | Anthropic | Claude | Gemini | JSONRemote work flexibility | U.S. business hoursSenior-level Full TimeMexico - Remote R2d ago
-
Senior-level Full TimeRemote, Guadalajara R2d ago
-
AI Engineer II - Marketing USD 39K-72KAPI Development | AWS | Backend Development | CI/CD | DockerRemote workMid-level Full TimeMexico, Remote R2d ago
-
Ingeniero de Datos AbInitio Proficient MXN 420K-420KAb Initio | Agile | Data Architecture | Data Modeling | Data ProcessingMid-level Full TimeMexico R2d ago
-
Data Engineer USD 120K-147KAWS | Apache Airflow | Apache Spark | Azure | Batch ProcessingFully remote | Professional growth opportunitiesMid-level Full TimeBrazil R2d ago
-
Mid-level Full TimeMexico, Remote R2d ago
-
Sr Clojure Backend Software Engineer MXN 911K-1300KClojure | ClojureScript | LLM APIs | PostgreSQL | Prompt engineeringSenior-level Full TimeRemote, Mexico R3d ago
-
FBS Data Engineer MXN 789K-1080KAccess Controls | Amazon Redshift | Audit trails | CCPA | DBTComprehensive benefits package | Flexible work arrangements | Paid time off | Private health insurance | Remote workSenior-level Full TimeMexico - Remote R3d ago
-
[GenAI] Sênior Software Engineer - híbrido Florianópolis MXN 101K-101KAWS | Azure | CD | CI | CI/CDChildcare assistance | Dental insurance | Education benefit | Emotional support | Fuel allowanceMid-level Full TimeFlorianopolis, Santa Catarina, Brasil R3d ago