Software Engineer, Data Infrastructure & Acquisition - São Paulo, Brazil
Tasks
- Build dataset roadmap for model training
- Collaborate with scientists on data collection cost throughput quality
- Develop Linux bash and Python scripts
- Extend cloud infrastructure for ingestion pipeline
- Find new audio data sources
- Ingest audio data into ingestion pipeline
- Integrate Terraform for infrastructure as code
- Operate ingestion pipeline infrastructure
- Support large-scale dataset creation
Perks/Benefits
- N/A
Skills/Tech-stack
Bash | Cloud platform | Data Ingestion | Data Processing | Docker | Google Cloud | Google Cloud Platform | Infrastructure as Code | Large Scale Data | Large-scale | Large-scale Data Processing | Linux | Python | Terraform | Web Crawling | “as-code”
Education
Roles
Related jobs
-
AWS | Apache Airflow | Azure | Cloud platform | DBTContinuous learning opportunities | Flexible work arrangements | Office work options | Paid time off | Private health insuranceMid-level Full TimeBrazil3h ago
-
AI Engineer USD 125K-197KAgentic Architectures | Langchain | Language Models | Large Language Models | Model OrchestrationMid-level Full TimeCanada1d ago
-
Data Scientist / Machine Learning Engineer USD 110K-133KAWS SageMaker | Agile | Apache Airflow | Azure Machine Learning | DBTEnglish communication | Remote workMid-level Full TimeBrazil / Colombia / Costa Rica … R1d ago
-
AWS Glue | AWS Step Functions | Amazon Athena | Amazon S3 | Apache AirflowChildcare support | Dental insurance | Extended parental leave | Gympass | Health insuranceMid-level Full TimeBrazil2d ago
-
Data Analyst, Product GBP 95K-124KA/B | A/B Testing | Analytical Functions | Apache Airflow | B testingSenior-level Full TimeUnited Kingdom2d ago
-
Databricks | ELT | ETL | Power Apps | Power AutomateBirthday day off | Birthday recognition | Collaborative inclusive environment | Dental insurance | Gym membershipEntry-level Full TimeSão Paulo, SP, Brazil2d ago
-
Analista de Dados Pleno BRL 60K-60KDashboard Development | Data Governance | Data Modeling | Data Quality | Data integrationDental insurance | Education Partner | Gym membership | Life insurance | Meal vouchersMid-level Full TimeCampinas, Brazil2d ago
-
Apache Spark | Autoloader | Data Governance | Data Quality | DatabricksMid-level Full TimeSão Paulo, Brazil2d ago
-
APIs | Attribution Modeling | Campaign Optimization | Causal Inference | ClusteringAccess to diverse client datasets | Collaborative team environment | Hybrid work model | Knowledge sharing | Opportunities for challenging projectsMid-level Contract FreelanceBrazil2d ago
-
Forward Deployed Engineer, Enterprise AI [LATAM] BRL 319K-396KAWS | Automated testing | Cloud Computing | Cloud platform | ComplianceSenior-level Full TimeSão Paulo, Brazil2d ago
-
Forward Deployed Engineer, Enterprise AI [LATAM] BRL 234K-295KAI | API Design | AWS | Cloud Computing | Cloud platformSenior-level Full TimeSão Paulo, Brazil2d ago
-
AWS | Apache Airflow | Apache Spark | Azure | Azure DataBirthday day off | Casual dress code | Dental insurance | Educational partnerships | Extended maternity and paternity leaveSenior-level Full TimeBrazil2d ago
-
Adversarial Testing | Artificial Intelligence | Bias Assessment | Experiment tracking | Hallucination detectionContract based opportunity | Opportunity to work on advanced AI systems | Remote work flexibilitySenior-level Contract Full TimeBrazil R3d ago
-
Cloud infrastructure | Containerization | Docker | GPU Computing | KubernetesCareer growth in AI infrastructure | Four-day work week | Fully remote | Global team collaboration | Open communication inclusive cultureSenior-level Full TimeBrazil R3d ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Opportunity to work on AI and audio product | Remote friendly distributed work environment | Supportive team environmentMid-level Full TimeRecife, Brazil3d ago
-
AWS Textract | Autogen | Azure Form Recognizer | CI/CD | Computer VisionBirthday day off | Childcare assistance | Cultural partnerships | Dental insurance | Family support for new parentsSenior-level Full TimeBrazil R3d ago
-
Data Engineer BRL 216K-275KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Data IngestionWork from homeSenior-level Full TimeBrazil3d ago
-
Arquitetura de Dados e IA | Remota - 134857 BRL 119K-119KAWS Glue | AWS SageMaker | Agile | Amazon Athena | Amazon EMRRemote workSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0003d ago
-
Engenharia de Dados AWS (Pleno/Sênior) | Remota - 134904 BRL 120K-120KAWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step FunctionsRemote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0003d ago
-
Engenharia de Dados AWS (Pleno/Sênior) | Remota - 134905 BRL 120K-120KAWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step FunctionsRemote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0003d ago
-
Engenharia de Dados AWS Sênior | Remota - 134936 BRL 120K-120KAWS Glue | AWS Lambda | AWS Step Functions | Amazon EventBridge | Amazon S3Collaborative team | Independent work | Problem solving support | Remote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0003d ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | Batch ProcessingEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapSenior-level Full TimeRecife, Brazil3d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | Batch Processing | CI/CD | DagsterEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeCampinas, Brazil3d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | CI/CD | Dagster | Data LineageEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBrasília, Brazil3d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | CI/CD | Dagster | Data Lineage | Data QualityEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRio de Janeiro, Brazil3d ago