Analista de Engenharia de Dados II - Vaga Afirmativa para Mulheres
Tasks
- Build data ingestion pipelines
- Collaborate with business and analytics teams to ensure secure data availability
- Create documentation for data pipelines
- Develop and optimize Spark Structured Streaming jobs
- Implement data quality
- Maintain Delta Lake tables
- Perform data cost and performance optimization
- Use Git for version control
- Write Spark SQL transformations
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Autoloader | Data Governance | Data Quality | Databricks | Delta Lake | ETL | Git | Python | Spark SQL | Spark Structured Streaming | Structured Streaming
Education
N/A
Roles
Related jobs
-
AWS Glue | AWS Step Functions | Amazon Athena | Amazon S3 | Apache AirflowChildcare support | Dental insurance | Extended parental leave | Gympass | Health insuranceMid-level Full TimeBrazil19h ago
-
Data Analyst, Product GBP 95K-124KA/B | A/B Testing | Analytical Functions | Apache Airflow | B testingSenior-level Full TimeUnited Kingdom20h ago
-
Databricks | ELT | ETL | Power Apps | Power AutomateBirthday day off | Birthday recognition | Collaborative inclusive environment | Dental insurance | Gym membershipEntry-level Full TimeSão Paulo, SP, Brazil20h ago
-
Analista de Dados Pleno BRL 60K-60KDashboard Development | Data Governance | Data Modeling | Data Quality | Data integrationDental insurance | Education Partner | Gym membership | Life insurance | Meal vouchersMid-level Full TimeCampinas, Brazil22h ago
-
APIs | Attribution Modeling | Campaign Optimization | Causal Inference | ClusteringAccess to diverse client datasets | Collaborative team environment | Hybrid work model | Knowledge sharing | Opportunities for challenging projectsMid-level Contract FreelanceBrazil1d ago
-
Forward Deployed Engineer, Enterprise AI [LATAM] BRL 319K-396KAWS | Automated testing | Cloud Computing | Cloud platform | ComplianceSenior-level Full TimeSão Paulo, Brazil1d ago
-
AWS | Apache Airflow | Apache Spark | Azure | Azure DataBirthday day off | Casual dress code | Dental insurance | Educational partnerships | Extended maternity and paternity leaveSenior-level Full TimeBrazil1d ago
-
Adversarial Testing | Artificial Intelligence | Bias Assessment | Experiment tracking | Hallucination detectionContract based opportunity | Opportunity to work on advanced AI systems | Remote work flexibilitySenior-level Contract Full TimeBrazil R1d ago
-
Cloud infrastructure | Containerization | Docker | GPU Computing | KubernetesCareer growth in AI infrastructure | Four-day work week | Fully remote | Global team collaboration | Open communication inclusive cultureSenior-level Full TimeBrazil R1d ago
-
AWS Textract | Autogen | Azure Form Recognizer | CI/CD | Computer VisionBirthday day off | Childcare assistance | Cultural partnerships | Dental insurance | Family support for new parentsSenior-level Full TimeBrazil R1d ago
-
Data Engineer BRL 216K-275KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Data IngestionWork from homeSenior-level Full TimeBrazil1d ago
-
Arquitetura de Dados e IA | Remota - 134857 BRL 119K-119KAWS Glue | AWS SageMaker | Agile | Amazon Athena | Amazon EMRRemote workSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados AWS (Pleno/Sênior) | Remota - 134904 BRL 120K-120KAWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step FunctionsRemote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados AWS (Pleno/Sênior) | Remota - 134905 BRL 120K-120KAWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step FunctionsRemote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados AWS Sênior | Remota - 134936 BRL 120K-120KAWS Glue | AWS Lambda | AWS Step Functions | Amazon EventBridge | Amazon S3Collaborative team | Independent work | Problem solving support | Remote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | Batch ProcessingEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapSenior-level Full TimeRecife, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | Batch Processing | CI/CD | DagsterEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeCampinas, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | CI/CD | Dagster | Data LineageEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBrasília, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | CI/CD | Dagster | Data Lineage | Data QualityEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRio de Janeiro, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeSalvador, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | CI/CD | Dagster | Data LineageEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBelo Horizonte, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | CI/CD | DagsterEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimePorto Alegre, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | Batch Processing | CI/CD | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsSenior-level Full TimeCuritiba, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeSão Paulo, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS | AWS Kinesis | Apache Airflow | Apache Kafka | AzureEducation budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimeFlorianópolis, Brazil1d ago