Engenheiro de Dados Pleno
Tasks
- Analyze and optimize Databricks cost
- Analyze and optimize Databricks performance
- Build data ingestion pipelines
- Collaborate with analytics teams
- Create technical documentation
- Implement data quality checks
- Maintain data ingestion pipelines
- Optimize data pipeline throughput
- Optimize data with Delta Lake
- Partition data for performance
- Process data with Spark Structured Streaming
- Query data with Spark SQL
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Data Governance | Data Ingestion | Data Modeling | Data Quality | Databricks | Delta Lake | ETL | Git | Python | Spark SQL | Spark Structured Streaming | Structured Streaming
Education
N/A
Roles
Related jobs
-
AI Agents | AWS | CI/CD | Developer experience | FinetuningEntry-level Full TimeSão Paulo, Brazil19h ago
-
Anthropic Claude | Application Insights | Asynchronous systems | Azure Application Insights | Azure OpenAIB2B contract arrangement | Flexible work environment | Long-term engagement | Remote workSenior-level Contract Full TimeBrazil R23h ago
-
Agentic SDLC | Artificial Intelligence | Artificial Intelligence Development Life Cycle | Artificial intelligence development | Context awarenessChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveMid-level Full TimeBrazil1d ago
-
AI Foundry | AWS Bedrock | AWS GovCloud | AWS SageMaker | Agentic AI401k matching | Career development | Dental insurance | Flexible work arrangements | Health insuranceSenior-level Full TimeBrazil1d ago
-
Senior Data Engineer - Databricks BRL 319K-455KAWS | Apache Spark | Automation Scripting | CI/CD | Cloud SecurityEquipment and office stipend | Flexible PTO | Learning and development stipend | Paid exams and certifications | Professional development planSenior-level Full TimeBRAZIL R1d ago
-
Automation | Azure Data | Azure Data Explorer | CSV | Cloud SecurityCollaborative global working environment | Cross-functional collaboration | Exposure to large scale telemetry | Professional growth | Remote work opportunityMid-level Full TimeBrazil R1d ago
-
Data Scientist II, Applied ML BRL 223K-271KA/B | A/B Testing | API Development | B testing | Hypothesis TestingMid-level Full TimeSão Paulo, São Paulo, Brazil1d ago
-
Data Engineer PL - 135468 INT BRL 119K-119KAPI Integration | Apache Airflow | DBT | DBT Core | Data GovernanceMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Apache Airflow | Apache Spark | BigQuery | Cloud Composer | Cloud StorageDental insurance | Gym membership | Health insurance | Home office | Life insuranceEntry-level Full TimeSão Paulo, Brazil1d ago
-
Data Analytics Lead BRL 319K-443KAI readiness | Analytics | Data Architecture | Data Modeling | Data integrationFlexible work environment | Work from home optionSenior-level Full TimeBrazil - São Paulo R1d ago
-
Amazon Web Services | Apache Spark | Cloud platform | DBT | Data ModelingAnniversary day off | Childcare support | Day off for birthday | Dental insurance | Financial supportEntry-level Full TimeSão Paulo, Brazil1d ago
-
Senior Backend Software Engineer BRL 54K-72KAPI Integration | Alerting | Amazon Web Services | Apache Airflow | CI/CDSenior-level Full TimeBrasil1d ago
-
Engenheiro de Dados Senior BRL 134K-134KApache Airflow | Apache Spark | Cloud Computing | Data Modeling | Data QualityFlexible work accommodations | Hybrid workSenior-level Full TimeSão Paulo, Brazil1d ago
-
Apache Spark | Avro | Cluster computing | Column Pruning | DatabricksEntry-level Full TimeSão Paulo, Brasil2d ago
-
AWS | AWS CloudWatch | AWS Glue | AWS Lambda | AWS Step FunctionsChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveMid-level Full TimeBrazil2d ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | CI/CD | DNS | Firewalls | GitAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimeSão Bernardo do Campo, Brazil2d ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | CI/CD | DNS | Git | GrafanaFlexible hours | Learning budget | Mentorship | Remote work | Well-being programsSenior-level Full TimeRio de Janeiro, Brazil2d ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI/CD | DNS | FirewallCollaborative culture | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeSorocaba, Brazil2d ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI/CD | DNS | GitAnnual learning budget | Flexible hours | Mentorship | Remote work | Support programsSenior-level Full TimeBelo Horizonte, Brazil2d ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI/CD | DNS | FirewallFlexible hours | Learning budget | Mentorship | Remote work | Support programsSenior-level Full TimeSão Paulo, Brazil2d ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI/CD | DNS | FirewallsAnnual TechTalks | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeBrasília, Brazil2d ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Authentication | CI/CD | Code Quality | DNSAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimePorto Alegre, Brazil2d ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | CI/CD | CMDB | DNS | GitFlexible hours | Learning budget | Mentorship | Remote work | Supportive collaborative cultureSenior-level Full TimeSalvador, Brazil2d ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI/CD | DNS | Data ProcessingAnnual learning budget | Flexible hours | Mentorship | Remote work | Well-being programsSenior-level Full TimeFlorianópolis, Brazil2d ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic API | Automated testing | CI Pipeline | CI/CD | DNSFlexible hours | Learning budget | Mentorship | Remote work | Well-being programsSenior-level Full TimeRecife, Brazil2d ago