Senior Data Engineer
Tasks
- Automate pipeline build testing and migrations
- Build SQL for data processing
- Build data development standards
- Build data quality models and ABCR frameworks
- Build pipelines for generative AI training data
- Collaborate with data scientists to build pipelines
- Design and develop ETL and ELT pipelines
- Design data ingestion frameworks
- Ensure effectiveness of ingestion and data delivery frameworks
- Implement vector databases for RAG
- Provide design guidance on data models
- Translate requirements into data design
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Machine Learning | Azure SQL | Azure SQL Data | Azure SQL Data Warehouse | Azure Stream | Azure Stream Analytics | CI/CD | Change Data Capture | Data Capture | Data Factory | Data Lake Storage | Data Modeling | Data Warehouse | Data Warehousing | Data integration | Databricks | Dimension Table | ELT | ETL | Fact Table | Machine Learning | Python | SCD Type 1 | SCD Type 3 | SCD Type-2 | SQL | SQL Data Warehouse | SnowSQL | Snowflake | Snowflake Schema | Snowpipe | Spark | Star Schema | Stream Analytics | Type 1 | Type 2)
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeState of Rio Grande do Sul, …8h ago
-
AWS CloudFormation | Airflow | Amazon Kinesis | Amazon Redshift | BigQueryFlexible hours | Remote workMid-level Full TimeBrazil - Remote R22h ago
-
Senior Data Engineer BRL 234K-300KAgile | Analysis Services | Azure | Azure Analysis | Azure Analysis ServicesSenior-level Full TimeBrazil -Sao Paulo22h ago
-
Senior Data Engineer AI | Inglês BRL 78K-119KAzure Cognitive | Azure Cognitive Services | Azure Machine Learning | Cognitive Services | Data PipelinesSenior-level Full TimeBrazil - Sao Paulo1d ago
-
Senior-level Full TimeSão Paulo, Brazil1d ago
-
Data Architecture | Data Modeling | Data Normalization | Data pipeline | Dimensional ModelingMid-level Full TimeSão Paulo, SP, Brazil1d ago
-
Data Engineer BRL 120K-144KClassification | Clustering | DAX | Data Modeling | Data VisualizationCasual office dress code | Childcare subsidies | Clube Ben partnership | Days off | Dental insuranceMid-level Full TimeCampinas, São Paulo, Brazil1d ago
-
Data Engineer BRL 305K-385KAlerting | Apache Spark | Azure | CI/CD | Data GovernanceChildcare subsidies | Dental insurance | Health insurance | Language and training platforms | Life insuranceMid-level Full TimeCampinas, Brazil1d ago
-
Senior Data Engineer BRL 304K-370KAWS Lambda | Amazon RDS | Amazon S3 | Amazon Web Services | Apache SparkEquipment stipend | Flexible PTO | Learning and development stipend | Paid certifications exams | Professional development planSenior-level Full TimeBRAZIL R1d ago
-
[job-28646] Developer Master IA (SDLC+GenAI) BRL 18K-18KAgent systems | Automated testing | CI/CD | Code review | Data PrivacyChildcare support | Dental insurance | Discount club | Extended parental leave | GympassSenior-level Full TimeBrazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAmazon Web Services | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBelo Horizonte, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office work optionSenior-level Full TimePorto Alegre, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeCampinas, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimeSão Bernardo do Campo, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeRecife, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeFlorianópolis, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeSão Paulo, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeSalvador, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeSorocaba, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBrasília, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAmazon Web Services | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Growth roadmaps | MentorshipSenior-level Full TimeRio de Janeiro, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flextime | Mentorship | Office work optionSenior-level Full TimeCuritiba, Brazil1d ago
-
API Integration | AWS S3 | Apache Airflow | CI/CD | DBTEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapMid-level Full TimeCuritiba, Brazil1d ago
-
BI Dashboards | Compliance analytics | Excel | Fraud Detection | KPIsDental insurance | Gym membership | Health insurance | Home office | Hybrid workSenior-level Full TimeSão Paulo, Brazil1d ago
-
Amazon Redshift | Canonical Metrics | DBT | Data Architecture | Data ModelingFully remote | Healthcare coverage | Home office equipment allowance | Learning and development budget | Paid parental leaveSenior-level Full TimeBrazil R1d ago