Senior Data Engineer
Tasks
- Automate pipeline build testing and migrations
- Build SQL for data processing
- Build data development standards
- Build data quality models and ABCR frameworks
- Build pipelines for generative AI training data
- Collaborate with data scientists to build pipelines
- Design and develop ETL and ELT pipelines
- Design data ingestion frameworks
- Ensure effectiveness of ingestion and data delivery frameworks
- Implement vector databases for RAG
- Provide design guidance on data models
- Translate requirements into data design
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Machine Learning | Azure SQL | Azure SQL Data | Azure SQL Data Warehouse | Azure Stream | Azure Stream Analytics | CI/CD | Change Data Capture | Data Capture | Data Factory | Data Lake Storage | Data Modeling | Data Warehouse | Data Warehousing | Data integration | Databricks | Dimension Table | ELT | ETL | Fact Table | Machine Learning | Python | SCD Type 1 | SCD Type 3 | SCD Type-2 | SQL | SQL Data Warehouse | SnowSQL | Snowflake | Snowflake Schema | Snowpipe | Spark | Star Schema | Stream Analytics | Type 1 | Type 2)
Education
N/A
Roles
Related jobs
-
AWS | Apache Airflow | Azure | CI/CD | Data EngineeringCareer growth opportunities | Continuous learning | Flexible working hours | Fully remote | Home office setup supportSenior-level Full TimeBrazil R20h ago
-
API Design | AWS | Apache Spark | CI/CD | CrossplaneCareer development | Dental insurance | Flexible schedule | Health insurance | Home office supportSenior-level Full TimeBrazil20h ago
-
Data Engineer (GTM) BRL 150K-230KAirflow | Apache Beam | Batch Ingestion | BigQuery | Clay401k retirement plan | Fully funded travel after four years | Gympass membership | Language learning opportunities | Medical, dental, and vision coverageMid-level Full TimeSão Paulo, SP20h ago
-
APIs | Apache Airflow | Azure Data | Azure Data Factory | Data FactoryDental insurance | Gym membership support | Health insurance | Life insurance | Meal or food allowanceMid-level Full TimeBrazil21h ago
-
Cloud Computing | Data Pipelines | ETL | Google Colab | Information RetrievalCareer growth | Continuous learning culture | Coworking access | Flexible schedule | Fully remote workMid-level Full TimeBrazil R22h ago
-
APIs | BigQuery | Copilot Studio | Data Governance | GeminiChildcare support | Dental insurance | Food Voucher | Gym pass | Health insuranceEntry-level Full TimeSão Paulo, Brazil1d ago
-
AI Agents | APIs | Automation | BI | BigQueryChildcare assistance | Dental insurance | Food Voucher | Gym membership | Health insuranceEntry-level Full TimeSão Paulo, Brazil1d ago
-
API Management | APIs | ArgoCD | Azure DevOps | CI/CDChildcare allowance | Company civic leave program | Dental insurance | Employee Assistance Program (EAP) | Extended maternity leaveSenior-level Full TimeSão Paulo1d ago
-
Engenheiro de Software Senior (.NET) | BTG Empresas BRL 119K-119K.NET | AWS | Azure | C# | CI/CDChildcare allowance | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo1d ago
-
.NET | AWS | Azure | C# | CI/CDChildcare allowance | Dental insurance | EAP | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo1d ago
-
.NET | API Design | AWS | Asynchronous programming | C#Childcare assistance | Dental insurance | EAP | Employee assistance program | Extended parental leaveSenior-level Full TimeSão Paulo1d ago
-
.NET | Agile | Amazon Web Services | C# | CI/CDChildcare support | Dental insurance | Employee assistance program | Extended parental leave | Food allowanceSenior-level Full TimeSão Paulo1d ago
-
.NET | .Net Core | API Gateway | AWS | AgileChildcare support | Dental insurance | EAP | Gym membership | Life insuranceSenior-level Full TimeSão Paulo1d ago
-
Engenheiro de Software .NET Pleno | BTG Empresas BRL 80K-80K.NET | .Net Core | AWS | Agile | Amazon SNSChildcare support | Dental insurance | Employee Assistance Program (EAP) | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo1d ago
-
AWS | Agile | Azure DevOps | CI/CD | Cloud ArchitectureChildcare assistance | Dental insurance | Employee assistance program | Gym membership | Health insuranceEntry-level Full TimeSão Paulo1d ago
-
Accessibility | CI/CD | CSS3 | Cypress | DatadogChildcare assistance | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo1d ago
-
.NET | API Gateway | AWS Cloud | Azure DevOps | C#Childcare allowance | Dental insurance | Employee Assistance Program (EAP) | Extended maternity leave | Extended paternity leaveMid-level Full TimeSão Paulo1d ago
-
Analista / Engenheiro de Dados - Suprimentos BRL 72K-96KAzure | Data Governance | Data Lake | Data Modeling | Data WarehouseEnglish proficiency | Executive reporting support | Hybrid workSenior-level Full TimeSAO PAULO, SP, Brasil1d ago
-
AI machine learning | Airflow | CI/CD | Cloud platform | DagsterCollaborative mission driven culture | Exposure to cutting edge AI and data technologies | High autonomy | High-impact strategic projects | Inclusive work environmentSenior-level Full TimeBrazil1d ago
-
AWS | AWS Glue | AWS IAM | AWS Lambda | Amazon RedshiftChildcare assistance | Continuous learning platforms | Dental insurance | Discounts and corporate benefits | Extended paternity leaveSenior-level Full TimeBrazil1d ago
-
AWS | AWS Glue | Amazon Athena | Amazon CloudWatch | Apache AirflowCollaborative knowledge sharing culture | Continuous learning | Flexible arrangements | Global innovation projects | Professional developmentSenior-level Full TimeBrazil1d ago
-
Airflow | Apache Spark | BigQuery | Cloud Storage | Cloud platformCollaborative culture | Continuous learning | Professional growth | Remote workMid-level Full TimeBrazil R1d ago
-
AWS | Airflow | Amazon Redshift | Azure | BigQueryFlexible working hours | Remote workSenior-level Full TimeBrazil - Remote R2d ago
-
Bilby | CAMB | Class | Computer Physics | DOLFINxFreelance project-based work | Part-time engagementSenior-level FreelanceBrazil - Remote R2d ago
-
Engenheiro/Engenheira de Dados - Python, AWS BRL 20K-31KAWS CloudFormation | AWS DevOps | AWS Glue | AWS Lambda | AWS Step FunctionsDental insurance | Employee wellness program | Flexible work hours | Health insurance | Hybrid workMid-level Full TimeBarueri, BR2d ago