Senior Big Data Engineer - SAP Concur Complete
São Leopoldo, BR, 93022-718
BRL 304K-396K (estimate) Senior-level Full Time
Tasks
- Build data pipeline infrastructure
- Build infrastructure as code
- Build lakehouse and data warehouse architectures
- Collaborate on canonical data models
- Design data pipelines
- Develop ETL/ELT workflows
- Ensure data quality and observability
- Implement CI CD for data code
- Implement real-time streaming pipelines
- Maintain Delta Lake and Apache Iceberg tables
- Optimize pipeline performance and costs
- Process batch and streaming data
- Set up data validation and lineage
Perks/Benefits
Skills/Tech-stack
ACID | AWS CDK | AWS EMR | AWS Glue | AWS Kinesis | AWS Lambda | AWS RDS | AWS S3 | Amazon Redshift | Apache Airflow | Apache Atlas | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | Cloud Storage | CloudWatch | DBT | Data Lake Storage | Data Modeling | Databricks | Datadog | Dataframes | Delta Lake | Docker | DynamoDB | ELT | ETL | GitHub Actions | Google BigQuery | Google Cloud | Google Cloud Storage | Google Dataproc | Google Pub/Sub | Grafana | Great Expectations | HDFS | Hive | Idempotency | Kafka Streams | Kubernetes | Lakehouse | Monte Carlo | NoSQL | OpenLineage | OpenTelemetry | Pub/Sub | PySpark | Python | SQL | Schema evolution | Snowflake | Soda | Spark SQL | Structured Streaming | Synapse Analytics | Terraform | YARN
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
[Job-29095] Engenheiro de Dados Sênior , Brazil BRL 18K-18KAzure Data | Azure Data Services | Azure ML | CI/CD | Data LakeChildcare assistance | Dental insurance | Discount platform | Employee performance bonus | Extended parental leaveSenior-level Full TimeBrazil14h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsMid-level Full TimeManaus, Brazil18h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data QualityEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeJoão Pessoa, Brazil18h ago
-
AWS | Amazon Redshift | DBT | Data Architecture | Data LakesFlextime | Growth roadmaps | Mentorship | Office options | Remote optionsMid-level Full TimeSão Luís, Brazil18h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data ModelingFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksMid-level Full TimeTeresina, Brazil18h ago
-
AWS | Algorithms | Amazon Redshift | DBT | Data LakeEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsMid-level Full TimeCampo Grande, Brazil18h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsMid-level Full TimeNiterói, Brazil18h ago
-
AWS | Amazon Redshift | DBT | Data Engineering | Data LakesFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsMid-level Full TimeAracaju, Brazil18h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsMid-level Full TimeSão José dos Campos, Brazil18h ago
-
AWS | Algorithms | Amazon Redshift | Computer Science | Computer science fundamentalsEducation budget | Fitness budget | Flextime | Growth roadmaps | MentorshipMid-level Full TimeMaceió, Brazil18h ago
-
AWS | Amazon Redshift | DBT | Data Lakes | Data QualityEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeUberlândia, Brazil18h ago
-
API Integration | API proxying | Agent Pipelines | Agentic Workflows | Automated testingFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsMid-level Full TimeRecife, Brazil18h ago
-
.NET | AI Coding Assistants | AI coding | API Integration | API proxyingEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeSão Bernardo do Campo, Brazil18h ago
-
API Integration | API proxying | Agent Pipelines | Agentic Workflows | Automated testingFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsMid-level Full TimeBelo Horizonte, Brazil18h ago
-
.NET | API proxying | Agentic Workflow | Automated testing | C#Flexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsMid-level Full TimeSalvador, Brazil18h ago
-
.NET | API proxying | Automated testing | C# | CI/CDEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeCuritiba, Brazil18h ago
-
.NET | AI Coding Assistants | AI coding | API proxying | Agentic WorkflowsEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeSão Paulo, Brazil18h ago
-
.NET | AI Agent | API Integration | API proxying | Agentic WorkflowEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeBrasília, Brazil18h ago
-
.NET | AI Coding Assistants | AI coding | API Integration | API proxyingFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsMid-level Full TimeRio de Janeiro, Brazil18h ago
-
.NET | API Integration | API Proxy | Agentic Workflow | Automated testingFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsMid-level Full TimeFlorianópolis, Brazil18h ago
-
.NET | API proxying | Agent Pipelines | Agentic Workflows | Artificial IntelligenceFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsMid-level Full TimePorto Alegre, Brazil18h ago
-
.NET | API Integration | API proxying | Agentic Workflow | Automated testingFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote optionsMid-level Full TimeSorocaba, Brazil18h ago
-
.NET | AI Coding Assistants | AI coding | API proxying | Agentic WorkflowsFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsMid-level Full TimeSalvador, Brazil18h ago
-
.NET | AI coding | AI coding assistant | API Integration | API proxyingEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeCuritiba, Brazil18h ago
-
.NET | API proxying | Automated testing | C# | CI/CDEducation budget | Fitness budget | Flextime remote and office options | Mentorship | Personalized growth roadmapsMid-level Full TimeSão Paulo, Brazil18h ago