Senior Big Data Engineer - SAP Concur Complete
São Leopoldo, BR, 93022-718
BRL 304K-396K (estimate) Senior-level Full Time
Tasks
- Build data pipeline infrastructure
- Build infrastructure as code
- Build lakehouse and data warehouse architectures
- Collaborate on canonical data models
- Design data pipelines
- Develop ETL/ELT workflows
- Ensure data quality and observability
- Implement CI CD for data code
- Implement real-time streaming pipelines
- Maintain Delta Lake and Apache Iceberg tables
- Optimize pipeline performance and costs
- Process batch and streaming data
- Set up data validation and lineage
Perks/Benefits
Skills/Tech-stack
ACID | AWS CDK | AWS EMR | AWS Glue | AWS Kinesis | AWS Lambda | AWS RDS | AWS S3 | Amazon Redshift | Apache Airflow | Apache Atlas | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | Cloud Storage | CloudWatch | DBT | Data Lake Storage | Data Modeling | Databricks | Datadog | Dataframes | Delta Lake | Docker | DynamoDB | ELT | ETL | GitHub Actions | Google BigQuery | Google Cloud | Google Cloud Storage | Google Dataproc | Google Pub/Sub | Grafana | Great Expectations | HDFS | Hive | Idempotency | Kafka Streams | Kubernetes | Lakehouse | Monte Carlo | NoSQL | OpenLineage | OpenTelemetry | Pub/Sub | PySpark | Python | SQL | Schema evolution | Snowflake | Soda | Spark SQL | Structured Streaming | Synapse Analytics | Terraform | YARN
Education
N/A
Roles
Regions
Countries
States
Language: en
Views:
5
Clicks:
3
Saves: 0
Related jobs
-
Senior Software Engineer, Data Engineering BRL 319K-412KCloud platform | DBT | Dagster | Datadog | DockerSenior-level Full TimeSão Paulo, State of São Paulo, … R1d ago
-
AI Lead (Brazil) BRL 144K-146KArtificial Intelligence | Customer Success | Data Analysis | Language Processing | Machine LearningRemote-first culture | Team collaborationSenior-level Full TimeRemote/Brazil R1d ago
-
AWS | Cloud Computing | Deep learning | Experimentation | Generative AIInclusion and affinity groups | Learning opportunities | Mentorship | Work-life balanceSenior-level Full TimeSao Paulo, Sao Paulo, BRA3d ago
-
AI Engineer (Agents) BRL 210K-210KAI SDK | Adversarial Testing | Async Programming | CI/CD | CachingDental insurance | Health insurance | Performance bonus | Remote work | Stock optionsSenior-level Full TimeRio de Janeiro R3d ago
-
AI Engineer (Agents) BRL 210K-210KAI SDK | Adversarial Benchmarking | Arize Phoenix | Asynchronous programming | CI/CDDental insurance | Health insurance | Performance bonus | Remote work | Stock optionsSenior-level Full TimeSão Paulo R3d ago
-
Data Engineer (GTM) BRL 114K-156KAirflow | Apache Beam | Apache Kafka | BigQuery | ClayDental insurance | Education and courses stipend | Health plan | Paid annual leave | Sports incentiveMid-level Full TimeSão Paulo, SP3d ago
-
Data Engineer: Data Foundry Engineer BRL 196K-218KAmazon Kinesis | Apache Airflow | Apache Spark | Dagster | Data GovernanceDental insurance | Education and courses stipend | Health plan | Paid annual leave | Sports incentiveMid-level Full TimeSão Paulo, SP3d ago
-
Jr Data Engineer BRL 30K-30KAWS | Apache Airflow | Azure | Batch Processing | CI/CDChildcare support | Dental insurance | Employee assistance program | Food allowance | GympassEntry-level Full TimeSão Paulo,São Paulo,BRA3d ago
-
[Job-29944] AI Engineer Senior (Javascript/React) BRL 234K-280KAI Agents | API Gateway | AWS Bedrock | AWS Lambda | AnthropicChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveSenior-level Full TimeBrasília3d ago
-
AI Agents | AI Observability | AWS | CI/CD | Cost OptimizationFully remote | Professional development | Work-life balanceSenior-level Full TimeBrazil R3d ago
-
Mid-level Full TimeSão Paulo, SP3d ago
-
Senior AI Prompt Engineer & GenAI Adoption Consultant BRL 300K-360KAI Fundamentals | AI Governance | API Integration | Artificial Intelligence | Artificial Intelligence AgentsHybrid flexibility | International projects | Medical healthcare | Ongoing learning reimbursement | Recognition programSenior-level Full TimeSão Paulo, Brazil3d ago
-
Senior-level Full TimeSão Carlos, SP, Brazil3d ago
-
Senior-level Full TimeSão Carlos, SP, Brazil3d ago
-
Entry-level Full TimeSão Carlos, SP, Brazil3d ago
-
Amazon Kinesis | Apache Kafka | Apache Spark | CI/CD | Data ModelingCareer growth opportunities | Flexible work arrangements | Learning-oriented culture | Opportunities to improve system design skillsMid-level Full TimeBrazil3d ago
-
Apache Airflow | Apache Spark | CI/CD | DBT | Data GovernanceCareer development | Health and wellness benefits | Hybrid work | Mentorship | Remote workSenior-level Full TimeBrazil3d ago
-
APIs | AWS Bedrock | AgentOps | Autogen | Azure AIBirthday day off | Certification programs | Childcare assistance | Dental plan | Educational partnershipsMid-level Full TimeBrazil3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Portfolio and LinkedIn sharing opportunity | Remote/distributed workMid-level Full TimeCuritiba, Brazil4d ago
-
Engenheiro de Dados Azure BRL 48K-80KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeTWGRJ - Teleworker/Offsite - BRA - … R4d ago
-
Engenheiro(a) de Dados Pleno (Azure/Databricks) BRL 21K-31KAzure | Azure Databricks | Data Engineering | PySpark | SQLChildcare assistance | Dental insurance | Extended maternity leave | Extended paternity leave | Gym membershipMid-level Full TimeSao Paulo, Torre Paineira, Brazil4d ago
-
Physics & Python Expert - Freelance AI Trainer USD 34K-34KBilby | CAMB | Class | DOLFINx | FenicsPart-time flexible hours | Project based workSenior-level FreelanceBrazil - Remote R4d ago
-
Engenheiro (a) de Dados Cloud Sr BRL 21K-24KAgile | Amazon Web Services | Apache Spark | Azure | Cloud platformCareer Development Programs | Diversity and inclusion initiatives | Flexible work environment | Global projects | Training programsMid-level Full TimeSão Paulo JK, SP, BR, 04543-0114d ago
-
[Job 29931] Senior, AI Data Engineer Brazil BRL 18K-18KDBT | Data Governance | Data Marts | Data Modeling | Data QualityChildcare support | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil4d ago
-
Analytical Architecture | Apache Airflow | Apache Spark | ClickHouse | CloudFormationStock optionsSenior-level Full TimeRemote (Brazil) R4d ago