Senior Big Data Engineer - SAP Concur Complete
São Leopoldo, BR, 93022-718
BRL 304K-396K (estimate) Senior-level Full Time
Tasks
- Build data pipeline infrastructure
- Build infrastructure as code
- Build lakehouse and data warehouse architectures
- Collaborate on canonical data models
- Design data pipelines
- Develop ETL/ELT workflows
- Ensure data quality and observability
- Implement CI CD for data code
- Implement real-time streaming pipelines
- Maintain Delta Lake and Apache Iceberg tables
- Optimize pipeline performance and costs
- Process batch and streaming data
- Set up data validation and lineage
Perks/Benefits
Skills/Tech-stack
ACID | AWS CDK | AWS EMR | AWS Glue | AWS Kinesis | AWS Lambda | AWS RDS | AWS S3 | Amazon Redshift | Apache Airflow | Apache Atlas | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | Cloud Storage | CloudWatch | DBT | Data Lake Storage | Data Modeling | Databricks | Datadog | Dataframes | Delta Lake | Docker | DynamoDB | ELT | ETL | GitHub Actions | Google BigQuery | Google Cloud | Google Cloud Storage | Google Dataproc | Google Pub/Sub | Grafana | Great Expectations | HDFS | Hive | Idempotency | Kafka Streams | Kubernetes | Lakehouse | Monte Carlo | NoSQL | OpenLineage | OpenTelemetry | Pub/Sub | PySpark | Python | SQL | Schema evolution | Snowflake | Soda | Spark SQL | Structured Streaming | Synapse Analytics | Terraform | YARN
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Data Analyst USD 96K-138KAutomation | CTE | Data Migration | Database Integrity | Debugging10 paid holidays per year | Annual performance reviews | Career growth opportunities | Learning culture | Quarterly performance bonusEntry-level ContractColombia; Argentina; Brazil; Mexico; Ecuador; Uruguay; …10h ago
-
Analista de Dados Pleno - 127203 INT BRL 107K-118KAPIs | Apache Airflow | Apache NiFi | Automated testing | AvroMid-level Full TimeAlphaville - Barueri, BR, 06.454-00014h ago
-
Senior-level Full TimeBrasil20h ago
-
Lead Data Engineer BRL 305K-396KBig Data | CI/CD | Data Architecture | Data Engineering | Data GovernanceSenior-level Full TimeBrazil, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | Concurrency debuggingFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBelo Horizonte, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | Concurrency | CsharpEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeSão Bernardo do Campo, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAmazon Web Services | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBrasília, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeCampinas, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeSorocaba, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimePorto Alegre, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Growth roadmap | MentorshipSenior-level Full TimeRecife, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | C# | Concurrency | SQLEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeSalvador, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | Cloud NativeEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimeFlorianópolis, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C Sharp | Cloud NativeEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeRio de Janeiro, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeCuritiba, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | Concurrency | CsharpEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeSão Paulo, Brazil1d ago
-
Engenheiro De Dados Pleno BRL 60K-60KBigQuery | Cloud Storage | Google Cloud | Google Cloud Storage | KNIMESenior-level Full TimeValinhos, State of São Paulo, Brazil1d ago
-
Senior Data Scientist - SAP Concur Travel BRL 325K-443KA/B | A/B Testing | AWS EC2 | AWS SageMaker | Amazon EMRContinuous learning opportunities | Flexible working models | Health and wellbeing support | Skill growthSenior-level Full TimeSão Leopoldo, BR, 93022-7181d ago
-
Engenharia de Dados Sênior (Híbrido/SP) - 132080 BRL 96K-119KApache Airflow | Apache Kafka | Apache Spark | Azure | ConfluenceHybrid work | In person 3x per weekMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
API Development | AWS | Agent systems | Continuous Delivery | DatabricksCorporate university | Dental plan | Gym membership reimbursement | Health insurance | Hybrid workSenior-level Full TimeIndaiatuba, São Paulo, BR, 13337-3001d ago
-
Senior-level Full TimeBrazil - Remote R1d ago
-
Agile | Anomaly Detection | Azure Data | Azure Data Factory | Azure DatabricksSenior-level Full TimeBrazil - Remote R1d ago
-
Apache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeSão Paulo, Brazil1d ago
-
AWS Cloud | Design Patterns | Kafka | Kubernetes | MicroservicesChildcare assistance | Dental insurance | Employee assistance program | Fitness program | Health insuranceEntry-level Full TimeSão Paulo, Rio de Janeiro ou …1d ago
-
AI Engineer (Brazil) BRL 232K-267KAWS | Agents | Azure | CI/CD | Cloud platformFlexible ways of working | International projects | Learning and development opportunities | Mentoring system | Supportive corporate cultureMid-level Contract Full TimeBlumenau, SC, Brazil1d ago