Engenharia de Dados AWS Sênior | Remota - 135667
Alphaville - Barueri, BR, 06.454-000
BRL 120K-144K (estimate) Senior-level Full Time
Tasks
- Administer Lake Formation data permissions
- Build Redshift tables and manage data sharing
- Build Spark PySpark transformations for multiple data sources
- Create SQL queries for SQL and NoSQL data
- Create and query Iceberg Delta tables using time travel snapshots
- Develop AWS Glue jobs configure crawlers run Spark jobs on EMR
- Develop Airflow DAGs configure connections schedule workflows
- Develop efficient SQL for relational and NoSQL
- Implement ElastiCache cache aside TTLs
- Implement data lineage cataloging classification access controls schema validations versioning
- Load data using Redshift COPY develop analytical queries and manage users
- Manage database schemas backups read replicas parameter groups
- Optimize Athena queries using partitioning columnar formats workgroups
Perks/Benefits
Skills/Tech-stack
ACID | AWS | AWS Glue | AWS Glue Catalog | Access patterns | Amazon Athena | Amazon EMR | Amazon Lake Formation | Amazon RDS | Amazon Redshift | Apache Airflow | Apache Spark | Columnar formats | Connection pooling | Cross Account | Data Contracts | Data Governance | Data Lineage | Data Partitioning | Data Sharing | Delta Lake | ElastiCache | Glue Catalog | Glue Crawlers | IAM | IAM Encryption | Iceberg | Lake Formation | Lakehouse | MPP | Materialized views | Memcached | Multi AZ | Observability | PySpark | Redis | Retries | SQL | Schema Registry | Schema evolution | Spark SQL | Workgroups | Workload management
Education
N/A
Roles
Related jobs
-
Access Controls | Airflow | Apache Spark | Asset bundles | CI/CDCertification incentives | Childcare allowance | Dental insurance | Educational discounts | Fitness and wellness benefitSenior-level Full TimeBrazil R1d ago
-
AWS Glue | AWS Lake | AWS Lake Formation | Amazon Athena | Amazon BedrockChildcare assistance | Continuous learning opportunities | Discounts through partner programs | Extended parental leave | Fitness and wellness programsMid-level Full TimeBrazil R1d ago
-
Engenheiro(a) GenAI & Machine Learning BRL 23K-24KAWS EKS | Agent systems | Airflow | Amazon Bedrock | Azure OpenAIChildcare assistance | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveNone Full TimeRio de Janeiro, Brazil1d ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2 | Amazon EMRChildcare allowance | Dental insurance | Extended family leave | Food allowance | Life insuranceSenior-level Full TimeSão Paulo1d ago
-
Visagio Talentos - Formados: Data Science e IA Generativa RJ (Exclusiva para Pessoas com Deficiência) BRL 23K-31KAgile methodology | Data Analysis | Database Concepts | Language Processing | Machine LearningClient interaction | Team collaboration | Training coursesNone Full TimeRio de Janeiro, Brasil1d ago
-
Analytics | Clojure | Data Contracts | Data Lineage | Data QualityDaycare allowance | Dental plan | Equity | Extended parental leave | Financial supportSenior-level Full TimeSão Paulo R1d ago
-
Engenheiro(a) de Dados BRL 20K-31KAPI Design | AWS | Apache Spark | DBT | Data CatalogCareer growth | Cross company impact | Innovative environment | Knowledge sharing | MentorshipSenior-level Full TimeBrasil1d ago
-
Lead Data Engineer (Brazil Based) BRL 234K-368KAI machine learning | AWS | AWS Glue | Amazon Athena | Amazon S3English language support | Travel opportunitiesSenior-level Full TimeSão Carlos, SP, Brazil1d ago
-
Senior Analytics Engineer (SQL, Scala) BRL 319K-390KAWS | Apache Spark | Automated testing | Azure | CI/CDHybrid flexibility | International projects | Medical healthcare | Ongoing learning reimbursement | Referral bonusesSenior-level Full TimeSão Paulo, Brazil1d ago
-
Data Engineer - GCP | PL (Hybrid/SP) BRL 119K-119KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CassandraHybrid workSenior-level Full TimeSão Paulo, Brasil R2d ago
-
Data Engineer - GCP | SR (Hybrid/SP) BRL 119K-119KAPIs | AWS Glue | Apache Airflow | Apache Kafka | Apache SparkHybrid workSenior-level Full TimeSão Paulo, Brasil R2d ago
-
Access Control | Anomaly Detection | Audit Logging | CI/CD | ClassificationCompetitive salary | Exposure to MLOps and LLMOps | Hands on cutting edge AI work | Remote work model | Scalable security governance and observability focusSenior-level Full TimeBrazil2d ago
-
Analista Sênior de Engenharia de Dados e IA BRL 24K-31KABAC | AWS Glue | Access Management | Agent Orchestration | Amazon AthenaChildcare assistance | Dental insurance | Discounts on financial products | Extended maternity and paternity leave | Health insuranceSenior-level Full TimeSão Paulo, Brasil R2d ago
-
AWS | Apache Spark | Azure DevOps | CI/CD | Cloud ComputingChildcare assistance | Dental insurance | Hybrid work model | Life events support | Life insuranceMid-level Full TimeBrazil R2d ago
-
AWS | Agent systems | Autogen | Automated testing | AzureChildcare assistance | Continuous learning | Dental insurance | Employee discounts | Extended parental leaveSenior-level Full TimeBrazil2d ago
-
AWS Glue | Agile Scrum | Apache Airflow | Apache Kafka | Apache SparkAgile collaborative environment | Career growth | Continuous learning opportunities | Professional development | Technical challenging projects with business impactMid-level Full TimeBrazil2d ago
-
Apache Airflow | BigQuery | CI/CD | Cloud Storage | Cloud platformContinuous learning | Emotional wellbeing programs | Employee discounts | Partner discounts | Self learningMid-level Full TimeCampo Grande, PT2d ago
-
AWS | Analytics engineering | Artificial Intelligence | Automated testing | Cloud ArchitectureChildcare assistance | Dental insurance | Discounts on financial products | Extended maternity leave | Extended paternity leaveMid-level Full TimeSão Paulo, Brasil R2d ago
-
API Integration | AWS | Agile | Airflow | AzureChildcare support | Company profit sharing | Continuous learning platform | Dental insurance | Discount clubSenior-level Full TimeBrazil2d ago
-
Access Control | Anomaly Detection | Artificial Intelligence | Audit Logging | CI/CDCompetitive salary | Remote workSenior-level Full TimeBrazil2d ago
-
Apache Spark | Azure | CI/CD | Cassandra | Data GovernanceChildcare reimbursement | Dental insurance | English training online | Extended parental leave | Flexible benefits programSenior-level Full TimeRio de Janeiro, Brasil R3d ago
-
APIs | Agent Frameworks | Agent systems | Chunking | EmbeddingsMid-level Full TimeBrasil3d ago
-
Senior Data Engineer Brazil BRL 212K-270KApache Beam | Apache Flink | Apache Spark | CI/CD | Cloud platformCoworking credits | Dental insurance | Gympass | Health insurance | Meal allowanceSenior-level Full TimeAvenida das Nações Unidas, 12901,11° andar … R3d ago
-
LLMs Data Analyst | Senior (Hybrid/SP) BRL 84K-108KAWS | Anthropic | Azure OpenAI | CI/CD | Cloud platformHybrid workSenior-level Full TimeSão Paulo, Brasil R3d ago
-
Data Management | Data Management Cloud | Data Quality | IBM DB2 | Informatica Data QualityMid-level Full TimeBrasil R3d ago