10740 - Arquiteto Big Data | Plataforma Inteligente para Crédito Agrícola) - Sênior
Tasks
- Build data-lake and data warehouse
- Collaborate with business data engineering data science and software teams
- Define data platform architecture
- Design batch and streaming data pipelines
- Design data ingestion processing and storage
- Ensure data quality traceability security and governance
- Establish data standards frameworks and best practices
- Evolve data architecture
- Make architectural decisions for performance availability and scalability
- Support analytics machine learning and artificial intelligence initiatives
Perks/Benefits
Skills/Tech-stack
Amazon Web Services | Apache Spark | Batch Processing | Cloud platform | Data Governance | Data Lake | Data Modeling | Data Quality | Data Security | Data Warehouse | Data integration | Data mesh | Databricks | Google Cloud | Google Cloud Platform | Hadoop | Microsoft Azure | NoSQL | Relational databases | Stream processing | Web Services
Education
N/A
Roles
Related jobs
-
Data Architect, Master Data Management INR 3000K-4000KAPI Integration | Cloud Data | Cloud Data Architecture | Cloud Native | Cloud Native ArchitectureEmployee incentive programs | Flexible vacation | Flexible work arrangements | Headspace app access | Hybrid work modelSenior-level Full TimeIndia, Bengaluru, Karnataka R22h ago
-
Senior-level Full TimeUS, CA, Remote, United States R22h ago
-
Solution Architect SGD 140K-195KAlerting | Ansible | Apache Hive | Apache NiFi | Apache SparkCareer development | Employee resource groups | Flexible work from home | Generous paid time off | Internet reimbursementSenior-level Full TimeSingapore-Remote R22h ago
-
AWS | AgentOps | Agile | Amazon Web Services | Apache IcebergAccess to premium subscriptions | Full remote | Long-term B2B collaboration | Paid sick leave | Paid vacationSenior-level ContractUkraine R1d ago
-
AI & Software Solutions Architect (Remote, Contract) PLN 263K-400KAI Agents | AWS | AgentOps | Agile | Apache IcebergFull remote | Long-term B2B collaboration | Paid sick leave | Paid vacation | Premium AI tools accessSenior-level ContractPoland R1d ago
-
Senior Solutions Engineer, AI Infrastructure USD 184K-287KApache Slurm | Apache Spark | BeeGFS | Ceph | CheckpointingSenior-level Full TimeRemote, NY, US R1d ago
-
Partner AI Deployment Engineer - AWS INR 2000K-3300KAWS Lambda | Amazon EC2 | Amazon Web Services | Enterprise Architecture | Generative AISenior-level Full TimeIndia - Remote R1d ago
-
APIs | Agile Scrum | Analytics | Application Modernization | Application Performance TuningSenior-level Full TimeHeadquarters, Denmark R1d ago
-
Data Architect INR 3000K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Purview | Azure SynapseFlexible remote work 20 percent | Inclusive workplace | Office-first collaborationSenior-level Full TimeIN - Hyderabad, India R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeBangalore India - Outer Ring Road R1d ago
-
Principle – Knowledge Governance & GenAI Enablement. INR 2475K-4000KAgent systems | Auditability | Compliance | Data Governance | Data LineageFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Remote, India R1d ago
-
Data Architect USD 67K-96KAgile | Amazon Web Services | Change Management | Code review | Data ModelingSenior-level Full TimeVirtual, United States R1d ago
-
VP, Forward Deployed Data Engineering USD 239K-359KAWS Glue | AWS S3 | Access Control | Airflow | Amazon Redshift401k match | Career development | Dental insurance | Disability insurance | Education benefitExecutive-level Full TimeWash, 213 Washington St., Newark, NJ, … R1d ago
-
Forward Deployed Engineer USD 150K-200KAPI Integration | AWS | Azure | Cloud platform | Data PipelinesEquity | Health benefits | Parental leave | Travel up to 20 percentMid-level Full TimeRemote R2d ago
-
Data Architecture | Data Governance | Data Modeling | Data integration | Database AdministrationRemote workSenior-level ContractRemote R3d ago
-
Database Architect / DBA USD 130K-160KAWS | Access Controls | Amazon Aurora | Amazon RDS | Amazon Redshift401k match | Dental insurance | Health insurance | Home office stipend | Paid HolidaysSenior-level Full TimeRemote R4d ago
-
Staff Data Architect USD 181K-260KAWS | Apache Airflow | Auto Scaling | Automation | Azure401k match | Disability insurance | Flexible time off | Health, dental, and vision insurance | HolidaysSenior-level Full TimeUnited States R4d ago
-
Amazon Web Services | Apache Airflow | Cloud platform | DBT | Data ComplianceFully remote within India | Mentorship | Professional growth | Technical leadership visibilitySenior-level Full TimeIndia R4d ago
-
Senior Data Architect USD 130K-205KAPI | AWS | Amazon SageMaker | Apache Spark | CI/CDAgile environment | Flexible work arrangements | Professional developmentSenior-level Full TimeRemote - United States R4d ago
-
Sr. Solutions Engineer - AI Natives Business USD 152K-209KAWS | Apache Spark | Azure | Data Engineering | Data ScienceAnnual performance bonus | Equity | Remote work | Travel requiredSenior-level Full TimeRemote - California; Remote - Colorado; … R4d ago
-
AKS | Access Management | Alerting | Azure | Backup and RecoveryBasic life insurance | Company subsidized medical benefits | Dental coverage | Flexible work arrangements | Paid Long Term DisabilitySenior-level Full TimeRemote R4d ago
-
Apache Spark | Architecture | Big Data | Java | Proof of ConceptFrench and English business proficiency | Hybrid schedule | Travel up to 30 percentSenior-level Full TimeFrance R4d ago