Hadoop Solutions Architect
Tasks
- Build data pipelines
- Create data warehouse solutions
- Define non-functional requirements
- Define technology strategy for data domain
- Design fault tolerant data architecture
- Develop ETL processes
- Ensure data quality, integrity, and security
- Lead evaluation of big data technologies
- Mentor data engineers
- Optimize data process performance
- Perform design and code reviews
- Support solution design and architectural roadmap
- Translate requirements into architectural designs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Ansible | Architecture roadmap | Automation | Azure | BigQuery | Ceph | Cirata | Data Modeling | Data Quality | Data Security | Data Warehousing | Databricks | DevOps | Docker | ETL | GoogleCloud | HDFS | Hadoop | IaaS | Java | Jira | Kubernetes | Kudu | Linux | Minio | Network Security | OpenShift | Ozone | PaaS | Performance Engineering | PostgreSQL | Proof of Concept | Python | SaaS | Scalability | Snowflake | Starburst | Teradata | Trino | VMware | WatsonX
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R7d ago
-
AI Governance | AI Solution | AI Solution Architecture | API Integration | CI/CDSenior-level Contract Full TimeTampa, FL, United States8h ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContinuous learning | Flexible work schedule | MacBook provided | Remote work | Team collaborationSenior-level Full TimePhiladelphia, United States R12h ago
-
AWS | AWS IAM | Access Management | Amazon S3 | Amazon VPCOnsite positionSenior-level ContractJersey City, United States14h ago
-
Director, AI Architecture USD 159K-230KAzure | Bias detection | CI/CD | Computer Vision | Data PipelinesOnsite childcare | Paid parental leave | Paid time off | Public Service Loan Forgiveness Qualified Employer | Retirement programsSenior-level Full TimeTexas-Dallas-5323 Harry Hines Blvd15h ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Data Platform Architect USD 100K-175KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeWork at Home - Tennessee, USA …1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Principal, Data Engineer USD 133K-284KAzure Data | Azure Data Factory | Business Intelligence | Data Architecture | Data Factory401k match | Company-Paid Holidays | Disability insurance | Education assistance | Employee assistance programSenior-level Full TimeMelbourne, FL, United States; Tallahassee, Florida, …1d ago
-
AWS | Cloud Run | Containerization | Django | Docker401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeSan Jose, CA, United States1d ago
-
Staff Data Platform and Products Architect USD 132K-250KAPI Gateway | Apache Airflow | Apache Beam | Apache Kafka | BigQueryAdoption & Surrogacy Reimbursement | Community service time off | Employee resource groups | Fertility treatments | Flexible family care daysSenior-level Full TimeDearborn, MI, United States1d ago
-
Data Architect USD 110K-200KArtificial Intelligence | Artificial Intelligence Security | Data Architecture | Data Governance | Data ModelingSenior-level Full TimeDC Metro Area1d ago
-
Robotics Engineer - Autonomous Data Center Systems USD 169K-355KAlerting | Automation | CI/CD | Cause analysis | Change ManagementSenior-level Full TimeUnited States1d ago
-
Technical Architect - Enterprise Data USD 138K-200KAI API | AI API integration | API Integration | Azure | Azure DataDiversity and inclusion | Work-life balanceSenior-level Full TimeDallas, TX, United States1d ago
-
Digital Analytics Senior Consultant USD 149K-180KAdobe Experience | Adobe Experience Platform | Adobe Journey Optimizer | Adobe Web SDK | Channel activationSenior-level Full TimeUnited States1d ago
-
AI Cloud Engineer USD 127K-180KAutomation | Cause analysis | Cloud Architecture | Cloud Security | Cost OptimizationSenior-level Full TimeColumbus, GA, United States1d ago
-
Customer Success | Data Engineering | Distributed Systems | Presales | Program ManagementHybrid work | Travel up to 30%Senior-level Full TimeRemote - California; Remote - Colorado; … R1d ago
-
Epic | Health Catalyst) | Qlik | SQL | SnowflakeDriving distance to worksite | Monthly onsite visitsSenior-level Full TimeBellaire, TX, United States1d ago
-
Azure Data -AI -Architect USD 119K-258KAzure Compliance | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsSenior-level Full TimeUSA1d ago
-
Data Architect USD 165K-190KAccess Control | Azure | Canonical Data | Canonical Data Modeling | Cloud Architecture401k match | Dental insurance | Medical insurance | Mental health support | Paid HolidaysSenior-level Full TimeMinneapolis, MN1d ago
-
Enterprise Cybersecurity AI Architect USD 128K-237KAI Services | API | API Gateways | API Security | Adversarial Machine LearningSenior-level Full TimeAtlanta, GA, United States1d ago
-
Angular | Autogen | CI/CD | Databricks | Distributed SystemsMentoring system | Professional developmentSenior-level Full TimeJersey City, NJ, United States1d ago
-
Principal AI Engineering Architect USD 224K-308KAWS | Data Processing | Docker | Google Cloud | High AvailabilityAdoption and surrogacy reimbursement | Cancer Care Program | Employee Assistance Program (EAP) | Fertility coverage | Flexible time offSenior-level Full TimeUnited States - Remote R1d ago
-
Lead AI Architect USD 118K-196KAPI Design | AWS | Ansible | Azure | Azure Machine LearningTravel requiredSenior-level Full TimePA, Working at Home - Pennsylvania, …2d ago