Associate
Cary, 3000 CentreGreen Way, United States
USD 116K-140K Mid-level Full Time
Tasks
- Automate infrastructure with Infrastructure as Code
- Build cloud data lakes using storage and compute services
- Build metadata driven ingestion and transformation frameworks
- Create near real time and batch data pipelines
- Define cloud standards guidelines and best practices
- Design and implement distributed data processing pipelines
- Develop and refine cloud architecture and roadmaps
- Ensure data security and access controls
- Implement CI/CD pipelines
- Integrate Apache Kafka with REST API
- Integrate relational databases and heterogeneous data sources
- Manage big data workloads in distributed environments
- Orchestrate and monitor enterprise data workflows
- Perform performance tuning partitioning and fault tolerance
- Use Hadoop ecosystem components
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Cloud platform | Control-M | Git | Google Cloud | Google Cloud Platform | HDFS | Hadoop | Hive | Infrastructure as Code | JSON | Jenkins | Microsoft Azure | MySQL | Oracle Database | Parquet | PostgreSQL | REST API | Spark SQL | Spark Streaming | Terraform | XML | YARN | “as-code”
Education
Regions
Countries
States
Cities
Related jobs
-
Consulting Data Architect USD 100K-140KAWS | Apache Flink | Apache Kafka | Apache Spark | Azure Event401k matching | Employee assistance program | Flexible spending accounts | Health/Dental/Vision | Life and disability insuranceSenior-level Full TimeDenver, CO, United States1d ago
-
Technical Solutions Architect II -- Data Engineer USD 150K-180KAWS | Agentic AI | Apache Airflow | Azure | Azure Data401k matching | Dental and vision insurance | Employee assistance program | Flexible spending accounts | Health and wellbeing benefitsMid-level Full TimeRemote - Nationwide, United States1d ago
-
AI | ClickHouse | Confluence | ETL | Git401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeColumbia, Maryland1d ago
-
Software Engineer 1 - (Python, UI/UX, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 1 - (AI, Python, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Docker | Helm401k match | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer, Machine Learning Infrastructure USD 140K-230KAPI Development | AWS | Airflow | Alerting | CI/CD401k access | Flexible PTO | Health, dental, vision coverage | Paid mealsMid-level Full TimeSan Francisco, CA, US1d ago
-
Principal Data Architect USD 123K-175KABAC | API Architecture | Access Control | Access Management | Active Directory401k | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeHanscom Afb, United States1d ago
-
APIs | AWS | Apache Spark | Azure | Azure Data401k matching | Dental insurance | Flexible working arrangements | Health insurance | Life insuranceSenior-level Full TimeSkokie, United States1d ago
-
Anomaly investigation | Bitbake | Bitbucket Pipelines | C# | C++Travel up to 20 percentMid-level Full TimeHerndon, United States1d ago
-
Access Control | Azure | Azure Backup | Azure CLI | Azure DataKnowledge transfer | MentoringSenior-level ContractSaint Paul, United States1d ago
-
Data Engineer, PDPO - Offense & Defense USD 147K-269KApache Spark | ClickHouse | Data Modeling | Data Warehousing | Distributed SystemsEntry-level Full TimeSan Jose, California, United States1d ago
-
Software Engineer, GenAI Silicon Automation, DeepMind USD 174K-252KABC | Application Programming | Application Programming Interfaces | C++ | CI/CDMid-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer, Google Cloud Storage USD 147K-210KAccess Control | Best practices | Block Storage | C++ | Chaos EngineeringMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA1d ago
-
AI Solutions Engineer USD 123K-178KAI Agents | Azure DevOps | Azure Machine Learning | Bias detection | CI/CDDental insurance | Disability insurance | Medical insurance | Paid time off | Supplemental insuranceSenior-level Full TimeReston, VA, US2d ago
-
Algorithm Engineer USD 150K-170KCI/CD | Code review | Data labeling | Deep learning | Digital SignalIn person office hubs | Remote work flexibilityMid-level Full TimeBoston, MA / Remote R2d ago
-
Analytics Engineer USD 130K-170KCI/CD | DBT | Data Modeling | Data Quality | Data Quality Testing401k match | Flexible time off | Health benefits day one | Paid caregiver leave | Paid parental leaveSenior-level Full TimeUnited States (Remote) R2d ago
-
Senior Principal Software Engineer, Machine Learning USD 222K-453KA/B | A/B Testing | B testing | Canary Deployment | Capacity PlanningHybrid work model | MentorshipSenior-level Full TimeRemote, US R2d ago
-
CI/CD | Fastlane | Git | Multithreading | SOLIDAsynchronous culture | Bonus | Learning support resources | Remote work | Stock optionsSenior-level Full TimeKansas City, MO, USA R2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly team atmosphere | Remote distributed settingMid-level Full TimeDenver, CO, USA2d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPMid-level Full TimeBellevue, WA, USA2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive salary | Friendly laid-back atmosphere | Remote or distributed workMid-level Full TimePalo Alto, CA, USA2d ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous work culture | Opportunity for high impact | Remote or distributed work | Supportive teamMid-level Full TimeLos Angeles, CA, USA2d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Entrepreneurial team | Flexible, hands-off management | Impactful products for learning differences | Remote/distributed workMid-level Full TimeKirkland, WA, USA2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Career growth | Distributed work setting | Friendly work environment | Opportunity for impactMid-level Full TimeSan Jose, CA, USA2d ago
-
Bash | Cloud infrastructure | Cloud platform | Data Processing | DockerAsynchronous culture | Competitive salary | Remote-friendlyMid-level Full TimeOakland, CA, USA2d ago