Associate
Cary, 3000 CentreGreen Way, United States
USD 116K-140K Mid-level Full Time
Tasks
- Automate infrastructure with Infrastructure as Code
- Build cloud data lakes using storage and compute services
- Build metadata driven ingestion and transformation frameworks
- Create near real time and batch data pipelines
- Define cloud standards guidelines and best practices
- Design and implement distributed data processing pipelines
- Develop and refine cloud architecture and roadmaps
- Ensure data security and access controls
- Implement CI/CD pipelines
- Integrate Apache Kafka with REST API
- Integrate relational databases and heterogeneous data sources
- Manage big data workloads in distributed environments
- Orchestrate and monitor enterprise data workflows
- Perform performance tuning partitioning and fault tolerance
- Use Hadoop ecosystem components
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Cloud platform | Control-M | Git | Google Cloud | Google Cloud Platform | HDFS | Hadoop | Hive | Infrastructure as Code | JSON | Jenkins | Microsoft Azure | MySQL | Oracle Database | Parquet | PostgreSQL | REST API | Spark SQL | Spark Streaming | Terraform | XML | YARN | “as-code”
Education
Regions
Countries
States
Cities
Related jobs
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R19h ago
-
API Integration | AWS Bedrock | Auditing | Authentication | AuthorizationMentoring | MentorshipMid-level Full TimeMenlo Park, CA, United States20h ago
-
Senior Software Engineer (Java Full Stack) - Hybrid USD 138K-183KAgile | C plus plus | Concurrency | Data Structures | Embedded SystemsHybrid work | Remote work possibleSenior-level ContractBoston, United States22h ago
-
Data Architect USD 145K-180KAWS Glue | AWS Lambda | AWS Redshift | AWS S3 | Azure DevOpsDental insurance | Disability insurance | Educational assistance | Flexible spending account | Health savings accountSenior-level Full TimeHouston, Texas | Tulsa, Oklahoma | …23h ago
-
Analytics and Insights Engineer III USD 131K-218KApache Spark | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeRichmond, Virginia, United States23h ago
-
C++ | Computer Vision | Data Processing | Deep learning | Domain AdaptationEntry-level Full TimeSan Jose, California, United States23h ago
-
Staff Software Engineer, AI/ML, Google Cloud Security USD 207K-300KAgentic AI | Artificial Intelligence | Cloud Security | Cloud platform | Data ProcessingSenior-level Full TimeReston, VA, USA; New York, NY, …1d ago
-
Senior Software Engineer, Google Cloud Dataproc USD 174K-252KApache Hive | Apache Spark | C++ | Data Warehouse | Data Warehouse InternalsSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Apache Spark | Azure | Azure Data | Azure Data Lake | Azure Data Lake StorageHands-on project experience | Mentorship from engineers | Onsite work 5 days per week | Team collaborationEntry-level Full TimeIrvine, CA, US1d ago
-
Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsLearning opportunities | Mentorship | On site work 5 days per week | Team collaborationEntry-level Full TimeIrvine, CA, US1d ago
-
Analytics Data Engineer USD 94K-130KAzure Data | Azure Data Factory | CI/CD | Data Analysis | Data FactoryRemote workMid-level Full TimeFlagstaff, AZ, US1d ago
-
Director Data Engineering USD 178K-255KARM | Agile | Amazon Web Services | Azure Data | Azure Data Factory401k match | Company paid life insurance | Employee assistance program | Health, dental, and vision insurance | Paid time offExecutive-level Full TimeLeawood, KS, US1d ago
-
AI Application & Cloud Operations Engineer (Mid level) USD 108K-117KAWS | AWS Bedrock | AWS CloudTrail | AWS CloudWatch | AWS PrivateLinkMid-level Contract Full TimePlano, TX, United States1d ago
-
Software Engineer, Applied AI USD 173K-250KABAC | Agentic Frameworks | Apache Airflow | Audit trails | BIMDental insurance | Generous PTO | Health insurance | Retirement or Pension Plan | Vision insuranceMid-level Full TimeSan Francisco, CA1d ago
-
Staff Data Engineer USD 147K-184KAmazon Kinesis | Amazon Web Services | Apache Airflow | Apache Iceberg | Apache SparkDental insurance coverage | Health insurance coverage | Paid parental leave | Paid vacation | Relocation assistanceSenior-level Full TimeBerkeley, CA1d ago
-
Associate, Client Intelligence (Data Scientist) USD 98K-132KAWS | Apache Spark | Azure | Big Data | Cloud platformEmployee resource groups | Matching gift program | Professional development | Sustainability and Climate Change Initiatives | Volunteerism programMid-level Full TimeNew York, NY, US, 100011d ago
-
AI Developer - Model Creation & Full Stack USD 130K-145KAWS | Aiohttp | Angular | Asyncio | Azure DatabricksRemote work | USPS Public Trust Clearance supportMid-level Full TimeWork from home, VA, United States1d ago
-
API Gateway | AWS Lambda | AWS Step Functions | Amazon SQS | Apache Airflow401k matching | Employee stock options | Health benefits | Hybrid work onsite 2 to 3 days per week | Paid time offExecutive-level Full TimeNew York, United States R1d ago
-
AIOps | Anomaly Detection | Anthos | CRD | Control Plane401k plan | Basic life insurance | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeResearch Triangle Park, North Carolina, United … R1d ago
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R1d ago
-
Senior Computer Vision & Machine Learning Engineer USD 140K-206KAblation Studies | CI/CD | Data Pipelines | Docker | Error AnalysisAutonomy | Client project impact | Support for professional growthSenior-level Full TimeRemote, US R1d ago
-
Senior Embedded Software Engineer, Linux USD 154K-230KC# | C++ | CI/CD | Cross-compilation | Device DriversLearning and development stipend | PTO | Parental leave | Sick leaveSenior-level Full TimeLong Beach, California, United States1d ago
-
Computer Vision & Machine Learning Engineer USD 150K-200KAblation Studies | CI/CD | Computer Vision | Data Pipelines | DockerEntry-level Full TimeRemote, US R1d ago
-
Staff Data Engineer USD 162K-224KAmazon Managed Workflows for Apache Airflow | Apache Airflow | Apache Druid | Apache Iceberg | CCPA401k employer match | Annual WIN bonus | Flexible vacation | Mental health resources | Paid HolidaysSenior-level Full TimeU.S. Remote R1d ago
-
Sr AI Engineer II - Agentic AI USD 123K-215KAWS | Agent Orchestration | Evaluation and monitoring | Event Driven | Event-driven architectureSenior-level Full TimePhoenix, AZ, United States1d ago