Senior Associate - Data Engineer
Tasks
- Build ETL/ELT infrastructure
- Build data models and schemas
- Collaborate with architects and analysts
- Design data pipelines
- Develop and debug PySpark Spark Python
- Develop data transformations
- Evaluate data pipeline architecture and recommend improvements
- Implement ETL/ELT processes
- Implement data quality validation
- Monitor and troubleshoot pipeline performance
- Optimize data integration pipelines
- Participate in scrum sprints for delivery
Perks/Benefits
Skills/Tech-stack
AWS | AWS DMS | AWS Glue | AWS Lambda | Amazon RDS | Amazon S3 | Azure | DBT | Data Lakes | Data Management | Data Quality | Data Store | Data Warehouses | Databricks | Databricks SQL | Dimensional Modeling | ELT | ETL | Master Data | Master Data Management | MySQL | Operational data | Operational data store | Oracle | PostgreSQL | PySpark | Python | Redshift | SQL | Snowflake | Spark
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
As-a-Service | C++ | Cloud Functions | Cloud platform | Compute TechnologiesSenior-level Full TimeSunnyvale, CA, USA2h ago
-
Research Engineer, Gemini Latent Thinking, DeepMind USD 207K-300KAblation Study | Algorithm Development | Deep learning | Experiment design | Language ModelsSenior-level Full TimeCambridge, MA, USA; Mountain View, CA, …2h ago
-
Manufacturing Test Engineer, Data Center USD 120K-172KBSCAN | Bash | Bring-up | Calibration | Correlation studyMid-level Full TimeAtlanta, GA, USA2h ago
-
Software Engineer, Compiling, Quantum AI USD 147K-211KC++ | Classical coding theory | Coding theory | Compiler architecture | CompilersMid-level Full TimeMountain View, CA, USA; Los Angeles, …2h ago
-
Research Scientist, Robotics, Embodied AI, DeepMind USD 147K-211KDeep learning | Language Models | Machine Learning | Python | Reinforcement LearningSenior-level Full TimeMountain View, CA, USA2h ago
-
Software Engineer, Decoding, Quantum AI USD 147K-211KC++ | Concurrency | Device Driver Development | Device driver | Driver DevelopmentMid-level Full TimeLos Angeles, CA, USA; Goleta, CA, …2h ago
-
C# | C++ | Co-design | Compiler technology | Computer ArchitectureSenior-level Full TimeSunnyvale, CA, USA2h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R5h ago
-
ALB | ALB/NLB | AWS | AWS CDK | AWS CloudSenior-level Full TimeDallas, Texas, United States10h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R13h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | Mathematics | NumPy | Number theoryFreelance opportunity | Part-time project-based workSenior-level FreelanceFlorida, United States - Remote R13h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R13h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R13h ago
-
API Integration | Agent systems | Asynchronous processing | Chunking | Cost OptimizationCompetitive salary based on experience | High-impact role | Opportunity to scale AI systems | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R13h ago
-
AI Full Stack Engineer - KS001 USD 160K-225KAds API | Agent systems | Anthropic Claude | Cost monitoring | EmbeddingsHigh-impact role | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R13h ago
-
Software Engineer I/II, Machine Learning USD 129K-190KAWS | Amazon S3 | Apache Airflow | Apache Arrow | CI/CD401k matching | Flexible spending account | Health insurance | Hybrid work | Life insuranceMid-level Full TimeBoston Office14h ago
-
ML Ops Engineer USD 174K-226KAWS | Cloud infrastructure | Cost Optimization | Data Ingestion | GCPHybrid work schedule | In-office at least 3 days per weekMid-level Full TimeSan Francisco HQ Office R14h ago
-
Machine Learning Engineer - 1 USD 130K-228KCNN | Cross-validation | Data Pipelines | Deep learning | Document processingEquity options | Flexible-hybrid work | Medical, dental & vision coverage | Professional development budget | Team offsitesNone Full TimeHybrid - San Mateo, California R14h ago
-
Senior-level Full TimeSan Jose, CA, United States15h ago
-
Senior Machine Learning Engineer - Cybersecurity USD 80K-200KAnomaly Detection | Behavioral analytics | Cyber Threat | Cyber Threat Detection | CybersecuritySenior-level Full TimeSan Jose, CA, United States15h ago
-
Senior-level Full TimePalo Alto15h ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R15h ago
-
Senior-level Full TimePalo Alto16h ago
-
Software Engineer AI Data Platform - CoreAI USD 84K-180KAutomated testing | Batching | C# | C++ | CI/CDEntry-level Full TimeRedmond, WA, US16h ago
-
Software Engineer SME (TS/SCI with Poly Required) USD 187K-318KAPI | API Key | Amazon Kinesis | Amazon Web Services | Apache AirflowMid-level Full TimeChantilly, Virginia, United States16h ago