Sr. Data Engineer ( big data )
San Bruno, CA; Sunnyvale, CA; Sunnyvale, CA; Sunnyvale, CA; Sunnyvale, CA; San Mateo, CA
A USD 108K-155K (estimate) Senior-level Full Time
Tasks
- Build end-to-end data pipelines
- Debug test and validate data workflows
- Develop data processing jobs
- Document data lineage and requirements
- Implement data modeling and analytics
- Ingest real time data using Kafka
- Optimize Teradata SQL performance
- Perform ETL and data transformations
- Process large data sets with distributed computing
- Troubleshoot data pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | BTEQ | Bash | Cassandra | Cause analysis | Data Lineage | Data Modeling | ETL | FastExport | FastLoad | Flume | HBase | Hadoop | Hive | Java | Kafka | MapReduce | MultiLoad | Performance optimization | Pig | Presto | Python | R | Root Cause Analysis | Root cause | SAS | SQL Performance Optimization | Scala | Tableau | Teradata | Teradata SQL | Teradata SQL Performance Optimization | Testing | Unix Shell | YARN
Education
Roles
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R27d ago
-
Mechanical Robotics Engineer USD 77K-130KAutomation Controls | CAD design | Cause analysis | Condition Monitoring | Current Signature AnalysisMid-level Full TimeLincolnton, NC, United States9h ago
-
Sr. Systems Engineer - AI USD 141K-209KAlerting | Artificial Intelligence | Auto Scaling | Automation | Backup and RecoverySenior-level Full TimeKansas City, KS, United States10h ago
-
Data Analytics Engineer USD 139K-230KAWS | Azure | Azure Data | Azure Data Lake | Cloud platformDEI initiatives | Dental insurance | Medical insurance | Mental health support | Remote workSenior-level Full TimeRemote, United States R10h ago
-
Data Engineer USD 126K-208KAPI Integration | APIs | AWS | Amazon Redshift | Apache AirflowDEI initiatives | Dental insurance | Employee recognition program | Medical insurance | Mental health supportMid-level Full TimeRemote, United States R10h ago
-
Senior-level Full TimePleasanton, CA, United States10h ago
-
Data Engineer (Healthcare) USD 105K-130KAWS | AWS Redshift | Apache Airflow | Azure | Azure DataKnowledge sharing | Mentoring | Quarterly travel | Remote workMid-level Full TimeUSA, Remote; USA, Remote; USA, Remote R10h ago
-
ETL | Elasticsearch | JSON | Jupyter Notebooks | Kibana401k match | Paid medical | Paid time off | Training supportSenior-level Full TimeColumbia, MD R10h ago
-
Applied AI Intern USD 70K-80KArtificial Intelligence | C++ | Data-driven | Data-driven analysis | PythonCommuting Stipend | Team mealsEntry-level InternshipMountain View, CA, US12h ago
-
Applied AI Engineer USD 140K-220KAWS SageMaker | Agentic Workflows | C++ | Fine Tuning | Foundation Models401k | Dental insurance | Health insurance | Team meals | Vision insuranceEntry-level Full TimeMountain View, CA, US / San …12h ago
-
Senior Engineer, Data Management USD 140K-150KAPI Development | AWS | Agile | Azure | Cloud platform401k | Dental insurance | Disability insurance | Employee assistance program | Life insuranceSenior-level Full TimeNew York, NY, United States13h ago
-
Lead Data Engineer USD 170K-185KAWS Athena | AWS Data | AWS Data Pipeline | AWS EMR | AWS Glue401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeMcLean, VA, United States13h ago
-
Data Engineer III USD 97K-163KApache Spark | Data Modeling | Data Quality | Data integration | DatabricksAbility to work independently | Mentorship | Professional development | Travel opportunitiesSenior-level Full TimeBaltimore, Maryland, United States14h ago
-
Senior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …14h ago
-
Senior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …14h ago
-
Algorithms | C++ | Data Mining | Data Pipelines | Data StructuresDevelopment workshops | Learning programs | Mentorship | Social eventsEntry-level InternshipSeattle, Washington, United States14h ago
-
Security Engineer, Investigator - GenAI USD 143K-208KAI detection | Agent Orchestration | Bias Mitigation | Big Data | Cyber ThreatsMid-level Full TimeMenlo Park, CA | Seattle, WA …15h ago
-
ABAQUS | ANSYS | Bearings | Bolted Joints | CADSenior-level Full TimeRedmond, WA15h ago
-
Software Engineer, AI/ML, Google Lens USD 147K-210KA/B | A/B Testing | API Design | Accessibility | B testingMid-level Full TimeMountain View, CA, USA15h ago
-
Partner Forward Deployed Engineer V, GenAI, Google Cloud USD 262K-364KAgent systems | Cloud platform | CrewAI | Evaluation Pipelines | Google CloudSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …15h ago
-
Senior Staff Software Engineer, Cloud AI, Full Stack USD 262K-364KC++ | CSS | Data Storage | Distributed Computing | GoBonus | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Agentic AI | C++ | Cloud Security | Computer Vision | Data PreparationSenior-level Full TimeSan Francisco, CA, USA15h ago
-
Staff Algorithm Engineer USD 150K-250KAWS EC2 | AWS S3 | AWS SageMaker | Active Learning | Amazon Web ServicesHigh autonomy | Mentorship and knowledge-sharing | Startup environmentSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL17h ago
-
Forward Deployment AI Engineer USD 200K-250KActive Directory | Azure Active Directory | C++ | IT Infrastructure | JavaDental insurance | Health insurance | Hybrid work | Learning and growth budget | Paid time offSenior-level Full TimeNew York, NY, US17h ago
-
Customer Success Physicist- Tel Aviv USD 136K-211KAutomation | English | Python | Quantum Physics | Software developmentTravel opportunitiesMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL19h ago