Senior Engineer, Big Data
Tasks
- Build data models for analytics and application layers
- Build scalable batch and real time ingestion pipelines
- Create standards and best practices
- Design data management architecture
- Develop ETL and streaming processes
- Develop and test data systems for analytics
- Document data systems
- Implement Hadoop platform components
- Lead data engineering team
- Plan and schedule projects
- Troubleshoot technical issues with infrastructure support
Perks/Benefits
- N/A
Skills/Tech-stack
Ambari | Apache HBase | Apache Hive | Apache Impala | Apache Kafka | Apache Phoenix | Apache Spark | Apache Storm | Cloudera Manager | Data Governance | Data Modeling | Data Quality | Data Warehouse | ETL | HDFS | Hadoop | Java | Kerberos | Metadata Management | NoSQL | Python | REST | Ranger | SOAP | Scala | Sentry | Streaming | Talend | YARN | Zookeeper
Education
Related jobs
-
Senior Software Engineer, Generative AI, Ads Safety USD 174K-252KAI Agents | Algorithms | C++ | Computer Vision | Context learningSenior-level Full TimeMountain View, CA, USA5h ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Artificial Intelligence | Cloud Architecture | Cloud Computing | Data PrivacySenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA5h ago
-
C++ | Compute Optimization | Deep learning | GPU | JAXSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA5h ago
-
Forward Deployed Engineer II, Applied AI, Cloud USD 127K-183KAPIs | Agent systems | Agentic Workflows | Conversational AI | DebuggingTravel 50% timeSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …5h ago
-
Data Engineer, Geo 3P and Developer Data Operations USD 106K-151KArtificial Intelligence | BigQuery | C++ | Cloud Dataflow | Data MiningEntry-level Full TimeMountain View, CA, USA5h ago
-
Senior Data Engineer USD 150K-220KAmazon Redshift | Apache Hudi | Apache Iceberg | Apache Pinot | Autovacuum401k match | Dental insurance | Hardware provided | Health insurance | Unlimited PTOSenior-level Full TimeNew York11h ago
-
Staff Engineer, Datacenter Server Lifecycle USD 320K-405KAWS | Asset tracking | Coreboot | Decommissioning | Firmware verificationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York …12h ago
-
AI & Robotics Data Collection Engineer (Intern) USD 68K-82KContainerization | Linux | Python | ROS2 | Shell ScriptingFully stocked kitchen | Meals provided | Onsite workEntry-level InternshipMilpitas, CA12h ago
-
Mid-level Full TimeTysons, VA, United States13h ago
-
Mid-level Full TimeRemote, United States R13h ago
-
Senior AI Infrastructure Engineer - Training Platform USD 216K-270KAWS | Admission controllers | C++ | CUDA | Custom ResourcesCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …13h ago
-
Data Analyst, Payments Performance USD 124K-187KCode review | Data Visualization | Data analytics | Git | Python401k plan | Company bonus | Equity | Medical, dental, vision benefits | Wellness stipendsSenior-level Full TimeSeattle, WA14h ago
-
Analytics Engineer USD 124K-187KCode review | Data Visualization | Git | Python | SQL401k plan | Company bonus | Dental benefits | Equity | Medical benefitsSenior-level Full TimeSeattle, WA14h ago
-
Senior Robotics Engineer, Maritime USD 220K-292KAnomaly Detection | C++ | Cameras | Computer Vision | Data AnalysisCommuter benefits | Generous time off | Healthcare benefits | Income protection | Mental health resourcesSenior-level Full TimeCosta Mesa, California, United States14h ago
-
Senior Robotics Engineer, Maritime USD 220K-292KAnomaly Detection | C++ | Cameras | Computer Vision | GazeboCaregiver leave | Commuter benefits | Dental benefits | Fertility coverage | Healthcare benefitsSenior-level Full TimeQuincy, Massachusetts, United States15h ago
-
Principal Sales Engineer – Warehouse Robotics Systems USD 100K-300KAPI | AutoCAD | AutoMod | EDI | Emulate3DTravel to customer sitesSenior-level Full TimeSan Mateo, CA15h ago
-
Software Engineer USD 100K-150KAmazon Simple Queue Service | Amazon Web Services | Bedrock | Data Pipelines | Distributed Systems401k retirement plan | Dental insurance | Health insurance | Unlimited vacation | Vision insuranceSenior-level Full TimeLos Angeles, CA, US16h ago
-
Data Engineer / Azure Fabric Engineer Consultant USD 119K-193KAI Search | Access Control | Automated Monitoring | Azure AI | Azure AI SearchSenior-level Full TimeMason, OH, US16h ago
-
Mid-level Full TimeScottsdale, AZ16h ago
-
Principal Engineer, Data & ML Platform USD 120K-180KAPIs | Automated testing | Batch Processing | Cloud platform | Data ModelingSenior-level Full TimeScottsdale, AZ16h ago
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R16h ago
-
Lead Data Engineer USD 122K-207KAgile | Apache NiFi | Apache Spark | ETL | Java401k match | Dental insurance | Disability insurance | Fitness reimbursement or facilities | Health insuranceSenior-level Full TimeO'Fallon, Missouri (Main Campus), United States17h ago
-
Senior Assistant Vice President USD 164K-220KAWS | Agent Orchestration | AgentOps | Asynchronous programming | AuditabilitySenior-level Full TimeUnited States17h ago
-
Data Science and AI Intern USD 50K-50KAWS | Cloud Computing | DBT | Data Visualization | ETLFree daily on site lunches | Free on site EV charging | Latest hardware | On-site gym | Open & transparent cultureEntry-level InternshipMenlo Park, CA17h ago
-
Machine Learning Engineer, Growth USD 0K-0KFeature Engineering | Machine Learning | Model Deployment | Model Evaluation | Model TrainingCell phone allowance | Childcare allowance | Company holidays | Dogfood budget | Family planning benefitMid-level Full TimeSan Francisco, CA17h ago