Big Data Engineer, AVP
Building 300-Whippany Campus, Jefferson Park, United States
USD 160K-170K Executive-level Full Time
Tasks
- Analyze log files
- Build and maintain data pipelines
- Collaborate with data scientists on machine learning models
- Conduct release management and pipeline activities
- Create and monitor automated scripts
- Design and implement data warehouses
- Develop data lakes
- Enable data transfer and processing
- Install configure and support Hadoop clusters
- Manage access control and data governance
- Monitor data system health
- Oversee Hadoop and UNIX environment engineering
- Perform incident root cause analysis
- Perform performance tuning
- Plan capacity and data replication
Perks/Benefits
Skills/Tech-stack
Access Control | Capacity Planning | Chef | Cloudera | Cluster configuration | Data Governance | Data Lakes | Data Pipelines | Data Warehousing | Data replication | Disk Management | Hadoop | ITIL | Log Analysis | Machine Learning | Performance Tuning | Query Optimization | RCA | RFT | Release Management | Table Partitioning | Unix
Education
N/A
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA1h ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R6h ago
-
Data Analysis | Data Visualization | GenAI | Java | Jupyter NotebookSenior-level Full TimeCupertino11h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States12h ago
-
Machine Learning Engineer, Sensor Pipelines USD 175K-215KC++ | Computer Vision | JAX | Machine Learning | PyTorchHybrid work scheduleMid-level Full TimeMountain View, CA, USA12h ago
-
Data Engineer USD 112K-160KAWS | AWS S3 | Airflow | Azure | CI/CD401k match | Family leave | Medical, dental, and vision insurance | PTO | Paid HolidaysMid-level Full TimeSanta Monica, CA, United States13h ago
-
Director, Foundation Model Data Recipes USD 349K-431KBayesian Inference | Data Clustering | Data Filtering | Data Mining | Data PreprocessingBonus | Equity incentive plan | Health insuranceExecutive-level Full TimeMountain View, CA. USA; San Francisco, …14h ago
-
Software Engineer, ML Platform (ML Training) USD 175K-265KAWS | Computer Vision | DeepSpeed | Distributed Training | JAXMid-level Full TimeFoster City, CA14h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA14h ago
-
Senior Data Engineer USD 180K-210KAirflow | Anomaly Detection | BigQuery | CI/CD | Cloud platform401k employer match | Annual Company Holidays | Catered lunches | Company retreat | Comprehensive health coverageSenior-level Full TimeNew York City14h ago
-
Senior Robotics Software Engineer USD 113K-151K3D simulation | AI | API Development | Agile | C++In-person office work | Lab workSenior-level Full TimeAustin, Texas, United States15h ago
-
AI/ML Engineer USD 91K-184KAutomated Machine Learning | Continuous Deployment | Continuous integration | Data Pipelines | MLOpsMid-level Full TimeArlington, VA15h ago
-
Senior Software Engineer; Analytics Infrastructure USD 167K-230KAPI Design | Backend Engineering | Caching | Columnar Databases | Data ModelingBack up child care support | Employee stock purchase program ESPP | Flexible time off | Home office & equipment stipend | Learning and development stipendSenior-level Full TimeSan Francisco, CA15h ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R15h ago
-
Machine Learning Research Engineer, App Store Search USD 185K-313KA/B | A/B Testing | Apache Spark | B testing | Fine TuningMid-level Full TimeSeattle16h ago
-
Principal Machine Learning Engineer USD 126K-264KCode review | Continuous Delivery | Continuous integration | Data Preprocessing | Data Privacy401k match | Adoption Assistance | Dental insurance | Health insurance | Life insuranceSenior-level Full TimeSeattle, WA, United States16h ago
-
Machine Learning Engineer - Vision USD 160K-250KActive Learning | Annotation tools | CAD/CAM | Computer Vision | Image Segmentation401k | Dental insurance | Equity | Flexible vacation | Health insuranceSenior-level Full TimeLos Angeles, CA16h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA16h ago
-
Senior Software Engineer, MLOps USD 175K-220KAgile | Batch Processing | Consistency guarantees | Data Modeling | Data Pipelines401k match | Charitable donation match | Commuter benefits | Dental insurance | Flexible time offSenior-level Full TimeRemote - United States R16h ago
-
Software Engineer (Data Engineer) USD 90K-135KAPI | AWS | Apache Airflow | Apache Spark | Azure401k plan | Employer health insurance | Employer life and disability insurance | Paid government holidays | Paid time offMid-level Full TimeHerndon, VA17h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas17h ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R17h ago
-
Machine Learning Engineer III, Core Agents USD 175K-219KAWS Bedrock | Amazon SageMaker | Embedding Models | Evaluation | IndexingSenior-level Full TimeRedwood City, CA17h ago